Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Jia-Bin Huang

GAN to generate machine learning papers

GAN

Erwin Driessens, Maria Verstappen

Using Face Recognition and a robot arm to find grains of sand that looks like faces

Face Recognition, CNN

Christian Mio Loclair, Waltz Binaire

A computer looks at itself with a camera and translates image features into text with an RNN

Camera, CNN, RNN

Esteban Salgado

A StyleGAN trained on a dataset synthesised with analog and digital materials

GAN, StyleGAN

Apathia Records

Style Transfer with Optical Flow and DeepDream applied to a music video

StyleTransfer, DeepDream, Optical Flow

Andreas Refsgaard, Gene Kogan

Use a CNN to classify instruments in a live drawing and add the instrument tracks in Ableton Live to compose in real-time

CNN, Classification, openFrameworks, OpenCV, Ableton Live

Bastien Girschig, Google Arts & Culture Lab

Use PoseNet to extract a pose and generate stick figure choreographies

UMAP, PoseNet

Robbie Barrat

GPT-2 to generate a set of rules describing a drawing, inspired by Sol LeWitt

Transformer, GPT

Monolesan

Using PoseNet to create art using your body parts like eyes, hands, chest and knees

PoseNet, Camera, TensorFlow.js

Jonathan Fly

Apply GauGAN on Charlie Chaplin dressed as a tree

GauGAN, GAN

Kishi Yuma

GAN trained on pictures of hands

GAN

Helena Sarin

SNGAN trained on doodles and upscaled and colorized with CycleGAN

GAN, CycleGAN, SNGAN

Baum & Leahy

Blend sounds from Wavenet trained on field recordings, and NSynth tuned on nature sounds from British Library Wildlife and Environmental Sounds archive

Magenta, VAE, NSynth, Wavenet

Helena Sarin

GAN trained on personal pictures of flowers

GAN

Mario Klingemann

DeepDream applied to the face of a woman

DeepDream, Gradient Ascent

Alexander Mordvintsev

Reverse Super-Resolution by turning high-res images into low-res

Super-Resolution

Alec Wright, Eero-Pekka Damskägg, Lauri Juvela, Vesa Välimäki, Keith Bloemer, Zak Jost

Real-time guitar amplifier emulation with deep learning

WaveNet

Katerina Malakhova

Visualize the latent representation of a grandmother in a CNN

CNN

Christian Mio Loclair, Waltz Binaire

Adjust user interface animations according to an ANN trained on user interactions

ANN

Mario Klingemann

Generate epigrams with GPT-2 and display them on vintage time table boards

Transformer, GPT

Mike Tyka

Create videos with BigGAN and add music with the Music Transformer

BigGAN, GAN, Music Transformer

Mario Klingemann

2D cluster arrangement by feature vectors

CNN, Clustering

Fabin Rasheed

Use GPT-3 to describe a painting step-by-step and paint it according to the instructions

GPT

Jonathan Fly

Start with a video clip of a rollercoaster and then predict the next frame with a pix2pix model, feeding the previous frame

Pix2pix

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners