Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Diego Porres

StyleGAN-generated Mexican and Guatemalan textiles

GAN, StyleGAN

Sougwen Chung

Train an RNN on drawing motions and create a painting in collaboration where the model has one color and Sougwen Chung has another

RNN, LSTM

Jonathan Fly

Upscaling old video games with GauGAN

GauGAN, GAN

Refik Anadol

Adjust a painting in real-time with a 3D point cloud and Face Tracking to create the illusion of a 3D painting

Face Tracking, Point Cloud

Mario Klingemann

Generate epigrams with GPT-2 and display them on vintage time table boards

Transformer, GPT

Aydao, Elissa Kathryn

Apply First Order Motion to Elissa Kathryn's TikTok video and create a collage of famous motives

First Order Motion

Bob L. Sturm

RNN generated Gaelic folk music

RNN

Tal Shiri, Joel Simon

Train a DCGAN on Perlin Noise to generate shapes, cut the generated shapes from an Artbreeder image, the cutouts and placement are optimized with feature inversion over a face classifier

DLIB, CNN, Perlin Noise, DCGAN, Artbreeder, StyleGAN, BigGAN, GAN

Michael Friesen

Create images in the style of Beksinski with CLIP and BigGAN

Big Sleep, CLIP, BigGAN

Agisoft

Fast 3D Style Transfer

Style Transfer, 3D

Es Devlin, Ross Goodwin, Google Arts & Culture Lab

Say a word and an RNN generates a poem which is displayed

Voice detection, RNN, Microphone

Jack Qiao

Generate font combinations by matching the CNN features of fonts

NNS, CNN

Hans Brouwer

Audio-reactive latent interpolation with StyleGAN2 created by modulating latent and noise inputs with musical features

StyleGAN2

Emil Wallner

Generate a logo from a drawing using pix2pix HD

pix2pix, GAN

Sofia Crespo

CNN generated blend of of birds

CNN

Stephanie Dinkins

An RNN trained on oral histories from three generations of women from a single-family to highlight concerns of people who are underrepresented in the tech sector, displayed with an interactive voice assistant

RNN, LSTM, Microphone

Mario Klingemann

Deleting weights in GANs to create glitches

GAN, Weights

Rafael Redondo

Extract depth maps with MegaDepth and animate paintings in 3D

MegaDepth

Matt Groh, Ziv Epstein, Manuel Cebrian, Iyad Rahwan

Use GAN paintings and Object Detection to remove objects from a video

Object Detection, GAN, Inpainting

Shardcore

Apply First Order Motion to objects with faces

First Order Motion

Kishi Yuma

GAN interpolation inspired by Francis Bacon

GAN

Lisha Li, Vladimir Glazachev, Dzmitry Pletnikau, Eric Liu

Automatically animate digital humans or your digital double with just text or speech

Text to Animation of Virtual Characters

Eunsu Kang, Donald Craig, Austin Dill, Songwei Ge, Barnabas Poczos

Use WaveGAN to generate sound based on touch

WaveGAN, Hardware, GAN

Jonathan Fly

Use SinGAN to train a GAN with a single image, Frymire, the classic compression image

SinGAN, GAN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners