Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Zaria Howard

Draw a face in VR and translate it to a real face with a Conditional GAN

pix2pix, VR, GAN

Monolesan

Using PoseNet to create art using your body parts like eyes, hands, chest and knees

PoseNet, Camera, TensorFlow.js

Kyle Steinfeld

3D GAN generated architecture by converting CAD models to 2d tiled heightfield images

GAN, Heightfield, CAD

Alexander Mordvintsev

Transition between artworks by continuously applying Style Transfer

Style Transfer

NaN

An interactive demo to type with StyleGAN-generated letterforms

StyleGAN

Maxime Plantady, Evelyne Drouin

Light projections on a sculpture based on facial expressions

Expression Detection

YACHT, Ross Goodwin, Tom White, Mario Klingemann

An album with songs generated with Magenta’s MusicVAE model and lyrics made by an LSTM trained by Ross Goodwin

Magenta, VAE, NSynth Super

Fabin Rasheed

An LSTM trained on 350k haikus, the generated Haiku is then translated to an image with AttnGAN and then painted

AttnGAN, LSTM, FastPhotoStyle

Scott Eaton

Custom pix2pix HD turning sketches into sculptures

pix2pix, GAN

Tero Parviainen

Mix latent space of sounds using wheels

VAE, Magenta

Lulu xXX

Optical Flow based Style Transfer of woman singing

StyleTransfer, Optical Flow, deepflow

Google AI

Turn book paragraphs into an RNN features and match them with similar paragraphs

RNN, NNS

Lisha Li, Vladimir Glazachev, Dzmitry Pletnikau, Eric Liu

Automatically animate digital humans or your digital double with just text or speech

Text to Animation of Virtual Characters

Alsino Skowronnek

A StyleGAN trained on thousands of frames of a filmed sequence of images of graffiti from NYC in the late 70s/early 80s. The output is interpreted into a painting and an AR filter

StyleGAN

Jonathan Fly

A BigGAN latent video about a butterfly augmented with ImageJ and GauGAN

GauGAN, GAN, BigGAN, ImageJ

Mariel Pettee, Chase Shimmin, Douglas Duhaime, Ilya Vidrin

Generated choreography with VAEs trained on high-quality motion capture data of improvisational dance

VAE, RNN

Bastien Girschig

Censor inappropriate Bible sections

Text classification

Bastien Girschig, Google Arts & Culture Lab

Use PoseNet to extract a pose and generate stick figure choreographies

UMAP, PoseNet

Amber Frid-Jimenez

RNN generative piano music inspired by Satie

RNN

Michael Kelly

GAN generated images of Edo woodblock art

GAN

Eyal Gruss, Ayelet Sapirshtein, Vered Heruti

A machine that creates live, generated, visual poetry from spoken poetry in any language

AttnGAN, Machine translation, Speech to text

Eyal Gruss

A browser-based app to animate faces with your camera in real-time, created with a Google Colab wrapper for First Order Motion

First Order Motion, Wav2lip, Liquid Warping GAN

Casey Reas

GAN generated video of scanned plants inspired by Stan Brakhage

GAN

Susie Rong Fu

A camera takes a photo and a Style Transfer model translates it into a sketch, while Susie Rong Fu makes a portrait of the same person

StyleTransfer, Camera

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners