Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Eunsu Kang, Donald Craig, Austin Dill, Songwei Ge, Barnabas Poczos

Use WaveGAN to generate sound based on touch

WaveGAN, Hardware, GAN

Gene Kogan

A Conditional GAN trained on OpenStreetMap's map and corresponding satellite image inspired by Italo Calvino's Invisible Cities

pix2pix, GAN, Device

Gene Kogan

Continuously zoom in a image and apply DeepDream and use Dense Captioning to label objects in the video

DenseCap, DeepDream

Refik Anadol

A StyleGAN trained on 100 million pictures of New York; the GAN-generated images are then animated with Point Advection in Houdini

GAN, Houdini, ESR-GAN, StyleGAN

David Ha, Douglas Eck

Generative vector doodles with an RNN

RNN, QuickDraw

Lia Coleman

StyleGAN trained on blooming flowers with background removal using DaVinci Resolve, then interpolated with fleshdigressions and TouchDesigner's CHOP function according to cello music

StyleGAN, fleshdigressions, DaVinci Resolve, TouchDesigner, CHOP

Doron Adler

Overfit StyleGAN on 250 nonsensical images and then apply StyleTransfer

StyleGAN, GAN, StyleTransfer

Jason Salavon

Combine a collage of GAN interpolations to create motives, then projected on a building

GAN

Hannu Töyrylä

GAN-generated images from personal photos from Finland

GAN

Robbie Barrat

Apply patches from artworks to a painting and guide it with a GAN discriminator

GAN, Discriminator, Inpainting

Magenta

Translating everyday sounds into instruments with Magenta's Differentiable Digital Signal Processing

DDSP, Magenta

Refik Anadol

A StyleGAN trained on 2 million architecture photos and interpolated

GAN, ESR-GAN, StyleGAN

Errthang is alive

StyleGAN2-ADA trained on myths and interpolated with music

StyleGAN

Refik Anadol

A StyleGAN trained on images from Mars MRO and interpolated frame-by-frame to create a 3D effect

GAN, ESR-GAN, StyleGAN

Bastien Girschig, Google Arts & Culture Lab

Use PoseNet to extract a pose and generate stick figure choreographies

UMAP, PoseNet

Jason Salavon

Reconstruct images by introploating a collage of GANs and guiding it with a GAN discriminator

GAN, Discriminator

Vibert Thio, Douglas Eck

An interactive room where you can create music with Magenta's javascript version of MusicVAE and MelodyRNN

Magenta, VAE, RNN

Mario Klingemann

A blog post made with Markov Chains starting with religion and ending up discussing Adobe After Effects

Markov Chains

Nathan Shipley, Bobbo Andonova

Translate Bobbo Andonova's live sketch video to a person with Pixel2style2pixel, a StyleGAN Encoder for Image-to-Image Translation

Pixel2style2pixel

Christian Mio Loclair, Waltz Binaire

GAN generated 3D sculpture and made in marble

GAN, Point Cloud

Simon Doury, Google Arts & Culture Lab

Insert a few notes and the model improvises in the style of Bach

Magenta

Will Stedden

Translate artist's 3500-word story into a video using CLIP-based Story2Hallucination

Story2Hallucination, CLIP, BigGAN

Lulu xXX, Jacob Sutton

Apply Slic Superpixels and Style2Paint to Jacob Sutton's music video

Style Transfer

Mario Klingemann

GAN collage interpolation of three dogs

GAN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners