Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

BĂ„rd Ionson

art-DCGAN trained on 20K images of oscilloscope art to mimic the effect when you close your eyes and rub them

art-DCGAN, GAN

Christine Payne

A music generator trained on hundreds of thousands of MIDI files and trained with GPT-2

GPT

Cyril Diagne, Simon Doury, Google Arts & Culture Lab

Organise the features of an image with t-SNE, and visualize the similarity between artworks

t-SNE, CNN

Derrick Schultz

StyleGAN and Super-Resolution of flowers

StyleGAN

Sofia Crespo

CNN generated blend of nature posters

CNN

Google Creative Lab

Conduct your own orchestra by extracting your pose

PoseNet, Camera

Kishi Yuma

GAN inpainting of Guido Reni's Mary Magdalene

GAN, Inpainting

Robbie Barrat

Kanye West RNN lyrics generator

RNN

Jake Elwes

Use an image captioning model that translates CNN features to RNN features, and another GAN that translates RNN features to images in a loop

RNN, Image Captioning, CNN, GAN

Parag K. Mital

Mining Unlabeled Electronic Music Databases through 3D Interactive Visualization of Latent Component Relationships

Feature vectors

Jana Sam, Alexander Mordvintsev

Zooming inside of an artwork and applying Style Transfer to transfer to another artwork

Style Transfer

Mike Tyka

A GAN trained on faces from Flickr

GAN

Parag K. Mital

A generative audio mashup tool using Memory Mosaic

Memory Mosaic

Es Devlin, Ross Goodwin, IYOIYO, Google Arts & Culture Lab

Generate a poem from a word and project it on your face

RNN, Camera

Refik Anadol

A StyleGAN trained on 2 million architecture photos and interpolated

GAN, ESR-GAN, StyleGAN

Yotam Mann, Google Creative Lab

A user plays a few keys on a piano and an RNN model generates more according to your input

RNN, Magenta

Andrew Pfalz

RNN generated string instruments with a tutorial

RNN, LSTM

Billie Eilish, Google Creative Lab, YouTube Music, IYOIYO, Plan8

An interactive, gradient-based audio and video alignment of thousands of covers of Billie Eilish’s “Bad Guy”

Kevin Ho, Google Creative Lab

Measure the distance between CNN features to pair fonts

RNN, NNS

Jonathan Fly

A CNN model that extracts depth maps from artworks and then augment them in a 3D point cloud

Depth Map, Point Cloud

Google Research, Google Creative Lab, YouTube Music

Analyse voice files to match the similarity to Freddie Mercury

CNN, RNN, Classification, Magenta

Mario Klingemann

Turn finger drawings into a GAN generated image

pix2pix, Camera, GAN

Lin Fei Fei, Vadim Epstein

Several CV processing techniques have been applied to the paintings of Lin Fei Fei to turn them into an animated story

3D photo inpaint, First Order Motion, StyleGAN2, ConSinGAN, Video interpolation

Gene Kogan

Video texture synthesis using contentless Style Transfer

Style Transfer, Contentless

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners