Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Mario Klingemann

GAN collage interpolation of three dogs

GAN

Nathan Shipley, Bella Poarch

Using StyleGAN transfer learning and layer blending to create a cartoon of Uma Thurman and then animating her using First Order Motion with a video of Bella Poarch from TikTok

StyleGAN, First Order Motion, GAN

Lulu xXX

Style Transfer, Optical Flow, and Background Removal applied to video

Style Transfer, Background Removal, Optical flow, DeepFlow

Egor Kraft

A GAN trained on a thousand blots of ink splashed onto watercolour paper and interpolated live on electronic ink screens

GAN

Parag K. Mital

A generative audio mashup tool using Memory Mosaic

Memory Mosaic

J. Rosenbaum

GAN-generated roman statues with generative music and descriptions

GAN

Torin Blankensmith, Kyle Phillips, Google Creative Lab

Blend two melodies using the latent vectors from a VAE

VAE, Magenta

Cyril Diagne, Simon Doury, Google Arts & Culture Lab

Organise the features of an image with t-SNE, and visualize the similarity between artworks

t-SNE, CNN

Ryosuke Tanno

GAN generated images of Japanese Anime Food I

GAN

Lulu xXX, Paradis

Apply Slow motion and fluid footage and Optical Flow based Style Transfer on Paradis's Recto Verso

StyleTransfer, Optical Flow, deepflow

Naofumi Akimoto

Create a video with a conditional GAN using next frame predictions

GAN, pix2pix

Tony Beltramelli

Translate image features from a graphical user interface to RNN generated website

Image Captioning, pix2code, RNN, LSTM, CNN

Andreas Refsgaard, Gene Kogan

Use a CNN to classify instruments in a live drawing and add the instrument tracks in Ableton Live to compose in real-time

CNN, Classification, openFrameworks, OpenCV, Ableton Live

Tyler Kvochick

GAN generated images of architecture plans

GAN

Elijah M

Using Portraitai and Deepart.io to create a style and then use EbSynth to apply it to a video

Portraitai, deepart.io, EbSynth, Style Transfer

Google Arts & Culture Lab

Use a camera and CNN to classify artworks in an exhibition

CNN, Classification

Mario Klingemann

DeepDream applied to the face of a woman

DeepDream, Gradient Ascent

Christian Mio Loclair, Waltz Binaire

A computer looks at itself with a camera and translates image features into text with an RNN

Camera, CNN, RNN

Nathan Vogel

Translate online maps to 19th century maps in real-time with CycleGAN

CycleGAN, GAN

Lisha Li, Vladimir Glazachev, Dzmitry Pletnikau, Eric Liu

Automatically animate digital humans or your digital double with just text or speech

Text to Animation of Virtual Characters

Bill T. Jones, Google Creative Lab

Detect poses and voice and add the spoken words live in the choreography

PoseNet, Camera, Voice detection, Microphone

Susie Rong Fu

A camera takes a photo and a Style Transfer model translates it into a sketch, while Susie Rong Fu makes a portrait of the same person

StyleTransfer, Camera

Gene Kogan

Video texture synthesis using contentless Style Transfer

Style Transfer, Contentless

Guillaume Slizewicz

A mobile broadcasting robot using MobileNet V2 trained on COCO, OCR, and text to speech to amplify messages in public spaces

OCR, Text-to-speech, COCO, MobileNetV2

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners