Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Vadim Epstein

Painting by Viktor Vasnetsov, animated with 'Animating Landscape' and Multi-Domain Multi-Modality I2I translation

Multi-Domain Multi-Modality I2I translation, Animating Landscape

Ross Goodwin

Put a camera on a car to create a road trip novel, by translating CNN features to text, and using it as a prompt for a text generating model

RNN, CNN, Image Captioning, Camera

Julia Vergazova, Nikolya Ulyanov

Feeding surveillance camera images into a 3d-photo-inpainting network

3d photo inpainting

Hannu Töyrylä

Custom GAN-generated image with self-attention, trained on personal photos from Finland

GAN, Self-attention

Christine Payne

A music generator trained on hundreds of thousands of MIDI files and trained with GPT-2

GPT

Stephanie Dinkins

An RNN trained on oral histories from three generations of women from a single-family to highlight concerns of people who are underrepresented in the tech sector, displayed with an interactive voice assistant

RNN, LSTM, Microphone

Memo Akten

Pick random words from Word2Vec and look at their relationships to the words ‘man’ and ‘woman’

Word2Vec

Magenta, Google Creative Lab

Blend several beats melodies by mixing the latent vector of MIDI files

VAE, Magenta

Ryosuke Tanno

GAN generated images of Japanese Anime Food I

GAN

Jason Antic

Colorize B&W picture of Detroit with a pix2pix U-Net

U-net, Resnet, ImageNet, pix2pix, DeOldify

Xinyue Yang

Classify voice with an RNN and match it with doodles

RNN, Classification, QuickDraw

Sougwen Chung

Train an RNN on drawing motions and create a painting in collaboration with a robot arm controlled by the model

RNN, LSTM

Elijah M

Using Portraitai and Deepart.io to create a style and then use EbSynth to apply it to a video

Portraitai, deepart.io, EbSynth, Style Transfer

Simon Doury, Google Arts & Culture Lab

Insert a few notes and the model improvises in the style of Bach

Magenta

Susie Rong Fu

A camera takes a photo and a Style Transfer model translates it into a sketch, while Susie Rong Fu makes a portrait of the same person

StyleTransfer, Camera

Google Creative Lab, Google Arts & Culture Lab, IYOIYO

Match a user generated drawing with paintings, by extracting the features of the outline of an image and paring it with the drawings

NNS, Edge Detection, CNN

Mike Tyka

Create videos with BigGAN and add music with the Music Transformer

BigGAN, GAN, Music Transformer

Lulu xXX, Jacob Sutton

Apply Slic Superpixels and Style2Paint to Jacob Sutton's music video

Style Transfer

Cunicode

A StyleGAN trained on thousands of public domain beetle illustrations

StyleGAN, GAN

Kaz Sato, Google Creative Lab

Rock-Paper-Scissors game based on a robot with sensors, an ANN classifies the sensory data

ANN, Hardware

Jennifer Walshe, Memo Akten

Train an audio RNN and GAN on Jennifer Walshe's video performances, and generate music and visuals real-time during a duet with the artist and model

Grannma Magnet, RNN, GAN

Ross Goodwin

Use an N-gram model to generate 10 000 sonnets trained on works by William Shakespeare

N-gram

Gene Kogan

Progressively-grown GAN trained on WikiArts

GAN, Progressively Grown GAN

Libby Heaney

Pass the pixels of a frame through a Quantum Computer and track the transition with Open Pose

Quantum Computer, Open Pose, CNN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners