Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Alec Wright, Eero-Pekka Damskägg, Lauri Juvela, Vesa Välimäki, Keith Bloemer, Zak Jost

Real-time guitar amplifier emulation with deep learning

WaveNet

Nadine Lessio

Use Alexa voice assistants and add heuristics for it to disagree

Voice Detection, IoT, Hardware

Alsino Skowronnek

A StyleGAN trained on thousands of frames of a filmed sequence of images of graffiti from NYC in the late 70s/early 80s. The output is interpreted into a painting and an AR filter

StyleGAN

Sey Min

Take a selfie and use a CNN to determine how likely you are to be a k-pop star

CNN, Classification

OpenAI

Create images from text captions using GPT-3 and trained on 400M text–image pairs

DALL·E, GPT

Christian Mio Loclair, Waltz Binaire

A computer looks at itself with a camera and translates image features into text with an RNN

Camera, CNN, RNN

Yotam Mann, Google Creative Lab

A user plays a few keys on a piano and an RNN model generates more according to your input

RNN, Magenta

Alex J. Champandard

Extract patches from an image to generate a texture with a GAN discriminator

GAN, Discriminator, Inpainting

Jürgen Schmidhuber, Douglas Eck

Blues Improvisation with an LSTM

RNN, LSTM

Mario Klingemann

Extract face markers and use a pix2pix model to translate the face markers into paintings

GAN, pix2pix, Expression Detection

Mike Tyka

RNN generated tweets trained on US political bots and printed like Tweets

RNN

Stanislas Chaillou

StyleGAN interpolation, trained on Karl Blossfeldt's herbarium (1928)

StyleGAN

Magenta, Google Creative Lab

Blend several beats melodies by mixing the latent vector of MIDI files

VAE, Magenta

Bjørn Karmann, Google Creative Lab

A CNN model in a device that collects data and is auto trained to make an action

CNN, Hardware

Lisha Li, Vladimir Glazachev, Dzmitry Pletnikau, Eric Liu

Automatically animate digital humans or your digital double with just text or speech

Text to Animation of Virtual Characters

Anna Ridler

A GAN trained on handmade ink drawings based on the film Fall of the House of Usher (1929) as well as the GAN-generated images themselves

GAN

Anna Ridler

A voiceover via a CNN and RNN for Walt Disney's Nature's Half Acre (1951) trained on text from female protagonists in romance novels

RNN, LSTM, CNN

Ziv Epstein, Matt Groh, Manuel Cebrian, Iyad Rahwan

Use GAN inpaintings to add spirits to videos

GAN, Inpainting

Minne Atairu

A StyleGAN model trained on portraits

StyleGAN, GAN

Alexander Mordvintsev

Neural CA based experience, highlighting the relation between individual cells and their collective

Nerual CA

Ross Goodwin, Oscar Sharp

Augment and cut an exiting film with an LSTM generated screenplay, voice synthesis, and face-swapping

RNN, LSTM, Deep Fakes

Dani Joy

An overpainted GAN interpolation of a smoking monkey

GAN

Naofumi Akimoto

Create a video with a conditional GAN using next frame predictions

GAN, pix2pix

Suk Kyoung Choi

Style Transfer Trump's executive order with Kurt Schwitters' Das Und-bild, using the artist's philosophy to criticise

Style Transfer

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners