Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Maxime Lefebvre

GAN generated roman theatre projected on moving tiles

GAN

Nushin Isabelle Yazdani

Generative images of convicts using a GAN

GAN

Jürgen Schmidhuber, Douglas Eck

Blues Improvisation with an LSTM

RNN, LSTM

Maxime Plantady, Evelyne Drouin

Light projections on a sculpture based on facial expressions

Expression Detection

Gene Kogan

A Conditional GAN trained on OpenStreetMap's map and corresponding satellite image inspired by Italo Calvino's Invisible Cities

pix2pix, GAN, Device

Massive Attack, Mario Klingemann

GAN generated music video

GAN

Kayra Uckilinc

Apply First Order Motion to a collage of oil paintings, with banjo music, and based on Bella Poarch's TikTok video

First Order Motion

Helena Nikonole

Train an LSTM on sacred texts. Use voice synthesis to play the generated scriptures on unsecured surveillance cameras with speakers

LSTM

Hector Rodriguez

Reconstruct the film Alphaville (1965) by extracting patches from the same film and reassemble them with Simplex Volume Maximization

Simplex Volume Maximization

Gene Kogan

Translate a live face to face trackers and turn them into a another person with Pix2pix

GAN, Pix2pix, Camera

Alexander Mordvintsev

Visualize features in a neural network using Gradient Ascent

CNN, Activations

Jason Salavon

GAN interpolation based on a camera feed

GAN, Camera

Ryan Murdock

Perceptual MinMax trained on 80 images from CelebA

Min-Max

Alexander Mordvintsev, Nicola Pezzotti, Ludwig Schubert, Chris Olah

3D Style Transfer

Style Transfer, 3D

Mario Klingemann

Create a deep fake with Kellyanne Conway's by translating face markers into a video of a person speaking

GAN, pix2pix

Bill T. Jones, Google Creative Lab

Detect poses and voice and add the spoken words live in the choreography

PoseNet, Camera, Voice detection, Microphone

Es Devlin, Ross Goodwin, IYOIYO, Google Arts & Culture Lab

Generate a poem from a word and project it on your face

RNN, Camera

Anne Spalter

An image with circles Style Transferred with pictures of three airplanes using Nightcafe, and the spaceman and asteroid are animated with Plotaverse

Style Transfer

Eyal Gruss

A browser-based app to animate faces with your camera in real-time, created with a Google Colab wrapper for First Order Motion

First Order Motion, Wav2lip, Liquid Warping GAN

Alexander Mordvintsev

Transition between artworks by continuously applying Style Transfer

Style Transfer

Zhihao Ouyang, Yihang Yin, Kun Yan, Jian Wu, Xiaolin Hu

Compose violin music with prompts trained with a combination of a CNN and RNN, and performed

RNN, CNN, rGMIR, Magenta

Eyal Gruss, Ayelet Sapirshtein, Vered Heruti

A machine that creates live, generated, visual poetry from spoken poetry in any language

AttnGAN, Machine translation, Speech to text

Monolesan

Using PoseNet to create art using your body parts like eyes, hands, chest and knees

PoseNet, Camera, TensorFlow.js

Sofia Crespo

CNN generated blend of species and 3D printed

CNN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners