Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Bastien Girschig, Romain Cazier, Google Arts & Culture Lab

Match a user-generated shape with paintings; the CNN features of the shapes are matched with a database of features of outlined artworks

NNS, Edge Detection, CNN

Ryan Murdock

Use BigGAN and CLIP-based Gradient Ascent to generate an image of "a horse head with four eyes"

BigGAN, Gradient Ascent, CLIP

Mario Klingemann

Create a deep fake with Kellyanne Conway's by translating face markers into a video of a person speaking

GAN, pix2pix

Benjamin Wilkins, J.H. Gold

Use a CNN to classify low fidelity wireframes to mobile app components

CNN, Classification, Camera

Mike Tyka

Class visualization of insects with DeepDream

DeepDream, Gradient Ascent

Albert Barqué-Duran

Use a 3D GAN to generate an Emoji, 3D print the generated Emoji, and paint it during a live performance

GAN, Height map

Christian Mio Loclair, Waltz Binaire

GAN generated 3D sculpture and made in marble

GAN, Point Cloud

Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, Ilya Sutskever

Generate music with a combination of VQ-VAE and Sparse Transformers trained on 1.2 million songs

VQ-VAE, Sparse Transformer

Daniel Voshart

Using Artbreeder to translate statues of Roman emperors to latent vectors, and adjusting the vector to make them real

ArtBreeder, GAN, Photoshop

Fabio Rovai

GAN trained on GAP clothes with super-resolution

GAN

Scott Eaton

Custom pix2pix HD turning sketches into bodies

pix2pix, GAN

Gene Kogan

Apply Gradient Smoothing to create an infinite pattern from DeepDream

DeepDream, Gradient Smoothing

David Ha, Douglas Eck

Generative vector doodles with an RNN

RNN, QuickDraw

Mike Tyka

Create videos with BigGAN and add music with the Music Transformer

BigGAN, GAN, Music Transformer

Alexander Mordvintsev, Nicola Pezzotti, Ludwig Schubert, Chris Olah

3D Style Transfer

Style Transfer, 3D

Memo Akten

Translate objects and hand movements to nature scenes with a Conditional GAN

pix2pix, GAN

Derrick Schultz

Style Transfer applied to a collage of eyes

Style Transfer

Josh Nimoy

DeepDream inspired by Classical Western Art History

DeepDream, Gradient Ascent

Stephanie Dinkins

An RNN trained on oral histories from three generations of women from a single-family to highlight concerns of people who are underrepresented in the tech sector, displayed with an interactive voice assistant

RNN, LSTM, Microphone

Robbie Barrat

Apply patches from artworks to a painting and guide it with a GAN discriminator

GAN, Discriminator, Inpainting

Michael Kelly

GAN generated images of Edo woodblock art

GAN

Bas Uterwijk

Using Artbreeder to translate Jesus and other historical figures to latent vectors, and adjusting the vector to make them real

GAN, Artbreeder

Eric Anderson

StyleGAN trained on plasma photos, displayed in a collage

StyleGAN, GAN

Alex J. Champandard

Translate two-bit doodles into paintings with Semantic Style Transfer

Style Transfer

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners