Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Helena Sarin

GAN trained on personal pictures of leafs

GAN

Jana Sam, Alexander Mordvintsev

Zooming inside of an artwork and applying Style Transfer to transfer to another artwork

Style Transfer

Baum & Leahy

Blend sounds from Wavenet trained on field recordings, and NSynth tuned on nature sounds from British Library Wildlife and Environmental Sounds archive

Magenta, VAE, NSynth, Wavenet

Xander Steenbrugge

GAN generated textures and post processing in B3D with meditative music

GAN, B3D

Ryan Putnam

A GAN interpolation of detailed oil painting strokes

GAN, StyleGAN

Mike Tyka

RNN generated tweets trained on US political bots and printed like Tweets

RNN

Albert Jimenez

GAN generative images based on Dali

GAN

Jonathan Fly

Start with a video clip of a rollercoaster and then predict the next frame with a pix2pix model, feeding the previous frame

Pix2pix

Helena Sarin

GAN trained on personal pictures of flowers

GAN

Xinyue Yang

Classify voice with an RNN and match it with doodles

RNN, Classification, QuickDraw

Manny Tan, Kyle McDonald, Google Creative Lab

A visual map of drum sound made by extracting the features and clustering them with t-SNE

t-SNE

Jennifer Walshe, Memo Akten

Train an audio RNN and GAN on Jennifer Walshe's video performances, and generate music and visuals real-time during a duet with the artist and model

Grannma Magnet, RNN, GAN

Nadine Lessio

Use Alexa voice assistants and add heuristics for it to disagree

Voice Detection, IoT, Hardware

Cyril Diagne, Nicolas Barradeau, Simon Doury, Google Arts & Culture Lab

Map artworks with t-SNE

t-SNE, CNN

David Ha, Douglas Eck

Generative vector doodles with an RNN

RNN, QuickDraw

Mauro Martino, Nima Dehmami, Luca Stornaiuolo

A 3D-generated sculpture made with points and links inspired by image2image networks

pix2pix, Point Cloud

Memo Akten

Pick random words from Word2Vec and look at their relationships to the words ‘man’ and ‘woman’

Word2Vec

Nye Thompson

Scene classification from surveillance cameras, clustered, visualized, and printed

CNN

Refik Anadol

Extract CNN features from images and organize images with cuml-UMAP, create a device to explore the space with hand motions

cuml-UMAP

Apathia Records

Style Transfer with Optical Flow and DeepDream applied to a music video

StyleTransfer, DeepDream, Optical Flow

Jonathan Fly

Use SinGAN to train a GAN with a single image, Frymire, the classic compression image

SinGAN, GAN

Ivan Pravdin

StyleGAN blended model from human poses GAN and FFHQ

StyleGAN, GAN

Alexander Mordvintsev

Run an image through a pre-trained CNN, and then upscale the image backward. For each layer, adjust the image according to the difference between the activations and the image

CNN, Activations, DeepDream, Gradient Ascent

Jeff Thompson

Generative touch with a robotic arm, translating image features to movements

Hardware, CNN, RNN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners