Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Google Creative Lab

Collect dataset and use AutoML to classify the images

AutoML, CNN, Hardware

Egor Kraft

A GAN trained on a thousand blots of ink splashed onto watercolour paper and interpolated live on electronic ink screens

GAN

Tom White

A program that generates abstract images and is guided by a trained CNN classifier

CNN

Helena Sarin

GAN trained on personal pictures of leafs

GAN

Lulu xXX

Clustering of Static-Adaptive Correspondences for Deformable Object Tracking (CMT), with Optical Flow enhanced Style Transfer, and a loop generating algorithm based on Optical Flow

CMT, StyleTransfer, Optical Flow, deepflow

Philipp Schmitt, Steffen Weiß

Generate chairs with a GAN and then produce the generated chairs

GAN

Guillaume Slizewicz

A character generator model is trained on a technical database to identify criminals from 1907. It's contrasted with a modern webcam linked to a facial recognition algorithm

Face recognition

Hans Brouwer

Audio-reactive latent interpolation with StyleGAN2 created by modulating latent and noise inputs with musical features

StyleGAN2

Seung Joon Choi

Combining CPPN visuals and combining it with raymarching, VAE generated music

CPPN, VAE, Raymarching, ANN

Merzmensch

A montage with several 3D Ken Burns Effect generated videos from images

3D Ken Burns Effect

Memo Aktken

DeepDream applied to a satellite image of Google's headquarters

DeepDream, Gradient Ascent

Fabin Rasheed

Give Google's voice assistant a StyleGAN face in VR and animate answers with First Order Motion

StyleGAN, GAN, VR, First Order Motion

NOAA, Google Creative Lab

Visualize and detect whales and deep-sea animals from ocean sounds

CNN, NNS

Robbie Barrat, Acne

Train a GAN on Acne clothing, generate images with the GAN, and create physical products according to the GAN images

GAN

Maxime Plantady, Evelyne Drouin

Light projections on a sculpture based on facial expressions

Expression Detection

Jonathan Fly

A CNN model that extracts depth maps from artworks and then augment them in a 3D point cloud

Depth Map, Point Cloud

Mario Klingemann

A next frame prediction using pix2pix feeding the newly generated image repeatedly

pix2pix, GAN

Gene Kogan

Apply Style Transfer with 17 different paintings on Alice in Wonderland

StyleTransfer

Ziv Epstein, Matt Groh, Manuel Cebrian, Iyad Rahwan

Use GAN inpaintings to add spirits to videos

GAN, Inpainting

David Ha

Use a CPPN to create shader-like images including a tutorial

CPPN, ANN

Gene Kogan

Progressively-grown GAN trained on WikiArts

GAN, Progressively Grown GAN

Daniel Smilkov, Fernanda Viégas, Martin Wattenberg, the Big Picture team, Google Creative Lab

Generates a 3D t-SNE map to visualize high-dimensional data

t-SNE

Jennifer Walshe, Memo Akten

Train an audio RNN and GAN on Jennifer Walshe's video performances, and generate music and visuals real-time during a duet with the artist and model

Grannma Magnet, RNN, GAN

Helena Sarin, Dmitri Cherniak

A GAN trained on algorithmically generated art

GAN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners