Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Josh Nimoy

DeepDream inspired by Classical Western Art History

DeepDream, Gradient Ascent

François Quévillon

A tool for creating an endless car video. It's made by modifying parameters in the sampling system that's created with image features and other technologies

CNN

Helena Sarin, Dmitri Cherniak

A GAN trained on algorithmically generated art

GAN

Parag K. Mital

A generative audio mashup tool using Memory Mosaic

Memory Mosaic

Eyal Gruss

A browser-based app to animate faces with your camera in real-time, created with a Google Colab wrapper for First Order Motion

First Order Motion, Wav2lip, Liquid Warping GAN

Ziv Epstein, Matt Groh, Manuel Cebrian, Iyad Rahwan

Use GAN inpaintings to add spirits to videos

GAN, Inpainting

Jason Salavon

Combine a collage of GAN interpolations to create motives, then projected on a building

GAN

Google Brand Studio

Use a camera to find objects and a CNN identifies if it's correct

Camera, CNN, Classification

Libby Heaney

Use voice and text features to match it with Britain's citizen test

Microphone, RNN, Classification

Alexandre Devaux

Using BodyPix to segment people and WebXR to create holograms on-the-fly

BodyPix, Tensorflow.js

Google Creative Lab

Extract the pose from a picture and match it with an image with the same pose

PoseNet, Camera

Christine Sugrue, Google Arts & Culture Lab

Use Object Detection to explore details in artworks

CNN, Object Detection

Ben Snell

A 3D-GAN trained on sculptures inspired by the influence of nature and nurture

GAN, 3D

Hye Min Cho

Neural Radiance Fields applied to a rotating butterfly

NeRF

Bill T. Jones, Google Creative Lab

Detect poses and voice and add the spoken words live in the choreography

PoseNet, Camera, Voice detection, Microphone

Google Creative Lab

Collect dataset and use AutoML to classify the images

AutoML, CNN, Hardware

Lingdong Huang, Zheng Jiang, Giada Sun, Tong Bai, Eunsu Kang, Barnabas Poczos

Generate a vintage Chinese opera by extracting poses and augmenting them with a pix2pix model

pix2pix, RNN, LSTM, Markov Chain, OpenPose, Detectron

Ryan Murdock

Perceptual MinMax trained on 80 images from CelebA

Min-Max

Dan Motzenbecker, Google Creative Lab

Take a picture of something to hear how to say it in a different language

CNN, Translation

Synflux, Hatara

A GAN trained on 2 million birds and converted to double Jacquard knit format

GAN

Nao Tokui

Turn images into sound by matching CNN features with CNN features of audio files

CNN, NNS

Mario Klingemann

DeepDream applied to the face of a woman

DeepDream, Gradient Ascent

Helena Sarin

GAN trained on personal pictures of flowers

GAN

Jürgen Schmidhuber

Create an artwork with the shortest algorithm while at the same time captures the essence of an object, using Kolmogorov Complexity

Occam's razor, Kolmogorov complexity

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners