Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Kishi Yuma

GAN inpainting of Guido Reni's Mary Magdalene

GAN, Inpainting

Gene Kogan

Visualize the layers of a CNN with your camera

CNN, Camera

Jessica In, George Profenza, Sam Price

A live, interactive drawing installation that facilitates collaboration between a human and a robot, the model is trained on the QuickDraw dataset and uses the QuickDraw Classifier, and a custom SketchRNN

Hardware, SketchRNN, QuickDraw, Classifier

Fabin Rasheed

Translate a painting to a real-world photograph with GauGAN

GauGAN, GAN

Lulu xXX

DJ video with video texture advection with flipfluids and Optical Flow based Style Transfer

StyleTransfer, Optical Flow, deepflow

Sofia Crespo

Add DeepDream like patterns on 3D beatles and print the new specimens

DeepDream, 3D

Helena Sarin

GAN trained on personal pictures of leafs

GAN

Taryn Southern, DJ beep code

Generate a melody with Watson Beat and remix it to generate a song called Genesis

VAE, Watson Beat

Xavier Snelgrove

Create a texture by combining two images with Style Transfer

Style Transfer, Texture synthesis

Diego Porres

GAN-generated Mexican and Guatemalan textiles

DCGAN, GAN

Mario Klingemann

Extract face markers and use a pix2pix model to translate the face markers into paintings

GAN, pix2pix, Expression Detection

Bill T. Jones, Google Creative Lab

Detect poses and voice and add the spoken words live in the choreography

PoseNet, Camera, Voice detection, Microphone

Gene Kogan

Continuously zoom in a image and apply DeepDream and use Dense Captioning to label objects in the video

DenseCap, DeepDream

Xavier Snelgrove and Matthew Tesfaldet

Generate shader-like animations with CPPN using microphone prompts

CPPN, Microphone

Lulu xXX, STORROR

Use Detectron2 to identify people in STORROR's parkour video and apply Optical Flow based Style Transfer

Detectron2, Optical Flow, StyleTransfer, deepflow

Memo Akten

RNN model trained on sounds and morphing trajectories in latent space z

Grannma Magnet, RNN

Item 1 of 3

LIA

Using Chimera Painter to turn scribbled monsters into real monsters

Chimera Painter

Refik Anadol

A StyleGAN trained on 2 million architecture photos and interpolated

GAN, ESR-GAN, StyleGAN

Lia Coleman

StyleGAN trained on blooming flowers with background removal using DaVinci Resolve, then interpolated with fleshdigressions and TouchDesigner's CHOP function according to cello music

StyleGAN, fleshdigressions, DaVinci Resolve, TouchDesigner, CHOP

Nikita Pekin

Text-to-image for "A painting of a murder in the style of Monet" generated by The Big Sleep

Big Sleep, CLIP

Xander Steenbrugge

GAN generated textures and post processing in B3D with meditative music

GAN, B3D

Ben Snell

A 3D-GAN trained on sculptures inspired by the influence of nature and nurture

GAN, 3D

Baum & Leahy

Blend sounds from Wavenet trained on field recordings, and NSynth tuned on nature sounds from British Library Wildlife and Environmental Sounds archive

Magenta, VAE, NSynth, Wavenet

Item 1 of 2

Nuntinee Tansrisakul, Yuguang Zhang

A GAN-generated video is rendered with a digital pinhole camera process, the negatives are printed, and then processed in a darkroom to restore the aesthetic of analog photos in a digital-first world

GAN

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners