Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Susie Rong Fu

A camera takes a photo and a Style Transfer model translates it into a sketch, while Susie Rong Fu makes a portrait of the same person

StyleTransfer, Camera

Xander Steenbrugge

GAN generated textures and post processing in B3D with meditative music

GAN, B3D

Yotam Mann, Google Creative Lab

A tool to mix the latent space of two instruments

VAE, Magenta

Michael Kelly

GAN generated images of Edo woodblock art

GAN

Yuxi Liu

A robot that uses a camera and translates the image feature to RNN features, and writes poems on the beach

RNN, CNN, Image Captioning

Naofumi Akimoto

Create a video with a conditional GAN using next frame predictions

GAN, pix2pix

Josh Nimoy

DeepDream inspired by Classical Western Art History

DeepDream, Gradient Ascent

Elijah M

Using Portraitai and Deepart.io to create a style and then use EbSynth to apply it to a video

Portraitai, deepart.io, EbSynth, Style Transfer

Alsino Skowronnek

A StyleGAN trained on thousands of frames of a filmed sequence of images of graffiti from NYC in the late 70s/early 80s. The output is interpreted into a painting and an AR filter

StyleGAN

Ziv Epstein, Matt Groh, Manuel Cebrian, Iyad Rahwan

Use GAN inpaintings to add spirits to videos

GAN, Inpainting

Obvious

GAN trained on masks, and make the masks according to the GAN-generated images

GAN

Shortcut

Digital painting augmented with stylized-neural-painting on RunwayML

stylized-neural-painting

Diego Porres

StyleGAN-generated Mexican and Guatemalan textiles

GAN, StyleGAN

Cyril Diagne, Nicolas Barradeau, Simon Doury, Google Arts & Culture Lab

Map artworks with t-SNE

t-SNE, CNN

Hector Rodriguez

Reconstruct the film Alphaville (1965) by extracting patches from the same film and reassemble them with Simplex Volume Maximization

Simplex Volume Maximization

Magenta

Translating everyday sounds into instruments with Magenta's Differentiable Digital Signal Processing

DDSP, Magenta

Sofia Crespo

CNN generated blend of species and 3D printed

CNN

Jason Antic

Colorize B&W livingroom in Sweden with a pix2pix U-Net

U-net, Resnet, ImageNet, pix2pix, DeOldify

Google ZOO, bit.studio

Learn shadow art by having a CNN classify and correct your hand patterns

CNN, Classification, Camera

Refik Anadol

A StyleGAN generated image and painted on a canvas

GAN, ESR-GAN, StyleGAN

Amber Frid-Jimenez

RNN generative piano music inspired by Satie

RNN

Benjamin Wilkins, J.H. Gold

Use a CNN to classify low fidelity wireframes to mobile app components

CNN, Classification, Camera

Yotam Mann

Resynthesized audio from YouTube with neural nets trained on vocal and instrumental recordings

WaveGAN, GAN

Lulu xXX, Paradis

Apply Slow motion and fluid footage and Optical Flow based Style Transfer on Paradis's Recto Verso

StyleTransfer, Optical Flow, deepflow

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners