Submit a Project

ML x ART

A showcase with creative machine learning experiments

👋 I'm Emil, a resident at the Google Arts & Culture Lab. I've curated this collection.

Year
Artist
Technology
Theme
Medium
Default order

Alexander Mordvintsev

Use Style Transfer where the content comes from a face and the style from a video of clouds

Style Transfer

Bruce MacDonald

Fooling Facial Detection with Fashion

Facial Detection

AI Dungeon

Use GPT-3 to create a text adventure

Transformer, GPT

Tony Beltramelli

Translate image features from a graphical user interface to RNN generated website

Image Captioning, pix2code, RNN, LSTM, CNN

Jason Salavon

Reconstruct images by introploating a collage of GANs and guiding it with a GAN discriminator

GAN, Discriminator

Christian Mio Loclair, Waltz Binaire

A computer looks at itself with a camera and translates image features into text with an RNN

Camera, CNN, RNN

Sofia Crespo

Use Style Transfer from creatures and plants, to create new creatures, printed

Style Transfer, Texture synthesis

Yotam Mann

Resynthesized audio from YouTube with neural nets trained on vocal and instrumental recordings

WaveGAN, GAN

Josh Nimoy

DeepDream inspired by Classical Western Art History

DeepDream, Gradient Ascent

Mauro Martino, Nima Dehmami, Luca Stornaiuolo

A 3D-generated sculpture made with points and links inspired by image2image networks

pix2pix, Point Cloud

Jack Qiao

Generate font combinations by matching the CNN features of fonts

NNS, CNN

Emil Wallner

Use an image captioning model, pix2code, to translate design mockups into a website

Image Captioning, pix2code, RNN, LSTM, CNN

Es Devlin, Ross Goodwin, Google Arts & Culture Lab

Say a word and an RNN generates a poem which is displayed

Voice detection, RNN, Microphone

Alexandre Devaux

Using BodyPix to segment people and WebXR to create holograms on-the-fly

BodyPix, Tensorflow.js

Erik Swahn

StyleGAN trained on floor plans and stacked on top of each other

StyleGAN, GAN

Guillaume Slizewicz

A mobile broadcasting robot using MobileNet V2 trained on COCO, OCR, and text to speech to amplify messages in public spaces

OCR, Text-to-speech, COCO, MobileNetV2

Daniel J Hofmann

Use a colorization model to over-colorize an image to generate a glitch effect

Colorization

Alex J. Champandard

Extract patches from an image to generate a texture with a GAN discriminator

GAN, Discriminator, Inpainting

Sey Min

Take a selfie and use a CNN to determine how likely you are to be a k-pop star

CNN, Classification

Jürgen Schmidhuber

Algorithmically generate a face that requires the least amount of features to encode, inspired by Leonardo da Vinci and Albrecht Dürer

Occam's razor, Kolmogorov complexity

Zihou Ng

A browser-based exploration of real-time latent space navigation of GAN at higher resolutions with WebGL

GAN

Fabin Rasheed

Give Google's voice assistant a StyleGAN face in VR and animate answers with First Order Motion

StyleGAN, GAN, VR, First Order Motion

Joel Simon

Use a word vector to generate an image, and a discriminator to detect the word vector from the generated image, made by CNCing unfired clay

GAN, cDCGAN

Bjørn Karmann, Google Creative Lab

A CNN model in a device that collects data and is auto trained to make an action

CNN, Hardware

Submit projects here 💅

☞ ML x ART on Twitter

Copyright © 2021 Emil Wallner

All artworks © of their respective owners