Gentle overview of Machine Learning for Artists. It covers new era defining prototypes for art powered by AI along with description on how Neural Networks work and how they generate images. This deck is based on several public talks that I gave including CG Event and What's Next conferences.

1. https://www.google.com/url?
ARTIFICIAL
INTELLIGENCE
Renaldas Zioma
Unity Labs
Machine Learning and the future of content creation and art.
Gentle overview for Artists.

2. AI TO EMPOWER THE ARTIST
© Blutgruppe/Corbis

3. NEW CREATIVE TOOLS ARE COMING
https://www.youtube.com/watch?v=xwsMjX8IuGkVideo:

4. NEW CREATIVE TOOLS
#1 ARTISTIC EXPLORATION

5. Learning a Manifold of Fonts
Neill D.F. Campbell and Jan Kautz
ARTISTIC EXPLORATION
FONTS
http://bit.ly/2iW3xjaOnline demo:

6. ARTISTIC EXPLORATION
DESIGN
Create Anime Characters with A.I
Y. Jin, J. Zhang, M. Li, Y. Tian, H. Zhu www.youtube.com/watch?v=PUkQbGaL4FgVideo:

7. ARTISTIC EXPLORATION
DESIGN
http://bit.ly/2ibeMHuOnline demos: http://make.girls.moe

8. ARTISTIC EXPLORATION
FACE
Progressive Growing of GANs
T. Karras, T. Aila, S. Laine, J. Lehtinen http://bit.ly/2k6VlQpVideo:

9. ARTISTIC EXPLORATION
FACE IN 3D
http://bit.ly/2naBPDWOnline demo:
Progressive Growing of GANs
T. Karras, T. Aila, S. Laine, J. Lehtinen

10. ARTISTIC EXPLORATION
FACE MATH
Unsupervised Representation Learning with DCGAN
A. Radford, L. Metz, S. Chintala

11. ARTISTIC EXPLORATION
FORM
Exploring 3D Shapes using Autoencoder
N. Umetani, Autodesk Research http://bit.ly/2jsTth3Video:

12. ARTISTIC EXPLORATION
STYLE
Deep Photo Style Transfer
F. Luan, S. Paris, E. Shechtman, K. Bala. Adobe research
ORIGINAL STYLE RESULT

13. ARTISTIC EXPLORATION
STYLE
http://stylit.orgDemo:
StyLit
J. Fišer, O. Jamriška, M Lukáč, Adobe Research

14. COPYRIGHT 2016 @ UNITY TECHNOLOGIES
Image courtesy of AMGunnersFC as uploaded on reddit

15. NEW CREATIVE TOOLS
#2 ASSET SEARCH

16. NEW CREATIVE TOOLS
#3 ACCELERATORS & REFINERS

17. ACCELERATORS & REFINERS
GUIDE RAY-TRACER
NVIDIA Iray and image is courtesy of NVIDIA NVIDIA Iray AI Announcement link

18. ACCELERATORS & REFINERS
UPSCALER
Super Resolution using Deep Learning
A. J. Champandard

19. ACCELERATORS & REFINERS
UPSCALER
http://bigjpg.comOnline demo:

20. ACCELERATORS
FLUID SOLVER
www.youtube.com/watch?v=w71zxkniJfoVideo:
FluidNet
J. Tompson, K. Schlachter, P. Sprechmann, K. Perlin

21. NEW CREATIVE TOOLS
#4 ROBO ARTISTS

22. ROBO ARTISTS
SKETCH ☛ IMAGE
Pix2Pix
P. Isola, J. Zhu, T. Zhou, A. Efros
https://affinelayer.com/pixsrv/Online demo:
Super Resolution using Deep Learning
A. J. Champandard

23. ROBO ARTISTS
TEXTURE VARIATIONS

24. ROBO ARTISTS
DE-LIGHTING
http://bit.ly/unity-delightingDownload from Unity Asset Store:

25. ROBO ARTISTS
ENVIRONMENT SYNTHESIS
www.youtube.com/watch?v=5w685udM838Video:
Example Based Terrain Authoring /w CGAN
E. Guerin, J. Digne, E. Galin, A. Peytavie, C. Wolf, B Benes, B Martinez

26. NEW CREATIVE TOOLS
#5 ANIMATION SYNTHESIS

27. ROBO ARTISTS
ANIMATION SYNTHESIS
www.youtube.com/watch?v=86fC31nv8eMVideo:
DeepLoco
X. Peng, G. Berseth, K Yin, M. Panne

28. RNN, ANIMATIONS
Video link
Video link
Video link
Video link

29. ANIMATION SYNTHESIS
FAKE NEWS
www.youtube.com/watch?v=9Yq67CjDqvwVideo:
Synthesizing Obama: learn Lipsync from Audio
S. Suwajanakorn, S. Seitz, I Kemelmacher

30. NEW CREATIVE TOOLS
SUMMARY
• Artistic exploration
• Search
automatic asset tagging, search by example
• Acceleration
upscale, denoise, fluid/erosion solvers, approximate GI
• Automatisation
variations, colorization, delighting, previz tools
• Animation synthesis

31. WHAT DOES AI SEE?
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain

32. WHAT DOES AI SEE?
MEANING
LAYERS OF INTERLINKED
NEURON CELLS

33. TRAINED ON MILLIONS OF IMAGES

34. WHAT DOES AI SEE?
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain Layer 2

35. WHAT DOES AI SEE?
Layer 3
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain

36. WHAT DOES AI SEE?
Layer 5
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain

37. WHAT DOES AI SEE?
Layer 6
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain

38. WHAT DOES AI SEE?
Layer 8
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain

39. HOW DOES IT WORK?

40. AI ARCHITECTURES
UPSCALER

41. AI ARCHITECTURES
DEEP DREAM

42. AI ARCHITECTURES
STYLE TRANSFER

43. AI ARCHITECTURES
GENERATIVE ADVERSARIAL (GAN)
GENERATOR
DISCRIMINATOR
?

44. AI ARCHITECTURES
RECURSIVE

45. AI ARCHITECTURES
MIX MODALITIES
MEANING
FEATURESIMAGE
AUDIO

46. BONUS
USE RENDERED IMAGES TO TRAIN AI

47. BONUS
TO CLOSE THE LOOP
Assets by FINWARD STUDIOS