Proceduralism is a powerful language of rules, dependencies and patterns that can generate content indistinguishable from a manually produced one. Yet there are new opportunities that hold a great potential to enhance the existing techniques. In this talk, SEED's Anastasia Opara shares some of the early tests of marrying Proceduralism and Deep Learning and discusses how it can contribute to the current workflows. You can view a recording of the presentation from 2018's Everything Procedural Conference here: https://www.youtube.com/watch?v=dpYwLny0P8M

1. Exploring the Collaboration
between Proceduralism and
Deep Learning

2. About/ what is SEED
S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N
S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N

3. M a s s i v e S c a l e S i n g l e A s s e t S c a l e

11. Feedback image is by Max Berends on the Mirror Scene (Siggraph 2017)

13. Quick!
To the hype-mobile!

15. “Image Style Transfer Using Convolutional Neural Networks,” Gatys et al. 2016.

16. “Artistic style transfer for videos“,
Manuel Ruder, Alexey Dosovitskiy and Thomas Brox, 2016.
https://www.youtube.com/watch?v=Khuj4ASldmU

17. “Deep Dream”, Google, 2015

18. “Image-to-Image Translation with Conditional Adversarial Networks”, Phillip Isola et al., 2017

19. “Image-to-Image Translation with Conditional Adversarial Networks”, Phillip Isola et al., 2017

20. “Phase-Functioned Neural Networks for Character Control”,
Daniel Holden et al., 2017
https://www.youtube.com/watch?v=Ul0Gilv5wvY

21. Experimental Self-Learning AI in Battlefield 1
https://www.youtube.com/watch?v=ZZsSx6kAi6Y

22. SEED – Project PICA PICA
https://www.youtube.com/watch?v=LXo0WdlELJk

29. From Pixar’s “Lifted”

40. input targetoutput
Trained with Pix2Pix (https://github.com/phillipi/pix2pix)

41. XKCD by Randall Munroe: https://xkcd.com/1838/

43. • Procedural data for testing and training
• Neural Nets as a compression mechanism
• Combining multiple hand-crafted networks

44. • Procedural data for testing and training
• Neural Nets as a compression mechanism
• Combining multiple hand-crafted networks

48. How do I learn this stuff?
• Show my learning journey, recommend sources
• Make your Own Neural Network
• Other people’s code
• Papers! Implement it yourselves
• MIT Artificial Intelligence course w Patrick Winston
• KEEP A LEARNING JOURNAL!!!

50. Check out SEED
A n a s t a s i a O p a r a ( @ a n a s t a s i a o p a r a )A n a s t a s i a O p a r a ( @ a n a s t a s i a o p a r a )