IP-Racine presentation of Brainstorm results

1. Brainstorm Multimedia
Improving Digital Filmmaking by
using Virtual Set technology.
by
Hector Viguer
IDIFF 30
Jan 2008

2. Brainstorm Evolution.
• Working Fields:
– VR-Sets for Broadcast
– Presentations.
• High end.
• Stereo.
– Real Time Render Engine.
• Aston.
• Accuweather
– Film Previz.
• R&D IPRacine
• Production - Encodacam.
IDIFF 30
Jan 2008

3. VR SET: BBC 2007.
IDIFF 30
Jan 2008

4. NASDAQ 2006.
IDIFF 30
Jan 2008

5. Brainstorm Evolution.
• 1993 Brainstorm is founded from 2
companies:
– Montesa Graphics: Software development
• Custom made software for TV stations.
• Custom render engine for animations.
– Punto y Chroma: Production House
• 1994: First VR Studio for Television
(Antena3 Spain)
• 1995: First International convention:
NAB
• UP to now selling REAL TIME
graphics solution all over the world.
IDIFF 30
Jan 2008

6. Brainstorm Evolution.
• Film related Projects
– Level 47
– ILM (Artificial intelligence)
– Shadow Projects
– General Lift (Encodacam)
IDIFF 30
Jan 2008

7. Brainstorm Evolution.
• LEVEL 47
– Low budget
– Use Virtual Set Techniques.
– Use of Precalculated VR
environments (Brenders)
– 1997
IDIFF 30
Jan 2008

8. Brainstorm Evolution.
• LEVEL 47, MOVIE CLIP
IDIFF 30
Jan 2008

9. Brainstorm Evolution.
• Industries Light & Magic
– Artificial Intelligence.
– Publications.
– Siggraph.
– 2001
IDIFF 30
Jan 2008

10. ILM.
• Computer Graphics World 2001
IDIFF 30
Jan 2008

11. ILM.
IDIFF 30
Jan 2008

12. ILM.
IDIFF 30
Jan 2008

13. ILM.
• Visual FX
IDIFF 30
Jan 2008

14. ILM.
• AI, MOVIE CLIP
IDIFF 30
Jan 2008

15. Brainstorm Evolution.
• Shadow Projects.
Puppets, puppetiers & VR
– Television: “The Book of Pooh”.
– Film tests:
• Monkey King.
• Sizzling Kung Fu Mice.
IDIFF 30
Jan 2008

16. Shadow Projects.
IDIFF 30
Jan 2008

17. Shadow Projects.
IDIFF 30
Jan 2008

18. Shadow Projects.
IDIFF 30
Jan 2008

19. Shadow Projects.
IDIFF 30
Jan 2008

20. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

21. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

22. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

23. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

24. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

25. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

26. Shadow Projects.
• Monkey King.
IDIFF 30
Jan 2008

27. Shadow Projects.
• MOKEY KING, MOVIE CLIP
IDIFF 30
Jan 2008

28. Shadow Projects.
• Sizzling Kung Fu Mice.
IDIFF 30
Jan 2008

29. Shadow Projects.
• Sizzling Kung Fu Mice.
IDIFF 30
Jan 2008

30. Shadow Projects.
IDIFF 30
Jan 2008

31. Shadow Projects.
IDIFF 30
Jan 2008

32. Brainstorm Evolution.
• General Lift.
– Motion Capture Specialist.
– Joint Development:
• Encodacam.
– Projects:
• Panavision demo.
• I Robot (Vancouver) 2004
• Stealth (Australia) 2005
• Shark Boy and Lava Girl, 2005
• Riddick Chronicles, 2006
• Speed Racer, 2007/2008
IDIFF 30
Jan 2008

33. General Lift.
IDIFF 30
Jan 2008

34. General Lift.
IDIFF 30
Jan 2008

35. General Lift.
• Sizzling Kung Fu Mice.
IDIFF 30
Jan 2008

36. General Lift.
IDIFF 30
Jan 2008

37. General Lift.
• PANAVISION DEMO, MOVIE
IDIFF 30
Jan 2008

38. General Lift.
• I ROBOT
– Vancouver 2004.
– Press Releases
• Cinefex 99
• Cinema UK
• ACS
• Film and Video
• Premiere
• Summer of supervisors
IDIFF 30
Jan 2008

39. General Lift.
IDIFF 30
Jan 2008

40. General Lift.
• I ROBOT
IDIFF 30
Jan 2008

41. General Lift.
• I ROBOT
IDIFF 30
Jan 2008

42. General Lift.
• I ROBOT, MOVIE CLIPS
IDIFF 30
Jan 2008

43. General Lift.
• SHARK BOY AND LAVA GIRL
– 2005
– Movie CLIPS
IDIFF 30
Jan 2008

44. General Lift.
• Riddick Chronicles (2006)
• SPEED RACER (2007)
– Shooting finished
– Nothing can be shown.
– Shortly on the screens.
• FUTURE:
– General Lift working independent from
Brainstorm.
– Superman?
IDIFF 30
Jan 2008

45. VR Set Technology Applied.
• Benefits (I).
– Director can see.
• Choosing the shots.
– Cameramen can Frame.
• Framing with 3D environment.
• Continuing shots over 3D.
– Dailies with low quality 3D.
• Daily preview with CG BG.
IDIFF 30
Jan 2008

46. VR Set Technology Applied.
• Benefits (II).
– Camera tracking position is
recorded.
• No need of Post process tracking
retrieval.
– Only good shots with BG are kept.
IDIFF 30
Jan 2008

47. VR Set Technology Applied.
• CURRENT STATUS.
– IP-RACINE improvements.
– HD Preview is possible.
– Preview quality is growing very fast.
• Due to 3D Graphic cards and games.
– Less Hardware required.
• Shaders technology
• Chromakey using shaders.
IDIFF 30
Jan 2008

48. RealTime PREVIZ
• Current status of Quality.
• SHADERS, MOVIE CLIP
IDIFF 30
Jan 2008

49. FILM - REAL TIME - PREVIZ.
• REAL TIME RENDERING
– SDI and HD rendering in real time.
– Real-time software Chroma-Key for
low quality preview.
• EQUIPMENT & COST REDUCTION
– Off the shelf Graphic Boards:
• Shader technology
• OpenGL optimizations.
• VIRTUAL CAMERA PARAMETERS
SENT TO VIPER CAMERA.
– Embedded as metadata
• LOCAL DATA RECORDING
– Timecode/Camera parameters/Events
data recorder.
– SD SDI video recorder.
IDIFF 30
Jan 2008

50. Original VR FILM DIAGRAM.
IDIFF 30
Jan 2008

51. Improved VR FILM DIAGRAM
SYSTEM WORKFLOW
IDIFF 30
Jan 2008

52. Workflow improvements.
• OnSet Previsualization:
– Cost Reduction:
• Removal of Video Equipment.
• Internal ChromaKey and Delay.
• OnSet PostProcessing.
– HD Clip Playback directly in
Brainstorm.
IDIFF 30
Jan 2008

53. POSTPROCESSING.
• QUASI-REALTIME.
• ON-SET High Quality
Shot Preview.
• Automated Tool.
• Using Shaders:
– Textured Phong Lighting.
– Textured Bump Map
Lighting.
– High quality defocus.
– High quality lighting effects
– Software Chromakey
– Colour Correction
IDIFF 30
Jan 2008

54. VR Set Technology Applied.
• FUTURE.
– Seems promising.
– But is slowly starting to be adopted.
IDIFF 30
Jan 2008