1. Garage Overview 2. Stress Wristband 3. Plan a Drilling with Hololens 4. Digital Twin 5. Formula E Virtual Experience 6. Drilling Rig Virtual Experience 7. Virtual Fitting Room 8. Holoportation 9. Making a Virtual Tour with three JS and webGL

1. Best ideas started in
Garages
the heart of innovation

2. 2
• Garage Overview
• Embedded & IoT Experience
• Augmented Reality
• Virtual Reality
• Virtual Fitting Room
• Holoportation
• Making a Virtual Tour with three JS
and WebGL
AGENDA

3. 3
Garage
Overview

4. 4
GARAGE: FROM RESEARCH TO PRODUCTION
EPAM Garage is a separate unit on a leading edge of analysis and research with the focus on
the following activities:
Research new opportunities in design and production of revolutionary
new hardware, firmware, and software
Hardware design and prototyping
Problem-solving in challenging high-technological and knowledge-
based tasks, TRIZ practices. Accelerators creation. Conducting
experiments.
Full cycle of device production from research to fully functional
prototype

5. 5
EPAM GARAGE: PRINCIPLES
We are developing new business
cases for our existing and potential
customers based on most recent
achievements in engineering and
science. We are investigating new
technologies and developing new
expertise.
Research and
development
We are growing talented engineers and inspiring them for
innovations. We are providing environment and support for everyone
who is willing to contribute to our projects.
Opportunities
for everyone
We are working on implementation of
the projects and products related to
strategic directions approved and
validated by management.
Strategic
projects
MAIN DIRECTIONS

6. 6
Embedded
& IoT

7. 7
SMART GREENHOUSE: IOT DEVELOPER
CHALLENGE WINNER
Agriculture in the modern world offers a huge space
for opportunities for using smart devices and other
innovations from the world of the Internet of things
helping to enhance automation and increase
productivity.
EPAM Systems deliver a full-featured, automated,
Smart Greenhouse to grow indoor plants, remotely
controlling and monitoring light, temperature and
humidity, checking growing process remotely with
time-lapse photography. The provided solution also
has electricity failure/outage protection.
During the project implementation, EPAM Systems
significantly contributed to Open Source.
KEY HIGHLIGHTS
• Raspberry PI based hardware platform
• Java based backend and firmware
• Web-based frontend
SOLUTION
The Smart Greenhouse Project is an
Oracle IoT winner 2014 in the
professional category.

8. 8
STRESS WRISTBAND
Stress recognition
Body & ambient
temperature sensors
Accelerometer
Sound recording
Multiple sensors enhancing
detection & probability
Daily history
Cloud service

9. 9
Augmented
Reality

10. 10
AUGMENTED REALITY EXPERIENCE
MICROSOFT HOLOLENS

11. 11
SCHLUMBERGER: DRILLING IN HOLOLENS
CHALLENGE
Develop an application
to visualize oil drilling
process using AR
technology
APPROACH
• Microsoft Hololens
• Unity 3D & C#
RESULT
• Drilling project
visualized as landmass
• Multiuser support for
mixed reality

12. 12
SHLUMBERGER: DRILLING IN HOLOLENS
MULTIUSER PLANNING AND
DRILLING MONITORING
EPAM Systems together with one of the world's leading brands in oil and gas
industry has developed a system that allows to plan and monitor the drilling
in real time directly from the office of the company using mixed reality
technology.

13. 13
Virtual
Reality

14. 14
VIRTUAL REALITY WITH HTC VIVE

15. 15
FORMULA E FOR TELECOM INDUSTRY
CHALLENGE
• The challenge was to create application that
allows watching online translations of
Formula E championships. High quality video
translation, interactive map, position of cars
on a map synchronized with main
translation, additional screens with videos
from driver cockpits or from cameras on a
map. Immersive videos 360 allow to jump
right into the race.
APPROACH
• Unity 3D & HTC VIVE for virtual reality
• Autodesk Maya to work with 3D models
RESULT
• Functional and interactive application for
virtual reality was developed. Application is
ready to be shown to customers and
stakeholders. User of this POC is able to
watch part of translation from Marakesh (7
laps), jump around the luxury room, watch
moving cars on a map and interact with
virtual objects using lasers pointed from VIVE
controllers.

16. 16
Fitting Room

17. 17
FITTING ROOM
Scanning

18. 18
FITTING ROOM
Metrics
Scannedmodel Result Segmentation SmoothingRecognition

19. 19
DESIGN

20. 20

21. 21
DRESSING

22. 22
DRESSING

23. 23
Holoportation

24. 24
HOLOPORTATION

25. 25
HOLOPORTATION
Pepper`s ghost

26. 26
HOLOPORTATION
Reconstruction
Kinect
Depthmap Rgbmap
Reconstructed mesh

27. 27
HOLOPORTATION
Reconstruction
Scanned model Kinect camera

28. 28
Virtual Tour

29. 29
VIRTUAL TOUR
Android & iOS external app

30. 30
VIRTUAL TOUR
Unity3d WebGL

31. 31
VIRTUAL TOUR
Google VR View (js lib)
https://github.com/googlevr/vrview.git
• Works in Browsers (including Mobile
ones)
• Supports panorama view, google
cardboard
• Quick tour creation
- Do not supports Web VR

32. 32
VIRTUAL TOUR
A-frame, React VR (js libs)
https://github.com/aframevr/aframe.git
• Works in Browsers (including Mobile
ones)
• Supports Web VR
- Requires additional development

33. 33
HTC
VIVE

34. 34
HTC VIVE

35. 35
HTC VIVE

36. 36
VIRTUAL TOUR
A-frame, React VRGoogle VR View
• Mobile Browsers, panorama view,
Google cardboard
• Fast development
• Mobile Browsers,, panorama view,
Google cardboard
• Requires development of Virtual
Tour
• Samsung Gear VR — Samsung
Internet
(Only Galaxy mobiles)
• HTC Vive — Firefox Nightly
• Oculus Rift — Firefox Nightly

37. 37
PANORAMA
Panorama 360 Google Camera Cardboard
Nexusnative camera app
Ricohtheta
…

38. 38
XMP METADATA
GImage:Data=“RTb2Z0d2FyZQBiZSBF5ccllPAAA…”

39. 39
3D EFFECT
top - left side
bottom - right side

40. 40
PANORAMA TOOLS
Cardboardcameraconverter Cardboardcameratoolkit

41. 41

42. 42

43. 43
Google VR View Three.js Web GL

44. 44
Three.js
Svg Html5
Canvas
Web GL
THREE.js
• Create Screen
• Create renderer
• Create Camera
• Create 3D Objects (with materials)
Pipeline:
Alternatives:
• GLGE
• SceneJS
• PhiloGL

45. 45
WEB GL
Application Layer
Hardware

46. 46
WEB GL
Application Layer
Hardware
WebGL
OpenGL, DirectX
HAL

47. 47
WEB GL
Application Layer
Hardware
WebGL
OpenGL, DirectX
HAL
Three.js
Browser
Angle

48. 48
epamvrtour.azurewebsites.net

49. 49
Thank you!