vodQA Pune (2019) - Augmented reality overview and testing challenges

1. Augmented Reality Overview and
Testing Challenges
VodQA 2019
By :
Abhay Dalvi and Bhagyashree Waval
16th March 2019

2. 3
SnapChat Selfie
Making selfies Great
through Augmented
reality
SnapChats DOG FILTER.

4. 5
So, What is AR ?

5. VR vs AR vs MR
Source: uxplanet.org

6. Different Types of AR
7

7. Marker Based
Detects trained marker for displaying
AR object on top.
Markers - QR codes, Hiro Images,
different patterns.

8. Markerless
Enables enhanced view of real
environment.

9. Location Based
Enables enhanced view of real
environment.
● Primarily relies on GPS,
accelerometer, digital
compass to identify phone's
location and position with the
high level of accuracy

10. Leveraging AR in
Industries
1
1

11. Medical - Microsoft Hololens
Markerless ARSource: https://www.youtube.com/channel/UCT2rZIAL-zNqeK1OmLLUa6g

12. Medical - Accuvein
Markerless ARSource: https://www.accuvein.com/why-accuvein/ar/

13. Travel - Gatwick Airport App
Location based AR

14. Retail - Ikea Place App
Marker based ARSource: https://youtu.be/vDNzTasuYEw

15. Retail - Rolex - Try on experience
Markerless ARSource:https://www.instagram.com/p/BimWBrNDVvTNXV3440A-
W7K7AWzZrdjtyrqaWo0/?taken-by=bernard.marr

16. Education - Google Sky Map
Location based ARSource: https://www.youtube.com/watch?v=p6znyx0gjb4

17. Education - Augthat!
Markerless ARSource: https://www.youtube.com/watch?v=kg3CcaAgnUM&t

18. Why is AR in Mobile
Browsers ?
1
9

19. Marker based AR on Web

20. Markerless AR on Web
● SLAM engine
● Develop application using
Aframe or ThreeJS
● Supports Android and
iPhone
● Demo

21. Markerless AR on Web

22. Markerless AR on Web
● Runs on Chrome
Canary

23. Testing Aspects
2
5

24. Traditional UI Testing vs AR
Testing ?

25. User
Experience

26. Some Fundamental
Aspects of User Experience
Testing...
2
8

27. 2
9
Motion tracking
● Uses feature points to
compute its change in
location.
● Anchor point testing to
ensure that it tracks the
object's position over
time

28. 3
0
Environmental Understanding
● Plane - where object can
be placed
● Size of real world objects
● Borders
● Animation

29. 3
1
Lightning Estimations
● Objects do not
carry a light source
with them
wherever they go.
● They are lit by
external light
sources

30. 3
2
Response and familiar gestures
● Hit Test to take an
(x,y) coordinate
corresponding to
the phone's screen

31. Requires Better Test
Planning and
Arrangements
Because ...
3
3

32. Real Environment
User(s) and Behavior
Devices and Software
More Time Consuming

33. 3
5
Inconsistent Behavior
● Number and
Arrangement of
feature points
doesn't remain
stable

34. 3
6
No Simulator Support
No Camera view, Gyroscope,
Accelerometer

35. 3
7
Evolving H/W and S/W Support
iPhone 6s and later
v 12.0 and above
Android 8
v 70 - 72
iOS 12 and aboveOS Version
Device
Browser
Other s/w
Pixel,Nexus and other
ARkit

36. Performance ...
3
8

37. 3
9
Polygon counts / Triangles

38. Testing tools
● Chromecast
● Instant preview
4
0

39. 4
1
Airtest
Source: https://airtest.netease.com/docs/en/3_faq/airtest_poco_faqs.html

40. 4
2
Poco
Source: https://airtest.netease.com/docs/en/3_faq/airtest_poco_faqs.html

41. 4
3

42. THANK YOU
Abhay Dalvi
abhayda@thoughtworks.com
Bhagyashree Waval
bhagyaw@thoughtworks.com