for more Information visit the below references.....! http://www.pranavmistry.com/projects/sixthsense/ https://code.google.com/p/sixthsense/wiki/Software Microsoft 2020 technology future vision http://www.youtube.com/watch?v=2wto6SFl13A

1. 1

2. Under the guidance of
Asst.Prof. LAKSHMI BAI G
M.Tech., Dept of CS&E.
RICHARD DES NIEVES M (1CK10CS030)
Kolar - 563101
C. BYREGOWDA INSTITUTE OF
TECHNOLOGY
Presented By
Technical Seminar On
2
SIXTH SENSE TECHNOLOGY

3.  INTRODUCTION
 WHAT IS SIXTH SENSE TECHNOLOGY
 WHAT DOES IT DO
 EVOLUTION OF THE TECHNOLOGY
 SIXTH SENSE OVERVIEW
 SIXTH SENSE PROTOTYPE
 COMPONENTS
 HOW IT WORKS
 HARDWARE SETUP
 SOFTWARE SETUP
 PRESTENT DEVICES
 APPLICATIONS
 ADVANTAGES
 DISADVANTAGES
 FUTURE ENHANCEMENTS
 CONCLUSION
 REFFERENCE
CONTENTS
3

4. INTRODUCTION
 Sixth Sense is a wearable gestural interface
that augments the physical world around us
with digital information.
 Technology that plays with Human gestures
to make the world more interactive and
workflow much easier.
 Pranav Mistry , of Indian origin, a Ph.D
student of Fluid Interfaces Group at the MIT
Media Lab is the mastermind behind the
sixth sense technology.
Pranav Mistry
4

5. WHAT IS SIXTH SENSE
TECHNOLOGY
'Sixth Sense' is a wearable gestural interface
that augments the physical world around us
with digital information and lets us use
natural hand gestures to interact with that
information.
It augments the physical world around us
with digital information and lets us use
natural hand gestures to interact with that
information.
5

6. WHY SIXTH SENSE ?
6

7. WHAT DOES IT DO?
 “Sixth Sense” brings intangible, digital information into
the tangible world, and allows us to interact with this
information via natural hand gestures.
 6thfrees information from its confines, seamlessly
integrating it with reality, thus making the entire world
your computer.
7

8. EVOLUTION OF THE
TECHNOLOGY
8

9. SIXTH SENSE DEVICE
Earlier Devices
9

10. SIXTH SENSE OVERVIEW
 Developed by Pranav Mistry
Research assistant/PhD candidate MIT,USA.
 Portable device that is worn around neck.
 Consists of:
Camera
Colored Markers
Projector
A smart phone
10

11. SIXTH SENSE PROTOTYPE
A Pocket Projector
Projects visual
information to interfaces
like wall, physical
objects.
A Camera Tracks user
hand gestures.
Colored Markers
Movements of fiducials
are interpreted into
gestures.
Mirror
Smart phone
11

12. C A M E R A
 Captures an object in view and tracks the user’s hand
gestures.
 It sends the data to smart phone.
 It acts as a digital eye, connecting you to the world of
digital information.
12

13. P R O J E C T O R
 The projector projects visual information enabling surfaces and
physical objects to be used as interfaces.
 The project itself contains a battery inside, with 3 hours of battery
life.
 A tiny LED projector displays data sent from the smart phone on
any surface in view–object, wall, or person.
13

14. MIRROR
 The usage of the mirror is significant as the projector
dangles pointing downwards from the neck.
14

15. SMART PHONE
 A Web-enabled smart phone in the user’s pocket processes
the video data
 Other software searches the Web and interprets the hand
gestures
15

16. C O L O R M A R K E R S
 It is at the tip of the user’s fingers .
 Marking the user’s fingers with red, yellow, green, and blue tape helps
the webcam recognize gestures.
 The movements and arrangements of these makers are interpreted into
gestures that act as interaction instructions for the projected application
interfaces.
16

17. HARDWARE SETUP
 Mobile:
 Nokia n95 smart phone is used . & it
also supports any smart phones.
 It is multitasking capability.
 Built-in camera provides execution of
both:
 Gesture tracking engine with Gesture
enabled application.
 Projector:
 Pocket projector Pk101 from Optoma
is used. 17

18. Software Setup:
Applications are implemented using JAVA 2MICRO
edition.
Computer vision library is written in symbian c++
(used in Gesture tracking).
The software works on the basis of computer vision
Events & Gestures:
 Events & Gestures are detected using colored markers
attached to fingers.
18

19. Examples Of Hand Gestures
19

20. HOW IT WORKS ?
captureSend for
processing
Reflect on
desired
surfaceProject image
Send
Info
• Images
• Pictures
• Gesture
Info on
surface
20

21. Present Device
21

22. A P P L I C A T I O N S
22

23. Make a call
You can use the Sixth Sense to project a
keypad onto your hand, then use that virtual
keypad to make a call.
Call up a map
With the map application we can call up
the map of our choice and then use thumbs
and index fingers to navigate the map
23

24. Check the time
Draw a circle on your wrist to get
a virtual watch that gives you the
correct time.
Create multimedia reading
experiences
Sixth Sense can be programmed to project
related videos onto newspaper articles you
are reading.
24

25. Drawing application
The drawing application lets the user draw
on any surface by tracking the fingertip
movements of the user’s index finger.
Zooming features
The user can zoom in or zoom out using
intuitive hand movements.
25

26. Get product information
Sixth Sense uses image recognition or
marker technology to recognize products
we pick up, then feeds us information on
those products.
Get book information
The system can project Amazon ratings on
that book, as well as reviews and other
relevant information.
26

27. Take pictures
If you fashion your index fingers
and thumbs into a square
("framing" gesture), the system
will snap a photo.
After taking the desired number of
photos, we can project them onto a
surface, and use gestures to sort
through the photos, and organize
and resize them.
27

28. ADVANTAGES
 Portable
 Support Multi touch and Multi user interaction.
 Cost Effective (350$).
 Data access directly from the machines in real time.
 Mind map the idea anywhere.
 Open Source Software.
28

29. DISADVANTAGES
 Hardware limitations of the devices, that we
currently carry around with us.
 For example many phones will not allow the
external camera feed to be manipulated in real
time.
 Post processing can occur however.
29

30. FUTURE ENHANCEMENTS
 To get rid of color markers.
 To incorporate camera and projector
inside mobile computing device.
 To have 3D gesture tracking.
 To make Sixth Sense work as fifth
Sense for disabled person.
30

31. The Future Technology…
31

32. 32

33. CONCLUSION
 Sixth Sense recognizes the objects
around us, displaying information
automatically and letting us to access it
in any way we need.
 The Sixth Sense prototype implements
several applications that demonstrate
the usefulness, viability and flexibility
of the system.
 Allowing us to interact with this
information via natural hand gestures.
 The potential of becoming the ultimate
"transparent" user interface for
accessing information about everything
around us.
33

34. REFERENCE
 Jasleen Josan ,“SIXTH SENSE TECHNOLOGY”. International Journal of Recent
Advances in Engineering & Technology (IJRAET) ISSN. ISSN (Online): 2347 - 2812,
Volume-1, Issue - 1, October, 2013.
 Abhinav Sharma ,“SIXTH SENSE TECHNOLOGY”. International Journal on Recent
and Innovation Trends in Computing and Communication. ISSN 2321 – 8169 ,IJRITCC |
APR 2013, Avalable @ http://www.ijritcc.org .
 “Basic Principles of Sixth Sense Technology”, Monika Arora / VSRD International
Journal of CS & IT Vol. 2 (8), 2012. VSRD-IJCSIT, Vol. 2 (8), 2012, 687-693.
 http://www.pranavmistry.com/projects/sixthsense/
 https://code.google.com/p/sixthsense/wiki/Software
 Microsoft 2020 technology future vision
http://www.youtube.com/watch?v=2wto6SFl13A.
34

35. Thank You……
Any Queries ??
35