The document describes Sixth Sense technology, a wearable gestural interface created by Pranav Mistry. It consists of a camera, projector, mirror, mobile device, and colored markers. The camera tracks hand movements and objects, the projector augments physical environments with projected interfaces, and the mobile device acts as the processing unit. Some applications include checking the time, making calls, taking photos, and getting flight updates through gestures. While portable and low-cost, it has limitations from device hardware and requires correct gestures. The source code was released open source to further develop this technology that connects the physical and digital world through gestures.

1. SIXTH SENSE TECHNOLOGY
PRSENTED BY:
ANJALI S. PATIL

2. CONTENTS
• INTRODUCTION
• WHAT IS SIXTH SENSETECHNOLOGY?
• COMPONENTS
• HOW IT WORKS
• HARDWARE & SOFTWARE SETUP
• PRESENT DEVICES
• APPLICATIONS
• ADVANTAGES
• DISADVANTAGES
• FUTURE ENHANCEMENTS
• CONCLUSION

3. INTRODUCTION
 Sixth sense is a wearable gestural
interface that connect the
physical world around us with
digital information.
 Technology that plays with human
gestures to make the world more
interactive & workflow much
easier.
 Pranav Mistry, of Indian origin, a
Ph.D. student of fluid interfaces
group at the MIT Media Lab is the
mastermind behind the sixth
sense technology

4. WHAT IS THE SIXTH SENSE
TECHNOLOGY?
THE 5 SENSES
Here comes
the sixth sense

5. COMPONENTS
The Main Components:
 Camera
 Projector
 Mirror
 Mobile
 Colored Markers

6. CAMERA
 Captures user’s hand movements
and gestures (used in
reorganization of user gestures)
 Captures the scene in front and
objects the user is interacting with
(used in object reorganization and
tracking)
 Takes a photo of the scene in front
when the user performs a ‘framing’
gesture

7. PROJECTOR
 Projects graphical user interface
of the selected application onto
surfaces or walls in front.
 Augments the physical objects
the user interacting with by
projecting just-in-time and
related information from the
Internet.

8. MIRROR
 The mirror reflects the projection coming out from the
projector and thus helps in projecting onto the desired
locations on walls or surfaces.
MICROPHONE
 The microphone is an optional component of the Sixth
Sense. It is required when using a paper as a computing
interface. When the user wants to use a sheet of paper as
an interactive surface, he or she clips the microphone to
the paper.

9. MOBILE COMPUTING DEVICES
• The Sixth Sense system uses a
mobile computing device in user’s
pocket as the processing device.
• The software program enabling all
the features of the system runs on
this computing device.
• This device can be a mobile phone
or a small laptop computer

10. COLOR MARKERS
 It is at the tip of the user’s fingers .
 Marking the user’s fingers with red,
yellow, green, and blue tape helps
the webcam recognize gestures
 The movements and arrangements
of these makers are interpreted into
gestures that act as interaction
instructions for the projected
application interfaces

11. SOFTWARE & HARDWARE
• Computer vision library is written Symbian C++ (used
in gesture tracking).
• Multi touch gesture
• Free hand gesture
• Iconic gesture
HARDWARE:
 Smart phone
 Projector
 camera
SOFTWARE:

12. WORKING PRINCIPLE

13. APPLICATION
Check the time Make a call
Take a photo Get flight update

14. ADVANTAGES
• Portable.
• Support multi touch & multi user interaction.
• Cost effective(350$).
• Data access directly from the machines in real time.
• Mind map the idea anywhere.
• Open source software

15. disadvantages
 Hardware limitations of the devices, that we
currently carry around with us.
 The projector runs on the batteries for power
where regularly have to replace
 We have to give correct instruction.

16. conclusion
• Sixth sense is a wearable hi-tech device
• Sixth Sense prototypes cost approximately $350 to
build (not including the computer), the main cost
being the micro-projector.
• This technology make our world @ fingertip, it is
your third eye, digital eye, connecting you to the
digital world of information.
• Mistry had announced in Nov 2009 that the source
code will be released with an open source license.

17. • "WUW - wear Ur world: a wearable gestural interface",
Proceedings of CHI EA '09 Extended Abstracts on Human
Factors in Computing Systems Pages 4111-4116, ACM
New York, NY, USA
• MIT Media Lab Technical Report 260, December 1994
• Pattie Maes + Pranav Mistry: Meet the SixthSense
interaction | Video on. Ted.com. Retrieved on 2013-12-
09.
References