3. INTRODUCTION
Sixth Sense is a wearable gesture interface that augments the
physical worlds around us with digital information and lets us use
natural hand gestures to interact with that information.
It was developed by PRANAV MISTRY, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab.
Sixth Sense bridges the gap by bringing intangible digital
information out into the tangible world, and allowing us to interact
with this information via natural hand
Sixth Sense comprises of a Pocket projector, a mirror and a
camera. The hardware components are coupled in a pendant
like mobile wearable device.
4. Origin of Sixth Sense Technology
The idea of Sixth Sense Technology was first developed
in 1997 at MIT Media Lab by Steve Mann, as a head
worn device. In 1998, it was made into an neck worn
device.
The name Sixth Sense was coined and published in
2001.
Mann referred to this wearable computing technology
as affording a "Synthetic Synesthesia of the Sixth Sense",
believing that wearable computing and digital
information could act in addition to the five traditional
senses.
Later this idea was taken by Pranav Mistry who built on
the concept of the Telepointer, a neck worn projector
and camera combination.
Steve Mann
Pranav Mistry
5. WHY SIXTH SENSE TECHNOLOGY?
As we know and see by the picture here...
The five traditional Senses are: EYES, NOSE, TONGUE, EAR and SENSES.
The sixth sense added now is the PENDANT like MOBILE WEARABLE DEVICE.
The answer to WHY sixth sense technology is nothing more that a single line which is that:-
“SIXTH SENSE IS ALL ABOUT MAKING THE TECHNOLOGY MORE HUMAN”
6. COMPONENTS
The hardware components
are arranged in a PENDANT
like MOBILE WEARABLE
DEVICE.
The hardware components
are as follows:-
1. CAMERA
2. PROJECTOR
3. MIRROR
4. SMART PHONE
5. COLOUR MARKERS
7. 1. CAMERA
The camera recognizes and tracks
users' hand gestures and physical
objects using computer-vision based
techniques.
It sends the data to the smart phone.
Thus, a camera acts as a digital eye
connecting us to the world of digital
communication.
8. 2. PROJECTOR
The projector projects visual information
enabling surfaces and physical objects to be
used as interfaces.
It itself contains a battery inside with 3
hours of battery life.
A tiny LED projector displays data sent
from the smart phone on any surface in view
i.e. Object, wall, or person.
9. 3. MIRROR
The projector dangles
pointing downwards from
the neck so the usage of
mirror is significant.
It basically inverts and
helps the projector to
project the image erected.
10. 4. SMART PHONE
A Web-enabled smart
phone in the user’s
pocket processes the
video data.
Other software searches
the web and interprets
the hand gestures.
11. 5. COLOUR MARKERS
These markers are present at the tip of the
user’s fingers.
Marking the user’s fingers with RED,
YELLOW, GREEN AND BLUE tape helps the
the web camera recognize gestures.
The movements and arrangements of these
markers are interpreted into gestures that act
as interaction instructions for the projected
application interfaces.
14. APPLICATIONS OF SIXTH SENSE TECHNOLOGY
Some applications are
discussed below:
oMAKE A CALL
oCALL UP A MAP
oCHECK TIME
oCREATE
MULTIMEDIA
READING
EXPERIENCES
oZOOMING FEATURES
15. The SixthSense can be
used to project the
keypad (as on a phone)
onto our hand and then
make a call through the
virtual keypad.
16. With this application
we can call up the map
of our choice and then
use the thumb and
index fingers to
navigate through the
map.
17. By this application we can
get to check time by
drawing a circle on our
wrist. This makes us get a
virtual watch which gives
us the correct time.
18. Sixth sense can be
programmed to project
related videos onto
newspaper articles
being read.
20. If we fashion our index fingers and
thumbs into a square(“FRAMING”
gesture) , the system will snap a photo.
After taking a desired number of photos,
we can project them onto a surface and
use gestures to sort through the photos
and organize and resize them.
Index fingers and thumbs in
square(“framing” gesture)
23. CONCLUSION
→ Sixth sense recognizes the objects around us,
displaying the information automatically and letting us
access in any way we need.
→Sixth Sense prototype implements several
applications that demonstrate the usefulness,
viability and flexibility of the system.
→Allows us to interact with the information by
hand gestures.
→It has the potential of becoming the ultimate
“transparent user interface” for accessing
information about everything around us.