A power point presentation on Blue Eyes Technology.

1. By
M.Ramki

2.  INTRODUCTION
 WHAT IS BLUE EYE TECHNOLOGY?
 HISTORY
 NEED!
 SYSTEM OVERVIEW – DAU & CSU
 TECHNOLOGIES USED
 DATA SECURITY
 PRESENT SCENARIO
 APPLICATIONS
 CONCLUSION
CONTENTS:

3. WHAT IS BLUE EYES TECHNOLOGY?
The BLUE EYES technology aims at creating computational machines that
have perceptual and sensory ability like those of human beings.
It also aims at creating machines that can satisfy the user’s wants and
understands a human’s emotional state.

4. BLUE in the term stands
for Bluetooth, which
enables reliable
wireless
communication.
EYES ,because the eye
movement enables us to
obtain a lot of interesting
and important
information.

5. The research on blue-tooth technology to read human emotions was first
carriedout by scientists at Microsoft using quantum mechanics.
But now currently blue eyes technology is being developed by the team of
40 researchers at Poznan University of Technology. It makes use of the
“blue tooth technology” developed by Ericsson.
History

6. 
To avoid and reduce human errors like:
Tiredness – Huge load of work to be performed by
an individual.
Mental Illness – typical body imbalance.
Emotional outcomes – outrage of emotions like
fear or anger.
Brain Unconsciousness – continuous brain
involvement while long drives or precision
research.
Why Blue Eyes?

7.  To build a machine that can understand
your emotions
 A pc that can listen, talk or interact.
 Verify your identity, feels your presence
and interact with you.
 Adding such perceptual abilities to
computers would enable computers and
humans to work together more as
partners.
Need for Blue Eyes

8. What does blue eyes not do?
Neither predicts nor interferes with
operator’s thoughts like changing the
emotion of the user.
Cannot force the operator to work on
different tasks rather the one at present.

9. How can we make computers “see” and
“feel” ?
Blue eyes uses sensing technology to
identify a user’s actions and to extract key
information from the user.
Information is then analyzed to determine
the user’s physical, emotional, or
informational state.

10. SYSTEM OVERVIEW
Blue eyes system monitors the status of the operator’s visual attention through measurement of saccadic activity.
The system checks parameters like heart beat rate and blood oxygenation against abnormal and triggers user
defined alarms.
• The system consists of
Data Acquisition Unit (DAU)
Central System Unit (CSU)

11. 
DAU FEATURES
• Lightweight
• Runs on batteries - low
power consumption
• Easy to use - does not
disturb the operator
working
• ID cards for operator
authorization
• Voice transmission using
hardware PCM codec
Data Acquisition Unit
Bluetooth
Atmel 89C52
microcontroller
Jazz
Multisensor

12. 
DAU COMPONENTS
 Atmel 89C52 microcontroller -
system core
 Bluetooth module (based on
ROK101008)
 HD44780 - small LCD display
 24C16 - I2C EEPROM (on a
removable ID card)
 MC145483 – 13bit PCM codec
 Jazz Multi sensor interface
 Beeper and LED indicators ,6 AA
batteries and voltage level
monitor.

13. DAU COMPONENTS - Representation

14. 
CSU FEATURES
Connection
management
 Data processing
 Data recording
 Access verification
 System maintenance
Connection
Manager
Data Analysis
Visualization
ModuleBluetooth
Connection
Manager
Data
Logger

15. 
CSU COMPONENTS
CONNECTION MANAGER –
main task to perform low-level blue-tooth
communication
DATA ANALYSIS MODULE –
performs the analysis of the raw sensor data
DATA LOGGER MODULE –
provides support for storing the monitored data.
VISUALIZATION MODULE –
provides user interface for the supervisors

16. Jazz
AT89C52
Microcontroller
Bluetooth
device

17. DAU
small CMOScamera to monitor the operator’s point of gaze
single PCB (SMDtechnology) low voltage ICs
CSU
data mining algorithms, advanceddata- base encryption
using AES standards and othercryptictechniques.
Future Improvements

18. 
TECHNOLOGIES USED
• Emotion Pointing
• Manual And Gaze Input Cascaded (MAGIC)
• Artificial Intelligent Speech Recognition
• Simple User Interest Tracker (SUITOR)

19. THE
DIFFERENT
WAYS ARE-
Facial recognition
Gesture
recognition
Eye tracking Speech recognition
EMOTION
MOUSE

20. 
EMOTION MOUSE
Simplest way
People spend approximately 1/3 of their total
computer time touching input device like mouse
etc..
Physiological data is obtained from the
sensing mouse and emotional state is
determined.
A user model will be built that reflects the
personality or the trait of the user.

21. 

22. SENTIC MOUSE - It is
a modified computer
mouse that includes a
directional pressure
sensor for
aiding in recognition of
emotional valence
EXPRESSION
GLASSES - A wearable
device which allows any
viewer to visualize the
confusion and
interest levels of the
wearer.

23.  Measurement of heart rate, temperature, galvanic
skin response (GSR), general somatic activity.
 Heart rate was measured with chest strap sensor,
temperature with thermocouple attached to a digital
multi-meter (DMM), GSR also with DMM, somatic
movement with computer mouse movements.
 Six basic emotions that were recorded are anger,
fear, sadness, disgust, joy and surprise .
EXPERIMENT

24. 

25. 
SAMPLE OBTAINED FROM EMOTIONAL
MOUSE

26. Happy
Sad
Surprise
Disguise
FACIAL EXPRESSIONS ….!!
Anger

27. BLUE EYE – EMOTIONAL MOUSE
sensors is the mouse which senses the
psychological attributes which are correlated to
emotions using correlation model by simply
touching the mouse, the computer will be able
to determine a person’s emotional state.
BLUE EYE enabled TELEVISION
– could become active when the user makes an
eye contact.
IBM Research

28. 
MAGIC POINTING
Reduce the cursor movement needed
for target selection
Click on the target with a regular
manual input device
Two magic pointing techniques
 Liberal
 Conservative

29. MAGIC pointing is the technique of
tracking eye movement of the user
and perform the desired operation.

30. Eye Detection through infrared rays

31.  To warp the cursor to every
new object the user looks at.
 User takes control of the
target by find and search or
ignore it and search for next.
 “Pro-Active” since cursor
waits on every single
potential target.
 “Over-Active” when user
merely looks at something or
nothing.
Liberal Approach

32.  Does not warp the cursor target
until the manual pointing device is
activated or used.
 Cursor is warped to the gaze area
through eye tracker.
 Steer the cursor towards the target
to acquire it.
 Cursor position is offset to the
intersection of manual activating
vector and the boundary of gaze
area.
Conservative Approach

33. 
Limitations of MAGIC
Unnatural to overload a perceptual with a motor
control task.
The subconscious jittery motion of eyes could not
be actively used as a perceptual device.
Target not selected if not looked at for a specified
period of time.
Unwanted target gets selected if stared at without
user intention.

34. Speech recognition
Scanned input words are matched against
internally stored known words
Slight variations: statistical techniques for
matching process

35.  Input words are scanned and matched against internally
stored words.
 Identification causes some action to be taken.
 User speaks to the computer through microphone.
 Filtered and fed to ADC and then stored in RAM
 Binary representation become standard , against which
future are compared .
 Pattern matching is designed to look for the best fit
because of variations in loudness, pitch, frequency
difference, time gap, etc.
ARTIFICIAL INTELLIGENT
SPEECH RECOGNITION

36. 
 To control weapons by voice commands.
 Pilot give commands to computers by speaking into
microphones.
 For making airline and hotel reservations.
 For making reservations, canceling reservations or
making enquiries.
 Can be connected to word processors and instead of
writing, simply dictate to them.
APPLICATION OF ARTIFICIAL INTELLIGIENT SPEECH
RECOGNITION

37. SUITOR
Help by fetching more information at desktop
Notice where the user’s eyes focus on the screen
Fills a scrolling ticker on a computer screen with information
related to user’s task
Ex. If reading headline ,pops up the story in the browser
window

38. 
DATA SECURITY
Only registered mobile devices can connect
to the system
Bluetooth connection authentication
 Bluetooth connection encryption
 Access rights restrictions
 Personal and physiological data encryption

39. 
BlueEyes® is a conceptual
project that utilizes Bluetooth
technology in a guidance system
for visually impaired in the
“underground” Paris Metro area.
It provides users with mobility
solution information and
assistance suited to public
transport networks, which gives
them autonomy over their routes
known and unknown.
The Present Scenario

40. 
Blue Eyes technology concept can
be used at schools in case of
emergencies like fire accident etc..
The concept can be used at
ATM’s for secure transactions.

41. 
APPLICATIONS
In smart cameras ,lie detectors and emotional speech processing.
Retailing record and interpret customer movements
In automobile industry
In video games
Military
Power station
Flight control centres
Ovens and refrigerators
To create “Face Responsive
Display” and “Perceptive
Environment” Generic control
rooms.

42. 
CONCLUSION
Provides more delicate and user friendly
facilitiesin computingdevices
Gap between the electronic and physical
worldisreduced
The computers can be run using implicit
commandsinsteadof theexplicitcommands
Allows easy multi-tasking by the human
withouttheuse of robots.

44. 
n www.seminar4u.com
n www.howstuffswork.com
n www.cs.put.poznan.com
n www.whitepapers.com
n www.ibmresearchcenter.com
n www.almaden.ibm.com
n www.research.ibm.com
References