SlideShare ist ein Scribd-Unternehmen logo
1 von 74
Wave to Me: User Identification Using
Body Lengths and Natural Gestures
Eiji Hayashi
Manuel Maas
Jason Hong
Human-Computer Interaction Institute
Carnegie Mellon University
Slick user identification
Slick user identification
with reasonable security
Gesture
EachDifferent Gesture for user
AllSame Gesture for user
11
97% accurate
System
Lab Study 1 (Basic Evals)
Lab study 2 (Long-term Eval)
Field Study
System
Lab Study 1 (Basic Evals)
Lab study 2 (Long-term Eval)
Field Study
Body-based
User Identification
Overview
Body-based
User Identification
Registration
Body-based
User Identification
Registration
Identification
Body-based
User Identification
Registration
Identification
User ID
Reject
Kinect
Kinect
Kinect
Joint
Positions
Kinect
Feature
Extraction
Joint
Positions
Kinect
Feature
Extraction
Physiological
17 body segment
lengths
Kinect
Feature
Extraction
Physiological
17 body segment
lengths
Behavioral
26 movement
properties
Kinect
Feature
Extraction
43 Features
Kinect
Feature
Extraction
Feature Vector
Kinect
Feature
Extraction
SVM
Feature Vector
Kinect
Feature
Extraction
SVM Pre-Recorded
Data
Feature Vector
Kinect
Feature
Extraction
SVM Pre-Recorded
Data
User ID + Confidence
Kinect
Feature
Extraction
SVM
Threshold
Pre-Recorded
Data
User ID + Confidence
Kinect
Feature
Extraction
SVM
Threshold
Pre-Recorded
Data
User ID or Reject
Errors
False Acceptance Rate (FAR)
Accept others as a registered user
False Rejection Rate (FRR)
Reject a registered user as others
Errors
False Acceptance Rate (FAR)
Accept others as a registered user
False Rejection Rate (FRR)
Reject a registered user as others
Equal Error Rate (EER)
FAR = FRR = EER
Errors
False Acceptance Rate (FAR)
Accept others as a registered user
False Rejection Rate (FRR)
Reject a registered user as others
Equal Error Rate (EER)
FAR = FRR = EER
Accuracy = 1 – 2 x EER
Assumption
There are 7 registered users in our system
Assumption
There are 7 registered users in our system
Make comparison among studies easy
Assumption
There are 7 registered users in our system
Make comparison among studies easy
Be reasonable for home use
Assumption
There are 7 registered users in our system
Choose 10,000 combination of 7 participants
Calculate EER over them
System
Lab Study 1 (Basic Evals)
Lab study 2 (Long-term Eval)
Field Study
Gestures
Hand Waving
Come-Over
One Hand Raised
Making a Phone Call
Data Collection
Hand Waving
Come-Over
One Hand Raised
Phone Call
Gesture
Data Collection
Hand Waving
Come-Over
One Hand Raised
Phone Call
Standing
Sitting
Gesture Posture
Data Collection
Hand Waving
Come-Over
One Hand Raised
Phone Call
Standing
Sitting
1st Day
3 days later
Gesture Posture Session
Data Collection
Hand Waving
Come-Over
One Hand Raised
Phone Call
Standing
Sitting
1st Day
3 days later
Gesture Posture Session
10
Data Collection
Hand Waving
Come-Over
One Hand Raised
Phone Call
Standing
Sitting
1st Day
3 days later
Gesture Posture Session
10
160 / participants
Participants
36 participants
14 males / 22 females
19 – 64 years old
168cm (SD=10.2)
78.0 kg (SD=22.0)
Gestures
Hand Waving
Come-Over
One Hand Raised
Making a Phone Call
Using Either Gesture or Lengths
Same day & posture
3 days later
Different Posture
Same day & posture
3 days later
Different Posture
Gesture Body Lengths
EER [%]
Using Either Gesture or Lengths
Same day & posture
3 days later
Different Posture
Same day & posture
3 days later
Different Posture
Gesture Body Lengths
EER [%]
2.1%
0.5%
Using Either Gesture or Lengths
Same day & posture
3 days later
Different Posture
Same day & posture
3 days later
Different Posture
Gesture Body Lengths
EER [%]
11.8%
19.8%
Using Either Gesture or Lengths
Same day & posture
3 days later
Different Posture
Same day & posture
3 days later
Different Posture
Gesture Body Lengths
EER [%]
10.0%
41.5%
Using Both Gesture and Lengths
3 days later
3 days later
Gesture Body Lengths
EER [%]
Both
3 days later (Standing)
3 days later (Sitting)
4.3%
6.2%
System
Lab Study 1 (Basic Evals)
Lab study 2 (Long-term Eval)
Field Study
Data Collection
Hand Waving
Standing
Sitting
1st Day
3 days later
1 week later
2 weeks later
Gesture Posture Session
10
80 / participants
Participants
27 participants
20 males / 7 females
19 – 62 years old
173cm (SD=9.8)
75.1 kg (SD=21.1)
Long term StabilityEER[%]
Days
Long term StabilityEER[%]
Days
Sitting
Standing
Long term StabilityEER[%]
Days
Stable after the 3rd session
Training with 2 sessionsEER[%]
Days
Training with 2 sessionsEER[%]
Days
Sitting
Standing
Training with 2 sessionsEER[%]
Days
EER < 1%
System
Lab Study 1 (Basic Evals)
Lab study 2 (Long-term Eval)
Field Study
Does it Work at Homes?
• Collected data at participants’ living rooms
• Placed a Kinect on a TV
• Asked participant to behave as usual
– Stand where you feel reasonable
– Sit as you normally do in a living room
Participants
12 participants (5 house hold)
5 males / 7 females
18 – 42 years old
159.5cm (SD=11.4)
56.9 kg (SD=6.9)
It Worked!
EER [%]
Standing
Sitting
Standing
Sitting
Lab Study 2 Field Study
Implication
Recognizing a gesture
Recognizing a gesture AND a user’s identity
• Natural gestures + body lengths
• 2 seconds of hand waving gesture
Conclusion
Gesture
Body Lengths
Proposed Scheme
EER [%]
Wave to Me: User Identification Using
Body Lengths and Natural Gestures
Eiji Hayashi
ehayashi@cs.cmu.edu
www.cs.cmu.edu/~ehayashi/
Human-Computer Interaction Institute
Carnegie Mellon University
Backup slides
# of Registered UsersEER[%]
# of Registered Users
# of Registered UsersEER[%]
# of Registered Users
2.8%
2.3%
N=25
Open Questions
Getting worse constantly?
Training with two sessions?
Data Collection
Hand Waving
Standing
Sitting
1st Session
2nd Session
3rd Session
Gesture Posture Session
10
60 / participants
Yet Another Open Question
Does it actually work at home?

Weitere ähnliche Inhalte

Ähnlich wie Wave to Me: User Identification Using Body Lengths and Natural Gestures, at CHI 2014

Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
InsideScientific
 
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematicsDoes-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
Jack Hebron
 
Effect of Sit To Sit And Activity On Forward Bending Test
Effect of Sit To Sit And Activity On Forward Bending TestEffect of Sit To Sit And Activity On Forward Bending Test
Effect of Sit To Sit And Activity On Forward Bending Test
Apeksha Besekar
 
Introduction 1 pageConclusion 1 page Fix the format, spelling .docx
Introduction 1 pageConclusion 1 page Fix the format, spelling .docxIntroduction 1 pageConclusion 1 page Fix the format, spelling .docx
Introduction 1 pageConclusion 1 page Fix the format, spelling .docx
normanibarber20063
 
Retroalimentacion visual sobre rendiemiento
Retroalimentacion visual sobre rendiemientoRetroalimentacion visual sobre rendiemiento
Retroalimentacion visual sobre rendiemiento
Sisercom SAC
 
Efectos de retroaluimentacion
Efectos de retroaluimentacionEfectos de retroaluimentacion
Efectos de retroaluimentacion
Sisercom SAC
 

Ähnlich wie Wave to Me: User Identification Using Body Lengths and Natural Gestures, at CHI 2014 (20)

Place Cell Mapping and Stress Monitoring in Head-Fixed Mice Navigating an Air...
Place Cell Mapping and Stress Monitoring in Head-Fixed Mice Navigating an Air...Place Cell Mapping and Stress Monitoring in Head-Fixed Mice Navigating an Air...
Place Cell Mapping and Stress Monitoring in Head-Fixed Mice Navigating an Air...
 
Motor control Assessment
Motor control AssessmentMotor control Assessment
Motor control Assessment
 
HI-POCT Conference Paper
HI-POCT Conference PaperHI-POCT Conference Paper
HI-POCT Conference Paper
 
Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
Lessons From The Core: Longitudinal Assessment vs. Point Sampling of Behavior...
 
Research Poster
Research Poster Research Poster
Research Poster
 
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
 
Técnica de elongaciones (Streching) en los procesos de rehabilitación. Dra. D...
Técnica de elongaciones (Streching) en los procesos de rehabilitación. Dra. D...Técnica de elongaciones (Streching) en los procesos de rehabilitación. Dra. D...
Técnica de elongaciones (Streching) en los procesos de rehabilitación. Dra. D...
 
Wearable Accelerometer Optimal Positions for Human Motion Recognition(LifeTec...
Wearable Accelerometer Optimal Positions for Human Motion Recognition(LifeTec...Wearable Accelerometer Optimal Positions for Human Motion Recognition(LifeTec...
Wearable Accelerometer Optimal Positions for Human Motion Recognition(LifeTec...
 
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematicsDoes-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
Does-tester-experience-affect-the-reliability-of-multi-segment-foot-kinematics
 
Experiences of a Quantified Self
Experiences of a Quantified SelfExperiences of a Quantified Self
Experiences of a Quantified Self
 
Trunk muscles activation in different sitting postures during abdominal hollo...
Trunk muscles activation in different sitting postures during abdominal hollo...Trunk muscles activation in different sitting postures during abdominal hollo...
Trunk muscles activation in different sitting postures during abdominal hollo...
 
CIMT presentation for APCP
CIMT presentation for APCPCIMT presentation for APCP
CIMT presentation for APCP
 
11.man and machine the measurement of range of movement of the wrist
11.man and machine the measurement of range of movement of the wrist11.man and machine the measurement of range of movement of the wrist
11.man and machine the measurement of range of movement of the wrist
 
Tecnologías que mejoran el resultado en el proceso de rehabilitación de perso...
Tecnologías que mejoran el resultado en el proceso de rehabilitación de perso...Tecnologías que mejoran el resultado en el proceso de rehabilitación de perso...
Tecnologías que mejoran el resultado en el proceso de rehabilitación de perso...
 
An Evaluation of the Leap Motion Depth Sensing Camera for Tracking Hand and F...
An Evaluation of the Leap Motion Depth Sensing Camera for Tracking Hand and F...An Evaluation of the Leap Motion Depth Sensing Camera for Tracking Hand and F...
An Evaluation of the Leap Motion Depth Sensing Camera for Tracking Hand and F...
 
Effect of Sit To Sit And Activity On Forward Bending Test
Effect of Sit To Sit And Activity On Forward Bending TestEffect of Sit To Sit And Activity On Forward Bending Test
Effect of Sit To Sit And Activity On Forward Bending Test
 
Introduction 1 pageConclusion 1 page Fix the format, spelling .docx
Introduction 1 pageConclusion 1 page Fix the format, spelling .docxIntroduction 1 pageConclusion 1 page Fix the format, spelling .docx
Introduction 1 pageConclusion 1 page Fix the format, spelling .docx
 
Retroalimentacion visual sobre rendiemiento
Retroalimentacion visual sobre rendiemientoRetroalimentacion visual sobre rendiemiento
Retroalimentacion visual sobre rendiemiento
 
Efectos de retroaluimentacion
Efectos de retroaluimentacionEfectos de retroaluimentacion
Efectos de retroaluimentacion
 

Kürzlich hochgeladen

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

Wave to Me: User Identification Using Body Lengths and Natural Gestures, at CHI 2014