SlideShare ist ein Scribd-Unternehmen logo
1 von 30
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
07/02/2013
Jacob A. Hasselgren, Stephen J. Elliott, Jue Gue
TRADEOFF BETWEEN
IMPRESSION NUMBERS
AND ATTEMPT NUMBERS
AGENDA
• Introduction
• Methodology
• Results
• Lessons learned
• Next steps
INTRODUCTION
• Many factors can impact the
performance of a biometric system from
poor quality data [1]:
– Skin conditions [2]
– HBSI [3]
– Associated meta-data [4]
• Collect appropriate data and minimize
time/error
MOTIVATION
• The efficiency of a biometric system is
important
• While investigating habituation of
biometric systems, the issue of the
proper number of impressions collected
and time arose
MOTIVATION
• We collect everyday – at what point do
you stop collecting from a subject?
– 3 samples?
– 6 samples?
– 9 samples?
• We cannot keep subjects forever due to
time and costs
MOTIVATION
• Number of subjects is important
• Must design protocol to keep costs low
while still processing as many subjects
as possible
• How many impressions should be
collected from each subject?
• How many attempts should be allowed?
• Which fingers should be collected?
QUESTIONS
• Are some fingers harder to collect?
– Do some take longer?
• Is the image quality of the first three any
different from the last three?
• Does the performance change when
slicing groups taken from subjects?
– ie. Do the first three impressions match well
against the last three impressions of the
same subject?
DATA
• Collection of multimodal
samples
• Only data from one
fingerprint sensor is be
used for analysis
• U.are.U 4500
• Taken from ongoing aging study in the
BSPA Labs
DEFINITIONS
Term Meaning
SAS Successfully acquired sample,
synonymous with impression
Impression number Number given to each SAS, ranging
from 1-6
Interaction attempt number Number given to each interaction
attempt, whether it results in success
or failure, ranging from 1-18
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
METHODOLOGY
METHODOLOGY
• 6 impressions/SAS were taken on each
finger with a maximum of 18 interaction
attempts to do so
• Fingers used:
– Left index
– Left middle
– Right index
– Right middle
METHODOLOGY
• An impression number was given to
each SAS in order for each finger
– Six impressions per finger, impression
numbers range 1-6
• An interaction attempt number was given
to each interaction attempt in order for
each finger
– Max of 18 interaction attempts was given to
submit 6 SAS’s, intearction attempt numbers
range 1-18
METHODOLOGY
• A number of approaches were used to
analyze the samples
– An analysis of the number of attempts
required for each finger
– Compare quality scores between designated
groups (first three, last three)
– Compare matching rates between same
designated groups
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
RESULTS
NUMBER OF INTERACTION
ATTEMPTS
• A comparison of the number of SAS’s to
the number of interaction attempts was
performed
• Each subjects submitted six SAS’s
• Did any given finger require more
interaction attempts than others?
NUMBER OF ATTEMPTS
NUMBER OF ATTEMPTS
• No significant difference between the
fingers was found
• The right middle finger seems to have
the most interaction attempts of all of the
fingers collected
– As well as the most variance
DISTRIBUTION OF QUALITY
• A comparison of the first three collected
samples for any given finger to the last
three was performed to find differences
in image quality
DISTRIBUTION OF QUALITY
• All of the samples were pushed through
a quality scoring algorithm, Aware WSQ
1000
• Scores a number of different metrics,
with an overall quality score
• This overall quality score was used in the
following analysis
DISTRIBUTION OF QUALITY
DISTRIBUTION OF QUALITY
• A one-way ANOVA was used to compare
the first three SAS to the last three
• No finger showed a significant difference
Finger P-Value
RI 0.155
RM 0.460
LI 0.090
LM 0.050
MATCHING PERFORMANCE
• A comparison of the first three collected
samples for any given finger to the last
three was performed to find differences
in matching performance
MATCHING PERFORMANCE
• The samples were enrolled into a
minutiae-based matching
software, Megamatcher 4.3
• The first three SAS’s and last three
SAS’s were enrolled separately
• Equal error rates were used for results
MATCHING PERFORMANCE
Finger First 3 vs First 3 Last 3 vs. Last 3 First 3 vs. Last 3
LI 0.0000 0.0000 0.0006
LM 0.3322 0.0000 0.1282
RI 0.0000 0.0000 0.0000
RM 0.0000 0.0000 0.0000
MATCHING PERFORMANCE
• No improvements were noticed in
performance for any fingers except for
left middle
– The EER improves from .3322 to .0000
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
LESSONS LEARNED
LESSONS LEARNED
• No issues were found when comparing
the number of interactions attempts
between fingers
– Though, right middle finger may require
more attempts to collect impressions
• To save time and unnecessary costs, it
may not be practical to collect additional
samples
– No significant improvement was found after
collecting three additional samples
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
NEXT STEPS
NEXT STEPS
• Replicate this study on more sensors
• Attempt to observe habituation using
more than one visit
– Observe effect of habituation on attempt
numbers
• Include time-on-task to get a true
estimation on time required to collect
SAS
• Include hand dominance in interaction
attempts
BIOMETRICS LAB
Biometric Standards, Performance and Assurance Laboratory
Department of Technology, Leadership and Innovation
QUESTIONS?
jahassel@purdue.edu

Weitere ähnliche Inhalte

Ähnlich wie (2013) Trade-off Between Impression Numbers and Attempt Numbers

Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...Gabor Szabo, CQE
 
Planning of experiment in industrial research
Planning of experiment in industrial researchPlanning of experiment in industrial research
Planning of experiment in industrial researchpbbharate
 
Bad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph OursBad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph OursQA or the Highway
 
How much testing is enough
How much testing is enoughHow much testing is enough
How much testing is enoughReti Yulvenia
 
Countries’ presentation on internal quality control: Sri Lanka
Countries’ presentation on internal quality control: Sri LankaCountries’ presentation on internal quality control: Sri Lanka
Countries’ presentation on internal quality control: Sri LankaExternalEvents
 
Audit Sampling. Murodullo Turdiyev.pptx
Audit Sampling. Murodullo Turdiyev.pptxAudit Sampling. Murodullo Turdiyev.pptx
Audit Sampling. Murodullo Turdiyev.pptxJanobHechkim1
 
How predictive models help Medicinal Chemists design better drugs_webinar
How predictive models help Medicinal Chemists design better drugs_webinarHow predictive models help Medicinal Chemists design better drugs_webinar
How predictive models help Medicinal Chemists design better drugs_webinarAnn-Marie Roche
 
Practical application of simulation models at Careggi university hospital
Practical application of simulation models at Careggi university hospitalPractical application of simulation models at Careggi university hospital
Practical application of simulation models at Careggi university hospitalDecision Science Community
 
Training on the topic MSA as per new RevAF.pptx
Training on the topic MSA as per new RevAF.pptxTraining on the topic MSA as per new RevAF.pptx
Training on the topic MSA as per new RevAF.pptxSantoshKale31
 
Shyam presentation prefinal
Shyam presentation prefinalShyam presentation prefinal
Shyam presentation prefinalShyam Raj
 
Design of experiments
Design of experimentsDesign of experiments
Design of experimentsUpendra K
 
Bab 1 Fundamentals Of Testing
Bab 1 Fundamentals Of TestingBab 1 Fundamentals Of Testing
Bab 1 Fundamentals Of Testinglolayoriva
 
Testing Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de testsTesting Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de testsHervKoya
 

Ähnlich wie (2013) Trade-off Between Impression Numbers and Attempt Numbers (20)

Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
 
Planning of experiment in industrial research
Planning of experiment in industrial researchPlanning of experiment in industrial research
Planning of experiment in industrial research
 
Bad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph OursBad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph Ours
 
Bad metric, bad!
Bad metric, bad!Bad metric, bad!
Bad metric, bad!
 
Overview of statistical tests: Data handling and data quality (Part II)
Overview of statistical tests: Data handling and data quality (Part II)Overview of statistical tests: Data handling and data quality (Part II)
Overview of statistical tests: Data handling and data quality (Part II)
 
How much testing is enough
How much testing is enoughHow much testing is enough
How much testing is enough
 
Countries’ presentation on internal quality control: Sri Lanka
Countries’ presentation on internal quality control: Sri LankaCountries’ presentation on internal quality control: Sri Lanka
Countries’ presentation on internal quality control: Sri Lanka
 
Design of Experiments
Design of ExperimentsDesign of Experiments
Design of Experiments
 
MSA (GR&R)
MSA (GR&R)MSA (GR&R)
MSA (GR&R)
 
Audit Sampling. Murodullo Turdiyev.pptx
Audit Sampling. Murodullo Turdiyev.pptxAudit Sampling. Murodullo Turdiyev.pptx
Audit Sampling. Murodullo Turdiyev.pptx
 
How predictive models help Medicinal Chemists design better drugs_webinar
How predictive models help Medicinal Chemists design better drugs_webinarHow predictive models help Medicinal Chemists design better drugs_webinar
How predictive models help Medicinal Chemists design better drugs_webinar
 
Practical application of simulation models at Careggi university hospital
Practical application of simulation models at Careggi university hospitalPractical application of simulation models at Careggi university hospital
Practical application of simulation models at Careggi university hospital
 
Data quality: total survey error
Data quality: total survey errorData quality: total survey error
Data quality: total survey error
 
Session 3 sample design
Session 3   sample designSession 3   sample design
Session 3 sample design
 
Training on the topic MSA as per new RevAF.pptx
Training on the topic MSA as per new RevAF.pptxTraining on the topic MSA as per new RevAF.pptx
Training on the topic MSA as per new RevAF.pptx
 
Bad Metric, Bad!
Bad Metric, Bad!Bad Metric, Bad!
Bad Metric, Bad!
 
Shyam presentation prefinal
Shyam presentation prefinalShyam presentation prefinal
Shyam presentation prefinal
 
Design of experiments
Design of experimentsDesign of experiments
Design of experiments
 
Bab 1 Fundamentals Of Testing
Bab 1 Fundamentals Of TestingBab 1 Fundamentals Of Testing
Bab 1 Fundamentals Of Testing
 
Testing Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de testsTesting Metrics and Tools, Analyse de tests
Testing Metrics and Tools, Analyse de tests
 

Mehr von International Center for Biometric Research

An Investigation into Biometric Signature Capture Device Performance and User...
An Investigation into Biometric Signature Capture Device Performance and User...An Investigation into Biometric Signature Capture Device Performance and User...
An Investigation into Biometric Signature Capture Device Performance and User...International Center for Biometric Research
 
Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...International Center for Biometric Research
 
(2010) Fingerprint recognition performance evaluation for mobile ID applications
(2010) Fingerprint recognition performance evaluation for mobile ID applications(2010) Fingerprint recognition performance evaluation for mobile ID applications
(2010) Fingerprint recognition performance evaluation for mobile ID applicationsInternational Center for Biometric Research
 

Mehr von International Center for Biometric Research (20)

HBSI Automation Using the Kinect
HBSI Automation Using the KinectHBSI Automation Using the Kinect
HBSI Automation Using the Kinect
 
IT 34500
IT 34500IT 34500
IT 34500
 
An Investigation into Biometric Signature Capture Device Performance and User...
An Investigation into Biometric Signature Capture Device Performance and User...An Investigation into Biometric Signature Capture Device Performance and User...
An Investigation into Biometric Signature Capture Device Performance and User...
 
Entropy of Fingerprints
Entropy of FingerprintsEntropy of Fingerprints
Entropy of Fingerprints
 
Biometric and usability
Biometric and usabilityBiometric and usability
Biometric and usability
 
Examining Intra-Visit Iris Stability - Visit 4
Examining Intra-Visit Iris Stability - Visit 4Examining Intra-Visit Iris Stability - Visit 4
Examining Intra-Visit Iris Stability - Visit 4
 
Examining Intra-Visit Iris Stability - Visit 6
Examining Intra-Visit Iris Stability - Visit 6Examining Intra-Visit Iris Stability - Visit 6
Examining Intra-Visit Iris Stability - Visit 6
 
Examining Intra-Visit Iris Stability - Visit 2
Examining Intra-Visit Iris Stability - Visit 2Examining Intra-Visit Iris Stability - Visit 2
Examining Intra-Visit Iris Stability - Visit 2
 
Examining Intra-Visit Iris Stability - Visit 1
Examining Intra-Visit Iris Stability - Visit 1Examining Intra-Visit Iris Stability - Visit 1
Examining Intra-Visit Iris Stability - Visit 1
 
Examining Intra-Visit Iris Stability - Visit 3
Examining Intra-Visit Iris Stability - Visit 3Examining Intra-Visit Iris Stability - Visit 3
Examining Intra-Visit Iris Stability - Visit 3
 
Best Practices in Reporting Time Duration in Biometrics
Best Practices in Reporting Time Duration in BiometricsBest Practices in Reporting Time Duration in Biometrics
Best Practices in Reporting Time Duration in Biometrics
 
Examining Intra-Visit Iris Stability - Visit 5
Examining Intra-Visit Iris Stability - Visit 5Examining Intra-Visit Iris Stability - Visit 5
Examining Intra-Visit Iris Stability - Visit 5
 
Interoperability and the Stability Score Index
Interoperability and the Stability Score IndexInteroperability and the Stability Score Index
Interoperability and the Stability Score Index
 
Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...Advances in testing and evaluation using Human-Biometric sensor interaction m...
Advances in testing and evaluation using Human-Biometric sensor interaction m...
 
Cerias talk on testing and evaluation
Cerias talk on testing and evaluationCerias talk on testing and evaluation
Cerias talk on testing and evaluation
 
IT 54500 overview
IT 54500 overviewIT 54500 overview
IT 54500 overview
 
Ben thesis slideshow
Ben thesis slideshowBen thesis slideshow
Ben thesis slideshow
 
(2010) Fingerprint recognition performance evaluation for mobile ID applications
(2010) Fingerprint recognition performance evaluation for mobile ID applications(2010) Fingerprint recognition performance evaluation for mobile ID applications
(2010) Fingerprint recognition performance evaluation for mobile ID applications
 
ICBR Databases
ICBR DatabasesICBR Databases
ICBR Databases
 
Understanding Fingerprint Skin Characteristics and Image Quality
Understanding Fingerprint Skin Characteristics and Image QualityUnderstanding Fingerprint Skin Characteristics and Image Quality
Understanding Fingerprint Skin Characteristics and Image Quality
 

Kürzlich hochgeladen

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKJago de Vreede
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 

Kürzlich hochgeladen (20)

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 

(2013) Trade-off Between Impression Numbers and Attempt Numbers

  • 1. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation 07/02/2013 Jacob A. Hasselgren, Stephen J. Elliott, Jue Gue TRADEOFF BETWEEN IMPRESSION NUMBERS AND ATTEMPT NUMBERS
  • 2. AGENDA • Introduction • Methodology • Results • Lessons learned • Next steps
  • 3. INTRODUCTION • Many factors can impact the performance of a biometric system from poor quality data [1]: – Skin conditions [2] – HBSI [3] – Associated meta-data [4] • Collect appropriate data and minimize time/error
  • 4. MOTIVATION • The efficiency of a biometric system is important • While investigating habituation of biometric systems, the issue of the proper number of impressions collected and time arose
  • 5. MOTIVATION • We collect everyday – at what point do you stop collecting from a subject? – 3 samples? – 6 samples? – 9 samples? • We cannot keep subjects forever due to time and costs
  • 6. MOTIVATION • Number of subjects is important • Must design protocol to keep costs low while still processing as many subjects as possible • How many impressions should be collected from each subject? • How many attempts should be allowed? • Which fingers should be collected?
  • 7. QUESTIONS • Are some fingers harder to collect? – Do some take longer? • Is the image quality of the first three any different from the last three? • Does the performance change when slicing groups taken from subjects? – ie. Do the first three impressions match well against the last three impressions of the same subject?
  • 8. DATA • Collection of multimodal samples • Only data from one fingerprint sensor is be used for analysis • U.are.U 4500 • Taken from ongoing aging study in the BSPA Labs
  • 9. DEFINITIONS Term Meaning SAS Successfully acquired sample, synonymous with impression Impression number Number given to each SAS, ranging from 1-6 Interaction attempt number Number given to each interaction attempt, whether it results in success or failure, ranging from 1-18
  • 10. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation METHODOLOGY
  • 11. METHODOLOGY • 6 impressions/SAS were taken on each finger with a maximum of 18 interaction attempts to do so • Fingers used: – Left index – Left middle – Right index – Right middle
  • 12. METHODOLOGY • An impression number was given to each SAS in order for each finger – Six impressions per finger, impression numbers range 1-6 • An interaction attempt number was given to each interaction attempt in order for each finger – Max of 18 interaction attempts was given to submit 6 SAS’s, intearction attempt numbers range 1-18
  • 13. METHODOLOGY • A number of approaches were used to analyze the samples – An analysis of the number of attempts required for each finger – Compare quality scores between designated groups (first three, last three) – Compare matching rates between same designated groups
  • 14. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation RESULTS
  • 15. NUMBER OF INTERACTION ATTEMPTS • A comparison of the number of SAS’s to the number of interaction attempts was performed • Each subjects submitted six SAS’s • Did any given finger require more interaction attempts than others?
  • 17. NUMBER OF ATTEMPTS • No significant difference between the fingers was found • The right middle finger seems to have the most interaction attempts of all of the fingers collected – As well as the most variance
  • 18. DISTRIBUTION OF QUALITY • A comparison of the first three collected samples for any given finger to the last three was performed to find differences in image quality
  • 19. DISTRIBUTION OF QUALITY • All of the samples were pushed through a quality scoring algorithm, Aware WSQ 1000 • Scores a number of different metrics, with an overall quality score • This overall quality score was used in the following analysis
  • 21. DISTRIBUTION OF QUALITY • A one-way ANOVA was used to compare the first three SAS to the last three • No finger showed a significant difference Finger P-Value RI 0.155 RM 0.460 LI 0.090 LM 0.050
  • 22. MATCHING PERFORMANCE • A comparison of the first three collected samples for any given finger to the last three was performed to find differences in matching performance
  • 23. MATCHING PERFORMANCE • The samples were enrolled into a minutiae-based matching software, Megamatcher 4.3 • The first three SAS’s and last three SAS’s were enrolled separately • Equal error rates were used for results
  • 24. MATCHING PERFORMANCE Finger First 3 vs First 3 Last 3 vs. Last 3 First 3 vs. Last 3 LI 0.0000 0.0000 0.0006 LM 0.3322 0.0000 0.1282 RI 0.0000 0.0000 0.0000 RM 0.0000 0.0000 0.0000
  • 25. MATCHING PERFORMANCE • No improvements were noticed in performance for any fingers except for left middle – The EER improves from .3322 to .0000
  • 26. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation LESSONS LEARNED
  • 27. LESSONS LEARNED • No issues were found when comparing the number of interactions attempts between fingers – Though, right middle finger may require more attempts to collect impressions • To save time and unnecessary costs, it may not be practical to collect additional samples – No significant improvement was found after collecting three additional samples
  • 28. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation NEXT STEPS
  • 29. NEXT STEPS • Replicate this study on more sensors • Attempt to observe habituation using more than one visit – Observe effect of habituation on attempt numbers • Include time-on-task to get a true estimation on time required to collect SAS • Include hand dominance in interaction attempts
  • 30. BIOMETRICS LAB Biometric Standards, Performance and Assurance Laboratory Department of Technology, Leadership and Innovation QUESTIONS? jahassel@purdue.edu

Hinweis der Redaktion

  1. Good subjects, in theory, can submit three consistently good samples. Do we allow bad subjects to repeatedly submit samples when they may be submitting bad samples regardless. This will affect the time to collect, futhermore, the cost of collection.
  2. Good subjects, in theory, can submit three consistently good samples. Do we allow bad subjects to repeatedly submit samples when they may be submitting bad samples regardless. This will affect the time to collect, futhermore, the cost of collection.
  3. Bad subjects submitting three bad samples, will the sample improve with an additional.
  4. Is there any difference in image quality and does that quality stop core/deltas from being visible?