SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
Applications to Science

                                     Pietro Perona
                           California Institute of Technology

                          NSF Workshop - Frontiers in Vision
                              Cambridge, 23 Aug 2011




Friday, August 26, 2011
Goals

                     • A few examples
                     • Implications for machine vision
                     • Lessons learned
                     • NSF’s role

Friday, August 26, 2011
Plan

                     • Intro (5’)
                     • Sketch of a few success stories (50’)
                     • Discussion (10’)


Friday, August 26, 2011
‘Lunging’ (view from top)




Friday, August 26, 2011
Why measure behavior




Friday, August 26, 2011
Why measure behavior

                          • Genes <<>> Brains <<>> Behavior




Friday, August 26, 2011
Why measure behavior

                          • Genes <<>> Brains <<>> Behavior
                          • Ethology



Friday, August 26, 2011
Why measure behavior

                          • Genes <<>> Brains <<>> Behavior
                          • Ethology
                          • What is behavior?


Friday, August 26, 2011
Fly behavior
                          (as we understand it today)




   Adapted from:
   Kravitz et al.
   PNAS April 16, 2002
   vol. 99 no. 8
   5664–5668


Friday, August 26, 2011
Friday, August 26, 2011
Friday, August 26, 2011
Detection performance




                                    [Dankert et al., Nature Methods, April 2009]
Friday, August 26, 2011
Phenotyping




                                [Dankert et al., Nature Methods, 2009]
Friday, August 26, 2011
Ethograms




                             [Dankert et al., Nature Methods, April 2009]
Friday, August 26, 2011
Perception




                                                        PSYCHOLOGY
                          interaction, cooperation,
                                competition



                            plans, goals, behavior,
                               relationships ...


                          pose, movemes, actions,
                          activities, objects, scenes




                                                        SENSORY
                            images, trajectories




                                      World
Friday, August 26, 2011
Action                                 Perception




                                                                                                     PSYCHOLOGY
                                                                     interaction, cooperation,
 PLANNING
                          group-level goals and plans
                                                                           competition
                      SOCIAL NETWORK                                         THEORY OF SOCIOLOGY
                                                        INDIVIDUAL


                                                                       plans, goals, behavior,
                          individual goals and plans
                                                                          relationships ...
                      PREFRONTAL CORTEX                                     THEORY OF PSYCHOLOGY



                                                                     pose, movemes, actions,
 MOTOR




                               motor programs
                                                                     activities, objects, scenes




                                                                                                     SENSORY
                     MOTOR CORTEX                                                      RECOGNITION




                            sensor-based control                       images, trajectories
                     SPINAL CORD                                                 IMAGING,TRACKING




                                                                                 World
Friday, August 26, 2011
Lessons learned
                     • Image deluge in science
                     • Doing better than the scientists
                     • Payoffs in science, not in MV (short term)
                          ‣   Must work as scientist
                          ‣   Students must be interested in science too
                          ‣   Publish in unfamiliar venues
                          ‣   CV publications are suspicious

                     • Benefit to MV: new challenges and datasets
                     • Benefit to PI: fun, learning
Friday, August 26, 2011
Basic research needed

                     • Tracking, detection and identification
                     • Parts and pose
                     • Hierarchical models (for time series)
                     • Unsupervised discovery of categories
                     • Weakly supervised learning

Friday, August 26, 2011

Weitere ähnliche Inhalte

Ähnlich wie Fcv appli science_perona

Fcv taxo perona
Fcv taxo peronaFcv taxo perona
Fcv taxo peronazukun
 
Architectural Research Methods Table
Architectural  Research  Methods    TableArchitectural  Research  Methods    Table
Architectural Research Methods TableGalala University
 
Emotion Ontology and Affective Neuroscience
Emotion Ontology and Affective NeuroscienceEmotion Ontology and Affective Neuroscience
Emotion Ontology and Affective NeuroscienceJanna Hastings
 
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...Sebastian Deterding
 
Quali lecture 1: Understanding the research process
Quali lecture 1: Understanding the research processQuali lecture 1: Understanding the research process
Quali lecture 1: Understanding the research processJari Laru
 
Learning Styles Inventory
Learning Styles InventoryLearning Styles Inventory
Learning Styles InventoryKori
 
Aesthetics of Touch: Desform Conference
Aesthetics of Touch: Desform ConferenceAesthetics of Touch: Desform Conference
Aesthetics of Touch: Desform ConferenceVicky Teinaki
 
Understanding Educational Enquiry
Understanding Educational EnquiryUnderstanding Educational Enquiry
Understanding Educational Enquirysyuserena
 
Cognitive processes
Cognitive processesCognitive processes
Cognitive processesMirzaNaadir
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentationUzma Waqas
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentationUzma Waqas
 
17 Sep 25 NIPS Attention & Consciousness
17 Sep 25 NIPS Attention & Consciousness17 Sep 25 NIPS Attention & Consciousness
17 Sep 25 NIPS Attention & ConsciousnessNao (Naotsugu) Tsuchiya
 

Ähnlich wie Fcv appli science_perona (18)

Fcv taxo perona
Fcv taxo peronaFcv taxo perona
Fcv taxo perona
 
Architectural Research Methods Table
Architectural  Research  Methods    TableArchitectural  Research  Methods    Table
Architectural Research Methods Table
 
Emotion Ontology and Affective Neuroscience
Emotion Ontology and Affective NeuroscienceEmotion Ontology and Affective Neuroscience
Emotion Ontology and Affective Neuroscience
 
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...
Coding conduct: Games, Play, and Human Conduct Between Technical Code and Soc...
 
Quali lecture 1: Understanding the research process
Quali lecture 1: Understanding the research processQuali lecture 1: Understanding the research process
Quali lecture 1: Understanding the research process
 
Learning Styles Inventory
Learning Styles InventoryLearning Styles Inventory
Learning Styles Inventory
 
Aesthetics of Touch: Desform Conference
Aesthetics of Touch: Desform ConferenceAesthetics of Touch: Desform Conference
Aesthetics of Touch: Desform Conference
 
Understanding Educational Enquiry
Understanding Educational EnquiryUnderstanding Educational Enquiry
Understanding Educational Enquiry
 
Cognitive processes
Cognitive processesCognitive processes
Cognitive processes
 
201204 AME High Five
201204 AME High Five201204 AME High Five
201204 AME High Five
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentation
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentation
 
VBPR 1st seminar
VBPR 1st seminarVBPR 1st seminar
VBPR 1st seminar
 
MNsMM
MNsMMMNsMM
MNsMM
 
2011 Taiwan UX Summit_Workshop B
2011 Taiwan UX Summit_Workshop B2011 Taiwan UX Summit_Workshop B
2011 Taiwan UX Summit_Workshop B
 
2012 Taiwan UX Summit 工作坊A 簡報
2012 Taiwan UX Summit 工作坊A 簡報2012 Taiwan UX Summit 工作坊A 簡報
2012 Taiwan UX Summit 工作坊A 簡報
 
Vass2012 fisher
Vass2012 fisherVass2012 fisher
Vass2012 fisher
 
17 Sep 25 NIPS Attention & Consciousness
17 Sep 25 NIPS Attention & Consciousness17 Sep 25 NIPS Attention & Consciousness
17 Sep 25 NIPS Attention & Consciousness
 

Mehr von zukun

My lyn tutorial 2009
My lyn tutorial 2009My lyn tutorial 2009
My lyn tutorial 2009zukun
 
ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVzukun
 
ETHZ CV2012: Information
ETHZ CV2012: InformationETHZ CV2012: Information
ETHZ CV2012: Informationzukun
 
Siwei lyu: natural image statistics
Siwei lyu: natural image statisticsSiwei lyu: natural image statistics
Siwei lyu: natural image statisticszukun
 
Lecture9 camera calibration
Lecture9 camera calibrationLecture9 camera calibration
Lecture9 camera calibrationzukun
 
Brunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer visionBrunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer visionzukun
 
Modern features-part-4-evaluation
Modern features-part-4-evaluationModern features-part-4-evaluation
Modern features-part-4-evaluationzukun
 
Modern features-part-3-software
Modern features-part-3-softwareModern features-part-3-software
Modern features-part-3-softwarezukun
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptorszukun
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectorszukun
 
Modern features-part-0-intro
Modern features-part-0-introModern features-part-0-intro
Modern features-part-0-introzukun
 
Lecture 02 internet video search
Lecture 02 internet video searchLecture 02 internet video search
Lecture 02 internet video searchzukun
 
Lecture 01 internet video search
Lecture 01 internet video searchLecture 01 internet video search
Lecture 01 internet video searchzukun
 
Lecture 03 internet video search
Lecture 03 internet video searchLecture 03 internet video search
Lecture 03 internet video searchzukun
 
Icml2012 tutorial representation_learning
Icml2012 tutorial representation_learningIcml2012 tutorial representation_learning
Icml2012 tutorial representation_learningzukun
 
Advances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer visionAdvances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer visionzukun
 
EM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysisEM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysiszukun
 
Object recognition with pictorial structures
Object recognition with pictorial structuresObject recognition with pictorial structures
Object recognition with pictorial structureszukun
 
Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities zukun
 
Icml2012 learning hierarchies of invariant features
Icml2012 learning hierarchies of invariant featuresIcml2012 learning hierarchies of invariant features
Icml2012 learning hierarchies of invariant featureszukun
 

Mehr von zukun (20)

My lyn tutorial 2009
My lyn tutorial 2009My lyn tutorial 2009
My lyn tutorial 2009
 
ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCV
 
ETHZ CV2012: Information
ETHZ CV2012: InformationETHZ CV2012: Information
ETHZ CV2012: Information
 
Siwei lyu: natural image statistics
Siwei lyu: natural image statisticsSiwei lyu: natural image statistics
Siwei lyu: natural image statistics
 
Lecture9 camera calibration
Lecture9 camera calibrationLecture9 camera calibration
Lecture9 camera calibration
 
Brunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer visionBrunelli 2008: template matching techniques in computer vision
Brunelli 2008: template matching techniques in computer vision
 
Modern features-part-4-evaluation
Modern features-part-4-evaluationModern features-part-4-evaluation
Modern features-part-4-evaluation
 
Modern features-part-3-software
Modern features-part-3-softwareModern features-part-3-software
Modern features-part-3-software
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptors
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectors
 
Modern features-part-0-intro
Modern features-part-0-introModern features-part-0-intro
Modern features-part-0-intro
 
Lecture 02 internet video search
Lecture 02 internet video searchLecture 02 internet video search
Lecture 02 internet video search
 
Lecture 01 internet video search
Lecture 01 internet video searchLecture 01 internet video search
Lecture 01 internet video search
 
Lecture 03 internet video search
Lecture 03 internet video searchLecture 03 internet video search
Lecture 03 internet video search
 
Icml2012 tutorial representation_learning
Icml2012 tutorial representation_learningIcml2012 tutorial representation_learning
Icml2012 tutorial representation_learning
 
Advances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer visionAdvances in discrete energy minimisation for computer vision
Advances in discrete energy minimisation for computer vision
 
EM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysisEM algorithm and its application in probabilistic latent semantic analysis
EM algorithm and its application in probabilistic latent semantic analysis
 
Object recognition with pictorial structures
Object recognition with pictorial structuresObject recognition with pictorial structures
Object recognition with pictorial structures
 
Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities Iccv2011 learning spatiotemporal graphs of human activities
Iccv2011 learning spatiotemporal graphs of human activities
 
Icml2012 learning hierarchies of invariant features
Icml2012 learning hierarchies of invariant featuresIcml2012 learning hierarchies of invariant features
Icml2012 learning hierarchies of invariant features
 

Kürzlich hochgeladen

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024SynarionITSolutions
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 

Kürzlich hochgeladen (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 

Fcv appli science_perona

  • 1. Applications to Science Pietro Perona California Institute of Technology NSF Workshop - Frontiers in Vision Cambridge, 23 Aug 2011 Friday, August 26, 2011
  • 2. Goals • A few examples • Implications for machine vision • Lessons learned • NSF’s role Friday, August 26, 2011
  • 3. Plan • Intro (5’) • Sketch of a few success stories (50’) • Discussion (10’) Friday, August 26, 2011
  • 4. ‘Lunging’ (view from top) Friday, August 26, 2011
  • 6. Why measure behavior • Genes <<>> Brains <<>> Behavior Friday, August 26, 2011
  • 7. Why measure behavior • Genes <<>> Brains <<>> Behavior • Ethology Friday, August 26, 2011
  • 8. Why measure behavior • Genes <<>> Brains <<>> Behavior • Ethology • What is behavior? Friday, August 26, 2011
  • 9. Fly behavior (as we understand it today) Adapted from: Kravitz et al. PNAS April 16, 2002 vol. 99 no. 8 5664–5668 Friday, August 26, 2011
  • 12. Detection performance [Dankert et al., Nature Methods, April 2009] Friday, August 26, 2011
  • 13. Phenotyping [Dankert et al., Nature Methods, 2009] Friday, August 26, 2011
  • 14. Ethograms [Dankert et al., Nature Methods, April 2009] Friday, August 26, 2011
  • 15. Perception PSYCHOLOGY interaction, cooperation, competition plans, goals, behavior, relationships ... pose, movemes, actions, activities, objects, scenes SENSORY images, trajectories World Friday, August 26, 2011
  • 16. Action Perception PSYCHOLOGY interaction, cooperation, PLANNING group-level goals and plans competition SOCIAL NETWORK THEORY OF SOCIOLOGY INDIVIDUAL plans, goals, behavior, individual goals and plans relationships ... PREFRONTAL CORTEX THEORY OF PSYCHOLOGY pose, movemes, actions, MOTOR motor programs activities, objects, scenes SENSORY MOTOR CORTEX RECOGNITION sensor-based control images, trajectories SPINAL CORD IMAGING,TRACKING World Friday, August 26, 2011
  • 17. Lessons learned • Image deluge in science • Doing better than the scientists • Payoffs in science, not in MV (short term) ‣ Must work as scientist ‣ Students must be interested in science too ‣ Publish in unfamiliar venues ‣ CV publications are suspicious • Benefit to MV: new challenges and datasets • Benefit to PI: fun, learning Friday, August 26, 2011
  • 18. Basic research needed • Tracking, detection and identification • Parts and pose • Hierarchical models (for time series) • Unsupervised discovery of categories • Weakly supervised learning Friday, August 26, 2011