SlideShare ist ein Scribd-Unternehmen logo
1 von 40
1
How Deep Learning and Drones Can
Save the World from Asteroids?
@SravanthiSinha
Are asteroids a threat to the Earth?
@SravanthiSinha
4
What’s an Asteroid?
Credit: NASA, JAXA and ESA (montage by Emily
Lakdawalla)
5
Impact of Itokawa
@SravanthiSinha
Where do they live?
7
What's the solution and why find meteorites?
@SravanthiSinha
8
Composition affects
threat assessment and
deflection technologies
Why find meteorites?
@SravanthiSinha
- It takes 100 man hours to find
one meteorite
- To increase meteorite finds, the
efficiency must be increased
- We have trajectories, but finding
meteorites is difficult
9
Current approach to find meteorites
@SravanthiSinha
Use a drone combined with Deep learning to
increase fresh meteorite finds
10 @SravanthiSinha
11
Why Deep Learning is the best
solution?
@SravanthiSinha
12
Traditional Computer Vision - Anomaly Detection
@SravanthiSinha
13
Data-Set
@SravanthiSinha
14
2 wrong classifications
out of 17000 patches!
Our Deep Learning Solution
@SravanthiSinha
15
2 correctly labelled meteorites…
124 incorrectly labelled patches…
out of 17000 patches
Our Deep Learning Solution
@SravanthiSinha
16
Challenges
@SravanthiSinha
Unbalanced data!
17
Dataset Creation
18
How we solved the problem?
@SravanthiSinha
rotations
19
reflection resolution brightness saturation
Our meteorite pictures
320
Internet meteorites in field
280
Internet meteorites photoshopped
35
635 images... tiny dataset !
32 augmentations per image 21000 images... respectable dataset !
Dataset Augmentation
@SravanthiSinha
20
~15 million natural images
Leveraging Big Data
@SravanthiSinha
21
GoogLeNet AlexNet
~6 million parameters ~61 million parameters
Leveraging Pre-trained Networks
@SravanthiSinha
22
Model Ensembling
@SravanthiSinha
23
Hardware / Software
Each model ~2 hours to train
On a CPU it would be ~1 week !
@SravanthiSinha
24
DEMO
@SravanthiSinha
25
The ADELIE Meteorite Hunter
26
The ADELIE Meteorite Hunter
27
The ADELIE Meteorite Hunter
Functionality in place
28
The ADELIE Meteorite Hunter
29
The ADELIE Meteorite Hunter
30
The ADELIE Meteorite Hunter
31
The ADELIE Meteorite Hunter
32
The ADELIE Meteorite Hunter
33
The ADELIE Meteorite Hunter
34
The ADELIE Meteorite Hunter
35
The ADELIE Meteorite Hunter
Archive images for
future learning.
36
The ADELIE Meteorite Hunter
37
The ADELIE Meteorite Hunter
38
The ADELIE Meteorite Hunter
Image processing
○ Faster inference time
○ Weak classifier
○ Reduce false positives
Improved hardware
○ Autonomous height control (LIDAR)
○ Better camera resolution
○ Longer battery life
○ Additional sensors (IR, hyperspectral?, etc.)
39 @SravanthiSinha
Ongoing work..
Amar Shah - Data Scientist,
PhD Student, Cambridge
Robert Citron - Planetary
Scientist, PhD Student, UC
Berkeley
Christopher Watkins, Data
Scientist, PhD Student,
CSIRO, Melbourne
Sravanthi Sinha, Full-Stack
Software Developer, Holberton
School, San Francisco
Peter Jenniskens, Project
Mentor, Meteor Astronomer,
SETI Institute
40
Team
@SravanthiSinha

Weitere ähnliche Inhalte

Andere mochten auch

Astronomy Photographer of the Year 2016: Winners & Finalists
Astronomy Photographer of the Year 2016: Winners & FinalistsAstronomy Photographer of the Year 2016: Winners & Finalists
Astronomy Photographer of the Year 2016: Winners & Finalistsmaditabalnco
 
An Overview of Asteroid Data
An Overview of Asteroid DataAn Overview of Asteroid Data
An Overview of Asteroid DataJ.L. Galache, PhD
 
Asteroids - Comets - Meteoroids
Asteroids - Comets - MeteoroidsAsteroids - Comets - Meteoroids
Asteroids - Comets - Meteoroidsdwinter1
 
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...PromptWorks
 
26. Stellar Objects Notes
26. Stellar Objects Notes26. Stellar Objects Notes
26. Stellar Objects Notesmgitterm
 
NASA Frontier Development Lab 2016 - Asteroids 101
NASA Frontier Development Lab 2016 - Asteroids 101NASA Frontier Development Lab 2016 - Asteroids 101
NASA Frontier Development Lab 2016 - Asteroids 101J.L. Galache, PhD
 
KGrothe -ASAT2016-DefendingEarth
KGrothe -ASAT2016-DefendingEarthKGrothe -ASAT2016-DefendingEarth
KGrothe -ASAT2016-DefendingEarthKaren Grothe
 
Dtu10e lecture ppt_ch09 2
Dtu10e lecture ppt_ch09 2Dtu10e lecture ppt_ch09 2
Dtu10e lecture ppt_ch09 2Asma Said,PhD
 
APPENDIX_F_2005_TP_neo_Cassandra_web
APPENDIX_F_2005_TP_neo_Cassandra_webAPPENDIX_F_2005_TP_neo_Cassandra_web
APPENDIX_F_2005_TP_neo_Cassandra_webMarshall Alphonso
 

Andere mochten auch (20)

08 lecture outline
08 lecture outline08 lecture outline
08 lecture outline
 
Astronomy Photographer of the Year 2016: Winners & Finalists
Astronomy Photographer of the Year 2016: Winners & FinalistsAstronomy Photographer of the Year 2016: Winners & Finalists
Astronomy Photographer of the Year 2016: Winners & Finalists
 
Planetary Defense and NEO Exploration
Planetary Defense and NEO ExplorationPlanetary Defense and NEO Exploration
Planetary Defense and NEO Exploration
 
An Overview of Asteroid Data
An Overview of Asteroid DataAn Overview of Asteroid Data
An Overview of Asteroid Data
 
14 review clickers
14 review clickers14 review clickers
14 review clickers
 
Современное состояние дистанционного зондирования Земли из Космоса. Зарубежны...
Современное состояние дистанционного зондирования Земли из Космоса. Зарубежны...Современное состояние дистанционного зондирования Земли из Космоса. Зарубежны...
Современное состояние дистанционного зондирования Земли из Космоса. Зарубежны...
 
13 lecture outline
13 lecture outline13 lecture outline
13 lecture outline
 
13 review clickers
13 review clickers13 review clickers
13 review clickers
 
14 lecture outline
14 lecture outline14 lecture outline
14 lecture outline
 
Asteroids - Comets - Meteoroids
Asteroids - Comets - MeteoroidsAsteroids - Comets - Meteoroids
Asteroids - Comets - Meteoroids
 
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...
PromptWorks Talk Tuesdays: Dustin Ingram 8/23/16 "Detecting Asteroids with Ne...
 
26. Stellar Objects Notes
26. Stellar Objects Notes26. Stellar Objects Notes
26. Stellar Objects Notes
 
NASA Frontier Development Lab 2016 - Asteroids 101
NASA Frontier Development Lab 2016 - Asteroids 101NASA Frontier Development Lab 2016 - Asteroids 101
NASA Frontier Development Lab 2016 - Asteroids 101
 
KGrothe -ASAT2016-DefendingEarth
KGrothe -ASAT2016-DefendingEarthKGrothe -ASAT2016-DefendingEarth
KGrothe -ASAT2016-DefendingEarth
 
Target tracking
Target trackingTarget tracking
Target tracking
 
12 review clickers
12 review clickers12 review clickers
12 review clickers
 
Dtu10e lecture ppt_ch09 2
Dtu10e lecture ppt_ch09 2Dtu10e lecture ppt_ch09 2
Dtu10e lecture ppt_ch09 2
 
12 review clickers
12 review clickers12 review clickers
12 review clickers
 
Asteroids
AsteroidsAsteroids
Asteroids
 
APPENDIX_F_2005_TP_neo_Cassandra_web
APPENDIX_F_2005_TP_neo_Cassandra_webAPPENDIX_F_2005_TP_neo_Cassandra_web
APPENDIX_F_2005_TP_neo_Cassandra_web
 

Ähnlich wie DEEP LEARNING SUMMIT ASIA 2016

Artificial intelligence in space exploration venkat vajradhar - medium
Artificial intelligence in space exploration   venkat vajradhar - mediumArtificial intelligence in space exploration   venkat vajradhar - medium
Artificial intelligence in space exploration venkat vajradhar - mediumvenkatvajradhar1
 
Creating a Big Data Machine Learning Platform in California
Creating a Big Data Machine Learning Platform in CaliforniaCreating a Big Data Machine Learning Platform in California
Creating a Big Data Machine Learning Platform in CaliforniaLarry Smarr
 
Artificial Intelligence In Astronomy
Artificial Intelligence In AstronomyArtificial Intelligence In Astronomy
Artificial Intelligence In AstronomyTracy Drey
 
Introduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolutionIntroduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolutionDarian Frajberg
 
Report to the NAC
Report to the NACReport to the NAC
Report to the NACLarry Smarr
 
AI - Savior or Supervillain?
AI - Savior or Supervillain?AI - Savior or Supervillain?
AI - Savior or Supervillain?Ganes Kesari
 
AI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabAI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabGanesan Narayanasamy
 
Mike Warren Keynote
Mike Warren KeynoteMike Warren Keynote
Mike Warren KeynoteData Con LA
 
Big Data in Science
Big Data in ScienceBig Data in Science
Big Data in ScienceFLARECAST
 
Big Data in Science
Big Data in ScienceBig Data in Science
Big Data in ScienceFLARECAST
 

Ähnlich wie DEEP LEARNING SUMMIT ASIA 2016 (11)

Artificial intelligence in space exploration venkat vajradhar - medium
Artificial intelligence in space exploration   venkat vajradhar - mediumArtificial intelligence in space exploration   venkat vajradhar - medium
Artificial intelligence in space exploration venkat vajradhar - medium
 
Creating a Big Data Machine Learning Platform in California
Creating a Big Data Machine Learning Platform in CaliforniaCreating a Big Data Machine Learning Platform in California
Creating a Big Data Machine Learning Platform in California
 
Lausanne 2019 #2
Lausanne 2019 #2Lausanne 2019 #2
Lausanne 2019 #2
 
Artificial Intelligence In Astronomy
Artificial Intelligence In AstronomyArtificial Intelligence In Astronomy
Artificial Intelligence In Astronomy
 
Introduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolutionIntroduction to the Artificial Intelligence and Computer Vision revolution
Introduction to the Artificial Intelligence and Computer Vision revolution
 
Report to the NAC
Report to the NACReport to the NAC
Report to the NAC
 
AI - Savior or Supervillain?
AI - Savior or Supervillain?AI - Savior or Supervillain?
AI - Savior or Supervillain?
 
AI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabAI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development Lab
 
Mike Warren Keynote
Mike Warren KeynoteMike Warren Keynote
Mike Warren Keynote
 
Big Data in Science
Big Data in ScienceBig Data in Science
Big Data in Science
 
Big Data in Science
Big Data in ScienceBig Data in Science
Big Data in Science
 

Kürzlich hochgeladen

Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bSérgio Sacani
 
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...Mohammad Khajehpour
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)AkefAfaneh2
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPirithiRaju
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptxAlMamun560346
 
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Joonhun Lee
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfrohankumarsinghrore1
 
IDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicineIDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicinesherlingomez2
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedDelhi Call girls
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Servicenishacall1
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learninglevieagacer
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY1301aanya
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksSérgio Sacani
 
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONSTS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONrouseeyyy
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPirithiRaju
 
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts ServiceJustdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Servicemonikaservice1
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxBhagirath Gogikar
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learninglevieagacer
 

Kürzlich hochgeladen (20)

Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
Seismic Method Estimate velocity from seismic data.pptx
Seismic Method Estimate velocity from seismic  data.pptxSeismic Method Estimate velocity from seismic  data.pptx
Seismic Method Estimate velocity from seismic data.pptx
 
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
IDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicineIDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicine
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONSTS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts ServiceJustdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptx
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 

DEEP LEARNING SUMMIT ASIA 2016

Hinweis der Redaktion

  1. This has already happened at least once. The likely reason you don’t see any dinosaurs around the neighborhood.
  2. ITOKAVA EFFECT
  3. ITOKAVA EFFECT
  4. How to deflect an Asteroid?
  5. Out of 800 trajectories, we only have 27 recovered meteorites . We need to increase that > 40 meteorite types > 100 asteroid families Within each family, there’s a range of properties Can Deep learning improve our ability to locate freshly fallen meteorites?
  6. OUR IDEA/APPROACH
  7. WORK IN PROGRESS
  8. Acknowledgement to the team involved