SlideShare ist ein Scribd-Unternehmen logo
1 von 51
Augmented  Reality
Tracking-Learning-Detection (Predator ) Algorithm HCI Demo using Virtual Mouse
Augmented Reality? Overlaying of digital data on the real world
The Team  Navneet Nikhil Manohar Ritesh http://tinyurl.com/twdemo
We built  “  An augmented reality application to be used inside an Enterprise to manage contacts and location services. “
PANACEA TWANACEA * Possible names for the application
Contacts Problems Not Updated Unmanageable Non-scalable
Contacts Problems Wait! Is there a name of a person as well? So, now I know the person as well his/her phone number. What happens if the Phone number changes? Exposed Phone numbers
Contacts Problems Navneet KumarDeveloper ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076 navneetk@thoughtworks.com  … passé
Contacts Problems  Future of Visiting Cards Navneet Kumar With Best Wishes  ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076 navneetk@thoughtworks.com  . . .You know why?
Contacts Problems My only use for it now is to attach it to gifts that I give.
A radical new way of exchanging contacts inside the enterprise vCards 2.0
      Contacts Management
You meet these guys at Dev-Camp. How long do you think it will take you exchange your contact information?   We say about 10 seconds!
Possibilities … * Stock photo from stck.xchng
A new way of putting up Assistance and event posters. Posters
A new way of putting up assistance posters. No numbers, no hassles.  For all Travel related Queries Logon to PANACEA Powered by PANACEA
X-Conf 4 – March 5th Event Posters - Revisited //TODO: Add functionality that will add this event to your calendar and notify you 10 mins before the event  Don't do that, then! (Doctor, it hurts when I rewrite legacy applications) Powered by PANACEA * Photo courtesy thoughtworker.com
Presence  * VISION @starkcoffee - hopefully my.thoughtworks will be a completely fresh experience to TWers !
* VISION Dinesh Tantri – Geek Lunch Talk: Introducing  myThoughtWorks Give Feedback , ask questions Logon to PANACEA Powered by PANACEA Event / Conference Feedback(1/2) PANACEA
Event / Conference Feedback(2/2) * VISION Talk: Introducing  my.thoughtworks! Comments Feedback PANACEA
How we do this.  Tech
  Application Walkthrough
 - 3 step process  - Core of the idea is a ML Algorithm for face recognition ,[object Object], Face Recognition Status flags convey what thread is currently active and processing.
Step 1 Detecting… No Faces in this Image
Step 2 Scanning… A Face Found !!!
Step 3 Fetching… Fetch Data From Active Directory PratekhsaUday Prateeksha@thoughtworks.com Mobile : 9686577076
Implementation and Challenges Uh Oh!
First Approach  Training Set Manual Training Face Detection LDAP Face Recognition Service Calls App Massive Database of Photos
Problems with this approach  Too Painful  Training Set Manual Training Face Detection Face Recognition Service Calls App Not Real time – Not scalable
Second Approach Gives Compile Using opencv.so C++ Libraries Android NDK opencv.so Java Native Interface (JNI) App
          Face Recognition
Pros & Cons - Second Approach opencv.so Java Native Interface (JNI) App Not Accurate Near Real time No Service Calls Poor Training data Totally in Phone
Face Recognition PANACEA
Hybrid Approach Face Detection Scanning Mode Face? Yes Face Recognition Training Mode
Train Every Employee ?? Damn ! It’s painful
Distributed Dataset Training
Do you know these applications? * Logos courtesy their corresponding websites
Location Problems     Only 13% of the smart phones sold across the world are Location Aware   Less than 4% of all mobile phones sold last year were Location aware.  * Stats courtesy: http://textopiablog.wordpress.com/2010/02/22/how-many-people-own-a-location-aware-device/
Location Problems Too many places. Search doesn’t solve the problem either.  *screen shot courtesy google.com
Location Problems Roof top Restaurant Roof top - Bar Pizzeria Chinese Restaurant Cafe Multiple Avenues – Same GPS Location
Creating and using GPS agnostic Hyper local communities  Location
Introducing the PlaceMark! Join my community and share your thoughts
Hyperlocal Community
Enterprise Network Chicago Bangalore Pune Chennai Melbourne
Implementation Face Detection Scanning Mode Face? Yes Face Recognition Location?
Application Architecture Main UI Surface Overlays Camera Info Overlay status Overlay Processing Android native detection Recognition service Gab server Location  server PANACEA
Panacea

Weitere ähnliche Inhalte

Ähnlich wie Panacea

Mind Mapping Ideation Final
Mind Mapping Ideation FinalMind Mapping Ideation Final
Mind Mapping Ideation Final
jascc1
 
Sr.Application Support Engg(having 4.11 years of EXP) 2
Sr.Application Support Engg(having 4.11 years of EXP) 2Sr.Application Support Engg(having 4.11 years of EXP) 2
Sr.Application Support Engg(having 4.11 years of EXP) 2
Hitesh Kushwaha
 

Ähnlich wie Panacea (20)

Mind Mapping Ideation Final
Mind Mapping Ideation FinalMind Mapping Ideation Final
Mind Mapping Ideation Final
 
World Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for DevelopersWorld Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for Developers
 
Final Report_213110090
Final Report_213110090Final Report_213110090
Final Report_213110090
 
Flexter fundpitch ai
Flexter fundpitch aiFlexter fundpitch ai
Flexter fundpitch ai
 
Creadigol Solution, Creative Business with Technologies
Creadigol Solution, Creative Business with TechnologiesCreadigol Solution, Creative Business with Technologies
Creadigol Solution, Creative Business with Technologies
 
Strategic Alliance proposal to IT Service Providers – Creating Growth Opportu...
Strategic Alliance proposal to IT Service Providers – Creating Growth Opportu...Strategic Alliance proposal to IT Service Providers – Creating Growth Opportu...
Strategic Alliance proposal to IT Service Providers – Creating Growth Opportu...
 
App evolution meets adsense
App evolution meets adsenseApp evolution meets adsense
App evolution meets adsense
 
FINAL REVIEW for final semester internship.pptx
FINAL REVIEW for final semester internship.pptxFINAL REVIEW for final semester internship.pptx
FINAL REVIEW for final semester internship.pptx
 
GTC West (AM): Technology As A Tool For Innovation
GTC West (AM): Technology As A Tool For InnovationGTC West (AM): Technology As A Tool For Innovation
GTC West (AM): Technology As A Tool For Innovation
 
Emerging Marketing Technologies Webinar
Emerging Marketing Technologies WebinarEmerging Marketing Technologies Webinar
Emerging Marketing Technologies Webinar
 
Company profile
Company profileCompany profile
Company profile
 
An involving approach to intranet design
An involving approach to intranet designAn involving approach to intranet design
An involving approach to intranet design
 
DE REPORT ON CAPTCHA CODE FOR CSE B.TECH STUDENTS
DE REPORT ON CAPTCHA CODE FOR CSE B.TECH STUDENTSDE REPORT ON CAPTCHA CODE FOR CSE B.TECH STUDENTS
DE REPORT ON CAPTCHA CODE FOR CSE B.TECH STUDENTS
 
Sr.Application Support Engg(having 4.11 years of EXP) 2
Sr.Application Support Engg(having 4.11 years of EXP) 2Sr.Application Support Engg(having 4.11 years of EXP) 2
Sr.Application Support Engg(having 4.11 years of EXP) 2
 
Thinking about the full stack to create great mobile experiences
Thinking about the full stack to create great mobile experiencesThinking about the full stack to create great mobile experiences
Thinking about the full stack to create great mobile experiences
 
Imagine Cup 2011
Imagine Cup 2011Imagine Cup 2011
Imagine Cup 2011
 
19 nov15parikshit singh tomar a
19 nov15parikshit singh tomar a19 nov15parikshit singh tomar a
19 nov15parikshit singh tomar a
 
app on ai chatbot.pdf
app on ai chatbot.pdfapp on ai chatbot.pdf
app on ai chatbot.pdf
 
EqTribe projects so far
EqTribe projects so farEqTribe projects so far
EqTribe projects so far
 
MarsDevs - Mobile Apps Case Studies.pdf
MarsDevs - Mobile Apps Case Studies.pdfMarsDevs - Mobile Apps Case Studies.pdf
MarsDevs - Mobile Apps Case Studies.pdf
 

Mehr von Navneet kumar

Mehr von Navneet kumar (9)

Bitcoin cryptosecurity
Bitcoin cryptosecurityBitcoin cryptosecurity
Bitcoin cryptosecurity
 
Eagle Eye
Eagle EyeEagle Eye
Eagle Eye
 
Lambda Architecture in Practice
Lambda Architecture in PracticeLambda Architecture in Practice
Lambda Architecture in Practice
 
TrafikSense: Intelligent adaptive traffic signal
TrafikSense: Intelligent adaptive traffic signalTrafikSense: Intelligent adaptive traffic signal
TrafikSense: Intelligent adaptive traffic signal
 
BlueBox: A videoconf dongle prototype
BlueBox: A videoconf dongle prototypeBlueBox: A videoconf dongle prototype
BlueBox: A videoconf dongle prototype
 
How Not to Code
How Not to CodeHow Not to Code
How Not to Code
 
Securty 101
Securty 101Securty 101
Securty 101
 
Breaking Bad: Enterprise Network Security
Breaking Bad: Enterprise Network SecurityBreaking Bad: Enterprise Network Security
Breaking Bad: Enterprise Network Security
 
Performance tuning in hybrid mobile apps
Performance tuning in hybrid mobile appsPerformance tuning in hybrid mobile apps
Performance tuning in hybrid mobile apps
 

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 

Panacea

  • 2. Tracking-Learning-Detection (Predator ) Algorithm HCI Demo using Virtual Mouse
  • 3. Augmented Reality? Overlaying of digital data on the real world
  • 4. The Team Navneet Nikhil Manohar Ritesh http://tinyurl.com/twdemo
  • 5. We built “ An augmented reality application to be used inside an Enterprise to manage contacts and location services. “
  • 6. PANACEA TWANACEA * Possible names for the application
  • 7.
  • 8.
  • 9. Contacts Problems Not Updated Unmanageable Non-scalable
  • 10. Contacts Problems Wait! Is there a name of a person as well? So, now I know the person as well his/her phone number. What happens if the Phone number changes? Exposed Phone numbers
  • 11. Contacts Problems Navneet KumarDeveloper ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076 navneetk@thoughtworks.com … passé
  • 12. Contacts Problems Future of Visiting Cards Navneet Kumar With Best Wishes ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076 navneetk@thoughtworks.com . . .You know why?
  • 13. Contacts Problems My only use for it now is to attach it to gifts that I give.
  • 14. A radical new way of exchanging contacts inside the enterprise vCards 2.0
  • 15. Contacts Management
  • 16. You meet these guys at Dev-Camp. How long do you think it will take you exchange your contact information? We say about 10 seconds!
  • 17. Possibilities … * Stock photo from stck.xchng
  • 18. A new way of putting up Assistance and event posters. Posters
  • 19. A new way of putting up assistance posters. No numbers, no hassles. For all Travel related Queries Logon to PANACEA Powered by PANACEA
  • 20. X-Conf 4 – March 5th Event Posters - Revisited //TODO: Add functionality that will add this event to your calendar and notify you 10 mins before the event Don't do that, then! (Doctor, it hurts when I rewrite legacy applications) Powered by PANACEA * Photo courtesy thoughtworker.com
  • 21. Presence * VISION @starkcoffee - hopefully my.thoughtworks will be a completely fresh experience to TWers !
  • 22. * VISION Dinesh Tantri – Geek Lunch Talk: Introducing myThoughtWorks Give Feedback , ask questions Logon to PANACEA Powered by PANACEA Event / Conference Feedback(1/2) PANACEA
  • 23. Event / Conference Feedback(2/2) * VISION Talk: Introducing my.thoughtworks! Comments Feedback PANACEA
  • 24. How we do this. Tech
  • 25. Application Walkthrough
  • 26.
  • 27. Step 1 Detecting… No Faces in this Image
  • 28. Step 2 Scanning… A Face Found !!!
  • 29. Step 3 Fetching… Fetch Data From Active Directory PratekhsaUday Prateeksha@thoughtworks.com Mobile : 9686577076
  • 31. First Approach Training Set Manual Training Face Detection LDAP Face Recognition Service Calls App Massive Database of Photos
  • 32. Problems with this approach  Too Painful Training Set Manual Training Face Detection Face Recognition Service Calls App Not Real time – Not scalable
  • 33. Second Approach Gives Compile Using opencv.so C++ Libraries Android NDK opencv.so Java Native Interface (JNI) App
  • 34. Face Recognition
  • 35. Pros & Cons - Second Approach opencv.so Java Native Interface (JNI) App Not Accurate Near Real time No Service Calls Poor Training data Totally in Phone
  • 37. Hybrid Approach Face Detection Scanning Mode Face? Yes Face Recognition Training Mode
  • 38. Train Every Employee ?? Damn ! It’s painful
  • 40.
  • 41. Do you know these applications? * Logos courtesy their corresponding websites
  • 42. Location Problems Only 13% of the smart phones sold across the world are Location Aware Less than 4% of all mobile phones sold last year were Location aware. * Stats courtesy: http://textopiablog.wordpress.com/2010/02/22/how-many-people-own-a-location-aware-device/
  • 43. Location Problems Too many places. Search doesn’t solve the problem either. *screen shot courtesy google.com
  • 44. Location Problems Roof top Restaurant Roof top - Bar Pizzeria Chinese Restaurant Cafe Multiple Avenues – Same GPS Location
  • 45. Creating and using GPS agnostic Hyper local communities Location
  • 46. Introducing the PlaceMark! Join my community and share your thoughts
  • 48. Enterprise Network Chicago Bangalore Pune Chennai Melbourne
  • 49. Implementation Face Detection Scanning Mode Face? Yes Face Recognition Location?
  • 50. Application Architecture Main UI Surface Overlays Camera Info Overlay status Overlay Processing Android native detection Recognition service Gab server Location server PANACEA

Hinweis der Redaktion

  1. Augmented reality (AR) is a term for a live direct or an indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input, such as sound or graphics. Simple Defn : overlaying of digital data on the real world.
  2. Face Recognition – Once a face is detected, the face has to be processed by an algorithm which will associate a unique id from the training set.
  3. Once the algorithm returns a unique identifier based on the processed image, we fetch the data corresponding to that id. In our case, the details from Active Directory. (actually, not just AD)
  4. We found Open Source Computer Vision. A free library that does object detection, recognition and 500 other image processing algorithm
  5. This video visualizes the detection process of OpenCV's face detector. The algorithm uses the Viola Jones method of calculating the integral image and then performing some calculations on all the areas defined by the black and white rectangles to analyze the differences between the dark and light regions of a face. The sub-window (in red) is scanned across the image at various scales to detect if there is a potential face within the window. If not, it continues scanning. If it passes all stages in the cascade file, it is marked with a red rectangle. But this does not yet confirm a face. In the post-processing stage all the potential faces are checked for overlaps. Typically, 2 or 3 overlapping rectangles are required to confirm a face. Loner rectangles are rejected as false-positives.In stead of finding faces, the algorithm should discard non-faces.