SlideShare ist ein Scribd-Unternehmen logo
1 von 9
Downloaden Sie, um offline zu lesen
Developing the
“True HDR” app
for iPhone
Why HDR?
Often, you see a beautiful
scene but you cannot capture
it on camera.
You get the sky but the rest of
the picture is too dark...
Why HDR?
Or, you get the shadows but
the sky is washed out.
Your eyes perceive high
dynamic range but most
cameras have low dynamic
range.
Capture what your eyes see, via
computational means
Capture what your eyes see, via
computational means
A bit of history
● Released in 2009 after Apple introduced the 3GS with “auto-focus”
feature.
● At the time, there were several apps with “HDR” in their names but
all they did was single-image contrast enhancement.
● Initially version was low-resolution (1 MP); current version supports
up to 19 MP.
● Apple’s introduction of built-in HDR in 2010 didn’t kill the app. Not
all HDR’s are created equal; many like our results better.
Challenges
● Automatically aligning photos with drastically different
exposures
● The merge should be as natural-looking as possible.
We don’t want halo artifacts.
● Image processing can need a LOT of memory but
memory is a prized resource on mobile
● Doing things fast
The Ups and Downs of App
Development
Highlights
● Appreciative users
● Was #1 in Japan and #3 in the US, for a short time
● Was inaugural member of Apple’s “App Store Hall of Fame”
Setbacks
● 8-month period when updates kept getting rejected by Apple
Lessons & Anecdotes
Contact me:
Yuanzhen Li
yzli@csail.mit.edu
Interested in computational photo
app projects?

Weitere ähnliche Inhalte

Andere mochten auch

Raskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 NovemberRaskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 November
Camera Culture Group, MIT Media Lab
 
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh RaskarWhat is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
Camera Culture Group, MIT Media Lab
 

Andere mochten auch (19)

Introduction to Light Fields
Introduction to Light FieldsIntroduction to Light Fields
Introduction to Light Fields
 
Raskar TEDMED 2013
Raskar TEDMED 2013Raskar TEDMED 2013
Raskar TEDMED 2013
 
Google Glass Breakdown
Google Glass BreakdownGoogle Glass Breakdown
Google Glass Breakdown
 
Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)
 
Raskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 NovemberRaskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 November
 
What is Media in MIT Media Lab, Why 'Camera Culture'
What is Media in MIT Media Lab, Why 'Camera Culture'What is Media in MIT Media Lab, Why 'Camera Culture'
What is Media in MIT Media Lab, Why 'Camera Culture'
 
Multiview Imaging HW Overview
Multiview Imaging HW OverviewMultiview Imaging HW Overview
Multiview Imaging HW Overview
 
Stereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt HirschStereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt Hirsch
 
Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh RaskarWhat is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Google Glass Overview
Google Glass OverviewGoogle Glass Overview
Google Glass Overview
 
Raskar stanfordextremecompuimagingapr2016
Raskar stanfordextremecompuimagingapr2016Raskar stanfordextremecompuimagingapr2016
Raskar stanfordextremecompuimagingapr2016
 
Kinect Tutorial
Kinect Tutorial Kinect Tutorial
Kinect Tutorial
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
Light Field Photography Introduction
Light Field Photography IntroductionLight Field Photography Introduction
Light Field Photography Introduction
 
Introduction to Photography
Introduction to PhotographyIntroduction to Photography
Introduction to Photography
 
Time of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael WhyteTime of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael Whyte
 
Computer Vision Introduction
Computer Vision IntroductionComputer Vision Introduction
Computer Vision Introduction
 

Ähnlich wie Developing "True HDR" for the iPhone

Untapped Cities iPhoneography Workshop
Untapped Cities iPhoneography WorkshopUntapped Cities iPhoneography Workshop
Untapped Cities iPhoneography Workshop
untappedcities
 
16 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s516 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s5
Samson Lam
 
Technical skills
Technical skillsTechnical skills
Technical skills
nathesa
 

Ähnlich wie Developing "True HDR" for the iPhone (20)

Android VS apple
Android VS apple Android VS apple
Android VS apple
 
Teen Photography Class
Teen Photography ClassTeen Photography Class
Teen Photography Class
 
Gopro case study
Gopro case studyGopro case study
Gopro case study
 
Equipment list
Equipment listEquipment list
Equipment list
 
Android vs. IOS: Comparing features & functions
Android vs. IOS: Comparing features & functionsAndroid vs. IOS: Comparing features & functions
Android vs. IOS: Comparing features & functions
 
iPhone 14 Versus iPhone 12 2022_23.pdf
iPhone 14 Versus iPhone 12 2022_23.pdfiPhone 14 Versus iPhone 12 2022_23.pdf
iPhone 14 Versus iPhone 12 2022_23.pdf
 
iOS 13 Every New Feature iPhone You Need To Know About
iOS 13 Every New Feature iPhone You Need To Know AboutiOS 13 Every New Feature iPhone You Need To Know About
iOS 13 Every New Feature iPhone You Need To Know About
 
Untapped Cities iPhoneography Workshop
Untapped Cities iPhoneography WorkshopUntapped Cities iPhoneography Workshop
Untapped Cities iPhoneography Workshop
 
Shoot to thrill
Shoot to thrillShoot to thrill
Shoot to thrill
 
Why apple i phone 12 pro is people's first choice
Why apple i phone 12 pro is people's first choiceWhy apple i phone 12 pro is people's first choice
Why apple i phone 12 pro is people's first choice
 
Adopt i os 13 dark mode in your ios app
Adopt i os 13 dark mode in your ios appAdopt i os 13 dark mode in your ios app
Adopt i os 13 dark mode in your ios app
 
Apple iPhone 5 review
 Apple iPhone 5 review  Apple iPhone 5 review
Apple iPhone 5 review
 
16 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s516 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s5
 
Gopro case study
Gopro case studyGopro case study
Gopro case study
 
Confused - Updating your iPhone to iOS 13 ??
Confused - Updating your iPhone to iOS 13 ??Confused - Updating your iPhone to iOS 13 ??
Confused - Updating your iPhone to iOS 13 ??
 
Technical skills
Technical skillsTechnical skills
Technical skills
 
Special features of iphone 13
Special features of iphone 13Special features of iphone 13
Special features of iphone 13
 
Apple i os 13 features and version release updates
Apple i os 13 features and version release updatesApple i os 13 features and version release updates
Apple i os 13 features and version release updates
 
Apple iPhone 6 Plus review
Apple iPhone 6 Plus reviewApple iPhone 6 Plus review
Apple iPhone 6 Plus review
 
Apple iPhone 6 review in pictures
Apple iPhone 6 review in picturesApple iPhone 6 review in pictures
Apple iPhone 6 review in pictures
 

Mehr von Camera Culture Group, MIT Media Lab

God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
Camera Culture Group, MIT Media Lab
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Camera Culture Group, MIT Media Lab
 
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Camera Culture Group, MIT Media Lab
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
Camera Culture Group, MIT Media Lab
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Camera Culture Group, MIT Media Lab
 

Mehr von Camera Culture Group, MIT Media Lab (11)

Raskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award TalkRaskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award Talk
 
Lost Decade of Computational Photography
Lost Decade of Computational PhotographyLost Decade of Computational Photography
Lost Decade of Computational Photography
 
Covid Safe Paths
Covid Safe PathsCovid Safe Paths
Covid Safe Paths
 
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
 
Raskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis GuidanceRaskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis Guidance
 
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
 
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
 
Unspoken Challenges in AR and XR
Unspoken Challenges in AR and XRUnspoken Challenges in AR and XR
Unspoken Challenges in AR and XR
 

Kürzlich hochgeladen

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 

Developing "True HDR" for the iPhone

  • 2. Why HDR? Often, you see a beautiful scene but you cannot capture it on camera. You get the sky but the rest of the picture is too dark...
  • 3. Why HDR? Or, you get the shadows but the sky is washed out. Your eyes perceive high dynamic range but most cameras have low dynamic range.
  • 4. Capture what your eyes see, via computational means
  • 5. Capture what your eyes see, via computational means
  • 6. A bit of history ● Released in 2009 after Apple introduced the 3GS with “auto-focus” feature. ● At the time, there were several apps with “HDR” in their names but all they did was single-image contrast enhancement. ● Initially version was low-resolution (1 MP); current version supports up to 19 MP. ● Apple’s introduction of built-in HDR in 2010 didn’t kill the app. Not all HDR’s are created equal; many like our results better.
  • 7. Challenges ● Automatically aligning photos with drastically different exposures ● The merge should be as natural-looking as possible. We don’t want halo artifacts. ● Image processing can need a LOT of memory but memory is a prized resource on mobile ● Doing things fast
  • 8. The Ups and Downs of App Development Highlights ● Appreciative users ● Was #1 in Japan and #3 in the US, for a short time ● Was inaugural member of Apple’s “App Store Hall of Fame” Setbacks ● 8-month period when updates kept getting rejected by Apple Lessons & Anecdotes
  • 9. Contact me: Yuanzhen Li yzli@csail.mit.edu Interested in computational photo app projects?