SlideShare ist ein Scribd-Unternehmen logo
1 von 34
Downloaden Sie, um offline zu lesen
Data Processing Workflow
for the
National Geographic
World Atlas Mobile App
Rosemary Wardley
Steve Gifford
Introduction
World Atlas App
Previous versions & Problems
Goals for new app
Data production
Data processing
Conclusions
World Atlas App for iPhone/iPad
Digital & Interactive Atlas
Political basemaps
Flags & Facts
Search Index
Statistical Overlays
Distance Calculator
How	
  it	
  was	
  done	
  before
How	
  it	
  was	
  done	
  before
How	
  it	
  was	
  done	
  before
How	
  it	
  was	
  done	
  before
How	
  it	
  was	
  done	
  before
App	
  Design/UX	
  Flaws
App	
  Design/UX	
  Flaws
App	
  Design/UX	
  Flaws
Goals	
  for	
  World	
  Atlas	
  v.4
Tighter	
  control	
  over	
  the	
  data	
  for	
  editorial	
  purposes	
  
Leverage	
  more	
  of	
  our	
  databases	
  
Reduce	
  the	
  amount	
  of	
  custom	
  processing	
  
Fit	
  into	
  evolving	
  Editorial/Production	
  workflow	
  
App	
  data	
  that	
  is	
  easier	
  to	
  update	
  &	
  replicate	
  
Maintain	
  NG	
  brand	
  identity	
  	
  
Add	
  flexibility	
  &	
  reduce	
  size	
  of	
  the	
  App	
  
Hybrid	
  Raster	
  &	
  Vector	
  process
Full	
  Workflow
Data	
  Production
Inputs:	
  Standard	
  Carto	
  Datasets
75	
  Million	
  
Zooms	
  0-­‐2
40	
  Million	
  
Zooms	
  2-­‐4
20	
  Million	
  
Zooms	
  5-­‐6
10	
  Million	
  
Zooms	
  7-­‐8
Editorial	
  &	
  Production	
  Steps
GFID	
  match
Flags	
  &	
  Facts
Search	
  Index	
  Creation
GIS	
  Database	
  Steps
Final	
  Product
Raster	
  &	
  Vector	
  Outputs
Background	
  
Raster
Full	
  PDF
Symbol	
  
Shapefiles
Boundary	
  
Shapefiles
Data	
  Processing
Why Vectors?
Image Artifacts
Blurry text & symbols
Tile edge discontinuities
Size
Images are big
Vectors are small
Selection Data
Tapping logic simpler
Vector Processing
Symbols
Points from GIS database
Both visual and selection
Text
Extracted from PDF
Purely visual
Boundaries
Areals from GIS database
Invisible, just for selection
Background Raster
Including
Roads, Rivers
Fills, stipples
Etc (lots of etc)
Excluding
Symbols
Text
Text Extraction
Parse the PDF
Need for each character
Location
Rotation
Size
Font
Output to Shapefile
Uploading to Mapbox
Image basemaps
Low res everything
High res blanks
Vectors
Symbols
Text
Boundaries
Anatomy of a Tile
How did it go?
App is released and working
Text is Sharp
Symbols are Sharp
Data size is way down
Old app: 500MB per layer
New app:75MB per layer
Conclusions:	
  Data	
  Update	
  Process
Conclusions:	
  Software	
  Used
Mapbox Studio
Wrapup & Contact
Rosemary Wardley
rwardley@ngs.org	
  
nationalgeographic.com
Steve Gifford
sjg@mousebirdconsulting.com	
  
mousebird.github.io/WhirlyGlobe/	
  

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Survey Data Management
Survey Data ManagementSurvey Data Management
Survey Data Management
 
Using FME to Transform Survey 123 Data
Using FME to Transform Survey 123 DataUsing FME to Transform Survey 123 Data
Using FME to Transform Survey 123 Data
 
2016 vendor showcase: arc gis online: management tips and tools for success b...
2016 vendor showcase: arc gis online: management tips and tools for success b...2016 vendor showcase: arc gis online: management tips and tools for success b...
2016 vendor showcase: arc gis online: management tips and tools for success b...
 
ArcGIS Enterprise Tips and Tricks - Esri Ireland 'Do One Thing Well' Webinar #5
ArcGIS Enterprise Tips and Tricks - Esri Ireland 'Do One Thing Well' Webinar #5ArcGIS Enterprise Tips and Tricks - Esri Ireland 'Do One Thing Well' Webinar #5
ArcGIS Enterprise Tips and Tricks - Esri Ireland 'Do One Thing Well' Webinar #5
 
Oracle BI Cloud
Oracle BI CloudOracle BI Cloud
Oracle BI Cloud
 
A2B Data™ Brochure
A2B Data™ BrochureA2B Data™ Brochure
A2B Data™ Brochure
 
TDWI Schweiz 2019 - Building Streaming Data Warehouses
TDWI Schweiz 2019 -  Building Streaming Data WarehousesTDWI Schweiz 2019 -  Building Streaming Data Warehouses
TDWI Schweiz 2019 - Building Streaming Data Warehouses
 
Esriuk_track9_1spatial
Esriuk_track9_1spatialEsriuk_track9_1spatial
Esriuk_track9_1spatial
 
SwiftAnt rpa_and_chatbots services_Microsoft Gold Partner
SwiftAnt rpa_and_chatbots services_Microsoft Gold PartnerSwiftAnt rpa_and_chatbots services_Microsoft Gold Partner
SwiftAnt rpa_and_chatbots services_Microsoft Gold Partner
 
The experience from a successful Forms to APEX migration
The experience from a successful Forms to APEX migrationThe experience from a successful Forms to APEX migration
The experience from a successful Forms to APEX migration
 
Automating and Scheduling Data Usage and Reporting
Automating and Scheduling Data Usage and Reporting Automating and Scheduling Data Usage and Reporting
Automating and Scheduling Data Usage and Reporting
 
QCard: Dynamics AX and Atlas Reporting
QCard: Dynamics AX and Atlas ReportingQCard: Dynamics AX and Atlas Reporting
QCard: Dynamics AX and Atlas Reporting
 
SwiftAnt Azure Migration_Low OPEX
SwiftAnt Azure Migration_Low OPEXSwiftAnt Azure Migration_Low OPEX
SwiftAnt Azure Migration_Low OPEX
 
Gis as a service
Gis as a serviceGis as a service
Gis as a service
 
Summer 2018 release webinar
Summer 2018 release webinarSummer 2018 release webinar
Summer 2018 release webinar
 
What's New in Cartegraph
What's New in CartegraphWhat's New in Cartegraph
What's New in Cartegraph
 
ArcGIS - A Platform for Developers & Startups
ArcGIS - A Platform for Developers & StartupsArcGIS - A Platform for Developers & Startups
ArcGIS - A Platform for Developers & Startups
 
The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...
 
Discover more Swift B2B Integrator_eiPaaS
Discover more Swift B2B Integrator_eiPaaSDiscover more Swift B2B Integrator_eiPaaS
Discover more Swift B2B Integrator_eiPaaS
 
SwiftAnt EDI Services_Microsoft Gold Partner
SwiftAnt EDI Services_Microsoft Gold PartnerSwiftAnt EDI Services_Microsoft Gold Partner
SwiftAnt EDI Services_Microsoft Gold Partner
 

Ähnlich wie Data Processing Workflow for the National Geographic World Atlas Mobile App

Data Alchemy Overview Presentation (Static Version)
Data Alchemy Overview Presentation (Static Version)Data Alchemy Overview Presentation (Static Version)
Data Alchemy Overview Presentation (Static Version)
Mark Rubenstein
 
What’s new in SAP BusinessObject BI 4.1? (part1)
What’s new in SAP BusinessObject BI 4.1? (part1)What’s new in SAP BusinessObject BI 4.1? (part1)
What’s new in SAP BusinessObject BI 4.1? (part1)
tasmc
 
Big data tim
Big data timBig data tim
Big data tim
T Weir
 

Ähnlich wie Data Processing Workflow for the National Geographic World Atlas Mobile App (20)

Technical Walkthrough of SAP S/4HANA System Conversion
Technical Walkthrough of SAP S/4HANA System ConversionTechnical Walkthrough of SAP S/4HANA System Conversion
Technical Walkthrough of SAP S/4HANA System Conversion
 
Creating Commercial Data Products with FME
Creating Commercial Data Products with FMECreating Commercial Data Products with FME
Creating Commercial Data Products with FME
 
Data Alchemy Overview Presentation (Static Version)
Data Alchemy Overview Presentation (Static Version)Data Alchemy Overview Presentation (Static Version)
Data Alchemy Overview Presentation (Static Version)
 
What’s new in SAP BusinessObject BI 4.1? (part1)
What’s new in SAP BusinessObject BI 4.1? (part1)What’s new in SAP BusinessObject BI 4.1? (part1)
What’s new in SAP BusinessObject BI 4.1? (part1)
 
Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017
 
Data-Driven and User-Centric: Improving enterprise productivity and engagemen...
Data-Driven and User-Centric: Improving enterprise productivity and engagemen...Data-Driven and User-Centric: Improving enterprise productivity and engagemen...
Data-Driven and User-Centric: Improving enterprise productivity and engagemen...
 
Architecture of Big Data Solutions
Architecture of Big Data SolutionsArchitecture of Big Data Solutions
Architecture of Big Data Solutions
 
Leveraging Google Maps with Business Intellilgence
Leveraging Google Maps with Business IntellilgenceLeveraging Google Maps with Business Intellilgence
Leveraging Google Maps with Business Intellilgence
 
Introduction to Seebo
Introduction to SeeboIntroduction to Seebo
Introduction to Seebo
 
Big data tim
Big data timBig data tim
Big data tim
 
Location Intelligence - The where factor
Location Intelligence - The where factorLocation Intelligence - The where factor
Location Intelligence - The where factor
 
What's New with SAP BusinessObjects Business Intelligence 4.1?
What's New with SAP BusinessObjects Business Intelligence 4.1?What's New with SAP BusinessObjects Business Intelligence 4.1?
What's New with SAP BusinessObjects Business Intelligence 4.1?
 
Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data Processing
 
Integrating GMaps Plugin with SAP BusinessObjects
Integrating GMaps Plugin with SAP BusinessObjectsIntegrating GMaps Plugin with SAP BusinessObjects
Integrating GMaps Plugin with SAP BusinessObjects
 
Growth hacking in the age of Data
Growth hacking in the age of DataGrowth hacking in the age of Data
Growth hacking in the age of Data
 
Decoding SAP S/4HANA System Conversion
Decoding SAP S/4HANA System ConversionDecoding SAP S/4HANA System Conversion
Decoding SAP S/4HANA System Conversion
 
SAP - Business Objects - Ri happy
SAP - Business Objects - Ri happySAP - Business Objects - Ri happy
SAP - Business Objects - Ri happy
 
FJ_Trainer
FJ_TrainerFJ_Trainer
FJ_Trainer
 
Mobile pulse sept 2014
Mobile pulse sept 2014Mobile pulse sept 2014
Mobile pulse sept 2014
 

Mehr von mousebird (6)

New features in WhirlyGlobe-Maply Version 2.4 and Beyond!
New features in WhirlyGlobe-Maply Version 2.4 and Beyond!New features in WhirlyGlobe-Maply Version 2.4 and Beyond!
New features in WhirlyGlobe-Maply Version 2.4 and Beyond!
 
Serious Geospatial Apps using WhirlyGlobe-Maply
Serious Geospatial Apps using WhirlyGlobe-MaplySerious Geospatial Apps using WhirlyGlobe-Maply
Serious Geospatial Apps using WhirlyGlobe-Maply
 
Eclipse unconference nov_2_2015
Eclipse unconference nov_2_2015Eclipse unconference nov_2_2015
Eclipse unconference nov_2_2015
 
Boundless dec 2014
Boundless dec 2014Boundless dec 2014
Boundless dec 2014
 
Google dec 2014
Google dec 2014Google dec 2014
Google dec 2014
 
AvidGeo Dec 2014
AvidGeo Dec 2014AvidGeo Dec 2014
AvidGeo Dec 2014
 

Kürzlich hochgeladen

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
VictorSzoltysek
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Kürzlich hochgeladen (20)

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
How to Choose the Right Laravel Development Partner in New York City_compress...
How to Choose the Right Laravel Development Partner in New York City_compress...How to Choose the Right Laravel Development Partner in New York City_compress...
How to Choose the Right Laravel Development Partner in New York City_compress...
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 

Data Processing Workflow for the National Geographic World Atlas Mobile App