SlideShare ist ein Scribd-Unternehmen logo
1 von 81
Downloaden Sie, um offline zu lesen
Analyzing OpenStreetMap
                       using CartoDB

Sunday, October 14, 12
Senior scientist and developer @vizzuality
          Find me @andrewxhill




Sunday, October 14, 12
User, developer, and pusher of limits @cartodb
          Find me @andrewxhill




Sunday, October 14, 12
blog.cartodb.com
Sunday, October 14, 12
So tell me already,
         What is CartoDB?




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
CartoDB is a tool to build applications
          and master your geospatial data




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Importing OSM data into CartoDB
            it’s sooooo easy




Sunday, October 14, 12
We support directly importing OSM
            and other formats too!
                 shp, csv, kml, etc




Sunday, October 14, 12
CartoDB uses osm2pgsql
            it keeps it simple




Sunday, October 14, 12
Sunday, October 14, 12
1 OSM file becomes 4 CartoDB tables

                         1. Points
                         2. Polygons
                         3. Roads
                         4. Linestrings




Sunday, October 14, 12
Import local data from .org or mirror
            simple drag-drop support on most browsers




Sunday, October 14, 12
Or! Import directly from URL
            www.openstreetmap.org




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
From here the sky is the limit
            combine SQL, CartoCSS, and APIs with ease




Sunday, October 14, 12
no. seriously.




Sunday, October 14, 12
SQL
                         remember. it’s everywhere




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
EMBED
                          sql is everywhere




Sunday, October 14, 12
Sunday, October 14, 12
SQL API
                          sql is everywhere




Sunday, October 14, 12
Sunday, October 14, 12
youraccount/osmtable/11/1022/679.png




                     youraccount/osmtable/11/1022/679.png?yada WHERE rail
Sunday, October 14, 12
CREATIVITY sql is everywhere




Sunday, October 14, 12
not for me




Sunday, October 14, 12
http://goo.gl/orkoq
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
CLIENT SIDE     Leaflet, Google Maps, Backbone, D3




Sunday, October 14, 12
Sunday, October 14, 12
OR
                         more practical things




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
INNOVATION     they don’t let us sleep...




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
_I want to see ‘X’ over time
                         using the SQL API with big data




Sunday, October 14, 12
Sunday, October 14, 12
WITH	
  hgrid	
  
          	
  	
  	
  	
  	
  AS	
  (SELECT	
  Cdb_rectanglegrid(Cdb_xyz_extent(8,	
  12,	
  5),	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Cdb_xyz_resolution(5)	
  *	
  4,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Cdb_xyz_resolution(5)	
  *	
  4)	
  AS	
  cell)	
  
          SELECT	
  x,	
  
          	
  	
  	
  	
  	
  	
  	
  y,	
  
          	
  	
  	
  	
  	
  	
  	
  Array_agg(c)	
  vals,	
  
          	
  	
  	
  	
  	
  	
  	
  Array_agg(d)	
  dates	
  
          FROM	
  	
  	
  (SELECT	
  St_xmax(hgrid.cell)	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  x,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  St_ymax(hgrid.cell)	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  y,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Count(i.cartodb_id)	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  c,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Floor((	
  Date_part('epoch',	
  built)	
  -­‐	
  -­‐10418716800	
  )	
  /	
  32837875)	
  d	
  
          	
  	
  	
  	
  	
  	
  	
  	
  FROM	
  	
  	
  hgrid,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  us_po_offices	
  i	
  
          	
  	
  	
  	
  	
  	
  	
  	
  WHERE	
  	
  St_intersects(i.the_geom_webmercator,	
  hgrid.cell)	
  
          	
  	
  	
  	
  	
  	
  	
  	
  GROUP	
  	
  BY	
  hgrid.cell,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Floor((	
  Date_part('epoch',	
  built)	
  -­‐	
  -­‐10418716800	
  )	
  /	
  32837875)	
  
          	
  	
  	
  	
  	
  	
  	
  )	
  f	
  
          GROUP	
  	
  BY	
  x,	
  
          	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  y




Sunday, October 14, 12
Raw                   Datacube

                    1000

                                                                      300
                         100
                                               70


                          10

                               3
                                                           2
                           1                                                      1.5
                                         1.2
                                   3mb              70mb                  300mb




            Payload sizes
Sunday, October 14, 12
http://goo.gl/TsGsr
Sunday, October 14, 12
https://dl.dropbox.com/u/580074/osm_edits_in_madrid.mov

Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
That’s CartoDB +
               OpenStreetMap in a nutshell
            come talk to me, I’m sure I missed much more




Sunday, October 14, 12
Sunday, October 14, 12
Sunday, October 14, 12
xº




Sunday, October 14, 12
Thanks!
         @andrewxhill




Sunday, October 14, 12

Weitere ähnliche Inhalte

Ähnlich wie Using CartoDB to analyze OpenStreetMap data

OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012
Theo Schlossnagle
 
Ks2009 Semanticweb In Action
Ks2009 Semanticweb In ActionKs2009 Semanticweb In Action
Ks2009 Semanticweb In Action
Rinke Hoekstra
 
D3.js capita selecta
D3.js capita selectaD3.js capita selecta
D3.js capita selecta
Joris Klerkx
 

Ähnlich wie Using CartoDB to analyze OpenStreetMap data (20)

WebGL and three.js
WebGL and three.jsWebGL and three.js
WebGL and three.js
 
Keeping responsive into the future by Chris mills
Keeping responsive into the future by Chris millsKeeping responsive into the future by Chris mills
Keeping responsive into the future by Chris mills
 
Writing your own RDD for fun and profit
Writing your own RDD for fun and profitWriting your own RDD for fun and profit
Writing your own RDD for fun and profit
 
Mongo db for C# Developers
Mongo db for C# DevelopersMongo db for C# Developers
Mongo db for C# Developers
 
Recommender Systems with Ruby (adding machine learning, statistics, etc)
Recommender Systems with Ruby (adding machine learning, statistics, etc)Recommender Systems with Ruby (adding machine learning, statistics, etc)
Recommender Systems with Ruby (adding machine learning, statistics, etc)
 
Augmented Reality with JavaScript and Appcelerator Titanium
Augmented Reality with JavaScript and Appcelerator TitaniumAugmented Reality with JavaScript and Appcelerator Titanium
Augmented Reality with JavaScript and Appcelerator Titanium
 
Dynamic C++ Silicon Valley Code Camp 2012
Dynamic C++ Silicon Valley Code Camp 2012Dynamic C++ Silicon Valley Code Camp 2012
Dynamic C++ Silicon Valley Code Camp 2012
 
Productionalizing Spark Streaming
Productionalizing Spark StreamingProductionalizing Spark Streaming
Productionalizing Spark Streaming
 
Bringing the Semantic Web closer to reality: PostgreSQL as RDF Graph Database
Bringing the Semantic Web closer to reality: PostgreSQL as RDF Graph DatabaseBringing the Semantic Web closer to reality: PostgreSQL as RDF Graph Database
Bringing the Semantic Web closer to reality: PostgreSQL as RDF Graph Database
 
Rails Sojourn: One Man's Journey - Wicked Good Ruby Conference 2013
Rails Sojourn: One Man's Journey - Wicked Good Ruby Conference 2013Rails Sojourn: One Man's Journey - Wicked Good Ruby Conference 2013
Rails Sojourn: One Man's Journey - Wicked Good Ruby Conference 2013
 
Improving PySpark Performance - Spark Beyond the JVM @ PyData DC 2016
Improving PySpark Performance - Spark Beyond the JVM @ PyData DC 2016Improving PySpark Performance - Spark Beyond the JVM @ PyData DC 2016
Improving PySpark Performance - Spark Beyond the JVM @ PyData DC 2016
 
Introduction to the Hadoop Ecosystem with Hadoop 2.0 aka YARN (Java Serbia Ed...
Introduction to the Hadoop Ecosystem with Hadoop 2.0 aka YARN (Java Serbia Ed...Introduction to the Hadoop Ecosystem with Hadoop 2.0 aka YARN (Java Serbia Ed...
Introduction to the Hadoop Ecosystem with Hadoop 2.0 aka YARN (Java Serbia Ed...
 
Zeno rocha - HTML5 APIs para Mobile
Zeno rocha - HTML5 APIs para MobileZeno rocha - HTML5 APIs para Mobile
Zeno rocha - HTML5 APIs para Mobile
 
SassConf: It takes a village to raise a stylesheet
SassConf: It takes a village to raise a stylesheetSassConf: It takes a village to raise a stylesheet
SassConf: It takes a village to raise a stylesheet
 
OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012
 
Getting the best performance with PySpark - Spark Summit West 2016
Getting the best performance with PySpark - Spark Summit West 2016Getting the best performance with PySpark - Spark Summit West 2016
Getting the best performance with PySpark - Spark Summit West 2016
 
Mapnik Sotm 2007
Mapnik Sotm 2007Mapnik Sotm 2007
Mapnik Sotm 2007
 
Ks2009 Semanticweb In Action
Ks2009 Semanticweb In ActionKs2009 Semanticweb In Action
Ks2009 Semanticweb In Action
 
D3.js capita selecta
D3.js capita selectaD3.js capita selecta
D3.js capita selecta
 
RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)
 

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 

Using CartoDB to analyze OpenStreetMap data