SlideShare a Scribd company logo
1 of 21
1© Copyright 2013 Pivotal. All rights reserved. 1© Copyright 2013 Pivotal. All rights reserved.
Climate Data Lake: Empowering Citizen
Scientists in Acadia National Park
Srivatsan Ramanujam
Principal Data Scientist, Pivotal
@being_bayesian
John Cardente
Distinguished Engineer/Lead Data Scientist, EMC
@johncardente
19-Feb-2015
2© Copyright 2013 Pivotal. All rights reserved. 2© Copyright 2013 Pivotal. All rights reserved.
Climate Change is happening
Source: NASA
3© Copyright 2013 Pivotal. All rights reserved.
Source: National Geographic
At the Ice Caps…
From Chasing Ice
by James Balog
4© Copyright 2013 Pivotal. All rights reserved.
And in the
Oceans…
5© Copyright 2013 Pivotal. All rights reserved. 5© Copyright 2013 Pivotal. All rights reserved.
Weather is Nature’s clock
6© Copyright 2013 Pivotal. All rights reserved. 6© Copyright 2013 Pivotal. All rights reserved.
And the clock is shifting
Source: EPA
7© Copyright 2013 Pivotal. All rights reserved. 7© Copyright 2013 Pivotal. All rights reserved.
English Oak Winter Moth Pied Flycatcher
Both et al. 2006 Nature
EARLIER SAME TIME
EACH YEAR
Disrupting species interactions
8© Copyright 2013 Pivotal. All rights reserved. 8© Copyright 2013 Pivotal. All rights reserved.
…the study of the timing of recurring plant and animal life-
cycle stages, or phenophases, and their relationship to
environmental conditions.
Phenology
Source: USA National Phenology Network
9© Copyright 2013 Pivotal. All rights reserved. 9© Copyright 2013 Pivotal. All rights reserved.
Acadia National Park
Source: Wikipedia
A key phenology
observation point
10© Copyright 2013 Pivotal. All rights reserved. 10© Copyright 2013 Pivotal. All rights reserved.
Citizen Science, the “Hadoop” of Phenology
11© Copyright 2013 Pivotal. All rights reserved.
Challenges impeding scientific progress
 A multitude of disparate data sources
 Different approaches to data conditioning
 Different analysis platforms and scripts
Inconsistent data treatment distracts the
scientific debate from the findings!
12© Copyright 2013 Pivotal. All rights reserved.
Challenges to encouraging citizen science
 Different infrastructures for data collection
 Unable to see how contributions help science
 Inability to analyze the data and collaborate with scientists
Missing a feedback loop to encourage and
engage citizen scientists
13© Copyright 2013 Pivotal. All rights reserved.
EMC Federation teams up with Earthwatch
14© Copyright 2013 Pivotal. All rights reserved.
Objectives
• Authoritative, curated data repository
• Shared analysis platform and software libraries
• Web portals to
– Show citizen scientists how contributions benefit science
– Present data visualization and exploration tools
– Provide access to data sets for volunteer analysis
– Offer common data collection APIs and interfaces
– Host forums to interact with leading scientists
15© Copyright 2013 Pivotal. All rights reserved.
Climate Data Lake
PL/X
Hadoop++
Data
Data Lake Foundation
Explore
CloudFoundry
Collect
Isilon ECS
16© Copyright 2013 Pivotal. All rights reserved.
The kick-off expedition at Acadia
17© Copyright 2013 Pivotal. All rights reserved.
Post kick-off activities
• Established partnerships with data providers
• Stood up initial Data Lake platform
• Active collaboration across all participants on data
conditioning, analysis, feature selection, and visualization
• Launching an initial web presence in March
18© Copyright 2013 Pivotal. All rights reserved.
What’s next
• Pursuing the “full vision” using Federation Technologies
• Talking with other potential corporate sponsors
• Exploring ways to expand support to other climate and
academic projects
19© Copyright 2013 Pivotal. All rights reserved. 19© Copyright 2013 Pivotal. All rights reserved.
20© Copyright 2013 Pivotal. All rights reserved.
Learn More
• White House Press Release:
Harnessing Climate Data to Boost
Ecosystem & Water Resilience
• Pivotal Blog: Pivotal Data Science
Looks at Climate Change @ Acadia
NP
• EMC Reflections Blog: Big Data vs.
Climate Change
BlogsEMC TV video
21© Copyright 2013 Pivotal. All rights reserved.
The Team
@alyssacaddle1
@stevendozen
@johncardente
@lilewite
@being_bayesian
@maryanngarwood
@emctv
@TheMatthewNolan
@johnnysuire
@sriauggie31
@earthwatch_org
@schoodicinst
@hwschoodic
+ many more (not on twitter ) !

More Related Content

What's hot

9. Media Exposure- DNA News
9. Media Exposure- DNA News9. Media Exposure- DNA News
9. Media Exposure- DNA News
Jaymin Gajjar
 

What's hot (7)

Geothermal Energy - Global Development Status
Geothermal Energy - Global Development StatusGeothermal Energy - Global Development Status
Geothermal Energy - Global Development Status
 
Keynote presentation at GEORG Geothermal Workshop, Nov. 24, 2016
Keynote presentation at GEORG Geothermal Workshop, Nov. 24, 2016Keynote presentation at GEORG Geothermal Workshop, Nov. 24, 2016
Keynote presentation at GEORG Geothermal Workshop, Nov. 24, 2016
 
Future Energy Summit 2017 - Environmental Law & Policy Center
Future Energy Summit 2017 - Environmental Law & Policy CenterFuture Energy Summit 2017 - Environmental Law & Policy Center
Future Energy Summit 2017 - Environmental Law & Policy Center
 
Nha Renewables Mann
Nha Renewables MannNha Renewables Mann
Nha Renewables Mann
 
Energy Research and Innovation
Energy Research and InnovationEnergy Research and Innovation
Energy Research and Innovation
 
Presentation
Presentation Presentation
Presentation
 
9. Media Exposure- DNA News
9. Media Exposure- DNA News9. Media Exposure- DNA News
9. Media Exposure- DNA News
 

Similar to Climate Data Lake: Empowering Citizen Scientists in Acadia National Park

Introdution to Landsat and Google Earth Engine
Introdution to Landsat and Google Earth EngineIntrodution to Landsat and Google Earth Engine
Introdution to Landsat and Google Earth Engine
Veerachai Tanpipat
 
Climate Data Sharing for Urban Resilience - OGC Testbed 11
Climate Data Sharing for Urban Resilience - OGC Testbed 11Climate Data Sharing for Urban Resilience - OGC Testbed 11
Climate Data Sharing for Urban Resilience - OGC Testbed 11
George Percivall
 
2013 keynote com.geo_reed v2
2013 keynote com.geo_reed v22013 keynote com.geo_reed v2
2013 keynote com.geo_reed v2
Carl Reed
 
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
GEO Analytics Canada
 

Similar to Climate Data Lake: Empowering Citizen Scientists in Acadia National Park (20)

Andy Fox DART
Andy Fox DARTAndy Fox DART
Andy Fox DART
 
ICHEC - Observation systems, technologies and big data
ICHEC - Observation systems, technologies and big dataICHEC - Observation systems, technologies and big data
ICHEC - Observation systems, technologies and big data
 
Introdution to Landsat and Google Earth Engine
Introdution to Landsat and Google Earth EngineIntrodution to Landsat and Google Earth Engine
Introdution to Landsat and Google Earth Engine
 
Improving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domainImproving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domain
 
Climate Data Sharing for Urban Resilience - OGC Testbed 11
Climate Data Sharing for Urban Resilience - OGC Testbed 11Climate Data Sharing for Urban Resilience - OGC Testbed 11
Climate Data Sharing for Urban Resilience - OGC Testbed 11
 
Managing Social Science Data from the Arctic with ELOKA, ACADIS, NSIDC, and (...
Managing Social Science Data from the Arctic with ELOKA, ACADIS, NSIDC, and (...Managing Social Science Data from the Arctic with ELOKA, ACADIS, NSIDC, and (...
Managing Social Science Data from the Arctic with ELOKA, ACADIS, NSIDC, and (...
 
Scoping meeting presentation 4 29-13
Scoping meeting presentation 4 29-13Scoping meeting presentation 4 29-13
Scoping meeting presentation 4 29-13
 
Facing data sharing in a heterogeneous research community: lights and shadows...
Facing data sharing in a heterogeneous research community: lights and shadows...Facing data sharing in a heterogeneous research community: lights and shadows...
Facing data sharing in a heterogeneous research community: lights and shadows...
 
2013 keynote com.geo_reed v2
2013 keynote com.geo_reed v22013 keynote com.geo_reed v2
2013 keynote com.geo_reed v2
 
Nisqually Funding Mechanisms Workshop Part 2
Nisqually Funding Mechanisms Workshop Part 2Nisqually Funding Mechanisms Workshop Part 2
Nisqually Funding Mechanisms Workshop Part 2
 
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
Advances in satellite EO data analytics for aquaculture - Aquaculture Canada ...
 
Esri and the Scientific Community
Esri and the Scientific CommunityEsri and the Scientific Community
Esri and the Scientific Community
 
The changing landscape of science
The changing landscape of scienceThe changing landscape of science
The changing landscape of science
 
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
 
Herring Noaa Spring08
Herring Noaa Spring08Herring Noaa Spring08
Herring Noaa Spring08
 
IEDA Overview & Updates, March 2014
IEDA Overview & Updates, March 2014IEDA Overview & Updates, March 2014
IEDA Overview & Updates, March 2014
 
LPS19 ExtremeEarth Project
LPS19 ExtremeEarth ProjectLPS19 ExtremeEarth Project
LPS19 ExtremeEarth Project
 
Ease Leads to Exposure , Exposure Leads to Adoption
Ease Leads to Exposure, Exposure Leads to AdoptionEase Leads to Exposure, Exposure Leads to Adoption
Ease Leads to Exposure , Exposure Leads to Adoption
 
'Planning Reform on the island of Ireland: From Policy to Practice', Cooperat...
'Planning Reform on the island of Ireland: From Policy to Practice', Cooperat...'Planning Reform on the island of Ireland: From Policy to Practice', Cooperat...
'Planning Reform on the island of Ireland: From Policy to Practice', Cooperat...
 
Experiences as a producer, consumer and observer of open data
Experiences as a producer, consumer and observer of open dataExperiences as a producer, consumer and observer of open data
Experiences as a producer, consumer and observer of open data
 

More from Srivatsan Ramanujam

More from Srivatsan Ramanujam (9)

Machine Learning Driven Sales and Marketing for Everyone
Machine Learning Driven Sales and Marketing for EveryoneMachine Learning Driven Sales and Marketing for Everyone
Machine Learning Driven Sales and Marketing for Everyone
 
Data Science for predictive maintenance in connected vehicles
Data Science for predictive maintenance in connected vehiclesData Science for predictive maintenance in connected vehicles
Data Science for predictive maintenance in connected vehicles
 
All thingspython@pivotal
All thingspython@pivotalAll thingspython@pivotal
All thingspython@pivotal
 
Data Driven Action : A Primer on Data Science
Data Driven Action : A Primer on Data ScienceData Driven Action : A Primer on Data Science
Data Driven Action : A Primer on Data Science
 
Analyzing Power of Tweets in Predicting Commodity Futures
Analyzing Power of Tweets in Predicting Commodity FuturesAnalyzing Power of Tweets in Predicting Commodity Futures
Analyzing Power of Tweets in Predicting Commodity Futures
 
Pivotal Data Labs - Technology and Tools in our Data Scientist's Arsenal
Pivotal Data Labs - Technology and Tools in our Data Scientist's Arsenal Pivotal Data Labs - Technology and Tools in our Data Scientist's Arsenal
Pivotal Data Labs - Technology and Tools in our Data Scientist's Arsenal
 
A Pipeline for Distributed Topic and Sentiment Analysis of Tweets on Pivotal ...
A Pipeline for Distributed Topic and Sentiment Analysis of Tweets on Pivotal ...A Pipeline for Distributed Topic and Sentiment Analysis of Tweets on Pivotal ...
A Pipeline for Distributed Topic and Sentiment Analysis of Tweets on Pivotal ...
 
PyMADlib - A Python wrapper for MADlib : in-database, parallel, machine learn...
PyMADlib - A Python wrapper for MADlib : in-database, parallel, machine learn...PyMADlib - A Python wrapper for MADlib : in-database, parallel, machine learn...
PyMADlib - A Python wrapper for MADlib : in-database, parallel, machine learn...
 
Python Powered Data Science at Pivotal (PyData 2013)
Python Powered Data Science at Pivotal (PyData 2013)Python Powered Data Science at Pivotal (PyData 2013)
Python Powered Data Science at Pivotal (PyData 2013)
 

Recently uploaded

Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
amitlee9823
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
JoseMangaJr1
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
amitlee9823
 

Recently uploaded (20)

Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
 
Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
ELKO dropshipping via API with DroFx.pptx
ELKO dropshipping via API with DroFx.pptxELKO dropshipping via API with DroFx.pptx
ELKO dropshipping via API with DroFx.pptx
 
Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 

Climate Data Lake: Empowering Citizen Scientists in Acadia National Park

  • 1. 1© Copyright 2013 Pivotal. All rights reserved. 1© Copyright 2013 Pivotal. All rights reserved. Climate Data Lake: Empowering Citizen Scientists in Acadia National Park Srivatsan Ramanujam Principal Data Scientist, Pivotal @being_bayesian John Cardente Distinguished Engineer/Lead Data Scientist, EMC @johncardente 19-Feb-2015
  • 2. 2© Copyright 2013 Pivotal. All rights reserved. 2© Copyright 2013 Pivotal. All rights reserved. Climate Change is happening Source: NASA
  • 3. 3© Copyright 2013 Pivotal. All rights reserved. Source: National Geographic At the Ice Caps… From Chasing Ice by James Balog
  • 4. 4© Copyright 2013 Pivotal. All rights reserved. And in the Oceans…
  • 5. 5© Copyright 2013 Pivotal. All rights reserved. 5© Copyright 2013 Pivotal. All rights reserved. Weather is Nature’s clock
  • 6. 6© Copyright 2013 Pivotal. All rights reserved. 6© Copyright 2013 Pivotal. All rights reserved. And the clock is shifting Source: EPA
  • 7. 7© Copyright 2013 Pivotal. All rights reserved. 7© Copyright 2013 Pivotal. All rights reserved. English Oak Winter Moth Pied Flycatcher Both et al. 2006 Nature EARLIER SAME TIME EACH YEAR Disrupting species interactions
  • 8. 8© Copyright 2013 Pivotal. All rights reserved. 8© Copyright 2013 Pivotal. All rights reserved. …the study of the timing of recurring plant and animal life- cycle stages, or phenophases, and their relationship to environmental conditions. Phenology Source: USA National Phenology Network
  • 9. 9© Copyright 2013 Pivotal. All rights reserved. 9© Copyright 2013 Pivotal. All rights reserved. Acadia National Park Source: Wikipedia A key phenology observation point
  • 10. 10© Copyright 2013 Pivotal. All rights reserved. 10© Copyright 2013 Pivotal. All rights reserved. Citizen Science, the “Hadoop” of Phenology
  • 11. 11© Copyright 2013 Pivotal. All rights reserved. Challenges impeding scientific progress  A multitude of disparate data sources  Different approaches to data conditioning  Different analysis platforms and scripts Inconsistent data treatment distracts the scientific debate from the findings!
  • 12. 12© Copyright 2013 Pivotal. All rights reserved. Challenges to encouraging citizen science  Different infrastructures for data collection  Unable to see how contributions help science  Inability to analyze the data and collaborate with scientists Missing a feedback loop to encourage and engage citizen scientists
  • 13. 13© Copyright 2013 Pivotal. All rights reserved. EMC Federation teams up with Earthwatch
  • 14. 14© Copyright 2013 Pivotal. All rights reserved. Objectives • Authoritative, curated data repository • Shared analysis platform and software libraries • Web portals to – Show citizen scientists how contributions benefit science – Present data visualization and exploration tools – Provide access to data sets for volunteer analysis – Offer common data collection APIs and interfaces – Host forums to interact with leading scientists
  • 15. 15© Copyright 2013 Pivotal. All rights reserved. Climate Data Lake PL/X Hadoop++ Data Data Lake Foundation Explore CloudFoundry Collect Isilon ECS
  • 16. 16© Copyright 2013 Pivotal. All rights reserved. The kick-off expedition at Acadia
  • 17. 17© Copyright 2013 Pivotal. All rights reserved. Post kick-off activities • Established partnerships with data providers • Stood up initial Data Lake platform • Active collaboration across all participants on data conditioning, analysis, feature selection, and visualization • Launching an initial web presence in March
  • 18. 18© Copyright 2013 Pivotal. All rights reserved. What’s next • Pursuing the “full vision” using Federation Technologies • Talking with other potential corporate sponsors • Exploring ways to expand support to other climate and academic projects
  • 19. 19© Copyright 2013 Pivotal. All rights reserved. 19© Copyright 2013 Pivotal. All rights reserved.
  • 20. 20© Copyright 2013 Pivotal. All rights reserved. Learn More • White House Press Release: Harnessing Climate Data to Boost Ecosystem & Water Resilience • Pivotal Blog: Pivotal Data Science Looks at Climate Change @ Acadia NP • EMC Reflections Blog: Big Data vs. Climate Change BlogsEMC TV video
  • 21. 21© Copyright 2013 Pivotal. All rights reserved. The Team @alyssacaddle1 @stevendozen @johncardente @lilewite @being_bayesian @maryanngarwood @emctv @TheMatthewNolan @johnnysuire @sriauggie31 @earthwatch_org @schoodicinst @hwschoodic + many more (not on twitter ) !

Editor's Notes

  1. John
  2. John
  3. John
  4. John
  5. Vatsan
  6. Vatsan
  7. Vatsan
  8. Vatsan
  9. John
  10. John
  11. Vatsan
  12. John
  13. John, Vatsan
  14. Plug in blog links
  15. John
  16. John
  17. John
  18. John