Guest lecture for the course SIO 110, Introduction to GIS and GPS for Scientists, taught by Prof. Bernard Minster, UC-San Diego, San Diego, CA. Also presented to GEOL 371, Introduction to Geographic Information Systems, taught by Prof. James Clark, Wheaton College, Wheaton, IL.
1. Dawn Wright, Ph.D.
Esri Chief Scientist
Maps for Solving
the Worlds’
Biggest Problems
SIO 110: Intro to GIS and GPS for Scientists
Lesson 20
Winter Term, March 11, 2016
2. Maps for Solving the World’s Biggest Problems
Helping to guide the science behind it and the science done with it.
www.esri.com/about-esri
3. • Science at Esri
• Societal Applications
• New Areas for GIS
• Opportunities for You
4. Societal drivers of science are key.
How the Earth
should LOOK.
How we should
look AT the Earth.
Increasing fundamental
scientific understanding
Enabling stewardship
of the environment
Promoting
economic vitality
Protecting life
and property
How the Earth works.
Esri View of Science
esriurl.com/scicomm
5. How the Earth works…. How the Earth should look ….
How we should look at the Earth….
Agricultural Science
Hydrology
Ecology
Climate Science
Geology/Geophysics
Conservation Biology
Sustainability Science
/Geodesign
Forestry
Ocean Science
Geographic
Information Science /
Computer Science
8. Recent Esri Contributions to Science
Ecological Land Units
Esri + USGS
Scientific Python
R – ArcGIS Community
R-arcgis.github.io
Group on Earth Observations MOU
Improved Cloud Access to Imagery
Esri + NASA, MRF+LERC
Open
Water
Data
Open Water Data Initiative
Esri + USGS, CUAHSI, NOAA NWS, FEMA
New Science Books
Ecological Marine Units
Esri + USGS, MCI, NOAA, NatureServe, WHOI,
others
Citizen Science
9. Land Cover
Lithology
Landform
Bioclimate
Example: Warm Wet Plains on Metamorphic Rock
with Mostly Deciduous Forest
48,872 Combinations (Facets)
3,923 Unique Land Units/Colors
www.aag.org/global_ecosystems
esriurl.com/elu
esriurl.com/ecotapestry
esriurl.com/landscape
Ecological Land Units
14. Esri Contributions to Science
Ecological Land Units
Esri + USGS
Open
Water
Data
Scientific Python
R – ArcGIS Community
Open Water Data Initiative
Ecological Marine Units
R-arcgis.github.io
Esri + USGS, MCI, NOAA, NatureServe, others
Citizen Science
GEOSS MOU
Improved Cloud Access to Imagery
Esri + NASA, MRF+LERC
Esri + USGS, CUAHSI, NOAA NWS, FEMA
New Science Books
15. GIS as the Ultimate Integrator
Opening Access and Engaging Everyone
NetworkedSegmented
Creating Shared Information and Facilitating Collaboration
Shared
Geographic
UnderstandingStovepiped
Data
16. For Applying Geography
GIS Provides a Framework and Process
Observational
Science
Modeling and
Predicting
Analysis and
Interpretation
Planning and
Policy
Decision
Making
Action
Becoming Essential to Everything We Do . . .
17. Thanks to Carthage Smith of OECD, Heidi Laine of U. Helsinki, RDA Plenary 7
GIS as Part of “Open Science”
Providing a Platform for Open and “Intelligent” Access
Research
Data,
Materials
Scientific
Pubs
Access for
Scientists,
Companies,
the Public
Digital
Applications
Source
Code
Re-Asserting
Science as a
Global Public
Good
18. Industry Formats
Open Standards
Open Platform Ensuring Interoperability
. . . Integrated into Thousands of Systems
Open Software
REST
OPENDAP
WMS
WCS
CSW
GML
WFS
KML
WMTS
WPS
SLD
GeoPackage
SOAP
IFC
LAS
NetCDF
SQL
Extensible
Architecture
Open Source
Integration
Education
Materials
Open Source
Contributions (300+)
Embeddable
Components
Open
APIs
Open Data
Access
JSON
Product
Integration
AutoCAD
SAP HANA
IBM Cognos
Adobe Creative Cloud
AWS
Azure
MS Office
Imagery
DBMSs
DXF
DWGCOLLADA
OLEDB
FileGDB
AIXM
WaterML
CityGML
INSPIRE
OneGeology
Hadoop
DGN
Web Scene (I3S)
LERC
Shapefiles
19. Open Source Solutions
Delivering Innovation & Best Practices
Public Safety and
Emergency Management
• No Cost
• Easily Configurable
• Fully Supported
Hundreds of Ready-to-Use Maps & Apps
Utilities
Government
Military and
Security
500,000+ Downloads
Open Source
Solutions
21. Environmental Monitoring and Assessment
Monarch Butterfly
Habitat Conservation
USFWS
Conservation Reserve Program
USDA
Climate Change Scorecard
Forest Services
Calculating
First Ice Freeze
Monitoring Drought
NOAA
Fish Habitat
Assessment
USFWS
Trust for Public Lands
Green Infrastructure
Planning
Water Resource
Restoration
Arizona
Commercial Fishing
BOEM
22. Preparing for and Responding to Disasters
Nepal Earthquake
Response
FEMA
Vulnerable Populations
Wildfire
Damage Assessment
Oregon
Fire Alert System
Global Forest Watch
Red Cross
Optimizing
Humanitarian Resources
Boston Storm Weather
MEMA
Snow Fall
Coastal Flood Analysis
New York City,
New York
Power Outage
Idaho
Modeling Floods
Lake Champlain
23. GIS for Sustainable Development
Access to
Healthcare
Renewable Energy
Field Data
Collection
Demographics
Access to Education
Forest Management
Urban Design | Smart Communities
Water Management
27. • Faster, Easier & Everywhere
• Web Scenes in Online & Server
• Full KML Support
3D Visualization and Analysis
Building Models
Lidar Analysis
Thematic
Visualization
Virtual Cities
Rule-Based Models
Analytics
ArcGIS Earth
3D Cartography
Virtual Globes
28. Advancing the Science of Geography
Aggregation
Hot Spots
Charting
Mode-Specific Routing
Statistical Clustering
Web BrowserDesktop
InterpolationAnomaly Detection
Living Atlas
Integration
New Raster Functions
Bayesian Regression
(EBK)
Scientific
Data Support
Faster Geocoding (230+%)
Location Allocation
Buffer
Spatial Analysis Providing Insights and Understanding
Integrating Analysis Tools
Data Exploration
29. Supporting Single Scenes . . .
. . . and Massive Collections
• Powerful Analysis Tools (100+)
• Workflow Templates
• Additional Sensor Support
Imagery Integrated Capabilities for Management, Analysis, and Serving
Oblique Imagery and Measurements
Object-Based Image Analysis
Dynamic Processing Chains
Scientific Data
Full-Motion Video
UAV/Drone Support
Drone2Map (NEW)
Image Classification
Accuracy Assessment
30. Providing Massively Parallel Processing
. . . Creating New Insights
Big Data GeoAnalytics and Visualization of Massive Data
Raw Data
Parallelized Analytics
on Vector and Raster Data
Aggregated Data
Hot Spots
Coming Later
This Year…
31. Real-Time Integrating and Leveraging Dynamic Data
• Monitoring, Analysis and Alerting
• Stationary and Moving Events
• Large and High-Velocity Data Streams
Enabling Real-Time GIS Applications . . .
. . . Powering Responsive Action
Boston Marathon
GeoEvent
Server
Integrating Sensor Networks and IoT
Real Time Data
32. Over 1 Million Items, ~200 Tb of Data
160 M Map Requests by 1.6 M Users Per Day
4-5 B Map Tile Requests Per Month
Online Content A Living Atlas of the World
The Very Best of ArcGIS Online… Authoritative… Ready-to-Use
Basemaps | Imagery | Demographics | Landscape
Land Cover
Elevation
HIFLD Open
A16 Layers
NAIP
Federal+Academic Content
Landsat/GLDAS
NOAA
Statistics/Population
Basemaps
Images
Tens of Thousands of
Open Data Sets
34. Easy, Powerful, and Ready-to-Use
Apps Making GIS Available Everywhere
Public
Story Maps
Open Data
Office
ArcGIS EarthDashboardMaps for OfficeField
Navigator
Collector
Survey123
Workforce
Explorer
InsightsDrone2Map
Adobe
Creative Cloud
Crowdsourcing
57. Best wishes to you in
your work
GIS can help you expand your impact….
But to realize its full impact GIS needs you
and your generation. . .
. . . Understanding, Learning, Collaborating,
Innovating
Dawn Wright
Email: dwright@esri.com
Twitter: @deepseadawn
esriurl.com/scicomm
Hinweis der Redaktion
Esri focuses on mapping and data for conservation, disaster aid and relief, climate change mitigation and adaptation, “geodesigning” land and ocean space use to more closely follow natural systems, protecting freshwater resources, in short, using maps and geographic analysis to make the world a better place.
The mandate of the Esri Chief Scientist is to establish Esri as a bonafide member of the scientific community, not just a vendor of software.
Mention scientific advisory board service to NOAA, EPA; collaborations with NASA, connections to ORNL through NSF-funded CyberGIS project
There are many natural science domains in which GIS is being used effectively to understand how the Earth works. The above are areas that Esri is particularly strong in.
This generalized scientific process shows one way of looking at a cycle for conducting (quantitative) research
How and WHERE will climate change impact forest composition, coastal habitats, etc.?
What factors most affect the SPREAD of infectious diseases and invasive species?
How much will sea level change on a range of SPATIAL and TEMPORAL scales?
How and WHERE will climate change impact forest composition, coastal habitats, etc.?
What factors most affect the SPREAD of infectious diseases and invasive species?
How much will sea level change on a range of SPATIAL and TEMPORAL scales?
Clockwise from upper left (based on a slide presented at the FedGIS conference in Washington, DC, hence the call-outs to US federal government agencies):
ELU – Ecological Land Units
The Ecological Land Units (ELU) project is a collaboration between Esri and Dr. Roger Sayre of the USGS. It was officially launched last December at the ACES 2014: A Community on Ecosystem Services meeting in Washington, DC. For the ELU, we essentially undertook a massive biophysical stratification of the planet at a finest yet-attempted spatial resolution (250 m) to produce a first ever map of distinct physical environments and their associated land cover. We also offer a concept for delineating ecologically meaningful regions that is essentially both classification-neutral and data-driven. Our intent is to provide scientific support for planning and management (including as an important variable for GIS geodesign models and apps), and to enable understanding of impacts to ecosystems from climate change and other disturbances; hence for valuation of ecosystem SERVICES. In this way, we also offer fulfillment of one of the main recommendations of the White House PCAST report on sustainable environmental capital.
EMU – Ecological Marine Units
See next slides. Esri is collaborating with over 10 partners including the USGS, NOAA, and NatureServe, in developing a standardized, robust, and practical ecosystems classification and map for all the world’s oceans, completely in 3D. Officially commissioned by The Group on Earth Observations (GEO).
Group on Earth Observations MOU
One of the most comprehensive efforts in place to monitor the entire face of the Earth is a group of over 140 governments and leading international organizations (GEO) seeking to establish a fully functioning Global Earth Observation System of Systems (GEOSS). Esri is working with the National Research Council of Italy to integrate public scientific content from ArcGIS Online into the GEOSS data ecosystem, while encouraging the Esri GIS community to participate as contributors and users of GEOSS.
Geoss.maps.arcgis.com
Improved Cloud Access to Imagery: LERC/MRF
Esri and NASA have collaborated to improve access to imagery and raster data stored in the cloud using a combination of two technologies, Meta Raster Format (MRF) and Limited Error Raster Compression (LERC). MRF is an Open raster format originally designed at the NASA JPL to
optimize web access to rasters. LERC is a highly efficient algorithm that provides fast lossless and controlled lossy compression of image and raster data, and is especially suitable for geospatial applications. Esri was recently awarded a US Patent for LERC. LERC is integrated into NASA’s MRF support within GDAL (Geographic Data Abstraction Library), one of the most widely used open source projects in our industry. Esri’s LERC and its integration into MRF will enable our users to significantly reduce storage costs for enterprise image management solutions, and it will likely find its way into virtually every mapping/GIS application stack in use.
http://www.esri.com/esri-news/releases/15-4qtr/esri-and-nasa-collaborate-to-advance-cloud-access-to-imagery
https://blogs.esri.com/esri/arcgis/2015/12/16/storing-large-volumes-of-data-in-the-cloud/
Open Water Data Initiative
Esri is both a participant and stakeholder in the Open Water Data Initiative, as well as a partner in the National Flood Interoperability Experiment, developing spatial data processing and visualization tools. These help Federal agencies make the data as useful and accessible as possible (e.g., for other Federal agencies, state and local govt, water mgmt. authorities, agriculture sector, insurance sector, investment sector, etc)
R – ArcGIS Community
R (aka the R Project for Statistical Computing) is the world’s fastest growing environment for statistical computing. We are working with ArcGIS and R users worldwide to develop a community to promote learning, sharing, and collaboration. This community will include a repository of free, open source, R scripts, geoprocessing tools, and tutorials.
https://blogs.esri.com/esri/esri-insider/2015/07/20/building-a-bridge-to-the-r-community/
R-arcgis.github.io
A whole suite of apps for Citizen Science – esriurl.com/citizens
Scientific Python
To further strengthen the link between GIS and science, we have fully integrated ArcGIS with SciPy, a Python-based ecosystem of open-source software for mathematics, science, and engineering. By integrating the ENTIRE STACK of SciPy modules with ArcGIS we have made developing scientific and technical geoprocessing tools and scripts easier and more efficient.
https://blogs.esri.com/esri/esri-insider/2014/11/05/strengthening-the-link-between-gis-and-science/
Three New Science Books from Esri Press
Features the peer-reviewed work of leading researchers and managers for advancing science through GIS, as well as how to incorporate spatial thinking and GIS technology into research design and analysis.
esripress.esri.com
esriurl.com/ocnsolns
We found 48,872 unique combinations aggregated to 3923 ELUs. In 2015 106,959 unique combos thanks to the updated land forms and land cover, 2010 epoch, Global Land Cover, v. 1.4
Bioclimate, Landform, and Lithology = Drivers of Ecological Character (physical setting)
Land Cover = Response to the Physical Setting
Bioclimates - Global Environmental Stratification (GEnS), U. of Edinburgh - 50 year avg of temp/precip from met stations throughout world
30 arc sec raster, down-sampled to 250-m raster
Landforms – USGS – 250-m raster, derived from GMTED2010
Surficial Lithology - Global Lithological Map (GLiM), Hamburg University, Vector Polygons converted to 250-m raster
Land Cover - GlobCover, 2009, European Space Agency - MARIS satellite, 300 m rez resampled to 250 m
Version 2 recently released in 2015 with updated land cover, 2010 epoch, Global Land Cover, v. 1.4
Only layer that we had an option: GlobCover 2009, GlobeLand30 or MDA’s NaturalVue
GlobCover 2009 offered a richer, more flexible classification, which is compatible with USGS NLCD
NaturalVue was too old.
Both had significant quality issues relative to broad audience acceptance
Today, there are more options. Globeland30 continues to be improved. MDA has produced BaseVue
How did we make the map? Again, we define ecosystems as distinct physical environments and their associated vegetation, so we map ecosystems by first mapping, and then combining in a GIS, global bioclimates, global landforms, global geology, and global land cover.
Characterize the principle ecological land components of the terrestrial surface of the earth in a micro-scale, bottom-up, hierarchical classification process.
Subdivide the land surface of the earth into macro-scale physiographic (geomorphological) areas in a top-down, hierarchical regionalization process.
Combine the physiographic regionalization process with the ecological classification process to develop a hierarchical, ecophysiographic segmentation of the planet.
Weightings of 4 layers: 3, 3, 2, 1
Exploring the clusters in 3D within ArcGIS Pro. (image from Dec 21, 2015)
Exploring the clusters in 2D within EMU prototype Vertical Profile App, Temperature, Cluster 6 at top of water column
NOTE THE DRAFT NAME for this cluster: Very Warm – Oxic – EuHaline (temp, DO, sal)
ELU example was Warm Wet Plains on Metamorphic Rock with Mostly Deciduous Forest (bioclimate, land forms, lithology, land cover)
http://chrismahlke.github.io/emu/
Username: emuuser
Password:24clusters
Notice that many of these projects include many collaborators
Twitter reference: https://twitter.com/heidiklaine/status/704135333034590208
Providing an Open Platform for Collaboration and Innovation
--------------------
Resources
-----------------
59_UrbanForestPathways.jpg: DC’s Urban Forestry Administrator’s arborists map out pathways to the trees they care for. Each arborist has a specific zone, but often cover a need in an adjacent area.
7433_1 USDA FSA: Rich interactive experience showing where voluntary conservation efforts have had an impact on local ecosystems through 30 years of the Conservation Reserve Program.
7432_2 New Orleans, TPL: Priority areas of infrastructure investment that may reduce risk of flooding from stormwater, reduce the urban heat island effect, and address vulnerability of at-risk residents.
80 BOEM: Federally managed commercial fishing revenue (modeled) between 2007-2012. The results of the modeled fishing revenue data are applied to offshore renewable energy planning.
7496_1 USFWS: Habitat Information Tracking System (HabITS) showing coastal and partner project accomplishments , as well as the alignment of these programs with the National Monarch Butterfly Conservation priorities.
87 USFS: Climate Change Performance Scorecard showing results from 2014 – 2015 in USDA Forest Service Regions.
7432_3: Arizona, TPL: Planned restoration water recharge project and surrounding land ownership information.
--------------------
Resources
--------------------
91 MEMA: Winter Storm Jonas expected snowfall totals.
86 HSEMA: Winter Storm Jonas - DC-HSEMA ArcGIS Online snow event map, showing warming shelters, 311 snow calls for service, emergency snow routes and other critical facilities.
91 MEMA: Boston Storm, Feb. 4: Story Maps designed to monitor weather in Massachusetts. Images show pre-storm radar from NOAA, forecasted snowfall totals, and power outages immediately following the storm.
96 FEMA: Vulnerable population affected by East Coast flood event, Flood Journal for FEMA GeoSpatial Framework.
7457_1 USDA, 7447_2 Senator Wyden: Oregon - Wildfire acres burned and cost of suppression increased; Idaho – Wildfire acres burned and fire perimeters.
81 IAFC: Web App - International Association of Fire Chiefs Ready Set Go (RSG) members and 2015 wildfire perimeters provided by GeoMAC. Map provides a fire preparedness tool for RSG members.
106 Global Forest Watch: GFW Fires is a dynamic online forest monitoring and fire alert system that provides near-real time information that can empower people to better combat forest and land fires before they burn out of control. Active fires and wind patterns on September 25, 2015, during the peak of Indonesia's fire season.
77 NGA: Nepal Earthquake Support Map Product.
Regarding SDG goal 2 on Zero Hunger, according to the World Health Organization, moderate malnutrition is defined as a weight-for-age between -3 and -2 z-scores below the median of the WHO child growth standards. It can be due to a low weight-for-height (wasting) or a low height-for-age (stunting) or to a combination of both.
We may get maps, we very often don't get graphs, but we are absolutely hardwired to understand stories. As such, scientists MUST tell their STORY and th the importance of story
Every single scientific success is perfect fodder for a narrative structure
“People are moved by emotion. The best way to emotionally connect other people to our agenda begins with “Once upon a time…”
Science backs up the long-held belief that story is the most powerful means of communicating a message. Over the last several decades psychology has begun a serious study of how story affects the human mind. Results repeatedly show that our attitudes, fears, hopes, and values are strongly influenced by story. In fact, fiction seems to be more effective at changing beliefs than writing that is specifically designed to persuade through argument and evidence.”
http://www.fastcocreate.com/1680581/why-storytelling-is-the-ultimate-weapon
Scientists are often encouraged not to publish their work until it constitutes a complete story.
Why not combine BOTH, especially to take advantage of the power of maps and geography to educate, inform, and inspire people to action as well?
The story map is about using maps in new and innovative ways to get people excited and involved in the world.
Thanks to continuing changes in the Internet, cloud computing, mobile and tablet platforms, and to constant improvements in the software itself, we can now put the power of GIS into the hands of managers, CEOs, reporters, school kids—even policy makers.
“STORIES ARE STICKY”
“People are moved by emotion. The best way to emotionally connect other people to our agenda begins with “Once upon a time…”
Science backs up the long-held belief that story is the most powerful means of communicating a message. Over the last several decades psychology has begun a serious study of how story affects the human mind. Results repeatedly show that our attitudes, fears, hopes, and values are strongly influenced by story. In fact, fiction seems to be more effective at changing beliefs than writing that is specifically designed to persuade through argument and evidence.”
http://www.fastcocreate.com/1680581/why-storytelling-is-the-ultimate-weapon
Scientists are often encouraged not to publish their work until it constitutes a complete story.
Why not combine BOTH, especially to take advantage of the power of maps and geography to educate, inform, and inspire people to action as well?
The story map is about using maps in new and innovative ways to get people excited and involved in the world.
Thanks to continuing changes in the Internet, cloud computing, mobile and tablet platforms, and to constant improvements in the software itself, we can now put the power of GIS into the hands of managers, CEOs, reporters, school kids—even policy makers.
Danish Sargasso Sea Story Map
Technical University of Denmark’s (DTU) research vessel Dana was on an expedition in the Sargasso Sea in March and April 2014 to examine the role of climate-induced changes in spawning zones in the sole violent decline in Europe.
Story map is a new medium for bringing your data alive in interactive map form along with narrative text, images, videos, and other multimedia content to further engage and inspire your audience
Many GMT users are familiar with the Haxby colors of Bill Haxby of Lamont; Esri’s chief cartographer has developed a new color ramp for seafloor geomorphology of Harris et al.
Harris, P. T., M. Macmillan-Lawler, J. Rupp, and E. K. Baker. 2014. Geomorphology of the oceans. Mar. Geol. 352:4-24.
Narrative text with links to further resources as well as to the original data, thoroughly documented with metadata, links to the original journal article where appropriate, etc.
Data from Davies, A. J., and J. M. Guinotte. 2011. Global Habitat Suitability for Framework-Forming Cold-Water Corals. PLoS ONE 6:e18483.
Data from Davies, A. J., and J. M. Guinotte. 2011. Global Habitat Suitability for Framework-Forming Cold-Water Corals. PLoS ONE 6:e18483.
See also this GREAT blog post: 9 Nine Things You Didn’t Know You Could do with Story Maps
https://blogs.esri.com/esri/arcgis/2016/02/16/story-maps-9-things/
As well as Speaking the Language of Spatial Analysis via Story Maps esriurl.com/analyticalstories
At Esri, we believe people can do amazing things with applied geography. Things like protecting natural resources, eradicating disease, growing or starting businesses, and keeping communities safe and informed. Our mapping technology platform is called ArcGIS. It is designed to give you the power to meld data with maps so you can visualize and analyze your world. ArcGIS helps you find meaning in your data and make smarter decisions.