SlideShare a Scribd company logo
1 of 39
Workshop on Workflows on Earth Observation Steven Ramage, OGC [email_address] 21 June 2010,  Sir Clive Granger Building,  University of Nottingham
The importance of workflow ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Description of workflow ,[object Object],[object Object],[object Object]
OGC Interoperability Program ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
OGC Web Services standards ,[object Object],[object Object],[object Object]
OGC Web Services standards ,[object Object],[object Object],[object Object]
“ Chaining” Web Services for decision support … WCS WPS –  Classification WPS - WCTS WFS Internet Web servers OGC Interfaces Service chaining creates  value-added products  Decision Support  Client Geoprocessing worklow developed in OGC testbeds  since 2004 Assess Wildfire Activity
BPEL workflow in OWS-5 Participants chained combinations of services together to address the requirements of geospatial data conflation and image processing. It also addressed an important gap, which was the lack of SOAP (Simple Object Access Protocol) and WSDL (Web Service Description Language) descriptions for those APIs.
BPEL workflow in OWS-5 Both W3C standards are critical for creating and managing workflows using industry standards such as OASIS’s BPEL (Business Process Execution Language).  BPEL is the workflow description language used in many end-user service chaining tools such as Oracle BPEL Designer and George Mason University’s BPEL Power.
Conflation workflow architecture
Conflation workflow architecture The OWS-5 geo-processing workflow thread bound together WFS and WPS services in BPEL scripts to model data conflation in a consistent, repeatable fashion.  This successful prototype signaled the utility of this approach for a host of geospatial tasks that require the combination of many different geospatial services and operations. Fusion activities developed in OWS-7 and will have more focus in this area for OWS-8.
OGC Web Processing Service (WPS) WPS GetCapabilities Execute DescribeProcess Algorithms Repository … … Algorithm 1 Data Handler Repository … … Data Handler A Communication over the web using HTTP WPS-client Web Processing Service
REST-oriented workflow in OWS-5 The SOAP/WSDL/BPEL approach to chaining Web services is one of the most widely used ways to implement service oriented architectures (SOA).  However, other approaches, notably REST (Representational State Transfer) services, are also used to implement services in an enterprise.  Some feel that Web services do not need the extra layer of description provided by SOAP and WSDL to build reliable workflows.
REST-oriented workflow in OWS-5 REST uses HTTP and other parts of the basic Web platform.  In the SWE (Sensor Web Enablement) thread of OWS-5, participants used a REST-based architecture and WfXML to create workflows that allowed raw earth observation data to be acquired from assets, such as the EO-1 satellite, and then utilized by different WPS.  Relevant data were then published and distributed to end-users in formats such as GeoAtom (Atom with GeoRSS extensions) and KML.
Integrating smoke WPS into WfXML-R workflow GMU GRASS SOAP/WSDL GRASS  Image Algebra EO-1 SOS Google Earth Execute ,[object Object],[object Object],[object Object],[object Object],EO Sensor Web Workflow GMU WCS-T GetCapabilities DescribeProcess NGC EO-1 Smoke  WPS Calculated smoke geotiff Classified smoke geotiff Call calculation Call classifier ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
OWS-6 WPS Grid Processing ,[object Object],[object Object],[object Object]
OWS-6 WPS grid processing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
OWS-6 WPS grid processing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Grid-enabled WPS implementations ,[object Object],[object Object],[object Object],[object Object],[object Object]
Grid-enabled WPS implementations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
OGC online resources ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Debris Flow Monitoring System
Debris flow – scenario ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Debris flow - scenario
Debris flow – sensors and geo-processing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Debris flow monitoring system
Debris flow monitoring system
Debris flow monitoring system
Debris flow monitoring system
Debris flow operational scenario
Grid-enabled WPS from IfGI
Encapsulation vs. integration Integration requires a WSRF binding for WPS
Encapsulation vs. Integration
GEOSS AIP-2 flood prediction and response Led by NASA, Spot Image, Northrop Grumman, ERDAS From portal select desired theme and area of interest Wizard picks appropriate workflow for desired result Wizard Mozambique Disaster Management Information System (DMIS) Workflows Estimated rainfall accumulation and flood prediction model Flood Model Selected workflow automatically activates needed assets and models Baseline water level, flood waters and predicted flooding
GEOSS AIP-2 biodiversity & climate change Led by CNR, Univ of Colorado, GBIF IP3 Client &    Workflow engine IP3 Distributed Community Catalog/Mediator WCS - T Other Non-OGC Services GBIF Non-OGC Services OGC WPS  Access to Model CSW GEOSS Portal WCS  WFS  req req req resp resp resp req req resp resp req resp req resp req resp Broker Research Scientist req resp
SWE and geo-processing workflow SOS ! SAS Sensor Net Mission Control Center Access & Processing Node WPS CSW Register  Measurement  Types SPS CSW SAS SOS
The power of workflow Workflows can be formally described as programmes that invoke Web services that invoke other Web services that invoke other Web services.  Analytical models, decision support tools and other complex resources can quickly deliver results in this way and optionally, provide documentation of the steps.  There is an OGC Workflow Domain Working Group: this is a forum for describing, discussing and providing best practice guidance related to geospatial workflows using existing IT workflow standards.
Contact me
Thanks for your attention

More Related Content

Viewers also liked

Viewers also liked (7)

Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013
 
Agi 09 Soapbox Slides 1 Spatial
Agi 09 Soapbox Slides 1 SpatialAgi 09 Soapbox Slides 1 Spatial
Agi 09 Soapbox Slides 1 Spatial
 
Global Dialogue on Sustainable Development_S Ramage_Ordnance Survey Internati...
Global Dialogue on Sustainable Development_S Ramage_Ordnance Survey Internati...Global Dialogue on Sustainable Development_S Ramage_Ordnance Survey Internati...
Global Dialogue on Sustainable Development_S Ramage_Ordnance Survey Internati...
 
June 2012 _ OGC and ISO
June 2012 _ OGC and ISOJune 2012 _ OGC and ISO
June 2012 _ OGC and ISO
 
UN-GGIM: Europe Overview
UN-GGIM: Europe OverviewUN-GGIM: Europe Overview
UN-GGIM: Europe Overview
 
Steven Ramage OGC OSGIS 2010
Steven Ramage OGC OSGIS 2010Steven Ramage OGC OSGIS 2010
Steven Ramage OGC OSGIS 2010
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
 

Similar to 20100512 Workflow Ramage

2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
Rudolf Husar
 
2005-01-04 Web Services Survey an Inventory Background, Goals and Status
2005-01-04 Web Services Survey an Inventory Background, Goals and Status2005-01-04 Web Services Survey an Inventory Background, Goals and Status
2005-01-04 Web Services Survey an Inventory Background, Goals and Status
Rudolf Husar
 
Webinar september 2013
Webinar september 2013Webinar september 2013
Webinar september 2013
Marc Gille
 
Ogce Workflow Suite
Ogce Workflow SuiteOgce Workflow Suite
Ogce Workflow Suite
smarru
 
An End User Perspective on Implementing Oracle in the Engineering Environment
An End User Perspective on Implementing Oracle in the Engineering EnvironmentAn End User Perspective on Implementing Oracle in the Engineering Environment
An End User Perspective on Implementing Oracle in the Engineering Environment
jeffhobbs
 
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
Rudolf Husar
 

Similar to 20100512 Workflow Ramage (20)

Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)
Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)
Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)
 
060314 Ispra Htap Presentations Husar 060314 Ispra
060314 Ispra Htap Presentations Husar 060314 Ispra060314 Ispra Htap Presentations Husar 060314 Ispra
060314 Ispra Htap Presentations Husar 060314 Ispra
 
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
 
2005-01-04 Web Services Survey an Inventory Background, Goals and Status
2005-01-04 Web Services Survey an Inventory Background, Goals and Status2005-01-04 Web Services Survey an Inventory Background, Goals and Status
2005-01-04 Web Services Survey an Inventory Background, Goals and Status
 
Web Services Inventory
Web Services InventoryWeb Services Inventory
Web Services Inventory
 
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET- Big Data Processes and Analysis using Hadoop FrameworkIRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET- Big Data Processes and Analysis using Hadoop Framework
 
Field Data Collecting, Processing and Sharing: Using web Service Technologies
Field Data Collecting, Processing and Sharing: Using web Service TechnologiesField Data Collecting, Processing and Sharing: Using web Service Technologies
Field Data Collecting, Processing and Sharing: Using web Service Technologies
 
WLCG Grid Infrastructure Monitoring
WLCG Grid Infrastructure MonitoringWLCG Grid Infrastructure Monitoring
WLCG Grid Infrastructure Monitoring
 
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillMPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
 
Webinar september 2013
Webinar september 2013Webinar september 2013
Webinar september 2013
 
Ogce Workflow Suite
Ogce Workflow SuiteOgce Workflow Suite
Ogce Workflow Suite
 
grid mining
grid mininggrid mining
grid mining
 
Self-Tuning and Managing Services
Self-Tuning and Managing ServicesSelf-Tuning and Managing Services
Self-Tuning and Managing Services
 
An End User Perspective on Implementing Oracle in the Engineering Environment
An End User Perspective on Implementing Oracle in the Engineering EnvironmentAn End User Perspective on Implementing Oracle in the Engineering Environment
An End User Perspective on Implementing Oracle in the Engineering Environment
 
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
 
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
 
SAGA GIS 2.0.7
SAGA GIS 2.0.7SAGA GIS 2.0.7
SAGA GIS 2.0.7
 
Mashups for Network Management
Mashups for Network ManagementMashups for Network Management
Mashups for Network Management
 
SSG4Env EGU2010
SSG4Env EGU2010SSG4Env EGU2010
SSG4Env EGU2010
 
Zou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 ConciseZou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 Concise
 

More from Steven Ramage

More from Steven Ramage (20)

Steven Ramage GEO keynote RCMRD International Conference Aug 2021
Steven Ramage GEO keynote RCMRD International Conference Aug 2021Steven Ramage GEO keynote RCMRD International Conference Aug 2021
Steven Ramage GEO keynote RCMRD International Conference Aug 2021
 
Ramage GEO ISPRS July 2021
Ramage GEO ISPRS July 2021Ramage GEO ISPRS July 2021
Ramage GEO ISPRS July 2021
 
Steven Ramage GEO_World Bank OLC
Steven Ramage GEO_World Bank OLCSteven Ramage GEO_World Bank OLC
Steven Ramage GEO_World Bank OLC
 
S Ramage GEO REAP UR2020
S Ramage GEO REAP UR2020S Ramage GEO REAP UR2020
S Ramage GEO REAP UR2020
 
GEO update July 2020
GEO update July 2020GEO update July 2020
GEO update July 2020
 
GEO101 FOSS4G August 2019
GEO101 FOSS4G August 2019GEO101 FOSS4G August 2019
GEO101 FOSS4G August 2019
 
Ramage EO4SDG keynote August 2019
Ramage EO4SDG keynote August 2019Ramage EO4SDG keynote August 2019
Ramage EO4SDG keynote August 2019
 
GEO Data Technology Workshop Ramage April 2019
GEO Data Technology Workshop Ramage April 2019GEO Data Technology Workshop Ramage April 2019
GEO Data Technology Workshop Ramage April 2019
 
S Ramage WEF Davos 2019
S Ramage WEF Davos 2019S Ramage WEF Davos 2019
S Ramage WEF Davos 2019
 
S Ramage GEO FOSS$G2018
S Ramage GEO FOSS$G2018S Ramage GEO FOSS$G2018
S Ramage GEO FOSS$G2018
 
S Ramage GEO UN-GGIM8 August 2018
S Ramage GEO UN-GGIM8 August 2018S Ramage GEO UN-GGIM8 August 2018
S Ramage GEO UN-GGIM8 August 2018
 
GEO Symposium 2018
GEO Symposium 2018GEO Symposium 2018
GEO Symposium 2018
 
CUF Prague June 2018 Ramage GEO
CUF Prague June 2018 Ramage GEOCUF Prague June 2018 Ramage GEO
CUF Prague June 2018 Ramage GEO
 
Ramage Gi4DM Keynote March 2018
Ramage Gi4DM Keynote March 2018Ramage Gi4DM Keynote March 2018
Ramage Gi4DM Keynote March 2018
 
Ramage GEO-CRADLE March 2018 Istanbul
Ramage GEO-CRADLE March 2018 IstanbulRamage GEO-CRADLE March 2018 Istanbul
Ramage GEO-CRADLE March 2018 Istanbul
 
Ramage GEO World Urban Forum KL 2018
Ramage GEO World Urban Forum KL 2018Ramage GEO World Urban Forum KL 2018
Ramage GEO World Urban Forum KL 2018
 
S Ramage GEO_global forum disaster resilience_Nov2017
S Ramage GEO_global forum disaster resilience_Nov2017S Ramage GEO_global forum disaster resilience_Nov2017
S Ramage GEO_global forum disaster resilience_Nov2017
 
S Ramage GEO UN-GGIM HLF Mexico Nov 2017
S Ramage GEO UN-GGIM HLF Mexico Nov 2017S Ramage GEO UN-GGIM HLF Mexico Nov 2017
S Ramage GEO UN-GGIM HLF Mexico Nov 2017
 
S Ramage GEO_EFGS Nov 2017
S Ramage GEO_EFGS Nov 2017S Ramage GEO_EFGS Nov 2017
S Ramage GEO_EFGS Nov 2017
 
S Ramage GEO_IEOS Nov 2017
S Ramage GEO_IEOS Nov 2017S Ramage GEO_IEOS Nov 2017
S Ramage GEO_IEOS Nov 2017
 

20100512 Workflow Ramage

  • 1. Workshop on Workflows on Earth Observation Steven Ramage, OGC [email_address] 21 June 2010, Sir Clive Granger Building, University of Nottingham
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. “ Chaining” Web Services for decision support … WCS WPS – Classification WPS - WCTS WFS Internet Web servers OGC Interfaces Service chaining creates value-added products Decision Support Client Geoprocessing worklow developed in OGC testbeds since 2004 Assess Wildfire Activity
  • 8. BPEL workflow in OWS-5 Participants chained combinations of services together to address the requirements of geospatial data conflation and image processing. It also addressed an important gap, which was the lack of SOAP (Simple Object Access Protocol) and WSDL (Web Service Description Language) descriptions for those APIs.
  • 9. BPEL workflow in OWS-5 Both W3C standards are critical for creating and managing workflows using industry standards such as OASIS’s BPEL (Business Process Execution Language). BPEL is the workflow description language used in many end-user service chaining tools such as Oracle BPEL Designer and George Mason University’s BPEL Power.
  • 11. Conflation workflow architecture The OWS-5 geo-processing workflow thread bound together WFS and WPS services in BPEL scripts to model data conflation in a consistent, repeatable fashion. This successful prototype signaled the utility of this approach for a host of geospatial tasks that require the combination of many different geospatial services and operations. Fusion activities developed in OWS-7 and will have more focus in this area for OWS-8.
  • 12. OGC Web Processing Service (WPS) WPS GetCapabilities Execute DescribeProcess Algorithms Repository … … Algorithm 1 Data Handler Repository … … Data Handler A Communication over the web using HTTP WPS-client Web Processing Service
  • 13. REST-oriented workflow in OWS-5 The SOAP/WSDL/BPEL approach to chaining Web services is one of the most widely used ways to implement service oriented architectures (SOA). However, other approaches, notably REST (Representational State Transfer) services, are also used to implement services in an enterprise. Some feel that Web services do not need the extra layer of description provided by SOAP and WSDL to build reliable workflows.
  • 14. REST-oriented workflow in OWS-5 REST uses HTTP and other parts of the basic Web platform. In the SWE (Sensor Web Enablement) thread of OWS-5, participants used a REST-based architecture and WfXML to create workflows that allowed raw earth observation data to be acquired from assets, such as the EO-1 satellite, and then utilized by different WPS. Relevant data were then published and distributed to end-users in formats such as GeoAtom (Atom with GeoRSS extensions) and KML.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 23.
  • 24. Debris flow - scenario
  • 25.
  • 32. Encapsulation vs. integration Integration requires a WSRF binding for WPS
  • 34. GEOSS AIP-2 flood prediction and response Led by NASA, Spot Image, Northrop Grumman, ERDAS From portal select desired theme and area of interest Wizard picks appropriate workflow for desired result Wizard Mozambique Disaster Management Information System (DMIS) Workflows Estimated rainfall accumulation and flood prediction model Flood Model Selected workflow automatically activates needed assets and models Baseline water level, flood waters and predicted flooding
  • 35. GEOSS AIP-2 biodiversity & climate change Led by CNR, Univ of Colorado, GBIF IP3 Client & Workflow engine IP3 Distributed Community Catalog/Mediator WCS - T Other Non-OGC Services GBIF Non-OGC Services OGC WPS Access to Model CSW GEOSS Portal WCS WFS req req req resp resp resp req req resp resp req resp req resp req resp Broker Research Scientist req resp
  • 36. SWE and geo-processing workflow SOS ! SAS Sensor Net Mission Control Center Access & Processing Node WPS CSW Register Measurement Types SPS CSW SAS SOS
  • 37. The power of workflow Workflows can be formally described as programmes that invoke Web services that invoke other Web services that invoke other Web services. Analytical models, decision support tools and other complex resources can quickly deliver results in this way and optionally, provide documentation of the steps. There is an OGC Workflow Domain Working Group: this is a forum for describing, discussing and providing best practice guidance related to geospatial workflows using existing IT workflow standards.
  • 39. Thanks for your attention

Editor's Notes

  1. Web-based geospatial service chaining and decision supp ort . How do we reliably and repeatedly combine results from several distributed services on the web to produce a result for a user? Service chaining is the term commonly used for the process of organizing disparate web based services into an orderly process. For instance, a raw image is sent to a service that performs a coordinate transformation. This services sends the transformed image to a classifier service that processes the image to highlight areas of active fire. The result of this service is sent to a user’s client along with other geospatial data such as vegetation overlays, transportation. Service chaining will play an important role in future capabilities.
  2. Now completed.