The document summarizes the Geohazards TEP (GEP) service, which provides on-demand and systematic processing of Earth observation (EO) data to support geohazards analysis. The GEP offers access to Copernicus and other satellite data, massive cloud computing power, and processing services via a web portal, APIs, and command line tools. It processes data for applications like earthquake response, landslide mapping, and regularly monitors the Alps with Sentinel-1 data. Documentation and tutorials are available on the GEP website.
2. 2
Motivation and driving consideration about the service
Service architecture and interfaces: overview
- How the user can access the service
E.g.: REST, GUI, CLIs, etc.
- Service options and attributes
Acceptable Usage Policy (AUP)
Access policy and business model
Use cases
Documentation/tutorial/information
11/27/2018
Content
3. 3
The Geohazards TEP (GEP) is an enhancement of the precursor platforms (G-
POD, SSEP), and is designed to support the Geohazard Supersites (GSNL) and
the Geohazards community via the CEOS WG Disasters
GEP is an ESA originated R&D activity on the EO ground segment to
demonstrate the benefit of new technologies for large scale processing of EO
data
Its goal is to apply a complementary operations concept, i.e. moving User
activities to the Data: users access a work environment containing the data and
resources required, as opposed to downloading and replicating the data ‘at
home’
Achieved developing a Platform based on virtualization & federation of
satellite EO data and methods
11/27/2018
Motivation
4. 4
The GEP provides innovative responses to the geohazards community needs
(services & support)
- On-demand processing services to address AOI-specific analysis
- Systematic processing services to address needs for “common information layers”
- Massive Cloud Compute power, managing multi-tenant resources
- Access to Copernicus Sentinels-1/2/3 repositories
- Access to 70+ TB of EO data archives (ERS and ENVISAT), and specific data collections from EO
missions, such as JAXA’s ALOS-2, ASI’s Cosmo-Skymed and DLR’s TerraSAR-X, provided under
special arrangements in the framework f the CEOS WG Disaster and the GSNL.
Support the generation strain rate estimates and the mapping of active faults
at the global scale by providing EO InSAR and optical data and processing
capacities
Supports development and demonstration of advanced science products for
rapid earthquake response
11/27/2018
Motivation
5. 5
The Geohazards TEP platform is a complex system composed by the
following main components:
- Web portal: a community portal, focusing on sharing processing results amongst users,
integrating social medias and gathering users in communities. It offers a community
workspace where users can interact amongst themselves and access processing job or
datasets shared by the community. It offers also a completely integrated geobrowser, in
which users can discover existing EO collection or EO products produced by the
community, but also create new processing jobs using the available WPS services.
- Data Agency including
Catalogue service: the EO data catalogue allows quickly accessing metadata about main EO
satellite missions all over the world. Metadata are continuously harvested and ingested into
the catalogue. The catalogue, is also used to publish user's data products (directly uploaded
by the user, or retrieved from a WPS job)
Data Gateway: it manages the data access and storage. It automatically pulls data results
created by the processes on the WPS provider to a dedicated storage, in order to create
value-added (e.g WMS layers, time series, …), persistent and quickly available data results. It
also supports programmable and systematic data caching, in order to have data ready for
specific area of interest of the users
11/27/2018
Service architecture and interfaces
6. 6
GEP components (contd)
- Production Center: the PC is a set of components enabling the processing services on
the Geohazards TEP. It contains several heterogeneous modules enabling several
specific functions from service integration to bulk and massive processing in clusters
over IaaS and cloud. In particular it delivers a dynamic multi tenant cluster with the
full Hadoop YARN stack
- Development environment: the Developer Cloud Sandbox PaaS is the environment to
integrate scientific applications written in a variety of languages (e.g. Java, C++, IDL,
Python, R), then deploy, automate, manage and scale them in a very modular way.
The algorithm integration is performed from within a dedicated Virtual Machine,
running initially as a simulation environment (sandbox mode) that can readily scale
to production (cluster mode) and then be deployed on the Production Center. It is
accessed from a harmonized Shell environment and provides support tools to
facilitate the data access and workflow management tasks
11/27/2018
Service architecture and interfaces
7. 711/27/2018
Service architecture and interfaces
Sentinel-2 products
Amazon S3
Sentinel-1/2/3
products
Copernicus Scihub
Sentinel-1 products
Alaska Satellite
Facility
Data Agency
Terradue
Sentinel-1 products
(Sentinel 2/3
upcoming)
CNES PEPS
SH
B
AS
F
PEP
S
AW
S
T
2
Sentinel-1/2/3
products
National hubs (AT, GR, FI
…)
Col
lGS
Landsat-8
products
EarthExplorerUSG
S
Data Agency
Metadata and Data Brokering
8. 811/27/2018
Service architecture and interfaces
Federation of data centres
- EGI.eu (BELNET, INFN RECAS BARI)
- CNR IREA Computing Centre
- Poznań Supercomputing and Networking Center
… and Cloud providers
- Hetzner / Terradue Private Cloud
- EO IPT.PL
- Amazon AWS
Production Center
Federation and Cloud Bursting
9. 9
GEP services can be accessed in multiple ways according to type of users and
related needs. These are:
- The Terradue Cloud Platform API (REST API)
see http://docs.terradue.com/t2-api/
- The Developer Cloud Sandbox tools (CLI)
see http://docs.terradue.com/developer-sandbox/
- The GEP Web Portal (GUI)
see https://terradue.github.io/doc-tep-geohazards/
In the context of EOSC-Hub the services exposed by the Geohazards TEP will be
1. Sentinel-1 High-Resolution Change Monitoring for the Alpine Region
based on DLR High-Resolution InSAR Browse service
Systematic
Accessible via GEP Web Portal and Terradue Cloud Platform API
2. EO Services for Earthquake Response and Landslides Analysis
provides a set of terrain motion services to support co-seismic displacement mapping and
landslide analysis from optical and SAR images
on-demand
Accessible via GEP Web Portal
11/27/2018
Service access
10. 10
Service options for the Geohazards TEP
1. Sentinel-1 High-Res Change Monitoring for the Alpine Region
This service provides an interferometric product at 50m resolution and 25m pixel spacing
systematically for every 6-day Sentinel-1 SLC pair over the Alpine Region.
It generates 6 information layers that allow characterizing the applicability of InSAR over
geohazards sites (feasibility) in view of further ad-hoc processing with a variety of
interferometric chains. These layers are: master and slave calibrated amplitude, terrain
corrected coherence, terrain corrected interferogram, amplitude change composite and
amplitude coherence composite
2. EO Services for Earthquake Response and Landslides Analysis
This App provides a set of on-demand terrain motion services supporting interferogram
generation, co-seismic displacement mapping, landslide rapid mapping and landslide
displacement field monitoring with Sentinel-1 and Sentinel-2 data.
Service attributes
- N/A
11/27/2018
Service options and attributes
11. 11
Access to the GEP services
- Basic services: open and free with self registration
EO Data catalogue search functions
Public Job results visualisation
- Advanced services: requires filling a User Request Form
(URF) and is granted upon approval of the GEP Governance
after assessment of the URF
11/27/2018
Acceptable Usage Policy
12. 12
Access policies:
- Self registration for basic services
- Policy-based for advanced services
Payment model:
- Sponsored
- Subscription-based
11/27/2018
Access policies and Funding models
13. 13
As a GeoHazards expert, I want to interactively find relevant data for a given
area of interest and time period, and invoke processing from a predefined set of
functions over that area
- Fulfilled via the service 2.
EO Services for Earthquake Response and Landslides Analysis
- The users has access to a geobrowser with the possibility to do searches in
the EO data catalogue and select, preview, download data
- The user has access to a set of processing services that can be started on the
previously selected data
- The user can monitor processing progress and preview, download the
generated results
11/27/2018
Featured use cases (1)
14. 14
As a GeoHazards expert, I want to regularly/systematically process data over areas
of interest and have the results available
As a GeoHazards expert, I want to download data via APIs
- Fulfilled via the service 1.
Sentinel-1 High-Resolution Change Monitoring for the Alpine Region
- Information layers are generated systematically on the Alpine region (as soon as
new S-1 acquistions are available over the AoI)
- Generated information layers are published in the GEP Catalogue and in a OGC
compliant WMS server
The users has access to a geobrowser with the possibility to do searches in the
catalogue and select, preview, download generated data
The user can access the information layer metadata and data via the Terradue Cloud
Platform API and the Geoserver OGC WMS API
11/27/2018
Featured use cases (2)
15. 15
Provide link to user documentation, tutorials, etc.
- https://terradue.github.io/doc-tep-geohazards/
- http://docs.terradue.com/t2-api/
- https://geohazards-tep.eo.esa.int/#!
- https://geohazards-tep.eo.esa.int/#!blog
11/27/2018
Documentations