2004-11-13 Supersite Relational Database Project: (Data Portal?)

Supersite Relational Database Project: (Data Portal?) a sub- project of St. Louis Midwest Supersite Project Draft of the November 16, 2001 Presentation to the Supersite Program Nov 13, 2001

Purpose of the Supersite Relational Database System ,[object Object],[object Object],[object Object],[object Object]

Stated Features of Relational Data System ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Database Schema Design ,[object Object],[object Object],[object Object],[object Object]

Abstract (Minimal) Star Schema for Integrative, Cross-Supersite, Spatio-Temporal Analysis ,[object Object],[object Object],[object Object],[object Object],For integrative, cross-Supersite analysis, data queries by time, location and parameter, the database has to have time, location and parameter as dimensions The above minimal (multidimensional) schema was used in the CAPITA data exploration software, Voyager for the past 22 years, encoding 1000+ datasets. Most Supersite data require a more elaborate schema to fully capture the content

Extended Star Schema for SRDS ,[object Object],[object Object],[object Object]

Snowflake Example: Central Calif. AQ Study, CCAQS ,[object Object],[object Object],[object Object],[object Object]

Data Portal: Features ,[object Object],[object Object],[object Object]

From Heterogeneous to Homogeneous Schema ,[object Object],[object Object],[object Object],Data Adapter Extraction of homogeneous data from heterogeneous sources Subset used Abstract Schema Fact Table

Federated Data Warehouse Architecture ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],SQLDataAdapter1 CustomDataAdapter SQLDataAdapter2 SQLServer1 SQLServer2 LegacyServer Presentation Data Access & Use Provider Tier Heterogeneous Data Proxy Tier Data Homogenization, etc. Member Servers Proxy Server User Tier Data Consumption Processing Integration Federated Data Warehouse Fire Wall, Federation Contract Web Service, Uniform Query & Data

Universal Query/Response from SQL servers ,[object Object],[object Object],[object Object]

Summary of Proposed Database Schema Design ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data Entry to the Supersite Relational Data System: ,[object Object],[object Object],[object Object],EPA Supersite Data Coordinated Supersite Relational Tables EOSDIS Data Archive NARSTO ORNL DES, Data Ingest Supersite SQL Server DES-SQL Transformer Manual- SQL Transformer Auxiliary Batch Data Data Query Table Output Direct Web Data Input

Data Preparation Procedures: ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Related CAPITA Projects ,[object Object],[object Object],[object Object],[object Object],[object Object]

Federated Data Warehouse Architecture XML Web Services HTTP Services Time Chart Scatter Chart Text, Table Data View & Process Tier Layered Map Cursor OpenGIS Services Data are rendered by linked Data Views (map, time, text) Distributed data of multiple types (spatial, temporal text ) The Broker handles the views, connections, data access, cursor Satellite Vector GIS Data XDim Data OLAP Cube SQL Table Text Data Web Page Text Data Data Warehouse Tier Data View Manager Connection Manager Data Access Manager Cursor-Query Manager

Example Data Viewer (to be made more Supersite relevant) Map View Variable View Time View WebCamView The views are linked so that making a change in one view, such as selecting a different location in the map view, updates the other views.

Supersite Relational Data System: Schedule ,[object Object],[object Object],[object Object],Year 1 - 2002 Year 2 - 2003 Year 2 - 2004 RDMS Design Feedback Impl. & Test SQL Supersite Data Entry Auxiliary Data Entry Other Coordinated Data Entry Supersite, Coordinated and Auxiliary Data Updates

Personnel, Management and Facilities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Miscellaneous Stuff ,[object Object]

OpenGIS Web Services ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Distributed Data Analysis & Dissemination System: D-DADS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The D-DADS Components ,[object Object],[object Object],[object Object],[object Object],The multidimensional data access and manipulation component of D-DADS will be implemented using OLAP.

Interoperability ,[object Object],[object Object],[object Object],[object Object],One requirement for an effective distributed environmental data system is interoperability, defined as,

On-line Analytical Processing: OLAP ,[object Object],[object Object],[object Object],[object Object]

User Interaction with D-DADS Query XML data XML data Data View (Table, Map, etc.) Distributed Database

Metadata Standardization ,[object Object],[object Object],[object Object],Metadata standards for describing air quality data are currently being actively pursued by several organizations, including:

Potential D-DADS Nodes The following organizations are potential nodes in a distributed data analysis and dissemination system: ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Summary ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

‘Global’ and ‘Local’ AQ Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],National and Local AQ Analysis

Data Re-Use and Synergy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Content Content User User User Local Local Global Global Virtual Shared Resources Data, Knowledge Tools, Methods User User Shared part of resources

Integration for Global-Local Activities Global Activity Local Benefit Global data, tools => Improved local productivity Global data analysis => Spatial context; initial analysis Analysis guidance => Standardized analysis, reporting Local Activity Global Benefit Local data, tools => Improved global productivity Local data analysis => Elucidate, expand initial analysis Identify relevant issues => Responsive, relevant global work Global and local activities are both needed – e.g. ‘think global, act local’ ‘ Global’ and ‘Local’ here refers to relative, not absolute scale

Content Integration for Multiple Uses (Reports) Data from multiple measurements are shared by their providers or custodians Data are integrated, filtered, aggregated and fused in the process of analysis Reports use the analysis for Status and Trends; Exposure Assessment; Compliance … The creation of the needed reports requires data sharing and integration from multiple sources.

2004-11-13 Supersite Relational Database Project: (Data Portal?)

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (13)

Ähnlich wie 2004-11-13 Supersite Relational Database Project: (Data Portal?)

Ähnlich wie 2004-11-13 Supersite Relational Database Project: (Data Portal?) (20)

Mehr von Rudolf Husar

Mehr von Rudolf Husar (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

2004-11-13 Supersite Relational Database Project: (Data Portal?)