"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
061206 Ua Huntsville Seminar
1. Part I DataFed An Agile Distributed Air Quality Data System Rudolf B. Husar Washington University, St. Louis Seminar Presented at University of Alabama, Dept. of Atmospheric Sciences December 6, 2006
2. Revolution in Sensing (1990s) & Delivery (2000+) Real-time Air Pollution Sensing and Reporting High Resolution Satellite Data Surface PM25 and Ozone Data Smoke Plumes
3. Changes in Air Quality Management Command & Control Weight of Evidence Flexible NAAMS Rigid Monitoring
4.
5. Stages of AQ Data Flow and Value-Adding Processes Domain Processing Data Sharing Std. Interface Gen. Processing Std. Interface Data Control Reports Reporting Obs. & Models Decision Support System Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value-Adding Processes Reporting Inclusiveness Iterative/Agile Dynamic Report
6. Generic Decision Support for Air Quality Decisions Global Earth Observing System of Systems GEOSS Architecture Framework Knowledge into the Minds of Regulatory Analysts Knowledge into the Minds of Technical Analysts Observations Reports: Model Forecasts, Obs. Evidence Models Decisions Knowledge into the Minds of Decision- making managers Decision Support System
7.
8. Differentiating System Engineering and System of Systems Engineering “ System of Systems Engineering for Air Force Capability Development”, 2005
9.
10. Loosely Coupled Data Access through Standard Protocols The next three slides describe the key technologies used in the creation of an adaptable and responsive air quality information system. OGC data access protocols and standard formats facilitate loose coupling between data on the internet and processing services. For air quality, the Web Coverage Service (WCS), provides a universal simple query language for requesting data as where, when, what. That is: geographic (3D bounding box), time range and parameter. The Web Map Service (WMS) and Web Feature Service (WFS) are also useful. The use of standard data physical data formats and naming conventions elevates the syntactic and semantic interoperability. Within DataFed all data access services are implemented as WCS or WMS and optionally WFS. General format adapter components permit data request in a variety of standard formats. GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface T2 T1 Domain Processing Data Sharing Std. Interface Gen. Processing Std. Interface Data Control Reports Reporting Obs. & Models Decision Support System CF, EOS, OGC CF OGC, ISO OGC, ISO Standards netCDF, HDF.. Format Temperature What? Time When? BBOX Where? GetData Query
11. Web Services and Workflow for Loose Coupling Service Broker Service Provider Publish Find Bind Service User Web Service Interaction Domain Processing Data Sharing Std. Interface Gen. Processing Std. Interface Data Control Reports Reporting Obs. & Models Decision Support System Web Services Triad: Publish – Find – Bind Workflow Software: Dynamic Programming Service Chaining & Workflow
12. Collaborative Reporting and Dynamic Delivery Analysis Reports: Information supplied by many Needs continuous program feedback Report needs many authors Wiki technologies are for collaborative writing Dynamic Delivery: Much of the content is dynamic Animated presentations are compelling Movies and screencasts are for dynamic delivery Domain Processing Data Sharing Std. Interface Gen. Processing Std. Interface Data Control Reports Reporting Obs. & Models Decision Support System Co Writing - Wiki ScreenCast
13.
14. Approach: Mediation Between Users and Data Providers DataFed assumes spontaneous, autonomous data providers Non-intrusively wraps datasets for access by web services Mediates, homogenizes data views. e.g. geo-spatial, time...
15.
16.
17.
18.
19. Web Services: Building Blocks of DataFed Programming Access, Process, Render Data by Service Chaining Web Service Composition NASA SeaWiFS Satellite NOAA ATAD Trajectory OGC Map Boundary RPO VIEWS Chemistry Data Access Data Processing Layer Overlay LAYERS
We will start out by highlighting significant trends in air pollution monitoring and management Next we will describe an agile information system architecture for air quality decision support Finally, we will show the application of this architecture and technologies for two use cases: a real time smoke event analysis and a long-term model evaluation