SlideShare ist ein Scribd-Unternehmen logo
1 von 21
An Overview of
HDF-EOS
(Part I)

Doug Ilg
Raytheon STX
Doug.Ilg@gsfc.nasa.gov
(301) 441-4089
1
Outline
What is HDF-EOS?
The Grid Interface
The Point Interface

2
What is HDF-EOS?
An HDF “Profile”
An extension to HDF
A library built “on top” of HDF
Three new data objects
Three new programming interfaces

3
Why HDF-EOS?
Standard HDF lacks well defined ways of
handling some key needs of EOSDIS
Data structures for Earth remote
sensing data and in-situ measurements
with:
– tightly coupled geolocation information
– subsetting services based on geolocation

ECS metadata model

4
HDF-EOS Platforms
HDF-EOS Version 2.3 is available for:
Sun SPARC - Solaris
SGI - IRIX
DEC Alpha - Digital UNIX
HP 9000 - HP-UX
IBM RS/6000 - AIX
PC - Windows 95/NT
5
HDF-EOS Interfaces
C and FORTRAN Interfaces for:
Grid Data (GD)
Point Data (PT)
Swath Data (SW)

6
HDF-EOS Programming
Model
Writing
–
–
–
–
–
–
–
–

open file
create object
define structure
detach object*
attach object*
write data
detach object
close file

Reading
–
–
–
–
–
–

open file
attach object
inquire object
read data
detach object
close file

7
A Grid Data Set

8
A Grid Structure
Xdim
Size: 2000

Projinfo
Ydim
Size: 800

9
Projections Supported
Geographic
Transverse Mercator
Universal
Transverse Mercator
Hotine Oblique
Mercator
Space Oblique
Mercator
Polar Stereographic

Lambert Azimuthal
Equal Area
Lambert Conformal
Conic
Polyconic
Interrupted Goode’s
Homolosine
Integerized
Sinusoidal
10
Components of the Grid
Interface
Access
Definition
Basic I/O
Inquiry
Subset
Tiling
11
Tips on Writing a Grid
Order of calls is significant:
– Setting a compression method affects all
subsequently defined fields
– Setting a tiling scheme affects all
subsequently defined fields

12
Grid Subsetting Features
By Geolocation
– GDdefboxregion/Gdextractboxregion

By “Vertical” Field
– GDdefvrtregion/GDextractvrtregion

By Time (special case of vertical)
Tip: use Geolocation, then Vertical/
Temporal
13
Compression Methods for
Grids
Run-Length Encoding
Adaptive Huffman
Gzip

14
A Point Data Set
Lat
61.12
45.31
38.50
38.39
30.00
37.45
18.00
43.40
34.03
32.45
33.30
42.15
35.05
34.12
46.32
47.36
39.44
21.25
44.58
41.49
25.45

Lon Temp(C) Dewpt(C)
-149.48 15.00 5.00
-122.41 17.00 5.00
-77.00 24.00 7.00
-90.15 27.00 11.00
-90.05 22.00 7.00
-122.26 25.00 10.00
-76.45 27.00 4.00
-79.23 30.00 14.00
-118.14 25.00 4.00
-96.48 32.00 8.00
-112.00 30.00 10.00
-71.07 28.00 7.00
-106.40 30.00 9.00
-77.56 28.00 9.00
-87.25 30.00 8.00
-122.20 32.00 15.00
-104.59 31.00 16.00
-78.00 28.00 7.00
-93.15 32.00 13.00
-87.37 28.00 9.00
-80.11 19.00 3.00

15
A Point Structure
Lat
Long
Buoy ID
25.2645 091.2564
0126
22.3549 -93.4657
3564
23.2564 -89.2546
1256

Buoy ID
0126
0126
3564
1256
1256
0126
3564

Time Wave Height(ft) Temp(C)
01:26
2.54
18.4
05:56
3.58
18.2
06:28
12.64
16.4
08:12
7.58
17.1
09:58
7.76
17.2
09:59
4.23
20.1
10:16
10.23
17.5

16
The Point Interface
Access
Definition
Basic I/O
Inquiry
Subset

17
Tips on Writing a Point
Every level in a Point data set must be
linked into the hierarchy.
Before two levels can be linked, a link
field must exist.

18
Point Subsetting Features
By Time
– PTdeftimeperiod/PTextractperiod

By Geolocation
– PTdefboxregion/PTextractregion

Tip: use one or the other, not both

19
Compression Methods for
Points
NONE

20
Tips for HDF-EOS Coding
Most operations (read, write, subset)
work on a single field at a time.
Region IDs and Period IDs are interchangeable and can be reused to
further reduce a subset.
Partial writes (appending) on
compressed fields are only supported
through tiling.
21

Weitere ähnliche Inhalte

Was ist angesagt?

Fast & Energy-Efficient Breadth-First Search on a Single NUMA System
Fast & Energy-Efficient Breadth-First Search on a Single NUMA SystemFast & Energy-Efficient Breadth-First Search on a Single NUMA System
Fast & Energy-Efficient Breadth-First Search on a Single NUMA System
Yuichiro Yasui
 
WSE 6A-Octo-X Terrain Mapping UAV
WSE 6A-Octo-X Terrain Mapping UAVWSE 6A-Octo-X Terrain Mapping UAV
WSE 6A-Octo-X Terrain Mapping UAV
Manuel De La Cruz
 
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
Johan Andersson
 

Was ist angesagt? (20)

Real-Time Visual Simulation of Smoke
Real-Time Visual Simulation of SmokeReal-Time Visual Simulation of Smoke
Real-Time Visual Simulation of Smoke
 
Fast & Energy-Efficient Breadth-First Search on a Single NUMA System
Fast & Energy-Efficient Breadth-First Search on a Single NUMA SystemFast & Energy-Efficient Breadth-First Search on a Single NUMA System
Fast & Energy-Efficient Breadth-First Search on a Single NUMA System
 
Neighbourhood Preserving Quantisation for LSH SIGIR Poster
Neighbourhood Preserving Quantisation for LSH SIGIR PosterNeighbourhood Preserving Quantisation for LSH SIGIR Poster
Neighbourhood Preserving Quantisation for LSH SIGIR Poster
 
Advancements in-tiled-rendering
Advancements in-tiled-renderingAdvancements in-tiled-rendering
Advancements in-tiled-rendering
 
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelGDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
 
NUMA-aware thread-parallel breadth-first search for Graph500 and Green Graph5...
NUMA-aware thread-parallel breadth-first search for Graph500 and Green Graph5...NUMA-aware thread-parallel breadth-first search for Graph500 and Green Graph5...
NUMA-aware thread-parallel breadth-first search for Graph500 and Green Graph5...
 
LHCb Computing Workshop 2018: PV finding with CNNs
LHCb Computing Workshop 2018: PV finding with CNNsLHCb Computing Workshop 2018: PV finding with CNNs
LHCb Computing Workshop 2018: PV finding with CNNs
 
ARPS Architecture 1
ARPS Architecture 1ARPS Architecture 1
ARPS Architecture 1
 
Performance Analysis with Scalasca, part II
Performance Analysis with Scalasca, part IIPerformance Analysis with Scalasca, part II
Performance Analysis with Scalasca, part II
 
30th コンピュータビジョン勉強会@関東 DynamicFusion
30th コンピュータビジョン勉強会@関東 DynamicFusion30th コンピュータビジョン勉強会@関東 DynamicFusion
30th コンピュータビジョン勉強会@関東 DynamicFusion
 
BEFLIX
BEFLIXBEFLIX
BEFLIX
 
Logistic Regression in R-An Exmple.
Logistic Regression in R-An Exmple. Logistic Regression in R-An Exmple.
Logistic Regression in R-An Exmple.
 
ARPS Architecture
ARPS ArchitectureARPS Architecture
ARPS Architecture
 
WSE 6A-Octo-X Terrain Mapping UAV
WSE 6A-Octo-X Terrain Mapping UAVWSE 6A-Octo-X Terrain Mapping UAV
WSE 6A-Octo-X Terrain Mapping UAV
 
論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...
論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...
論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...
 
P1341cle
P1341cleP1341cle
P1341cle
 
Archaeological Surveying in the Middle East
Archaeological Surveying in the Middle EastArchaeological Surveying in the Middle East
Archaeological Surveying in the Middle East
 
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
 
Graph Regularised Hashing
Graph Regularised HashingGraph Regularised Hashing
Graph Regularised Hashing
 
Coq for ML users
Coq for ML usersCoq for ML users
Coq for ML users
 

Andere mochten auch

Andere mochten auch (20)

Metadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data ProvidersMetadata Requirements for EOSDIS Data Providers
Metadata Requirements for EOSDIS Data Providers
 
HDF Project Update
HDF Project UpdateHDF Project Update
HDF Project Update
 
IBM Visualization Data Explorer
IBM Visualization Data ExplorerIBM Visualization Data Explorer
IBM Visualization Data Explorer
 
HDF Explorer
HDF ExplorerHDF Explorer
HDF Explorer
 
HDF Server
HDF ServerHDF Server
HDF Server
 
HDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance SupportHDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance Support
 
MrSID
MrSIDMrSID
MrSID
 
HDF And HDF-EOS Tools
HDF And HDF-EOS ToolsHDF And HDF-EOS Tools
HDF And HDF-EOS Tools
 
An Introduction to HDF (1997)
An Introduction to HDF (1997)An Introduction to HDF (1997)
An Introduction to HDF (1997)
 
MATLAB and HDF-EOS
MATLAB and HDF-EOSMATLAB and HDF-EOS
MATLAB and HDF-EOS
 
Dataset Independent Subsetting
Dataset Independent SubsettingDataset Independent Subsetting
Dataset Independent Subsetting
 
Current HDF Tools (1997)
Current HDF Tools (1997)Current HDF Tools (1997)
Current HDF Tools (1997)
 
EOS Overview
EOS OverviewEOS Overview
EOS Overview
 
Incorporating ISO Metadata Using HDF Product Designer
Incorporating ISO Metadata Using HDF Product DesignerIncorporating ISO Metadata Using HDF Product Designer
Incorporating ISO Metadata Using HDF Product Designer
 
PCMDI Software System
PCMDI Software SystemPCMDI Software System
PCMDI Software System
 
Desktop Support for HDF and HDF-EOS
Desktop Support for HDF and HDF-EOSDesktop Support for HDF and HDF-EOS
Desktop Support for HDF and HDF-EOS
 
Indexing HDF5: A Survey
Indexing HDF5: A SurveyIndexing HDF5: A Survey
Indexing HDF5: A Survey
 
America Runs on Excel and HDF5 - Glued together by Python
America Runs on Excel and HDF5 - Glued together by PythonAmerica Runs on Excel and HDF5 - Glued together by Python
America Runs on Excel and HDF5 - Glued together by Python
 
His Expert's Voice
His Expert's VoiceHis Expert's Voice
His Expert's Voice
 
HDF
HDFHDF
HDF
 

Ähnlich wie An Overview of HDF-EOS (Part 1)

Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
Naoki (Neo) SATO
 
BWC Supercomputing 2008 Presentation
BWC Supercomputing 2008 PresentationBWC Supercomputing 2008 Presentation
BWC Supercomputing 2008 Presentation
lilyco
 
D3 D10 Unleashed New Features And Effects
D3 D10 Unleashed   New Features And EffectsD3 D10 Unleashed   New Features And Effects
D3 D10 Unleashed New Features And Effects
Thomas Goddard
 
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
Rudolf Husar
 

Ähnlich wie An Overview of HDF-EOS (Part 1) (20)

The HDF-EOS5 Tutorial
The HDF-EOS5 TutorialThe HDF-EOS5 Tutorial
The HDF-EOS5 Tutorial
 
HDF-EOS Overview and Status
HDF-EOS Overview and StatusHDF-EOS Overview and Status
HDF-EOS Overview and Status
 
Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
Deep Learning, Microsoft Cognitive Toolkit (CNTK) and Azure Machine Learning ...
 
EECSCon Poster
EECSCon PosterEECSCon Poster
EECSCon Poster
 
Dpdk applications
Dpdk applicationsDpdk applications
Dpdk applications
 
BWC Supercomputing 2008 Presentation
BWC Supercomputing 2008 PresentationBWC Supercomputing 2008 Presentation
BWC Supercomputing 2008 Presentation
 
Your Game Needs Direct3D 11, So Get Started Now!
Your Game Needs Direct3D 11, So Get Started Now!Your Game Needs Direct3D 11, So Get Started Now!
Your Game Needs Direct3D 11, So Get Started Now!
 
S51281 - Accelerate Data Science in Python with RAPIDS_1679330128290001YmT7.pdf
S51281 - Accelerate Data Science in Python with RAPIDS_1679330128290001YmT7.pdfS51281 - Accelerate Data Science in Python with RAPIDS_1679330128290001YmT7.pdf
S51281 - Accelerate Data Science in Python with RAPIDS_1679330128290001YmT7.pdf
 
D3 D10 Unleashed New Features And Effects
D3 D10 Unleashed   New Features And EffectsD3 D10 Unleashed   New Features And Effects
D3 D10 Unleashed New Features And Effects
 
Status of HDF-EOS, Related Software and Tools
Status of HDF-EOS, Related Software and ToolsStatus of HDF-EOS, Related Software and Tools
Status of HDF-EOS, Related Software and Tools
 
060128 Galeon Rept
060128 Galeon Rept060128 Galeon Rept
060128 Galeon Rept
 
Achitecture Aware Algorithms and Software for Peta and Exascale
Achitecture Aware Algorithms and Software for Peta and ExascaleAchitecture Aware Algorithms and Software for Peta and Exascale
Achitecture Aware Algorithms and Software for Peta and Exascale
 
RAPIDS – Open GPU-accelerated Data Science
RAPIDS – Open GPU-accelerated Data ScienceRAPIDS – Open GPU-accelerated Data Science
RAPIDS – Open GPU-accelerated Data Science
 
DAW: Duplicate-AWare Federated Query Processing over the Web of Data
DAW: Duplicate-AWare Federated Query Processing over the Web of DataDAW: Duplicate-AWare Federated Query Processing over the Web of Data
DAW: Duplicate-AWare Federated Query Processing over the Web of Data
 
Location based services for Nokia X and Nokia Asha using Geo2tag
Location based services for Nokia X and Nokia Asha using Geo2tagLocation based services for Nokia X and Nokia Asha using Geo2tag
Location based services for Nokia X and Nokia Asha using Geo2tag
 
State of the Art Web Mapping with Open Source
State of the Art Web Mapping with Open SourceState of the Art Web Mapping with Open Source
State of the Art Web Mapping with Open Source
 
Klessydra t - designing vector coprocessors for multi-threaded edge-computing...
Klessydra t - designing vector coprocessors for multi-threaded edge-computing...Klessydra t - designing vector coprocessors for multi-threaded edge-computing...
Klessydra t - designing vector coprocessors for multi-threaded edge-computing...
 
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
 
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
 
Presentation NBMP and PCC
Presentation NBMP and PCCPresentation NBMP and PCC
Presentation NBMP and PCC
 

Mehr von The HDF-EOS Tools and Information Center

Mehr von The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

An Overview of HDF-EOS (Part 1)

  • 1. An Overview of HDF-EOS (Part I) Doug Ilg Raytheon STX Doug.Ilg@gsfc.nasa.gov (301) 441-4089 1
  • 2. Outline What is HDF-EOS? The Grid Interface The Point Interface 2
  • 3. What is HDF-EOS? An HDF “Profile” An extension to HDF A library built “on top” of HDF Three new data objects Three new programming interfaces 3
  • 4. Why HDF-EOS? Standard HDF lacks well defined ways of handling some key needs of EOSDIS Data structures for Earth remote sensing data and in-situ measurements with: – tightly coupled geolocation information – subsetting services based on geolocation ECS metadata model 4
  • 5. HDF-EOS Platforms HDF-EOS Version 2.3 is available for: Sun SPARC - Solaris SGI - IRIX DEC Alpha - Digital UNIX HP 9000 - HP-UX IBM RS/6000 - AIX PC - Windows 95/NT 5
  • 6. HDF-EOS Interfaces C and FORTRAN Interfaces for: Grid Data (GD) Point Data (PT) Swath Data (SW) 6
  • 7. HDF-EOS Programming Model Writing – – – – – – – – open file create object define structure detach object* attach object* write data detach object close file Reading – – – – – – open file attach object inquire object read data detach object close file 7
  • 8. A Grid Data Set 8
  • 9. A Grid Structure Xdim Size: 2000 Projinfo Ydim Size: 800 9
  • 10. Projections Supported Geographic Transverse Mercator Universal Transverse Mercator Hotine Oblique Mercator Space Oblique Mercator Polar Stereographic Lambert Azimuthal Equal Area Lambert Conformal Conic Polyconic Interrupted Goode’s Homolosine Integerized Sinusoidal 10
  • 11. Components of the Grid Interface Access Definition Basic I/O Inquiry Subset Tiling 11
  • 12. Tips on Writing a Grid Order of calls is significant: – Setting a compression method affects all subsequently defined fields – Setting a tiling scheme affects all subsequently defined fields 12
  • 13. Grid Subsetting Features By Geolocation – GDdefboxregion/Gdextractboxregion By “Vertical” Field – GDdefvrtregion/GDextractvrtregion By Time (special case of vertical) Tip: use Geolocation, then Vertical/ Temporal 13
  • 14. Compression Methods for Grids Run-Length Encoding Adaptive Huffman Gzip 14
  • 15. A Point Data Set Lat 61.12 45.31 38.50 38.39 30.00 37.45 18.00 43.40 34.03 32.45 33.30 42.15 35.05 34.12 46.32 47.36 39.44 21.25 44.58 41.49 25.45 Lon Temp(C) Dewpt(C) -149.48 15.00 5.00 -122.41 17.00 5.00 -77.00 24.00 7.00 -90.15 27.00 11.00 -90.05 22.00 7.00 -122.26 25.00 10.00 -76.45 27.00 4.00 -79.23 30.00 14.00 -118.14 25.00 4.00 -96.48 32.00 8.00 -112.00 30.00 10.00 -71.07 28.00 7.00 -106.40 30.00 9.00 -77.56 28.00 9.00 -87.25 30.00 8.00 -122.20 32.00 15.00 -104.59 31.00 16.00 -78.00 28.00 7.00 -93.15 32.00 13.00 -87.37 28.00 9.00 -80.11 19.00 3.00 15
  • 16. A Point Structure Lat Long Buoy ID 25.2645 091.2564 0126 22.3549 -93.4657 3564 23.2564 -89.2546 1256 Buoy ID 0126 0126 3564 1256 1256 0126 3564 Time Wave Height(ft) Temp(C) 01:26 2.54 18.4 05:56 3.58 18.2 06:28 12.64 16.4 08:12 7.58 17.1 09:58 7.76 17.2 09:59 4.23 20.1 10:16 10.23 17.5 16
  • 18. Tips on Writing a Point Every level in a Point data set must be linked into the hierarchy. Before two levels can be linked, a link field must exist. 18
  • 19. Point Subsetting Features By Time – PTdeftimeperiod/PTextractperiod By Geolocation – PTdefboxregion/PTextractregion Tip: use one or the other, not both 19
  • 21. Tips for HDF-EOS Coding Most operations (read, write, subset) work on a single field at a time. Region IDs and Period IDs are interchangeable and can be reused to further reduce a subset. Partial writes (appending) on compressed fields are only supported through tiling. 21