SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
In Cooperation with the New Mexico Interstate Stream Commission (NMISC)

    Building a Water-Resources
    Geodatabase for the Rio Grande Basin
    – San Acacia, New Mexico to Fort
    Quitman, Texas
    Thomas E. Burley, GISP
    USGS Texas Water Science Center – Austin, TX

    2011 Texas GIS Forum – Austin, TX



U.S. Department of the Interior
U.S. Geological Survey
Overview – Need and Significance

 Data collected for middle Rio Grande Basin for variety of
  purposes over several decades by numerous agencies,
  researchers, and organizations
 Previous attempts to compile these data have not been
  complete or done in a way that could be repeated
 A well-organized and usable database is needed to
  identify management priorities and facilitate hydrologic
  studies
Hydrologic Geodatabase Overview

   Data organized into a comprehensive spatially-
    enabled relational database (geodatabase)
   Stores spatial and tabular data for area of interest
    from multiple sources
   Data can be queried and/or viewed spatially to assist
    in identifying data gaps, conduct spatial analysis, and
    support decision-making
Rio Grande Basin – San Acacia, New
       Mexico to Fort Quitman, Texas

   Surface-water catchments
    encompass approximate
    extents of underlying aquifers
    of interest
   Surface-water catchments
    used to geographically filter
    physical sites and associated
    data from sources with larger
    spatial delivery extents
Data Sources and Types
 Hard-copy reports, previous data compilations, and
  various collecting entities
 Updated web-accessible raw data sources such as USGS
  NWIS, EPA STORET and state environmental agencies,
  many current through day of download
 Surface-water discharges, ground-water elevations, and
  water-quality data (daily and instantaneous)
Data Complexity: Making Sense of it All
Compilation Methods and Tools
 Data pre-processing scripts stage raw data for loading (e.g.,
  separate source files with site/sample/result/parameter tables)
 Loaders query data from staged source files
   • Facilitate maintenance and updates
   • Document how table fields were mapped from source files to final compiled
      geodatabase

 Methods scalable for a variety of hydrologic studies (data types,
  data size)
   • 24 distinct data sources
   • Of those, 10 are pre-existing compilations or raw data aggregation efforts
      such as EPA STORET which contain data from one or more collecting
      entities
Data Pre-Processing Scripts
 Import and format data from raw downloaded files into one
  “staged” relational database per source
 Scripts help clean data to ensure data integrity
   •   Remove extraneous non-printable characters
   •   Remove extra spaces
   •   Date formatting (MM/DD/YYYY)
   •   Separate multiple data types from one field (e.g., result values with
       comments) into separate fields

 Repeatable script programs (VBScript, VBA) with code
  comments as documentation help ensure data consistency
  and reduce human error
Data Compilation Loaders

   Load data into compilation database from source “staged”
    databases
   Cross-walks source file table fields with compilation table
    fields
   Functions as process documentation; customizable for
    each source
   Repeatable and consistent – helps reduce human error
Data Management Challenges:
           The Devil is in the Details
 Source compilation relational databases – database design
  and data integrity issues
 Site identification (Site ID’s): different ID’s & names for the
  same physical location on the ground
 Duplicate data
 Data recovery efforts and methods used
 Null values vs. zero; result value rounding
 Little or no metadata in most cases
Direct Benefits to Researchers

                      Multiple agencies’ data
                       managed in one location
                      Record-level metadata to
Relevant Data Only     document collecting agencies
                       and data sources (not always
                       the same)
                      One comprehensive relational
                       geodatabase as opposed to
                       scattered records stored as flat
                       files in spreadsheets
Direct Benefits to Researchers (cont.)
 Data can be limited to
  just relevant
  parameters/sites using
  traditional database
  queries via Structured
  Query Language (SQL)
  and/or spatial selections
  in a GIS
 Data enhanced for map
  production and spatial
  and temporal analysis
Summary
   Usability of source data greatly enhanced
   Facilitates identification of data gaps – spatial,
    temporal, and thematic
   Multitude of data stored in a well-documented format
    that can be readily updated
   Sound data management helps support sound science
    – quality information can only be derived from quality
    data
Questions?
                      Thomas E. Burley
                 Texas Water Science Center
                   U.S. Geological Survey
                     teburley@usgs.gov

Associated Publication:
Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of
   water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line,
   New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File
   Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/

Weitere ähnliche Inhalte

Ă„hnlich wie Building a water resources geodatabase for the rio grande basin

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)Rudolf Husar
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120Rudolf Husar
 
Database Management Systems - Management Information System
Database Management Systems - Management Information SystemDatabase Management Systems - Management Information System
Database Management Systems - Management Information SystemNijaz N
 
Dats nih-dccpc-kc7-april2018-prs-uoxf
Dats  nih-dccpc-kc7-april2018-prs-uoxfDats  nih-dccpc-kc7-april2018-prs-uoxf
Dats nih-dccpc-kc7-april2018-prs-uoxfPhilippe Rocca-Serra
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyCESSDA Training
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifaxcmspinto
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifaxcmspinto
 
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsTYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsArti Parab Academics
 
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISCombining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISAnastasija Nikiforova
 
GPS to GIS Emergency Mapping
GPS to GIS Emergency MappingGPS to GIS Emergency Mapping
GPS to GIS Emergency Mappingrmikol
 
Relational database revised
Relational database revisedRelational database revised
Relational database revisedmnodalo
 
A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...ieeepondy
 
FINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxFINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxChristianMatas2
 
Geographic information systems (gis) for libraries
Geographic information systems (gis) for librariesGeographic information systems (gis) for libraries
Geographic information systems (gis) for librariesSeti Keshmiripour
 
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsSemantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsArtificial Intelligence Institute at UofSC
 

Ă„hnlich wie Building a water resources geodatabase for the rio grande basin (20)

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120
 
Database Management Systems - Management Information System
Database Management Systems - Management Information SystemDatabase Management Systems - Management Information System
Database Management Systems - Management Information System
 
Dats nih-dccpc-kc7-april2018-prs-uoxf
Dats  nih-dccpc-kc7-april2018-prs-uoxfDats  nih-dccpc-kc7-april2018-prs-uoxf
Dats nih-dccpc-kc7-april2018-prs-uoxf
 
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsBrislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evs
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
 
Dbms9
Dbms9Dbms9
Dbms9
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsTYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
 
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISCombining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
 
GPS to GIS Emergency Mapping
GPS to GIS Emergency MappingGPS to GIS Emergency Mapping
GPS to GIS Emergency Mapping
 
Data base
Data baseData base
Data base
 
Relational database revised
Relational database revisedRelational database revised
Relational database revised
 
A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...
 
FINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxFINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptx
 
Geographic information systems (gis) for libraries
Geographic information systems (gis) for librariesGeographic information systems (gis) for libraries
Geographic information systems (gis) for libraries
 
6.2 software
6.2 software6.2 software
6.2 software
 
EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206
 
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsSemantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
 

Mehr von Texas Natural Resources Information System

From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...Texas Natural Resources Information System
 

Mehr von Texas Natural Resources Information System (20)

Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012
 
Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312
 
Using gps technology at the texas general land
Using gps technology at the texas general landUsing gps technology at the texas general land
Using gps technology at the texas general land
 
Ussls austin civil utility - klein - 061312 - final
Ussls austin   civil utility - klein - 061312 - finalUssls austin   civil utility - klein - 061312 - final
Ussls austin civil utility - klein - 061312 - final
 
Tx dot gps applications fuegner
Tx dot gps applications   fuegnerTx dot gps applications   fuegner
Tx dot gps applications fuegner
 
Tnris 2012
Tnris 2012Tnris 2012
Tnris 2012
 
Nmc ussls charter 2012
Nmc ussls charter 2012Nmc ussls charter 2012
Nmc ussls charter 2012
 
Nationwide dgps (ndgps) lt mendoza
Nationwide dgps (ndgps)   lt mendozaNationwide dgps (ndgps)   lt mendoza
Nationwide dgps (ndgps) lt mendoza
 
Lyle tamucc 2
Lyle tamucc 2Lyle tamucc 2
Lyle tamucc 2
 
Dirks cgsic brief 2012
Dirks cgsic brief 2012Dirks cgsic brief 2012
Dirks cgsic brief 2012
 
Connected vehicle highway network applications
Connected vehicle highway network applicationsConnected vehicle highway network applications
Connected vehicle highway network applications
 
Cgsic presentation humphreys
Cgsic presentation humphreysCgsic presentation humphreys
Cgsic presentation humphreys
 
Cgsic navcen
Cgsic navcenCgsic navcen
Cgsic navcen
 
Gnss international policy regional cgsic (austin - jun2012)
Gnss international policy   regional cgsic (austin - jun2012)Gnss international policy   regional cgsic (austin - jun2012)
Gnss international policy regional cgsic (austin - jun2012)
 
From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...
 
Early warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulfEarly warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulf
 
We are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreamsWe are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreams
 
Volunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national mapVolunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national map
 
Uav image recognition technology and applications
Uav image recognition technology and applicationsUav image recognition technology and applications
Uav image recognition technology and applications
 
Texas high water marks crowd sourcing history, culture, and geography
Texas high water marks   crowd sourcing history, culture, and geographyTexas high water marks   crowd sourcing history, culture, and geography
Texas high water marks crowd sourcing history, culture, and geography
 

KĂĽrzlich hochgeladen

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 

KĂĽrzlich hochgeladen (20)

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 

Building a water resources geodatabase for the rio grande basin

  • 1. In Cooperation with the New Mexico Interstate Stream Commission (NMISC) Building a Water-Resources Geodatabase for the Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas Thomas E. Burley, GISP USGS Texas Water Science Center – Austin, TX 2011 Texas GIS Forum – Austin, TX U.S. Department of the Interior U.S. Geological Survey
  • 2. Overview – Need and Significance  Data collected for middle Rio Grande Basin for variety of purposes over several decades by numerous agencies, researchers, and organizations  Previous attempts to compile these data have not been complete or done in a way that could be repeated  A well-organized and usable database is needed to identify management priorities and facilitate hydrologic studies
  • 3. Hydrologic Geodatabase Overview  Data organized into a comprehensive spatially- enabled relational database (geodatabase)  Stores spatial and tabular data for area of interest from multiple sources  Data can be queried and/or viewed spatially to assist in identifying data gaps, conduct spatial analysis, and support decision-making
  • 4. Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas  Surface-water catchments encompass approximate extents of underlying aquifers of interest  Surface-water catchments used to geographically filter physical sites and associated data from sources with larger spatial delivery extents
  • 5. Data Sources and Types  Hard-copy reports, previous data compilations, and various collecting entities  Updated web-accessible raw data sources such as USGS NWIS, EPA STORET and state environmental agencies, many current through day of download  Surface-water discharges, ground-water elevations, and water-quality data (daily and instantaneous)
  • 6. Data Complexity: Making Sense of it All
  • 7. Compilation Methods and Tools  Data pre-processing scripts stage raw data for loading (e.g., separate source files with site/sample/result/parameter tables)  Loaders query data from staged source files • Facilitate maintenance and updates • Document how table fields were mapped from source files to final compiled geodatabase  Methods scalable for a variety of hydrologic studies (data types, data size) • 24 distinct data sources • Of those, 10 are pre-existing compilations or raw data aggregation efforts such as EPA STORET which contain data from one or more collecting entities
  • 8. Data Pre-Processing Scripts  Import and format data from raw downloaded files into one “staged” relational database per source  Scripts help clean data to ensure data integrity • Remove extraneous non-printable characters • Remove extra spaces • Date formatting (MM/DD/YYYY) • Separate multiple data types from one field (e.g., result values with comments) into separate fields  Repeatable script programs (VBScript, VBA) with code comments as documentation help ensure data consistency and reduce human error
  • 9. Data Compilation Loaders  Load data into compilation database from source “staged” databases  Cross-walks source file table fields with compilation table fields  Functions as process documentation; customizable for each source  Repeatable and consistent – helps reduce human error
  • 10. Data Management Challenges: The Devil is in the Details  Source compilation relational databases – database design and data integrity issues  Site identification (Site ID’s): different ID’s & names for the same physical location on the ground  Duplicate data  Data recovery efforts and methods used  Null values vs. zero; result value rounding  Little or no metadata in most cases
  • 11. Direct Benefits to Researchers  Multiple agencies’ data managed in one location  Record-level metadata to Relevant Data Only document collecting agencies and data sources (not always the same)  One comprehensive relational geodatabase as opposed to scattered records stored as flat files in spreadsheets
  • 12. Direct Benefits to Researchers (cont.)  Data can be limited to just relevant parameters/sites using traditional database queries via Structured Query Language (SQL) and/or spatial selections in a GIS  Data enhanced for map production and spatial and temporal analysis
  • 13. Summary  Usability of source data greatly enhanced  Facilitates identification of data gaps – spatial, temporal, and thematic  Multitude of data stored in a well-documented format that can be readily updated  Sound data management helps support sound science – quality information can only be derived from quality data
  • 14. Questions? Thomas E. Burley Texas Water Science Center U.S. Geological Survey teburley@usgs.gov Associated Publication: Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line, New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/