The document summarizes the validation program for environmental data records (EDRs) from the Cross-track Infrared Microwave Sounding Suite (CrIMSS) on the Joint Polar Satellite System (JPSS) NPP satellite. The program aims to validate CrIMSS EDRs including atmospheric vertical temperature profiles (AVTP), moisture profiles (AVMP), and pressure profiles (AVPP) against requirements. It outlines the validation team members and phases from pre-launch through long-term monitoring. Current pre-launch efforts include using proxy datasets from other satellites to test the EDR algorithm and initial statistics comparing CrIMSS EDRs to analysis data.
1. Joint Polar Satellite System (JPSS) Environmental
Data Record Validation Program for the NPP
Cross-track Infrared Microwave
Sounding Suite (CrIMSS)
Nicholas R. Nalli,1,2 Christopher D. Barnet,1 Lihang Zhou,*1,3
Murty Divakarla,1,4 and Degui Gu5
*Presented by Lihang Zhou
1 NOAA/NESDIS/STAR, Camp Springs, Maryland, USA
2 DellServices, Federal Government, Inc., Fairfax, Virginia, USA
3 JPSS Office, Silver Spring, Maryland, USA
4 I.M. Systems Group, Inc.
5 Northrop Grumman Aerospace Systems (NGAS), Redondo Beach, CA, USA
2. With contributions fromâŚ
⢠G. Guo (NOAA/NESDIS/STAR)
⢠X. Liu, S. Kizer (NASA/LaRC)
⢠B. Blackwell (MIT)
⢠H. Kilcoyne and J. Feeley (JPSS Office)
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 2
3. Outline
⢠CrIMSS (CrIS/ATMS) EDR Product Overview
⢠Cal/Val Program Status
â Overview
â Team Members (roles and responsibilities âfor the
recordâ)
â JPSS CrIMSS Cal/Val Phases
â Current (Pre-Launch Phase) Efforts
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 3
4. CrIMSS EDR
PRODUCT OVERVIEW
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 4
5. Atmospheric Vertical Temperature Profile (AVTP)
⢠EDR used for
initialization of high-
resolution NWP models,
atmospheric stability,
basic science research,
etc.
⢠Non-precipitating
scenes
⢠Key Performance
Parameter (KPP) for
lower tropospheric
CrIMSS AVTP EDR retrieved from SDR Proxy Data
temperature Acknowledgment to SOAT Members G. Guo, X. Liu, S. Kizer, and B. Blackwell
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 5
6. Atmospheric Vertical Moisture Profile (AVMP)
⢠EDR used for
initialization of high-
resolution NWP models,
atmospheric stability,
basic science research,
etc.
⢠Non-precipitating
scenes
⢠Key Performance
Parameter (KPP) for
lower tropospheric
CrIMSS AVMP EDR retrieved from SDR Proxy Data
water vapor Acknowledgment to SOAT Members G. Guo, X. Liu, S. Kizer, and B. Blackwell
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 6
7. Atmospheric Vertical Pressure Profile (AVPP);
Trace Gas IP and P3I
CrIMSS O3 IP retrieved from SDR
Proxy Data
⢠AVPP is an EDR derived Acknowledgement to SOAT Members G.
Guo, X. Liu, S. Kizer, B. Blackwell
from AVTP and AVMP
that requires validation.
⢠Trace gas retrievals from
sounders are desirable
for basic science
â O3 is an intermediate
product (IP) necessary
for optimal EDR
retrieval
Specification Performance Requirements
â CO and CH4 are
Parameter IORD-II NGAS SY15-0007
experimental (P3I)
Pressure Profile 4 hPa threshold, 2 hPa 3 hPa (with precip and
products (not funded goal Psurf error exclusions)
within cal/val CH4 (methane) column 1% precision, ďą5% n/a
program) accuracy
CO (carbon monoxide) 3% precision, ďą5% n/a
column accuracy
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 7
8. CrIMSS EDR
CAL/VAL PROGRAM STATUS
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 8
9. Cal/Val Program Overview
⢠The NPP CrIMSS EDR Validation Program is to ensure the data products comply with the
requirements of the sponsoring agencies, drawing on lessons learned from validating the
AIRS/AMSU and IASI/AMSU/MHS sounding systems.
â Using datasets proven valuable for global validation for AIRS (ECMWF, NCEP/GFS, RAOBs, etc)
â Team of Subject Matter Experts (SMEs) from both user and science communities to leverage heritage
knowledge, experience and tools as well as assure understanding of customer mission success
â Leverage existing capabilities wherever possible
⢠Operational real-time systems (ATOVS, GOES)
⢠AIRS and IASI processing and validation systems
⢠Routine AIRS and IASI instrument monitoring and characterization
⢠Intensive field campaign (aircraft sensor) cal/val experience
⢠To determine whether the EDRs have met their global performance specifications, a âroll-upâ of
regional assessments is envisioned.
â Typical validation methods characterize the performance of the EDRs in various ensembles of cases.
â Specifically, this will involve stratifying the specs according to various bins:
⢠day/night
⢠latitude bands (i.e., polar, midlatitude, tropical)
⢠land/ocean/ regional
⢠(possibly) altitude and surface characteristics
⢠Assessments will also be performed against current capabilities using heritage sensors and
algorithms
â Hyperspectral AIRS and IASI systems (well established comparable products)
â ATOVS (HIRS/AMSU) operational products to demonstrate the value of the hyperspectral measurements to
the user community
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 9
10. Team Members â Roles & Responsibilities (1/3)
NOAA Team Members
EDR Name Organization Funding Agency Task
Lead Chris Barnet NOAA/NESDIS/ JPSS Lead CrIS/ATMS
STAR EDR Team
AVTP/AVMP Changyong Cao NOAA/NESDIS/ JPSS Coordination w/
STAR GSICS
AVTP/AVMP Mitch Goldberg NOAA/NESDIS/ JPSS & NOAA-PSDI NGAS-code,
STAR NUCAPS
AVTP/AVMP Anthony Reale NOAA/NESDIR/ JPSS NPROVS
STAR
CrIMSS SDR John Derber NOAA/NCEP JPSS NWP ingest
AVTP/AVMP Fuzhong Weng NOAA/NESDIS/ NOAA-PSDI MiRS
STAR
CrIMSS SDR Yong Han NOAA/NESDIS/ JPSS CrIS SDR
STAR
CrIMSS SDR Tsan Mo NOAA/NESDIS/ JPSS ATMS SDR
July 2011
STAR
Nalli, Barnet, Zhou, et al. - IGARSS-11 10
11. Team Members â Roles & Responsibilities (2/3)
NOAA-External Team Members
EDR Name Organization Funding Agency Task
CriMSS SDR Gail Bingham USU/SDL JPSS CrIS/ATMS SDR
AVTP/AVMP Bill Blackwell MIT JPSS Microwave
products
AVTP/AVMP Allan Larar NASA/LaRC JPSS EDR Validation
AVTP/AVMP Xu Liu NASA/LaRC JPSS IASI proxy, EDR
validation
AVTP/AVMP Hank SSEC JPSS SDR, PEATE
Revercomb
AVTP/AVMP Dave Tobin SSEC JPSS ARM-RAOBS
AVTP/AVMP Larrabee Strow UMBC JPSS OSS validation
AVTP/AVMP Joel Susskind NASA/GSFC JPSS AIRS proxy
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 11
12. Team Members â Roles & Responsibilities (3/3)
NOAA-External Team Members
EDR Name Organization Funding Agency Task
CrIMSS SDR Steven Beck Aerospace Corp. external RAOB,LIDAR
CrIMSS SDR Steven English UKMET external UKMET analysis
CrIMSS SDR William Bell ECMWF external ECMWF analysis
AVTP/AVMP Steve Friedman NASA/JPL NASA Sounder PEATE
AVTP/AVMP Denise Hagan NGAS NG Prime EDR
CrIMSS SDR Degui Gu Validation/SDR
coordination
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 12
13. Cal/Val Phases
⢠Pre-Launch
⢠Early Orbit Checkout (EOC)
â L + 90 days, as sensors are activated
⢠Intensive Cal/Val (ICV)
â Stable SDR out to L + 24 months
⢠Long-Term Monitoring (LTM)
â From end of ICV (L + 24 months) to the end of operational lifetime
â Characterization of all EDR products and long-term demonstration of
performance
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 13
14. EDR Validation Activities by Phase (1/2)
Pre-Launch â Early Orbit Checkout
⢠Pre-launch
â Global synthetic datasets
⢠Tests algorithm for theoretical robustness â self-consistent temperature, moisture, ozone, and cloud water profiles are âcontrolledâ
⢠Simulated for a wide range of environmental scenes, including seasonal, diurnal, spatial variability, and actual sensor scanning
geometry including FOV rotation
â Proxy datasets
⢠Data derived from real measurements from existing satellite systems with similar specs (here AIRS/AMSU and IASI/AMSU)
⢠Used to test concepts and exercise CrIMSS algorithm ; support launch readiness (functionality of the code, develop methods of
empirical bias correction) and porting of algorithms
⢠Aqua/AIRS has advantage of having 9 IR FOVs and 01:30 orbit
⢠METOP/IASI has advantage of direct IR radiance spectral transform and MHS channels
⢠Early Orbit Checkout
â Model comparisons
⢠Useful at first light and for long-term monitoring
â Similar to AIRS science team activities using ECMWF and NCEP/GFS
â Compare forward models, sanity checks on âobs â calcâ
â Simultaneous nadir overpass and double differencing of radiances.
⢠Methods are becoming mature, high level of confidence from AIRS/IASI work.
â Inter-compare with operational AIRS and/or IASI products.
⢠Initially (first light) use off-line versions of CrIMSS products.
â Even if retrievals are poor, having geophysical state and diagnostics can help identify problems.
⢠Useful to identify and mitigate issues with the NGAS EDRs
â PCA analysis of noise characteristics and instrument monitoring.
⢠Can be used to verify instrument noise, random and systematic components.
⢠Can be used to monitor instrument health.
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 14
15. EDR Validation Activities by Phase (2/2)
Intensive Cal/Val â Long-Term Monitoring
⢠Operational RAOBs
â Useful for long-term characterization and global latitude representation. After
couple months should begin to have significant statistics.
â Tony Realeâs NOAA Products Validation System (NPROVS)
⢠Dedicated RAOBs
â Useful for regional characterization.
â Will take many months (years?) to accumulate enough statistics.
â Need site support and funding for large number of RAOBs.
â Ideally coordination through GCOS Reference Upper Air Network (GRUAN)
⢠Intensive Field Campaigns (e.g., Tobin et al. 2006, JGR, 111; Taylor et al. 2008, BAMS, 89;
Blackwell et al. 2001, TGARS, 39)
â Useful for SDR cal/val; state specification for thorough âcal/val dissectionâ.
â Will attempt coordination with other cal/val leads (e.g., VIIRS clouds).
â Scientific campaigns of opportunity
⢠Low cost, low risk; has advantage of exploiting scientific participation; crude âdress-
rehearsalâ
⢠NOAA Aerosols and Ocean Science Expeditions (AEROSE) (Nalli et al. 2011, BAMS), linkage
to GOES-R program
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 15
16. Current Pre-Launch Phase Efforts (1/2)
Ocean-only Cloud_Cleared (Divakarla, 2011)
⢠The SOAT is preparing for NPP AVTP- RMSD (K) AVMP RMSD (%)
launch with proxy datasets and
methods of evaluation
â Working toward launch readiness
Figures courtesy of SOAT team
effort: G. Guo, X. Liu, S. Kizer,
⢠Proxy Data Package for 19 Oct 07 B. Blackwell
_____ IASI (IR) -------- CrIMSS (IR+MW)
_____ IASI(MW) -------- CrIMSS(MW-Only)
âFocus Dayâ generated by SOAT
Retrieved Total Precipitable Water (cm) â Granules 139-142. (Divakarla et al., 2011)
(LaRC, MIT, NASA, and NOAA) IASI CrIMSS ECMWF
â CrIMSS EDR algorithm has
demonstrated good convergence
â Have obtained initial estimates of
OSS RTM biases
â Statistics of AVTP and AVMP
differences ECMWF analysis show
reasonable and encouraging
performance The Google-Earth Pro interface used to display CrIMSS/IASI
EDRs (and SDRs) offers a very powerful method to evaluate
EDRs qualitatively at the retrieval Field of Regard (FOR)
resolution. Many EDR products (AVTP, AVMP, Total O3 etc.)
can be cross-checked with this interface and has potential
Location of Granules
for many near real-time applications in the future.
139-142
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 16
17. Current Pre-Launch Phase Efforts (2/2)
RAOB
⢠NOAA AEROSE Campaigns
(Nalli et al. 2011)
â Pre-launch test of
deployment of scientific
validation campaigns of
opportunity.
â Ship-based dedicated RAOB
(PTU, z, wind, O3) over open
ocean.
â Region is of scientific interest
germane to the CrIMSS
mission.
⢠Saharan air layer (SAL) and
tropical cyclogenesis
⢠Dust and biomass burning NOAA Unique IASI Product
aerosols
⢠Tropospheric ozone
dynamics
⢠AEROSE 2010 is being used as
a field campaign proxy dataset
⢠AEROSE 2011 is currently
underway!
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 17
18. Summary
⢠The status of the NPP CrIMSS EDR Validation Program was
overviewed in this presentation. The validation program is to
ensure the data products comply with the requirements of
the sponsoring agencies. JPSS specifications for the AVTP,
AVMP and AVPP EDR products will replace IORD/NGAS specs.
⢠To demonstrate launch readiness, pre-launch Cal/Val efforts
are currently ongoing including the development of âproxy
datasets,â focus days, intensive campaigns-of-opportunity,
and initial tests of the IDPS EDR algorithm.
July 2011 Nalli, Barnet, Zhou, et al. - IGARSS-11 18