Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation products”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2001

SIMBIOS Data Product and Algorithm Validation with Emphasis on the Biogeochemical and Inherent Optical Properties

The purpose of our component of the Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) program is to address and quantify the relative accuracy of the various ocean color remote sensing products by means of product and algorithm validation. In order to accomplish these goals, we have been collaborating in an international research program in the Gulf of California designed to examine the spatial and temporal bio-optical variability in this region. In addition, we participated in various cruises of opportunity to supplement our validation data set. Our long-term objectives are to: (1) collect optical and biochemical data in oceanic and coastal regions of interest; (2) provide collected data to the Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) Bio-Optical Archive and Storage System (SeaBASS) database, the SIMBIOS project office, and other interested users; (3) maintain and update instrumentation and data archiving and dissemination systems; and (4) determine spatial and temporal error fields for the biological and geophysical data products from the various ocean color missions.

Zaneveld, J. Ronald V.↗
NASA NTRS2004

Toward a Global Map of Raindrop Size Distributions: Rain-Type Classification and Its Implications for Validating Global Rainfall Products - Part 1

Variability in the global distribution of precipitation is recognized as a key element in assessing the impact of climate change for life on earth. The response of precipitation to climate forcings is, however, poorly understood because of discrepancies in the magnitude and sign of climatic trends in satellite-based rainfall estimates. Quantifying and ultimately removing these biases is critical for studying the response of the hydrologic cycle to climate change. In addition, estimates of random errors owing to variability in algorithm assumptions on local spatial and temporal scales are critical for establishing how strongly their products should be weighted in data assimilation or model validation applications and for assigning a level of confidence to climate trends diagnosed from the data. This paper explores the potential for refining assumed drop size distributions (DSDs) in global radar rainfall algorithms by establishing a link between satellite observables and information gleaned from regional validation experiments where polarimetric radar, Doppler radar, and disdrometer measurements can be used to infer raindrop size distributions. By virtue of the limited information available in the satellite retrieval framework, the current method deviates from approaches adopted in the ground-based radar community that attempt to relate microphysical processes and resultant DSDs to local meteorological conditions. Instead, the technique exploits the fact that different microphysical pathways for rainfall production are likely to lead to differences in both the DSD of the resulting raindrops and the three-dimensional structure of associated radar reflectivity profiles. Objective rain-type classification based on the complete three-dimensional structure of observed reflectivity profiles is found to partially mitigate random and systematic errors in DSDs implied by differential reflectivity measurements. In particular, it is shown that vertical and horizontal reflectivity structure obtained from spaceborne radar can be used to reproduce significant differences in Z(sub dr) between the easterly and westerly climate regimes observed in the Tropical Rainfall Measuring Mission Large-scale Biosphere-Atmosphere (TRMM-LBA) field experiment as well as the even larger differences between Amazonian rainfall and that observed in eastern Colorado. As such, the technique offers a potential methodology for placing locally observed DSD information into a global framework.

L'Ecuyer, Tristan S.↗
NASA NTRS2016

Soil Moisture Active Passive Mission L4_C Data Product Assessment (Version 2 Validated Release)

The SMAP satellite was successfully launched January 31st 2015, and began acquiring Earth observation data following in-orbit sensor calibration. Global data products derived from the SMAP L-band microwave measurements include Level 1 calibrated and geolocated radiometric brightness temperatures, Level 23 surface soil moisture and freezethaw geophysical retrievals mapped to a fixed Earth grid, and model enhanced Level 4 data products for surface to root zone soil moisture and terrestrial carbon (CO2) fluxes. The post-launch SMAP mission CalVal Phase had two primary objectives for each science product team: 1) calibrate, verify, and improve the performance of the science algorithms, and 2) validate accuracies of the science data products as specified in the L1 science requirements. This report provides analysis and assessment of the SMAP Level 4 Carbon (L4_C) product pertaining to the validated release. The L4_C validated product release effectively replaces an earlier L4_C beta-product release (Kimball et al. 2015). The validated release described in this report incorporates a longer data record and benefits from algorithm and CalVal refinements acquired during the SMAP post-launch CalVal intensive period. The SMAP L4_C algorithms utilize a terrestrial carbon flux model informed by SMAP soil moisture inputs along with optical remote sensing (e.g. MODIS) vegetation indices and other ancillary biophysical data to estimate global daily net ecosystem CO2 exchange (NEE) and component carbon fluxes for vegetation gross primary production (GPP) and ecosystem respiration (Reco). Other L4_C product elements include surface (10 cm depth) soil organic carbon (SOC) stocks and associated environmental constraints to these processes, including soil moisture and landscape freeze/thaw (FT) controls on GPP and respiration (Kimball et al. 2012). The L4_C product encapsulates SMAP carbon cycle science objectives by: 1) providing a direct link between terrestrial carbon fluxes and underlying FT and soil moisture constraints to these processes, 2) documenting primary connections between terrestrial water, energy and carbon cycles, and 3) improving understanding of terrestrial carbon sink activity in northern ecosystems. There are no L1 science requirements for the L4_C product; however self-imposed requirements have been established focusing on NEE as the primary product field for validation, and on demonstrating L4_C accuracy and success in meeting product science requirements (Jackson et al. 2012). The other L4_C product fields also have strong utility for carbon science applications; however, analysis of these other fields is considered secondary relative to primary validation activities focusing on NEE. The L4_C targeted accuracy requirements are to meet or exceed a mean unbiased accuracy (ubRMSE) for NEE of 1.6 g C/sq m/d or 30 g C/sq m/yr, emphasizing northern (45N) boreal and arctic ecosystems; this is similar to the estimated accuracy level of in situ tower eddy covariance measurement-based observations (Baldocchi 2008).

Cal/Val↗
NASA NTRS2016

Evaluation of the Validated Soil Moisture Product from the SMAP Radiometer

NASA's Soil Moisture Active Passive (SMAP) mission launched on January 31, 2015 into a sun-synchronous 6 am/6 pm orbit with an objective to produce global mapping of high-resolution soil moisture and freeze-thaw state every 2-3 days using an L-band (active) radar and an L-band (passive) radiometer. The SMAP radiometer began acquiring routine science data on March 31, 2015 and continues to operate nominally. SMAP's radiometer-derived soil moisture product (L2_SM_P) provides soil moisture estimates posted on a 36 km fixed Earth grid using brightness temperature observations from descending (6 am) passes and ancillary data. A beta quality version of L2_SM_P was released to the public in September, 2015, with the fully validated L2_SM_P soil moisture data expected to be released in May, 2016. Additional improvements (including optimization of retrieval algorithm parameters and upscaling approaches) and methodology expansions (including increasing the number of core sites, model-based intercomparisons, and results from several intensive field campaigns) are anticipated in moving from accuracy assessment of the beta quality data to an evaluation of the fully validated L2_SM_P data product.

Ocean Salinity↗
NASA NTRS2025

Validation of Formaldehyde Products From Three Satellite Retrievals (OMI SAO, OMPS-NPP SAO, and OMI BIRA) in the Marine Atmosphere With Four Seasons of Atom Aircraft Observations

Formaldehyde (HCHO) in the atmosphere is an intermediate product from the oxidation of methane and non-methane volatile organic compounds. In remote marine regions, HCHO variability is closely related to atmospheric oxidation capacity and modeled HCHO in these regions is usually added as a global satellite HCHO background. Thus, it is important to understand and validate the levels of satellite HCHO over the remote oceans. Here we intercompare three satellite retrievals of total HCHO columns (OMI-SAO (v004), OMPS-NPP SAO, and OMI BIRA) and validate them against in situ observations from the NASA Atmospheric Tomography Mission (ATom) mission. All retrievals are correlated with ATom integrated columns over remote oceans, with OMI SAO (v004) showing the best agreement. This is also reflected in the mean bias (MB) for OMI SAO (-0.73±0.87) x 10 15 molec cm -2 , OMPS SAO (-0.76±0.88) x 10 15 molec cm -2 , and OMI BIRA (-1.40±1.11) x 10 15 molec cm -2 . We recommend the OMI-SAO (v004) retrieval for remote ocean atmosphere studies. Three satellite HCHO retrievals and in situ ATom columns all generally captured the spatial and seasonal distributions of HCHO in the remote ocean atmosphere. Retrieval bias varies by latitude and season, but a persistent low bias is found in all products at high latitudes and the general low bias is most severe for the OMI BIRA product. Examination of retrieval components reveals slant column corrections have a larger impact on the retrievals over remote marine regions while AMFs play a smaller role. This study informs that the potential latitude-dependent biases in the retrievals require further investigation for improvement and should be considered when using marine HCHO satellite data, and vertical profiles from in situ instruments are crucial for validating satellite retrievals.

Atom↗
NASA NTRS2017

Strategies for Validating Satellite Soil Moisture Products Using in Situ Networks: Lessons from the USDA-ARS Watersheds

There are a variety of soil moisture station designs and networks deployed throughout the world, each with varying applications and uses. The purpose of satellite validation of soil moisture products, a dense network of soil moisture networks are required with soil moisture sensors at the near surface (approx. 5 cm or less) to correspond to the satellite footprints and signals. The USDA- Agricultural Research Service operates a collection of soil moisture networks as a part of the Long Term Agro-ecosystem Research (LTAR) network to this end. These networks have been used to validate products from AMSR-E, SMOS, Aquarius, and SMAP. A review of these results and a synopsis of successful scaling strategies are discussed.

soil moisture↗
NASA NTRS2007

Survey of Product-line Verification and Validation Techniques

This report presents the results from the first task of the SARP Center Initiative, 'Product Line Verification of Safety-Critical Software.' Task 1 is a literature survey of available techniques for product line verification and validation. Section 1 of the report provides an introduction to product lines and motivates the survey of verification techniques. It describes what is reused in product-line engineering and explains the goal of verifiable conformance of the developed system to its product-line specifications. Section 2 of the report describes six lifecycle steps in product-line verification and validation. This description is based on, and refers to, the best practices extracted from the readings. It ends with a list of verification challenges for NASA product lines (2.7) and verification enablers for NASA product lines (2.8) derived from the survey. Section 3 provides resource lists of related conferences, workshops, industrial and defense industry experiences and case studies of product lines, and academic/industrial consortiums. Section 4 is a bibliography of papers and tutorials with annotated entries for relevant papers not previously discussed in sections 2 or 3.

testing↗
NASA NTRS2015

Validation of GOSAT Data Products; Interim Report on the GOSAT/TANSO Project

The Orbiting Carbon Observatory-2 (OCO-2) Team has continued working closely with the Greenhouse Gases Observing Satellite (GOSAT) team to (i) conduct vicarious calibration experiments in Railroad Valley, NV, U.S.A., (ii) retrieve estimates of X CO2 from OCO-2 and GOSAT TANSO-FTS data, and (iii) validate these products using internationally recognized standards. The OCO-/GOSAT relationship was reinforced in March 2015 with the signing a new Memorandum of Understanding between NASA and the GOSAT and GOSAT-2 partners. Over the past year, while the GOSAT team has been finalizing the V201 product, the OCO-2 team has focused primarily on the delivery of the OCO-2 product, providing new opportunities for cross calibration of the OCO-2 and GOSAT instruments and cross validation of their products. These efforts are just now producing results. Members of the OCO-2 team have also continued the analysis of the GOSAT V161.161 data and the ACOS B3.5 products. Those efforts have produced 2 new refereed publications and several others in review. The OCO-2 now preparing to reprocess the entire GOSAT TANSO-FTS data record using the GOSAT V201 product and OCO-2 B7 algorithm to produce a 7-year, multi-satellite climate data record for X(sub CO2).

Wennberg, Paul↗
NASA NTRS2016

Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the “Version 2” validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities.

SMAP L4_SM↗
NASA NTRS2007

Sensitivity Study for Sensor Optical and Electric Crosstalk Based on Spectral Measurements: An Application to Developmental Sensors Using Heritage Sensors Such As MODIS

The process of developing new sensors for space flight frequently builds upon the designs and experience of existing heritage space flight sensors. Frequently in the development and testing of new sensors, problems are encountered that pose the risk of serious impact on successful retrieval of geophysical products. This paper describes an approach to assess the importance of optical and electronic cross-talk on retrieval of geophysical products using new MODIS-like sensors through the use of MODIS data sets. These approaches may be extended to any sensor characteristic and any sensor where that characteristic may impact the Level 1 products so long as validated geophysical products are being developed from the heritage sensor. In this study, a set of electronic and/or optical cross-talk coefficients are postulated. These coefficients are sender-receiver influence coefficients and represent a sensor signal contamination on any detector on a focal plane when another band's detectors on that focal plane are stimulated with a monochromatic light. The approach involves using the postulated cross-talk coefficients on an actual set of MODIS data granules. The original MODIS data granules and the cross-talk impacted granules are used with validated geophysical algorithms to create the derived products. Comparison of the products produced with the original and cross-talk impacted granules indicates potential problems, if any, with the characteristics of the developmental sensor that are being studied.

Butler, James J.↗
NASA NTRS1983

Cloud observations with Nimbus-7 satellite data

A Nimbus-7 Cloud Data Processing Team was established in 1982 in order to implement cloud-related studies for as long as the spacecraft's Temperature Humidity IR radiometer and Total Ozone Mapping Spectrometer continue to operate. It will soon be possible to correlate the Nimbus-7 cloud cover information with International Satellite Cloud Climatology results. The production of validated Nimbus-7 cloud products was scheduled to begin in November, 1983; each year of Nimbus-7 cloud data should take about four months to produce.

Stowe, L. L.↗
NASA NTRSDate not supplied

NASA EOSDIS 20 Years of Data Usage and User Assessment in Support of Open Science Initiative

NASA EOS Data and Information System (EOSDIS) has been distributing data to world-wide users free with open access. Since the launch of NASA’s Terra satellite in 1999, more than 10,000 distinct EOS data products have been archived and distributed by NASA-funded Earth Science data centers encompassed by the EOSDIS. As of September 30, 2022, more than 90 PB of data archived by EOSDIS have been made available to public users and during FY 2023 over 60 PB have been distributed to public users worldwide. Over these twenty and more years, it has shown significant increase in the distribution of various data products. This has been possible due to free and open access of the data thereby a step towards open science initiative. The purposes of this study are 1) to perform a comprehensive investigation of the archive and distribution patterns of EOSDIS data products for last 20 years, 2) to identify and characterize the global user community for those data, 3) analyze the increased demand for data products, 4) evaluate distribution of higher level products because those are the ones most frequently used in the studies of natural disasters by public users (those data requestors not involved directly in the production or validation of the data products.) and contribute globally to the advance scientific understanding of the Earth-Atmosphere Systems. Funded by the Earth Science Data and Information System (ESDIS) Project, the ESDIS Metrics System (EMS) collects archive, distribution, and user information from EOSDIS data centers. The information (comprising all data products including heritage datasets going back to the 1990s) is stored in a relational database from which it can be analyzed in many ways. We present several metrics analyses that include data distribution patterns for all, as well as the most frequently requested data products; and user characterizations by country, domain, and Earth Science discipline (e.g., Land, Ocean, Cryosphere) of the requested products. Due to the enormous quantity of data handled by EOSDIS data centers and requirements of future data systems to archive increasing amounts of Earth Science data from future and current Earth Science missions effectively, the results of this study can provide insight on how the user communities have accessed the data and provide guidance for open science initiative.

Lalit Wanchoo↗
NASA NTRS2004

Validation of SCIAMACHY Radiances and Ozone Products Using Ground and Space Observations

Validation of SCIAMACHY data products are is key element for the detecting a stratospheric ozone recovery, which is a high priority for environmental research and environmental policy. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of satellite radiances from space and from the ground can be an effective means for correcting long term drifts of backscatter type satellite measurements such as SCIAMACHY and can be used to cross calibrate all BUV instruments in orbit (TOMS, SBUV/2, GOME, OMI, GOME-2, OMPS). This method bypasses the retrieval algorithms used for both satellite and ground based measurements that are normally used to validate and correct the satellite data. This approach however requires well calibrated instruments and an accurate radiative transfer model that accounts for aerosols. In addition to comparing radiances, validation of SCIAMACHY ozone products will conducted by comparing total and profile ozone with TOMS and SBUV/2.

Hilsenrath, E.↗
NASA NTRS2012

NASA In Situ Data Needs to Support the Operational Calibration and Validation of Ocean Color Satellite Data Products

Calibrating ocean color satellite instruments and validating their data products requires temporal and spatial abundances of high quality in situ oceanographic data. The Consortium for Ocean Leadership Ocean Observing Initiative (OOl) is currently implementing a distributed array of in-water sensors that could provide a significant contribution to future ocean color activities. This workshop will scope the optimal way to use and possibly supplement the planned OOl infrastructure to maximize its utility and relevance for calibration and validation activities that support existing and planned NASA ocean color missions. Here, I present the current state of the art of NASA validation of ocean color data products, with attention to autonomous time-series (e.g., the AERONET -OC network of above-water radiometers), and outline NASA needs for data quality assurance metrics and adherence to community-vetted data collection protocols

Werdel, P. Jeremy↗