Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation products”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
NASA NTRS1990

Earth Radiation Budget Experiment (ERBE) validation

During the past 4 years, data from the Earth Radiation Budget Experiment (ERBE) have been undergoing detailed examination. There is no direct source of groundtruth for the radiation budget. Thus, this validation effort has had to rely heavily upon intercomparisons between different types of measurements. The ERBE SCIENCE Team chose 10 measures of agreement as validation criteria. Late in August 1988, the Team agreed that the data met these conditions. As a result, the final, monthly averaged data products are being archived. These products, their validation, and some results for January 1986 are described. Information is provided on obtaining the data from the archive.

Barkstrom, Bruce R.↗
NASA NTRS2000

Rainfall Product Evaluation for the TRMM Ground Validation Program

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Amitai, E.↗
NASA NTRS2014

Validation of Land Surface Temperature Products Derived from the Visible Infrared Imaging Radiometer Suite (VIIRS) Using Ground-based and Heritage Satellite Measurements

Thermal infrared satellite observations of the Earth's surface are widely used to retrieve Land Surface Temperature (LST) and monitor LST changes around the world. Since January 2012, the Visible Infrared Imaging Radiometer Suite (VIIRS) onboard the Suomi National Polar-Orbiting Partnership (S-NPP) has provided daily observations of LST with a spatial resolution of 750 m at nadir. Comparison of the standard VIIRS LST product with the equivalent daily standard product from the Moderate Resolution Imaging Spectroradiometer (MODIS) collection-5 and with ground-based measurements over vegetated and inland water surfaces showed good agreement. Analysis indicated the accuracy and precision of the VIIRS product over these cover types was 0.2 K and 2.0 K respectively provided the analyses included appropriate compensation for any spatial heterogeneity in LST within the validation site. However, comparisons between in situ LST and the VIIRS and MODIS LST.

Land surface temperature↗
NASA NTRS2006

ARISE (Antarctic Remote Ice Sensing Experiment) in the East 2003: Validation of Satellite-derived Sea-ice Data Product

Preliminary results are presented from the first validation of geophysical data products (ice concentration, snow thickness on sea ice (h(sub s) and ice temperature (T(sub i))fr om the NASA EOS Aqua AMSR-E sensor, in East Antarctica (in September-October 2003). The challenge of collecting sufficient measurements with which to validate the coarse-resolution AMSR-E data products adequately was addressed by means of a hierarchical approach, using detailed in situ measurements, digital aerial photography and other satellite data. Initial results from a circumnavigation of the experimental site indicate that, at least under cold conditions with a dry snow cover, there is a reasonably close agreement between satellite- and aerial-photo-derived ice concentrations, i.e. 97.2+/-.6% for NT2 and 96.5+/-2.5% for BBA algorithms vs 94.3% for the aerial photos. In general, the AMSR-E concentration represents a slight overestimate of the actual concentration, with the largest discrepancies occurring in regions containing a relatively high proportion of thin ice. The AMSR-E concentrations from the NT2 and BBA algorithms are similar on average, although differences of up to 5% occur in places, again related to thin-ice distribution. The AMSR-E ice temperature (T(sub i)) product agrees with coincident surface measurements to approximately 0.5 C in the limited dataset analyzed. Regarding snow thickness, the AMSR h(sub s) retrieval is a significant underestimate compared to in situ measurements weighted by the percentage of thin ice (and open water) present. For the case study analyzed, the underestimate was 46% for the overall average, but 23% compared to smooth-ice measurements. The spatial distribution of the AMSR-E h(sub s) product follows an expected and consistent spatial pattern, suggesting that the observed difference may be an offset (at least under freezing conditions). Areas of discrepancy are identified, and the need for future work using the more extensive dataset is highlighted.

Massom, Robert A.↗
NASA NTRS2009

Evaluation of TRMM Ground-Validation Radar-Rain Errors Using Rain Gauge Measurements

Ground-validation (GV) radar-rain products are often utilized for validation of the Tropical Rainfall Measuring Mission (TRMM) spaced-based rain estimates, and hence, quantitative evaluation of the GV radar-rain product error characteristics is vital. This study uses quality-controlled gauge data to compare with TRMM GV radar rain rates in an effort to provide such error characteristics. The results show that significant differences of concurrent radar-gauge rain rates exist at various time scales ranging from 5 min to 1 day, despite lower overall long-term bias. However, the differences between the radar area-averaged rain rates and gauge point rain rates cannot be explained as due to radar error only. The error variance separation method is adapted to partition the variance of radar-gauge differences into the gauge area-point error variance and radar rain estimation error variance. The results provide relatively reliable quantitative uncertainty evaluation of TRMM GV radar rain estimates at various times scales, and are helpful to better understand the differences between measured radar and gauge rain rates. It is envisaged that this study will contribute to better utilization of GV radar rain products to validate versatile spaced-based rain estimates from TRMM, as well as the proposed Global Precipitation Measurement, and other satellites.

Wang, Jianxin↗
DOE OSTI2026

Advanced Manufacturing of Cathode Materials for Lithium-ion Batteries

Original objectives (per the Statement of Project Objectives) centered on developing and translating a continuous pilot process for cathode materials production while targeting (i) a 29% manufacturing cost reduction, (ii) an 82% energy consumption reduction for cathode production, and (iii) a doubling of manufacturing productivity. Planned validation included characterization at appropriate analytical facilities and electrochemical performance evaluation progressing from half-cells to pouch-cell formats, with a pathway to kilogram-scale production of finished cathode materials for representative testing. Scope evolution: During execution, the project team identified that the surfactant-enabled chemistry offered high selectivity for lithium precipitation from brine sources. A formal scope revision shifted the final project year from cathode manufacturing development to direct lithium extraction/lithium recovery, while maintaining the overarching intent of cost reduction and process simplification relevant to the battery supply chain.

25 ENERGY STORAGE↗
NASA NTRS2009

A Blended Global Snow Product using Visible, Passive Microwave and Scatterometer Satellite Data

A joint U.S. Air Force/NASA blended, global snow product that utilizes Earth Observation System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS), Advanced Microwave Scanning Radiometer for EOS (AMSR-E) and QuikSCAT (Quick Scatterometer) (QSCAT) data has been developed. Existing snow products derived from these sensors have been blended into a single, global, daily, user-friendly product by employing a newly-developed Air Force Weather Agency (AFWA)/National Aeronautics and Space Administration (NASA) Snow Algorithm (ANSA). This initial blended-snow product uses minimal modeling to expeditiously yield improved snow products, which include snow cover extent, fractional snow cover, snow water equivalent (SWE), onset of snowmelt, and identification of actively melting snow cover. The blended snow products are currently 25-km resolution. These products are validated with data from the lower Great Lakes region of the U.S., from Colorado during the Cold Lands Processes Experiment (CLPX), and from Finland. The AMSR-E product is especially useful in detecting snow through clouds; however, passive microwave data miss snow in those regions where the snow cover is thin, along the margins of the continental snowline, and on the lee side of the Rocky Mountains, for instance. In these regions, the MODIS product can map shallow snow cover under cloud-free conditions. The confidence for mapping snow cover extent is greater with the MODIS product than with the microwave product when cloud-free MODIS observations are available. Therefore, the MODIS product is used as the default for detecting snow cover. The passive microwave product is used as the default only in those areas where MODIS data are not applicable due to the presence of clouds and darkness. The AMSR-E snow product is used in association with the difference between ascending and descending satellite passes or Diurnal Amplitude Variations (DAV) to detect the onset of melt, and a QSCAT product will be used to map areas of snow that are actively melting.

Foster, James L.↗
NASA NTRS2004

Heating Structures Derived from Satellite

Rainfall is a key link in the hydrologic cycle and is a primary heat source for the atmosphere. The vertical distribution of latent-heat release, which is accompanied by rainfall, modulates the large-scale circulations of the tropics and in turn can impact midlatitude weather. This latent heat release is a consequence of phase changes between vapor, liquid, and solid water. The Tropical Rainfall Measuring Mission (TRMM), a joint U.S./Japan space project, was launched in November 1997. It provides an accurate measurement of rainfall over the global tropics which can be used to estimate the four-dimensional structure of latent heating over the global tropics. The distributions of rainfall and inferred heating can be used to advance our understanding of the global energy and water cycle. This paper describes several different algorithms for estimating latent heating using TRMM observations. The strengths and weaknesses of each algorithm as well as the heating products are also discussed. The validation of heating products will be exhibited. Finally, the application of this heating information to global circulation and climate models is presented.

Tao, W.-K.↗
NASA NTRSDate not supplied

Comparison of Observed Longwave, Shortwave Irradiance and Surface Temperature from “MOSAiC” to CERES Radiative Transfer Calculations and Inputs

As atmospheric temperatures rise due to increased anthropogenic forcing, the effect is expected to be larger over the arctic than midlatitude and tropics, known as polar amplification. A multi-national program, the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) was ran between Sept 2019 and Oct 2020. The project deployed scientific instruments on board the German research vessel Polarstern with the ship remaining across a year to observe all aspects of polar climate. The US DOE deployed the ARM AMF2 aboard the ship along with several off-ship sites for extended spatial observations. Of particular importance was the measurement of the energetics of the ice/ocean/atmosphere interactions through observations of surface irradiance and surface temperatures. NASA’s Clouds and the Earth’s Radiant Energy System (CERES) project produces the SYN1deg Edition 4 data product. This product provides high quality, hourly, globally gridded and temporally complete maps of top of atmosphere (TOA), in atmosphere, and surface irradiances. TOA fluxes are derived from CERES instruments and geostationary satellites. In addition, TOA, in atmosphere, and surface irradiances are computed using the Langley Fu and Liou radiative transfer model. The radiative transfer model is run hourly at 1 degree ~equal area spatial resolution. Meteorological profiles are provided by Global Modeling and Assimilation Office’s GEOS-541 reanalysis product. Cloud properties are derived solely from Terra and Aqua MODIS imagers northward of 60°. Here we compare SYN1deg hourly calculations of surface irradiance to observations from the AMF2 to validate the products estimates of surface irradiance in this challenging area. Along with the irradiance comparisons we take a close look at the surface temperature record in the GEOS-541 product and compare it over both time and space to several surface observations provided by MOSAiC. Along with the comparison to the re-analysis record we will compare these observed surface temperatures to those derived from the AIRS product, which is known to have some difficulty in extreme high latitude areas. The goals of this study are 1) understand computed surface downward irradiance and temperature error separated by surface type (e.g. sea ice or open water) and by season, and 2) error covariance in spatial and temporal space. We seek to use this information to extrapolate the error from the MOSAiC domain to a larger arctic region.

David A Rutan↗
NASA NTRS2018

An Initial Validation of Landsat 5 and 7 Derived Surface Water Temperature for U.S. Lakes, Reservoirs, and Estuaries

The United States Harmful Algal Bloom and Hypoxia Research Control Act of 2014 identified the need for forecasting and monitoring harmful algal blooms (HAB) in lakes, reservoirs, and estuaries across the nation. Temperature is a driver in HAB forecasting models that affects both HAB growth rates and toxin production. Therefore, temperature data derived from the U.S. Geological Survey Landsat 5 Thematic Mapper and Landsat 7 Enhanced Thematic Mapper Plus thermal band products were validated across 35 lakes and reservoirs, and 24 estuaries. In situ data from the Water Quality Portal (WQP) were used for validation. The WQP serves data collected by state, federal, and tribal groups. Discrete in situ temperature data included measurements at 11,910 U.S. lakes and reservoirs from 1980 through 2015. Landsat temperature measurements could include 170,240 lakes and reservoirs once an operational product is achieved. The Landsat-derived temperature mean absolute error was 1.34 C in lake pixels (is) greater than180 m from land, 4.89 C at the land-water boundary, and 1.11 C in estuaries based on comparison against discrete surface in situ measurements. This is the first study to quantify Landsat resolvable U.S. lakes and reservoirs, and large-scale validation of an operational satellite provisional temperature climate data record algorithm. Due to the high performance of open water pixels, Landsat satellite data may supplement traditional in situ sampling by providing data for most U.S. lakes, reservoirs, and estuaries over consistent seasonal intervals (even with cloud cover) for an extended period of record of more than 35 years.

Schaeffer, Blake A.↗
NASA NTRS1997

Pre-Launch Tasks Proposed in our Contract of December 1991

We propose, during the pre-EOS phase to: (1) develop, with other MODIS Team Members, a means of discriminating different major biome types with NDVI and other AVHRR-based data. (2) develop a simple ecosystem process model for each of these biomes, BIOME-BGC (3) relate the seasonal trend of weekly composite NDVI to vegetation phenology and temperature limits to develop a satellite defined growing season for vegetation; and (4) define physiologically based energy to mass conversion factors for carbon and water for each biome. Our final core at-launch product will be simplified, completely satellite driven biome specific models for net primary production. We will build these biome specific satellite driven algorithms using a family of simple ecosystem process models as calibration models, collectively called BIOME-BGC, and establish coordination with an existing network of ecological study sites in order to test and validate these products. Field datasets will then be available for both BIOME-BGC development and testing, use for algorithm developments of other MODIS Team Members, and ultimately be our first test point for MODIS land vegetation products upon launch. We will use field sites from the National Science Foundation Long-Term Ecological Research network, and develop Glacier National Park as a major site for intensive validation.

Running, Steven W.↗
NASA NTRS1998

Pre-Launch Tasks Proposed in our Contract of December 1991

We propose, during the pre-EOS phase to: (1) develop, with other MODIS Team Members, a means of discriminating different major biome types with NDVI and other AVHRR-based data; (2) develop a simple ecosystem process model for each of these biomes, BIOME-BGC; (3) relate the seasonal trend of weekly composite NDVI to vegetation phenology and temperature limits to develop a satellite defined growing season for vegetation; and (4) define physiologically based energy to mass conversion factors for carbon and water for each biome. Our final core at-launch product will be simplified, completely satellite driven biome specific models for net primary production. We will build these biome specific satellite driven algorithms using a family of simple ecosystem process models as calibration models, collectively called BIOME-BGC, and establish coordination with an existing network of ecological study sites in order to test and validate these products. Field datasets will then be available for both BIOME-BGC development and testing, use for algorithm developments of other MODIS Team Members, and ultimately be our first test point for MODIS land vegetation products upon launch. We will use field sites from the National Science Foundation Long-Term Ecological Research network, and develop Glacier National Park as a major site for intensive validation.

Source record↗
NASA NTRS2006

Draft Plan for Characterizing Commercial Data Products in Support of Earth Science Research

This presentation introduces a draft plan for characterizing commercial data products for Earth science research. The general approach to the commercial product verification and validation includes focused selection of a readily available commercial remote sensing products that support Earth science research. Ongoing product verification and characterization will question whether the product meets specifications and will examine its fundamental properties, potential and limitations. Validation will encourage product evaluation for specific science research and applications. Specific commercial products included in the characterization plan include high-spatial-resolution multispectral (HSMS) imagery and LIDAR data products. Future efforts in this process will include briefing NASA headquarters and modifying plans based on feedback, increased engagement with the science community and refinement of details, coordination with commercial vendors and The Joint Agency Commercial Imagery Evaluation (JACIE) for HSMS satellite acquisitions, acquiring waveform LIDAR data and performing verification and validation.

Ryan, Robert E.↗
NASA NTRS2014

Visualization of Capsule Reentry Vehicle Heat Shield Ablation Using Naphthalene PLIF

The Orion Multi-Purpose Crew Vehicle (MPCV) will use an ablative heat shield and improved understanding of the ablation process would be beneficial for design purposes. Given that ablation is a multi-physics process involving heat and mass transfer, codes aiming to predict heat shield ablation are in need of experimental data pertaining to the turbulent transport of ablation products for validation. At The University of Texas at Austin, a technique is being developed that uses planar laser-induced fluorescence (PLIF) of a low-temperature sublimating ablator (naphthalene) to visualize the transport of ablation products in a supersonic flow. Since ablation at reentry temperatures can be difficult to recreate in a laboratory setting it is desirable to create a limited physics problem and simulate the ablation process at relatively low temperature conditions using naphthalene. A scaled Orion MPCV model with a solid naphthalene heat shield has been tested in a Mach 5 wind tunnel at various angles of attack in the current work. PLIF imaging reveals the distribution of the ablation products as they are transported into the heat-shield boundary layer and over the capsule shoulders into the separated shear layer and backshell recirculation region. Visualizations of the capsule shear layer using both naphthalene PLIF and Schlieren imaging compared favorably. High concentrations of naphthalene in the capsule separated flow region, intermittent turbulent structures on the heat shield surface, and interesting details of the capsule shear layer structure were observed using the naphthalene PLIF technique. The capsule shear layer was also shown to generally appear to be more turbulent at lower angles of attack. Furthermore, the PLIF signal increased steadily over the course of a run indicating that during a wind tunnel run the model heated up and the rate of naphthalene ablation increased. The shear layer showed increasing signs of turbulence over the course of a wind tunnel run as well, likely because of the combination of increased surface roughness and surface blowing rate. PLIF imaging also detected regions with a relatively low concentration of naphthalene in the capsule backshell recirculation region that are most likely the result of cross-flow-induced vortices on the capsule afterbody.

Combs, Christopher S.↗
NASA NTRS2004

Validation of EOS Aqua AMSR Sea Ice Products for East Antarctica

This paper presents results from AMSR-E validation activities during a collaborative international cruise onboard the RV Aurora Australis to the East Antarctic sea ice zone (64-65 deg.S, 110-120 deg.E) in the early Austral spring of 2003. The validation strategy entailed an IS-day survey of the statistical characteristics of sea ice and snowcover over a Lagrangian grid 100 x 50 km in size (demarcated by 9 drifting ice beacons) i.e. at a scale representative of Ah4SR pixels. Ice conditions ranged h m consolidated first-year ice to a large polynya offshore from Casey Base. Data sets collected include: snow depth and snow-ice interface temperatures on 24 (?) randomly-selected floes in grid cells within a 10 x 50 km area (using helicopters); detailed snow and ice measurements at 13 dedicated ice stations, one of which lasted for 4 days; time-series measurements of snow temperature and thickness at selected sites; 8 aerial photography and thermal-IR radiometer flights; other satellite products (SAR, AVHRR, MODIS, MISR, ASTER and Envisat MERIS); ice drift data; and ancillary meteorological (ship-based, meteorological buoys, twice-daily radiosondes). These data are applied to a validation of standard AMSR-E ice concentration, snowcover thickness and ice-temperature products. In addition, a validation is carried out of ice-surface skin temperature products h m the NOAA AVHRR and EOS MODIS datasets.

Massom, Rob↗
NASA NTRS2000

Science Requirements Document for OMI-EOS

A Dutch-Finnish scientific and industrial consortium is supplying the Ozone Monitoring Instrument (OMI) for Earth Observing System-Aura (EOS-Aura). EOS-Aura is the next NASA mission to study the Earth's atmosphere extensively, and successor to the highly successful UARS (Upper Atmospheric Research Satellite) mission. The 'Science Requirements Document for OMI-EOS' presents an overview of the Aura and OMI mission objectives. It describes how OMI fits into the Aura mission and it reviews the synergy with the other instruments onboard Aura to fulfill the mission. This evolves in the Scientific Requirements for OMI (Chapter 3), stating which trace gases have to be measured with what necessary accuracy, in order for OMI to meet Aura's objectives. The most important data product of OMI, the ozone vertical column, densities shall have a better accuracy and an improved global coverage than the predecessor instruments TOMS (Total Ozone Monitoring Spectrometer) and GOME (Global Ozone Monitoring Experiment), which is a.o. achieved by a better signal to noise ratio, improved calibration and a wide field-of-view. Moreover, in order to meet its role on Aura, OMI shall measure trace gases, such as NO2, OClO, BrO, HCHO and SO2, aerosols, cloud top height and cloud coverage. Improved accuracy, better coverage, and finer ground grid than has been done in the past are goals for OMI. After the scientific requirements are defined, three sets of subordinate requirements are derived. These are: the algorithm requirements, i.e. what do the algorithms need in order to meet the scientific requirements; the instrument and calibration requirements, i.e. what has to be measured and how accurately in order to provide the quality of data necessary for deriving the data products; and the validation requirements, i.e. a strategy of how the OMI program will assure that its data products are valid in the atmosphere, at least to the required accuracy.

Levelt, P. F.↗