Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

Development of a Fluid Structures Interaction Test Technique for Fabrics

Application of fluid structures interaction (FSI) computational techniques to configurations of interest to the entry, descent and landing (EDL) community is limited by two factors - limited characterization of the material properties for fabrics of interest and insufficient experimental data to validate the FSI codes. Recently ILC Dover Inc. performed standard tests to characterize the static stress-strain response of four candidate fabrics for use in EDL applications. The objective of the tests described here is to address the need for a FSI dataset for CFD validation purposes. To reach this objective, the structural response of fabrics was measured in a very simple aerodynamic environment with well controlled boundary conditions. Two test series were undertaken. The first series covered a range of tunnel conditions and the second focused on conditions that resulted in fabric panel buckling.

Zilliac, Gregory G.↗

TOVS Pathfinder product validation and intercomparison

Validation and intercomparison is an essential part of the Pathfinder program. Since its organization within the International TOVS Working Group, the TOVS community has continuously emphasized this aspect of the product retrieval problem. In the previous sections of this report, the TOVS Pathfinder SWG has recommended a careful and coherent reorganization and archiving of TOVS radiance data, and three distinct pathways for deriving product variables from this TOVS radiance archive. The importance in taking this multiple path approach to creating climate datasets rests in our firm belief that there is now global 'absolute truth' data for any of the derived physical parameters. Each of the selected methods is based upon a different set of assumptions. The challenge in interpreting Pathfinder data is to determine what alterations in the physical attributes of the environment contribute to evidence of global change extracted from observed or derived Pathfinder datasets. The Pathfinder validation and intercomparison activity must include validation of the forward problem, by which one calculates an estimate of upwelling radiance information from given earth and atmospheric data, and validation of the inverse problem, by which one calculates estimates of earth and atmospheric information from given upwelling satellite spectral radiance data.

Source record↗

Geopositional Accuracy Assessment of EarthSat Geocover Landsat Orthorectified Imagery

NASA purchased EarthSat GeoCover orthorectified Landsat imagery of global land areas covering three historical frames: (1) mid-1970's imagery from the Landsat Multispectral Scanner (MSS); (2) late 1980's-early 1990's imagery from the Landsat Thematic Mapper (TM); and (3) year 2000 imagery from the Landsat Enhanced Thematic Mapper Plus (ETM+). Because of the distinct time frames covered by these datasets, this imagery is valuable to land cover change research. Because geopositional accuracy plays a critical role in this area of scientific research. NASA performed an independent assessment of the geopositional accuracy of each EarthSat dataset using an independent set of government-provided ground control points (GCPs). These points were instrumental in the geopositional accuracy assessment of the TM imagery. Because of the orthorectification processes of the MSS imagery and the MSS pixel size, the aforementioned GCPs could not be used, and an alternate relative assessment procedure using the previously validated TM imagery as a "truth" dataset was used for the MSS data. Finally, the ETM data specification was defined in both an absolute sense with respect to ground coordinated and relative to the previously validated TM dataset. Therefore, two separate methods were used in validating the ETM-data. Results of the NASA independent assessments showed that the accuracies of the EarthSat GeoCover datasets met the defined specifications or were within the error and limitations of the verification methods employed.

Smith, Charles M.↗

Lift distribution and velocity field measurements for a three-dimensional, steady blade/vortex interaction

A wind tunnel experiment simulating a steady three-dimensional helicopter rotor blade/vortex interaction is reported. The experimental configuration consisted of a vertical semispan vortex-generating wing, mounted upstream of a horizontal semispan rotor blade airfoil. A three-dimensional laser velocimeter was used to measure the velocity field in the region of the blade. Sectional lift coefficients were calculated by integrating the velocity field to obtain the bound vorticity. Total lift values, obtained by using an internal strain-gauge balance, verified the laser velocimeter data. Parametric variations of vortex strength, rotor blade angle of attack, and vortex position relative to the rotor blade were explored. These data are reported (with attention to experimental limitations) to provide a dataset for the validation of analytical work.

Dunagan, Stephen E.↗

Validation of Orthorectified Interferometric Radar Imagery and Digital Elevation Models

This work was performed under NASA's Verification and Validation (V&V) Program as an independent check of data supplied by EarthWatch, Incorporated, through the Earth Science Enterprise Scientific Data Purchase (SDP) Program. This document serves as the basis of reporting results associated with validation of orthorectified interferometric interferometric radar imagery and digital elevation models (DEM). This validation covers all datasets provided under the first campaign (Central America & Virginia Beach) plus three earlier missions (Indonesia, Red River: and Denver) for a total of 13 missions.

Smith Charles M.↗

Spatial and Temporal Varying Thresholds for Cloud Detection in Satellite Imagery

A new cloud detection technique has been developed and applied to both geostationary and polar orbiting satellite imagery having channels in the thermal infrared and short wave infrared spectral regions. The bispectral composite threshold (BCT) technique uses only the 11 micron and 3.9 micron channels, and composite imagery generated from these channels, in a four-step cloud detection procedure to produce a binary cloud mask at single pixel resolution. A unique aspect of this algorithm is the use of 20-day composites of the 11 micron and the 11 - 3.9 micron channel difference imagery to represent spatially and temporally varying clear-sky thresholds for the bispectral cloud tests. The BCT cloud detection algorithm has been applied to GOES and MODIS data over the continental United States over the last three years with good success. The resulting products have been validated against "truth" datasets (generated by the manual determination of the sky conditions from available satellite imagery) for various seasons from the 2003-2005 periods. The day and night algorithm has been shown to determine the correct sky conditions 80-90% of the time (on average) over land and ocean areas. Only a small variation in algorithm performance occurs between day-night, land-ocean, and between seasons. The algorithm performs least well. during he winter season with only 80% of the sky conditions determined correctly. The algorithm was found to under-determine clouds at night and during times of low sun angle (in geostationary satellite data) and tends to over-determine the presence of clouds during the day, particularly in the summertime. Since the spectral tests use only the short- and long-wave channels common to most multispectral scanners; the application of the BCT technique to a variety of satellite sensors including SEVERI should be straightforward and produce similar performance results.

Jedlovec, Gary↗

Supersonic Inlet Test for a Quiet Supersonic Transport Technology Demonstrator in the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel

NASA funded the preliminary design of a flight demonstrator aircraft with a greatly reduced sonic boom signature to enable supersonic flight over land. In 2017, two tests were performed at the NASA Glenn Research Center 8- by 6-foot Supersonic Wind Tunnel, an aerodynamic stability/control test and an inlet performance test. The inlet was unique due to the location on the vehicle, located on the top centerline near the rear of the aircraft. Test data provided a validation and performance dataset for engine integration on the demonstrator vehicle. The subject of this report is the subsonic and supersonic performance data collected for the centerline top-mounted inlet.

Castner, Raymond↗

Science Diplomacy Through Cities: Applying NASA Earth Observations at the Urban Scale

NASA's scientific expertise and data products are enhancing cities' environmental monitoring activities by pioneering applications of remote sensing and model-based Earth Observations at the urban scale. The above activities have greatly benefitted from engaging stakeholders and city practitioners from the start. Further, NASA's collaborations with cities have: Advanced NASA science, in testing new products and validating of satellite datasets, while meeting the needs of city governments. Broadened Rio de Janeiro's regional viewpoint and strengthened its relationships with neighboring cities. Scientific collaborations with cities benefit from: Selecting city partners with a high level of technical capacity and willing to make strong investments in joint projects. Sustained communication and face-to-face interactions. Well-defined deliverables, with dedicated resources and personnel. Pairing global datasets and projections with in situ measurements and local knowledgeSensitivity to local working culture and politics.

urban environment↗

Pilot Workload Rating Predictions Using Image Data and Recurrent Neural Networks

In this work, we augmented existing methods for estimating pilot workload ratings with deep neural networks trained using data from simulated flight tests in the Vertical Motion Simulator (VMS). We used an existing method, Spare Capacity Operations Estimator (SCOPE), along with a recurrent neural network and conducted comparison studies between the two methods individually, and when used together. We found that using both methods together can improve the result over using either approach alone. In our first test case, we achieved an improved linear correlation coefficient of 0.409 over that of SCOPE alone at 0.352 on the training dataset. Through cross validation, we also found that the results may be dependent on the split of training vs. validation data, and that further investigation should be conducted to understand what additional inputs to the neural network model should be made.

Image Data↗

Shape from spectra

We introduce a new unified atmospheric–topographic correction approach that estimates surface geometry directly from the radiance measurement. Surface topography influences the at-sensor radiance measurement, making precise topography modeling critical in applications like vegetation or snow studies in mountainous terrain. Currently, elevation maps are used to derive topographic variables such as the slope and sky-view factor. This process is error-prone since static global digital elevation models do not generally achieve the accuracy required, and even minor mismatches in spatial resolution can introduce significant artifacts in downstream processing. Here we demonstrate that it is possible to estimate topographic parameters directly from spectral data, ensuring perfect physical consistency, temporal coincidence, and spatial alignment. We present experiments estimating topographic slope in two scenes in Southern California, with data from NASA’s Next Generation Airborne Visible/Near Infrared Imaging Spectrometer (AVIRIS-NG). We compared our radiance-based estimates against high-resolution lidar datasets. Our initial validation result showed a correlation of R 2 = 0.864 (n = 160) over the homogeneous surface of Beckman Auditorium’s cone-shaped roof on the Caltech campus in Pasadena, California. We then validate the model over a larger study site near Santa Clarita, California, finding R 2 = 0.923 (n = 40,000) in a 350 x 350m area. The accuracy of our model estimates, combined with its systematic advantages over the alternative, show the potential of the approach for use in both airborne campaigns and orbital missions.

Nimrod Carmon↗

Enabling API Access to the Space Weather Services at the Community Coordinated Modeling Center

Over the span of 20 years, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) has been leading a number of community-driven services and applications that provide a free and open access to the cutting-edge space weather and Heliophysics models through a simple web-based interface. CCMC also oversees an open archive of user model simulations and related metadata, maintains space weather-related data streams, curates validation and event datasets, and more. To maximize utility of its complementary services and data holdings, CCMC has been gradually building up an ad-hoc set of interfaces and specifications that facilitate coupling and interconnection within the organization, while also simplifying management and monitoring of the data. As the models continue to grow in maturity and complexity, CCMC is looking to reduce the complexity for its end users by making public some of the internal APIs as well as implementing dedicated interfaces as required by the community. In this presentation, we will overview the current run services at CCMC and will describe our current and near-future efforts in providing interfaces to these services.

space weather↗

Assimilation of Sea Ice Thickness Derived from Cryosat-2 Along-Track Freeboard Measurements into the Met Office's Forecast Ocean Assimilation Model (FOAM)

The feasibility of assimilating sea ice thickness (SIT) observations derived from CryoSat-2 along-track measurements of sea ice freeboard is successfully demonstrated using a 3D-Var assimilation scheme, NEMOVAR, within the Met Office's global, coupled ocean–sea-ice model, Forecast Ocean Assimilation Model (FOAM). The CryoSat-2 Arctic freeboard measurements are produced by the Centre for Polar Observation and Modelling (CPOM) and are converted to SIT within FOAM using modelled snow depth. This is the first time along-track observations of SIT have been used in this way, with other centres assimilating gridded and temporally averaged observations. The assimilation leads to improvements in the SIT analysis and forecast fields generated by FOAM, particularly in the Canadian Arctic. Arctic-wide observation-minus-background assimilation statistics for 2015–2017 show improvements of 0.75 m mean difference and 0.41 m root-mean-square difference (RMSD) in the freeze-up period and 0.46 m mean difference and 0.33 m RMSD in the ice break-up period. Validation of the SIT analysis against independent springtime in situ SIT observations from NASA Operation IceBridge (OIB) shows improvement in the SIT analysis of 0.61 m mean difference (0.42 m RMSD) compared to a control without SIT assimilation. Similar improvements are seen in the FOAM 5 d SIT forecast. Validation of the SIT assimilation with independent Beaufort Gyre Exploration Project (BGEP) sea ice draft observations does not show an improvement, since the assimilated CryoSat-2 observations compare similarly to the model without assimilation in this region. Comparison with airborne electromagnetic induction (Air-EM) combined measurements of SIT and snow depth shows poorer results for the assimilation compared to the control, despite covering similar locations to the OIB and BGEP datasets. This may be evidence of sampling uncertainty in the matchups with the Air-EM validation dataset, owing to the limited number of observations available over the time period of interest. This may also be evidence of noise in the SIT analysis or uncertainties in the modelled snow depth, in the assimilated SIT observations, or in the data used for validation. The SIT analysis could be improved by upgrading the observation uncertainties used in the assimilation. Despite the lack of CryoSat-2 SIT observations available for assimilation over the summer due to the detrimental effect of melt ponds on retrievals, it is shown that the model is able to retain improvements to the SIT field throughout the summer months due to prior, wintertime SIT assimilation. This also results in regional improvements to the July modelled sea ice concentration (SIC) of 5 % RMSD in the European sector, due to slower melt of the thicker sea ice.

Emma K. Fiedler↗

Global and Regional Evaluation of Over-Land Spectral Aerosol Optical Depth Retrievals from SeaWiFS

This study evaluates a new spectral aerosol optical depth (AOD) dataset derived from Sea-viewing Wide Field-of-view Sensor (Sea WiFS) measurements over land. First, the data are validated against Aerosol Robotic Network (AERONET) direct-sun AOD measurements, and found to compare well on a global basis. If only data with the highest quality flag are used, the correlation is 0.86 and 72% of matchups fall within an expected absolute uncertainty of 0.05 + 20% (for the wavelength of 550 nm). The quality is similar at other wavelengths and stable over the 13-year (1997-2010) mission length. Performance tends to be better over vegetated, low-lying terrain with typical AOD of 0.3 or less, such as found over much of North America and Eurasia. Performance tends to be poorer for low-AOD conditions near backscattering geometries, where Sea WiFS overestimates AOD, or optically-thick cases of absorbing aerosol, where SeaWiFS tends to underestimate AOD. Second, the SeaWiFS data are compared with midvisible AOD derived from the Moderate Resolution Imaging Spectrometer (MODIS) and Multiangle Imaging Spectroradiometer (MISR). All instruments show similar spatial and seasonal distributions of AOD, although there are regional and seasonal offsets between them. At locations where AERONET data are available, these offsets are largely consistent with the known validation characteristics of each dataset. With the results of this study in mind, the SeaWiFS over-land AOD record should be suitable for quantitative scientific use.

Sayer, A. M.↗

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗

Atmospheric Correction at AERONET Locations: A New Science and Validation Data Set

This paper describes an AERONET-based Surface Reflectance Validation Network (ASRVN) and its dataset of spectral surface bidirectional reflectance and albedo based on MODIS TERRA and AQUA data. The ASRVN is an operational data collection and processing system. It receives 50x50 square kilometer subsets of MODIS L1B data from MODAPS and AERONET aerosol and water vapor information. Then it performs an accurate atmospheric correction for about 100 AERONET sites based on accurate radiative transfer theory with high quality control of the input data. The ASRVN processing software consists of L1B data gridding algorithm, a new cloud mask algorithm based on a time series analysis, and an atmospheric correction algorithm. The atmospheric correction is achieved by fitting the MODIS top of atmosphere measurements, accumulated for 16-day interval, with theoretical reflectance parameterized in terms of coefficients of the LSRT BRF model. The ASRVN takes several steps to ensure high quality of results: 1) cloud mask algorithm filters opaque clouds; 2) an aerosol filter has been developed to filter residual semi-transparent and sub-pixel clouds, as well as cases with high inhomogeneity of aerosols in the processing area; 3) imposing requirement of consistency of the new solution with previously retrieved BRF and albedo; 4) rapid adjustment of the 16-day retrieval to the surface changes using the last day of measurements; and 5) development of seasonal back-up spectral BRF database to increase data coverage. The ASRVN provides a gapless or near-gapless coverage for the processing area. The gaps, caused by clouds, are filled most naturally with the latest solution for a given pixels. The ASRVN products include three parameters of LSRT model (k(sup L), k(sup G), k(sup V)), surface albedo, NBRF (a normalized BRF computed for a standard viewing geometry, VZA=0 deg., SZA=45 deg.), and IBRF (instantaneous, or one angle, BRF value derived from the last day of MODIS measurement for specific viewing geometry) for MODIS 500m bands 1-7. The results are produced daily at resolution of 1 km in gridded format. We also provide cloud mask, quality flag and a browse bitmap image. The new dataset can be used for a wide range of applications including validation analysis and science research.

Wang, Yujie↗

Validation of Satellite-Based Wind Observations During PISTON

PISTON cruises provide a useful and unique suite of measurements relevant to validating satellite-based ocean wind datasets near tropical convection. In this talk, we will focus on opportunities for using PISTON observations to validate two different scatterometer datasets: (1) Cyclone Global Navigation Satellite System (CYGNSS) (2) Advanced Scatterometer (ASCAT).

Lang, Timothy↗

Evaluation of Methods to Estimate the Surface Downwelling Longwave Flux during Arctic Winter

Surface longwave radiation fluxes dominate the energy budget of nighttime polar regions, yet little is known about the relative accuracy of existing satellite-based techniques to estimate this parameter. We compare eight methods to estimate the downwelling longwave radiation flux and to validate their performance with measurements from two field programs in thc Arctic: the Coordinated Eastern Arctic Experiment (CEAREX ) conducted in the Barents Sea during the autumn and winter of 1988, and the Lead Experiment performed in the Beaufort Sea in the spring of 1992. Five of the eight methods were developed for satellite-derived quantities, and three are simple parameterizations based on surface observations. All of the algorithms require information about cloud fraction, which is provided from the NASA-NOAA Television and Infrared Observation Satellite (TIROS) Operational Vertical Sounder (TOVS) polar pathfinder dataset (Path-P): some techniques ingest temperature and moisture profiles (also from Path-P): one-half of the methods assume that clouds are opaque and have a constant geometric thickness of 50 hPa, and three include no thickness information whatsoever. With a somewhat limited validation dataset, the following primary conclusions result: (1) all methods exhibit approximately the same correlations with measurements and rms differences, but the biases range from -34 W sq m (16% of the mean) to nearly 0; (2) the error analysis described here indicates that the assumption of a 50-hPa cloud thickness is too thin by a factor of 2 on average in polar nighttime conditions; (3) cloud-overlap techniques. which effectively increase mean cloud thickness, significantly improve the results; (4) simple Arctic-specific parameterizations performed poorly, probably because they were developed with surface-observed cloud fractions; and (5) the single algorithm that includes an estimate of cloud thickness exhibits the smallest differences from observations.

Chiacchio, Marc↗