SEARCH · Search NASA

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2015

Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS)

The Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) mission will extend the SAGE data record from the ideal vantage point of the International Space Station (ISS). The ISS orbital inclination is ideal for SAGE measurements providing coverage between 70 deg north and 70 deg south latitude. The SAGE data record includes an extensively validated data set including aerosol optical depth data dating to the Stratospheric Aerosol Measurement (SAM) experiments in 1975 and 1978 and stratospheric ozone profile data dating to the Stratospheric Aerosol and Gas Experiment (SAGE) in 1979. These and subsequent data records, notably from the SAGE II experiment launched on the Earth Radiation Budget Satellite in 1984 and the SAGE III experiment launched on the Russian Meteor-3M satellite in 2001, have supported a robust, long-term assessment of key atmospheric constituents. These scientific measurements provide the basis for the analysis of five of the nine critical constituents (aerosols, ozone (O3), nitrogen dioxide (NO2), water vapor (H2O), and air density using O2) identified in the U.S. National Plan for Stratospheric Monitoring. SAGE III on ISS was originally scheduled to fly on the ISS in the same timeframe as the Meteor-3M mission, but was postponed due to delays in ISS construction. The project was re-established in 2009.

Gasbarre, Joseph↗

NASA NTRS2016

Active Learning with Rationales for Identifying Operationally Significant Anomalies in Aviation

A major focus of the commercial aviation community is discovery of unknown safety events in flight operations data. Data-driven unsupervised anomaly detection methods are better at capturing unknown safety events compared to rule-based methods which only look for known violations. However, not all statistical anomalies that are discovered by these unsupervised anomaly detection methods are operationally significant (e.g., represent a safety concern). Subject Matter Experts (SMEs) have to spend significant time reviewing these statistical anomalies individually to identify a few operationally significant ones. In this paper we propose an active learning algorithm that incorporates SME feedback in the form of rationales to build a classifier that can distinguish between uninteresting and operationally significant anomalies. Experimental evaluation on real aviation data shows that our approach improves detection of operationally significant events by as much as 75% compared to the state-of-the-art. The learnt classifier also generalizes well to additional validation data sets.

anomaly detection↗

NASA NTRS2021

A Machine Learning Approach to Objective Identification of Dust in Satellite Imagery

Airborne dust has broad adverse effects on human activity, including aviation, human health, and agriculture. Remote sensing observations are used to detect dust and aerosols in the atmosphere using long established techniques. False color Red-Green-Blue (RGB) imagery using band differences sensitive to dust absorption (Dust RGB) is currently used operationally to assist forecasters and decision-makers in identifying dust at night, but there are still limitations, subjectivity, and nuances to image interpretation making night-time dust identification difficult even for experts. This study applies machine learning to the problem of night-time dust detection with a simple random forest (RF) model using Geostationary Operational Environmental Satellite-16 (GOES-16) Advanced Baseline Imager (ABI) infrared imagery, band differences sensitive to dust absorption, and Dust RGB color components as inputs to the model. The RF model achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels and 99.96% of no-dust pixels for all dust images in the validation data set. The addition of a single null case to the training data set drastically reduces error in labeling no-dust pixels as dust from 45% to 14.5%. Application of the machine learning model to the April 13–14, 2019 dust event demonstrates the ability of the model to identify dust during night-time hours when visual dust detection is limited by the cooling ground surface characteristics.

dust↗

NASA NTRS2018

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

NASA NTRSDate not supplied

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗

NASA NTRS1980

NASA TLA workload analysis support. Volume 2: Metering and spacing studies validation data

Four sets of graphic reports--one for each of the metering and spacing scenarios--are presented. The complete data file from which the reports were generated is also given. The data was used to validate the detail task of both the pilot and copilot for four metering and spacing scenarios. The output presents two measures of demand workload and a report showing task length and task interaction.

Sundstrom, J. L.↗

NASA NTRS1991

Validating a large geophysical data set - Experiences with satellite-derived cloud parameters

The goal of this study is to validate the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and to use the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The need to work with Level 2 (point) data, rather than Level 3 (gridded) data for validation purposes is discussed, and some techniques developed for charting the assumptions made in deriving an algorithm and generating a code to produce geophysical quantities from measured radiances are presented.

Kahn, Ralph↗

NASA NTRS2006

The Use of RGPS Kinematic Data to Estimate Nonlinear Sea Ice Motion

In current simulations of the interaction between sea ice and its environment, large significance is placed on the deformation of the sea ice. Sea ice deformation is an important process in determining the sea ice thickness distribution across a wide range of space and time scales. Changes in the sea ice thickness distribution affect energy and mass fluxes between the atmosphere and ocean and also the strength of the ice. While most current ice models assume linear variation in the ice motion field to calculate strain, deformation of sea ice occurs through the opening, closing and shearing of ice along discrete linear features. New numerical models are being developed which explicitly account for discontinuities in ice motion, and the need for requisite data sets for model validation has emerged. Multiple buoy data sets, as well as satellite data, have been used to examine the movement and deformation of sea ice. Generally it has been found that the ice motion field has been represented well by buoy data, as well as satellite data over a broad range of scales. However, the underlying deformation (spatial variation in displacement) as represented by different data sets may vary. For the work presented here, sea ice motion In current simulations of the interaction between sea ice and its environment, large significance is placed on the deformation of the sea ice. Sea ice deformation is an important process in determining the sea ice thickness distribution across a wide range of space and time scales. Changes in the sea ice thickness distribution affect energy and mass fluxes between the atmosphere and ocean and also the strength of the ice. While most current ice models assume linear variation in the ice motion field to calculate strain, deformation of sea ice occurs through the opening, closing and shearing of ice along discrete linear features. New numerical models are being developed which explicitly account for discontinuities in ice motion, and the need for requisite data sets for model validation has emerged. Multiple buoy data sets, as well as satellite data, have been used to examine the movement and deformation of sea ice. Generally it has been found that the ice motion field has been represented well by buoy data, as well as satellite data over a broad range of scales. However, the underlying deformation (spatial variation in displacement) as represented by different data sets may vary. For the work presented here, sea ice motio

Pruis, M.↗

NASA NTRS2012

First Assessments of Predicted ICESat-2 Performance Using Aircraft Data

The Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) is a next-generation laser altimeter designed to continue key observations of ice sheet elevation change, sea ice freeboard, vegetation canopy height, earth surface elevation, and sea surface height. Scheduled for launch in mid-2016, ICESat-2 will use a high repetition rate (10 kHz), small footprint (10 m nominal ground diameter) laser, and a single-photon-sensitive detection strategy (photon counting) to measure precise range to the earth's surface. Using green light (532 nm), the six beams of ICESat-2 will provide improved spatial coverage compared with the single beam of ICESat, while the differences in transmit energy among the beams provide a large dynamic range. The six beams are arranged into three pairs of beams which allow slopes to measured on an orbit-by-orbit basis. In order to evaluate models of predicted ICESat-2 performance and provide ICESat-2-like data for algorithm development, an airborne ICESat-2 simulator was developed and first flown in 2010. This simulator, the Multiple Altimeter Beam Experimental Lidar (MABEL) was most recently deployed to Iceland in April 2012 and collected approx 85 hours of science data over land ice, sea ice, and calibration targets. MABEL uses a similar photon-counting measurement strategy to what will be used on ICESat-2. MABEL collects data in 16 green channels and an additional 8 channels in the infrared aligned across the direction of flight. By using NASA's ER-2 aircraft flying at 20km altitude, MABEL flies as close to space as is practical, and collects data through approx 95% of the atmosphere. We present background on the MABEL instrument, and data from the April 2012 deployment to Iceland. Among the 13 MABEL flights, we collected data over the Greenland ice sheet interior and outlet glaciers in the southwest and western Greenland, sea ice data over the Nares Strait and Greenland Sea, and a number of small glaciers and ice caps in Iceland and Svalbard. Several of the flights were coincident in time and space with NASA's Operation IceBridge, which provides an independent data set for validation. MABEL also collected data along CryoSat track 10482 in north central Greenland approximately one month after CryoSat passed overhead.

Neumann, Thomas↗

NASA NTRS1999

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

NASA NTRS1999

Validation of Satellite Retrieved Land Surface Variables

Lakshmi, Venkataraman↗

NASA NTRS2010

Utilization of Airborne and in Situ Data Obtained in SGP99, SMEX02, CLASIC and SMAPVEX08 Field Campaigns for SMAP Soil Moisture Algorithm Development and Validation

Field experiment data sets that include coincident remote sensing measurements and in situ sampling will be valuable in the development and validation of the soil moisture algorithms of the NASA's future SMAP (Soil Moisture Active and Passive) mission. This paper presents an overview of the field experiment data collected from SGP99, SMEX02, CLASIC and SMAPVEX08 campaigns. Common in these campaigns were observations of the airborne PALS (Passive and Active L- and S-band) instrument, which was developed to acquire radar and radiometer measurements at low frequencies. The combined set of the PALS measurements and ground truth obtained from all these campaigns was under study. The investigation shows that the data set contains a range of soil moisture values collected under a limited number of conditions. The quality of both PALS and ground truth data meets the needs of the SMAP algorithm development and validation. The data set has already made significant impact on the science behind SMAP mission. The areas where complementing of the data would be most beneficial are also discussed.

Soil moisture↗

NASA NTRSDate not supplied

Mars Sample Return Earth Entry System Woven Roughness Mach 6 Aeroheating Test

The Mars Sample Return Earth Entry System is the first entry vehicle designed for a NASA flagship mission to utilize a woven thermal protection system as well as a 52.5 degree sphere cone forebody geometry. As a result, no heritage aeroheating experimental data set exists to compare with computational predictions. In order to obtain a set of validation data for computational models, an extensive wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project. The first entry in the test campaign was completed in April of 2023, which was an investigation of turbulent heating augmentation due to woven thermal protection system roughness on the 52.5 degree Mars Sample Return - Earth Entry System vehicle forebody geometry. This test entry produced the first ever experimental aeroheating data on a 52.5 degree sphere-cone geometry as well as the first NASA experimental aeroheating data on a woven surface roughness pattern. Data obtained from this test campaign is being directly leveraged to support the NASA flight program, as experimental results are being utilized to validate the computational models which characterize the aeroheating environment that the vehicle experiences and predict turbulent surface heating levels and margins across the woven surface.

Jonathan S Cheatwood↗

NASA NTRSDate not supplied

Mars Sample Return Earth Entry System Woven Roughness Mach 6 Aeroheating Test

The Mars Sample Return Earth Entry System is the first entry vehicle designed for a NASA flagship mission to utilize a woven thermal protection system as well as a 52.5 degree sphere cone forebody geometry. As a result, no heritage aeroheating experimental data set exists to compare with computational predictions. In order to obtain a set of validation data for computational models, an extensive wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project. The first entry in the test campaign was completed in April of 2023, which was an investigation of turbulent heating augmentation due to woven thermal protection system roughness on the 52.5 degree Mars Sample Return - Earth Entry System vehicle forebody geometry. This test entry produced the first ever experimental aeroheating data on a 52.5 deg sphere-cone geometry as well as the first NASA experimental aeroheating data on a woven surface roughness pattern. Data obtained from this test campaign is being directly leveraged to support the NASA flight program, as experimental results are being utilized to validate the computational models which characterize the aeroheating environment that the vehicle experiences and predict turbulent surface heating levels and margins across the woven surface.

Jonathan Cheatwood↗

NASA NTRS2022

A Compilation of Global Bio-Optical in Situ Data for Ocean Colour Satellite Applications – Version Three

A global in situ data set for validation of ocean colour products from the ESA Ocean Colour Climate Change Initiative (OC-CCI) is presented. This version of the compilation, starting in 1997, now extends to 2021, which is important for the validation of the most recent satellite optical sensors such as Sentinel 3B OLCI and NOAA-20 VIIRS. The data set comprises in situ observations of the following variables: spectral remote-sensing reflectance, concentration of chlorophyll-a, spectral inherent optical properties, spectral diffuse attenuation coefficient, and total suspended matter. Data were obtained from multi-project archives acquired via open internet services or from individual projects acquired directly from data providers. Methodologies were implemented for homogenization, quality control, and merging of all data. Minimal changes were made on the original data, other than conversion to a standard format, elimination of some points, after quality control and averaging of observations that were close in time and space. The result is a merged table available in text format. Overall, the size of the data set grew with 148 432 rows, with each row representing a unique station in space and time (cf. 136 250 rows in previous version; Valente et al., 2019). Observations of remote-sensing reflectance increased to 68 641 (cf. 59 781 in previous version; Valente et al., 2019). There was also a near tenfold increase in chlorophyll data since 2016. Metadata of each in situ measurement (original source, cruise or experiment, principal investigator) are included in the final table. By making the metadata available, provenance is better documented and it is also possible to analyse each set of data separately.

ocean color↗

NASA NTRS1997

Analysis of Solar Spectral Irradiance Measurements from the SBUV/2-Series and the SSBUV Instruments

During this period of performance, 1 March 1997 - 31 August 1997, the NOAA-11 SBUV/2 solar spectral irradiance data set was validated using both internal and external assessments. Initial quality checking revealed minor problems with the data (e.g. residual goniometric errors, that were manifest as differences between the two scans acquired each day). The sources of these errors were determined and the errors were corrected. Time series were constructed for selected wavelengths and the solar irradiance changes measured by the instrument were compared to a Mg II proxy-based model of short- and long-term solar irradiance variations. This analysis suggested that errors due to residual, uncorrected long-term instrument drift have been reduced to less than 1-2% over the entire 5.5 year NOAA-11 data record. Detailed statistical analysis was performed. This analysis, which will be documented in a manuscript now in preparation, conclusively demonstrates the evolution of solar rotation periodicity and strength during solar cycle 22.

Cebula, Richard P.↗

NASA NTRS1992

A technique for global monitoring of net solar irradiance at the ocean surface. II - Validation

The generation and validation of the first satellite-based long-term record of surface solar irradiance over the global oceans are addressed. The record is generated using Nimbus-7 earth radiation budget (ERB) wide-field-of-view plentary-albedo data as input to a numerical algorithm designed and implemented based on radiative transfer theory. The mean monthly values of net surface solar irradiance are computed on a 9-deg latitude-longitude spatial grid for November 1978-October 1985. The new data set is validated in comparisons with short-term, regional, high-resolution, satellite-based records. The ERB-based values of net surface solar irradiance are compared with corresponding values based on radiance measurements taken by the Visible-Infrared Spin Scan Radiometer aboard GOES series satellites. Errors in the new data set are estimated to lie between 10 and 20 W/sq m on monthly time scales.

Chertock, Beth↗

NASA NTRS2015

Laser Remote Sensing From ISS: CATS Cloud and Aerosol Level 2 Data Products (Heritage Edition)

The Cloud-Aerosol Transport System (CATS) instrument was developed at NASA's Goddard Space Flight Center (GSFC) and deployed to the International Space Station (ISS) on 10 January 2015. CATS is mounted on the Japanese Experiment Module's Exposed Facility (JEM_EF) and will provide near-continuous, altitude-resolved measurements of clouds and aerosols in the Earth's atmosphere. The CATS ISS orbit path provides a unique opportunity to capture the full diurnal cycle of cloud and aerosol development and transport, allowing for studies that are not possible with the lidar aboard the CALIPSO platform, which flies in the sun-synchronous A-Train orbit." " One of the primary science objectives of CATS is to continue the CALIPSO aerosol and cloud profile data record to provide continuity of lidar climate observations during the transition from CALIPSO to EarthCARE. To accomplish this, the CATS project at NASA's Goddard Space Flight Center (GSFC) and the CALIPSO project at NASA's Langley Research Center (LaRC) are closely collaborating to develop and deliver a full suite of CALIPSO-like level 2 data products that will be produced using the newly acquired CATS level 1B data whenever CATS is operating in science modes 1. The CALIPSO mission is now well into its ninth year of on-orbit operations, and has developed a robust set of mature and well-validated science algorithms to retrieve the spatial and optical properties of clouds and aerosols from multi-wavelength lidar backscatter signals. By leveraging both new and existing NASA technical resources, this joint effort by the CATS and CALIPSO teams will deliver validated lidar data sets to the user community at the earliest possible opportunity. The science community will have access to two sets of CATS Level 2 data products. The "Operational" data products will be produced by the GSFC CATS team utilizing the new instrument capabilities (e.g., multiple FOVs and 1064 nm depolarization), while the "Heritage" data products created using the existing CALIPSO algorithms and the CATS 532 nm channels and the total 1064 nm channel. " Below is the development of the CATS "Heritage" level 2 software and data along with some initial results with operational data."

Rodier, Sharon↗