Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Validated environmental and physiological data from the CELSS Breadboard Projects Biomass Production Chamber. BWT931 (Wheat cv. Yecora Rojo)

This KSC database is being made available to the scientific research community to facilitate the development of crop development models, to test monitoring and control strategies, and to identify environmental limitations in crop production systems. The KSC validated dataset consists of 17 parameters necessary to maintain bioregenerative life support functions: water purification, CO2 removal, O2 production, and biomass production. The data are available on disk as either a DATABASE SUBSET (one week of 5-minute data) or DATABASE SUMMARY (daily averages of parameters). Online access to the VALIDATED DATABASE will be made available to institutions with specific programmatic requirements. Availability and access to the KSC validated database are subject to approval and limitations implicit in KSC computer security policies.

Stutte, G. W.↗
NASA NTRS2011

The NASA CloudSat/GPM Light Precipitation Validation Experiment (LPVEx)

Ground-based measurements of cool-season precipitation at mid and high latitudes (e.g., above 45 deg N/S) suggest that a significant fraction of the total precipitation volume falls in the form of light rain, i.e., at rates less than or equal to a few mm/h. These cool-season light rainfall events often originate in situations of a low-altitude (e.g., lower than 2 km) melting level and pose a significant challenge to the fidelity of all satellite-based precipitation measurements, especially those relying on the use of multifrequency passive microwave (PMW) radiometers. As a result, significant disagreements exist between satellite estimates of rainfall accumulation poleward of 45 deg. Ongoing efforts to develop, improve, and ultimately evaluate physically-based algorithms designed to detect and accurately quantify high latitude rainfall, however, suffer from a general lack of detailed, observationally-based ground validation datasets. These datasets serve as a physically consistent framework from which to test and refine algorithm assumptions, and as a means to build the library of algorithm retrieval databases in higher latitude cold-season light precipitation regimes. These databases are especially relevant to NASA's CloudSat and Global Precipitation Measurement (GPM) ground validation programs that are collecting high-latitude precipitation measurements in meteorological systems associated with frequent coolseason light precipitation events. In an effort to improve the inventory of cool-season high-latitude light precipitation databases and advance the physical process assumptions made in satellite-based precipitation retrieval algorithm development, the CloudSat and GPM mission ground validation programs collaborated with the Finnish Meteorological Institute (FMI), the University of Helsinki (UH), and Environment Canada (EC) to conduct the Light Precipitation Validation Experiment (LPVEx). The LPVEx field campaign was designed to make detailed measurements of cool-season light precipitation by leveraging existing infrastructure in the Helsinki Precipitation Testbed. LPVEx was conducted during the months of September--October, 2010 and featured coordinated ground and airborne remote sensing components designed to observe and quantify the precipitation physics associated with light rain in low-altitude melting layer environments over the Gulf of Finland and neighboring land mass surrounding Helsinki, Finland.

Petersen, Walter A.↗
NASA NTRSDate not supplied

Fundamental Test of a Hovering Rotor: Comprehensive Measurements for CFD Validation

A model-scale hover test of a 4-bladed, 11.08-ft diameter rotor was recently completed inside the National Full-Scale Aerodynamics Complex 80- by 120-Foot Wind Tunnel test section. The primary objective of the test was to acquire key experimental data for a hovering rotor of sufficient quality and quantity to allow validation of state-of-the-art analysis codes. A comprehensive measurement set has been acquired, including rotor performance, blade airloads, flow transition locations, blade deflections, and wake geometry for a range of tip Mach numbers and collective settings. The present paper provides an overview of the test, including detailed descriptions of the hardware, instrumentation, and measurement systems. In addition, the specific test objectives, approach, and sample results are presented. The full test database, as well as detailed rotor geometry information, will ultimately be shared openly on a NASA-sponsored website to serve as a benchmark validation dataset.

Hover↗
NASA NTRS2024

Expanded Signal to Noise Ratio Estimates for Validating Next-Generation Satellite Sensors in Oceanic, Coastal, and Inland Waters

The launch of the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) and the Surface Biology and Geology (SBG) satellite sensors will provide increased spectral resolution compared to existing platforms. These new sensors will require robust calibration and validation datasets, but existing field-based instrumentation is limited in its availability and potential for geographic coverage, particularly for coastal and inland waters, where optical complexity is substantially greater than in the open ocean. The minimum signal-to-noise ratio (SNR) is an important metric for assessing the reliability of derived biogeochemical products and their subsequent use as proxies, such as for biomass, in aquatic systems. The SNR can provide insight into whether legacy sensors can be used for algorithm development as well as calibration and validation activities for next-generation platforms. We extend our previous evaluation of SNR and associated uncertainties for representative coastal and inland targets to include the imaging sensors PRISM and AVIRIS-NG, the airborne-deployed C-AIR radiometers, and the shipboard HydroRad and HyperSAS radiometers, which were not included in the original analysis. Nearly all the assessed hyperspectral sensors fail to meet proposed criteria for SNR or uncertainty in remote sensing reflectance (R rs ) for some part of the spectrum, with the most common failures (>20% uncertainty) below 400 nm, but all the sensors were below the proposed 17.5% uncertainty for derived chlorophyll-a. Instrument suites for both in-water and airborne platforms that are capable of exceeding all the proposed thresholds for SNR and R rs uncertainty are commercially available. Thus, there is a straightforward path to obtaining calibration and validation data for current and next-generation sensors, but the availability of suitable high spectral resolution sensors is limited.

signal-to-noise ratio↗
NASA NTRS2016

How Universal is the Relationship Between Remotely Sensed Vegetation Indices and Crop Leaf Area Index? A Global Assessment

Leaf Area Index (LAI) is a key variable that bridges remote sensing observations to the quantification of agroecosystem processes. In this study, we assessed the universality of the relationships between crop LAI and remotely sensed Vegetation Indices (VIs). We first compiled a global dataset of 1459 in situ quality-controlled crop LAI measurements and collected Landsat satellite images to derive five different VIs including Simple Ratio (SR), Normalized Difference Vegetation Index (NDVI), two versions of the Enhanced Vegetation Index (EVI and EVI2), and Green Chlorophyll Index (CI(sub Green)). Based on this dataset, we developed global LAI-VI relationships for each crop type and VI using symbolic regression and Theil-Sen (TS) robust estimator. Results suggest that the global LAI-VI relationships are statistically significant, crop-specific, and mostly non-linear. These relationships explain more than half of the total variance in ground LAI observations (R2 greater than 0.5), and provide LAI estimates with RMSE below 1.2 m2/m2. Among the five VIs, EVI/EVI2 are the most effective, and the crop-specific LAI-EVI and LAI-EVI2 relationships constructed by TS, are robust when tested by three independent validation datasets of varied spatial scales. While the heterogeneity of agricultural landscapes leads to a diverse set of local LAI-VI relationships, the relationships provided here represent global universality on an average basis, allowing the generation of large-scale spatial-explicit LAI maps. This study contributes to the operationalization of large-area crop modeling and, by extension, has relevance to both fundamental and applied agroecosystem research.

Vegetation Index↗
DOE OSTI2024

Event-Based Energy Impact Tracking and Forecasting with Limited Measurements for Rooftop Units

Packaged air conditioning units and heat pumps, also known as rooftop units (RTUs), are responsible for almost 133 billion kWh of electricity usage annually on site for space cooling U.S. commercial buildings. In addition, the use of heat pumps is a trend we expect to accelerate as buildings transition from fossil fuel-based heating to electricity as a key step for decarbonizing the U.S. commercial buildings sector. However, the operation conditions and energy use of RTUs and heat pumps are usually not well monitored as they are not commonly integrated with building automation systems and lack exposed sensing and control points. To fill this gap, this paper proposes a framework for tracking and forecasting energy impacts resulting from degradation of performance and improved performance for unit servicing using limited data. The proposed framework makes use of a constrained dataset, specifically measurements of the outdoor air temperature and the power demand of individual RTUs, to track and forecast changes in energy use associated with changes in performance over various temporal horizons ranging from days to weeks. Following the detection of an RTU fault, performance degradation, or performance improvement, the framework employs a prediction model to assess the cumulative energy impact. We demonstrate the effectiveness of the method with field-collected data for servicing and degradation examples and compare the predicting accuracy of Gradient Boosting Decision Tree (GBDT) Regression models to Support Vector Regression and Linear Regression models. The results show that GBDT achieved the best accuracy for time-series validation datasets for the servicing and degradation cases, and the prediction model was able to track the cumulative energy impacts of events. The proposed framework can inform building owners of the cumulative change in energy usage of RTUs associated with performance degradation, performance improvement, or a fault.

packaged air conditioners, packaged heat pumps, ro↗
NASA NTRS1994

Arctic ocean radiative fluxes and cloud forcing estimated from the ISCCP C2 cloud dataset, 1983-1990

Radiative fluxes and cloud forcings for the ocean areas of the Arctic are computed from the monthly cloud product of the International Satellite Cloud Climatology Project (ISCCP) for 1983-90. Spatially averaged short-wave fluxes are compared well with climatological values, while downwelling longwave fluxes are significantly lower. This is probably due to the fact that the ISCCP cloud amounts are underestimates. Top-of-the-atmosphere radiative fluxes are in excellent agreement with measurements from the Earth Radiation Budget Experiment (ERBE). Computed cloud forcings indicate that clouds have a warming effect at the surface and at the top of the atmosphere during winter and a cooling effect during summer. The net radiative effect of clouds is larger at the surface during winter but greater at the top of the atmosphere during summer. Overall the net radiative effect of clouds at the top of the atmosphere is one of cooling. This is in contrast to a previous result from ERBE data showing arctic cloud forcings have a net warming effect. Sensitivities to errors in input parameters are generally greater during winter with cloud amount being the most important paarameter. During summer the surface radiation balance is most sensitive to errors in the measurements of surface reflectance. The results are encouraging, but the estimated error of 20 W/sq m in surface net radiative fluxes is too large, given that estimates of the net radiative warming effect due to a doubling of CO2 are on the order of 4 W/sq m. Because it is difficult to determine the accuracy of results with existing in situ observations, it is recommended that the development of improved algorithms for the retrieval of surface radiative properties be accompanied by the simultaneous assembly of validation datasets.

Schweiger, Axel J.↗
DOE OSTI2025

Network Anomaly Detection in Distributed Edge Computing Infrastructure

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the computational burden associated with analyzing large-scale network traffic to identify anomalies. This paper introduces a distributed edge computing framework that integrates federated learning with Apache Spark and Kubernetes to address these challenges. We hypothesize that our approach, which enables collaborative model training across distributed nodes, significantly enhances the detection accuracy of network anomalies across different network types. We show that by leveraging distributed computing and containerization technologies, our framework not only improves scalability and fault tolerance but also achieves superior detection performance compared to state-of-the-art methods. Extensive experiments on the UNSW-NB15 and ROAD datasets validate the effectiveness of our approach, demonstrating statistically significant improvements in detection accuracy and training efficiency over baseline models, as confirmed by MannWhitney U and Kolmogorov-Smirnov tests (p<0.05).

Marfo, William [University of Texas at El Paso,Dep↗
DOE OSTI2024

Entropy-Infused Deep Learning Loss Function for Capturing Extreme Values in Wind Power Forecasting

Extreme scenarios in wind power generation occur with higher frequency and larger magnitude in the recent years due to the ever-increasing extreme meteorological factors. Accurate forecasting of the occurrence of extreme values in wind power generation is of great concern to ensure reliable power system operation. Recently, deep learning models have surged in popularity for wind power forecasting, with the mean squared error (MSE) loss function being commonly used. However, the MSE loss function, being sensitive to extreme values, disproportionately penalizes larger errors, cannot adequately capture the extreme values present in wind energy data, and novel loss functions have seldom been tailored for wind power forecasting. To this end, in this paper, we introduce a novel loss function specifically crafted to capture extreme values in wind power forecasting. The experimental results with four fundamental deep learning methods on open source wind power dataset validate that the new loss function is efficient and superior in all cases compared to MSE in capturing extreme values while maintaining forecasting performance.

17 WIND ENERGY↗
DOE OSTI2025

Detecting Masquerade Attacks in Controller Area Networks Using Graph Machine Learning

Modern vehicles rely on a myriad of electronic control units (ECUs) interconnected via controller area networks (CANs) for critical operations. Despite their ubiquitous use and reliability, CANs are susceptible to sophisticated cyberattacks, particularly masquerade attacks, which inject false data that mimic legitimate messages at the expected frequency. These attacks pose severe risks such as unintended acceleration, brake deactivation, and rogue steering. Traditional intrusion detection systems (IDS) often struggle to detect these subtle intrusions due to their seamless integration into normal traffic. This paper introduces a novel framework for detecting masquerade attacks in the CAN bus using graph machine learning (ML). We hypothesize that the integration of shallow graph embeddings with time series features derived from CAN frames enhances the detection of masquerade attacks. We show that by representing CAN bus frames as message sequence graphs (MSGs) and enriching each node with contextual statistical attributes from time series, we can enhance detection capabilities across various attack patterns compared to using graph-based features only. Our method ensures a comprehensive and dynamic analysis of CAN frame interactions, improving robustness and efficiency. Extensive experiments on the ROAD dataset validate the effectiveness of our approach, demonstrating statistically significant improvements in the detection rates of masquerade attacks compared to a baseline that uses graph-based features only as confirmed by Mann-Whitney U and Kolmogorov-Smirnov tests (p < 0.05) .

Marfo, William [Univ. of Texas, El Paso, TX (Unite↗
DOE OSTI2024

EMT data generation

The integration of inverter-based resources (IBRs) in power systems is accelerating, bringing with it significant benefits such as reduced greenhouse gas emissions, improved grid resilience, and increased energy independence. Despite these advantages, the widespread adoption of IBRs introduces several challenges, including issues related to grid stability, increased operational complexity, and the need for updated regulatory frameworks. To address these challenges, IEEE released Standard 2800 in 2022, which sets forth the necessary interconnection capabilities and performance criteria for IBRs connected to transmission and sub-transmission systems. This standard outlines the performance requirements to ensure the reliable integration of IBRs into the bulk power system. Furthermore, in 2023, the North American Electric Reliability Corporation (NERC) published a reliability guideline for electromagnetic transient (EMT) modeling of BPS-connected IBRs. This guideline provides recommendations for developing EMT model requirements, performing model quality checks, and implementing verification practices specifically for EMT models representing BPS-connected inverter-based resources in reliability studies conducted by transmission planners and planning coordinators. These standards and guidelines have a profound impact on EMT studies for transmission networks, influencing system stability analyses, grid recovery and resynchronization processes, fault ride-through evaluations, protection and coordination strategies, advanced control methodologies, and the inclusion of IBRs in transient models of transmission networks. As a result, the generation of EMT data is crucial for conducting various transient-based studies to understand the impact of IBRs. EMT data generation use cases serve as the basis for scenarios in event detection and identification use cases, providing comprehensive details about EMT data generation for transmission grids with inverter-based resources. These use cases supply sufficient training and validation datasets for subsequent EMT analysis algorithms.

Xia, Qianxue↗
DOE OSTI2026

Integration of GOES Data for Solar Resource Assessment of the Contiguous United States

The National Solar Radiation Database (NSRDB), produced by the National Laboratory of the Rockies (NLR), provides high-resolution solar resource data for the contiguous United States (CONUS) using Geostationary Operational Environmental Satellite (GOES) East and West observations. This study evaluates the integration of multi-satellite data within the GOES-East/West overlap regions, where conventional longitude-based selection methods often produce an artificial boundary seam. Our results demonstrate that an advanced blending algorithm, which incorporates sun-satellite scattering angles and satellite viewing zenith angles, improves NSRDB accuracy and creates a spatially continuous dataset. Validation against ground-based irradiance measurements reveals reductions in both percentage error (PE) and normalized Root Mean Square Error (nRMSE), particularly in the central United States. The dynamical integration of multi-satellite data provides a robust foundation for more precise modeling of solar resource and improved spatiotemporal analysis of solar ramp across the CONUS.

14 SOLAR ENERGY↗
NASA NTRS1995

Estimating the urban bias of surface shelter temperatures using upper-air and satellite data. Part 1: Development of models predicting surface shelter temperatures

Multiple regression techniques were used to predict surface shelter temperatures based on the time period 1986-89 using upper-air data from the European Centre for Medium-Range Weather Forecasts (ECMWF) to represent the background climate and site-specific data to represent the local landscape. Global monthly mean temperature models were developed using data from over 5000 stations available in the Global Historical Climate Network (GHCN). Monthly maximum, mean, and minimum temperature models for the United States were also developed using data from over 1000 stations available in the U.S. Cooperative (COOP) Network and comparative monthly mean temperature models were developed using over 1150 U.S. stations in the GHCN. Three-, six-, and full-variable models were developed for comparative purposes. Inferences about the variables selected for the various models were easier for the GHCN models, which displayed month-to-month consistency in which variables were selected, than for the COOP models, which were assigned a different list of variables for nearly every month. These and other results suggest that global calibration is preferred because data from the global spectrum of physical processes that control surface temperatures are incorporated in a global model. All of the models that were developed in this study validated relatively well, especially the global models. Recalibration of the models with validation data resulted in only slightly poorer regression statistics, indicating that the calibration list of variables was valid. Predictions using data from the validation dataset in the calibrated equation were better for the GHCN models, and the globally calibrated GHCN models generally provided better U.S. predictions than the U.S.-calibrated COOP models. Overall, the GHCN and COOP models explained approximately 64%-95% of the total variance of surface shelter temperatures, depending on the month and the number of model variables. In addition, root-mean-square errors (rmse's) were over 3 C for GHCN models and over 2 C for COOP models for winter months, and near 2 C for GHCN models and near 1.5 C for COOP models for summer months.

Epperson, David L.↗
NASA NTRS2000

A Catchment-Based Approach to Modeling Land Surface Processes in a GCM: Parameter Estimation and Model Demonstration - Part 2

The viability of a new catchment-based land surface model (LSM) developed for use with general circulation models is demonstrated. First, simple empirical functions -- tractable enough for operational use in the LSM -- are established that faithfully capture the control of topography on the subgrid variability of soil moisture and the surface water budget, as predicted by theory. Next, the full LSM is evaluated offline. Using forcing and validation datasets developed for PILPS Phase 2c, the minimally calibrated model is shown to reproduce observed evaporation and runoff fluxes successfully in the Red-Arkansas River Basin. A complementary idealized study that employs the range of topographic variability seen over North America demonstrates that the simulated surface water budget does vary strongly with topography, which can, by itself, induce variations in annual evaporation as high as 20%.

Ducharne, Agnes↗
NASA NTRS2010

Evolving the Technical Infrastructure of the Planetary Data System for the 21st Century

The Planetary Data System (PDS) was established in 1989 as a distributed system to assure scientific oversight. Initially the PDS followed guidelines recommended by the National Academies Committee on Data Management and Computation (CODMAC, 1982) and placed emphasis on archiving validated datasets. But overtime user demands, supported by increased computing capabilities and communication methods, have placed increasing demands on the PDS. The PDS must add additional services to better enable scientific analysis within distributed environments and to ensure that those services integrate with existing systems and data. To face these challenges the Planetary Data System (PDS) must modernize its architecture and technical implementation. The PDS 2010 project addresses these challenges. As part of this project, the PDS has three fundamental project goals that include: (1) Providing more efficient client delivery of data by data providers to the PDS (2) Enabling a stable, long-term usable planetary science data archive (3) Enabling services for the data consumer to find, access and use the data they require in contemporary data formats. In order to achieve these goals, the PDS 2010 project is upgrading both the technical infrastructure and the data standards to support increased efficiency in data delivery as well as usability of the PDS. Efforts are underway to interface with missions as early as possible and to streamline the preparation and delivery of data to the PDS. Likewise, the PDS is working to define and plan for data services that will help researchers to perform analysis in cost-constrained environments. This presentation will cover the PDS 2010 project including the goals, data standards and technical implementation plans that are underway within the Planetary Data System. It will discuss the plans for moving from the current system, version PDS 3, to version PDS 4.

Beebe, Reta F.↗
NASA NTRS2011

Fluid Structure Interaction of Parachutes in Supersonic Planetary Entry

A research program to provide physical insight into disk-gap-band parachute operation in the supersonic regime on Mars was conducted. The program included supersonic wind tunnel tests, computational fluid dynamics and fluid structure interaction simulations. Specifically, the nature and cause of the "area oscillation" phenomenon were investigated to determine the scale, aerodynamic, and aero-elastic dependence of the supersonic parachute collapse and re-inflation event. A variety of non-intrusive, temporally resolved, and high resolution diagnostic techniques were used to interrogate the flow and generate validation datasets. The results of flow visualization, particle image velocimetry, load measurements, and photogrammetric reconstruction will be presented. Implications to parachute design, use, and verification will also be discussed.

parachute↗
NASA NTRS2019

Antarctic Ice Shelf Thickness Change from Multimission Lidar Mapping

We calculate rates of ice thickness change and bottom melt for ice shelves in West Antarctica and the Antarctic Peninsula from a combination of elevation measurements from NASA–CECS Antarctic ice mapping campaigns and NASA Operation IceBridge corrected for oceanic processes from measurements and models, surface velocity measurements from synthetic aperture radar, and high-resolution outputs from regional climate models. The ice thickness change rates are calculated in a Lagrangian reference frame to reduce the effects from advection of sharp vertical features, such as cracks and crevasses, that can saturate Eulerian-derived estimates. We use our method over different ice shelves in Antarctica, which vary in terms of size, repeat coverage from airborne altimetry, and dominant processes governing their recent changes. We find that the Larsen-C Ice Shelf is close to steady state over our observation period with spatial variations in ice thickness largely due to the flux divergence of the shelf. Firn and surface processes are responsible for some short-term variability in ice thickness of the Larsen-C Ice Shelf over the time period. The Wilkins Ice Shelf is sensitive to short-timescale coastal and upper-ocean processes, and basal melt is the dominant contributor to the ice thickness change over the period. At the Pine Island Ice Shelf in the critical region near the grounding zone, we find that ice shelf thickness change rates exceed 40m/yr, with the change dominated by strong submarine melting. Regions near the grounding zones of the Dotson and Crosson ice shelves are decreasing in thickness at rates greater than 40m/yr, also due to intense basal melt. NASA–CECS Antarctic ice mapping and NASA Operation IceBridge campaigns provide validation datasets for floating ice shelves at moderately high resolution when coregistered using Lagrangian methods.

Sutterley, Tyler C.↗
NASA NTRS2011

TPSAS-NF1676L-12839-DND

Hyper-spectral remote sensors, such as Atmospheric Infrared Sounder (AIRS) and Infrared Atmospheric Sounding Interferometer (IASI), provides top of atmospheric radiances with high information content on atmospheric and surface properties. In order to analyze these data in real time, fast, and accurate forward and inverse models are needed. We will describe a method of simultaneously retrieving atmospheric temperature, moisture, cloud, and surface properties using all available spectral channels without sacrificing computational speed. The method has been successfully applied to AIRS, IASI, and NAST-I data. By applying the same method to the current and future hyperspectral sounders, the derived products will have less errors due to biases introduced by different retrieval methods. We have compared the retrieved products to radiosondes, aircraft measurements and other validation dataset. Simulations have done to quantify retrieval errors associated with the retrievals. The essence of the method is to convert channel radiance spectra into super-channels by an Empirical Orthogonal Function (EOF) transformation. A Principal Component-based Radiative Transfer Model (PCRTM) developed at NASA Langley Research Center is used to calculate both the super-channel magnitudes and derivatives with respect to atmospheric profiles and other properties. The inversion algorithm is based on a non-linear Levenberg-Marquardt method with climatology covariance matrices and a priori information as constraints. One advantage of this approach is that it uses all information content from the hyper-spectral data so that the retrieval is less sensitive to instrument noise and eliminates the need for selecting a subset of the channels. The PCRTM forward model has also been used to performance end-to-end sensor performance simulations of the Climate Absolute Radiance and Refractivity Observatory (CLARREO).

Xu Liu↗