Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Datasets of Faults in Variable Air Volume Terminal Units in a Multi-Zone Commercial Building

Faults in HVAC systems can decrease system efficiency and equipment lifespan, leading to 5%–30% of energy consumption being wasted in commercial buildings. We identified two common faults in HVAC variable air volume systems: a stuck damper fault in the variable air volume terminal unit and a discharge airflow sensor fault. We conducted three sets of damper stuck tests and two sets of airflow sensor tests, each including a fault-free scenario and scenarios with varying levels of faults, over one day. The faults were implemented in Oak Ridge National Laboratory’s two-story Flexible Research Platform building to generate a high-quality, well-controlled dataset covering fault-induced and fault-free scenarios. The test building, fault test scenarios, and data validation are described here. The open-source dataset includes 1 min intervals of weather and building data on the presence and absence of building faults. This dataset can be used to analyze the effects of HVAC system faults on system operation and indoor building conditions, and to develop or evaluate a fault detection and diagnosis algorithm.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Galaxy cluster matter profiles - I. Self-similarity, mass calibration, and observable-mass relation validation employing cluster mass posteriors

We present a study of the weak lensing inferred matter profiles ΔΣ(R) of 698 South Pole Telescope (SPT) thermal Sunyaev-Zel’dovich effect (tSZE) selected and MCMF optically confirmed galaxy clusters in the redshift range 0.25 < z < 0.94 that have associated weak gravitational lensing shear profiles from the Dark Energy Survey (DES). Rescaling these profiles to account for the mass dependent size and the redshift dependent density produces average rescaled matter profiles ΔΣ(R/R200c)/(ρcritR200c) with a lower dispersion than the unscaled ΔΣ(R) versions, indicating a significant degree of self-similarity. Galaxy clusters from hydrodynamical simulations also exhibit matter profiles that suggest a high degree of self-similarity, with RMS variation among the average rescaled matter profiles with redshift and mass falling by a factor of approximately six and 23, respectively, compared to the unscaled average matter profiles. We employed this regularity in a new Bayesian method for weak lensing mass calibration that employs the so-called cluster mass posterior P(M200|ζ̂, λ̂, z), which describes the individual cluster masses given their tSZE (ζ̂) and optical (λ̂, z) observables. This method enables simultaneous constraints on richness λ-mass and tSZE detection significance ζ-mass relations using average rescaled cluster matter profiles. We validated the method using realistic mock datasets and present observable-mass relation constraints for the SPT×DES sample, where we constrained the amplitude, mass trend, redshift trend, and intrinsic scatter. Our observable-mass relation results are in agreement with the mass calibration derived from the recent cosmological analysis of the SPT×DES data based on a cluster-by-cluster lensing calibration. Our new mass calibration technique offers a higher efficiency when compared to the single cluster calibration technique. We present new validation tests of the observable-mass relation that indicate the underlying power-law form and scatter are adequate to describe the real cluster sample but that also suggest a redshift variation in the intrinsic scatter of the λ-mass relation may offer a better description. In addition, the average rescaled matter profiles offer high signal-to-noise ratio (S/N) constraints on the shape of real cluster matter profiles, which are in good agreement with available hydrodynamical ΛCDM simulations. This high S/N profile contains information about baryon feedback, the collisional nature of dark matter, and potential deviations from general relativity.Key words: gravitational lensing: weak / galaxies: clusters: general / large-scale structure of Universe

79 ASTRONOMY AND ASTROPHYSICS↗

A generative machine learning model for designing metal hydrides applied to hydrogen storage

Developing new metal hydrides is a critical step toward efficient hydrogen storage in carbon-neutral energy systems. However, existing materials databases, such as the Materials Project, contain a limited number of well-characterized hydrides, which constrains the discovery of optimal candidates. This work presents a framework that integrates causal discovery with a lightweight generative machine learning model to generate novel metal hydride candidates that may not exist in current databases. Using a dataset of 450 samples (270 training, 90 validation, and 90 testing), the model generates 1000 candidates. After ranking and filtering, six previously unreported chemical formulas and crystal structures are identified, four of which are validated by density functional theory simulations and show strong potential for future experimental investigation. Overall, the proposed framework provides a scalable and time-efficient approach for expanding hydrogen storage datasets and accelerating materials discovery.

generative model↗

Underway Sampling of Marine Inherent Optical Properties on the Tara Oceans Expedition as a Novel Resource for Ocean Color Satellite Data Product Validation

Developing and validating data records from operational ocean color satellite instruments requires substantial volumes of high quality in situ data. In the absence of broad, institutionally supported field programs, organizations such as the NASA Ocean Biology Processing Group seek opportunistic datasets for use in their operational satellite calibration and validation activities. The publicly available, global biogeochemical dataset collected as part of the two and a half year Tara Oceans expedition provides one such opportunity. We showed how the inline measurements of hyperspectral absorption and attenuation coefficients collected onboard the R/V Tara can be used to evaluate near-surface estimates of chlorophyll-a, spectral particulate backscattering coefficients, particulate organic carbon, and particle size classes derived from the NASA Moderate Resolution Imaging Spectroradiometer onboard Aqua (MODISA). The predominant strength of such flow-through measurements is their sampling rate-the 375 days of measurements resulted in 165 viable MODISA-to-in situ match-ups, compared to 13 from discrete water sampling. While the need to apply bio-optical models to estimate biogeochemical quantities of interest from spectroscopy remains a weakness, we demonstrated how discrete samples can be used in combination with flow-through measurements to create data records of sufficient quality to conduct first order evaluations of satellite-derived data products. Given an emerging agency desire to rapidly evaluate new satellite missions, our results have significant implications on how calibration and validation teams for these missions will be constructed.

remote sensing↗

Chrono-Validation of Near-Real-Time Landslide Susceptibility Models via Plugin Statistical Simulations

The idea behind any validation scheme in landslide susceptibility studies is to test whether a model calibrated on a certain data can predict an unknown dataset of the same nature (landslide presences/absences and covariates). Almost the entirety of landslide susceptibility studies are validated by subsetting a single dataset into a training and test sets. This dataset usually corresponds either to event-specific or to historical inventories. Very rarely, a multi-temporal inventory is available and, in the few cases where this condition is met, the validation practices involve training a model on a specific landslide inventory, deriving a single predictive equation and validating it on a subsequent landslide inventory. This commonly leads landslide predictive studies, even those with a strong statistical rigor, to neglect the uncertainty estimation in their modeling scheme. In statistics, validation can also be performed via statistical simulations. This means that after fitting a given model, one can generate any number of predictive functions and test their predictive skills on any type and number of unknown datasets. In this work, we take a similar direction and we apply it to model and validate three separate co-seismic inventories, including an uncertainty estimation phase. We mapped these inventories within the same area in Indonesia, for three earthquakes occurred in 2012, 2017 and 2018. Specifically, we build three event-specific Bayesian Generalize Additive Models of the binomial family. From each model we then simulate 1000 predictive realizations over the remaining two inventories, by using a plug-in scheme where all the morphometric covariates are kept fixed and only the ground motion is replaced according to the prediction target. By doing so, we introduce a new analytical tool for near-real-time landslide predictive purposes, which is able to produce a probabilistic model which stands in between the definitions of susceptibility and hazard. In fact, our model is able to accurately estimate “where” and “when” - although not “how frequently” - landslide have occurred by featuring the multitemporal information of the trigger. In our findings, the simulations are quite similar to the fitted models; and the nine combinations we analyse produce excellent performance. This result confirms the assumption that “the past is the key to the future”, as we show that the relative contribution of each variable and their interactions in each probabilistic model remains practically the same across temporal replicates. This information is not trivial because it supports the routines implemented in global near-real-time applications.

Temporal validation↗

The Collection 6 'dark-target' MODIS Aerosol Products

Aerosol retrieval algorithms are applied to Moderate resolution Imaging Spectroradiometer (MODIS) sensors on both Terra and Aqua, creating two streams of decade-plus aerosol information. Products of aerosol optical depth (AOD) and aerosol size are used for many applications, but the primary concern is that these global products are comprehensive and consistent enough for use in climate studies. One of our major customers is the international modeling comparison study known as AEROCOM, which relies on the MODIS data as a benchmark. In order to keep up with the needs of AEROCOM and other MODIS data users, while utilizing new science and tools, we have improved the algorithms and products. The code, and the associated products, will be known as Collection 6 (C6). While not a major overhaul from the previous Collection 5 (C5) version, there are enough changes that there are significant impacts to the products and their interpretation. In its entirety, the C6 algorithm is comprised of three sub-algorithms for retrieving aerosol properties over different surfaces: These include the dark-target DT algorithms to retrieve over (1) ocean and (2) vegetated-dark-soiled land, plus the (3) Deep Blue (DB) algorithm, originally developed to retrieve over desert-arid land. Focusing on the two DT algorithms, we have updated assumptions for central wavelengths, Rayleigh optical depths and gas (H2O, O3, CO2, etc.) absorption corrections, while relaxing the solar zenith angle limit (up to 84) to increase pole-ward coverage. For DT-land, we have updated the cloud mask to allow heavy smoke retrievals, fine-tuned the assignments for aerosol type as function of season location, corrected bugs in the Quality Assurance (QA) logic, and added diagnostic parameters such as topographic altitude. For DT-ocean, improvements include a revised cloud mask for thin-cirrus detection, inclusion of wind speed dependence in the retrieval, updates to logic of QA Confidence flag (QAC) assignment, and additions of important diagnostic information. At the same time as we have introduced algorithm changes, we have also accounted for upstream changes including: new instrument calibration, revised land-sea masking, and changed cloud masking. Upstream changes also impact the coverage and global statistics of the retrieved AOD. Although our responsibility is to the DT code and products, we have also added a product that merges DT and DB product over semi-arid land surfaces to provide a more gap-free dataset, primarily for visualization purposes. Preliminary validation shows that compared to surface-based sunphotometer data, the C6, Level 2 (along swath) DT-products compare at least as well as those from C5. C6 will include new diagnostic information about clouds in the aerosol field, including an aerosol cloud mask at 500 m resolution, and calculations of the distance to the nearest cloud from clear pixels. Finally, we have revised the strategy for aggregating and averaging the Level 2 (swath) data to become Level 3 (gridded) data. All together, the changes to the DT algorithms will result in reduced global AOD (by 0.02) over ocean and increased AOD (by 0.02) over land, along with changes in spatial coverage. Changes in calibration will have more impact to Terras time series, especially over land. This will result in a significant reduction in artificial differences in the Terra and Aqua datasets, and will stabilize the MODIS data as a target for AEROCOM studie

Aerosol retrieval algorithms↗

Solar Radiation Measurements (CRADA Final Report)

Long-term solar radiation measurements are important for understanding solar resource availability and variability for systems design and deployment of cost-effective solar resource technologies. Additionally high-quality traceable solar measurements are required to validate satellite-based solar resource datasets that provide high-resolution long-term data covering the US. The purpose and intent of this agreement is to collect long-term solar radiation and meteorological measurements from the state-of-the-art facility at the University of Arizona to meet the above needs.

14 SOLAR ENERGY↗

SCEC/USGS Community Stress-Drop Validation Study: How Spectral Fitting Approaches Influence Measured Source Parameters

Spectral source parameters used to estimate an earthquake’s stress drop (⁠Δσ⁠) can vary significantly across measurement approaches. The Statewide California Earthquake Center/U.S. Geological Survey Community Stress‐Drop Validation Study was initiated to compare source parameter estimates, focusing initially on a dataset from the 2019 Ridgecrest earthquake sequence. As part of that validation effort, here we focus on one potential source of uncertainty: whether spectral fitting approaches alone, applied to a common set of spectra from the 2019 Ridgecrest sequence result in different source parameter estimates. By using a common set of benchmark spectra analyzed across a consistent frequency band of 1–40 Hz, we eliminate many sources of variability. A subgroup of validation study participants volunteered to estimate the low‐frequency displacement (⁠Ω 0 ⁠) and corner frequency (⁠ƒ c ⁠) by fitting a smooth function to benchmark displacement spectra. Participants used linear‐ or log‐sampled spectra, assumed a Brune or Boatwright spectral model, and applied different misfit criteria. We compare 17 approaches used to estimate ⁠Ω 0 ⁠, ƒ c ⁠, and Δσ for 54 earthquake spectra. Our results reveal that 35% of events have Δσ estimates within a factor of two, whereas others exhibit variations exceeding an order of magnitude. The variability in and can largely be attributed to whether a spectrum is consistent with the smooth function of an idealized simple crack model. The trade‐off between Ω 0 and ƒ c may be more pronounced when using linearly sampled spectra, as higher frequency spectral bumps control the fits. As expected, methods that assumed a Boatwright model tended to have lower Ω 0 and somewhat higher ƒ c compared to those assuming a Brune model, although resulting Δσ estimates are similar. Finally, when compared to the overall validation study results, the fitting approach alone may account for between 5% and 90% (25% on average) of the total variability in spectral Δσ⁠.

58 GEOSCIENCES↗

A physically based mechanical model for Mullins effect in thermoplastic polyurethanes

Despite decades of research, connecting the chemical and physical structure of thermoplastic polyurethanes to their mechanical properties remains highly challenging. Of particular note are their large-deformation and rate-dependent behaviors, which vary greatly with molecular chemistry, including the type and relative content of soft and hard segments. In this work, we develop a physically motivated mechanical theory for predicting the behavior of thermoplastic polyurethanes. The theory incorporates a representation of microstructural evolution during mechanical deformation, which captures the signatures of stress softening over cyclic loading (commonly referred to as the Mullins effect). There are only eight physically motivated fitting parameters, including a direct dependence on the hard segment fraction. The model predicts that increasing the hard segment fraction leads to higher stiffness and greater energy dissipation, in quantitative agreement with published experimental data. Furthermore, we provide a comprehensive analysis of the model and validate its predictions across several independent datasets focused on mechanical characterization. Direct comparisons to experimental data demonstrate its predictive capability on the effect of loading rate, cyclic deformations, and applied tension or compression. Altogether, this work establishes a predictive framework that connects polymer chemistry and microstructure to emergent mechanical behaviors.

36 MATERIALS SCIENCE↗

Toroidal injection angle dependence of EC assisted plasma initiation at DIII-D

An experimental scan of the electron cyclotron waves (EC) toroidal injection angle in plasma breakdown is performed at the DIII-D tokamak. The second harmonic, extraordinary mode EC is used for the study. The dependence of n e and T e on the EC injection angle cannot be conclusively drawn from this study due to the large error bars in the n e and T e measurements. On the other hand, high T e data points are observed in some discharges which can be explained by nonlinear heating. The D α emission measurement shows a clear relation between the breakdown time and the injection angle. An experimental investigation of the cause of the dependence of breakdown delay on the EC injection angle suggests that when the injection angle is oblique, the EC heating after the reflection at the inboard wall may become ineffective and cause the breakdown delay even when the EC heating before and directly upon injection remains effective. A preliminary run of the heat and transport balance code DYON indicates that the obtained dataset is suitable for a quantitative validation of EC absorption models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Linking Threat Agents to Targeted Organizations: A Pipeline for Enhanced Cybersecurity Risk Metrics

In this study, we present a methodology leveraging Large Language Models (LLMs) to transform Cybersecurity Threat Intelligence (CTI) narratives into actionable insights for individual organizations. Our approach automates the extraction of machine-readable adversary SKRAM (Skills, Knowledge, Resources, Authorities, and Motivation) attributes from open-source reports, extending LLM utility beyond typical interactions. This innovation enables precise, automated assessments of cybersecurity risks posed by various adversaries. Using a chain-of-thought and multi-shot prompting strategy, our methodology advances the automation of cybersecurity feature extraction for new machine-learning models that predict the risk of adversary targeting. This approach is refined using a substantial dataset of over 150 analyst-validated threat reports and synthetic organizational data from 900 companies. Here, by bootstrapping the training data with a rule-based heuristic over synthetic data, we have developed a high-accuracy machine-learning model that allows entities to dynamically prioritize threats and defensive actions.

Cyber Threat Intelligence↗

Model Residuals as Shields: A Two-Level Formulation to Defend Smart Grids From Poisoning Attacks

The advancement of smart grids presents both vast opportunities and heightened cybersecurity risks. Data-driven defense mechanisms, though designed as a shield against these threats, can fall prey to poisoning attacks. We delve into regression settings, underscoring the imperative to fortify defenses against a spectrum of poison ratios, notably those above 0.5—an issue scarcely addressed in prior studies. Recognizing the susceptibilities of smart grids and their manipulable sensors, we exploit the very intent of poisoning attacks, compromising model accuracy, as our defense mechanism. Our proposed two-level optimization framework discerns between poisoned and authentic data based on model residuals, outperforming or matching existing methods in 72% to 77% of precision and 75% to 80% of recalls across various poisoning attacks, poison ratios, and datasets. Once the authentic data are identified, the trained model is adaptable for a variety of applications. Comprehensive evaluations on different smart grid datasets, pitted against myriad poisoning schemes, validate our methodology’s edge over existing methods. Here, we also shed light on the implications of model misspecification originating from temporal auto-correlation, a common feature in Internet of Things and smart grid data.

Adversarial machine learning (ML)↗

Cybersecurity Center for Offshore Wind Energy (Final Project Report)

This project establishes a Cybersecurity Center for Offshore Wind Energy with the objective of designing and operating a cyber-physical testbed for wind energy farms (WEFs) that enables comprehensive cybersecurity research. The testbed incorporates a Supervisory Control and Data Acquisition (SCADA) system connected to turbine models via industrial-grade programmable logic controllers (PLCs) and remote terminal units (RTUs). It supports side-channel data acquisition, implementation and analysis of various cyberattack scenarios, and development of attack detection, mitigation, and best-practice guidance tailored to wind energy systems. During the project, the team expanded the number and fidelity of mathematical turbine models (MTMs), integrated these models with SCADA infrastructure, and deployed a scaled physical turbine and associated sensors. High-resolution operational and side-channel data streams were collected and used to refine machine-learning (ML)-based attack detection systems and to extend the WindCRAFT framework to multi-turbine threat scenarios. The project demonstrated a realistic, scalable environment for evaluating cyber threats, validated attack detection approaches using enriched datasets, and identified new multi-turbine and inter-turbine communication attack vectors. The resulting testbed, models, and security mechanisms provide a foundation for ongoing R&D and deployment of cyber-resilient offshore wind energy systems.

17 WIND ENERGY↗

Characterization and classification of sea ice in polarimetric SAR data

A more detailed characterization of the apparent thin ice types in the multifrequency, multipolarization synthetic aperture radar (SAR) dataset acquired during a campaign for validation of the DMSP SSM/I radiometer ice products is given. The emphasis is on providing a more detailed characterization of the signatures of apparent thin ice types observed in this data and the utility of these signatures for ice type classification purposes. The statistical characteristics of these signatures and their dependence on system calibration are summarized. Implications of these observations for sea ice scattering models are briefly discussed.

Kwok, R.↗

Validation of Cloud Properties From Multiple Satellites Using CALIOP Data

The NASA Langley Satellite ClOud and Radiative Property retrieval System (SatCORPS) is routinely applied to multispectral imagery from several geostationary and polar-orbiting imagers to retrieve cloud properties for weather and climate applications. Validation of the retrievals with independent datasets is continuously ongoing in order to understand differences caused by calibration, spatial resolution, viewing geometry, and other factors. The CALIOP instrument provides a decade of detailed cloud observations which can be used to evaluate passive imager retrievals of cloud boundaries, thermodynamic phase, cloud optical depth, and water path on a global scale. This paper focuses on comparisons of CALIOP retrievals to retrievals from MODIS, VIIRS, AVHRR, GOES, SEVIRI, and MTSAT. CALIOP is particularly skilled at detecting weakly-scattering cirrus clouds with optical depths less than approx. 0.5. These clouds are often undetected by passive imagers and the effect this has on the property retrievals is discussed.

Yost, Christopher R.↗

Blunt-Body Paradox and Improved Application of Transient-Growth Framework

The “Reshotko-Tumin transition criterion" based on optimal transient growth successfully correlates laboratory measurements of roughness induced transition over blunt body configurations. Even though transient growth has not been conclusively linked to the measured onset of transition, the above correlation denotes the only available physics-based model for subcritical transition in blunt body flows, since the latter do not support any modal instabilities at typical experimental conditions. Unlike other established models based on empirical curve fits that are valid for a specific subclass of datasets, the optimal-growth-based transition criterion appears to provide a reasonable correlation with measurements in various wind tunnel and ballistic range facilities and for a broad range of surface temperature ratios. This paper is focused on optimal growth calculations that improve upon significant shortcomings of the computations underlying the Reshotko-Tumin correlation. The improved framework is applied to leeward transition over a spherical section forebody that was tested in the Mach 6 Adjustable Contour Expansion wind tunnel at Texas A&M University. The computed results highlight the significance of nonparallel basic state evolution, curvature terms, and an optimization procedure that varies both inflow and outflow locations of the transient growth interval. More important, the results indicate that the modified correlation is very close to its original form, and hence, that the accuracy of the transient-growth-based transition criterion is not compromised by using a more thorough theoretical framework. Yet the results also show that the optimal energy gain up to the predicted transition onset location can be rather small, highlighting the need to further investigate the optimal growth criterion for additional experimental configurations and to also uncover the in-depth physics underlying blunt body transition.

Freestream conditions↗

TPSAS-NF1676L-30044-DND

The Clouds and the Earth's Radiant Energy System (CERES) project now has over 17 years accurately observed top-of-the-atmosphere (TOA) flux record for climate monitoring and diagnostic studies. The CERES FluxByCldTyp dataset, which contains cloud properties and radiative fluxes for 42 cloud types sorted by cloud top pressure and cloud optical depth, is used to investigate the clouds and their associated TOA (top-of-the-atmosphere) fluxes changes over the tropical area during ENSO events during the observed period. Unlike past studies, this study shows the impact of ENSO on cloud properties like optical depth, cloud top effective pressure and temperature and TOA LW and SW fluxes for each sub cloud type. The study reveals the detailed contributions from different cloud types for radiative characteristics during different regimes of ENSOs. This is especially important for very small net TOA radiative balance due to the cancellation of the fluxes from different cloud types. The dataset serves as a more stringent validation of climate models for cloud properties and radiative fluxes.

Sun, Moguo↗

Neural Network Reflectance Prediction Model for Both Open Ocean and Coastal Waters

Remote sensing of global ocean color is a valuable tool for understanding the ecology and biogeochemistry of the worlds oceans, and provides critical input to our knowledge of the global carbon cycle and the impacts of climate change. Ocean polarized reflectance contains information about the constituents of the upper ocean euphotic zone, such as colored dissolved organic matter (CDOM), sediments, phytoplankton, and pollutants. In order to retrieve the information on these constituents, remote sensing algorithms typically rely on radiative transfer models to interpret water color or remote-sensing reflectance; however, this can be resource-prohibitive for operational use due to the extensive CPU time involved in radiative transfer solutions. In this work, we report a fast model based on machine learning techniques, called Neural Network Reflectance Prediction Model (NNRPM), which can be used to predict ocean bidirectional polarized reflectance given inherent optical properties of ocean waters. This supervised model is trained using a large volume of data derived from radiative transfer simulations for coupled atmosphere and ocean systems using the successive order of scattering technique (SOS-CAOS). The performance of the model is validated against another large independent test dataset generated from SOS-CAOS. The model is able to predict both polarized and unpolarized reflectances with an absolute error (AE) less than 0.004 for 99% of test cases. We have also shown that the degree of linear polarization (DoLP) for unpolarized incident light can be predicted with an AE less than 0.002 for 99% of test cases. In general, the simulation time of SOS-CAOS depends on optical depth, and required accuracy. When comparing the average speeds of the NNRPM against the SOS-CAOS model for the same parameters, we see that the NNRPM is able to predict the Ocean BRDF 6000 times faster than SOS-CAOS. Both ultraviolet and visible wavelengths are included in the model to help differentiate between dissolved organic material and chlorophyll in the study of the open ocean and the coastal zone. The incorporation of this model into the retrieval algorithm will make the retrieval process more efficient, and thus applicable for operational use with global satellite observations.

radiative transfer↗