Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

A Comprehensive Validation Methodology for Sparse Experimental Data

A comprehensive program of verification and validation has been undertaken to assess the applicability of models to space radiation shielding applications and to track progress as models are developed over time. The models are placed under configuration control, and automated validation tests are used so that comparisons can readily be made as models are improved. Though direct comparisons between theoretical results and experimental data are desired for validation purposes, such comparisons are not always possible due to lack of data. In this work, two uncertainty metrics are introduced that are suitable for validating theoretical models against sparse experimental databases. The nuclear physics models, NUCFRG2 and QMSFRG, are compared to an experimental database consisting of over 3600 experimental cross sections to demonstrate the applicability of the metrics. A cumulative uncertainty metric is applied to the question of overall model accuracy, while a metric based on the median uncertainty is used to analyze the models from the perspective of model development by analyzing subsets of the model parameter space.

Norman, Ryan B.↗
DOE OSTI2019

Bayesian Assimilation of Multiscale Precipitation Data and Sparse Ground Gauge Observations in Mountainous Areas

Estimating the spatial distribution of precipitation is important for understanding ecohydrological processes at catchment scales. However, this estimation is difficult in mountainous areas because ground-based observation stations are often sparsely located and do not represent the spatial variability of precipitation. In this study, we develop a Bayesian assimilation method based on data collected on the Tibetan Plateau from 1980 to 2014 to estimate monthly and daily precipitation. To accomplish this, point-scale ground meteorological observations are combined with large-scale precipitation data such as satellite observations or reanalysis data. First, we remove the terrain effects from ground observations by fitting the precipitation data as functions of elevation, and then we spatially interpolate the residuals to 5-km-resolution grids to obtain monthly and daily precipitation. Additionally, we use Tropical Rainfall Measuring Mission (TRMM) satellite observations and ERA-Interim reanalysis data. Cross-validation methods are used to evaluate our method; the results show that our method not only captures the change in precipitation with terrain but also significantly reduces the associated uncertainty. The improvements are more evident in the main river source areas on the edge of the Tibetan Plateau, where elevation changes dramatically, and in high-altitude areas, where the ground gauges are sparse compared with those in low-altitude areas. Our assimilation method is applicable to other regions and is particularly useful for mountainous watersheds where ground meteorological stations are sparse and precipitation is considerably influenced by terrain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Fast Scanning Probe Microscopy via Machine Learning: Non-Rectangular Scans with Compressed Sensing and Gaussian Process Optimization

Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, a factor of 5.8 reduction in data collection using a combination of sparse spiral scanning with compressive sensing and Gaussian process regression reconstruction is demonstrated. It is found that even extremely sparse spiral scans offer strong reconstructions with less than 6% error for Gaussian process regression reconstructions. Further, the error associated with each reconstructive technique per reconstruction iteration is analyzed, finding the error is similar past ≈15 iterations, while at initial iterations Gaussian process regression outperforms compressive sensing. Finally, this study highlights the capabilities of reconstruction techniques when applied to sparse data, particularly sparse spiral PFM scans, with broad applications in scanning probe and electron microscopies.

36 MATERIALS SCIENCE↗
NASA NTRS2019

A Global Assessment of Added Value in the SMAP Level-4 Soil Moisture Product Relative to Its Baseline Land Surface Model

The Soil Moisture Active Passive (SMAP) Level-4 product provides enhanced soil moisture estimates by assimilating SMAP brightness temperature observations into a land surface model. Here, an unbiased qualitative estimate of the relative skill of SMAP Level-4 and model-only surface soil moisture (versus true soil moisture) is derived using only one additional noisy (but independent) soil moisture product. The method is applied globally and verified using high-quality, ground-based measurements where available. Results demonstrate that assimilating SMAP brightness temperature has relatively little impact in data-rich areas like the United States and Europe. In contrast, much larger improvement is observed in data-sparse regions, including much of Africa and central Australia, where model-only simulations are disproportionately impacted by low-quality model forcing. Therefore, ground validation conducted in data-rich areas does not adequately sample the added value of SMAP data assimilation for data-sparse regions and substantially underestimates the added skill provided by the SMAP Level-4 system.

SMAP L4↗
NASA NTRS2022

Design of Materials with Alchemite

Machine learning models that establish the relationships between materials processing and properties can enable inverse design of materials through active learning. Alchemite is a commercial software that can perform inverse materials design on sparse data. Here we evaluate Alchemite’s performance on a dataset of shape memory alloys and a dataset of heat exchangers compared to baseline random forest models. Alchemite had higher accuracy when making predictions on sparse data and was more accurate or nearly as accurate as random forests on complete datasets while also quantifying uncertainty. The software was also used to suggest processing steps and design parameters to optimize properties and performance; however, physical validation of the suggested design parameters was beyond the scope of this work. Several useful design insights were gained about the impact of the design parameters on properties and performance including the importance of dopant choice and amount for shape memory alloys and the importance of height and weight on the thermal resistance of heat exchangers.

Machine learning↗
DOE OSTI2026

Data for A Hybrid Biophysical-Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81–0.94) and H (R2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

AI/ML↗
DOE OSTI2024

Three-dimensional reconstruction of x-ray emission volumes in magnetized liner inertial fusion from sparse projection data using a learned basis

The ability to visualize x-ray and neutron emission from fusion plasmas in 3D is critical to understand the origin of the complex shapes of the plasmas in experiments. Unfortunately, this remains challenging in experiments that study a fusion concept known as Magnetized Liner Inertial Fusion (MagLIF) due to a small number of available diagnostic views. Here, we present a basis function-expansion approach to reconstruct MagLIF stagnation plasmas from a sparse set of x-ray emission images. A set of natural basis functions is “learned” from training volumes containing quasi-helical structures whose projections are qualitatively similar to those observed in experimental images. Tests on several known volumes demonstrate that the learned basis outperforms both a cylindrical harmonic basis and a simple voxel basis with additional regularization, according to several metrics. Two-view reconstructions with the learned basis can estimate emission volumes to within 11% and those with three views recover morphology to a high degree of accuracy. The technique is applied to experimental data, producing the first 3D reconstruction of a MagLIF stagnation column from multiple views, providing additional indications of liner instabilities imprinting onto the emitting plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Development of a Framework and Methodology for an Advanced Reactor Materials Environmental Effects Design Guide

Advanced non-light-water reactor components may operate at elevated temperature while experiencing cyclic loading, significant neutron irradiation, and exposure to reactor coolant. ASME Boiler and Pressure Vessel Code, Section III, Division 5, provides design rules for elevated-temperature service but does not include specific procedures to account for environmental effects on material properties. This report develops an initial framework and methodology for an Environmental Effects Design Guide (EEDG) focused on neutron irradiation; coolant-environment effects are reserved for future work. The proposed approach treats irradiation as a property-based overlay on the existing Division 5 design process, with two routes: a sparse-data route applying two reduction factors — FCR on creep-rupture strength and FF on fatigue life — for the creep-fatigue evaluations that typically control the design of advanced high-temperature reactor components, and a fuller framework developing the property-to-rule chain across the four Division 5 checks (primary load, strain limits and ratcheting, creep-fatigue, and buckling), together with swelling and weldments as scope items. Both routes are scoped by an in-pile qualification that restricts the use of post-irradiation-examination-derived properties in regimes where an in-pile mechanism could control the design outcome. Illustrative outputs derived on a compiled annealed Type 316 database — FCR ≈ 0.78–0.86 and FF ≈ 0.4 — demonstrate the calculation method within that specific dataset. The framework is an initial, testable design-rule concept; it identifies a practical path for preliminary design evaluations under sparse data and the material data and testing needed to develop the framework further.

Barua, Bipul (ORCID:0000000247184113)↗
DOE OSTI2019

Comparison of Mesoscale Model Setups for Offshore Wind Resource Assessment: A New Jersey Case Study

As the offshore wind energy industry begins to emerge on the U.S. northeast coast, there is an urgent need for an accurate characterization of the offshore wind resource. The offshore regime features various resource characteristics not seen onshore, including frequent coastal low-level jets, non-steady surface conditions (e.g. waves), complex air-sea and land-sea interactions, and coastal mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed. mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed.

17 WIND ENERGY↗
DOE OSTI2020

Combined Force-Frequency Sampling for Simulation of Systems Having Rugged Free Energy Landscapes.

An adaptive, machine learning-based sampling method is presented for simulation of systems having rugged, multidimensional free energy landscapes. The method's main strength resides in its ability to learn both from the frequency of visits to distinct states and the generalized force estimates that arise in a system as it evolves in phase space. This is accomplished by introducing a self-integrating artificial neural network, which generates an estimate of the free energy directly from its derivatives. The usefulness of the proposed combined approach is examined in the context of two concrete examples, namely, an alanine dipeptide molecule in water and a polymer diffusing through a narrow pore. This new method is found to be robust, faster, and more accurate than approaches that rely only on frequency-based or generalized force-based estimations. After combining the proposed approach with overfill protection and support for sparse data storage and training, the method is shown to be more effective than comparable, previously available techniques and capable of scaling efficiently to larger numbers of collective variables.

Sevgen, Emre↗
DOE OSTI2020

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Sparse thermal data for cellular automata modeling of grain structure in additive manufacturing

Grain growth in the wake of the melt pool formed during alloy-based additive manufacturing (AM) is complex and multifaceted, depending on parameters governing heat transport, fluid flow, and solidification itself. Cellular automata (CA) models have proven effective in providing computationally efficient and physically sound predictions of grain structure for several AM problems, but their efficiency is tied to the performance of heat transport models. CA models use only a small portion of the problem's temperature data (near the moving melt pool boundary), and much of the CA calculations do not affect the final result due to re-melting of material. Coupling of and communication between heat transport and solidification models, and eliminating operations irrelevant towards final grain structure prediction, will be necessary for using these methods for efficient simulation of large parts. In this work, we introduce a procedure of decoupling the CA from temperature field simulation, using files of relevant temperature data written by the heat transport model. This approach is validated against the standard coupling approach using data obtained through the computational fluid dynamics software OpenFOAM. Negligible differences are seen in grain size, volume, and texture distributions for multilayer simulation of test problems, while the quantity of temperature data for these test problems was reduced by four orders of magnitude (from 100s of GB to 10s of MB) and the code performance sped up by a factor of around 50. Furthermore, variability in microstructure as a function of cell size, substrate, time step, and nucleation parameters is studied, and it is found that cell sizes less than or equal to 1.67 μm and sufficiently small time steps yield Αstatistically equivalent microstructures. Finally, a potential use case for this CA approach—the layer-wise convergence in grain structure starting from extremes in initial grain size—is examined. This approach's ability to simulate expected trends in nucleation and epitaxial grain growth for large regions of microstructure, simulated independently of heat transport models themselves, should prove useful for investigation of various microstructure uncertainties and prediction of part-scale experimental results.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Rapid Analyses of Sparse Seismoacoustic Data Reveals the Timing and Size of the Accurate Energetic Systems Explosion

On 10 October 2025 an explosion occurred at a facility operated by Accurate Energetic Systems in Humphreys County, Tennessee. The incident resulted in 16 fatalities and created a debris field over several square kilometers. To address remaining questions about explosion timing and size, we collected about 20 seismic and 19 acoustic records of the blast from sensors up to hundreds of kilometers away. We then deployed 10 distinct physics-based, reduced order models (ROMs) that used validated geological structure and atmospheric conditions from the time of the event, along with observations of body- and surface-wave energy, as well as acoustic overpressure and phase duration. Each ROM predicted either timing, yield estimates, or both. We binned these estimates and their uncertainties according to each ROMs’ assumptions about confinement (aboveground, buried fully coupled, and buried partially coupled) and combined these estimates with other forensic data to conclude that the event occurred as a single, aboveground explosion on 10 December 2025 12:47:50.8 ±0.1 s with a yield equivalent to 11.8 [2.3,16.5] tons of Trinitrotoluene. Our estimates align with the Bureau of Alcohol, Tobacco, Firearms and Explosives inventory reports of 11–13 tons. This multimethod approach demonstrates the use of remotely observed geophysical data to rapidly aid conventional forensic investigations of accidental explosions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2022

Zero-Truncated Poisson Tensor Decomposition for Sparse Count Data

We propose a novel statistical inference paradigm for zero-inflated multiway count data that dispenses with the need to distinguish between true and false zero counts. Our approach ignores all zero entries and applies zero-truncated Poisson regression on the positive counts. Inference is accomplished via tensor completion that imposes low-rank structure on the Poisson parameter space. Our main result shows that an $\textit{N}$-way rank-R parametric tensor 𝓜 ϵ (0, ∞) $I$Χ∙∙∙Χ$I$ generating Poisson observations can be accurately estimated from approximately $IR^2 \text{log}^2_2(I)$ non-zero counts for a nonnegative canonical polyadic decomposition. Several numerical experiments are presented demonstrating that our zero-truncated paradigm is comparable to the ideal scenario where the locations of false zero counts are known $\textit{a priori}$.

97 MATHEMATICS AND COMPUTING↗