Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Computational Information Criterion for Particle-Tracking with Sparse or Noisy Data

Traditional probabilistic methods for the simulation of advection-diffusion equations (ADEs) often overlook the entropic contribution of the discretization, e.g., the number of particles, within associated numerical methods. Many times, the gain in accuracy of a highly discretized numerical model is outweighed by its associated computational costs or the noise within the data. Herein, we address the question of how many particles are needed in a simulation to best approximate and estimate parameters in one-dimensional advective-diffusive transport. To do so, we use the well-known Akaike Information Criterion (AIC) and a recently-developed correction called the Computational Information Criterion (COMIC) to guide the model selection process. Random-walk and mass-transfer particle tracking methods are employed to solve the model equations at various levels of discretization. Numerical results demonstrate that the COMIC provides an optimal number of particles that can describe a more efficient model in terms of parameter estimation and model prediction compared to the model selected by the AIC even when the data is sparse or noisy, the sampling volume is not uniform throughout the physical domain, or the error distribution of the data is non-IID Gaussian.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Identification of RR Lyrae stars in multiband, sparsely-sampled data from the Dark Energy Survey using template fitting and Random Forest classification

Many studies have shown that RR Lyrae variable stars (RRL) are powerful stellar tracers of Galactic halo structure and satellite galaxies. The Dark Energy Survey (DES), with its deep and wide coverage (g ~ 23.5 mag in a single exposure; over 5000 deg2) provides a rich opportunity to search for substructures out to the edge of the Milky Way halo. However, the sparse and unevenly sampled multiband light curves from the DES wide-field survey (a median of four observations in each of grizY over the first three years) pose a challenge for traditional techniques used to detect RRL. We present an empirically motivated and computationally efficient template-fitting method to identify these variable stars using three years of DES data. When tested on DES light curves of previously classified objects in SDSS stripe 82, our algorithm recovers 89% of RRL periods to within 1% of their true value with 85% purity and 76% completeness. Using this method, we identify 5783 RRL candidates, ~28% of which are previously undiscovered. This method will be useful for identifying RRL in other sparse multiband data sets.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Emulation Modeling for Development of Cyber-Defense Capabilities for Satellite Systems

The objective of this project was to develop a novel capability to generate synthetic data sets for the purpose of training Machine Learning (ML) algorithms for the detection of malicious activities on satellite systems. The approach experimented with was to a) generate sparse data sets using emulation modeling and b) enlarge the sparse data using Generative Adversarial Networks (GANs). We based our emulation modeling on the Open Source NASA Operational Simulator for Small Satellites (NOS3) developed by the Katherine Johnson Independent Verification and Validation (IV&V) program in West Virginia. Significant new capabilities on NOS3 had to be developed for our data set generation needs. To expand these data sets for the purpose of training ML, we experimented with a) Extreme Learning Machines (ELMs) and b) Wasserstein-GANs (WGAN-GP).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2025

A DATA EFFICIENT SPARSE MODELING FRAMEWORK FOR POWER ESTIMATION IN WATER TREATMENT SENSING OPERATIONS

With increasing freshwater scarcity, advanced process design mechanisms such as Closed-Circuit Reverse Osmosis (CCRO) and Digital/Physical Twin systems are gaining traction in water treatment and reuse operations. While digital and physical twin models enable improved system insight and control, their development is often expensive and computationally intensive, requiring large volumes of synthetic or experimental data to characterize underlying process dynamics. This work introduces a sparse surrogate modeling framework to estimate power consumption from measured flow and pressure variables, along with their nonlinear polynomial and interaction expansions. To ensure model reliability and reduce overfitting, a two-stage pipeline is proposed. First, a dynamic data filtering algorithm is employed to remove uninformative observations and transient operational states. Second, a sparse penalized regression technique is applied to select a minimal set of parsimonious features. The proposed model achieves high sparsity, retaining only 7 out of 34 candidate features (≈79.41% sparsity) while delivering a root mean square error (RMSE) of 0.072 on the test dataset.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2019

Bayesian Assimilation of Multiscale Precipitation Data and Sparse Ground Gauge Observations in Mountainous Areas

Estimating the spatial distribution of precipitation is important for understanding ecohydrological processes at catchment scales. However, this estimation is difficult in mountainous areas because ground-based observation stations are often sparsely located and do not represent the spatial variability of precipitation. In this study, we develop a Bayesian assimilation method based on data collected on the Tibetan Plateau from 1980 to 2014 to estimate monthly and daily precipitation. To accomplish this, point-scale ground meteorological observations are combined with large-scale precipitation data such as satellite observations or reanalysis data. First, we remove the terrain effects from ground observations by fitting the precipitation data as functions of elevation, and then we spatially interpolate the residuals to 5-km-resolution grids to obtain monthly and daily precipitation. Additionally, we use Tropical Rainfall Measuring Mission (TRMM) satellite observations and ERA-Interim reanalysis data. Cross-validation methods are used to evaluate our method; the results show that our method not only captures the change in precipitation with terrain but also significantly reduces the associated uncertainty. The improvements are more evident in the main river source areas on the edge of the Tibetan Plateau, where elevation changes dramatically, and in high-altitude areas, where the ground gauges are sparse compared with those in low-altitude areas. Our assimilation method is applicable to other regions and is particularly useful for mountainous watersheds where ground meteorological stations are sparse and precipitation is considerably influenced by terrain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Fast Scanning Probe Microscopy via Machine Learning: Non-Rectangular Scans with Compressed Sensing and Gaussian Process Optimization

Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, a factor of 5.8 reduction in data collection using a combination of sparse spiral scanning with compressive sensing and Gaussian process regression reconstruction is demonstrated. It is found that even extremely sparse spiral scans offer strong reconstructions with less than 6% error for Gaussian process regression reconstructions. Further, the error associated with each reconstructive technique per reconstruction iteration is analyzed, finding the error is similar past ≈15 iterations, while at initial iterations Gaussian process regression outperforms compressive sensing. Finally, this study highlights the capabilities of reconstruction techniques when applied to sparse data, particularly sparse spiral PFM scans, with broad applications in scanning probe and electron microscopies.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Data for A Hybrid Biophysical-Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81–0.94) and H (R2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

AI/ML↗
DOE OSTI2024

Three-dimensional reconstruction of x-ray emission volumes in magnetized liner inertial fusion from sparse projection data using a learned basis

The ability to visualize x-ray and neutron emission from fusion plasmas in 3D is critical to understand the origin of the complex shapes of the plasmas in experiments. Unfortunately, this remains challenging in experiments that study a fusion concept known as Magnetized Liner Inertial Fusion (MagLIF) due to a small number of available diagnostic views. Here, we present a basis function-expansion approach to reconstruct MagLIF stagnation plasmas from a sparse set of x-ray emission images. A set of natural basis functions is “learned” from training volumes containing quasi-helical structures whose projections are qualitatively similar to those observed in experimental images. Tests on several known volumes demonstrate that the learned basis outperforms both a cylindrical harmonic basis and a simple voxel basis with additional regularization, according to several metrics. Two-view reconstructions with the learned basis can estimate emission volumes to within 11% and those with three views recover morphology to a high degree of accuracy. The technique is applied to experimental data, producing the first 3D reconstruction of a MagLIF stagnation column from multiple views, providing additional indications of liner instabilities imprinting onto the emitting plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Development of a Framework and Methodology for an Advanced Reactor Materials Environmental Effects Design Guide

Advanced non-light-water reactor components may operate at elevated temperature while experiencing cyclic loading, significant neutron irradiation, and exposure to reactor coolant. ASME Boiler and Pressure Vessel Code, Section III, Division 5, provides design rules for elevated-temperature service but does not include specific procedures to account for environmental effects on material properties. This report develops an initial framework and methodology for an Environmental Effects Design Guide (EEDG) focused on neutron irradiation; coolant-environment effects are reserved for future work. The proposed approach treats irradiation as a property-based overlay on the existing Division 5 design process, with two routes: a sparse-data route applying two reduction factors — FCR on creep-rupture strength and FF on fatigue life — for the creep-fatigue evaluations that typically control the design of advanced high-temperature reactor components, and a fuller framework developing the property-to-rule chain across the four Division 5 checks (primary load, strain limits and ratcheting, creep-fatigue, and buckling), together with swelling and weldments as scope items. Both routes are scoped by an in-pile qualification that restricts the use of post-irradiation-examination-derived properties in regimes where an in-pile mechanism could control the design outcome. Illustrative outputs derived on a compiled annealed Type 316 database — FCR ≈ 0.78–0.86 and FF ≈ 0.4 — demonstrate the calculation method within that specific dataset. The framework is an initial, testable design-rule concept; it identifies a practical path for preliminary design evaluations under sparse data and the material data and testing needed to develop the framework further.

Barua, Bipul (ORCID:0000000247184113)↗
DOE OSTI2019

Comparison of Mesoscale Model Setups for Offshore Wind Resource Assessment: A New Jersey Case Study

As the offshore wind energy industry begins to emerge on the U.S. northeast coast, there is an urgent need for an accurate characterization of the offshore wind resource. The offshore regime features various resource characteristics not seen onshore, including frequent coastal low-level jets, non-steady surface conditions (e.g. waves), complex air-sea and land-sea interactions, and coastal mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed. mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed.

17 WIND ENERGY↗
DOE OSTI2020

Combined Force-Frequency Sampling for Simulation of Systems Having Rugged Free Energy Landscapes.

An adaptive, machine learning-based sampling method is presented for simulation of systems having rugged, multidimensional free energy landscapes. The method's main strength resides in its ability to learn both from the frequency of visits to distinct states and the generalized force estimates that arise in a system as it evolves in phase space. This is accomplished by introducing a self-integrating artificial neural network, which generates an estimate of the free energy directly from its derivatives. The usefulness of the proposed combined approach is examined in the context of two concrete examples, namely, an alanine dipeptide molecule in water and a polymer diffusing through a narrow pore. This new method is found to be robust, faster, and more accurate than approaches that rely only on frequency-based or generalized force-based estimations. After combining the proposed approach with overfill protection and support for sparse data storage and training, the method is shown to be more effective than comparable, previously available techniques and capable of scaling efficiently to larger numbers of collective variables.

Sevgen, Emre↗
DOE OSTI2020

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Sparse thermal data for cellular automata modeling of grain structure in additive manufacturing

Grain growth in the wake of the melt pool formed during alloy-based additive manufacturing (AM) is complex and multifaceted, depending on parameters governing heat transport, fluid flow, and solidification itself. Cellular automata (CA) models have proven effective in providing computationally efficient and physically sound predictions of grain structure for several AM problems, but their efficiency is tied to the performance of heat transport models. CA models use only a small portion of the problem's temperature data (near the moving melt pool boundary), and much of the CA calculations do not affect the final result due to re-melting of material. Coupling of and communication between heat transport and solidification models, and eliminating operations irrelevant towards final grain structure prediction, will be necessary for using these methods for efficient simulation of large parts. In this work, we introduce a procedure of decoupling the CA from temperature field simulation, using files of relevant temperature data written by the heat transport model. This approach is validated against the standard coupling approach using data obtained through the computational fluid dynamics software OpenFOAM. Negligible differences are seen in grain size, volume, and texture distributions for multilayer simulation of test problems, while the quantity of temperature data for these test problems was reduced by four orders of magnitude (from 100s of GB to 10s of MB) and the code performance sped up by a factor of around 50. Furthermore, variability in microstructure as a function of cell size, substrate, time step, and nucleation parameters is studied, and it is found that cell sizes less than or equal to 1.67 μm and sufficiently small time steps yield Αstatistically equivalent microstructures. Finally, a potential use case for this CA approach—the layer-wise convergence in grain structure starting from extremes in initial grain size—is examined. This approach's ability to simulate expected trends in nucleation and epitaxial grain growth for large regions of microstructure, simulated independently of heat transport models themselves, should prove useful for investigation of various microstructure uncertainties and prediction of part-scale experimental results.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Rapid Analyses of Sparse Seismoacoustic Data Reveals the Timing and Size of the Accurate Energetic Systems Explosion

On 10 October 2025 an explosion occurred at a facility operated by Accurate Energetic Systems in Humphreys County, Tennessee. The incident resulted in 16 fatalities and created a debris field over several square kilometers. To address remaining questions about explosion timing and size, we collected about 20 seismic and 19 acoustic records of the blast from sensors up to hundreds of kilometers away. We then deployed 10 distinct physics-based, reduced order models (ROMs) that used validated geological structure and atmospheric conditions from the time of the event, along with observations of body- and surface-wave energy, as well as acoustic overpressure and phase duration. Each ROM predicted either timing, yield estimates, or both. We binned these estimates and their uncertainties according to each ROMs’ assumptions about confinement (aboveground, buried fully coupled, and buried partially coupled) and combined these estimates with other forensic data to conclude that the event occurred as a single, aboveground explosion on 10 December 2025 12:47:50.8 ±0.1 s with a yield equivalent to 11.8 [2.3,16.5] tons of Trinitrotoluene. Our estimates align with the Bureau of Alcohol, Tobacco, Firearms and Explosives inventory reports of 11–13 tons. This multimethod approach demonstrates the use of remotely observed geophysical data to rapidly aid conventional forensic investigations of accidental explosions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2022

Zero-Truncated Poisson Tensor Decomposition for Sparse Count Data

We propose a novel statistical inference paradigm for zero-inflated multiway count data that dispenses with the need to distinguish between true and false zero counts. Our approach ignores all zero entries and applies zero-truncated Poisson regression on the positive counts. Inference is accomplished via tensor completion that imposes low-rank structure on the Poisson parameter space. Our main result shows that an $\textit{N}$-way rank-R parametric tensor 𝓜 ϵ (0, ∞) $I$Χ∙∙∙Χ$I$ generating Poisson observations can be accurately estimated from approximately $IR^2 \text{log}^2_2(I)$ non-zero counts for a nonnegative canonical polyadic decomposition. Several numerical experiments are presented demonstrating that our zero-truncated paradigm is comparable to the ideal scenario where the locations of false zero counts are known $\textit{a priori}$.

97 MATHEMATICS AND COMPUTING↗