Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

High-performance equation solvers and their impact on finite element analysis

The role of equation solvers in modern structural analysis software is described. Direct and iterative equation solvers which exploit vectorization on modern high-performance computer systems are described and compared. The direct solvers are two Cholesky factorization methods. The first method utilizes a novel variable-band data storage format to achieve very high computation rates and the second method uses a sparse data storage format designed to reduce the number od operations. The iterative solvers are preconditioned conjugate gradient methods. Two different preconditioners are included; the first uses a diagonal matrix storage scheme to achieve high computation rates and the second requires a sparse data storage scheme and converges to the solution in fewer iterations that the first. The impact of using all of the equation solvers in a common structural analysis software system is demonstrated by solving several representative structural analysis problems.

Poole, Eugene L.↗
DOE OSTI2025

A DATA EFFICIENT SPARSE MODELING FRAMEWORK FOR POWER ESTIMATION IN WATER TREATMENT SENSING OPERATIONS

With increasing freshwater scarcity, advanced process design mechanisms such as Closed-Circuit Reverse Osmosis (CCRO) and Digital/Physical Twin systems are gaining traction in water treatment and reuse operations. While digital and physical twin models enable improved system insight and control, their development is often expensive and computationally intensive, requiring large volumes of synthetic or experimental data to characterize underlying process dynamics. This work introduces a sparse surrogate modeling framework to estimate power consumption from measured flow and pressure variables, along with their nonlinear polynomial and interaction expansions. To ensure model reliability and reduce overfitting, a two-stage pipeline is proposed. First, a dynamic data filtering algorithm is employed to remove uninformative observations and transient operational states. Second, a sparse penalized regression technique is applied to select a minimal set of parsimonious features. The proposed model achieves high sparsity, retaining only 7 out of 34 candidate features (≈79.41% sparsity) while delivering a root mean square error (RMSE) of 0.072 on the test dataset.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
NASA NTRS2010

A Comprehensive Validation Methodology for Sparse Experimental Data

A comprehensive program of verification and validation has been undertaken to assess the applicability of models to space radiation shielding applications and to track progress as models are developed over time. The models are placed under configuration control, and automated validation tests are used so that comparisons can readily be made as models are improved. Though direct comparisons between theoretical results and experimental data are desired for validation purposes, such comparisons are not always possible due to lack of data. In this work, two uncertainty metrics are introduced that are suitable for validating theoretical models against sparse experimental databases. The nuclear physics models, NUCFRG2 and QMSFRG, are compared to an experimental database consisting of over 3600 experimental cross sections to demonstrate the applicability of the metrics. A cumulative uncertainty metric is applied to the question of overall model accuracy, while a metric based on the median uncertainty is used to analyze the models from the perspective of model development by analyzing subsets of the model parameter space.

Norman, Ryan B.↗
NASA NTRS2019

A Global Assessment of Added Value in the SMAP Level-4 Soil Moisture Product Relative to Its Baseline Land Surface Model

The Soil Moisture Active Passive (SMAP) Level-4 product provides enhanced soil moisture estimates by assimilating SMAP brightness temperature observations into a land surface model. Here, an unbiased qualitative estimate of the relative skill of SMAP Level-4 and model-only surface soil moisture (versus true soil moisture) is derived using only one additional noisy (but independent) soil moisture product. The method is applied globally and verified using high-quality, ground-based measurements where available. Results demonstrate that assimilating SMAP brightness temperature has relatively little impact in data-rich areas like the United States and Europe. In contrast, much larger improvement is observed in data-sparse regions, including much of Africa and central Australia, where model-only simulations are disproportionately impacted by low-quality model forcing. Therefore, ground validation conducted in data-rich areas does not adequately sample the added value of SMAP data assimilation for data-sparse regions and substantially underestimates the added skill provided by the SMAP Level-4 system.

SMAP L4↗
NASA NTRS2022

Design of Materials with Alchemite

Machine learning models that establish the relationships between materials processing and properties can enable inverse design of materials through active learning. Alchemite is a commercial software that can perform inverse materials design on sparse data. Here we evaluate Alchemite’s performance on a dataset of shape memory alloys and a dataset of heat exchangers compared to baseline random forest models. Alchemite had higher accuracy when making predictions on sparse data and was more accurate or nearly as accurate as random forests on complete datasets while also quantifying uncertainty. The software was also used to suggest processing steps and design parameters to optimize properties and performance; however, physical validation of the suggested design parameters was beyond the scope of this work. Several useful design insights were gained about the impact of the design parameters on properties and performance including the importance of dopant choice and amount for shape memory alloys and the importance of height and weight on the thermal resistance of heat exchangers.

Machine learning↗
DOE OSTI2026

Data for A Hybrid Biophysical-Machine Learning Framework for Diurnal Surface Energy Flux Estimation Using Proximal Sensing

Thermal infrared-based remote sensing of surface energy fluxes has traditionally relied on high spatial resolution satellite data with revisit frequencies on the order of weeks. In this study, we evaluate a biophysics-based analytical surface energy balance model for predicting latent energy (LE) and sensible heat (H) fluxes using proximal sensing observations. The Surface Temperature Initiated Closure (STIC1.2) model has been extensively validated across a wide range of spatial and temporal scales using various satellite-derived thermal infrared data sets. Here we extend this validation by applying STIC at sub-hourly temporal resolution over multiple growing seasons for four distinct agricultural systems. We further develop and evaluate novel STIC variants that incorporate machine learning (ML) techniques to eliminate the need for surface energy balance observations, specifically net radiation and soil heat flux, thereby enhancing model applicability in data-sparse settings. The integration of a ML component to estimate surface available energy is shown to have strong predictive performance for both LE (R2 = 0.81–0.94) and H (R2 = 0.46–0.72) across all agricultural systems examined here, demonstrating the potential of hybrid biophysical-machine learning approaches for surface energy balance modeling with minimal data requirements. This study concludes with a novel application of explainable machine learning (exML) to diagnose sources of model error. This exML framework attributes residual prediction errors to both model input variables and environmental drivers not explicitly included in the simulation experiments. This approach provides a new pathway for improving model design and integrating previously overlooked yet influential variables into future model iterations.

AI/ML↗
DOE OSTI2026

Development of a Framework and Methodology for an Advanced Reactor Materials Environmental Effects Design Guide

Advanced non-light-water reactor components may operate at elevated temperature while experiencing cyclic loading, significant neutron irradiation, and exposure to reactor coolant. ASME Boiler and Pressure Vessel Code, Section III, Division 5, provides design rules for elevated-temperature service but does not include specific procedures to account for environmental effects on material properties. This report develops an initial framework and methodology for an Environmental Effects Design Guide (EEDG) focused on neutron irradiation; coolant-environment effects are reserved for future work. The proposed approach treats irradiation as a property-based overlay on the existing Division 5 design process, with two routes: a sparse-data route applying two reduction factors — FCR on creep-rupture strength and FF on fatigue life — for the creep-fatigue evaluations that typically control the design of advanced high-temperature reactor components, and a fuller framework developing the property-to-rule chain across the four Division 5 checks (primary load, strain limits and ratcheting, creep-fatigue, and buckling), together with swelling and weldments as scope items. Both routes are scoped by an in-pile qualification that restricts the use of post-irradiation-examination-derived properties in regimes where an in-pile mechanism could control the design outcome. Illustrative outputs derived on a compiled annealed Type 316 database — FCR ≈ 0.78–0.86 and FF ≈ 0.4 — demonstrate the calculation method within that specific dataset. The framework is an initial, testable design-rule concept; it identifies a practical path for preliminary design evaluations under sparse data and the material data and testing needed to develop the framework further.

Barua, Bipul (ORCID:0000000247184113)↗
DOE OSTI2026

Rapid Analyses of Sparse Seismoacoustic Data Reveals the Timing and Size of the Accurate Energetic Systems Explosion

On 10 October 2025 an explosion occurred at a facility operated by Accurate Energetic Systems in Humphreys County, Tennessee. The incident resulted in 16 fatalities and created a debris field over several square kilometers. To address remaining questions about explosion timing and size, we collected about 20 seismic and 19 acoustic records of the blast from sensors up to hundreds of kilometers away. We then deployed 10 distinct physics-based, reduced order models (ROMs) that used validated geological structure and atmospheric conditions from the time of the event, along with observations of body- and surface-wave energy, as well as acoustic overpressure and phase duration. Each ROM predicted either timing, yield estimates, or both. We binned these estimates and their uncertainties according to each ROMs’ assumptions about confinement (aboveground, buried fully coupled, and buried partially coupled) and combined these estimates with other forensic data to conclude that the event occurred as a single, aboveground explosion on 10 December 2025 12:47:50.8 ±0.1 s with a yield equivalent to 11.8 [2.3,16.5] tons of Trinitrotoluene. Our estimates align with the Bureau of Alcohol, Tobacco, Firearms and Explosives inventory reports of 11–13 tons. This multimethod approach demonstrates the use of remotely observed geophysical data to rapidly aid conventional forensic investigations of accidental explosions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
NASA NTRS1981

Preliminary results of an assessment of FGGE 'special effort' data and its impact on GLAS model analyses and forecasts

Attempts to improve the handling of satellite temperature and cloud-derived data during the FGGE experiment are compared with results gained during the trials. The satellite data were edited by assigning quality indicators to temperature soundings by means of the IR TV camera on the Tiros-N spacecraft, and to cloud-tracked wind data from GEO satellites. The data quality were assayed on the basis of horizontal, vertical, and temporal consistency of observed synoptic conditions. The data interpreter-operator retrieved all available data for an area, determined which regions were data-sparse, then used data-rich areas nearby to supply smoothed gradients into the zones with insufficient data. Results are presented for measurements taken during Jan.-Feb., and May 1979 over Alaska. It was found that enhanced and operational IR soundings were mostly equivalent. Some improvements were implemented in the 1000-300 mb layer thickness and intensification of atmospheric thermal gradients. Interactive processing was concluded to be an aid to processing Tiros-N data. The data-improvements treatment was found to significantly modify large scale analyses.

Atlas, R.↗
NASA NTRS2008

Orbit Determination During Spacecraft Emergencies with Sparse Tracking Data - THEMIS and TDRS-3 Lessons Learned

This paper provides an overview of the lessons learned from the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center s (GSFC) Flight Dynamics Facility s (FDF) support of the Time History of Events and Macroscale Interactions during Substorms (THEMIS) spacecraft emergency in February 2007, and the Tracking and Data Relay Satellite-3 (TDRS-3) spacecraft emergency in March 2006. A successful and timely recovery from both of these spacecraft emergencies depended on accurate knowledge of the orbit. Unfortunately, the combination of each spacecraft emergency with very little tracking data contributed to difficulties in estimating and predicting the orbit and delayed recovery efforts in both cases. In both the THEMIS and TDRS-3 spacecraft emergencies, numerous factors contributed to problems with obtaining nominal tracking data measurements. This paper details the various causative factors and challenges. This paper further enumerates lessons learned from FDF s recovery efforts involving the THEMIS and TDRS-3 spacecraft emergencies and scant tracking data, as well as recommendations for improvements and corrective actions. In addition, this paper describes the broad range of resources and complex navigation methods employed within the FDF for supporting critical navigation activities during all mission phases, including launch, early orbit, and on-orbit operations.

Morinelli, Patrick J.↗
NASA NTRS1985

Development of the variational SEASAT data analysis technique

Surface winds are closely associated with the surface pressure gradient. The variational SEASAT data analysis technique was designed to improve the sea level pressure analysis in the data sparse areas. The SEASAT-derived surface wind data were compared with observations from the Joint Air Sea Interaction Experiment (JASIN) and it was found that the satellite-derived sea surface wind has an accuracy of up to + or - 2 m/s in speed and + or - 20 deg in direction. These numbers are considered characteristic of the retrieved SEASAT wind field. By combining the densely spaced SEASAT-derived wind data with the sparsely distributed sea-level pressure observation via a variational adjustment technique subject to some appropriate physical constraint(s), an improvement in the sea-level pressure analysis is expected. It is demonstrated that a simple marine boundary layer scheme in conjunction with a variational adjustment technique can be developed to help improve the sea-level pressure analysis by the SEASAT-derived wind of a limited-area domain in the ocean.

Sasaki, Y. K.↗
DOE OSTI2026

Bayesian Physics Informed Spatio-Temporal Network for Streamflow Data Imputation

Reliable reconstruction of incomplete streamflow records is critical for improving hydrological forecasting, flood preparedness, and water resource management. However, large observational gaps and uncertainties in governing physical parameters limit the accuracy of traditional statistical and machinelearning imputation frameworks. To address these challenges, we develop a Bayesian Physics-Informed Spatio-Temporal Network (BPI-STNet) that jointly captures spatial and temporal dependencies while enforcing hydrologic consistency through embedded physical constraints. The framework integrates a GraphSAGE-LSTM architecture to model spatial connectivity across gauges and temporal flow dynamics, coupled with a Bayesian update mechanism to estimate uncertain parameters in a simplified water-balance framework. Unlike conventional physics-informed networks that rely on sampling-based posterior estimation, BPI-STNet derives an analytic solution to the inverse problem, allowing closed-form Bayesian updates of uncertain parameters Λ={α,β,k} using Gaussian priors and likelihoods. Applied to daily observations from the Susquehanna River Basin (1980-2022), BPI-STNet achieves substantial improvements over a purely data-driven RGNN baseline, which reduced RMSE by 23 % and MAE by 9 %, and achieving an average NSE values up to 0.96. The results demonstrate that coupling Bayesian inference with physics-informed learning yields physically consistent, uncertainty-aware reconstructions that preserve the temporal persistence and statistical distribution of observed flows. The proposed framework establishes a generalizable paradigm for data-sparse hydrologic systems where both data fidelity and physical interpretability are essential.

Krishnan Kutty Ambika, Anukesh [ORNL] (ORCID:00000↗
DOE OSTI2026

ECLEIRS: Exact conservation law embedded identification of reduced states for parameterized nonlinear conservation laws from sparse and noisy data

Multi-query applications such as parameter estimation, uncertainty quantification and design optimization for parameterized partial differential equation (PDE) systems are expensive. While reduced/latent state dynamics approaches for parameterized PDEs offer a viable alternative, these approaches rely on high-quality data and struggle with highly sparse spatiotemporal noisy measurements typically obtained from experiments. Furthermore, there is no guarantee that these models satisfy governing physical conservation laws. In this article, we propose a reduced state dynamics approach, referred to as ECLEIRS, that embeds exact conservation in the solution and flux representation by utilizing a space-time divergence-free neural network formulation. We compare ECLEIRS with other reduced state dynamics approaches, those that do not enforce any physical constraints and those with physics-informed loss functions, for three shock-propagation problems: 1-D advection, 1-D Burgers and 2-D Euler equations. In conclusion, the numerical experiments conducted in this study demonstrate that ECLEIRS provides the most accurate prediction of dynamics for unseen parameters even in the presence of highly sparse and noisy data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1986

Development of a variational SEASAT data analysis technique

Oceans are data-sparse areas in terms of conventional weather observations. The surface pressure field obtained solely by analyzing the conventional weather data is not expected to possess high accuracy. On the other hand, in entering asynoptic data such as satellite-derived temperature soundings into an atmospheric prediction system, an improved surface analysis is crucial for obtaining more accurate weather predictions because the mass distribution of the entire atmosphere will be better represented in the system as a result of the more accurate surface pressure field. In order to obtain improved surface pressure analyses over the oceans, a variational adjustment technique was developed to help blend the densely distributed surface wind data derived from the SEASAT-A radar observations into the sparsely distributed conventional pressure data. A simple marine boundary layer scheme employed in the adjustment technique was discussed. In addition, a few aspects of the current technique were determined by numerical experiments.

Sasaki, Y. K.↗
NASA NTRS2020

Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS) and Other Assimilated Hydrological Data at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides science support for several data sets relevant to agriculture and food security, including the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS), or FLDAS data set. The GES DISC is one of twelve NASA Earth Observing System (EOS) data centers that process, archive, document, and distribute data from Earth science missions and related projects. The GES DISC hosts a wide range of remote sensing and model data, and provides reliable and robust data access and other services to users worldwide. Beyond data archive and access, the GES DISC offers many services to visualize and analyze the data. This presentation provides a summary of the hydrological data available at the GES DISC, along with an overview of related data services. Specifically, the FLDAS data set has been adapted to work with domains, data streams, and monitoring and forecast requirements associated with food security assessment in data-sparse, developing country settings. The FLDAS global monthly data have a 0.1 x 0.1 degree spatial resolution covering the period from January 1982 to present. Global FLDAS monthly anomaly and monthly climatology data are also available at the GES DISC to evaluate how current conditions compare to averages over the FLDAS 35-year period. Several case studies using the FLDAS soil moisture, evapotranspiration, rainfall, runoff, and surface temperature data will be presented.

Loeser, Carlee↗
NASA NTRS2020

A Brief Assessment of the Impact of Nearly 40 Years of Assimilated Observations Over the Amazon Basin

Adding a Forecast Sensitivity-based Observation Impact component to Version 2 of the Modern Era Retrospective-analysis for Research and Applications, the present study provides an assessment of the impact of nearly 40 years of observations on short-range (24-hr) forecasts over the Amazon basin. Under self-verification, forecast errors are found to slightly increase from the early data-sparse days to the more recent years, when data dramatically increase. Throughout the reanalysis, satellite radiances dominate in volume, but only before 1999 they dominate the impacts. Beyond 1999, over 50% of forecast error reduction is associated with conventional observations (radiosondes). Atmospheric Motion Vectors are also found to be large contributors to error reduction, but their contribution reduces in dry periods. In opposition to Atmospheric Motion Vectors, satellite radiances tend to contribute more in the dry season. Results provide motivation for additional conventional observations and the use of all-sky treatment of radiances.

F. L. R. Diniz↗
DOE OSTI2026

Quantum block encoding for one-pair semiseparable matrices

Quantum block encoding (QBE) is a crucial step in the development of most quantum algorithms, as it provides an embedding of a given matrix into a suitable larger unitary matrix. Historically, the development of efficient techniques for QBE has mostly focused on sparse matrices; less effort has been devoted to data-sparse (e.g., rank-structured) matrices. In this work we examine a particular case of rank structure, namely, one-pair semiseparable matrices. We present a new block encoding approach that relies on a suitable factorization of the given matrix as the product of triangular and diagonal factors. To encode the matrix, the algorithm needs $2\log(N)+7$ ancillary qubits. Assuming that the data input oracles can be implemented with polylogarithmic depth, or that a QRAM input model is available, our proposed method requires $\mathcal{O}({\rm polylog} (N))$ time and has an error of $\mathcal{O}(N^2)$, where $N$ is the matrix size.

Antonioli, Giacomo [Pisa U.; CERN] (ORCID:00090000↗