Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Operator inference with roll outs for learning reduced models from scarce and low-quality data

Data-driven modeling has become a key building block in computational science and engineering. However, data that are available in science and engineering are typically scarce, often polluted with noise and affected by measurement errors and other perturbations, which makes learning the dynamics of systems challenging. Here, in this work, we propose to combine data-driven modeling via operator inference with the dynamic training via roll outs of neural ordinary differential equations. Operator inference with roll outs inherits interpretability, scalability, and structure preservation of traditional operator inference while leveraging the dynamic training via roll outs over multiple time steps to increase stability and robustness for learning from low-quality and noisy data. Numerical experiments with data describing shallow water waves and surface quasi-geostrophic dynamics demonstrate that operator inference with roll outs provides predictive models from training trajectories even if data are sampled sparsely in time and polluted with noise of up to 10%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference

Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). Here, this work focuses on the large class of physical systems that can be well described by models with quadratic and cubic nonlinear terms and proposes a regularizer for operator inference that induces a stability bias onto learned models. The proposed regularizer is physics informed in the sense that it penalizes higher-order terms with large norms and so explicitly leverages the polynomial model form that is given by the underlying physics. This means that the proposed approach judiciously learns from data and physical insights combined, rather than from either data or physics alone. Additionally, a formulation of operator inference is proposed that enforces model constraints for preserving structure such as symmetry and definiteness in linear terms. Numerical results demonstrate that models learned with operator inference and the proposed regularizer and structure preservation are accurate and stable even in cases where using no regularization and Tikhonov regularization leads to models that are unstable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Sparse Deep Neural Network Inference using different Programming Models

Sparse deep neural networks have gained increasing attention recently in achieving speedups on inference with reduced memory footprints. However, the real-world applications are little shown with specialized optimizations, yet a wide variety of DNN tasks remain dense without exploiting the advantages of sparsity in networks. Recent work presented by MIT/IEEE/Amazon GraphChallenge has demonstrated significant speedups and various techniques. Still, we find that there is limited investigation of the impact of various Python and C\slash C++ based programming models to explore new opportunities in general cases. In this work, we provide performance evaluation through different programming models using CuPy, cuSPARSE, and OpenMP to discuss the advantages and disadvantages of our sparse implementations on single-GPU and multiple GPUs of NVIDIA DGX-A100 40GB/80GB platforms.

machine learning, HPC↗
DOE OSTI2020

Linear two-pool models are insufficient to infer soil organic matter decomposition temperature sensitivity from incubations

Abstract Terrestrial carbon (C)-climate feedbacks depend strongly on how soil organic matter (SOM) decomposition responds to temperature. This dependency is often represented in land models by the parameter Q 10 , which quantifies the relative increase of microbial soil respiration per 10 °C temperature increase. Many studies have conducted paired laboratory soil incubations and inferred “active” and “slow” pool Q 10 values by fitting linear two-pool models to measured respiration time series. Using a recently published incubation study (Qin et al. in Sci Adv 5(7):eaau1218, 2019) as an example, here we first show that the very high parametric equifinality of the linear two-pool models may render such incubation-based Q 10 estimates unreliable. In particular, we show that, accompanied by the uncertain initial active pool size, the slow pool Q 10 can span a very wide range, including values as high as 100, although all parameter combinations are producing almost equally good model fit with respect to the observations. This result is robust whether or not interactions between the active and slow pools are considered (typically these interactions are not considered when interpreting incubation data, but are part of the predictive soil carbon models). This very large parametric equifinality in the context of interpreting incubation data is consistent with the poor temporal extrapolation capability of linear multi-pool models identified in recent studies. Next, using a microbe-explicit SOM model (RESOM), we show that the inferred two pools and their associated parameters (e.g., Q 10 ) could be artificial constructs and are therefore unreliable concepts for integration into predictive models. We finally discuss uncertainties in applying linear two-pool (or more generally multiple-pool) models to estimate SOM decomposition parameters such as temperature sensitivities from laboratory incubations. We also propose new observations and model structures that could enable better process understanding and more robust predictive capabilities of soil carbon dynamics.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1991

Mantle viscosity - A comparison of models from postglacial rebound and from the geoid, plate driving forces, and advected heat flux

Models of the radial variation of effective viscosity inferred from the earth's response to surface loads associated with Pleistocene deglaciation are compared to structures inferred from models of geodynamic phenomena associated with convection: the geoid, plate-driving forces, and advected heat flux. While observations of the earth's response to surface loads do not have sufficient resolution to justify more than two viscous layers, adequately matching the observed long-wavelength geoid anomalies associated with density contrasts in the lower mantle (inferred from seismic tomography) and in the upper mantle (inferred from a model of subducted slabs) requires more structure. It is possible to explain the geoid, observed plate velocities, the advected heat flux in the lower mantle, and relative sea-level variations in oceanic regions, all with a mantle with a high-viscosity/elastic lid, an asthenospheric channel of 2 x 10 exp 19 Pa s from 100 to 400-km depth, a 6 x 10 exp 20 Pa s transition zone, and a lower mantle of 6 x 10 exp 21 Pa s. The uplift history of Australia, Fennoscandia, and Laurentia can be explained with an asthenospheric viscosity less than a factor of 10 higher. Lateral variations in lower mantle viscosity are not required. Transient creep appears to be unimportant for the recent response-to-surface loads from Pleistocene deglaciation.

Hager, Bradford H.↗
DOE OSTI2026

Frequentist cosmological constraints from full-shape clustering measurements in DESI DR1

We present a frequentist analysis of clustering measurements from Data Release 1 of the Dark Energy Spectroscopic Instrument (DESI) using the standard profile likelihood method. While Bayesian inferences for effective field theory models of galaxy clustering can be highly sensitive to prior choices for extended cosmological models, frequentist inferences are not susceptible to such effects. We compare frequentist and Bayesian constraints for the parameter set {σ 8 , H 0 , Ω m , w 0 , w a } using the full-shape power spectrum multipoles, post-reconstruction baryon acoustic oscillation (BAO) measurements, and external datasets from the CMB and type Ia supernovae measurements. The frequentist confidence intervals are significantly shifted relative to the Bayesian credible intervals for the w 0 w a CDM model, unless supernovae data are included. When DESI full-shape and BAO data are fit jointly, we obtain the following 1σ frequentist confidence intervals for ΛCDM (w 0 w a CDM): σ 8 = 0.863 +0.048 -0.040 , H 0 = 68.96 +0.81 -0.80 km s -1 Mpc -1 , Ω m = 0.3034 ± 0.0110 (σ 8 = 0.782 +0.060 -0.036 , H 0 = 63.7 +4.2 -2.0 km s -1 Mpc -1 , Ω m = 0.378 +0.024 -0.047 , w 0 = -0.16 +0.10 -0.50 , w a = -3.0 +1.7 ), corresponding to 0.8σ, 0.3σ, 0.7σ (2.1σ, 4.1σ, 6.5σ, 6.3σ, 6.6σ) shifts between the maximum likelihood estimate and the Bayesian posterior mean for ΛCDM (w 0 w a CDM) respectively.

Bayesian reasoning↗
DOE OSTI2025

Reno

Reno is a tool for creating, visualizing, and analyzing system dynamics models in Python. It additionally has the ability to convert models to PyMC, allowing Bayesian inference on models with variables that include prior probability distributions.

Martindale, Nathan [Oak Ridge National Laboratory ↗
NASA NTRS1989

Hot oxygen geocorona as inferred from neutral exospheric models and mass spectrometer measurements

Summer hot oxygen densities of 10,000-30,000 per cubic cm at 1100 km (or 100,000-300,000 at 550 km) for low to moderate solar activities are inferred from differences between satellite drag and mass-spectrometer-based models. At high solar activities, densities at 925 km from 100,000-400,000 (or 5 x 10 to the 5th to 2 x 10 to the 6th at 550 km) are inferred from a limited number of Dynamics Explorer mass spectrometer measurements. The densities are of the same order as those reported previously from ground-based optical measurements. It is pointed out that a detailed theoretical calculation of the hot oxygen distribution consistent with the cool populations in mass-spectrometer-based models would provide the basis for a more complete interpretation of mass spectrometer data and of high-altitude differences between drag-based and mass-spectrometer-based models. It is concluded that hot oxygen could be providing the major contribution to satellite drag in the summer lower exosphere during low solar activity.

Hedin, A. E.↗
DOE OSTI2026

Inferring performance metrics for laser direct drive experiments on OMEGA

Quantifying performance improvements on the OMEGA laser facility requires robust inference of established no-alpha performance metrics, which requires, at minimum, a model to infer the shocked fuel mass and pressure of the confined fusion plasma. In this work, we describe the methodology used to infer performance metrics on OMEGA and present the current state-of-the art model used to infer these metrics from OMEGA experiments. In particular, since neutron images of cryogenic implosions are not available on OMEGA at present, we present how x-ray sizes are determined on OMEGA using a Gaussian Process regression model and how the neutron production region's size is inferred from them. As a result, we end by benchmarking the model using synthetic data and 1-D LILAC simulations and test its experimental self-consistency across available x-ray diagnostic channels.

Gopalaswamy, V. [Laboratory for Laser Energetics, ↗
NASA NTRS1981

The asymmetric 4.8 hour X-ray modulation of Cygnus X-3 - Model light curves and inferred orbital parameters

The 4.8 hour X-ray light curve of Cygnus X-3 is quantitatively described by several proposed models under the assumption that the binary orbit of Cyg X-3 is elliptic. The cocoon model implies an apparent size for the X-ray star's companion, which is larger than that of its critical lobe, and it is suggested that the emission of a dense stellar wind by the companion could lead to such a situation. It is shown that a helium star, with or without a hydrogen-rich envelope, seems to be the most likely Cyg X-3 companion, and that some of the observed variations in the 4.8 hour period can be accounted for by the apparent period variations due to apsidal motion.

Ghosh, P.↗
DOE OSTI2025

Simulation-Based Inference for Neutrino Interaction Model Parameter Tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla Maria [Fermilab]↗
DOE OSTI2025

Simulation-based inference for neutrino interaction model parameter tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
DOE OSTI2025

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges, requiring efficient hardware acceleration. Benchmarking the performance of LLMs across diverse hardware platforms is crucial to understanding their scalability and throughput characteristics. We introduce LLM-Inference-Bench, a comprehensive benchmarking suite to evaluate the hardware inference performance of LLMs. We thoroughly analyze diverse hardware platforms, including GPUs from Nvidia and AMD and specialized AI accelerators, Intel Habana and SambaNova. Our evaluation includes several LLM inference frameworks and models from LLaMA, Mistral, and Qwen families with 7B and 70B parameters. Our benchmarking results reveal the strengths and limitations of various models, hardware platforms, and inference frameworks. We provide an interactive dashboard to help identify configurations for optimal performance for a given hardware platform.

Chitty-Venkata, Krishna Teja↗
DOE OSTI2024

Inferring the Redshift of More than 150 GRBs with a Machine-learning Ensemble Model

Gamma-ray bursts (GRBs), due to their high luminosities, are detected up to a redshift of 10, and thus have the potential to be vital cosmological probes of early processes in the Universe. Fulfilling this potential requires a large sample of GRBs with known redshifts, but due to observational limitations, only 11% have known redshifts (z). There have been numerous attempts to estimate redshifts via correlation studies, most of which have led to inaccurate predictions. To overcome this, we estimated GRB redshift via an ensemble-supervised machine-learning (ML) model that uses X-ray afterglows of long-duration GRBs observed by the Neil Gehrels Swift Observatory. The estimated redshifts are strongly correlated (a Pearson coefficient of 0.93) and have an rms error, namely, the square root of the average squared error $\langle$Δz 2 $\rangle$, of 0.46 with the observed redshifts showing the reliability of this method. The addition of GRB afterglow parameters improves the predictions considerably by 63% compared to previous results in peer-reviewed literature. Finally, we use our ML model to infer the redshifts of 154 GRBs, which increase the known redshifts of long GRBs with plateaus by 94%, a significant milestone for enhancing GRB population studies that require large samples with redshift.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2004

Theoretical and Observational Determination of Global and Regional Radiation Budget, Forcing and Feedbacks at the Top-of-Atmosphere and Surface

Report consists of: 1. List of accomplishments 2. List of publications 3. Abstracts of published or submitted papers and 4. Subject invention disclosure. The accomplishments of the grant listed are: 1. Improved the third-order turbulence closure in cloud resolving models to remove the liquid water oscillation. 2. Used the University of California-Los Angeles (UCLA) large-eddy simulation (LES) model to provide data for radiation transfer testing. 3. Revised shortwave k-distribution models based on HITRAN 2000. 4. Developed a gamma-weighted two-stream radiative transfer model for radiation budget estimate applications. 5. Estimated the effect of spherical geometry to the earth radiation budget. 6. Estimated top-of-atmosphere irradiance over snow and sea ice surfaces. 7. Estimated the aerosol direct radiative effect at the top of the atmosphere. 8. Estimated the top-of-atmosphere reflectance of the clear-sky molecular atmosphere over ocean. 9. Developed and validated new set of Angular Distribution Models for the CERES TRMM satellite instrument (tropical) 10. Developed and validated new set of Angular Distribution Models for the CERES Terra satellite instrument (global) 11. Quantified the top-of-atmosphere direct radiative effect of aerosols over global oceans from merged CERES and MODIS observations 12 Clarified the definition of TOA flux reference level for radiation budget studies 13. Developed new algorithm for unfaltering CERES measured radiances 14. Used multiangle POLDER measurements to produce narrowband angular distribution models and examine the effect of scene identification errors on TOA albedo estimates 15. Developed and validated a novel algorithm called the Multidirectional Reflectance Matching (MRM) model for inferring TOA albedos from ice clouds using multi-angle satellite measurements. 16. Developed and validated a novel algorithm called the Multidirectional Polarized Reflectance Matching (MPRM) model for inferring particle shapes from ice clouds using multi-angle polarized satellite measurements. 17. Developed 4 advanced light scattering models including the three-dimensional (3D) uniaxial perfectly matched layer (UPML) finite-difference time-domain (FDTD) model. 18. Develop sunglint in situ measurement and study reflectance distribution in the sunglint area. 19. Lead a balloon-borne radiometer TOA albedo validation effort. 20. Developed a CERES surface UVB, UVA, and UV index product.

Loeb, Norman G.↗
DOE OSTI2023

Inferring Viral Transmission Time from Phylogenies for Known Transmission Pairs

When the time of an HIV transmission event is unknown, methods to identify it from virus genetic data can reveal the circumstances that enable transmission. We developed a single-parameter Markov model to infer transmission time from an HIV phylogeny constructed of multiple virus sequences from people in a transmission pair. Our method finds the statistical support for transmission occurring in different possible time slices. We compared our time-slice model results to previously described methods: a tree-based logical transmission interval, a simple parsimony-like rules-based method, and a more complex coalescent model. Across simulations with multiple transmitted lineages, different transmission times relative to the source’s infection, and different sampling times relative to transmission, we found that overall our time-slice model provided accurate and narrower estimates of the time of transmission. We also identified situations when transmission time or direction was difficult to estimate by any method, particularly when transmission occurred long after the source was infected and when sampling occurred long after transmission. Applying our model to real HIV transmission pairs showed some agreement with facts known from the case investigations. We also found, however, that uncertainty on the inferred transmission time was driven more by uncertainty from time calibration of the phylogeny than from the model inference itself. Encouragingly, comparable performance of the Markov time-slice model and the coalescent model—which make use of different information within a tree—suggests that a new method remains to be described that will make full use of the topology and node times for improved transmission time inference.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Assessing Membership Inference Attacks under Distribution Shifts

Membership inference attacks (MIAs) exploit machine learning models to infer whether a data point was in the training set, posing significant privacy risks even with limited black-box access. These attacks rely on the attacker approximating the target model’s training distribution, yet the impact of distribution shifts between target and shadow models on MIA success remains underexplored. We systematically evaluate five types of distribution shifts —-cutout, jitter, Gaussian noise, label shift, and attribute shift —- at varying intensities. Our results reveal that these shifts affect MIA effectiveness in nuanced ways, with some reducing attack success while others exacerbate vulnerabilities, and the same shift can have opposite effects depending on the type of MIA. This highlights the complex interplay between distributional differences and attack performance, offering critical insights for improving model defenses against MIAs.

Shi, Yichuan [Massachusetts Institute of Technolog↗