Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Amortized simulation-based frequentist inference for tractable and intractable likelihoods

Abstract High-fidelity simulators that connect theoretical models with observations are indispensable tools in many sciences. If the likelihood is known, inference can proceed using standard techniques. However, when the likelihood is intractable or unknown, a simulator makes it possible to infer the parameters of a theoretical model directly from real and simulated observations when coupled with machine learning. We introduce an extension of the recently proposed likelihood-free frequentist inference ( LF2I ) approach that makes it possible to construct confidence sets with the p -value function and to use the same function to check the coverage explicitly at any given parameter point. Like LF2I , this extension yields provably valid confidence sets in parameter inference problems for which a high-fidelity simulator is available. The utility of our algorithm is illustrated by applying it to three pedagogically interesting examples: the first is from cosmology, the second from high-energy physics and astronomy, both with tractable likelihoods, while the third, with an intractable likelihood, is from epidemiology 3 3 Code to reproduce all of our results is available on https://github.com/AliAlkadhim/ALFFI . .

Computer Science↗
DOE OSTI2024

Old-Aged groundwater contributes to mountain hillslope hydrologic dynamics

Understanding connectivity between the soil and deeper bedrock groundwater is needed to accurately predict a watershed’s response to perturbation, such as drought. Yet, the bedrock groundwater dynamics in mountainous environments are typically under-constrained and excluded from watershed hydrologic models. Here, we investigate the role of groundwater characterized with decadal and longer water ages on the hydrologic and mass-transport processes within a steep snow-dominated mountain hillslope in the Central Rocky Mountains (USA). We quantify subsurface and surface water mass-balance, groundwater flowpaths, and age distributions using the ParFlow-CLM integrated hydrologic and EcoSLIM particle tracking models, which are compared to hydrometric and environmental tracer observations. An ensemble of models with varied soil and hydrogeologic parameters reproduces observed groundwater levels and century-scale mean ages inferred from environmental tracers. The numerical models suggest soil water near the toe of the hillslope contains considerable (>60 % of the mass-flux) contributions from bedrock flowpaths characterized with water ages >10 years. Flowpath connectivity between the deeper bedrock and soil systems is present throughout the year, highlighting the potentially critical role of groundwater with old ages on processes such as evapotranspiration and streamflow generation. The coupled numerical model and groundwater age observations show the bedrock groundwater system influences the hillslope hydrodynamics and should be considered in mountain watershed conceptual and numerical models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Investigation of hydrometeorological influences on reservoir releases using explainable machine learning methods

Long short-term memory (LSTM) networks have demonstrated successful applications in accurately and efficiently predicting reservoir releases from hydrometeorological drivers including reservoir storage, inflow, precipitation, and temperature. However, due to its black-box nature and lack of process-based implementation, we are unsure whether LSTM makes good predictions for the right reasons. In this work, we use an explainable machine learning (ML) method, called SHapley Additive exPlanations (SHAP), to evaluate the variable importance and variable-wise temporal importance in the LSTM model prediction. In application to 30 reservoirs over the Upper Colorado River Basin, United States, we show that LSTM can accurately predict the reservoir releases with NSE ≥ 0.69 for all the considered reservoirs despite of their diverse storage sizes, functionality, elevations, etc. Additionally, SHAP indicates that storage and inflow are more influential than precipitation and temperature. Moreover, the storage and inflow show a relatively long-term influence on the release up to 7 days and this influence decreases as the lag time increases for most reservoirs. These findings from SHAP are consistent with our physical understanding. However, in a few reservoirs, SHAP gives some temporal importances that are difficult to interpret from a hydrological point of view, probably because of its ignorance of the variable interactions. SHAP is a useful tool for black-box ML model explanations, but the hydrological processes inferred from its results should be interpreted cautiously. More investigations of SHAP and its applications in hydrological modeling is needed and will be pursued in our future study.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Spatio-temporal Estimates of Disease Transmission Parameters for COVID-19 with a Fully-Coupled, County-Level Model of the United States

Sandia National Laboratories has developed a capability to estimate parameters of epidemiological models from case reporting data to support responses to the COVID-19 pandemic. A differentiating feature of this work is the ability to simultaneously estimate county-specific disease transmission parameters in a nation-wide model that considers mobility between counties. The approach is focused on estimating parameters in a stochastic SEIR model that considers mobility between model patches (i.e., counties) as well as additional infectious compartments. The inference engine developed by Sandia includes (1) reconstruction and (2) transmission parameter inference. Reconstruction involves estimating current population counts within each of the compartments in a modified SEIR model from reported case data. Reconstruction produces input for the inference formulations, and it provides initial conditions that can be used in other modeling and planning efforts. Inference involves the solution of a large-scale optimization problem to estimate the time profiles for the transmission parameters in each county. These provide quantification of changes in the transmission parameter over time (e.g., due to impact of intervention strategies). This capability has been implemented in a Python-based software package, epi_inference, that makes extensive use of Pyomo [5] and IPOPT [10] to formulate and solve the inference formulations.

42 ENGINEERING↗
DOE OSTI2020

Thermal and magnetic evolution of a crystallizing basal magma ocean in Earth's mantle

We present the thermochemical evolution of a downward crystallizing basal magma ocean (BMO) overlying the liquid outer core and probe its capability to dissipate enough power to generate and sustain an early dynamo. Furthermore, a total of 61 out of 112 scenarios for a BMO with imposed, present-day heat flux, Q BMO , values of 15, 18, and 21 TW and radiogenic heat, Q r , values of 4, 8, and 12 TW fully crystallized during the age of the Earth. Most of these models are energetically capable of inducing magnetic activity for the first 1.5 Gyrs, at least, with durations extending to 2.5 Gyrs; with final core-mantle boundary (CMB) temperatures of 4400 ±500 K-well within current best estimates for inferred temperatures. None of the models with Q BMO = 12 TW achieved a fully crystallized state, which may reflect a lower bound on the present-day heat flux across the CMB. BMO-powered dynamos exhibit strong dependence on the partition coefficient of iron into the liquid layer and its associated melting-point depression for a lower mantle composition at near-CMB conditions-parameters which are poorly constrained to date. Nonetheless, we show that a crystallizing BMO is a plausible mechanism to sustain an early magnetic field.

58 GEOSCIENCES↗
DOE OSTI2026

New approaches to Bayesian uncertainty quantification for Nuclear Science (Final Technical Report)

Inverse problems play a central role in experimentation and theory/data comparisons for many areas of modern Nuclear Physics (NP) and High-Energy Physics (HEP). Bayes’s Theorem is a powerful tool for solving Inverse Problems, providing conceptually transparent and unbiased constraints on theoretical parameters and their uncertainties (“Bayesian Inference”) and enabling the quantification of agreement or tension between models and data. However, analyses based on Bayesian Inference are often challenging for NP and HEP applications, either because of the large number of parameters in the problem, the high computational cost, or both. We propose a multi-institutional collaboration to develop and deploy novel Bayesian analysis tools that advance the scientific scope of a broad range of current and future NP experiments. This project brings together NP domain scientists working on several high-profile NP projects for which new, high-performance Bayesian Uncertainty Quantification (“Bayesian UQ”) methods are essential to carry out the science, and data scientists who are developing state-of-the-art methods applicable to these problems. The NP projects in this proposal comprise measurements of the mass and fundamental nature of the neutrino; study of the Quark-Gluon Plasma that filled the early universe; and mapping of natural and anthropogenic radiation environments. While these NP projects have very different scientific goals, with datasets and analysis approaches that differ significantly, they share common requirements for improving computationally intensive Bayesian analyses using advanced Machine Learning algorithms and will benefit strongly from a coherent effort to develop general solutions. This proposal brings together these projects and forefront ML-based data science algorithms to develop such general solutions. The methods developed in this project will also be more widely applicable, thereby advancing science in the larger Nuclear Physics portfolio.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Quantification of early nonpharmaceutical interventions aimed at slowing transmission of Coronavirus Disease 2019 in the Navajo Nation and surrounding states (Arizona, Colorado, New Mexico, and Utah)

During an early period of the Coronavirus Disease 2019 (COVID-19) pandemic, the Navajo Nation, much like New York City, experienced a relatively high rate of disease transmission. Yet, between January and October 2020, it experienced only a single period of growth in new COVID-19 cases, which ended when cases peaked in May 2020. The daily number of new cases slowly decayed in the summer of 2020 until late September 2020. In contrast, the surrounding states of Arizona, Colorado, New Mexico, and Utah all experienced at least two periods of growth in the same time frame, with second surges beginning in late May to early June. Here, we investigated these differences in disease transmission dynamics with the objective of quantifying the contributions of non-pharmaceutical interventions (NPIs) (e.g., behaviors that limit disease transmission). We considered a compartmental model accounting for distinct periods of NPIs to analyze the epidemic in each of the five regions. We used Bayesian inference to estimate region-specific model parameters from regional surveillance data (daily reports of new COVID-19 cases) and to quantify uncertainty in parameter estimates and model predictions. Our results suggest that NPIs in the Navajo Nation were sustained over the period of interest, whereas in the surrounding states, NPIs were relaxed, which allowed for subsequent surges in cases. Our region-specific model parameterizations allow us to quantify the impacts of NPIs on disease incidence in the regions of interest.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

A scalable variational method for estimating the latent infection-rate field of an outbreak

In this paper, we explore whether the infection-rate of a disease can serve as a robust monitoring variable in epidemiological surveillance algorithms. The infection-rate is dependent on population mixing patterns that do not vary erratically day-to-day; in contrast, daily case-counts used in contemporary surveillance algorithms are corrupted by reporting errors. The technical challenge lies in estimating the latent infection-rate from case-counts. Here we devise a Bayesian method to estimate the infection-rate across multiple adjoining areal units, and then use it, via an anomaly detector, to discern a change in epidemiological dynamics. We extend an existing model for estimating the infection-rate in an areal unit by incorporating a Markov random field model, so that we may estimate infection-rates across multiple areal units, while preserving spatial correlations observed in the epidemiological dynamics. To carry out the high-dimensional Bayesian inverse problem, we develop an implementation of mean-field variational inference specific to the infection model and integrate it with the random field model to incorporate correlations across counties. The method is tested on estimating the COVID-19 infection-rates across all 33 counties in New Mexico using data from the summer of 2020, and then employing them to detect the arrival of the Fall 2020 COVID-19 wave. We perform the detection using a temporal algorithm that is applied county-by-county. We also show how the infection-rate field can be used to cluster counties with similar epidemiological dynamics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A comparison between residential relocation timing of Sydney and Chicago residents: A Bayesian survival analysis

We report that understanding households' behaviour in residential relocation timing is of great importance in the field of transport engineering and economics. This research aims to develop a residential relocation model by considering the potential dynamic impacts of other households' decisions and variables, including economic and demographic attributes, housing features, intra-household decision-making structures, travel mode choice, and other life-course attributes. A multivariate parametric survival model with both fixed and time-varying covariates is developed. To the best of the authors' knowledge, this study is the first paper in the literature of residential relocation timing to propose the use of a Bayesian model in contrast to the widely used classic frequentist approach and have conducted a discussion on its advantages. An emerging residential relocation dataset collected for two cities in Australia and the USA (Sydney and Chicago cities) has been used, which covers residence, vehicle ownership, occupation, education, economic and demographic attributes of respondents. A comprehensive comparison between the results of two cities and a comparison between two Bayesian and frequentist approaches are made. This study confirms the impact of life-course variables, intra-household decision-making behaviours, and sociodemographic attributes on home mobility. According to the model outputs, the accelerating or decelerating impact of explanatory variables on the relocation timing has been almost the same in the two cities. The Bayesian model was confirmed to have some advantages over the frequentist model, including being straightforward to interpret, availability of making inferences on the results, and ease of handling complex models, and optimisation convergence complexities.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2018

Temporal Coupling of Subsurface and Surface Soil CO 2 Fluxes: Insights From a Nonsteady State Model and Cross-Wavelet Coherence Analysis

Inferences about subsurface CO 2 fluxes often rely on surface soil respiration (R soil ) estimates because directly measuring subsurface microbial and root respiration (collectively, CO 2 production, S Total ), is difficult. To evaluate how well R soil serves as a proxy for S Total , we applied the nonsteady state DEconvolution of Temporally varying Ecosystem Carbon componenTs model (0.01-m vertical resolution), using 6-hourly data from a Wyoming grassland, in six simulations that cross three soil types (clay, sandy loam, and sandy) with two depth distributions of subsurface biota. We used cross-wavelet coherence analysis to examine temporal coherence (localized linear correlation) and offsets (lags) between S Total and R soil and fluxes and drivers (e.g., soil temperature and moisture). Cross-wavelet coherence revealed higher coherence between fluxes and drivers than linear regressions between concurrent variables. Soil texture and moisture exerted the strongest controls over coherence between CO 2 fluxes. Coherence between CO 2 fluxes in all soil types was strong at short (~1 day) and long periods (>8 days), but soil type controlled lags, and rainfall events decoupled the fluxes at periods of 1–8 days for several days in sandy soil, up to 1 week in sandy loam, and for a month or more in clay soil. Concentrating root and microbial biomass nearer the surface decreased lags in all soil types and increased coherence up to 10% in clay soil. The assumption of high temporal coherence between R soil and S Total is likely valid in dry, sandy soil, but may lead to underestimates of short-term STotal in semiarid grasslands with fine-grained and/or wet soil.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Probabilistic inference of the structure and orbit of Milky Way satellites with semi-analytic modelling

Semi-analytic modelling furnishes an efficient avenue for characterizing dark matter haloes associated with satellites of Milky Way-like systems, as it easily accounts for uncertainties arising from halo-to-halo variance, the orbital disruption of satellites, baryonic feedback, and the stellar-to-halo mass (SMHM) relation. We use the SatGen semi-analytic satellite generator, which incorporates both empirical models of the galaxy–halo connection as well as analytic prescriptions for the orbital evolution of these satellites after accretion onto a host to create large samples of Milky Way-like systems and their satellites. By selecting satellites in the sample that match observed properties of a particular dwarf galaxy, we can infer arbitrary properties of the satellite galaxy within the cold dark matter paradigm. For the Milky Way’s classical dwarfs, we provide inferred values (with associated uncertainties) for the maximum circular velocity v max and the radius r max at which it occurs, varying over two choices of baryonic feedback model and two prescriptions for the SMHM relation. While simple empirical scaling relations can recover the median inferred value for v max and r max , this approach provides realistic correlated uncertainties and aids interpretability. We also demonstrate how the internal properties of a satellite’s dark matter profile correlate with its orbit, and we show that it is difficult to reproduce observations of the Fornax dwarf without strong baryonic feedback. Furthermore, the technique developed in this work is flexible in its application of observational data and can leverage arbitrary information about the satellite galaxies to make inferences about their dark matter haloes and population statistics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Prime VI

SAND2025-03757O Prime VI is a distribution-of-disease outbreak model calibration code based on variational inference. It accompanies a publication for submission to Statistics in Medicine journal, and the code will be maintained for open-source use on Sandia's GitLab. The software provides methods for calibrating an epidemiological model to measured case-count data for a multitude of correlated spatial regions. The code solves a Bayesian inverse problem for model calibration where the posterior over-model parameters are approximated through a custom implementation of variational inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗
DOE OSTI2024

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Joint cosmic density reconstruction from photometric and spectroscopic samples

ABSTRACT We reconstruct the dark matter density field from spatially overlapping spectroscopic and photometric redshift catalogues through a field-level forward modelling approach. Instead of directly inferring the underlying density field, we find the best-fitting initial Gaussian fluctuations that will evolve into the observed cosmic volume. To account for the substantial uncertainty of photometric redshifts we employ a differentiable continuous Poisson process. As an initial test, we construct a mock based on the upcoming Prime Focus Spectrograph combined with photometric sample modelled on the Subaru Hyper Suprime-Cam. Depending on the statistic of interest, we find improvements in cosmic structure classification equivalent to 50–100 per cent more spectroscopic targets by combining relatively sparse spectroscopic with dense photometric samples.

Horowitz, B.↗
DOE OSTI2025

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

People commonly utilize visualizations not only to examine a given dataset, but also to draw generalizable conclusions about the underlying models or phenomena. Prior research has compared human visual inference to that of an optimal Bayesian agent, with deviations from rational analysis viewed as problematic. However, human reliance on non-normative heuristics may prove advantageous in certain circumstances. We investigate scenarios where human intuition might surpass idealized statistical rationality. In two experiments, we examine individuals’ accuracy in characterizing the parameters of known data-generating models from bivariate visualizations. Our findings indicate that, although participants generally exhibited lower accuracy compared to statistical models, they frequently outperformed Bayesian agents, particularly when faced with extreme samples. Participants appeared to rely on their internal models to filter out noisy visualizations, thus improving their resilience against spurious data. However, participants displayed overconfidence and struggled with uncertainty estimation. They also exhibited higher variance than statistical machines. Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality. These results carry implications for designing visual analytics tools, offering new perspectives on how to integrate statistical models and analyst intuition for improved inference and decision-making. The data and materials for this paper are available at https://osf.io/qmfv6

human-machine collaboration↗
DOE OSTI2023

Canonical and noncanonical Hamiltonian operator inference

Here, a method for the nonintrusive and structure-preserving model reduction of canonical and noncanonical Hamiltonian systems is presented. Based on the idea of operator inference, this technique is provably convergent and reduces to a straightforward linear solve given snapshot data and gray-box knowledge of the system Hamiltonian. Examples involving several hyperbolic partial differential equations show that the proposed method yields reduced models which, in addition to being accurate and stable with respect to the addition of basis modes, preserve conserved quantities well outside the range of their training data.

97 MATHEMATICS AND COMPUTING↗