Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Distributed-Memory Sparse Deep Neural Network Inference Using Global Arrays

Partitioned Global Address Space (PGAS) models exhibit tremendous promise in developing efficient and productive distributed-memory parallel applications. They have been used extensively in scientific computations due to conveniently offering a ``shared-memory''-like model and convenient interfaces that separate communication with synchronization. Traditionally, PGAS communication models have been applied to dense/contiguously distributed data, but most modern applications depict varied levels of sparsity. Existing PGAS models require certain adaptations to support distributed sparse computations, since associated computations often require matrix arithmetic, in addition to data movement. The Global Arrays toolkit from Pacific Northwest National Laboratory (PNNL) is one of the earliest PGAS models to combine one-sided data communication and distributed matrix operations and is still used in the popular NWChem quantum chemistry suite. Recently, we have expanded the Global Arrays toolkit to support common sparse operations, like sparse matrix-dense matrix multiplies (SpMM), sparse matrix-sparse matrix multiplication (SpGEMM) and Sampled Dense-Dense Matrix Multiplication (SDDMM). As it turns out, these operations are the bedrock of sparse Deep Learning (DL); sparse deep neural networks and Graph Neural Networks (GNNs) have gained increasing attention recently in achieving speedups on training and inference with reduced memory footprints. Unlike scientific applications in High Performance Computing (HPC), modern (distributed-memory capable) DL toolkits often rely on non-standardized and closed-source vendor software optimizations, creating challenges in software-hardware co-design at scale. Our goal is to support a variety of distributed-memory sparse matrix operations and helper functions in the newly created Sparse Global Arrays (SGA), such that it is possible to build portable and productive Machine Learning scenarios for algorithm/software and hardware codesign purposes. Contemporary data-parallel schemes for training/inference are undergoing a major overhaul since model replication limits scalability and causes resource inefficiencies. As such, we have adopted tensor parallelism in decomposing the model and inputs, to mitigate memory issues. Current implementation is built on top of MPI and uses CPUs to maximize the portability across the platforms.

Distributed computing, machine learning↗

Differentiable stochastic halo occupation distribution

ABSTRACT In this work, we demonstrate how differentiable stochastic sampling techniques developed in the context of deep reinforcement learning can be used to perform efficient parameter inference over stochastic, simulation-based, forward models. As a particular example, we focus on the problem of estimating parameters of halo occupation distribution (HOD) models that are used to connect galaxies with their dark matter haloes. Using a combination of continuous relaxation and gradient re-parametrization techniques, we can obtain well-defined gradients with respect to HOD parameters through discrete galaxy catalogue realizations. Having access to these gradients allows us to leverage efficient sampling schemes, such as Hamiltonian Monte Carlo, and greatly speed up parameter inference. We demonstrate our technique on a mock galaxy catalogue generated from the Bolshoi simulation using a standard HOD model and find near-identical posteriors as standard Markov chain Monte Carlo techniques with an increase of ∼8× in convergence efficiency. Our differentiable HOD model also has broad applications in full forward model approaches to cosmic structure and cosmological analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗

ESD Reviews: Model Dependence in Multi-Model Climate Ensembles: Weighting, Sub-Selection and Out-Of-Sample Testing

The rationale for using multi-model ensembles in climate change projections and impacts research is often based on the expectation that different models constitute independent estimates; therefore, a range of models allows a better characterisation of the uncertainties in the representation of the climate system than a single model. However, it is known that research groups share literature, ideas for representations of processes, parameterisations, evaluation data sets and even sections of model code. Thus, nominally different models might have similar biases because of similarities in the way they represent a subset of processes, or even be near-duplicates of others, weakening the assumption that they constitute independent estimates. If there are near-replicates of some models, then treating all models equally is likely to bias the inferences made using these ensembles. The challenge is to establish the degree to which this might be true for any given application. While this issue is recognised by many in the community, quantifying and accounting for model dependence in anything other than an ad-hoc way is challenging. Here we present a synthesis of the range of disparate attempts to define, quantify and address model dependence in multi-model climate ensembles in a common conceptual framework, and provide guidance on how users can test the efficacy of approaches that move beyond the equally weighted ensemble. In the upcoming Coupled Model Intercomparison Project phase 6 (CMIP6), several new models that are closely related to existing models are anticipated, as well as large ensembles from some models. We argue that quantitatively accounting for dependence in addition to model performance, and thoroughly testing the effectiveness of the approach used will be key to a sound interpretation of the CMIP ensembles in future scientific studies.

Abramowitz, Gab↗

Progress in Constraining Nuclear Symmetry Energy Using Neutron Star Observables Since GW170817

The density dependence of nuclear symmetry energy is among the most uncertain parts of the Equation of State (EOS) of dense neutron-rich nuclear matter. It is currently poorly known especially at suprasaturation densities partially because of our poor knowledge about isovector nuclear interactions at short distances. Because of its broad impacts on many interesting issues, pinning down the density dependence of nuclear symmetry energy has been a longstanding and shared goal of both astrophysics and nuclear physics. New observational data of neutron stars including their masses, radii, and tidal deformations since GW170817 have helped improve our knowledge about nuclear symmetry energy, especially at high densities. Based on various model analyses of these new data by many people in the nuclear astrophysics community, while our brief review might be incomplete and biased unintentionally, we learned in particular the following: (1) The slope parameter L of nuclear symmetry energy at saturation density ρ0 of nuclear matter from 24 new analyses of neutron star observables was about L≈57.7±19 MeV at a 68% confidence level, consistent with its fiducial value from surveys of over 50 earlier analyses of both terrestrial and astrophysical data within error bars. (2) The curvature Ksym of nuclear symmetry energy at ρ0 from 16 new analyses of neutron star observables was about Ksym≈−107±88 MeV at a 68% confidence level, in very good agreement with the systematics of earlier analyses. (3) The magnitude of nuclear symmetry energy at 2ρ0, i.e., Esym(2ρ0)≈51±13 MeV at a 68% confidence level, was extracted from nine new analyses of neutron star observables, consistent with the results from earlier analyses of heavy-ion reactions and the latest predictions of the state-of-the-art nuclear many-body theories. (4) While the available data from canonical neutron stars did not provide tight constraints on nuclear symmetry energy at densities above about 2ρ0, the lower radius boundary R2.01=12.2 km from NICER’s very recent observation of PSR J0740+6620 of mass 2.08±0.07M⊙ and radius R=12.2–16.3 km at a 68% confidence level set a tight lower limit for nuclear symmetry energy at densities above 2ρ0. (5) Bayesian inferences of nuclear symmetry energy using models encapsulating a first-order hadron–quark phase transition from observables of canonical neutron stars indicated that the phase transition shifted appreciably both L and Ksym to higher values, but with larger uncertainties compared to analyses assuming no such phase transition. (6) The high-density behavior of nuclear symmetry energy significantly affected the minimum frequency necessary to rotationally support GW190814’s secondary component of mass (2.50–2.67) M⊙ as the fastest and most massive pulsar discovered so far. Overall, thanks to the hard work of many people in the astrophysics and nuclear physics community, new data of neutron star observations since the discovery of GW170817 have significantly enriched our knowledge about the symmetry energy of dense neutron-rich nuclear matter.

79 ASTRONOMY AND ASTROPHYSICS↗

Empirical model of global thermospheric temperature and composition based on data from the OGO-6 quadrupole mass spectrometer

An empirical global model for magnetically quiet conditions has been derived from longitudinally averaged N2, O, and He densities by means of an expansion in spherical harmonics. The data were obtained by the OGO-6 neutral mass spectrometer and cover the altitude range 400 to 600 km for the period 27 June 1969 to 13 May 1971. The accuracy of the analytical description is of the order of the experimental error for He and O and about three times experimental error for N2, thus providing a reasonable overall representation of the satellite observations. Two model schemes are used: one representing densities extrapolated to 450 km and one representing densities extrapolated to 120 km with exospheric temperatures inferred from N2 densities. Using the best fit model parameters the global thermospheric structure is presented in the form of a number of contour plots.

Hedin, A. E.↗

Quantiles, parametric-select density estimation, and bi-information parameter estimators

A quantile-based approach to statistical analysis and probability modeling of data is presented which formulates statistical inference problems as functional inference problems in which the parameters to be estimated are density functions. Density estimators can be non-parametric (computed independently of model identified) or parametric-select (approximated by finite parametric models that can provide standard models whose fit can be tested). Exponential models and autoregressive models are approximating densities which can be justified as maximum entropy for respectively the entropy of a probability density and the entropy of a quantile density. Applications of these ideas are outlined to the problems of modeling: (1) univariate data; (2) bivariate data and tests for independence; and (3) two samples and likelihood ratios. It is proposed that bi-information estimation of a density function can be developed by analogy to the problem of identification of regression models.

Parzen, E.↗

Water immersion and its computer simulation as analogs of weightlessness

Experimental studies and computer simulations of water immersion are summarized and discussed with regard to their utility as analogs of weightlessness. Emphasis is placed on describing and interpreting the renal, endocrine, fluid, and circulatory changes that take place during immersion. A mathematical model, based on concepts of fluid volume regulation, is shown to be well suited to simulate the dynamic responses to water immersion. Further, it is shown that such a model provides a means to study specific mechanisms and pathways involved in the immersion response. A number of hypotheses are evaluated with the model related to the effects of dehydration, venous pressure disturbances, the control of ADH, and changes in plasma-interstitial volume. By inference, it is suggested that most of the model's responses to water immersion are plausible predictions of the acute changes expected, but not yet measured, during space flight. One important prediction of the model is that previous attempts to measure a diuresis during space flight failed because astronauts may have been dehydrated and urine samples were pooled over 24-hour periods.

Leonard, J. I.↗

Density fluctuations in the interstellar medium: Evidence for anisotropic magnetogasdynamic turbulence. II - Stationary structures

A model of anisotropic, plasma-fluid variations was used to investigate the unknown origin of the power spectra of interstellar electron fluctuations inferred by Armstrong, Cordes, and Rickett (1981). The modeled electron variations are interpreted as density components of an anisotropic stationary mode of nonlinear magnetogasdynamics-tangential pressure balances. It is suggested that the wavenumber spectra of electron variations are identical to the spectra of the convecting velocity fields over a wide range of wavenumbers.

Higdon, J. C.↗

Machine learning for analysis of atomic spectral data

Physics based forward models are the basis on which many experimental diagnostics are interpreted. For some diagnostics, models can be computationally expensive which precludes their use in real time analysis. Reduced models have the potential to capture sufficient physics thereby enabling the desired real time analysis. Using statistical inference and machine learning techniques the application of reduced models for inversion of atomic spectral data used to diagnose magnetic fields in a plasma will be examined. Two approaches are considered, (a) a reduction of the forward model where traditional inversion can be performed on the proxy model, and (b) a reduction of the direct inverse where parameters are a function of measured signal. The resulting inversion is sufficiently fast to be utilized in an online context for digital twinning, and ultimately real-time prediction, design, and control of plasma systems, such as tokamaks. Furthermore, these methods will be demonstrated on both simulated and experimentally measured data.

74 ATOMIC AND MOLECULAR PHYSICS↗

Chromospheric Heating in Late-Type Stars: Evidence for Magnetic and Nonmagnetic Surface Structure

The aim of this paper is to evaluate recent observational and theoretical results concerning the physics of chromospheric heating as inferred from IUE, HST-GHRS and ROSAT data. These results are discussed in conjunction with theoretical model calculations based on acoustic and magnetic heating to infer some conclusions about the magnetic and non-magnetic surface structure of cool luminous stars. I find that most types of stars may exhibit both magnetic and nonmagnetic structures. Candidates for pure nonmagnetic surface structure include M-type giants and super-giants. M-type supergiants are also ideal candidates for identifying direct links between the appearance of hot spots on the stellar surface (perhaps caused by large convective bubbles) and temporarily increased chromospheric heating and emission.

Cuntz, Manfred↗

Accurate Holdup Calculations with Predictive Modeling & Data Integration

In facilities that process special nuclear material (SNM) it is important to account accurately for the fissile material that enters and leaves the plant. Although there are many stages and processes through which materials must be traced and measured, the focus of this project is material that is “held-up” in equipment, pipes, and ducts during normal operation and that can accumulate over time into significant quantities. Accurately estimating the holdup is essential for proper SNM accounting (vis-à-vis nuclear non-proliferation), criticality and radiation safety, waste management, and efficient plant operation. Usually it is not possible to directly measure the holdup quantity and location, so these must be inferred from measured radiation fields, primarily gamma and less frequently neutrons. Current methods to quantify holdup, i.e. Generalized Geometry Holdup (GGH), primarily rely on simple source configurations and crude radiation transport models aided by ad hoc correction factors. This project seeks an alternate method of performing measurement-based holdup calculations using a predictive model that employs state-of-the-art radiation transport codes capable of accurately simulating such situations. Inverse and data assimilation methods use the forward transport model to search for a source configuration that best matches the measured data and simultaneously provide an estimate of the level of confidence in the correctness of such configuration. In this work the holdup problem is re-interpreted as an inverse problem that is under-determined, hence may permit multiple solutions. A probabilistic approach is applied to solving the resulting inverse problem. This approach rates possible solutions according to their plausibility given the measurements and initial information. This is accomplished through the use of Bayes’ Theorem that resolves the issue of multiple solutions by giving an estimate of the probability of observing each possible solution. To use Bayes’ Theorem, one must have a model y(x) that maps the state variables x (the solution in this case) to the measurements y. In this case, the unknown state variables are the configuration and composition of the heldup SNM. The measurements are the detector readings. Thus, the natural model is neutral-particle radiation transport where a wealth of computational tools exists for performing these simulations accurately and efficiently. The combination of predictive model and Bayesian inference forms the Data Integration with Modeled Predictions (DIMP) method that serves as foundation for this project. The cost functional describing the model-to-data misfit is computed via a norm created by the inverse of the covariance matrix of the model parameters and responses. Since the model y(x) for the holdup problem is nonlinear, a nonlinear optimization on Q is conducted via Newton-type iterative methods to find the optimal values of the model parameters x. This project comprised a collaboration between NC State University (NCSU), the University of South Carolina (USC), and Oak Ridge National Laboratory (ORNL). The project was originally proposed in seven main tasks with an eighth contingency task to be performed if time and funding permitted; in fact time did not permit commencement of the contingency task and it was not performed. The remaining tasks involved holdup analysis with gamma detection strategies and separately with neutrons based on coincidence counting. Early in the project, and upon consultation with experts in coincidence counting it became evident that this approach is not viable for holdup applications and this task was replaced with an alternative, but valuable investigation that was carried out by the USC partner. Nevertheless, the experimental 4 measurements at ORNL of both gamma and neutron sources for the purpose of constructing Detector Response Functions (DRFs) with the associated uncertainties were indeed completed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Detection of the significant impact of source clustering on higher order statistics with DES Year 3 weak gravitational lensing data

We measure the impact of source galaxy clustering on higher order summary statistics of weak gravitational lensing data. By comparing simulated data with galaxies that either trace or do not trace the underlying density field, we show that this effect can exceed measurement uncertainties for common higher order statistics for certain analysis choices. We evaluate the impact on different weak lensing observables, finding that third moments and wavelet phase harmonics are more affected than peak count statistics. Using Dark Energy Survey (DES) Year 3 (Y3) data, we construct null tests for the source-clustering-free case, finding a p-value of p = 4 × 10 −3 (2.6σ) using third-order map moments and p = 3 × 10 −11 (6.5σ) using wavelet phase harmonics. The impact of source clustering on cosmological inference can be either included in the model or minimized through ad hoc procedures (e.g. scale cuts). We verify that the procedures adopted in existing DES Y3 cosmological analyses were sufficient to render this effect negligible. Failing to account for source clustering can significantly impact cosmological inference from higher order gravitational lensing statistics, e.g. higher order N-point functions, wavelet-moment observables, and deep learning or field-level summary statistics of weak lensing maps.

79 ASTRONOMY AND ASTROPHYSICS↗

Combining Computational Modeling with Reaction Kinetics Experiments for Elucidating the In Situ Nature of the Active Site in Catalysis

Microkinetic modeling based on density functional theory (DFT) derived energetics is important for addressing fundamental questions in catalysis. The quantitative fidelity of microkinetic models (MKMs), however, is often insufficient to conclusively infer the mechanistic details of a specific catalytic system. Here, this can be attributed to a number of factors such as an incorrect model of the active site for which DFT calculations are performed, deficiencies in the hypothesized reaction mechanism, inadequate consideration of the surface environment under reaction conditions, and intrinsic errors in the DFT exchange-correlation functional. Despite these limitations, we aim at developing a rigorous understanding of the reaction mechanism and of the nature of the active site for heterogeneous catalytic chemistries under reaction conditions. By achieving parity between experimental and modeling outcomes through robust parameter estimation and by ensuring coverage-consistency between DFT calculations and MKM predictions, it is possible to systematically refine the mechanistic model and, thereby, our understanding of the catalytic active site in situ.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian inference of Stochastic reaction networks using Multifidelity Sequential Tempered Markov Chain Monte Carlo

Stochastic reaction network models are often used to explain and predict the dynamics of gene regulation in single cells.These models usually involve several parameters, such as the kinetic rates of chemical reactions, that are not directly measurable and must be inferred from experimental data. Bayesian inference provides a rigorous probabilistic frame-work for identifying these parameters by finding a posterior parameter distribution that captures their uncertainty.Traditional computational methods for solving inference problems such as Markov Chain Monte Carlo methods based on classical Metropolis-Hastings algorithm involve numerous serial evaluations of the likelihood function, which in turn requires expensive forward solutions of the chemical master equation (CME). We propose an alternate approach based on a multifidelity extension of the Sequential Tempered Markov Chain Monte Carlo (ST-MCMC) sampler. This algorithm is built upon Sequential Monte Carlo and solves the Bayesian inference problem by decomposing it into a sequence of efficiently solved subproblems that gradually increase both model fidelity and the influence of the observed data. We reformulate the finite state projection (FSP) algorithm, a well-known method for solving the CME, to produce a hierarchy of surrogate master equations to be used in this multifidelity scheme. To determine the appropriate fidelity, we introduce a novel information-theoretic criteria that seeks to extract the most information about the ultimate Bayesian posterior from each model in the hierarchy without inducing significant bias. This novel sampling scheme is tested with high performance computing resources using biologically relevant problems.

97 MATHEMATICS AND COMPUTING↗

Backscatter model for the unusual radar properties of the Greenland Ice Sheet

A number of planetary objects exhibit large radar reflectivity and polarization ratios, and more recently, a similar behavior has been observed over a vast portion of the Earth's surface: the percolation facies of the Greenland Ice Sheet. Surface-based ranging radar data and snow stratigraphy studies demonstrated that the radar properties of that portion of Greenland are caused by enhanced scattering from massive, large, solid-ice bodies buried in the top few meters of the dry, cold, clean snowy surface of the ice sheet and created by seasonal melting and refreezing events. Here, we model the icy inclusions as randomly oriented, discrete, noninteracting, dielectric cylinders embedded in a transparent snow medium. An exact analytical solution is used to compute the scattered field from the cylinders. Using this model, we correctly predict the polarimetric radar observations gathered by an airborne imaging system at three wavelengths (5.6, 24, and 68 cm), between 19 deg and 65 deg incidence angle. The diameter and number density of the cylinders that are inferred from the radar data using the model are consistent with in situ observations of the icy inclusions. The large radar reflectivity and polarization ratios are interpreted as arising internal reflections of the radar signals in the icy inclusions that first-order external reflection models fail to predict. The results compare favorably with predictions from the coherent backscatter or weak localization theory and may provide a complementary framework for interpreting exotic radar echoes from other planetary objects.

Rignot, Eric↗

A ``Tail" of Two Cities: Fatality-based Modeling of COVID-19 Evolution in New York City and Cook County, IL

I describe $SIR$ modeling of the COVID-19 pandemic in two U.S. urban environments, New York City (NYC) and Cook County, IL, from onset through the month of June, 2020. Since testing was not widespread early in the pandemic in the U.S., I do not use data on confirmed cases and rely solely on public fatality data to estimate model parameters. Fits to the first 20 days of data determine a degenerate combination of the basic reproduction number, $R_0$, and the mean time to removal from the infectious population, $\gamma^{-1}$, with $\gamma (R_0-1) = 0.25 (0.21)$ inverse days for NYC (Cook County). Equivalently, the initial doubling time was $t_d = 2.8 (3.4)$ days for NYC (Cook). The early fatality data suggest that both locations had infections in early February. I model the mitigation measures implemented in mid-March in both locations (distancing, quarantine, isolation, etc) via a time-dependent reproduction number $R_t$ that declines monotonically from $R_0$ to a sma ller asymptotic value, with a parameterized functional form. The timing (mid-March) and duration (several days) of the transitions in $R_t$ appear well determined by the data. However, the fatality data determine only a degenerate combination of the parameters $R_0$, the percentage reduction in social contact due to mitigation measures, $X$, and the infection fatality rate (IFR), $f$. With flat priors, based on simulations the NYC model parameters have 95.45\% credible intervals of $R_0 = 3.0-5.4$, $X= 80-99.9\%$ and $f=2-6\%$, with $5-13\%$ of the population asymptotically infected. A strong external prior indicating a lower value of $f$ or of $\gamma^{-1}$ would imply lower values of $R_0$ and $X$ and higher percentage infection of the population. For Cook County, the evolution was qualitatively different: after mitigation measures were implemented, the daily fatality counts reached a plateau for about a month before tailing off. This is consistent with an $SIR$ model that exhibits ``critical slowing-down", in which $R_t$ plateaus ! at a value just above unity. For Cook County, the 95.45\% credible intervals for the model parameters are much broader and shifted downward, $R_0=1.4-4.7$, $X=26-54\%$, and $f=0.1-0.6\%$ with $15-88\%$ of the population asymptotically infected. Despite the apparently lower efficacy of its social contact reduction measures, Cook County has had significantly fewer fatalities per population than NYC, $D_\infty/N=100$ vs. 270 per 100,000. In the model, this is attributed to the lower inferred IFR for Cook; an external prior pointing to similar values of the IFR for the two locations would instead chalk up the difference in $D/N$ to differences in the relative growth rate of the disease. I derive a model-dependent threshold, $X^{crit}_e$, for `safe' re-opening, that is, for easing of contact reduction that would not trigger a second wave; for NYC, the models predict that increasing social contact by more than 20\% from post-mitigation levels will lead to renewed spread, while for Cook County the threshold value is very uncertain, given the parameter degeneracies. The timing of 2nd-wave growth will depend on the amplitude of contact increase relative to $X^{crit}_e$ and on the asymptotic growth rate, and the impact in terms of fatalities will depend on the parameter $f$.

Frieman, Joshua↗

Electrostatic emissions between electron gyroharmonics in the outer magnetosphere

A scheme was constructed and a theoretical model was developed to classify electrostatic emissions. All of the emissions appear to be generated by the same basic mechanism: an unstable electron plasma distribution consisting of cold electrons (less than 100 eV) and hot loss cone electrons (about 1 keV). Each emission class is associated with a particular range of model parameters; the wide band electric field data can thus be used to infer the density and temperature of the cold plasma component. The model predicts that gyroharmonic emissions near the plasma frequency require large cold plasma densities.

Hubbard, R. F.↗