Search NASA⌕ Search

SEARCH · Search NASA

Results for “Variational inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Physics-Informed Sparse Gaussian Process for Probabilistic Stability Analysis of Large-Scale Power System with Dynamic PVs and Loads

This work proposes a physics-informed sparse Gaussian process (SGP) for probabilistic stability assessment of large-scale power systems in the presence of uncertain dynamic PVs and loads. The differential and algebraic equations considering uncertainties from dynamic PVs and loads are reformulated to a nonlinear mapping relationship that allows the application of SGP. Thanks to the nonparametric characteristic of Gaussian process, the proposed framework does not require distributions of uncertain inputs and this distinguishes it from existing approaches. As the original Gaussian process is not scalable to large-scale systems with high dimensional uncertain inputs, this paper develops the SGP with a stochastic variational inference technique. It leads to approximately two orders of complex reduction. A data pre-processing step is also introduced to tackle the coexistence of stable and unstable cases by sample clustering and constructing separate SGPs. The probabilistic transient stability index is analyzed to assess system stability under different uncertain dynamics loads and PVs. Comparisons are performed with the sampling-based, the polynomial chaos expansion-based, and traditional Gaussian process-based methods on the modified IEEE 118-bus and Texas 2000-bus systems under various scenarios, including different levels of uncertainties and the existence of nonlinear correlations among dynamic PVs. The impacts of data quality and quantity issues are also investigated. It is shown that the proposed SGP achieves significantly improved computational efficiency while maintaining high accuracy with a limited number of data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Deep Generative Model for Non-Intrusive Identification of EV Charging Profiles

The proliferation of electric vehicles (EVs) brings environmental benefits and technical challenges to power grids. An identification algorithm which can accurately extract individual EV charging profiles out of widely available smart meter measurements has attracted great interests. This paper proposes a non-intrusive identification framework for EV charging profile extraction, which is driven by deep generative models (DGM). First, the proposed DGM is designed as a representation layer embedded into the Markov process and used to model the joint probability distribution of available time-series data. A novel contribution is to approximate posterior distributions by neural networks whose parameters are obtained by variational inference and supervised learning. Second, the EV charging status is inferred from the DGM via dynamic programming. Lastly, the desired EV charging profile can be reconstructed by the rated power of EV models and inferred status. Compared with the benchmark Hidden Markov Models, the proposed framework can better handle noise in data with less computational complexity and better overall accuracy performances with smaller recall. The proposed framework is validated by numerical experiments on the Pecan Street dataset.

33 ADVANCED PROPULSION SYSTEMS↗

Bayesian Segmentation (BCNN) v.1

Deep learning has been applied with great success to the segmentation of 3D X-Ray Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify problem areas. Bayesian neural networks (BNNs), which use variational inference to learn the posterior distribution of the neural network weights, have been proposed to incorporate UQ into deep learning models. This software is an implementation of a novel 3D Bayesian convolutional neural network (BCNN) that provides accurate binary segmentations and uncertainty maps for 3D volumes. In particular, the uncertainty maps generated by this BCNN capture continuity and visual gradients, making them interpretable as confidence intervals for segmentation usable in numerical simulations. SAND2019-12927 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

LaBonte, TylerMatthew↗

Designing an Optimal Sensor Network via Minimizing Information Loss

Optimal experimental design is a classic topic in statistics, with many well-studied problems, applications, and solutions. The design problem we study is the placement of sensors to monitor spatiotemporal processes, explicitly accounting for the temporal dimension in our modeling and optimization. We observe that recent advancements in computational sciences often yield large datasets based on physics-based simulations, which are rarely leveraged in experimental design. We introduce a novel model-based sensor placement criterion, along with a highly-efficient optimization algorithm, which integrates physics-based simulations and Bayesian experimental design principles to identify sensor networks that “minimize information loss” from simulated data. Our technique relies on sparse variational inference and (separable) Gauss-Markov priors, and thus may adapt many techniques from Bayesian experimental design. We validate our method through a case study monitoring air temperature in Phoenix, Arizona, using state-of-the-art physics-based simulations. Our results show our framework to be superior to random or quasi-random sampling, particularly with a limited number of sensors. We conclude by discussing practical considerations and implications of our framework, including more complex modeling tools and real-world deployments.

54 ENVIRONMENTAL SCIENCES↗

Quantification of neural networks uncertainties with applications to SAFARI-1 axial neutron flux profiles

Deep Neural Networks (DNNs) have been widely used as a data-driven modelling tool in nuclear engineering. However, as a Machine Learning model, Artificial Neural Network (ANN) predictions are subjected to uncertainties originating from the noise in training data, incomplete coverage of the domain, and imperfect neural network architectures. In this work, we target at quantifying the prediction/approximation uncertainties of ANNs using Monte Carlo Dropout (MCD), as well as Bayesian Neural Networks (BNNs) which are solved by variational inference. With a demonstration problem in which neural networks are used to predict the assembly axial neutron flux profiles, the results have shown that the three different neural network models (regular DNNs, DNNs solved with MCD and BNNs) can produce results that agree very well among each other and with the measurement data, on cycles that are not used in the training process. Besides the excellent generalization capability, the uncertainty bands produced by MCD and BNN agree very well, and in general, they can fully envelop the noisy measurement data points. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A scalable variational method for estimating the latent infection-rate field of an outbreak

In this paper, we explore whether the infection-rate of a disease can serve as a robust monitoring variable in epidemiological surveillance algorithms. The infection-rate is dependent on population mixing patterns that do not vary erratically day-to-day; in contrast, daily case-counts used in contemporary surveillance algorithms are corrupted by reporting errors. The technical challenge lies in estimating the latent infection-rate from case-counts. Here we devise a Bayesian method to estimate the infection-rate across multiple adjoining areal units, and then use it, via an anomaly detector, to discern a change in epidemiological dynamics. We extend an existing model for estimating the infection-rate in an areal unit by incorporating a Markov random field model, so that we may estimate infection-rates across multiple areal units, while preserving spatial correlations observed in the epidemiological dynamics. To carry out the high-dimensional Bayesian inverse problem, we develop an implementation of mean-field variational inference specific to the infection model and integrate it with the random field model to incorporate correlations across counties. The method is tested on estimating the COVID-19 infection-rates across all 33 counties in New Mexico using data from the summer of 2020, and then employing them to detect the arrival of the Fall 2020 COVID-19 wave. We perform the detection using a temporal algorithm that is applied county-by-county. We also show how the infection-rate field can be used to cluster counties with similar epidemiological dynamics.

60 APPLIED LIFE SCIENCES↗

Uncertainties in Density and Simulation Parameters for Radiographic Reconstructions Using Machine Learning

We will develop new and improved methods that will enable a fuller and more extensive use of experimental data, such as from radiographic imaging, towards better characterizing and reducing uncertainties in predictive modeling of weapons performance. We will achieve this by leveraging recent developments in the areas of computational imaging, statistical and machine learning, and reduced order modeling. Key new aspects of our approach include (a) a coupling of deep learning based density reconstruction with fast hydrodynamics simulators that will permit the development of certain guarantees on extrapolatability and bounds on certain other hydrodynamics-related para- metric uncertainties and (b) a dual approach towards better characterizing uncertainties in density reconstruction using deep learning based surrogates to accelerate Bayesian reconstructions on the one hand and using variational inference and Bayesian machine learning on the other hand.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Hydrodynamic and Radiographic Toolbox (HART)

With a multi-lab and university team, we propose to develop new methods for a Hydrodynamic and Radiographic Toolbox (HART) that will enable a fuller and more extensive use of experimental radiographic data towards better characterizing and reducing uncertainties in predictive modeling of weapons performance. We will achieve this by leveraging recent developments in areas of computational imaging, statistical and machine learning, and reduced order modeling of hydrodynamics. In terms of software practices, by partnering with XCP (RISTRA Project) we will conform to recent XCP standards that are inline with modern software practices and standards and ensure compatibility and ease of inter-operability with existing codes. Three new activities under this proposal include (a) the development and use of deep learning-based surrogates to accelerate reconstruction and variational inference of density fields from radiographs of hydrotests, (b) a model-data fusion strategy that couples deep learning-based density reconstructions with fast hydrodynamics simulators to better constrain the reconstruction, and (c) a method for treating asymmetries using techniques adopted from limited view tomography. All three new activities will be based on improved treatment of scatter, noise, beam spot movement, detector blur, and flat fielding in the forward model, and a use of sophisticated priors to aid in the re construction. The improvements to the forward model and improved algorithmic design of the reconstruction when complete will be contained in the iterative reconstruction code SHIVA—a code project that we have recently initiated. The many ways in which machine learning can be used in the reconstruction work will be contained in a code HERMES that has been initiated with DTRA support. For example, the significant levels of acceleration that will likely be achieved by the use of machine learning techniques will permit us (and are required) to quantify uncertainties in density retrievals. Next, the two-way coupling between density reconstruction and model-based simulation of the hydrodynamics will be contained in code EREBUS, and will permit a fuller realization of the potential of the data to constrain the hydrodynamic model and better address issues related to asymmetries in the problem. Finally, we anticipate that the better consistency with physics achieved in our reconstructions will allow them to be used by X-Division more so than today.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

A spatially regularized detector for emergent/re-emergent disease outbreaks

Early detection of outbreaks caused by emergent pathogens, using epidemiological surveillance data i.e., daily case counts, is difficult. This is because the data tend to be noisy during the early epoch of the outbreak. In contrast, the spread-rate of the disease tends to be well-behaved, as it depends only on the mixing patterns of the population and the characteristics of the pathogen, neither of which behave erratically in space-time. In this report, we explore whether the spread-rate can be used for epidemiological surveillance, conditional on case count data. Estimating the spread-rate from case count data allows us to exploit exogenous information, e.g., incubation period distributions etc., which can considerably smooth out any erratic temporal behavior. Further, epidemiological dynamics are spatially correlated, and if case counts are available for multiple areal units e.g., counties, these correlations could potentially be used to suppress noise in the early epoch data. These exogenous information and structure are not exploited by conventional syndromic surveillance detectors to extract a well-behaved latent variable for monitoring purposes. The technical challenge lies in the estimation of the spread-rate field jointly over a collection of areal units; further, the spread-rate varies over time. We develop a method based on mean-field variational inference to approximately estimate the spread-rate field, using a Gaussian Random Field Model for spatial regularization. The method is tested on the estimation of spread-rate in the thirty-three counties of New Mexico and detect the arrival of the Fall 2020 COVID-19 wave in September 2020. We find that the method is scalable, but underestimates the uncertainty in the estimated spread-rate field. We detect the arrival of the Fall 2020 wave a week ahead of conventional syndromic surveillance algorithms, but our simplistic detection algorithm, based on simple anomaly detection, suffers from a high false positive rate, similar to conventional detectors.

59 BASIC BIOLOGICAL SCIENCES↗

Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing

In Hezaveh et al. (2017) we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for obtaining the uncertainties of these parameters. We review the framework of variational inference to obtain approximate posteriors of Bayesian neural networks and apply it to a network trained to estimate the parameters of the Singular Isothermal Ellipsoid plus external shear and total flux magnification. We show that the method can capture the uncertainties due to different levels of noise in the input data, as well as training and architecture-related errors made by the network. To evaluate the accuracy of the resulting uncertainties, we calculate the coverage probabilities of marginalized distributions for each lensing parameter. By tuning a single hyperparameter, the dropout rate, we obtain coverage probabilities approximately equal to the confidence levels for which they were calculated, resulting in accurate and precise uncertainty estimates. Our results suggest that neural networks can be a fast alternative to Monte Carlo Markov Chains for parameter uncertainty estimation in many practical applications, allowing more than seven orders of magnitude improvement in speed.

Perreault Levasseur, Laurence↗

Mixing and Transport of Dust in the Early Solar Nebula as Inferred from Titanium Isotope Variations among Chondrules

Chondrules formed by the melting of dust aggregates in the solar protoplanetary disk and as such provide unique insights into how solid material was transported and mixed within the disk. Here, we show that chondrules from enstatite and ordinary chondrites show only small {sup 50}Ti variations and scatter closely around the {sup 50}Ti composition of their host chondrites. By contrast, chondrules from carbonaceous chondrites have highly variable {sup 50}Ti compositions, which, relative to the terrestrial standard, range from the small {sup 50}Ti deficits measured for enstatite and ordinary chondrite chondrules to the large {sup 50}Ti excesses known from Ca–Al-rich inclusions (CAIs). These {sup 50}Ti variations can be attributed to the addition of isotopically heterogeneous CAI-like material to enstatite and ordinary chondrite-like chondrule precursors. The new Ti isotopic data demonstrate that isotopic variations among carbonaceous chondrite chondrules do not require formation over a wide range of orbital distances, but can instead be fully accounted for by the incorporation of isotopically anomalous “nuggets” into chondrule precursors. As such, these data obviate the need for disk-wide transport of chondrules prior to chondrite parent body accretion and are consistent with formation of chondrules from a given chondrite group in localized regions of the disk. Finally, the ubiquitous presence of {sup 50}Ti-enriched material in carbonaceous chondrites and the lack of this material in the non-carbonaceous chondrites support the idea that these two meteorite groups derive from areas of the disk that remained isolated from each other, probably through the formation of Jupiter.

79 ASTRONOMY AND ASTROPHYSICS↗

Resolving Mixtures of Soot Characterized by SP-AMS Spectra Using a Latent Dirichlet Allocation Model

Soot produced by detonation or combustion events exhibits different chemical properties depending on the fuel, device construction, and environmental conditions in which the event occurs. These properties can be useful for defining relevant signatures for probabilistically identifying the different types of events that occurred, based on the soot that is produced from these events. However, it is rare to observe samples of soot from a detonation or combustion that are not contaminated by outside particles. In this paper, we present a method for resolving mixtures of soot to determine the contributions of sources that may be present in samples of recovered soot. We use Latent Dirichlet Allocation to describe the generative process for a sample of recovered soot, and use Variational Bayesian Inference to learn about the parameters associated with the generative model. We demonstrate the utility of this method by considering real samples of mixtures of soot under various frameworks to show that the model is able to identify the different components present in a sample of soot as well as their mixing proportions.

54 ENVIRONMENTAL SCIENCES↗

Localized mix-induced radiative cooling in a capsule implosion at the National Ignition Facility

In this work, w present direct measurements of electron temperature variations within an inertially confined deuterium-tritium plasma caused by localized mix of higher-Z materials into the central hot spot. The data are derived from newly developed differentially filtered penumbral imaging of the bremsstrahlung continuum emission. Our analysis reveals distinct localized emitting features in the stagnated hot-spot plasma, and we infer spatial variations in the electron temperature: the mixed region is 660±130eV colder than the surrounding hot-spot plasma at 3.26±0.11keV. Our analysis of the energy flow shows that we measure approximately steady-state conditions where the radiative losses in the mix region are balanced by heat conduction from the surrounding hot deuterium-tritium plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

INTERNAL-CYCLE VARIATION OF SOLAR DIFFERENTIAL ROTATION

The latitudinal distributions of the yearly mean rotation rates measured by Suzuki in 1998 and 2012 and Pulkkinen and Tuominen in 1998 are utilized to investigate internal-cycle variation of solar differential rotation. The rotation rate at the solar equator seems to have decreased since cycle 10 onward. The coefficient B of solar differential rotation, which represents the latitudinal gradient of rotation, is found to be smaller in the several years after the minimum of a solar cycle than in the several years after the maximum time of the cycle, and it peaks several years after the maximum time of the solar cycle. The internal-cycle variation of the solar rotation rates looks similar in profile to that of the coefficient B. A new explanation is proposed to address such a solar-cycle-related variation of the solar rotation rates. Weak magnetic fields may more effectively reflect differentiation at low latitudes with high rotation rates than at high latitudes with low rotation rates, and strong magnetic fields may more effectively repress differentiation at relatively low latitudes than at high latitudes. The internal-cycle variation is inferred as the result of both the latitudinal migration of the surface torsional pattern and the repression of strong magnetic activity in differentiation.

79 ASTRONOMY AND ASTROPHYSICS↗

SDSS-IV MaNGA: the chemical co-evolution of gas and stars in spiral galaxies

ABSTRACT We investigate archaeologically how the metallicity in both stellar and gaseous components of spiral galaxies of differing masses evolve with time, using data from the SDSS-IV MaNGA survey. For the stellar component, we can measure this evolution directly by decomposing the galaxy absorption-line spectra into populations of different ages and determining their metallicities. For the gaseous component, we can only measure the present-day metallicity directly from emission lines. However, there is a well-established relationship between gas metallicity, stellar mass, and star formation rate which does not evolve significantly with redshift; since the latter two quantities can be determined directly for any epoch from the decomposition of the absorption-line spectra, we can use this relationship to infer the variation in gas metallicity over cosmic time. Comparison of present-day values derived in this way with those obtained directly from the emission lines confirms the validity of the method. Application of this approach to a sample of 1619 spiral galaxies reveals how the metallicity of these systems has changed over the last 10 billion yr since cosmic noon. For lower-mass galaxies, both stellar and gaseous metallicity increase together, as one might expect in well-mixed fairly isolated systems. In higher-mass systems, the average stellar metallicity has not increased in step with the inferred gas metallicity, and actually decreases with time. Such disjoint behaviour is what one might expect if these more massive systems have accreted significant amounts of largely pristine gas over their lifetimes, and this material has not been well mixed into the galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Improving the Confidence in Retrievals of Vertical Distributions of Cloud Condensation Nuclei Number Concentration from ARM Supported by Aircraft In Situ Observations

Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.

Tian, Jingjing↗

DYNAMICAL VERSUS STELLAR MASSES IN COMPACT EARLY-TYPE GALAXIES: FURTHER EVIDENCE FOR SYSTEMATIC VARIATION IN THE STELLAR INITIAL MASS FUNCTION

Several independent lines of evidence suggest that the stellar initial mass function (IMF) in early-type galaxies becomes increasingly 'bottom-heavy' with increasing galaxy mass and/or velocity dispersion, σ. Here we consider evidence for IMF variation in a sample of relatively compact early-type galaxies drawn from the Sloan Digital Sky Survey. These galaxies are of sufficiently high stellar density that a dark halo likely makes a minor contribution to the total dynamical mass, M {sub dyn}, within one effective radius. We fit our detailed stellar population synthesis models to the stacked absorption line spectra of these galaxies in bins of σ and find evidence from IMF-sensitive spectral features for a bottom-heavy IMF at high σ. We also apply simple 'mass-follows-light' dynamical models to the same data and find that M {sub dyn} is significantly higher than what would be expected if these galaxies were stellar dominated and had a universal Milky Way IMF. Adopting M {sub dyn} ≈ M {sub *} therefore implies that the IMF is 'heavier' at high σ. Most importantly, the quantitative amount of inferred IMF variation is very similar between the two techniques, agreeing to within ∼< 0.1 dex in mass. The agreement between two independent techniques, when applied to the same data, provides compelling evidence for systematic variation in the IMF as a function of early-type galaxy velocity dispersion. Any alternative explanations must reproduce both the results from dynamical and stellar population-based techniques.

79 ASTRONOMY AND ASTROPHYSICS↗