Search NASA⌕ Search

SEARCH · Search NASA

Results for “Variational neural network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

319 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Using Machine Learning to Generate a GISS ModelE Calibrated Physics Ensemble (CPE)

A neural network (NN) surrogate of the NASA GISS ModelE atmosphere (version E3) is trained on a perturbed parameter ensemble (PPE) spanning 45 physics parameters and 36 outputs. The NN is leveraged in a Markov Chain Monte Carlo (MCMC) Bayesian parameter inference framework to generate a second posterior constrained ensemble coined a “calibrated physics ensemble,” or CPE. The CPE members are characterized by diverse parameter combinations and are, by definition, close to top-of-atmosphere radiative balance, and must broadly agree with numerous hydrologic, energy cycle and radiative forcing metrics simultaneously. Global observations of numerous cloud, environment, and radiation properties (provided by global satellite products) are crucial for CPE generation. The inference framework explicitly accounts for discrepancies (or biases) in satellite products during CPE generation. We demonstrate that product discrepancies strongly impact calibration of important model parameter settings (e.g., convective plume entrainment rates; fall speed for cloud ice). Structural improvements new to E3 are retained across CPE members (e.g., stratocumulus simulation). Notably, the framework improved the simulation of shallow cumulus and Amazon rainfall while not degrading radiation fields, an upgrade that neither default parameters nor Latin Hypercube parameter searching achieved. Analyses of the initial PPE suggested several parameters were unimportant for output variation. However, many “unimportant” parameters were needed for CPE generation, a result that brings to the forefront how parameter importance should be determined in PPEs. From the CPE, two diverse 45-dimensional parameter configurations are retained to generate radiatively-balanced, auto-tuned atmospheres that were used in two E3 submissions to CMIP6.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

A Robust and Efficient Deep Learning Method for Dynamical Mass Measurements of Galaxy Clusters

We demonstrate the ability of convolutional neural networks (CNNs) to mitigate systematics in the virial scaling relation and produce dynamical mass estimates of galaxy clusters with remarkably low bias and scatter. We present two models, CNN 1D and CNN 2D , which leverage this deep learning tool to infer cluster masses from distributions of member galaxy dynamics. Our first model, CNN 1D , infers cluster mass directly from the distribution of member galaxy line-of-sight velocities. Our second model, CNN 2D , extends the input space ofCNN 1D to learn on the joint distribution of galaxy line-of-sight velocities and projected radial distances. We train each model as a regression over cluster mass using a labeled catalog of realistic mock cluster observations generated from the MultiDark simulation and UniverseMachine catalog. We then evaluate the performance of each model on an independent set of mock observations selected from the same simulated catalog. The CNN models produce cluster mass predictions with lognormal residuals of scatter as low as 0.132 dex, greater than a factor of 2 improvement over the classical M–σ power-law estimator. Furthermore, the CNN model reduces prediction scatter relative to similar machinelearning approaches by up to 17% while executing in drastically shorter training and evaluation times (by a factor of 30) and producing considerably more robust mass predictions (improving prediction stability under variations in galaxy sampling rate by 30%).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Machine learning framework for quantum sampling of highly constrained, continuous optimization problems

In recent years, there is growing interest in using quantum computers for solving combinatorial optimization problems. In this work, we developed a generic, machine learning-based framework for mapping continuous-space inverse design problems into surrogate quadratic unconstrained binary optimization (QUBO) problems by employing a binary variational autoencoder and a factorization machine. The factorization machine is trained as a low-dimensional, binary surrogate model for the continuous design space and sampled using various QUBO samplers. Using the D-Wave Advantage hybrid sampler and simulated annealing, we demonstrate that by repeated resampling and retraining of the factorization machine, our framework finds designs that exhibit figures of merit exceeding those of its training set. We showcase the framework’s performance on two inverse design problems by optimizing (i) thermal emitter topologies for thermophotovoltaic applications and (ii) diffractive meta-gratings for highly efficient beam steering. This technique can be further scaled to leverage future developments in quantum optimization to solve advanced inverse design problems for science and engineering applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Elucidating proximity magnetism through polarized neutron reflectometry and machine learning

Polarized neutron reflectometry is a powerful technique to interrogate the structures of multilayered magnetic materials with depth sensitivity and nanometer resolution. However, reflectometry profiles often inhabit a complicated objective function landscape using traditional fitting methods, posing a significant challenge for parameter retrieval. In this work, we develop a data-driven framework to recover the sample parameters from polarized neutron reflectometry data with minimal user intervention. We train a variational autoencoder to map reflectometry profiles with moderate experimental noise to an interpretable, low-dimensional space from which sample parameters can be extracted with high resolution. We apply our method to recover the scattering length density profiles of the topological insulator–ferromagnetic insulator heterostructure Bi2Se3/EuS exhibiting proximity magnetism in good agreement with the results of conventional fitting. We further analyze a more challenging reflectometry profile of the topological insulator–antiferromagnet heterostructure (Bi,Sb)2Te3/Cr2O3 and identify possible interfacial proximity magnetism in this material. We anticipate that the framework developed here can be applied to resolve hidden interfacial phenomena in a broad range of layered systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Online Monitoring System for Concrete Structures Affected by Alkali-Silica Reaction

This report presents a comprehensive study of developing ultrasonic wave and acoustic emission (AE) techniques for long-term monitoring of alkali-silica reaction (ASR) development in concrete. Small, medium, and full-scale concrete specimens were cast, conditioned, and monitored for various periods, from at least one year to 2.4 years. The reactive concrete specimens contain coarse or fine reactive aggregates to study the effects of different types of reactive aggregates. Confinements were also designed to simulate the 2-dimensional confinement effects of reinforcement in the shield building of nuclear power plants. The concrete specimens were stored in a environmental chamber with high humidity and high temperature to accelerate the ASR development. The ultrasonic monitoring data shows high sensitivity to ASR development and could detect cracking initiation well before visible surface cracks occurred. However, the linear ultrasonic analysis based on wave velocity is strongly affected by temperature variation. Therefore, a nonlinear ultrasonic method was proposed to measure thermally induced nonlinear acoustic responses of concrete (thermal modulation of ultrasonic wave). The measured nonlinear acoustic parameter shows a high correlation with ASR expansion across specimens with different reactive aggregates and confinement conditions. The same conclusion was obtained from nonlinear resonance tests on small concrete prisms. Compared to the linear acoustic methods, the nonlinear tests show high sensitivities to ASR damage from internal microcracking initiation at the early stage to visible cracks at the late stage of ASR. The attributes of the thermal modulation of nonlinear ultrasonic method include high sensitivity, immunity to temperature effects, and strong correlation with ASR expansion, which demonstrate great potentials of the nonlinear ultrasonic method for diagnosis of ASR damage and prediction of concrete deterioration process. Acoustic emission is a passive sensing technique for damage assessment, and access to only one surface is needed even for thick and heavily reinforced elements such as the walls utilized for nuclear shield building. Additionally, relatively few sensors are required to monitor the progression of the damage process. Results indicate that the AE data can be related to the damage rating index, which is a petrography-based means of assessing damage due to ASR in reinforced concrete. Furthermore, AE is capable of detecting ASR damage long before surface cracking is visually noticeable. Boundary conditions play in important role in the progression of ASR damage and differences in boundary conditions are reflected in the AE data. Entropy based data assessment methods provide a means to assess the damage state, and convolutional neural network based data assessment provided a means to assess the damage state in real-time. Results indicate that artificial neural network models may be used as a means to predict volumetric expansion based on AE data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Resimulation-based self-supervised learning for pretraining physics foundation models

Self-supervised learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be adapted to the type of training data and downstream tasks required. We propose resimulation-based self-supervised representation learning (RS3L), a novel simulation-based SSL strategy that employs a method of resimulation to drive data augmentation for contrastive learning in the physical sciences, particularly, in fields that rely on stochastic simulators. By intervening in the middle of the simulation process and rerunning simulation components downstream of the intervention, we generate multiple realizations of an event, thus producing a set of augmentations covering all physics-driven variations available in the simulator. Using experiments from high-energy physics, we explore how this strategy may enable the development of a foundation model; we show how RS3L pretraining enables powerful performance in downstream tasks such as discrimination of a variety of objects and uncertainty mitigation. In addition to our results, we make the RS3L dataset publicly available for further studies on how to improve SSL strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Lie algebraic theory of barren plateaus for deep parameterized quantum circuits

Variational quantum computing schemes train a loss function by sending an initial state through a parametrized quantum circuit, and measuring the expectation value of some operator. Despite their promise, the trainability of these algorithms is hindered by barren plateaus (BPs) induced by the expressiveness of the circuit, the entanglement of the input data, the locality of the observable, or the presence of noise. Up to this point, these sources of BPs have been regarded as independent. In this work, we present a general Lie algebraic theory that provides an exact expression for the variance of the loss function of sufficiently deep parametrized quantum circuits, even in the presence of certain noise models. Our results allow us to understand under one framework all aforementioned sources of BPs. This theoretical leap resolves a standing conjecture about a connection between loss concentration and the dimension of the Lie algebra of the circuit’s generators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Artificial-intelligence-driven shot reduction in quantum measurement

Variational Quantum Eigensolver (VQE) provides a powerful solution for approximating molecular ground state energies by combining quantum circuits and classical computers. However, estimating probabilistic outcomes on quantum hardware requires repeated measurements (shots), incurring significant costs as accuracy increases. Optimizing shot allocation is thus critical for improving the efficiency of VQE. Current strategies rely heavily on hand-crafted heuristics requiring extensive expert knowledge. This paper proposes a reinforcement learning (RL)-based approach that automatically learns shot assignment policies to minimize total measurement shots while achieving convergence to the minimum of the energy expectation in VQE. The RL agent assigns measurement shots across VQE optimization iterations based on the progress of the optimization. This approach reduces VQE's dependence on static heuristics and human expertise. When the RL-enabled VQE is applied to a small molecule, a shot reduction policy is learned. The policy demonstrates transferability across systems and compatibility with other wavefunction Ansätze. In addition to these specific findings, this work highlights the potential of RL for automatically discovering efficient and scalable quantum optimization strategies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Invariant discovery of features across multiple length scales: Applications in microscopy and autonomous materials characterization

Physical imaging is a foundational characterization method in areas from condensed matter physics and chemistry to astronomy and spans length scales from atomic to universe. Images encapsulate crucial data regarding atomic bonding, materials microstructures, and dynamic phenomena such as microstructural evolution and turbulence, among other phenomena. The challenge lies in effectively extracting and interpreting this information. Variational Autoencoders (VAEs) have emerged as powerful tools for identifying the underlying factors of variation in image data, providing a systematic approach to distilling meaningful patterns from complex data sets. However, a significant hurdle in their application is the definition and selection of appropriate descriptors reflecting local structures. Here, we introduce the scale-invariant VAE approach (SI-VAE) based on the progressive training of the VAE with the descriptors sampled at different length scales. The SI-VAE allows the discovery of the length scale-dependent factors of variation in the system. Here, we illustrate this approach using the ferroelectric domain images and generalize it to the movies of the electron-beam induced phenomena in graphene and topography evolution across combinatorial libraries. This approach can further be used to initialize the decision making in automated experiments including structure–property discovery and can be applied across a broad range of imaging methods. This approach is universal and can be applied to any spatially resolved data including both experimental imaging studies and simulations, and can be particularly useful for exploration of phenomena such as turbulence and scale-invariant transformation fronts.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Influence of weather on gobbling activity of male wild turkeys

Gobbling activity of Eastern wild turkeys (Meleagris gallopavo silvestris; hereafter, turkeys) has been widely studied, focusing on drivers of daily variation. Weather variables are widely believed to influence gobbling activity, but results across studies are contradictory and often equivocal, leading to uncertainty in the relative contribution of weather variables to daily fluctuations in gobbling activity. Previous works relied on road-based auditory surveys to collect gobbling data, which limits data consistency, duration, and quantity due to logistical difficulties associated with human observers and restricted sampling frames. Development of new methods using autonomous recording units (ARUs) allows researchers to collect continuous data in more locations for longer periods of time, providing the opportunity to delve into factors influencing daily gobbling activity. We used ARUs from 1 March to 31 May to detail gobbling activity across multiple study sites in the southeastern United States during 2014–2018. We used state-space modeling to investigate the effects of weather variables on daily gobbling activity. Our findings suggest rainfall, greater wind speeds, and greater temperatures negatively affected gobbling activity, whereas increasing barometric pressure positively affected gobbling activity. Therefore, when using daily gobbling activity to make inferences relative to gobbling chronology, reproductive phenology, and hunting season frameworks, stakeholders should recognize and consider the potential influences of extended periods of inclement weather.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Representations and strategies for transferable machine learning improve model performance in chemical discovery

Strategies for machine-learning (ML)-accelerated discovery that are general across material composition spaces are essential, but demonstrations of ML have been primarily limited to narrow composition variations. By addressing the scarcity of data in promising regions of chemical space for challenging targets such as open-shell transition-metal complexes, general representations and transferable ML models that leverage known relationships in existing data will accelerate discovery. Over a large set (~1000) of isovalent transition-metal complexes, we quantify evident relationships for different properties (i.e., spin-splitting and ligand dissociation) between rows of the Periodic Table (i.e., 3d/4d metals and 2p/3p ligands). We demonstrate an extension to the graph-based revised autocorrelation (RAC) representation (i.e., eRAC) that incorporates the group number alongside the nuclear charge heuristic that otherwise overestimates dissimilarity of isovalent complexes. To address the common challenge of discovery in a new space where data are limited, we introduce a transfer learning approach in which we seed models trained on a large amount of data from one row of the Periodic Table with a small number of data points from the additional row. We demonstrate the synergistic value of the eRACs alongside this transfer learning strategy to consistently improve model performance. Analysis of these models highlights how the approach succeeds by reordering the distances between complexes to be more consistent with the Periodic Table, a property we expect to be broadly useful for other material domains.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A flexible proton beam imaging energy spectrometer (PROBIES) for high repetition rate or single-shot high energy density (HED) experiments (invited)

The PROBIES diagnostic is a new, highly flexible, imaging and energy spectrometer designed for laser-accelerated protons. The diagnostic can detect low-mode spatial variations in the proton beam profile while resolving multiple energies on a single detector or more. When a radiochromic film stack is employed for “single-shot mode,” the energy resolution of the stack can be greatly increased while reducing the need for large numbers of films; for example, a recently deployed version allowed for 180 unique energy measurements spanning ~3 to 75 MeV with <0.4 MeV resolution using just 20 films vs 180 for a comparable traditional film and filter stack. When utilized with a scintillator, the diagnostic can be run in high-rep-rate (>Hz rate) mode to recover nine proton energy bins. Here, we also demonstrate a deep learning-based method to analyze data from synthetic PROBIES images with greater than 95% accuracy on sub-millisecond timescales and retrained with experimental data to analyze real-world images on sub-millisecond time-scales with comparable accuracy.

3D printing↗
DOE OSTI2023

Disruption event characterization and forecasting in tokamaks

Disruption prediction and avoidance is a critical need for next-step tokamaks, such as ITER. Disruption Event Characterization and Forecasting (DECAF) research fully automates analysis of tokamak data to determine chains of events that lead to disruptions and to forecast their evolution allowing sufficient time for mitigation or complete avoidance of the disruption. Disruption event chains related to local rotating or global magnetohydrodynamic (MHD) modes and vertical instability are examined with warnings issued for many off-normal physics events, including density limits, plasma dynamics, confinement transitions, and profile variations. Along with Greenwald density limit evaluation, a local radiative island power balance theory is evaluated and compared to the observation of island growth. Automated decomposition and analysis of rotating tearing modes produce physical event chains leading to disruptions. A total MHD state warning model comprised of 15 separate criteria produces a disruption forecast about 180 ms before a standard locked mode detector warning. Single DECAF event analyses have begun on KSTAR, MAST, and NSTX/-U databases with thousands of shot seconds of device operation using from 0.5 to 1 × 10 6 tested sample times per device. An initial multi-device database comparison illustrates a highly important result that plasma disruptivity does not need to increase as βN increases. Global MHD instabilities, such as resistive wall modes (RWMs), can give the briefest time period of warning before disruption compared to other physics events. In an NSTX database with unstable RWMs, the mode onset, loss of boundary and current control, and disruption event warnings are found in all cases and vertical displacement events are found in 91% of cases. An initial time-dependent reduced physics model of kinetic RWM stabilization created to forecast the disruption chain predicts instability 84% of the time for experimentally unstable cases with a relatively low false positive rate. Instances of the disruption event chain analysis illustrate dynamics including H–L back transitions for rotating MHD and global RWM triggering events. Furthermore, disruption warnings are issued with sufficient time before the disruption (on transport timescales) to potentially allow active profile control for disruption avoidance, active mode control, or mitigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗