Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Nucleon Structure from 2+1 Flavor Domain Wall QCD at Nearly Physical Pion Mass

The RBC and UKQCD collaborations have been investigating hadron physics in numerical lattice quantum chromodynamics (QCD) with (2+1) flavors of dynamical domain wall fermions (DWF) quarks that preserves continuum-like chiral and flavor symmetries. The strange quark mass is adjusted to physical value via reweighting and degenerate up and down quark masses are set as light as possible. In a recent study of nucleon structure we found a strong dependence on pion mass and lattice spatial extent in isovector axialvector-current form factors. This is likely the first credible evidence for the pion cloud surrounding nucleon. Here we report the status of nucleon structure calculations with a new (2+1)-flavor dynamical DWF ensembles with much lighter pion mass of 180 and 250 MeV and a much larger lattice spatial exent of 4.6 fm. A combination of the Iwasaki and dislocation-suppressing-determinant-ratio (I+DSDR) gauge action and DWF fermion action allows us to generate these ensembles at cutoff of about 1.4 GeV while keeping the residual breaking of chiral symmetry sufficiently small. Nucleon source Gaussian smearing has been optimized. Preliminary nucleon mass estimates are 0.98 and 1.05 GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

LDRD Macromolcule Radiolysis Poster

Moving toward a circular carbon economy depends on enabling reuse of carbon-based macromolecules and increased recycling of waste products into higher value products. Macromolecules are challenging to valorize into products easily converted into liquid fuel or chemical feedstocks, due to their large and sometimes heterogeneous network of polymeric bonds. The novel aspect of this project is to show a proof of principle that radiolysis of macromolecules using “waste” radiation from energy production in the presence of radical capping donors presents an attractive opportunity to break down complex macromolecules into smaller molecules while controlling re-polymerization. This approach offers a new, cost-efficient way to utilize “waste” radiation and heat byproducts of nuclear energy production to convert a simple mixture of complex molecules into a complex mixture of small molecules, to be utilized as an energy source by the fuel industry, or to create value-added feedstocks for new polymers or commodity chemicals. Ionizing radiation can be harnessed to convert energy to molecules, adding value to low-value macromolecules as they are broken down into smaller, more easily separated feedstocks or fuels to be converted to a value-added product. This project will test 2 hypotheses. Hypothesis 1: Macromolecular materials that comprise biomass and coal or other macromolecules can be infused with radical capping donors (RCDs), and gamma irradiation of the resulting mixtures will produce ensembles of lower-molecular weight chemicals that can be more easily separated. If this expectation is realized, the conversion chemistry can be optimized by adjusting the feedstock composition, irradiation time, and choice of RCD.

02 - PETROLEUM↗

Scalable molecular dynamics on CPU and GPU architectures with NAMD

NAMD is a molecular dynamics program designed for high-performance simulations of very large biological objects on CPU- and GPU-based architectures. NAMD offers scalable performance on petascale parallel supercomputers consisting of hundreds of thousands of cores, as well as on inexpensive commodity clusters commonly found in academic environments. It is written in C++ and leans on Charm++ parallel objects for optimal performance on low-latency architectures. NAMD is a versatile, multipurpose code that gathers state-of-the-art algorithms to carry out simulations in apt thermodynamic ensembles, using the widely popular CHARMM, AMBER, OPLS, and GROMOS biomolecular force fields. Here, we review the main features of NAMD that allow both equilibrium and enhanced-sampling molecular dynamics simulations with numerical efficiency. We describe the underlying concepts utilized by NAMD and their implementation, most notably for handling long-range electrostatics; controlling the temperature, pressure, and pH; applying external potentials on tailored grids; leveraging massively parallel resources in multiple-copy simulations; and hybrid quantum-mechanical/molecular-mechanical descriptions. We detail the variety of options offered by NAMD for enhanced-sampling simulations aimed at determining free-energy differences of either alchemical or geometrical transformations and outline their applicability to specific problems. Last, we discuss the roadmap for the development of NAMD and our current efforts toward achieving optimal performance on GPU-based architectures, for pushing back the limitations that have prevented biologically realistic billion-atom objects to be fruitfully simulated, and for making large-scale simulations less expensive and easier to set up, run, and analyze. NAMD is distributed free of charge with its source code at www.ks.uiuc.edu.

high-performance computing↗

Recent advances in machine learning towards multiscale soft materials design

The multiscale design of soft materials requires an ensemble of computational techniques spanning quantum-chemistry to molecular dynamics to continuum modeling. The recent emergence of machine-learning (ML) and modern optimization algorithms has accelerated material property prediction, as well as stimulated the development of hybrid ML/molecular modeling methodologies capable of providing physical insights unobtainable from purely physics-based modeling and intuition. Such hybrid techniques also have important ramifications for the ML-enhanced interpretation of results from simulations and experiments alike. Leveraging ML techniques for the design of chemical or morphological structures based on a target property or functionality represents an exciting goal for the general area of soft materials, including polymers, liquid crystals, colloids, or biomolecules, to name a few representative classes of systems. Furthermore, we provide a perspective on recent work using ML techniques of relevance for the multiscale design of soft materials and outline potential future directions of interest to the soft materials community.

36 MATERIALS SCIENCE↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Ensemble Quasi-Newton HMC

We present a modification of the Hybrid Monte Carlo algorithm for tackling the critical slowing down of generating Markov chains of lattice gauge configurations towards the continuum limit. We propose a new method to exchange information within an ensemble of Markov chains, and use it to construct an approximate inverse Hessian matrix of the action inspired from quasi-Newton algorithms for optimization. The kinetic term of the molecular dynamics evolution includes the approximate Hessian for long distance couplings among the momenta. We show the result of applying the new algorithm to the U(1) gauge theory in two dimensions, and discuss our future plans.

Jin, Xiao-Yong↗

Mapping Stellar Surfaces. II. An Interpretable Gaussian Process Model for Light Curves

The use of Gaussian processes (GPs) as models for astronomical time series data sets has recently become almost ubiquitous, given their ease of use and flexibility. In particular, GPs excel at marginalization over the stellar signal when the variability due to starspots is treated as a nuisance, as in exoplanet transit modeling. However, these effective models are less useful in cases where the starspot signal is of primary interest, since it is not obvious how the parameters of the GP relate to physical parameters like the spot size, contrast, and latitudinal distribution. Instead, it is common practice to explicitly model the effect of individual starspots on the light curve and attempt to infer their properties via optimization or posterior inference. Unfortunately, this process is ill-posed and often computationally intractable when applied to stars with more than a few spots and/or to ensembles of many stars. Here we derive a closed-form expression for a GP that describes the light curve of a rotating, evolving stellar surface conditioned on a given distribution of starspot sizes, contrasts, and latitudes. We demonstrate that this model is correctly calibrated, allowing one to robustly infer physical parameters of interest from one or more light curves, including the typical spot radii and latitudes. Our GP has far-ranging implications for understanding the variability and magnetic activity of stars from light curves and radial velocity measurements, as well as for modeling correlated noise in exoplanet searches. Our implementation is efficient, user-friendly, and open-source, available in the package starry-process.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Observation of prolonged coherence time of the collective spin wave of an atomic ensemble in a paraffin-coated {sup 87}Rb vapor cell

We report a prolonged coherence time of the collective spin wave of a thermal {sup 87}Rb atomic ensemble in a paraffin-coated cell. The spin wave is prepared through a stimulated Raman process. The long coherence time is achieved by prolonging the lifetime of the spins with paraffin coating and minimize dephasing with optimal experimental configuration. The observation of the long-time-delayed-stimulated Stokes signal in the writing process suggests the prolonged lifetime of the prepared spins; a direct measurement of the decay of anti-Stokes signal in the reading process shows the coherence time is up to 300 mus after minimizing dephasing. This is 100 times longer than the reported coherence time in the similar experiments in thermal atomic ensembles based on the Duan-Lukin-Cirac-Zoller and its improved protocols. This prolonged coherence time sets the upper limit of the memory time in quantum repeaters based on such protocols, which is crucial for the realization of long-distance quantum communication. The previous reported fluorescence background in the writing process due to collision in a sample cell with buffer gas is also reduced in a cell without buffer gas.

74 ATOMIC AND MOLECULAR PHYSICS↗

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗

Toward machine-learning-assisted PW-class high-repetition-rate experiments with solid targets

We present progress in utilizing a machine learning (ML) assisted optimization framework to study the trends in a parameter space defined by spectrally shaped, high-intensity, petawatt-class (8 J, 45 fs) laser pulses interacting with solid targets and give the first simulation-based overview of predicted trends. A neural network (NN) incorporating uncertainty quantification is trained to predict the number of hot electrons generated by the laser–target interaction as a function of pulse shaping parameters. The predictions of this NN serve as the basis function for a Bayesian optimization framework to navigate this space. For post-experimental evaluation, we compare two separate neural network (NN) models. One is based solely on data from experiments, and the other is trained only on ensemble particle-in-cell simulations. Reviewing the predicted and observed trends across the experiment-capable laser parameter search space, we find that both ML models predict a maximal increase in hot electron generation at a level of approximately 12%–18%; however, no statistically significant enhancement was observed in experiments. On direct comparison of the NN models, the average discrepancy is 8.5%, with a maximum of 30%. Since shot-to-shot fluctuations in experiments affect the observations, we evaluate the behavior of our optimization framework by performing virtual experiments that vary the number of repeated observations and the noise levels. Here, we discuss the implications of such a framework for future autonomous exploration platforms in high-repetition-rate experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Storing entanglement of nuclear spins via Uhrig dynamical decoupling

Stroboscopic spin flips have already been shown to prolong the coherence times of quantum systems under noisy environments. Uhrig's dynamical decoupling scheme provides an optimal sequence for a quantum system interacting with a dephasing bath. Several experimental demonstrations have already verified the efficiency of such dynamical decoupling schemes in preserving single-qubit coherences. In this work we describe the experimental study of Uhrig's dynamical decoupling in preserving two-qubit entangled states using an ensemble of spin-1/2 nuclear pairs in solution state. We find that the performance of odd-order Uhrig sequences in preserving entanglement is superior to both even-order Uhrig sequences and periodic spin-flip sequences. We also find that there exists an optimal order of the Uhrig sequence in which a singlet state can be stored at high correlation for about 30 seconds.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Learning from many collider events at once

There have been a number of recent proposals to enhance the performance of machine learning strategies for collider physics by combining many distinct events into a single ensemble feature. To evaluate the efficacy of these proposals, we study the connection between single-event classifiers and multievent classifiers under the assumption that collider events are independent and identically distributed. We show how one can build optimal multievent classifiers from single-event classifiers, and we also show how to construct multievent classifiers such that they produce optimal single-event classifiers. This is illustrated for a Gaussian example as well as for classification tasks relevant for searches and measurements at the Large Hadron Collider. We extend our discussion to regression tasks by showing how they can be phrased in terms of parametrized classifiers. Empirically, we find that training a single-event (per-instance) classifier is more effective than training a multievent (per-ensemble) classifier, as least for the cases we studied, and we relate this fact to properties of the loss function gradient in the two cases. While we did not identify a clear benefit from using multievent classifiers in the collider context, we speculate on the potential value of these methods in cases involving only approximate independence, as relevant for jet substructure studies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Paw-Net: Stacking ensemble deep learning for segmenting scanning electron microscopy images of fine-grained shale samples

Segmentation of scanning electron microscopy (SEM) images is critical yet time-consuming for geological analyses, as it needs to differentiate the boundaries for different mineral objects to facilitate subsequent analyses, such as porosity calculation. Recently, various machine learning methods, especially convolutional neural networks (CNNs), have been explored to segment SEM images of fine-grained shale samples. However, we found that general CNNs do not yield optimal performance due to insufficient training data and imbalanced objects in SEM images. This work has revised the U-Net architecture, a popular approach for biomedical image analyses, by incorporating a loss function that addresses the imbalance issue. Furthermore, we used the ensemble learning method to train multiple models and combined the results to improve the overall performance of segmentation. We prepared 2162 sub-images from raw SEM images in our experiments and divided them into training, validation, and testing datasets. The overall results show that our method improves the average Intersection over Union (IOU) of mineral objects from 0.49 to 0.58, compared to the original U-Net model. Our method can clearly distinguish each object from others with boundaries, even in highly imbalanced images. Training our models takes less than three minutes using a single GPU, while manual labeling can take up to three hours for each image. Furthermore, the method helps geoscientists gain insights quickly and effectively by building neural network models from a small dataset of SEM images.

58 GEOSCIENCES↗

Prediction of grain structure after thermomechanical processing of U-10Mo alloy using sensitivity analysis and machine learning surrogate model

Abstract Hot rolling and annealing are critical intermediate steps for controlling microstructures and thickness variations when fabricating uranium alloyed with 10% molybdenum (U-10Mo), which is highly relevant to worldwide nuclear non-proliferation efforts. This work proposes a machine-learning surrogate model combined with sensitivity analysis to identify and predict U-10Mo microstructure development during thermomechanical processing. Over 200 simulations were collected using physics-based microstructure models covering a wide range of thermomechanical processing routes and initial alloy grain features. Based on the sensitivity analysis, we determined that an increase in rolling reduction percentage at each processing pass has the strongest effect in reducing the grain size. Multi-pass rolling and annealing can significantly improve recrystallization regardless of the reduction percentage. With a volume fraction below 2%, uranium carbide particles were found to have marginal effects on the average grain size and distribution. The proposed stratified stacking ensemble surrogate predicts the U-10Mo grain size with a mean square error four times smaller than a standard single deep neural network. At the same time, with a significant speedup (1000×) compared to the physics-based model, the machine learning surrogate shows good potential for U-10Mo fabrication process optimization.

36 MATERIALS SCIENCE↗

Robust deep learning framework for constitutive relations modeling

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. Here, we propose a general encoder-decoder deep learning framework that can model high-dimensional stress-strain data and complex loading histories with robustness and universal capability. The framework employs an encoder to project high-dimensional input information (e.g., loading history, loading conditions, and materials information) to a lower-dimensional hidden space and a decoder to map the hidden representation to the stress of interest. We evaluated various encoder architectures, including gated recurrent unit (GRU), GRU with attention, temporal convolutional network (TCN), and the Transformer encoder, on two complex stress-strain datasets that were designed to include a wide range of complex loading histories and loading conditions. All architectures achieved excellent test results with an root-mean-square error (RMSE) below 1 MPa. Additionally, we analyzed the capability of the different architectures to make predictions on out-of-domain applications, with an uncertainty estimation based on deep ensembles. The proposed approach provides a robust alternative to empirical/semi-empirical models for CRs modeling, offering the potential for more accurate and efficient materials design and optimization.

36 MATERIALS SCIENCE↗

Resolving atomistic structure and oxygen evolution activity in nickel antimonates

The oxygen evolution reaction (OER) requires electrodes that are not only catalytically active, but also stable under harsh electrochemical environments to enable efficient, durable technologies. Our recent report of a stable amorphous Ni 0.5 Sb 0.5 O z OER photoanode established Ni–Sb–O as an important system for computational understanding of both the structural and catalytic behavior of these complex oxides. In the present work we show that Ni x Sb 1-x O z with x > 0.33 crystallizes into a previously unknown phase. Guided by experimental X-ray diffraction, here, we use density functional theory calculations to perform a prototype phase search to identify a broad family of stable and metastable mixed rutile and hexagonal-like phases for x = 0.33, 0.50, and 0.66 compositions. For the identified phases, we predict favorable oxygen vacancy formation energies for Ni-rich compositions under the reducing synthesis conditions which match measured Ni K-edge X-ray absorption spectra. The calculated overpotential for the most active site decreases with increasing Ni content, from 0.91 V (x = 0.33) to 0.49 V (x = 0.66), which captures the experimentally observed trend. We find the active site changes from the Ni–O–Sb bridge to a Ni–O–Ni bridge at increasing Ni concentrations, rather than the commonly studied singly under-coordinated sites. Finally, detailed Pourbaix analysis of the identified phases show excellent electrochemical stability, consistent with experimentally measured low metal ion concentrations in the electrolyte of photoelectrochemical cells. Collectively, our consideration of an ensemble of structures enables identification of the most catalytically prolific structural motifs, aiding the understanding of crystalline and amorphous catalysts and elucidating the co-optimization of activity and durability in nickel antimonates.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

EFIT-Prime: Probabilistic and physics-constrained reduced-order neural network model for equilibrium reconstruction in DIII-D

We introduce EFIT-Prime, a novel machine learning surrogate model for EFIT (Equilibrium FIT) that integrates probabilistic and physics-informed methodologies to overcome typical limitations associated with deterministic and ad hoc neural network architectures. EFIT-Prime utilizes a neural architecture search-based deep ensemble for robust uncertainty quantification, providing scalable and efficient neural architectures that comprehensively quantify both data and model uncertainties. Physically informed by the Grad–Shafranov equation, EFIT-Prime applies a constraint on the current density J tor and a smoothness constraint on the first derivative of the poloidal flux, ensuring physically plausible solutions. Furthermore, the spatial location of the diagnostics is explicitly incorporated in the inputs to account for their spatial correlation. Extensive evaluations demonstrate EFIT-Prime's accuracy and robustness across diverse scenarios, most notably showing good generalization on negative-triangularity discharges that were excluded from training. Timing studies indicate an ensemble inference time of 15 ms for predicting a new equilibrium, offering the possibility of plasma control in real-time, if the model is optimized for speed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-objective optimization of interatomic potentials with application to MgO

The parameterization of a functional form for an interatomic potential is treated as a problem in multi-objective optimization. An autonomous, machine-learning approach based on the identification of the Pareto hypersurface of errors in predicted properties allows the development of an ensemble of parameterizations with high materials fidelity and robustness. The efficacy of this approach is illustrated for the simple example of a Buckingham potential for MgO. This approach also provides a strong foundation for uncertainty quantification of potential parameterizations.

36 MATERIALS SCIENCE↗