Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Active learning of ternary alloy structures and energies

Abstract Machine learning models with uncertainty quantification have recently emerged as attractive tools to accelerate the navigation of catalyst design spaces in a data-efficient manner. Here, we combine active learning with a dropout graph convolutional network (dGCN) as a surrogate model to explore the complex materials space of high-entropy alloys (HEAs). We train the dGCN on the formation energies of disordered binary alloy structures in the Pd-Pt-Sn ternary alloy system and improve predictions on ternary structures by performing reduced optimization of the formation free energy, the target property that determines HEA stability, over ensembles of ternary structures constructed based on two coordinate systems: (a) a physics-informed ternary composition space, and (b) data-driven coordinates discovered by the Diffusion Maps manifold learning scheme. Both reduced optimization techniques improve predictions of the formation free energy in the ternary alloy space with a significantly reduced number of DFT calculations compared to a high-fidelity model. The physics-based scheme converges to the target property in a manner akin to a depth-first strategy, whereas the data-driven scheme appears more akin to a breadth-first approach. Both sampling schemes, coupled with our acquisition function, successfully exploit a database of DFT-calculated binary alloy structures and energies, augmented with a relatively small number of ternary alloy calculations, to identify stable ternary HEA compositions and structures. This generalized framework can be extended to incorporate more complex bulk and surface structural motifs, and the results demonstrate that significant dimensionality reduction is possible in thermodynamic sampling problems when suitable active learning schemes are employed.

Chemistry↗

Effects of ensembles, ligand, and strain on adsorbate binding to alloy surfaces

Alloying elements with strong and weak adsorption properties can produce a catalyst with optimally tuned adsorbate binding. A full understanding of this alloying effect, however, is not well-established. Here, we use density functional theory to study the ensemble, ligand, and strain effects of close-packed surfaces alloyed by transition metals with a combination of strong and weak adsorption of H and O. Specifically, we consider PdAu, RhAu, and PtAu bimetallics as ordered and randomly alloyed (111) surfaces, as well as randomly alloyed 140-atom clusters. In these alloys, Au is the weak-binding component and Pd, Rh, and Pt are characteristic strong-binding metals. In order to separate the different effects of alloying on binding, we calculate the tunability of H- and O-binding energies as a function of lattice constant (strain effect), number of alloy-substituted sublayers (ligand effect), and randomly alloyed geometries (ensemble effect). We find that on these alloyed surfaces, the ensemble effect more significantly tunes the adsorbate binding as compared to the ligand and strain effects, with the binding energies predominantly determined by the local adsorption environment provided by the specific triatomic ensemble on the (111) surface. However, we also find that tuning of adsorbate binding from the ligand and strain effects cannot be neglected in a quantitative description. Extending our studies to other bimetallics (PdAg, RhAg, PtAg, PdCu, RhCu, and PtCu), we find similar conclusions that the tunability of adsorbate binding on random alloys is predominately described by the ensemble effect.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

EQC: Ensembled Quantum Computing for Variational Quantum Algorithms

Variational quantum algorithms (VQA), which are comprised of a classical optimizer and a parameterized quantum circuit, emerges as one of the most promising approaches of harvesting quantum power in the noisy-intermediate-scale-quantum (NISQ) era. However, the deployment of VQAs on today's NISQ devices often faces considerable system noise and prohibitively slow training speeds. On the other hand, the expensive supporting sources and infrastructure make quantum computers extremely keen on high utilization. In this paper, we propose a novel way of thinking about a quantum backend: rather than relying on one physical device which tends to introduce platform-specific noise and bias, a quantum ensemble, which distributes quantum tasks across parallel devices, can serve as a virtualized quantum computer for offering reduced noise levels through an adaptive mixture and also provide significantly improved training speeds through parallelization. With this idea, we build a distributive VQA optimization framework called DVQA, serving as the first effort in adopting parallel quantum devices for cooperative VQA training. To further constraint noise and speed-up convergence, we design a model for individual NISQ devices concerning their properties and running conditions, and propose a weighting mechanism for regularizing the returned gradients. Extensive evaluations on 10 IBM-Q quantum devices using the VQE example show that the distributive VQA training framework can substantially boost the training speed by 10.5x on average (up to 86x and at least 5.2x) with improved training accuracy.

Stein, Samuel A.↗

The Power of Many: An Ensemble Approach to Spectral Similarity

Quantifying the similarity between two mass spectra─a known reference mass spectrum and an unidentified sample mass spectrum─is at the heart of compound identification workflows in gas chromatography–mass spectrometry (GC-MS). The reference spectrum most like the sample is assigned as its identification (provided some quantitative similarity threshold is met, e.g., 80%) and thus accurately measuring similarity is essential. Significant research has gone toward developing metrics for this purpose, each of which has attempted to improve upon existing methods by incorporating GC-MS-specific information (e.g., peak ratios or retention times) or adopting various statistical and algorithmic frameworks. While this active development has led to a plethora of similarity metrics with demonstrated value across different contexts, the unfortunate consequence has been confusion surrounding which metric should be used as a global standard. No such metric is currently accepted as the standard method because different metrics have demonstrated optimal performance in different contexts. In this work, we propose an ensemble approach to spectral similarity scoring that combines the collective information from across existing similarity metrics to form an improved, globally representative similarity metric as a step toward establishing a global standard method. In conclusion, the resulting ensemble metrics are evaluated on over 88,000 spectra of varying complexity and demonstrate improved abilities to accurately rank the correct reference spectrum as the top-matching candidate for a sample relative to the rankings generated by individual similarity scores.

Carbohydrates↗

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗

Dataset from Manuscript: CO2 Electroreduction on Borated Copper Surfaces: Boron Active Sites, not Copper

(1) hcoverage-gcga: .db files with structures and data from GCGA sampling at various potentials (2) hcoverage-gcdft/vaspSC-finished.db: .db file with GCDFT calculations and structures on the sub-ensemble of various H coverages on CuB(3) int_ts: Optimized structures of intermediates and transition states for HER (H26.db and H39.db for LC and HC respectively), B migration (H33.db and H34.db), and CORR (H26.db and H39.db for LC and HC respectively)

Boron↗

Optimized recursion relation for the computation of partition functions in the superconfiguration approach

Partition functions of a canonical ensemble of non-interacting bound electrons are a key ingredient of the super-transition-array approach to the computation of radiative opacity. A few years ago, we published a robust and stable recursion relation for the calculation of such partition functions. In this work, we propose an optimization of the latter method and explain how to implement it in practice. The formalism relies on the evaluation of elementary symmetric polynomials, which opens the way to further improvements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

The role of pressure in inverse design for assembly

Isotropic pairwise interactions that promote the self-assembly of complex particle morphologies have been discovered by inverse design strategies derived from the molecular coarse-graining literature. While such approaches provide an avenue to reproduce structural correlations, thermodynamic quantities such as the pressure have typically not been considered in self-assembly applications. In this work, we demonstrate that relative entropy optimization can be used to discover potentials that self-assemble into targeted cluster morphologies with a prescribed pressure when the iterative simulations are performed in the isothermal-isobaric ensemble. The benefits of this approach are twofold. First, the structure and the thermodynamics associated with the optimized interaction can be controlled simultaneously. Second, by varying the pressure in the optimization, a family of interparticle potentials that all self-assemble the same structure can be systematically discovered, allowing for a deeper understanding of self-assembly of a given target structure and providing multiple assembly routes for its realization. Selecting an appropriate simulation ensemble to control the thermodynamic properties of interest is a general design strategy that could also be used to discover interaction potentials that self-assemble structures having, for example, a specified chemical potential.

74 ATOMIC AND MOLECULAR PHYSICS↗

Contributions of the electronic spin and orbital current to the CoCl{sub 4}{sup 2-} magnetic field probed in polarised neutron diffraction experiments

Polarised neutron diffraction experiments conducted at 4.2 K on Cs{sub 3}CoCl{sub 5} crystals have been analysed by using a four-dimensional model Hilbert space made of ab initio n-electron wave functions of the CoCl{sub 4}{sup 2-} molecular ion. Two spin-orbit mixing coefficients and several configuration interaction coefficients have been optimized by fitting calculated magnetic structure factors to experimental ones, to obtain the best ensemble density operator that is representable in the model space. A goodness of fit, {chi}{sup 2}, less then 1 has been obtained for the first time for the two experimental data sets available. In the present article, the optimized density operators are used to calculate the magnetic field densities that are the genuine observables probed in neutron diffraction experiments. Density maps of such observables are presented for the first time and numerical details are provided. The respective contributions of spin density and orbital current to the magnetic field density are analyzed.

36 MATERIALS SCIENCE↗

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

A Pattern-Recognition-Based Ensemble Data Imputation Framework for Sensors from Building Energy Systems

Building operation data are important for monitoring, analysis, modeling, and control of building energy systems. However, missing data is one of the major data quality issues, making data imputation techniques become increasingly important. There are two key research gaps for missing sensor data imputation in buildings: the lack of customized and automated imputation methodology, and the difficulty of the validation of data imputation methods. In this paper, a framework is developed to address these two gaps. First, a validation data generation module is developed based on pattern recognition to create a validation dataset to quantify the performance of data imputation methods. Second, a pool of data imputation methods is tested under the validation dataset to find an optimal single imputation method for each sensor, which is termed as an ensemble method. The method can reflect the specific mechanism and randomness of missing data from each sensor. The effectiveness of the framework is demonstrated by 18 sensors from a real campus building. The overall accuracy of data imputation for those sensors improves by 18.2% on average compared with the best single data imputation method.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Assessment of enzyme active site positioning and tests of catalytic mechanisms through X-ray–derived conformational ensembles

How enzymes achieve their enormous rate enhancements remains a central question in biology, and our understanding to date has impacted drug development, influenced enzyme design, and deepened our appreciation of evolutionary processes. While enzymes position catalytic and reactant groups in active sites, physics requires that atoms undergo constant motion. Numerous proposals have invoked positioning or motions as central for enzyme function, but a scarcity of experimental data has limited our understanding of positioning and motion, their relative importance, and their changes through the enzyme’s reaction cycle. To examine positioning and motions and test catalytic proposals, we collected “room temperature” X-ray crystallography data for Pseudomonas putida ketosteroid isomerase (KSI), and we obtained conformational ensembles for this and a homologous KSI from multiple PDB crystal structures. Here, ensemble analyses indicated limited change through KSI’s reaction cycle. Active site positioning was on the 1- to 1.5-Å scale, and was not exceptional compared to noncatalytic groups. The KSI ensembles provided evidence against catalytic proposals invoking oxyanion hole geometric discrimination between the ground state and transition state or highly precise general base positioning. Instead, increasing or decreasing positioning of KSI’s general base reduced catalysis, suggesting optimized Ångstrom-scale conformational heterogeneity that allows KSI to efficiently catalyze multiple reaction steps. Ensemble analyses of surrounding groups for WT and mutant KSIs provided insights into the forces and interactions that allow and limit active-site motions. Most generally, this ensemble perspective extends traditional structure–function relationships, providing the basis for a new era of “ensemble–function” interrogation of enzymes.

59 BASIC BIOLOGICAL SCIENCES↗

Control Design for Inhomogeneous-Broadening Compensation in Single-Photon Transducers

We report a transducer of single photons between microwave and optical frequencies can be used to realize quantum communication over optical fiber links between distant superconducting quantum computers. A promising scalable approach to constructing such a transducer is to use ensembles of quantum emitters interacting simultaneously with electromagnetic fields at optical and microwave frequencies. However, inhomogeneous broadening in the transition frequencies of the emitters can be detrimental to this collective action. In this paper, we utilize a gradient-based optimization strategy to design the temporal shape of the laser field driving the transduction system to mitigate the effects of inhomogeneous broadening. We study the improvement of transduction efficiencies as a function of inhomogeneous broadening in different single-emitter cooperativity regimes and correlate it with a restoration of super-radiance effects in the emitter ensembles. Furthermore, to assess the optimality of our pulse designs, we provide certifiable bounds on the design problem and compare them to the achieved performance.

74 ATOMIC AND MOLECULAR PHYSICS↗

Evaluation and Optimization of Snow Albedo Scheme in Noah-MP Land Surface Model Using In Situ Spectral Observations in the Colorado Rockies

The Biosphere-Atmosphere Transfer Scheme (BATS) ground snow albedo algorithm is commonly used in land-surface models (LSM), weather forecasting and research applications. This study addresses key uncertainties in BATS simulated ground snow albedo within the Noah-MP LSM framework through evaluation and optimization of the Noah-MP BATS ground snow albedo formulation using 2-band (visible and near-infrared (NIR)) in situ albedo observations at Rocky Mountain field stations. The Noah-MP BATS ground snow albedo scheme is extremely sensitive to its input parameters. Namely, an ensemble generated by varying BATS input parameters within potentially plausible ranges provides an average daily range (maximum ensemble member minus minimum ensemble member) of ground snow albedo exceeding 0.45 in visible and NIR bands. Parameter optimization improves agreement between simulated and in situ observed ground snow albedo in visible, NIR and broadband spectrums. Importantly, optimized parameters result in reduced biases relative to observed fresh-snow albedo and better agreement with observed albedo decay. Our analysis across different sites supports that the optimized BATS ground snow albedo parameters are appropriate to transfer in space and time, at least within the region studied (the central-southern Rocky Mountains). The primary error source remaining after parameter optimization is that observed fresh-snow albedo is highly variable, particularly in the NIR spectrum, whereas BATS fresh-snow albedo is constant, an issue which requires further investigation. This study shows significant correlations between observed fresh-snow albedo and surface meteorological conditions (e.g., downward shortwave radiation and temperature) which can support future model development that attempts to include a time-varying formulation for fresh-snow albedo.

54 ENVIRONMENTAL SCIENCES↗

Discovery of Tarantula Venom-Derived Na V 1.7-Inhibitory JzTx-V Peptide 5-Br-Trp24 Analogue AM-6120 with Systemic Block of Histamine-Induced Pruritis

Inhibitors of the voltage-gated sodium channel Na V 1.7 are being investigated as pain therapeutics due to compelling human genetics. We previously identified Na V 1.7-inhibitory peptides GpTx-1 and JzTx-V from tarantula venom screens. Potency and selectivity were modulated through attribute-based positional scans of native residues via chemical synthesis. In this paper, we report JzTx-V lead optimization to identify a pharmacodynamically active peptide variant. Molecular docking of peptide ensembles from NMR into a homology model-derived Na V 1.7 structure supported prioritization of key residues clustered on a hydrophobic face of the disulfide-rich folded peptide for derivatization. Replacing Trp24 with 5-Br- Trp24 identified lead peptides with activity in electrophysiology assays in engineered and neuronal cells. 5-Br-Trp24 containing peptide AM-6120 was characterized in X-ray crystallography and pharmacokinetic studies and blocked histamine-induced pruritis in mice after subcutaneous administration, demonstrating systemic Na V 1.7-dependent pharmacodynamics. Our data suggests a need for high target coverage based on plasma exposure for impacting in vivo end points with selectivity-optimized peptidic Na V 1.7 inhibitors.

60 APPLIED LIFE SCIENCES↗

Big Data-Based Approach to Detect, Locate, and Enhance the Stability of an Unplanned Microgrid Islanding

In this paper, a big data-based approach is proposed for the security improvement of an unplanned microgrid islanding (UMI). The proposed approach contains two major steps: the first step is big data analysis of wide-area monitoring to detect a UMI and locate it; the second step is particle swarm optimization (PSO)-based stability enhancement for the UMI. First, an optimal synchrophasor measurement device selection (OSMDS) and matching pursuit decomposition (MPD)-based spatial-temporal analysis approach is proposed to significantly reduce the volume of data while keeping appropriate information from the synchrophasor measurements. Second, a random forest-based ensemble learning approach is trained to detect the UMI. When combined with grid topology, the UMI can be located. Then the stability problem of the UMI is formulated as an optimization problem and the PSO is used to find the optimal operational parameters of the UMI. An eigenvalue-based multiobjective function is proposed, which aims to improve the damping and dynamic characteristics of the UMI. Finally, the simulation results demonstrate the effectiveness and robustness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗