Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Principles of Bayesian Ensemble Creation: Theoretical and Empirical Observations

Bayesian methods are theoretically optimal given their underlying assumptions. Bayesian model averaging (BMA) is generally considered the standard model for creating ensembles of learners using Bayesian methods, but this technique is often out-performed by more ad hoc methods in empirical studies. It has been proposed that Bayesian model averaging struggles in practice because it accounts for uncertainty about which model is the data-generating model but still operates under the assumption that only one of them is. Thus, BMA is unable to enrich the hypothesis space as effectively as other ensemble creation methods, serving as a form of optimal model selection, not optimal model combination. This work provides empirical verification for this hypothesis using both synthetic and real-world data. We propose several different approaches for Bayesian model combination, and demonstrate that they overcome this problem with BMA. We empirically show that even the most simplistic of Bayesian model combination strategies can compete with the traditional ad hoc techniques of bagging, boosting and stacking, as well as significantly outperforming BMA over a wide variety of cases. We also explore the implications of this observation as it relates to the effectiveness of ensemble learning.

97 MATHEMATICS AND COMPUTING↗

Optimized program completeness

Overall program completeness is optimized by selecting the ordered set of observations and targets that maximizes the efficiency for the ensemble of stars. We describe the optimization approach and report on completeness sensitivity to instrument throughput, inner working angle, instrument sensitivity, observational overhead, exo-zodiacal brightness, and target revisit constraints.

optimization↗

Optimizing the formation of depth-confined nitrogen vacancy center spin ensembles in diamond for quantum sensing

Spin ensembles of nitrogen vacancy (NV) centers in diamond are emerging as powerful spin-based sensors for magnetic, electric and thermal field imaging with high spatial and temporal resolution. In this work, we characterize the formation of depth-confined NV center ensembles, activated by electron irradiation in diamond layers grown by plasma enhanced chemical vapor deposition with nitrogen co-doping. To do so, we exploit the high magnetic sensitivity of ensembles of NV centers to probe their spin environment as a function of growth and irradiation parameters. We engineer an NV ensemble whose magnetic sensitivity is within a factor of two of the static NV-NV dipolar interaction limit, thus demonstrating a powerful platform for quantum sensing.

36 MATERIALS SCIENCE↗

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)↗

Toward “optimal” integration of terrestrial biosphere models

Multimodel ensembles (MME) are commonplace in Earth system modeling. Here we perform MME integration using a 10-member ensemble of terrestrial biosphere models (TBMs) from the Multiscale synthesis and Terrestrial Model Intercomparison Project (MsTMIP). We contrast optimal (skill based for present-day carbon cycling) versus naive (one model-one vote) integration. MsTMIP optimal and naive mean land sink strength estimates (-1.16 versus -1.15 Pg C per annum respectively) are statistically indistinguishable. This holds also for grid cell values and extends to gross uptake, biomass, and net ecosystem productivity. TBM skill is similarly indistinguishable. The added complexity of skill-based integration does not materially change MME values. This suggests that carbon metabolism has predictability limits and/or that all models and references are misspecified. Finally, resolving this issue requires addressing specific uncertainty types (initial conditions, structure, and references) and a change in model development paradigms currently dominant in the TBM community.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Approach for Spatiotemporal Multivariate Optimization of Environmental Monitoring Sensor Locations

Abstract Long-term environmental monitoring is critical for managing the soil and groundwater at contaminated sites. Recent improvements in state-of-the-art sensor technology, communication networks, and artificial intelligence have created opportunities to modernize this monitoring activity for automated, fast, robust, and predictive monitoring. In such modernization, it is required that sensor locations be optimized to capture the spatiotemporal dynamics of all monitoring variables as well as to make it cost-effective. The legacy monitoring datasets of the target area are important to perform this optimization. In this study, we have developed a machine-learning approach to optimize sensor locations for soil and groundwater monitoring based on ensemble supervised learning and majority voting. For spatial optimization, Gaussian process regression (GPR) is used for spatial interpolation, while the majority voting is applied to accommodate the multivariate temporal dimension. Results show that the algorithms significantly outperform the random selection of the sensor locations for predictive spatiotemporal interpolation. While the method has been applied to a four-dimensional dataset (with two-dimensional space, time, and multiple contaminants), we anticipate that it can be generalizable to higher-dimensional datasets for environmental monitoring sensor location optimization.

Siddiquee, Masudur R.↗

A catalogue of Locus Algorithm pointings for optimal differential photometry for 23 779 quasars

ABSTRACT This paper presents a catalogue of optimized pointings for differential photometry of 23 779 quasars extracted from the Sloan Digital Sky Survey (SDSS) Catalogue and a Score for each indicating the quality of the Field of View (FoV) associated with that pointing. Observation of millimagnitude variability on a time-scale of minutes typically requires differential observations with reference to an ensemble of reference stars. For optimal performance, these reference stars should have similar colour and magnitude to the target quasar. In addition, the greatest quantity and quality of suitable reference stars may be found by using a telescope pointing which offsets the target object from the centre of the FoV. By comparing each quasar with the stars which appear close to it on the sky in the SDSS Catalogue, an optimum pointing can be calculated, and a figure of merit, referred to as the ‘Score’ is calculated for that pointing. Highly flexible software has been developed to enable this process to be automated and implemented in a distributed computing paradigm, which enables the creation of catalogues of pointings given a set of input targets. Applying this technique to a sample of 40 000 targets from the fourth SDSS quasar catalogue resulted in the production of pointings and Scores for 23 779 quasars based on their magnitudes in the SDSS r-band. This catalogue is a useful resource for observers planning differential photometry studies and surveys of quasars to select those which have many suitable celestial neighbours for differential photometry.

79 ASTRONOMY AND ASTROPHYSICS↗

Asymptotically optimal purification and dilution of mixed qubit and Gaussian states

Given an ensemble of mixed qubit states, it is possible to increase the purity of the constituent states using a procedure known as state purification. The reverse operation, which we refer to as dilution, produces a larger ensemble, while reducing the purity level of the systems. In this paper we find asymptotically optimal procedures for purification and dilution of an ensemble of independently and identically distributed mixed qubit states, for some given input and output purities and an asymptotic output rate. Our solution involves using the statistical tool of local asymptotic normality, which recasts the qubit problem in terms of attenuation and amplification of a single-mode displaced Gaussian state. Therefore, to obtain the qubit solutions, we must first solve the analogous problems in the Gaussian setup. We provide full solutions to all of the above for the (global) trace-norm figure of merit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

TurboRVB: A many-body toolkit for ab initio electronic simulations by quantum Monte Carlo

TurboRVB is a computational package for ab initio Quantum Monte Carlo (QMC) simulations of both molecular and bulk electronic systems. The code implements two types of well established QMC algorithms: Variational Monte Carlo (VMC) and diffusion Monte Carlo in its robust and efficient lattice regularized variant. A key feature of the code is the possibility of using strongly correlated many-body wave functions (WFs), capable of describing several materials with very high accuracy, even when standard mean-field approaches [e.g., density functional theory (DFT)] fail. The electronic WF is obtained by applying a Jastrow factor, which takes into account dynamical correlations, to the most general mean-field ground state, written either as an antisymmetrized geminal power with spin-singlet pairing or as a Pfaffian, including both singlet and triplet correlations. This WF can be viewed as an efficient implementation of the so-called resonating valence bond (RVB) Ansatz, first proposed by Pauling and Anderson in quantum chemistry [L. Pauling, The Nature of the Chemical Bond (Cornell University Press, 1960)] and condensed matter physics [P.W. Anderson, Mat. Res. Bull 8, 153 (1973)], respectively. The RVB Ansatz implemented in TurboRVB has a large variational freedom, including the Jastrow correlated Slater determinant as its simplest, but nontrivial case. Moreover, it has the remarkable advantage of remaining with an affordable computational cost, proportional to the one spent for the evaluation of a single Slater determinant. Therefore, its application to large systems is computationally feasible. The WF is expanded in a localized basis set. Several basis set functions are implemented, such as Gaussian, Slater, and mixed types, with no restriction on the choice of their contraction. The code implements the adjoint algorithmic differentiation that enables a very efficient evaluation of energy derivatives, comprising the ionic forces. Thus, one can perform structural optimizations and molecular dynamics in the canonical NVT ensemble at the VMC level. For the electronic part, a full WF optimization (Jastrow and antisymmetric parts together) is made possible, thanks to state-of-the-art stochastic algorithms for energy minimization. In the optimization procedure, the first guess can be obtained at the mean-field level by a built-in DFT driver. The code was efficiently parallelized by using a hybrid MPI-OpenMP protocol, which is also an ideal environment for exploiting the computational power of modern Graphics Processing Unit accelerators.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗

Machine-learning accelerated geometry optimization in molecular simulation

Geometry optimization is an important part of both computational materials and surface science because it is the path to finding ground state atomic structures and reaction pathways. These properties are used in the estimation of thermodynamic and kinetic properties of molecular and crystal structures. This process is slow at the quantum level of theory because it involves an iterative calculation of forces using quantum chemical codes such as density functional theory (DFT), which are computationally expensive and which limit the speed of the optimization algorithms. It would be highly advantageous to accelerate this process because then one could do either the same amount of work in less time or more work in the same time. Here, we provide a neural network (NN) ensemble based active learning method to accelerate the local geometry optimization for multiple configurations simultaneously. We illustrate the acceleration on several case studies including bare metal surfaces, surfaces with adsorbates, and nudged elastic band for two reactions. In all cases, the accelerated method requires fewer DFT calculations than the standard method. In addition, we provide an Atomic Simulation Environment (ASE)-optimizer Python package to make the usage of the NN ensemble active learning for geometry optimization easier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mechanistic Insights and Rational Design of Ca-Doped CeO 2 Catalyst for Acetic Acid Ketonization

Carboxylic acid ketonization has recently gained significant attention to produce biomass-derived hydrocarbon fuels as it not only removes the highly reactive carboxylic functional group but also increases the size of the carbon chain. In this work, Ca-doped CeO 2 -based catalysts were investigated for acetic acid ketonization using a combined experimental and computational approach. Acetic acid conversion was performed across a range of temperatures including higher temperatures relevant to catalytic hot gas filtration (450 °C). Ca addition slightly decreases overall acetic acid ketonization reactivity yet stabilizes the catalyst at the higher temperatures necessary for catalytic hot gas filtration. From density functional theory calculations of the ketonization reaction mechanism, the C–C coupling and water formation steps are identified as two of the most energy-consuming steps on a CeO 2 surface with a proximal oxygen vacancy and the presence of a Ca dopant stabilizes the key intermediates. Calculations predict an optimal structure comprising three Ca ensembles to minimize the reaction free energies for C–C coupling and water formation steps. These findings provide a priori information to guide future experiments for ketonization catalyst design and development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prediction of Distributed River Sediment Respiration Rates Using Community-Generated Data and Machine Learning

River sediment microbial respiration is a key indicator of ecosystem functioning and the biogeochemical fluxes across this critical zone link surface and subsurface waters. As such, there is tremendous interest in measuring and mapping these respiration rates. Respiration observations are expensive and labor intensive; there is limited data available to the community. An open science, collaborative initiative is collecting samples for respiration rate analysis and multi-scale metadata; this evolving data set is being used for making machine learning (ML) predictions at unsampled sites to help inform continued community engagement. However, it is a challenge to find an optimum configuration for ML models to work with this feature-rich (i.e., 100+ possible input variables) data set. Here, we present results from a two-tiered approach to managing the analysis of this complex data set: (a) a stacked ensemble of models that automatically optimizes hyperparameters and manages the training of many models and (b) feature permutation importance to detect the most important features in the models. The major elements of this workflow are modular, portable, open, and cloud-based thus making this implementation a potential template for other applications. The models developed here predict that sediment organic matter chemistry is one of the most important features for predicting sediment respiration rate. Other larger-scale, important features fall into the categories of climatic, ecological, geological, and fluvial settings. Leveraging these larger-scale features to generate data-driven estimates of river sediment respiration rates reveals spatially consistent but heterogeneous patterns across the river network of the Columbia River Basin.

54 ENVIRONMENTAL SCIENCES↗

Testing the predictive power of theory for Pd x Ir (100-x) alloy nanoparticles for the oxygen reduction reaction

Here, density functional theory (DFT) calculations of O and OH binding energies on triatomic surface ensembles of Pd x Ir (100-x) nanoalloys successfully predicted the overall trend in experimental oxygen reduction reaction (ORR) activity as a function of nanoparticle (NP) composition. Specifically, triatomic Pd 3 ensembles were found to possess optimal O and OH binding energies and were predicted to be highly active sites for the ORR, rivaling that of Pt(111). However, DFT calculations suggest that the O binding energy increases at active sites containing Ir, thereby decreasing ORR activity. Pd x Ir (100-x) nanoalloys were synthesized using a microwave-assisted method and their activity towards the ORR was tested using rotating disk voltammetry (RDV). As predicted, the bimetallic electrocatalysts exhibited worse catalytic activity than the Pd-only NPs. The strong qualitative correlation between the theoretical and experimental results demonstrates that the activity of individual active sites on the surface of NPs can serve as a proxy for overall activity. This is a particularly useful strategy for applying DFT calculations to electrocatalysts that are too large for true first-principle analysis.

36 MATERIALS SCIENCE↗

Validating first-principles molecular dynamics calculations of oxide/water interfaces with x-ray reflectivity data

Metal oxide/water interfaces play a crucial role in many electrochemical and photocatalytic processes, such as photoelectrochemical water splitting, the creation of fuel from sunlight, and electrochemical CO 2 reduction. First-principles electronic structure calculations can reveal unique insights into these processes, such as the role of the alignment of the oxide electronic energy levels with those of liquid water. An essential prerequisite for the success of such calculations is the ability to predict accurate structural models of these interfaces, which in turn requires careful experimental validation. Here we report a general, quantitative validation protocol for first-principles molecular dynamics simulations of oxide/aqueous interfaces. The approach makes direct comparisons of interfacial x-ray reflectivity (XR) signals from experimental measurements and those obtained from ab initio simulations with semilocal and van der Waals functionals. The protocol is demonstrated here for the case of the Al 2 O 3 (001)/water interface, one of the simplest oxide/water interfaces. We discuss the technical requirements needed for validation, including the choice of the density functional, the simulation cell size, and the optimal choice of the thermodynamic ensemble. Our results establish a general paradigm for the validation of structural models and interactions at solid/water interfaces derived from first-principles simulations. Furthermore, while there is qualitative agreement between the simulated structures and the experimental best-fit structure, direct comparisons of simulated and measured XR intensities show quantitative discrepancies that derive from both bulk regions (i.e., alumina and water) as well as the interfacial region, highlighting the need for accurate density functionals to properly describe interfacial interactions. Our results show that XR data are sensitive not only to the atomic structure (i.e., the atom locations) but also to the electron-density distributions in both the substrate and at the interface.

36 MATERIALS SCIENCE↗

Optimizing Kernel Machines Using Deep Learning

Building highly non-linear and non-parametric models is central to several state-of-the-art machine learning systems. Kernel methods form an important class of techniques that induce a reproducing kernel Hilbert space (RKHS) for inferring non-linear models through the construction of similarity functions from data. These methods are particularly preferred in cases where the training data sizes are limited and when prior knowledge of the data similarities is available. Despite their usefulness, they are limited by the computational complexity and their inability to support end-to-end learning with a task specific objective. On the other hand, deep neural networks have become the de facto solution for end-to-end inference in several learning paradigms. In this article, we explore the idea of using deep architectures to perform kernel machine optimization, for both computational efficiency and end-to-end inferencing. To this end, we develop the DKMO (Deep Kernel Machine Optimization) framework, that creates an ensemble of dense embeddings using Nystrõm kernel approximations and utilizes deep learning to generate task-specific representations through the fusion of the embeddings. Intuitively, the filters of the network are trained to fuse information from an ensemble of linear subspaces in the RKHS. Furthermore, we introduce the kernel dropout regularization to enable improved training convergence. Finally, we extend this framework to the multiple kernel case, by coupling a global fusion layer with pre-trained deep kernel machines for each of the constituent kernels. Using case studies with limited training data, and lack of explicit feature sources, we demonstrate the effectiveness of our framework over conventional model inferencing techniques.

97 MATHEMATICS AND COMPUTING↗