Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble computing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Ongoing solution reproducibility of earth system models as they progress toward exascale computing

We present a methodology for solution reproducibility for the Energy Exascale Earth System Model during its ongoing software infrastructure development to prepare for exascale computers. The nonlinear chaotic nature of climate system simulations precludes traditional model verification approaches since machine precision differences—resulting from code refactoring, changes in software environment, and so on—grow exponentially to a different weather state. Here, we leverage the nature of climate as a statistical description of the atmosphere in order to establish model reproducibility. We evaluate the degree to which two-sample equality of distribution tests can confidently detect the change in climate from minor tuning parameter changes on model output variables in order to establish the level of difference that indicates a new climate. To apply this (baselined test), we target a section of the model’s development cycle wherein no intentional science changes have been applied to its source code. We compare an ensemble of short simulations that were conducted using a verified model configuration against a new ensemble with the same configuration but with the latest software infrastructure (Common Infrastructure for Modeling the Earth, CIME5.0), compiler versions, and software libraries. We also compare these against ensemble simulations conducted using the original version of the software infrastructure (CIME4.0) of the earlier model configuration, but with the latest compilers and software libraries, to test the impact of new compilers and libraries in isolation from additional software infrastructure. The two-sample equality of distribution tests indicates that these ensembles indeed represent the same climate.

97 MATHEMATICS AND COMPUTING↗

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗

Phase-coexistence simulations of fluid mixtures by the Markov Chain Monte Carlo method using single-particle models

We present a single-particle Lennard–Jones (L-J) model for CO{sub 2} and N{sub 2}. Simplified L-J models for other small polyatomic molecules can be obtained following the methodology described herein. The phase-coexistence diagrams of single-component systems computed using the proposed single-particle models for CO{sub 2} and N{sub 2} agree well with experimental data over a wide range of temperatures. These diagrams are computed using the Markov Chain Monte Carlo method based on the Gibbs-NVT ensemble. This good agreement validates the proposed simplified models. That is, with properly selected parameters, the single-particle models have similar accuracy in predicting gas-phase properties as more complex, state-of-the-art molecular models. To further test these single-particle models, three binary mixtures of CH{sub 4}, CO{sub 2} and N{sub 2} are studied using a Gibbs-NPT ensemble. These results are compared against experimental data over a wide range of pressures. The single-particle model has similar accuracy in the gas phase as traditional models although its deviation in the liquid phase is greater. Since the single-particle model reduces the particle number and avoids the time-consuming Ewald summation used to evaluate Coulomb interactions, the proposed model improves the computational efficiency significantly, particularly in the case of high liquid density where the acceptance rate of the particle-swap trial move increases. We compare, at constant temperature and pressure, the Gibbs-NPT and Gibbs-NVT ensembles to analyze their performance differences and results consistency. As theoretically predicted, the agreement between the simulations implies that Gibbs-NVT can be used to validate Gibbs-NPT predictions when experimental data is not available.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Internal protein motions in molecular-dynamics simulations of Bragg and diffuse X-ray scattering

Molecular-dynamics (MD) simulations of Bragg and diffuse X-ray scattering provide a means of obtaining experimentally validated models of protein conformational ensembles. This paper shows that compared with a single periodic unit-cell model, the accuracy of simulating diffuse scattering is increased when the crystal is modeled as a periodic supercell consisting of a 2 × 2 × 2 layout of eight unit cells. The MD simulations capture the general dependence of correlations on the separation of atoms. There is substantial agreement between the simulated Bragg reflections and the crystal structure; there are local deviations, however, indicating both the limitation of using a single structure to model disordered regions of the protein and local deviations of the average structure away from the crystal structure. Although it was anticipated that a simulation of longer duration might be required to achieve maximal agreement of the diffuse scattering calculation with the data using the supercell model, only a microsecond is required, the same as for the unit cell. Rigid protein motions only account for a minority fraction of the variation in atom positions from the simulation. The results indicate that protein crystal dynamics may be dominated by internal motions rather than packing interactions, and that MD simulations can be combined with Bragg and diffuse X-ray scattering to model the protein conformational ensemble.

59 BASIC BIOLOGICAL SCIENCES↗

Thermodynamics of charged black holes with a nonlinear electrodynamics source

We study the thermodynamical properties of electrically charged black hole solutions of a nonlinear electrodynamics theory defined by a power p of the Maxwell invariant, which is coupled to Einstein gravity in four and higher spacetime dimensions. Depending on the range of the parameter p, these solutions present different asymptotic behaviors. We compute the Euclidean action with the appropriate boundary term in the grand canonical ensemble. The thermodynamical quantities are identified and, in particular, the mass and the charge are shown to be finite for all classes of solutions. Interestingly, a generalized Smarr formula is derived and it is shown that this latter encodes perfectly the different asymptotic behaviors of the black hole solutions. The local stability is analyzed by computing the heat capacity and the electrical permittivity and we find that a set of small black holes is locally stable. In contrast to the standard Reissner-Nordstroem solution, there is a first-order phase transition between a class of these nonlinear charged black holes and the Minkowski spacetime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Continuous-variable controlled-Z gate using an atomic ensemble

The continuous-variable controlled-Z gate is a canonical two-mode gate for universal continuous-variable quantum computation. It is considered as one of the most fundamental continuous-variable quantum gates. Here we present a scheme for realizing continuous-variable controlled-Z gate between two optical beams using an atomic ensemble. The gate is performed by simply sending the two beams propagating in two orthogonal directions twice through a spin-squeezed atomic medium. Its fidelity can run up to one if the input atomic state is infinitely squeezed. Considering the noise effects due to atomic decoherence and light losses, we show that the observed fidelities of the scheme are still quite high within presently available techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Inter-Oligomer Interaction Influence on Photoluminescence in Cis-Polyacetylene Semiconductor Materials

Semiconducting conjugated polymers (CPs) are pivotal in advancing organic electronics, offering tunable properties for solar cells and field-effect transistors. Here, we carry out first-principle calculations to study individual cis-polyacetylene (cis-PA) oligomers and their ensembles. The ground electronic structures are obtained using density functional theory (DFT), and excited state dynamics are explored by computing nonadiabatic couplings (NACs) between electronic and nuclear degrees of freedom. We compute the nonradiative relaxation of charge carriers and photoluminescence (PL) using the Redfield theory. Our findings show that electrons relax faster than holes. The ensemble of oligomers shows faster relaxation compared to the single oligomer. The calculated PL spectra show features from both interband and intraband transitions. The ensemble shows broader line widths, redshift of transition energies, and lower intensities compared to the single oligomer. This comparative study suggests that the dispersion forces and orbital hybridizations between chains are the leading contributors to the variation in PL. It provides insights into the fundamental behaviors of CPs and the molecular-level understanding for the design of more efficient optoelectronic devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Two-state thermodynamics and the possibility of a liquid-liquid phase transition in supercooled TIP4P/2005 water

Water shows intriguing thermodynamic and dynamic anomalies in the supercooled liquid state. One possible explanation of the origin of these anomalies lies in the existence of a metastable liquid-liquid phase transition (LLPT) between two (high and low density) forms of water. While the anomalies are observed in experiments on bulk and confined water and by computer simulation studies of different water-like models, the existence of a LLPT in water is still debated. Unambiguous experimental proof of the existence of a LLPT in bulk supercooled water is hampered by fast ice nucleation which is a precursor of the hypothesized LLPT. Moreover, the hypothesized LLPT, being metastable, in principle cannot exist in the thermodynamic limit (infinite size, infinite time). Therefore, computer simulations of water models are crucial for exploring the possibility of the metastable LLPT and the nature of the anomalies. In this work, we present new simulation results in the NVT ensemble for one of the most accurate classical molecular models of water, TIP4P/2005. To describe the computed properties and explore the possibility of a LLPT, we have applied two-structure thermodynamics, viewing water as a non-ideal mixture of two interconvertible local structures (“states”). The results suggest the presence of a liquid-liquid critical point and are consistent with the existence of a LLPT in this model for the simulated length and time scales. We have compared the behavior of TIP4P/2005 with other popular water-like models, namely, mW and ST2, and with real water, all of which are well described by two-state thermodynamics. In view of the current debate involving different studies of TIP4P/2005, we discuss consequences of metastability and finite size in observing the liquid-liquid separation. We also address the relationship between the phenomenological order parameter of two-structure thermodynamics and the microscopic nature of the low-density structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Gaussian Mixture Model-Based Ensemble Kalman Filter for Machine Parameter Calibration

This letter proposes a novel Gaussian mixture model-based ensemble Kalman filter (GMM-EnKF) approach to the accurate calibration of the parameters of machine dynamic models. This approach aims to overcome some practical challenges of machine parameter calibration. Results show the proposed approach can provide high-accuracy calibrated parameters even when the machine operates under unbalanced network conditions and the measurement noises are non-Gaussian.

Fan, Rui↗

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗

Energy Conservation Through Cloned Execution Of Simulations

High-performance computing facilities used for scientific computing draw enormous energy, some of them consuming many megawatt-hours. Saving the energy consumption of computations on such facilities can dramatically reduce the total cost of their operation and help reduce environmental effects. Here, we focus on a way to reduce energy consumption in many ensembles of simulations. Using the method of simulation cloning to exploit parallelism while also significantly conserving the computational and memory requirements, we perform a detailed empirical study of energy consumed on a large supercomputer consisting of hardware accelerator cards (graphical processing units, GPUs). We build on previous insights from mathematical analysis and implementation of cloned simulations that result in computational and memory savings by several orders-of-magnitude. Using instrumentation to track the power drawn by thousands of accelerator cards, we report significant aggregate energy savings from cloned simulations.

Yoginath, Srikanth↗

Charge fluctuations from molecular simulations in the constant-potential ensemble

We revisit the statistical mechanics of charge fluctuations in capacitors. In constant-potential classical molecular simulations, the atomic charges of electrode atoms are treated as additional degrees of freedom which evolve in time so as to satisfy the constraint of fixed electrostatic potential for each configuration of the electrolyte. The present work clarifies the role of the overall electroneutrality constraint, as well as the link between the averages computed within the Born–Oppenheimer approximation and that of the full constant-potential ensemble. This allows us in particular to derive a complete fluctuation–dissipation relation for the differential capacitance, that includes a contribution from the charge fluctuations (around the charges satisfying the constant-potential and electroneutrality constraints) also present in the absence of an electrolyte. We provide a simple expression for this contribution from the elements of the inverse of the matrix defining the quadratic form of the fluctuating charges in the energy. We then illustrate numerically the validity of our results, and recover the expected continuum result for an empty capacitor with structureless electrodes at large inter-electrode distances. By considering a variety of liquids between graphite electrodes, we confirm that this contribution to the total differential capacitance is small compared to that induced by the thermal fluctuations of the electrolyte.

74 ATOMIC AND MOLECULAR PHYSICS↗

Principles of Bayesian Ensemble Creation: Theoretical and Empirical Observations

Bayesian methods are theoretically optimal given their underlying assumptions. Bayesian model averaging (BMA) is generally considered the standard model for creating ensembles of learners using Bayesian methods, but this technique is often out-performed by more ad hoc methods in empirical studies. It has been proposed that Bayesian model averaging struggles in practice because it accounts for uncertainty about which model is the data-generating model but still operates under the assumption that only one of them is. Thus, BMA is unable to enrich the hypothesis space as effectively as other ensemble creation methods, serving as a form of optimal model selection, not optimal model combination. This work provides empirical verification for this hypothesis using both synthetic and real-world data. We propose several different approaches for Bayesian model combination, and demonstrate that they overcome this problem with BMA. We empirically show that even the most simplistic of Bayesian model combination strategies can compete with the traditional ad hoc techniques of bagging, boosting and stacking, as well as significantly outperforming BMA over a wide variety of cases. We also explore the implications of this observation as it relates to the effectiveness of ensemble learning.

97 MATHEMATICS AND COMPUTING↗

A multi-dimensional parametric study of variability in multi-phase flow dynamics during geologic CO 2 sequestration accelerated with machine learning

Successful geologic CO 2 storage projects depend on numerical simulations to predict reservoir performance during site selection, injection verification, and post-injection monitoring phases of the project. These numerical simulations solve non-linear sets of coupled partial differential equations, while accounting for multi-phase fluid dynamics on the basis of constitutive equations that are embedded into the solution scheme. As a consequence, individual simulations often require tens to hundreds of hours to complete on high-performance computing clusters. Moreover, laboratory experiments reveal that parametric functions for capillary pressure and relative permeability exhibit substantial variability, even within the same rock type. This combination of computational expense and wide-ranging parametric variability means that there remains substantial uncertainty in the behavior of multi-phase CO 2 -water systems, particularly in the context of feedbacks between relative permeability and capillary pressure. To bridge this knowledge gap, here we develop a novel workflow that utilizes physics-based numerical simulation to train an artificial neural network (ANN) emulator for interrogating the multivariate parameter space that governs both capillary pressure and relative permeability. With this approach, the ANN is trained to emulate both fluid pressure distribution and CO 2 saturation, which are then interrogated quantitatively to generate parametric response surface mappings with high-fidelity resolution. Results from this study initially show that capillary entry pressure is the dominant control on both CO 2 plume geometry and fluid pressure propagation when considering the combined effects of capillary pressure and relative permeability, particularly when phase interference is low and residual CO 2 saturation is high. Moreover, the ANN emulator provides tremendous computational speed-up by computing 2691 individual simulations in several minutes; whereas, the same simulation ensemble would have required ~3 years of simulation time using only physics-based simulation methods (25,000 times speed up).

58 GEOSCIENCES↗

Predicting Flow in Fracture Networks With Quantum Algorithms

Uncertainty quantification plays a crucial role in the modeling of subsurface flow. For instance, uncertainties in the properties of geologic fracture networks significantly impact flow, requiring numerous simulations to accurately estimate quantities of interest. However, each simulation is computationally expensive because it requires solving a large linear system to capture features that involve both small and large fractures. An example is in percolation, where the interaction of many small fractures (which cumulatively can have a large surface area) with the rock matrix must be modeled precisely. Quantum computing is an emerging tool with the potential to address this issue. Quantum algorithms offer a significant speedup in solving linear systems, achieving efficiencies that are challenging to match with classical approaches. These classical approaches include direct solvers, such as LU decomposition, and iterative methods, notably preconditioned conjugate gradient, commonly used in subsurface modeling to solve large sparse systems. However, applying quantum algorithms to geologic fracture flow requires careful attention to algorithmic and problem-specific constraints to fully realize this quantum advantage. In this work we describe a quantum algorithm for generalized Monte Carlo applications with a quadratic speedup over the classical approaches which can be combined with the quantum speedup, currently under investigation, for solving quantum linear systems for subsurface flow. We show that for quantum algorithms the computational cost of estimating a quantity of interest for a statistical ensemble of networks is roughly the same as that of a single realization, essentially implying that one can get uncertainty quantification for free.

58 GEOSCIENCES↗

Spotlight: efficient automated global optimization in rietveld analysis of diffraction data

Performing reliable Rietveld analysis on tens or hundreds of powder diffraction datasets from parametric or time-resolved experiments often poses a bottleneck in extracting meaningful results from the data. While automated analysis of data has recently been demonstrated, high temperature annealing studies, during which phase transformations occur and lattice parameters may change due to repartitioning of elements, are prime examples where automation by a simple phase identification from a database of room temperature structures or automation by sequential refinements is likely to fail. To enable reliable, efficient, automated Rietveld analysis, we present a Python package named Spotlight , building on established Rietveld packages such as MAUD, GSAS , or GSAS-II , which extends the refinement of best fit parameters to a global optimization using an ensemble of optimizers leveraging hierarchical parallel execution on high-performance computing clusters. Spotlight further enables the efficient design of refinement plans through the iterative automated machine-learning of a surrogate for the refinement on which the global optimizations are performed until results from the surrogate converge to the response surface data. We demonstrate Spotlight with the analysis of uranium molybdenum and Ti–6Al–4V datasets, as well as in two open-source tutorials analyzing aluminium oxide and lead sulphate.

36 MATERIALS SCIENCE↗

Communication: Distinguishing between short-time non-Fickian diffusion and long-time Fickian diffusion for a random walk on a crowded lattice

The motion of cells and molecules through biological environments is often hindered by the presence of other cells and molecules. A common approach to modeling this kind of hindered transport is to examine the mean squared displacement (MSD) of a motile tracer particle in a lattice-based stochastic random walk in which some lattice sites are occupied by obstacles. Unfortunately, stochastic models can be computationally expensive to analyze because we must average over a large ensemble of identically prepared realizations to obtain meaningful results. To overcome this limitation we describe an exact method for analyzing a lattice-based model of the motion of an agent moving through a crowded environment. Using our approach we calculate the exact MSD of the motile agent. Our analysis confirms the existence of a transition period where, at first, the MSD does not follow a power law with time. However, after a sufficiently long period of time, the MSD increases in proportion to time. This latter phase corresponds to Fickian diffusion with a reduced diffusivity owing to the presence of the obstacles. Our main result is to provide a mathematically motivated, reproducible, and objective estimate of the amount of time required for the transport to become Fickian. Our new method to calculate this crossover time does not rely on stochastic simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mass density fluctuations in quantum and classical descriptions of liquid water

First principles molecular dynamics simulation protocol is established using revised functional of Perdew-Burke-Ernzerhof (revPBE) in conjunction with Grimme's third generation of dispersion (D3) correction to describe properties of water at ambient conditions. This study also demonstrates the consistency of the structure of water across both isobaric (NpT) and isothermal (NVT) ensembles. Going beyond the standard structural benchmarks for liquid water, we compute properties that are connected to both local structure and mass density fluctuations that are related to concepts of solvation and hydrophobicity. Finally, we directly compare our revPBE results to the Becke-Lee-Yang-Parr (BLYP) plus Grimme dispersion corrections (D2) and both the empirical fixed charged model (SPC/E) and many body interaction potential model (MB-pol) to further our understanding of how the computed properties herein depend on the form of the interaction potential.

74 ATOMIC AND MOLECULAR PHYSICS↗