Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Comparison of machine learning techniques to optimize the analysis of plutonium surrogate material via a portable LIBS device

The utilization of machine learning techniques has become commonplace in the analysis of optical emission spectra. These methods are often limited to variants of principal components analysis (PCA), partial-least squares (PLS), and artificial neural networks (ANNs). A plethora of other techniques exist and are well established in the world of data science, yet are seldom investigated for their use in spectroscopic problems. In this study, machine learning techniques were used to analyze optical emission spectra of laser-induced plasma from ceria pellets doped with silicon in order to predict silicon content. Additionally, a boosted regression ensemble model was created, and its predictive accuracy was compared to that of traditional PCA, PLS, and ANN regression models. Boosted regression tree ensembles yielded fits with R-squared (R2) values as high as 0.964 and mean-squared errors of prediction (MSEPs) as low as 0.074, providing the most accurate predictive model. Neural networks performed with slightly lower R2 values and higher MSEPs compared to the ensemble methods, thus indicating susceptibility to overfitting.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

User Guidelines and Best Practices for CASL VUQ Analysis Using Dakota

Sandia’s Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a physics-based computational model. This can lend efficiency and rigor to manual parameter perturbation studies already being conducted by analysts. However, Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. Dakota algorithms enrich complex science and engineering models, enabling an analyst to answer crucial questions of - Sensitivity: Which are the most important input factors or parameters entering the simulation, and how do they influence key outputs?; Uncertainty: What is the uncertainty or variability in simulation output, given uncertainties in input parameters? How safe, reliable, robust, or variable is my system? (Quantification of margins and uncertainty, QMU); Optimization: What parameter values yield the best performing design or operating condition, given constraints? Calibration: What models and/or parameters best match experimental data? In general, Dakota is the Consortium for Advanced Simulation of Light Water Reactors (CASL) delivery vehicle for verification, validation, and uncertainty quantification (VUQ) algorithms. It permits ready application of the VUQ methods described above to simulation codes by CASL researchers, code developers, and application engineers.

97 MATHEMATICS AND COMPUTING↗

ISMIP6-based projections of ocean-forced Antarctic Ice Sheet evolution using the Community Ice Sheet Model

Abstract. The future retreat rate for marine-based regions of the Antarctic Ice Sheet is one of the largest uncertainties in sea-level projections. The Ice Sheet Model Intercomparison Project for CMIP6 (ISMIP6) aims to improve projections and quantify uncertainties by running an ensemble of ice sheet models with atmosphere and ocean forcing derived from global climate models. Here, the Community Ice Sheet Model (CISM) is used to run ISMIP6-based projections of ocean-forced Antarctic Ice Sheet evolution. Using multiple combinations of sub-ice-shelf melt parameterizations and calibrations, CISM is spun up to steady state over many millennia. During the spin-up, basal friction parameters and basin-scale thermal forcing corrections are adjusted to optimize agreement with the observed ice thickness. The model is then run forward for 550 years, from 1950–2500, applying ocean thermal forcing anomalies from six climate models. In all simulations, the ocean forcing triggers long-term retreat of the West Antarctic Ice Sheet, especially in the Filchner–Ronne and Ross sectors. Mass loss accelerates late in the 21st century and then rises steadily for several centuries without leveling off. The resulting ocean-forced sea-level rise at year 2500 varies from about 150 to 1300 mm, depending on the melt scheme and ocean forcing. Further experiments show relatively high sensitivity to the basal friction law, moderate sensitivity to grid resolution and the prescribed collapse of small ice shelves, and low sensitivity to the stress-balance approximation. The Amundsen sector exhibits threshold behavior, with modest retreat under many parameter settings but complete collapse under some combinations of low basal friction and high thermal forcing anomalies. Large uncertainties remain, as a result of parameterized sub-shelf melt rates, simplified treatments of calving and basal friction, and the lack of ice–ocean coupling.

54 ENVIRONMENTAL SCIENCES↗

Optimizing process-based models to predict current and future soil organic carbon stocks at high-resolution

From hillslope to small catchment scales (< 50 km 2 ), soil carbon management and mitigation policies rely on estimates and projections of soil organic carbon (SOC) stocks. Here we apply a process-based modeling approach that parameterizes the MIcrobial-MIneral Carbon Stabilization (MIMICS) model with SOC measurements and remotely sensed environmental data from the Reynolds Creek Experimental Watershed in SW Idaho, USA. Calibrating model parameters reduced error between simulated and observed SOC stocks by 25%, relative to the initial parameter estimates and better captured local gradients in climate and productivity. The calibrated parameter ensemble was used to produce spatially continuous, high-resolution (10 m 2 ) estimates of stocks and associated uncertainties of litter, microbial biomass, particulate, and protected SOC pools across the complex landscape. Here, subsequent projections of SOC response to idealized environmental disturbances illustrate the spatial complexity of potential SOC vulnerabilities across the watershed. Parametric uncertainty generated physicochemically protected soil C stocks that varied by a mean factor of 4.4 × across individual locations in the watershed and a – 14.9 to + 20.4% range in potential SOC stock response to idealized disturbances, illustrating the need for additional measurements of soil carbon fractions and their turnover time to improve confidence in the MIMICS simulations of SOC dynamics.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Equilibrium and Nonequilibrium Approaches for Relative Binding Free Energy Predictions

Alchemical relative binding free energy calculations have recently found important applications in drug optimization. A series of congeneric compounds are generated from a preidentified lead compound, and their relative binding affinities to a protein are assessed in order to optimize candidate drugs. While methods based on equilibrium thermodynamics have been extensively studied, an approach based on nonequilibrium methods has recently been reported together with claims of its superiority. However, these claims pay insufficient attention to the basis and reliability of both methods. Here we report a comparative study of the two approaches across a large data set, comprising more than 500 ligand transformations spanning in excess of 300 ligands binding to a set of 14 diverse protein targets. Ensemble methods are essential to quantify the uncertainty in these calculations, not only for the reasons already established in the equilibrium approach but also to ensure that the nonequilibrium calculations reside within their domain of validity. If and only if ensemble methods are applied, we find that the nonequilibrium method can achieve accuracy and precision comparable to those of the equilibrium approach. Compared to the equilibrium method, the nonequilibrium approach can reduce computational costs but introduces higher computational complexity and longer wall clock times. There are, however, cases where the standard length of a nonequilibrium transition is not sufficient, necessitating a complete rerun of the entire set of transitions. This significantly increases the computational cost and proves to be highly inconvenient during large-scale applications. Our findings provide a key set of recommendations that should be adopted for the reliable implementation of nonequilibrium approaches to relative binding free energy calculations in ligand-protein systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Discriminative versus generative approaches to simulation-based inference

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is inherently lossy, since histograms are binned and low-dimensional. Deep learning has enabled unbinned and high-dimensional parameter estimation through neural likelihood(-ratio) estimation. We compare two approaches for neural simulation-based inference (NSBI): one based on discriminative learning (classification) and one based on generative modeling. These two approaches are directly evaluated on the same datasets, with a similar level of hyperparameter optimization in both cases. In addition to a Gaussian dataset, we study NSBI using a Higgs boson dataset from the FAIR Universe Challenge. We find that both the direct likelihood and likelihood ratio estimation are able to effectively extract parameters with reasonable uncertainties. For the numerical examples and within the set of hyperparameters studied, we found that the likelihood ratio method is more accurate and/or precise. Both methods have a significant spread from the network training and would require ensembling or other mitigation strategies in practice.

high energy physics↗

Revealing the atomic ordering of binary intermetallics using in situ heating techniques at multilength scales

Ordered intermetallic nanoparticles are promising electrocatalysts with enhanced activity and durability for the oxygen-reduction reaction (ORR) in proton-exchange membrane fuel cells (PEMFCs). The ordered phase is generally identified based on the existence of superlattice ordering peaks in powder X-ray diffraction (PXRD). However, after employing a widely used postsynthesis annealing treatment, we have found that claims of “ordered” catalysts were possibly/likely mixed phases of ordered intermetallics and disordered solid solutions. In this work, we employed in situ heating, synchrotron-based, X-ray diffraction to quantitatively investigate the impact of a variety of annealing conditions on the degree of ordering of large ensembles of Pt 3 Co nanoparticles. Monte Carlo simulations suggest that Pt 3 Co nanoparticles have a lower order–disorder phase transition (ODPT) temperature relative to the bulk counterpart. Furthermore, we employed microscopic-level in situ heating electron microscopy to directly visualize the morphological changes and the formation of both fully and partially ordered nanoparticles at the atomic scale. In general, a higher degree of ordering leads to more active and durable electrocatalysts. The annealed Pt 3 Co/C with an optimal degree of ordering exhibited significantly enhanced durability, relative to the disordered counterpart, in practical membrane electrode assembly (MEA) measurements. The results highlight the importance of understanding the annealing process to maximize the degree of ordering in intermetallics to optimize electrocatalytic activity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Automated Generation of Microkinetics for Heterogeneously Catalyzed Reactions Considering Correlated Uncertainties**

Abstract The study presents an ab‐initio based framework for the automated construction of microkinetic mechanisms considering correlated uncertainties in all energetic parameters and estimation routines. 2000 unique microkinetic models were generated within the uncertainty space of the BEEF‐vdW functional for the oxidation reactions of representative exhaust gas emissions from stoichiometric combustion engines over Pt(111) and compared to experiments through multiscale modeling. The ensemble of simulations stresses the importance of considering uncertainties. Within this set of first‐principles‐based models, it is possible to identify a microkinetic mechanism that agrees with experimental data. This mechanism can be traced back to a single exchange‐correlation functional, and it suggests that Pt(111) could be the active site for the oxidation of light hydrocarbons. The study provides a universal framework for the automated construction of reaction mechanisms with correlated uncertainty quantification, enabling a DFT‐constrained microkinetic model optimization for other heterogeneously catalyzed systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A machine learning approach to emulation and biophysical parameter estimation with the Community Land Model, version 5

Abstract. Land models are essential tools for understanding and predicting terrestrial processes and climate–carbon feedbacks in the Earth system, but uncertainties in their future projections are poorly understood. Improvements in physical process realism and the representation of human influence arguably make models more comparable to reality but also increase the degrees of freedom in model configuration, leading to increased parametric uncertainty in projections. In this work we design and implement a machine learning approach to globally calibrate a subset of the parameters of the Community Land Model, version 5 (CLM5) to observations of carbon and water fluxes. We focus on parameters controlling biophysical features such as surface energy balance, hydrology, and carbon uptake. We first use parameter sensitivity simulations and a combination of objective metrics including ranked global mean sensitivity to multiple output variables and non-overlapping spatial pattern responses between parameters to narrow the parameter space and determine a subset of important CLM5 biophysical parameters for further analysis. Using a perturbed parameter ensemble, we then train a series of artificial feed-forward neural networks to emulate CLM5 output given parameter values as input. We use annual mean globally aggregated spatial variability in carbon and water fluxes as our emulation and calibration targets. Validation and out-of-sample tests are used to assess the predictive skill of the networks, and we utilize permutation feature importance and partial dependence methods to better interpret the results. The trained networks are then used to estimate global optimal parameter values with greater computational efficiency than achieved by hand tuning efforts and increased spatial scale relative to previous studies optimizing at a single site. By developing this methodology, our framework can help quantify the contribution of parameter uncertainty to overall uncertainty in land model projections.

54 ENVIRONMENTAL SCIENCES↗

Inference of bipolar neutrino flavor oscillations near a core-collapse supernova based on multiple measurements at Earth

Neutrinos in compact-object environments, such as core-collapse supernovae, can experience various kinds of collective effects in flavor space, engendered by neutrino-neutrino interactions. These include “bipolar” collective oscillations, which are exhibited by neutrino ensembles where different flavors dominate at different energies. Considering the importance of neutrinos in the dynamics and nucleosynthesis in these environments, it is desirable to ascertain whether an Earth-based detection could contain signatures of bipolar oscillations that occurred within a supernova envelope. To that end, we, in this study, continue examining a cost-function formulation of statistical data assimilation (SDA) to infer solutions to a small-scale model of neutrino flavor transformation. SDA is an inference paradigm designed to optimize a model with sparse data. Our model consists of two monoenergetic neutrino beams with different energies emanating from a source and coherently interacting with each other and with a matter background, with radially varying interaction strengths. We attempt to infer flavor transformation histories of these beams using simulated measurements of the flavor content at locations “in vacuum” (that is, far from the source), which could in principle correspond to Earth-based detectors. Within the scope of this small-scale model, we found that: (i) based on such measurements, the SDA procedure is able to infer whether bipolar oscillations had occurred within the protoneutron star envelope, and (ii) if the measurements sample the full amplitude of the neutrino oscillations in vacuum, then the amplitude of the prior bipolar oscillations is well predicted. This result intimates that the inference paradigm can well complement numerical integration codes, via its ability to infer flavor evolution at physically inaccessible locations.

79 ASTRONOMY AND ASTROPHYSICS↗

Load Balancing Using Time Series Analysis for Soft Real Time Systems with Statistically Periodic Loads

This thesis provides design and analysis of techniques for global load balancing on ensemble architectures running soft-real-time object-oriented applications with statistically periodic loads. It focuses on estimating the instantaneous average load over all the processing elements. The major contribution is the use of explicit stochastic process models for both the loading and the averaging itself. These models are exploited via statistical time-series analysis and Bayesian inference to provide improved average load estimates, and thus to facilitate global load balancing. This thesis explains the distributed algorithms used and provides some optimality results. It also describes the algorithms' implementation and gives performance results from simulation. These results show that the authors' techniques allow more accurate estimation of the global system loading, resulting in fewer object migrations than local methods. The authors' method is shown to provide superior performance, relative not only to static load-balancing schemes but also to many adaptive load-balancing methods. Results from a preliminary analysis of another system and from simulation with a synthetic load provide some evidence of more general applicability.

LOAD CONTROL↗

Load Balancing Using Time Series Analysis for Soft Real Time Systems with Statistically Periodic Loads

This thesis provides design and analysis of techniques for global load balancing on ensemble architectures running soft-real-time object-oriented applications with statistically periodic loads. It focuses on estimating the instantaneous average load over all the processing elements. The major contribution is the use of explicit stochastic process models for both the loading and the averaging itself. These models are exploited via statistical time-series analysis and Bayesian inference to provide improved average load estimates, and thus to facilitate global load balancing. This thesis explains the distributed algorithms used and provides some optimality results. It also describes the algorithms' implementation and gives performance results from simulation. These results show that our techniques allow more accurate estimation of the global system load ing, resulting in fewer object migration than local methods. Our method is shown to provide superior performance, relative not only to static load-balancing schemes but also to many adaptive methods.

REAL TIME↗

Preparation of metrological states in dipolar-interacting spin systems

Abstract Spin systems are an attractive candidate for quantum-enhanced metrology. Here we develop a variational method to generate metrological states in small dipolar-interacting spin ensembles with limited qubit control. For both regular and disordered spatial spin configurations the generated states enable sensing beyond the standard quantum limit (SQL) and, for small spin numbers, approach the Heisenberg limit (HL). Depending on the circuit depth and the level of readout noise, the resulting states resemble Greenberger-Horne-Zeilinger (GHZ) states or Spin Squeezed States (SSS). Sensing beyond the SQL holds in the presence of finite spin polarization and a non-Markovian noise environment. The developed black-box optimization techniques for small spin numbers ( N ≤ 10) are directly applicable to diamond-based nanoscale field sensing, where the sensor size limits N and conventional squeezing approaches fail.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Measuring the Lower Critical Field of Superconductors Using Nitrogen-Vacancy Centers in Diamond Optical Magnetometry

The lower critical magnetic eld, H c1 , of superconductors is measured by using ensembles of NV-centers-in-diamond optical magnetometry. The technique is minimally invasive, and has sub- gauss eld sensitivity and submicrometer spatial resolution, which allow for accurate detection of the vector eld at which the vortices start penetrating the sample from the corners. Aided by the revised calculations of the effective demagnetization factors of actual cuboid - shaped samples, H c1 and the London penetration depth, λ, derived from H c1 can be obtained. We apply this method to three well-studied superconductors: optimally doped Ba(Fe 1-x Co x ) 2 As 2 , stoichiometric CaKFe 4 As 4 , and high-Tc cuprate YBa 2 Cu 3 O 7-δ . Our results are well compared with the values of λ obtained using other techniques, thus adding another non-destructive and sensitive method to measure these important parameters of superconductors.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

High-Resolution Modeling to Assess Tropical Cyclone Activity in Future Climate Regimes

Applied research is proposed with the following objectives: (i) to determine the most likely level of tropical cyclone intensity and frequency in future climate regimes, (ii) to provide a quantitative measure of uncertainty in these predictions, and (iii) to improve understanding of the linkage between tropical cyclones and the planetary-scale circulation. Current mesoscale weather forecasting models, such as the Weather Research and Forecasting (WRF) model, are capable of simulating the full intensity of tropical cyclones (TC) with realistic structures. However, in order to accurately represent both the primary and secondary circulations in these systems, model simulations must be configured with sufficient resolution to explicitly represent convection (omitting the convective parameterization scheme). Most previous numerical studies of TC activity at seasonal and longer time scales have not utilized such explicit convection (EC) model runs. Here, we propose to employ the moving nest capability of WRF to optimally represent TC activity on a seasonal scale using a downscaling approach. The statistical results of a suite of these high-resolution TC simulations will yield a realistic representation of TC intensity on a seasonal basis, while at the same time allowing analysis of the feedback that TCs exert on the larger-scale climate system. Experiments will be driven with analyzed lateral boundary conditions for several recent Atlantic seasons, spanning a range of activity levels and TC track patterns. Results of the ensemble of WRF simulations will then be compared to analyzed TC data in order to determine the extent to which this modeling setup can reproduce recent levels of TC activity. Next, the boundary conditions (sea-surface temperature, tropopause height, and thermal/moisture profiles) from the recent seasons will be altered in a manner consistent with various future GCM/RCM scenarios, but that preserves the large-scale shear and incipient disturbance activity. This will allow (i) a direct comparison of future TC activity that could be expected for an active or inactive season in an altered climate regime, and (ii) a measure of the level of uncertainty and variability in TC activity resulting from different carbon emission scenarios.

58 GEOSCIENCES↗

Development of Super Ensemble-Based Aviation Turbulence Guidance (SEATG) for Air Traffic Management

A new method for forecasting turbulence is developed and evaluated using the high resolution weather model and in situ turbulence observations from commercial aircraft. The new method is an ensemble of various turbulence metrics from multiple time-lagged ensemble forecasts created using a sequence of four procedures. These include weather modeling, calculation of turbulence metrics, mapping the metrics into a common turbulence-scale, and production of final forecast. The new method uses similar methodology as current operational turbulence forecast with three improvements. First, it uses a higher resolution ((delta)x = 3 km) weather model to capture cloud resolving scale phenomena. Second, it computes the metrics for multiple forecasts that are combined at the same valid time resulting in a time-lagged ensemble of multiple turbulence metrics. Finally, it provides both deterministic and probabilistic turbulence forecasts. Results show the new forecasts match well with observed radar reflectivity along a surface front as well as convectively induced turbulence outside the clouds on research period. Overall performance skill of the new turbulence forecast compared with the observed EDR data during the research period is superior to any single turbulence metric. The probabilistic turbulence forecast is used in an example air traffic management application for creating a wind-optimal route considering turbulence information. The wind-optimal route passing through areas of 50% potential for moderate-or-greater turbulence and the lateral turbulence avoidance routes starting from three different waypoints along the wind-optimal route from Los Angeles international airport to John F. Kennedy international airport are calculated using different turbulence forecasts. This example shows additional flight time is required to avoid potential turbulence encounters.

modeling↗

Effective optimization of atomic decoration in giant and superstructurally ordered crystals with machine learning

Crystals with complicated geometry are often observed with mixed chemical occupancy among Wyckoff sites, presenting a unique challenge for accurate atomic modeling. Similar systems possessing exact occupancy on all the sites can exhibit superstructural ordering, dramatically inflating the unit cell size. In this work, a crystal graph convolutional neural network (CGCNN) is used to predict optimal atomic decorations on fixed crystalline geometries. This is achieved with a site permutation search (SPS) optimization algorithm based on Monte Carlo moves combined with simulated annealing and basin-hopping techniques. Our approach relies on the evidence that, for a given chemical composition, a CGCNN estimates the correct energetic ordering of different atomic decorations, as predicted by electronic structure calculations. This provides a suitable energy landscape that can be optimized according to site occupation, allowing the prediction of chemical decoration in crystals exhibiting mixed or disordered occupancy, or superstructural ordering. Verification of the procedure is carried out on several known compounds, including the superstructurally ordered clathrate compound Rb8Ga27Sb16 and vacancy-ordered perovskite Cs2SnI6, neither of which was previously seen during the neural network training. In addition, the critical temperature of an order–disorder phase transition in solid solution CuZn is probed with our SPS routines by sampling site configuration trajectories in the canonical ensemble. This strategy provides an accurate method for determining favorable decoration in complex crystals and analyzing site occupation at unprecedented speed and scale.

Chemistry↗

Impact of Satellite Microwave Radiance Data Assimilation on GEOS Atmospheric Analysis and Forecasts in Tropics

The NASA Global Modeling and Assimilation Office (GMAO) has developed a system to assimilate all-sky microwave radiance data in the Goddard Earth Observing System (GEOS). The system provides additional constraints on the analysis process near the storm regions and adjusts the geophysical parameters such as precipitation, cloud, moisture, surface pressure, and wind by combining information from microwave radiance measurements and model forecasts in an optimal manner. The system proved that assimilating the all-sky microwave radiance data improve the GEOS atmospheric analyses and forecasts. This all-sky data framework has been included in the GEOS Forward Processing (FP) system and currently assimilating all-sky GMI data in real-time for GEOS global analysis and forecast production at the GMAO. This presentation describes the methodologies to assimilate cloud- and precipitation-affected microwave radiances in GEOS data assimilation system based on hybrid four-dimensional ensemble-variational (4D-EnVar) configuration. In the current operational GEOS-FP system, the addition of all-sky GMI radiances has the largest impact in the Tropics. Specific humidity is significantly improved in the short term (0-72 hours) forecasts. Similar improvements are seen in the Tropical and lower tropospheric temperature and winds. More detailed results on all-sky microwave radiance data impact on GEOS analysis and forecasts are discussed in this presentation.

Kim, Min-Jeong↗