Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Learning from many collider events at once

There have been a number of recent proposals to enhance the performance of machine learning strategies for collider physics by combining many distinct events into a single ensemble feature. To evaluate the efficacy of these proposals, we study the connection between single-event classifiers and multievent classifiers under the assumption that collider events are independent and identically distributed. We show how one can build optimal multievent classifiers from single-event classifiers, and we also show how to construct multievent classifiers such that they produce optimal single-event classifiers. This is illustrated for a Gaussian example as well as for classification tasks relevant for searches and measurements at the Large Hadron Collider. We extend our discussion to regression tasks by showing how they can be phrased in terms of parametrized classifiers. Empirically, we find that training a single-event (per-instance) classifier is more effective than training a multievent (per-ensemble) classifier, as least for the cases we studied, and we relate this fact to properties of the loss function gradient in the two cases. While we did not identify a clear benefit from using multievent classifiers in the collider context, we speculate on the potential value of these methods in cases involving only approximate independence, as relevant for jet substructure studies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Paw-Net: Stacking ensemble deep learning for segmenting scanning electron microscopy images of fine-grained shale samples

Segmentation of scanning electron microscopy (SEM) images is critical yet time-consuming for geological analyses, as it needs to differentiate the boundaries for different mineral objects to facilitate subsequent analyses, such as porosity calculation. Recently, various machine learning methods, especially convolutional neural networks (CNNs), have been explored to segment SEM images of fine-grained shale samples. However, we found that general CNNs do not yield optimal performance due to insufficient training data and imbalanced objects in SEM images. This work has revised the U-Net architecture, a popular approach for biomedical image analyses, by incorporating a loss function that addresses the imbalance issue. Furthermore, we used the ensemble learning method to train multiple models and combined the results to improve the overall performance of segmentation. We prepared 2162 sub-images from raw SEM images in our experiments and divided them into training, validation, and testing datasets. The overall results show that our method improves the average Intersection over Union (IOU) of mineral objects from 0.49 to 0.58, compared to the original U-Net model. Our method can clearly distinguish each object from others with boundaries, even in highly imbalanced images. Training our models takes less than three minutes using a single GPU, while manual labeling can take up to three hours for each image. Furthermore, the method helps geoscientists gain insights quickly and effectively by building neural network models from a small dataset of SEM images.

58 GEOSCIENCES↗

Prediction of grain structure after thermomechanical processing of U-10Mo alloy using sensitivity analysis and machine learning surrogate model

Abstract Hot rolling and annealing are critical intermediate steps for controlling microstructures and thickness variations when fabricating uranium alloyed with 10% molybdenum (U-10Mo), which is highly relevant to worldwide nuclear non-proliferation efforts. This work proposes a machine-learning surrogate model combined with sensitivity analysis to identify and predict U-10Mo microstructure development during thermomechanical processing. Over 200 simulations were collected using physics-based microstructure models covering a wide range of thermomechanical processing routes and initial alloy grain features. Based on the sensitivity analysis, we determined that an increase in rolling reduction percentage at each processing pass has the strongest effect in reducing the grain size. Multi-pass rolling and annealing can significantly improve recrystallization regardless of the reduction percentage. With a volume fraction below 2%, uranium carbide particles were found to have marginal effects on the average grain size and distribution. The proposed stratified stacking ensemble surrogate predicts the U-10Mo grain size with a mean square error four times smaller than a standard single deep neural network. At the same time, with a significant speedup (1000×) compared to the physics-based model, the machine learning surrogate shows good potential for U-10Mo fabrication process optimization.

36 MATERIALS SCIENCE↗

Robust deep learning framework for constitutive relations modeling

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. Here, we propose a general encoder-decoder deep learning framework that can model high-dimensional stress-strain data and complex loading histories with robustness and universal capability. The framework employs an encoder to project high-dimensional input information (e.g., loading history, loading conditions, and materials information) to a lower-dimensional hidden space and a decoder to map the hidden representation to the stress of interest. We evaluated various encoder architectures, including gated recurrent unit (GRU), GRU with attention, temporal convolutional network (TCN), and the Transformer encoder, on two complex stress-strain datasets that were designed to include a wide range of complex loading histories and loading conditions. All architectures achieved excellent test results with an root-mean-square error (RMSE) below 1 MPa. Additionally, we analyzed the capability of the different architectures to make predictions on out-of-domain applications, with an uncertainty estimation based on deep ensembles. The proposed approach provides a robust alternative to empirical/semi-empirical models for CRs modeling, offering the potential for more accurate and efficient materials design and optimization.

36 MATERIALS SCIENCE↗

Resolving atomistic structure and oxygen evolution activity in nickel antimonates

The oxygen evolution reaction (OER) requires electrodes that are not only catalytically active, but also stable under harsh electrochemical environments to enable efficient, durable technologies. Our recent report of a stable amorphous Ni 0.5 Sb 0.5 O z OER photoanode established Ni–Sb–O as an important system for computational understanding of both the structural and catalytic behavior of these complex oxides. In the present work we show that Ni x Sb 1-x O z with x > 0.33 crystallizes into a previously unknown phase. Guided by experimental X-ray diffraction, here, we use density functional theory calculations to perform a prototype phase search to identify a broad family of stable and metastable mixed rutile and hexagonal-like phases for x = 0.33, 0.50, and 0.66 compositions. For the identified phases, we predict favorable oxygen vacancy formation energies for Ni-rich compositions under the reducing synthesis conditions which match measured Ni K-edge X-ray absorption spectra. The calculated overpotential for the most active site decreases with increasing Ni content, from 0.91 V (x = 0.33) to 0.49 V (x = 0.66), which captures the experimentally observed trend. We find the active site changes from the Ni–O–Sb bridge to a Ni–O–Ni bridge at increasing Ni concentrations, rather than the commonly studied singly under-coordinated sites. Finally, detailed Pourbaix analysis of the identified phases show excellent electrochemical stability, consistent with experimentally measured low metal ion concentrations in the electrolyte of photoelectrochemical cells. Collectively, our consideration of an ensemble of structures enables identification of the most catalytically prolific structural motifs, aiding the understanding of crystalline and amorphous catalysts and elucidating the co-optimization of activity and durability in nickel antimonates.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

EFIT-Prime: Probabilistic and physics-constrained reduced-order neural network model for equilibrium reconstruction in DIII-D

We introduce EFIT-Prime, a novel machine learning surrogate model for EFIT (Equilibrium FIT) that integrates probabilistic and physics-informed methodologies to overcome typical limitations associated with deterministic and ad hoc neural network architectures. EFIT-Prime utilizes a neural architecture search-based deep ensemble for robust uncertainty quantification, providing scalable and efficient neural architectures that comprehensively quantify both data and model uncertainties. Physically informed by the Grad–Shafranov equation, EFIT-Prime applies a constraint on the current density J tor and a smoothness constraint on the first derivative of the poloidal flux, ensuring physically plausible solutions. Furthermore, the spatial location of the diagnostics is explicitly incorporated in the inputs to account for their spatial correlation. Extensive evaluations demonstrate EFIT-Prime's accuracy and robustness across diverse scenarios, most notably showing good generalization on negative-triangularity discharges that were excluded from training. Timing studies indicate an ensemble inference time of 15 ms for predicting a new equilibrium, offering the possibility of plasma control in real-time, if the model is optimized for speed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-objective optimization of interatomic potentials with application to MgO

The parameterization of a functional form for an interatomic potential is treated as a problem in multi-objective optimization. An autonomous, machine-learning approach based on the identification of the Pareto hypersurface of errors in predicted properties allows the development of an ensemble of parameterizations with high materials fidelity and robustness. The efficacy of this approach is illustrated for the simple example of a Buckingham potential for MgO. This approach also provides a strong foundation for uncertainty quantification of potential parameterizations.

36 MATERIALS SCIENCE↗

Direction-dependent localization errors in SPECT images

Purpose: Single photon emission computed tomography (SPECT) is being investigated for imaging inside radiation therapy treatment rooms to localize biological targets. Here, computer simulations were used to analyze locational and directional dependencies in localization errors and to assess the effects of spatial resolution modeling and observer normalization on localization performance. Methods: SPECT images of the XCAT phantom, containing 12 hot tumors, were reconstructed with detector response function compensation (DRC) and without DRC (nDRC). Numerical observers were forced to select the most suspicious tumor location, using normalized cross correlation (NXC) or un-normalized cross correlation (XC), from 3 cm diameter search volumes that each contained only one tumor. For each tumor site, localization was optimized as a function of the iteration number and postreconstruction smoothing. Localization error, the distance between true and estimated tumor positions, was calculated across the ensembles of 80 images. Direction-dependent localization bias and precision were estimated from the image ensemble. Results: For the six superficial tumors in close proximity to the detector trajectory, mean localization errors were <2 mm and were lowest or comparable using DRC-NXC, though differences from DRC-XC and nDRC-NXC were not statistically significant. DRC-NXC did provide statistically significantly better localization than nDRC-XC for five of these six tumors. At the other six sites where attenuation was more severe and the distance was generally greater between the tumor and detector, DRC typically did not show better localization than nDRC. Observer normalization improved the localization substantially for a tumor near the hotter heart. Localization errors were anisotropic and dependent on tumor location relative to the detector trajectory. Conclusions: This computer-simulation study compared localization performance for normalized and un-normalized numerical observers, which were used to estimate tumor positions in SPECT images, reconstructed with and without DRC. For tumors localized to <2 mm on average, which are good candidates for SPECT-guided radiation therapy, localization performance typically improved by compensating for the detector response function and by using a normalized observer. The observed direction-dependent localization errors have important implications for radiation therapy and are relevant to SPECT imaging in general.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Impacts of climate change and climate extremes on major crops productivity in China at a global warming of 1.5 and 2.0 °C

A new temperature goal of “holding the increase in global average temperature well below 2°C above pre-industrial levels and pursuing efforts to limit the temperature increase to 1.5°C above pre-industrial levels” has been established in the Paris Agreement, which calls for an understanding of climate risk under 1.5 and 2.0°C warming scenarios. Here, we evaluated the effects of climate change on growth and productivity of three major crops (i.e. maize, wheat, rice) in China during 2106–2115 in warming scenarios of 1.5 and 2.0°C using a method of ensemble simulation with well-validated Model to capture the Crop–Weather relationship over a Large Area (MCWLA) family crop models, their 10 sets of optimal crop model parameters and 70 climate projections from four global climate models.

54 ENVIRONMENTAL SCIENCES↗

Design Issues of GaAs and AlGaAs Delta-Doped p-i-n Quantum-Well APD's

We examine the basic design issues in the optimization of GaAs delta-doped and AlGAs delta-doped quantum-well avalanche photodiode (APD) structures using a theoretical analysis based on an ensemble Monte Carlo simulation. The devices are variations of the p-i-n doped quantum-well structure previously described in the literature. They have the same low-noise, high-gain and high-bandwidth features as the p-i-n doped quantum-well device. However, the use of delta doping provides far greater control or the doping concentrations within each stage possibly enhancing the extent to which the device can be depleted. As a result, it is expected that the proposed devices will operate at higher gain levels (at very low noise) than devices previously developed.

Wang, Yang↗

Extended experimental inferential structure determination method in determining the structural ensembles of disordered protein states

Proteins with intrinsic or unfolded state disorder comprise a new frontier in structural biology, requiring the characterization of diverse and dynamic structural ensembles. Here we introduce a comprehensive Bayesian framework, the Extended Experimental Inferential Structure Determination (X-EISD) method, which calculates the maximum log-likelihood of a disordered protein ensemble. X-EISD accounts for the uncertainties of a range of experimental data and back-calculation models from structures, including NMR chemical shifts, J-couplings, Nuclear Overhauser Effects (NOEs), paramagnetic relaxation enhancements (PREs), residual dipolar couplings (RDCs), hydrodynamic radii (R h ), single molecule fluorescence Förster resonance energy transfer (smFRET) and small angle X-ray scattering (SAXS). We apply X-EISD to the joint optimization against experimental data for the unfolded drkN SH3 domain and find that combining a local data type, such as chemical shifts or J-couplings, paired with long-ranged restraints such as NOEs, PREs or smFRET, yields structural ensembles in good agreement with all other data types if combined with representative IDP conformers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

How to COAAD Images. II. A Coaddition Image that is Optimal for Any Purpose in the Background-dominated Noise Limit

Image coaddition is one of the most basic operations that astronomers perform. In Paper I, we presented the optimal ways to coadd images in order to detect faint sources and to perform flux measurements under the assumption that the noise is approximately Gaussian. Here, we build on these results and derive from first principles a coaddition technique that is optimal for any hypothesis testing and measurement (e.g., source detection, flux or shape measurements, and star/galaxy separation), in the background-noise-dominated case. This method has several important properties. The pixels of the resulting coadded image are uncorrelated. This image preserves all the information (from the original individual images) on all spatial frequencies. Any hypothesis testing or measurement that can be done on all the individual images simultaneously, can be done on the coadded image without any loss of information. The PSF of this image is typically as narrow, or narrower than the PSF of the best image in the ensemble. Moreover, this image is practically indistinguishable from a regular single image, meaning that any code that measures any property on a regular astronomical image can be applied to it unchanged. In particular, the optimal source detection statistic derived in Paper I is reproduced by matched filtering this image with its own PSF. This coaddition process, which we call proper coaddition, can be understood as the maximum signal-to-noise ratio measurement of the Fourier transform of the image, weighted in such a way that the noise in the entire Fourier domain is of equal variance. This method has important implications for multi-epoch seeing-limited deep surveys, weak lensing galaxy shape measurements, and diffraction-limited imaging via speckle observations. The last topic will be covered in depth in future papers. We provide an implementation of this algorithm in MATLAB.

79 ASTRONOMY AND ASTROPHYSICS↗

A computational framework for uncertainty quantification and stochastic optimization in unit commitment with wind power generation.

We present a computational framework for integrating a state-of-the-art numerical weather prediction (NWP) model in stochastic unit commitment/economic dispatch formulations that account for wind power uncertainty. We first enhance the NWP model with an ensemble-based uncertainty quantification strategy implemented in a distributed-memory parallel computing architecture. We discuss computational issues arising in the implementation of the framework and validate the model using real wind-speed data obtained from a set of meteorological stations. We build a simulated power system to demonstrate the developments.

17 WIND ENERGY↗

Structural basis for TNA synthesis by an engineered TNA polymerase

Darwinian evolution experiments carried out on xeno-nucleic acid (XNA) polymers require engineered polymerases that can faithfully and efficiently copy genetic information back and forth between DNA and XNA. However, current XNA polymerases function with inferior activity relative to their natural counterparts. Here, we report five X-ray crystal structures that illustrate the pathway by which α-(L)-threofuranosyl nucleic acid (TNA) triphosphates are selected and extended in a template-dependent manner using a laboratory-evolved polymerase known as Kod-RI. Structural comparison of the apo, binary, open and closed ternary, and translocated product detail an ensemble of interactions and conformational changes required to promote TNA synthesis. Close inspection of the active site in the closed ternary structure reveals a sub-optimal binding geometry that explains the slow rate of catalysis. This key piece of information, which is missing for all naturally occurring archaeal DNA polymerases, provides a framework for engineering new TNA polymerase variants.

Science & Technology - Other Topics↗

Fixed-angle conjectures for the quantum approximate optimization algorithm on regular MaxCut graphs

The quantum approximate optimization algorithm (QAOA) is a near-term combinatorial optimization algorithm suitable for noisy quantum devices. However, little is known about performance guarantees for p > 2. A recent work computing MaxCut performance guarantees for 3-regular graphs conjectures that any d-regular graph evaluated at particular fixed angles has an approximation ratio greater than some worst-case guarantee. In this work, we provide numerical evidence for this fixed angle conjecture for p < 12. We compute and provide these angles via numerical optimization and tensor networks. These fixed angles serve for an optimization-free version of QAOA and have universally good performance on any 3-regular graph. Heuristic evidence is presented for the fixed angle conjecture on graph ensembles, which suggests that these fixed angles are "close" to global optimum. Under the fixed angle conjecture, QAOA has a larger performance guarantee than the Goemans Williamson algorithm on 3-regular graphs for p >= 11.

Wurtz, Jonathan↗

Singular Vectors for Moisture-Measuring Norms

In dynamic meteorology, singular vectors (SVs) are the structures that maximize a given norm of a forecast perturbation given a tangent linear model and a quadratic constraint on the initial perturbation. That constraint is a prescription of the value of either the same or a different norm applied to the initial perturbations. In the sense that SVs maximize the forecast perturbations according to a specified measure, they may be considered as optimal perturbations. SVs are used to characterize predictability, to identify and correct possible initial errors given forecast errors, to create a set of significant perturbations for ensemble forecasting, or to determine locations for observation targeting. They are a specific application of generally defined singular vectors in mathematics.

Errico, Ronald M.↗

MERRA-2 Ocean: The NASA Global Modeling and Assimilation Office's Weakly Coupled Atmosphere-Ocean Reanalysis Using GEOS-S2S Version 3

The NASA Modern Era Reanalysis for Research and Applications (MERRA2) has been a respected and widely used reanalysis that has so far been restricted to the atmosphere. Now a newly released version of the atmosphere/ocean coupled data assimilation system (AODAS) has been developed by the NASA/Goddard Global Modeling and Assimilation Office to perform a retrospective ocean reanalysis from 1982 to present. In addition to assimilating all available in situ data (e.g. Argo, mooring, XBT and CTD data) and altimetry information into the ocean, the new version (GEOS-S2S Version 3) model includes a higher resolution, eddy-permitting ocean model than previous versions, a more realistic implementation of the atmosphere-ocean interface layer, and an improved coupling between glacier and ocean (among other improvements). In addition, this ocean data assimilation was expanded to include the assimilation of satellite sea surface salinity. The MERRA-2 AODAS will be described, and preliminary results will be shown from the assimilation reanalysis and from retrospective forecasts issued using a new ensemble strategy. Following the Global Ocean Data Assimilation Experiment (GODAE) protocols, we will present Class 1 through Class 4 validation results from the ocean reanalysis. Results indicate an improved ocean mixed layer depth, improved salinity near Greenland, an improved diurnal cycle of the sea surface skin temperature, an improved estimate of ocean evaporation, and better representation of western boundary currents (e.g. Gulf Stream) from our new ocean reanalysis. One of the motivations of this project is to provide optimal initial states for ENSO forecasting. Therefore, we will also present some preliminary results of retrospective ENSO forecasts. After thorough testing, it is expected that the GEOS-S2S Version 3 will replace our contributions to North American Multi-Model Ensemble (NMME), WCRP Subseasonal to Seasonal (S2S), and IRI seasonal prediction forecast projects.

Molod, Andrea↗

Sequential ensemble transform for Bayesian inverse problems

In this work, we present the Sequential Ensemble Transform (SET) method, an approach for generating approximate samples from a Bayesian posterior distribution. The method explores the posterior distribution by solving a sequence of discrete optimal transport problems to produce a series of transport plans which map prior samples to posterior samples. We prove that the sequence of Dirac mixture distributions produced by the SET method converges weakly to the true posterior as the sample size approaches infinity. Furthermore, our numerical results indicate that, when compared to standard Sequential Monte Carlo (SMC) methods, the SET approach is more robust to the choice of Markov mutation kernels and requires less computational efforts to reach a similar accuracy when used to explore complex posterior distributions. Finally, we describe adaptive schemes that allow to completely automate the use of the SET method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗