Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Predicting critical heat flux with uncertainty quantification and domain generalization using conditional variational autoencoders and deep neural networks

Deep generative models (DGMs) can generate synthetic data samples that closely resemble the original dataset, addressing data scarcity. In this work, we developed a conditional variational autoencoder (CVAE) to augment critical heat flux (CHF) data used for the 2006 Groeneveld lookup table. To compare with traditional methods, a fine-tuned deep neural network (DNN) regression model was evaluated on the same dataset. Both models achieved small mean absolute relative errors, with the CVAE showing more favorable results. Uncertainty quantification (UQ) was performed using repeated CVAE sampling and DNN ensembling. The DNN ensemble improved performance over the baseline, while the CVAE maintained consistent results with less variability and higher confidence. Both models achieved small errors inside and outside the training domain, with slightly larger errors outside. Altogether, the CVAE performed better than the DNN in predicting CHF and exhibited better uncertainty behavior.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗

GrainNN: A neighbor-aware long short-term memory network for predicting microstructure evolution during polycrystalline grain formation

High fidelity simulations of grain formation in alloys are an indispensable tool for process-to-mechanical-properties characterization. Such simulations, however, can be computationally expensive as they require fine spatial and temporal discretizations. Their cost becomes an obstacle to parametric studies and ensemble runs and ultimately makes downstream tasks like optimal control and uncertainty quantification challenging. To enable such downstream tasks, we introduce GrainNN, an efficient and accurate reduced-order model for epitaxial grain growth in additive manufacturing conditions. GrainNN is a sequence-to-sequence long-short-term-memory (LSTM) deep neural network that evolves the dynamics of manually crafted features. Its innovations are (1) an attention mechanism with grain-microstructure-specific transformer architecture; and (2) an overlapping combination of several clones of the network to generalize to grain configurations that are different from those used for training. This design enables GrainNN to predict grain formation for unseen physical parameters, grain number, domain size and geometry. Furthermore, GrainNN not only reconstructs the quantities of interest but also can be pointwise accurate. In our numerical experiments, we use a polycrystalline phase field method to both generate the training data and assess GrainNN. For multiparametric, ensemble simulations with many grains, GrainNN can be orders of magnitude faster than phase field simulations, while delivering 5%–15% pointwise error. Additionally, this speedup includes the cost of the phase field simulations for generating training data.

36 MATERIALS SCIENCE↗

Impact of jet-production data on the next-to-next-to-leading-order determination of HERAPDF2.0 parton distributions

The HERAPDF2.0 ensemble of parton distribution functions (PDFs) was introduced in 2015. The final stage is presented, a next-to-next-to-leading-order (NNLO) analysis of the HERA data on inclusive deep inelastic ep scattering together with jet data as published by the H1 and ZEUS collaborations. A perturbative QCD fit, simultaneously of $\alpha _s(M_Z^2)$ and the PDFs, was performed with the result $\alpha _s(M_Z^2)= 0.1156 \pm 0.0011~\mathrm{(exp)}~ ^{+0.0001}_{-0.0002}~ \mathrm{(model}$ $\mathrm{+ parameterisation)}~ \pm 0.0029~\mathrm{(scale)}$. The PDF sets of HERAPDF2.0Jets NNLO were determined with separate fits using two fixed values of $\alpha _s(M_Z^2)$, $\alpha _s(M_Z^2)$ = 0.1155 and 0.118, since the latter value was already chosen for the published HERAPDF2.0 NNLO analysis based on HERA inclusive DIS data only. The different sets of PDFs are presented, evaluated and compared. The consistency of the PDFs determined with and without the jet data demonstrates the consistency of HERA inclusive and jet-production cross-section data. The inclusion of the jet data reduced the uncertainty on the gluon PDF. Predictions based on the PDFs of HERAPDF2.0Jets NNLO give an excellent description of the jet-production data used as input.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Leveraging machine learning to enhance aerosol classification using Single-Particle Mass Spectrometry

Advancing automated classification of atmospheric aerosols from Single-Particle Mass Spectrometry (SPMS) data remains challenging due to overlapping ion signatures, compositional diversity, and limited labeled data. This study evaluates supervised and semi-supervised learning frameworks to enhance aerosol identification by jointly leveraging labeled and unlabeled spectra. Four models were compared: a supervised Support Vector Machine (SVM), a self-training SVM, a stacked autoencoder classifier, and a stacked autoencoder trained using a temporal-ensembling Mean Teacher approach. All models achieved high and stable accuracies (90.0 %–91.1 %), surpassing previous results on the same dataset (87 %) and matching the performance of state-of-the-art deep learning methods. Despite small global metric differences (≤ 1 %), semi-supervised variants yielded up to 5 %–10 % improvements for compositionally rare particle types – such as soot (0.77 % of spectra, F1-score: 0.93–0.97) and hazelnut pollen (0.98 % of spectra, F1-score: 0.97–1.00) – equating to roughly ∼ 187 additional correctly classified spectra. These gains are scientifically significant, as such rare particles exert disproportionate influence on radiative absorption and ice nucleation processes; their improved detection reduces modeled uncertainties in aerosol absorption optical depth and mixed-phase cloud ice nucleation rates. The models' residual misclassifications (≈ 9 %) largely arise from true spectral overlap among chemically adjacent species (e.g., Na- vs. K-feldspar, coated vs. uncoated feldspars), reflecting physical compositional continuity rather than algorithmic error. Collectively, these findings demonstrate that leveraging unlabeled data to learn robust spectral representations and refine classification enhances both fidelity and interpretability, bridging data-driven analysis with aerosol–climate process understanding.

54 ENVIRONMENTAL SCIENCES↗

Deep learning model for fast, science-based forecasting of fluid migration along faults in geologic carbon storage scenarios

Effective long-term geologic storage depends on robust site selection and credible, science-based forecasting of subsurface behavior to ensure storage integrity. For this work, we develop a deep learning–based reduced-order model (ROM) to quantify potential carbon dioxide (CO₂) and brine migration through geological faults. The ROM combines a Transformer model for binary classification and a Stacked Ensemble for regression, trained on a comprehensive dataset generated from 1400 physics-based reservoir simulations. Key geologic and operational parameters—including fault geometry, reservoir structure, and injection conditions—were systematically varied to capture a wide range of fluid migration scenarios. The ROM accurately predicts the onset of migration, cumulative migration volumes of both CO₂ and brine, and associated migration rates, as compared to an independent set of validation simulations, while significantly reducing computational cost compared to traditional simulation methods. Model performance was evaluated across diverse fault configurations, revealing that shallow reservoir geometry and fault angle are among the most influential factors governing migration behavior. Sensitivity analysis using SHapley Additive exPlanations (SHAP) provided interpretability, revealing distinct patterns in how geological and operational features drive transient versus cumulative migration outcomes. The ROM’s ability to rapidly simulate fault migration scenarios enables efficient sensitivity analyses, scenario evaluations, and decision support for site selection and monitoring design. This approach enhances the safety, scalability, and long-term operational performance of geologic carbon storage (GCS) systems by providing a robust, interpretable tool for predicting subsurface fluid migration and assessing fault-related migration potential.

42 ENGINEERING↗

Long-term evolution of 1991 DA: A dynamically evolved extinct Halley-type comet

The long-term dynamical evolution of 21 variational orbits for the intermediate-period asteroid 1991 DA was followed for up to +/-10(exp 5) years from the present. 1991 DA is close to the 2:7 resonance with Jupiter; it has avoided close encounters, within 1 AU, with this planet for at least the past 30,000 years, even at the node crossing. The future evolution typically shows no close encounters with Jupiter within at least 50,000 years. This corresponds to the mean time between node crossings with either Jupiter or Saturn. Close encounters with Saturn and Jupiter lead to a chaotic evolution for the whole ensemble, while secular perturbations cause large-amplitude swings in eccentricity and inclination (the latter covering the range 15 deg approximately less than i approximately less than 85 deg) which correlate with deep excursions of the perihelion distance to values much less than 1 AU. These variations are similar to those found in P/Machholz and a variety of other high-inclination orbits, e.g., P/Hartley-IRAS. We emphasize the connection between the orbital evolution of 1991 DA and that of Halley-type comets. If 1991 DA was once a comet, it is not surprising that it is now extinct.

Hahn, Gerhard↗

Generalizable Image Segmentation for Microstructure Characterization Through Integrated SEM and EBSD Analysis

We demonstrate generalizable semantic segmentation using minimal ground truth data. Correlated scanning electron microscopy (SEM) images and electron backscatter diffraction (EBSD) measurements of frictionstir processed 316L stainless steel plates were used to train deep learning models for grain boundary segmentation. Secondary electron (SE) imaging taken at an accelerating voltage of 10 keV correlated to EBSD-derived grain boundaries produced the best performing model. Notably, an ensemble of three models trained on a single SE image produced accurate segmentation over a series of BSE images of samples manufactured under different processing parameters, with a resultant mean absolute error in grain size of 0.34 µm. The striking generalizability of the models likely results from the similar escape depths of the SE training input and the EBSD training output and the reduced probability of dislocation artifacts appearing in the image. This finding highlights the importance of considering the physical principles behind imaging in the development of robust segmentation models for microstructure characterization.

Taufique, Mohammad Fuad Nur↗

CoSim: A Simulator for Co-Scheduling of Batch and On-Demand Jobs in HPC Datacenters

The increasing scale and complexity of scientific applications are rapidly transforming the ecosystem of tools, methods, and workflows adopted by the high-performance computing (HPC) community. Big data analytics and deep learning are gaining traction as essential components in this ecosystem in a variety of scenarios, such as, steering of experimental instruments , acceleration of high-fidelity simulations through surrogate computations, and guided ensemble searches. In this context, the batch job model traditionally adopted by the supercomputing in-frastructures needs to be complemented with support to schedule opportunistic on-demand analytics jobs, leading to the problem of efficient preemption of batch jobs with minimum loss of progress. In this paper, we design and implement a simulator, CoSim, that enables on-the-fly analysis of the trade-offs arising between delaying the start of opportunistic on-demand jobs, which leads to longer analytics latency, and loss of progress due to preemption of batch jobs, which is necessary to make room for on-demand jobs. To this end, we propose an algorithm based on dynamic programming with predictable performance and scalability that enables supercomputing infrastructure schedulers to analyze the aforementioned trade-off and take decisions in near real-time. Compared with other state-of-art approaches using traces of the Theta pre-Exascale machine, our approach is capable of finding the optimal solution, while achieving high performance and scalability.

batch job preemption↗

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Prediction of DIII-D Pedestal Structure from Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. An experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (ne) and electron temperature (Te) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (Ip), toroidal magnetic field (Bφ), neutral beam heating power (PNBI) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Sensitivity of organized convective storms to model grid spacing in current and future climates

Mesoscale convective systems (MCSs) are complexes of thunderstorms that become organized and cover hundreds of kilometres over several hours. MCSs are prolific rain producers in the tropics and mid-latitudes and are the major cause of warm-season flooding. Traditionally, climate models have difficulties in simulating MCSs partly due to the misrepresentation of complex process interactions that operate across a large range of scales. Significant improvements in simulating MCSs have been found in kilometre-scale models that explicitly simulate deep convection. However, these models operate in the grey zone of turbulent motion and have known deficiencies in simulating small-scale processes (e.g. entrainment, vertical mass transport). Here, we perform mid-latitude idealized ensemble MCS simulations under current and future climate conditions in three atmospheric regimes: hydrostatic (12 km horizontal grid spacing; Δx), non-hydrostatic (Δx = 4, 2 and 1 km) and large eddy scale (Δx = 500 m and 250 m). Our results show a dramatic improvement in simulating MCS precipitation, movement, cold pools, and cloud properties when transitioning from 12 km to 4 km Δx. Decreasing Δx beyond 4 km results in modest improvements except for up- and downdraft sizes, average vertical mass fluxes, and cloud top height and temperature, which continue to change. Most important for climate modelling is that Δx = 4 km simulations reliably capture most MCS climate change signals compared to those of the Δx = 250 m runs. Significantly different climate change signals are found in Δx = 12 km runs that overestimate extreme precipitation changes by up to 100%.

54 ENVIRONMENTAL SCIENCES↗

Using Enhanced Grace Water Storage Data to Improve Drought Detection by the U.S. and North American Drought Monitors

NASA's Gravity Recovery and Climate Experiment (GRACE) satellites measure time variations of the Earth's gravity field enabling reliable detection of spatio-temporal variations in total terrestrial water storage (TWS), including groundwater. The U.S. and North American Drought Monitors rely heavily on precipitation indices and do not currently incorporate systematic observations of deep soil moisture and groundwater storage conditions. Thus GRACE has great potential to improve the Drought Monitors by filling this observational gap. GRACE TWS data were assimilating into the Catchment Land Surface Model using an ensemble Kalman smoother enabling spatial and temporal downscaling and vertical decomposition into soil moisture and groundwater components. The Drought Monitors combine several short- and long-term drought indicators expressed in percentiles as a reference to their historical frequency of occurrence. To be consistent, we generated a climatology of estimated soil moisture and ground water based on a 60-year Catchment model simulation, which was used to convert seven years of GRACE assimilated fields into drought indicator percentiles. At this stage we provide a preliminary evaluation of the GRACE assimilated moisture and indicator fields.

Houborg, Rasmus↗

Atomic Layer Deposition with TiO2 for Enhanced Reactivity and Stability of Aromatic Hydrogenation Catalysts

Hydrogenation of aromatic molecules in fossil- and bio-derived fuels is essential for decreasing emissions of harmful combustion products and addressing growing concerns around urban air pollution. In this work, we used atomic layer deposition to significantly enhance the hydrogenation performance of a conventional supported Pd catalyst by applying an ultrathin coating of TiO2 in a scalable powder coating process. The TiO2-coated catalyst showed substantial gains in the conversion of multiple aromatic molecules, including a 5-fold improvement in turnover frequency versus the uncoated catalyst in the hydrogenation of naphthalene. This activity enhancement was maintained upon scaling the coating synthesis process from 3 to 100 g. Based on the results from Xray photoelectron spectroscopy, X-ray absorption spectroscopy, and computational modeling, the activity enhancement was attributed to ensemble effects resulting from partial TiO2 coverage of the Pd surface rather than fundamental changes to the Pd electronic structure. Additional durability testing confirmed that the TiO2 coating improved the thermal and hydrothermal stability of the catalyst as well as tolerance toward sulfur impurities in the reactant stream. Using an economic model of an industrial deep hydrogenation process, we found that an increase in catalyst activity or lifetime of 2× would justify even a relatively high estimate for the cost of TiO2 atomic layer deposition coatings at scale

atomic layer↗

The Role of Subcloud Mesoscale Convergence in Sculpting Convective Updraft Width and Depth

The initiation of deep moist convection is governed in part by the horizontal width of updrafts near cloud base, which limits the deleterious effects of entrainment-driven dilution on buoyant thermals ascending through the free troposphere. However, the factors controlling cloud-base updraft width, which in turn dictates cloud depth, are not well understood. We track the evolving three-dimensional structure of the mesoscale subcloud forcing for vertical motion and near-cloud thermodynamic ingredients within a high-resolution ensemble of simulations of seven realistic daytime orographic convection initiation events to determine their relative roles in controlling cloud width and depth. Statistical analysis of approximately 5000 cloudy updraft samples indicates that the most important contributors to the width of cloudy updrafts across the ensemble are the depth and magnitude of the subcloud mesoscale ascent. However, the depth achieved by clouds is more consistently predicted by the near-cloud ambient relative humidity within the lower to middle free troposphere and convective available potential energy. Therefore, although the width of cloudy updrafts may be partly set at low levels by the mesoscale vertical mass and moisture flux, the likelihood of deep moist convection is governed by the generation of positive buoyancy within cumulus thermals and entrainment-driven dilution that reduces it. The persistence of the low-level mesoscale vertical forcing locally consolidates and vertically transports boundary layer moisture, helping to reduce updraft dilution. However, these factors vary in relative impacts on cloudy updrafts across individual cases, indicating multiple pathways for deep convection initiation.

Convective storms↗

Uncertainty quantification for deep learning in particle accelerator applications

With the advent of increased computational resources and improved algorithms, machine learning-based models are being increasingly applied to complex problems in particle accelerators. However, such data-driven models may provide overly confident predictions with unknown errors and uncertainties. For reliable deployment of machine learning models in high-regret and safety-critical systems such as particle accelerators, estimates of prediction uncertainty are needed along with accurate point predictions. In this investigation, we evaluate Bayesian neural networks (BNN) as an approach that can provide accurate predictions along with reliably quantified uncertainties for particle accelerator problems, and compare their performance with bootstrapped ensembles of neural networks. We select three accelerator setups for this evaluation: a storage ring, a photoinjector, and a linac. The problems span different data volumes and dimensionalities (e.g., scalar predictions as well as image outputs). It is found that BNN provide accurate predictions of the mean along with reliable estimates of predictive uncertainty across the test cases. In this vein, BNN may offer an attractive alternative to deterministic deep learning tools to generate accurate predictions with quantified uncertainties in particle accelerator applications.

43 PARTICLE ACCELERATORS↗

Mallat Scattering Transformation based surrogate for Magnetohydrodynamics

Abstract A Machine and Deep Learning (MLDL) methodology is developed and applied to give a high fidelity, fast surrogate for 2D resistive MagnetoHydroDynamic (MHD) simulations of Magnetic Liner Inertial Fusion (MagLIF) implosions. The resistive MHD code is used to generate an ensemble of implosions with different liner aspect ratios, initial gas preheat temperatures (that is, different adiabats), and different liner perturbations. The liner density and magnetic field as functions of x , y , and z were generated. The Mallat Scattering Transformation (MST) is taken of the logarithm of both fields and a Principal Components Analysis (PCA) is done on the logarithm of the MST of both fields. The fields are projected onto the PCA vectors and a small number of these PCA vector components are kept. Singular Value Decompositions of the cross correlation of the input parameters to the output logarithm of the MST of the fields, and of the cross correlation of the SVD vector components to the PCA vector components are done. This allows the identification of the PCA vectors vis-a-vis the input parameters. Finally, a Multi Layer Perceptron (MLP) neural network with ReLU activation and a simple three layer encoder/decoder architecture is trained on this dataset to predict the PCA vector components of the fields as a function of time. Details of the implosion, stagnation, and the disassembly are well captured. Examination of the PCA vectors and a permutation importance analysis of the MLP show definitive evidence of an inverse turbulent cascade into a dipole emergent behavior. The orientation of the dipole is set by the initial liner perturbation. The analysis is repeated with a version of the MST which includes phase, called Wavelet Phase Harmonics (WPH). While WPH do not give the physical insight of the MST, they can and are inverted to give field configurations as a function of time, including field-to-field correlations.

97 MATHEMATICS AND COMPUTING↗

The modification and application of Kuo's parameterization of cumulus convection in middle latitudes

An evaluation to reveal physical insight into the involved mechanisms through a combination of the large scale heat and moisture budgets and formulation of the latent heat released was performed. To improve upon the treatment of the interaction of deep convection with the environment, modifications consisting of considerations of the large scale moisture supply and of the vertical transport of moisture and of dry static energy inside the cloud are made. Also, a two layer cloud ensemble model is combined with the modified scheme. An examination of the modified scheme is performed by combining the large scale heat and moisture budgets and the modified formulation of the latent heat released. The modified parameterization procedures are compared with the original scheme, and the results of tests of both schemes are discussed. A variational optimization scheme is developed to analyze the wind field such that the integrated continuity equation and the global boundary condition are satisfied.

Liang, W. J.↗