Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

COVID-19 dynamics across the US: A deep learning study of human mobility and social behavior

This paper presents a deep learning framework for epidemiology system identification from noisy and sparse observations with quantified uncertainty. The proposed approach employs an ensemble of deep neural networks to infer the time-dependent reproduction number of an infectious disease by formulating a tensor-based multi-step loss function that allows us to efficiently calibrate the model on multiple observed trajectories. The method is applied to a mobility and social behavior-based SEIR model of COVID-19 spread. The model is trained on Google and Unacast mobility data spanning a period of 66 days, and is able to yield accurate future forecasts of COVID-19 spread in 203 US counties within a time-window of 15 days. Interestingly, a sensitivity analysis that assesses the importance of different mobility and social behavior parameters reveals that attendance of close places, including workplaces, residential, and retail and recreational locations, has the largest impact on the effective reproduction number. Furthermore, the model enables us to rapidly probe and quantify the effects of government interventions, such as lock-down and re-opening strategies. Taken together, the proposed framework provides a robust workflow for data-driven epidemiology model discovery under uncertainty and produces probabilistic forecasts for the evolution of a pandemic that can judiciously provide information for policy and decision making. All codes and data accompanying this manuscript are available at https://github.com/PredictiveIntelligenceLab/DeepCOVID19.

60 APPLIED LIFE SCIENCES↗

Evaluation of Seismic Artificial Intelligence with Uncertainty

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still a lack of robust evaluation frameworks for evaluating and comparing DLMs. Here, we address this gap by designing an evaluation framework that jointly incorporates two crucial aspects: performance uncertainty and learning efficiency. To target these aspects, we meticulously construct the training, validation, and test splits using a clustering method tailored to seismic data and enact an expansive training design to segregate performance uncertainty arising from stochastic training processes and random data sampling. The framework’s ability to guard against misleading declarations of model superiority is demonstrated through the evaluation of PhaseNet (Zhu and Beroza, 2018), a popular seismic phase picking DLM, under three training approaches. Our framework helps practitioners choose the best model for their problem and set performance expectations by explicitly analyzing model performance with uncertainty at varying budgets of training data.

58 GEOSCIENCES↗

Accurate and uncertainty-aware multi-task prediction of HEA properties using prior-guided deep Gaussian processes

Surrogate modeling techniques have become indispensable in accelerating the discovery and optimization of high-entropy alloys (HEAs), especially when integrating computational predictions with sparse experimental observations. This study systematically evaluates the training and testing performance of four prominent surrogate models—conventional Gaussian processes (cGP), Deep Gaussian processes (DGP), encoder-decoder neural networks for multi-output regression and eXtreme Gradient Boosting (XGBoost)—applied to a hybrid dataset of experimental and computational properties of the 8-component HEA system Al-Co-Cr-Cu-Fe-Mn-Ni-V. We specifically assess their capabilities in predicting correlated material properties, including yield strength, hardness, modulus, ultimate tensile strength, elongation, and average hardness under dynamic/quasi-static conditions, alongside auxiliary computational properties. The comparison highlights the strengths of hierarchical deep modeling approaches in handling heteroscedastic, heterotopic, and incomplete data commonly encountered in materials science. Our findings illustrate that combined surrogate models such as DGPs infused with machine-learned priors outperform other surrogates by effectively capturing inter-property correlations and by assimilating prior knowledge. This enhanced predictive accuracy positions the combined surrogate models as powerful tools for robust and data-efficient materials design.

36 MATERIALS SCIENCE↗

Peri-Net-Pro: the neural processes with quantified uncertainty for crack patterns

Abstract This paper develops a deep learning tool based on neural processes (NPs) called the Peri-Net-Pro, to predict the crack patterns in a moving disk and classifies them according to the classification modes with quantified uncertainties. In particular, image classification and regression studies are conducted by means of convolutional neural networks (CNNs) and NPs. First, the amount and quality of the data are enhanced by using peridynamics to theoretically compensate for the problems of the finite element method (FEM) in generating crack pattern images. Second, case studies are conducted with the prototype microelastic brittle (PMB), linear peridynamic solid (LPS), and viscoelastic solid (VES) models obtained by using the peridynamic theory. The case studies are performed to classify the images by using CNNs and determine the suitability of the PMB, LBS, and VES models. Finally, a regression analysis is performed on the crack pattern images with NPs to predict the crack patterns. The regression analysis results confirm that the variance decreases when the number of epochs increases by using the NPs. The training results gradually improve, and the variance ranges decrease to less than 0.035. The main finding of this study is that the NPs enable accurate predictions, even with missing or insufficient training data. The results demonstrate that if the context points are set to the 10th, 100th, 300th, and 784th, the training information is deliberately omitted for the context points of the 10th, 100th, and 300th, and the predictions are different when the context points are significantly lower. However, the comparison of the results of the 100th and 784th context points shows that the predicted results are similar because of the Gaussian processes in the NPs. Therefore, if the NPs are employed for training, the missing information of the training data can be supplemented to predict the results.

Mathematics↗

DeepGrid: Robust Deep Reinforcement Learning-based Contingency Management

Increasing uncertainty raised by the integration of renewable energy resources requires an enormous number of simulations to be carried out for the security assessment of the power grid. However, it is challenging to assess the steady-state and dynamic security indices for different system contingency events by doing an exhaustive analysis in real-time due to the computational and communication constraints. One promising solution is using data-driven techniques along with the system models to train an intelligent contingency management framework to better handle the contingencies in real-time. Nevertheless, implementing a data-driven technique to obtain the best remedial actions necessitates to account for the effect of the measurement noise on the performance of the contingency management. To tackle these challenges, we leverage a robust deep reinforcement learning (DRL) algorithm called Double Deep Q-Network (DDQN) to design a recommender system capable of prescribing optimal control actions with the help of the real-time digital simulator (RTDS). The use of RTDS system in combination with the advanced DRL algorithm allows to explore a wide variety of system contingencies in order to derive better remedial actions. The performance of the proposed algorithm is evaluated in IEEE 9-bus system under different loading conditions, and different network configurations in presence of noisy measurements.

Ghasemkhani, Amir↗

The DECADE cosmic shear project II: photometric redshift calibration of the source galaxy sample

We present the photometric redshift characterization and calibration for the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The redshifts are estimated from a combination of wide-field photometry, deep-field photometry with associated redshift estimates, and a transfer function between the wide field and deep field that is estimated using a source injection catalog. We construct four tomographic bins for the galaxy catalog, and estimate the redshift distribution, $n(z)$, within each one using the Self-organizing Map Photo-Z (SOMPZ) methodology. Our estimates include the contributions from sample variance, zeropoint calibration uncertainties, and redshift biases, as quantified for the deep-field dataset. The total uncertainties on the mean redshifts are $σ_{\langle}$$_z$$_{\rangle} ≈ 0.01$. The SOMPZ estimates are then compared to those from the clustering redshift method, obtained by cross-correlating our source galaxies with galaxies in spectroscopic surveys, and are shown to be consistent with each other.

Anbajagane, D. [Univ. of Chicago, IL (United State↗

State of Stress Uncertainty Quantification and Geomechanical Risk Analysis for Subsurface Engineering

All subsurface stress measurement methods available for deep subsurface applications are indirect and involve a significant amount of uncertainty. Quantifying these uncertainties is critical for applications where the state of stress is a component of a risk analysis with significant safety, environmental, and economic considerations. A publicly available and open source tool called the State of Stress Analysis Tool (SOSAT) has been developed to aid in performing a Bayesian uncertainty quantification and geomechanical risk analysis using many types of commonly available data. A new feature of this tool is using data from the FutureGen 2.0 site. The new feature of the tool was uses information about the absence or presence of borehole breakouts to constrain the state of stress. This new feature allows the user to specify probability distributions for the relevant parameters such as the drilling mud pressure, temperature, and the formation strength properties. The tool computes the posterior joint probability distribution of the horizontal principal stresses. Using random samples from this posterior distribution the tool then computes the probability of activating a critically oriented fault at a range of pore pressures. This latter feature can be used to aid in the assessment of the risk of induced seismicity and leakage in geologic carbon sequestration and enhanced geothermal systems.

Burghardt, Jeffrey A.↗

Deep Learning Reconstruction of Daily Soil CO 2 Efflux Reveals Biogeochemical Insights and Reduces Annual Estimate Uncertainty Despite Limited Daily Predictability

Soil CO 2 efflux is commonly measured monthly or seasonally, leaving daily dynamics poorly resolved and contributing to global estimation uncertainty. We trained a single Long Short-Term Memory (LSTM) model to predict daily soil CO 2 efflux across 82 globally distributed sites in COSORE, with 0.2%–46.9% daily data coverage from 2003 to 2020. Despite using far fewer sites than are typically used to train a single deep learning model, with observations biased toward temperate mesic sites, the LSTM model performed well at approximately one-third of sites, reconstructed nearly 2 decades of daily efflux, and outperformed commonly used approaches for estimating daily efflux when applied to the same data set. Performance was weakest at pronounced peaks and troughs and at non-temperate sites with <1.5 years of observations and irregular data patterns. Nevertheless, annual efflux from reconstructed daily data had <40% error even at underperforming sites, substantially improving estimates derived from monthly and seasonal sampling (maximum errors of 95% and 136%, respectively). Temperature sensitivity (Q 10 ) estimated from reconstructed daily predictions closely matched estimates from daily observations, whereas Q 10 values derived from monthly or seasonal observations deviated substantially, suggesting that coarse temporal sampling may contribute to uncertainty in reported Q 10 values. Consistent daily reconstructions further enabled trend analyses for well-performing, predominantly temperate sites and showed increasing soil CO 2 efflux at most sites from 2003 to 2020, with more variable summer trends. Despite limitations, these results demonstrate the potential of LSTM models to reconstruct daily soil CO 2 efflux and reduce estimation uncertainties from sparse observations.

Smykalov, Valerie [Pennsylvania State University, ↗

Quantification of neural networks uncertainties with applications to SAFARI-1 axial neutron flux profiles

Deep Neural Networks (DNNs) have been widely used as a data-driven modelling tool in nuclear engineering. However, as a Machine Learning model, Artificial Neural Network (ANN) predictions are subjected to uncertainties originating from the noise in training data, incomplete coverage of the domain, and imperfect neural network architectures. In this work, we target at quantifying the prediction/approximation uncertainties of ANNs using Monte Carlo Dropout (MCD), as well as Bayesian Neural Networks (BNNs) which are solved by variational inference. With a demonstration problem in which neural networks are used to predict the assembly axial neutron flux profiles, the results have shown that the three different neural network models (regular DNNs, DNNs solved with MCD and BNNs) can produce results that agree very well among each other and with the measurement data, on cycles that are not used in the training process. Besides the excellent generalization capability, the uncertainty bands produced by MCD and BNN agree very well, and in general, they can fully envelop the noisy measurement data points. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Deep-field analytical calibration

The next generation of imaging surveys, including the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), Euclid, and the Nancy Grace Roman Space Telescope, will provide unprecedented constraints on cosmology using weak gravitational lensing. To fully exploit this statistical power, shear measurement methods must achieve sub- per cent accuracy while mitigating systematic biases from noise, the point-spread function (PSF), blending, and shear-dependent detection. The analytical calibration framework (AnaCal) has demonstrated such accuracy but requires adding noise to images, reducing effective depth. We introduce Deep-Field Analytical Calibration (DEEP-FIELD AnaCal), an extension of AnaCal that uses deep-field images to compute shear responses while preserving the statistical power of wide-field data. We validate DEEP-FIELD AnaCal on isolated and blended galaxy image simulations with LSST-like conditions, finding it meets the stringent requirement of multiplicative bias $|m| < 3\times 10^{-3}$ at 99.7 per cent confidence. Compared to standard AnaCal applied to wide-field images, DEEP-FIELD AnaCal increases the effective galaxy number density from 17 to 30 arcmin$^{-2}$ for simulated 10-yr LSST data. With deep fields $10\times$ longer than the wide field, we find pixel noise variance in shear estimation is reduced by 30 per cent and overall uncertainty by $\sim 25~{{\ \rm per\ cent}}$. Finally, using the LSST Deep Drilling Fields strategy, we assess sample variance and find an equivalent calibration uncertainty of $\lesssim 0.3~{{\ \rm per\ cent}}$. These results demonstrate that DEEP-FIELD AnaCal offers a promising path to achieve the required shear calibration for upcoming weak lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

The Importance of an Ensemble Approach for Modeling Aerosol‐Convection Interactions

Aerosol-convection interactions modulate cloud microphysics, thermodynamics, and updraft intensity, contributing to climate-scale aerosol-radiative forcing. However, quantifying aerosol indirect effects in mixed-phase deep convection remains challenging due to uncertainties in parameterized physics and initial conditions driving nonlinear evolution of convective processes. This study investigates the convective updraft sensitivity to random initial temperature perturbations using an idealized ensemble modeling framework informed by in situ thermodynamic and aerosol observations from the DOE TRACER field campaign. We analyze the impact of small-scale initial perturbations on updraft velocity and supersaturation, and determine the ensemble size required to minimize stochastic internal variability. Results show that minor thermodynamic perturbations can produce updraft variability comparable to aerosol-induced changes reported in prior work. An ensemble of 10 members sufficiently reduces variability, enabling robust investigation of aerosol-related updraft invigoration and informing the design of future ensemble-based aerosol-convection interaction studies in environments with significant spatiotemporal mesoscale thermodynamic and aerosol heterogeneity.

aerosol-convection interactions↗

Type Ia supernova observations combining data from the Euclid mission and the Vera C. Rubin Observatory

ABSTRACT The Euclid mission will provide first-of-its-kind coverage in the near-infrared over deep (three fields, ∼10–20 square degrees each) and wide (∼10 000 square degrees) fields. While the survey is not designed to discover transients, the deep fields will have repeated observations over a two-week span, followed by a gap of roughly six months. In this analysis, we explore how useful the deep field observations will be for measuring properties of Type Ia supernovae (SNe Ia). Using simulations that include Euclid’s planned depth, area, and cadence in the deep fields, we calculate that more than 3700 SNe between 0.0 < $z$ < 1.5 will have at least five Euclid detections around peak with signal-to-noise ratio larger than 3. While on their own, Euclid light curves are not good enough to directly constrain distances, when combined with legacy survey of space and time (LSST) deep field observations, we find that uncertainties on SN distances are reduced by 20–30 per cent for $z$ < 0.8 and by 40–50 per cent for $z$ > 0.8. Furthermore, we predict how well additional Euclid mock data can be used to constrain a key systematic in SN Ia studies – the size of the luminosity ‘step’ found between SNe hosted in high-mass (>1010 M⊙) and low-mass (<1010 M⊙) galaxies. This measurement has unique information in the rest-frame near-infrared (NIR). We predict that if the step is caused by dust, we will be able to measure its reduction in the NIR compared to optical at the 4σ level. We highlight that the LSST and Euclid observing strategies used in this work are still provisional and some level of joint processing is required. Still, these first results are promising, and assuming that Euclid begins observations well before the Nancy Roman Space Telescope (Roman), we expect this data set to be extremely helpful for preparation for Roman itself.

Astronomy & Astrophysics↗

Insights into Methodologies and Stochastic Optimization of Thermal Energy Storage-Coupled Advanced Reactor Systems: A Comparison of Methods for Accessing Long-Term Sub-System Sizing Adequacy

This paper investigates the potential of coupling Thermal Energy Storage (TES) with Advanced Reactors (ARs) to address uncertainties posed by climate change in deep decarbonized power systems. The TES Use-case Team at Idaho National Laboratory (INL) has examined the potential of storing thermal energy from ARs during low demand periods and optimizing discharge during peak-priced hours, in both steady-state and transient conditions. Building on this groundwork, this study bridges the gaps in optimal sizing of the sub-system of TES-coupled AR systems using Risk Analysis Virtual Environment (RAVEN) and Holistic Energy Resource Optimization Network (HERON), INL?s framework for grid optimization. By applying this framework, we present statistically-robust optimal charge, discharge including balance of plant (BOP), and storage sizing for the High-Temperature Gas-Cooled Reactor (HTGR) with 203 MWth output. To this end, we generated synthetic price samples for 30 years using 2018 ? 2021 real-time market data from ERCOT, PJM and MISO. Our results reveals that the TES-coupled HTGR system is highly effective in maximizing revenue from electricity sales. We observed a substantial increase of 40 % in ERCOT and a noteworthy 15 % increase in PJM and MISO when compared to the conventional BOP without TES. This improvement is achieved through regionally-tailored sub-system sizing, which ranges from 398 to 416 MWth for the discharge system and 610 to 1029 MWth for the TES. We find that the average electricity price directly impacts the overall economics, while price volatility influences storage size. Additional sensitivity analyses were performed to access the impact of key assumptions on system economics and sizing, differentiating the optimization window (i.e., 24 ? 219 hours of chronological observations) and by imposing storage continuity condition in tracking TES cycles. We observed that at the 120-hour of the optimization window, a reasonable balance between computation time and accuracy was achieved. Our analysis also highlights the significance of conducting multi-day cycle analysis (> 120-hour) for TES to capture interaction between electricity prices and storage dynamics, providing a comprehensive understanding of TES behavior that AR developers should integrate into their plant designs.

25 ENERGY STORAGE↗

Improving the representation of shallow cumulus convection with the simplified-higher-order-closure–mass-flux (SHOC+MF v1.0) approach

Abstract. Parameterized boundary layer turbulence and moist convection remain some of the largest sources of uncertainty in general circulation models. High-resolution climate modeling aims to reduce that uncertainty by explicitly attempting to resolve deep moist convective motions. An example of such a model is the Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) with a target global resolution of 3.25 km, allowing for a more accurate representation of complex mesoscale deep convective dynamics. Yet, small-scale planetary boundary layer turbulence and shallow convection still need to be parameterized, which in SCREAM is accomplished through the turbulent-kinetic-energy-based (TKE-based) simplified higher-order closure (SHOC) – a simplified version of the assumed-double-Gaussian-PDF (probability density function) higher-order-closure method. In this paper, we implement a stochastic-multiplume mass-flux (MF) parameterization of dry and shallow convection in SCREAM to go beyond the limitations of double-Gaussian-PDF closures and couple it to SHOC (SHOC+MF). The new parameterization implemented in a single-column model type version of SCREAM produces results for two shallow cumulus convection cases (marine and continental shallow convection) that agree well with the reference data from large-eddy simulations, thus improving the general representation of the thermodynamic quantities and their turbulent fluxes as well as cloud macrophysics in the model. Furthermore, SHOC+MF parameterization shows weak sensitivity to the vertical grid resolution and model time step.

54 ENVIRONMENTAL SCIENCES↗

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

Distributed energy resources (DERs), such as solar PVs and energy storage, can be used to restore distribution system critical loads after the extreme weather events to increase grid resilience. However, coordinating multiple DERs together with tie-switches for multi-step restoration process under renewable uncertainty is challenging. This paper proposes a deep reinforcement learning to control discrete actions of switching on/off tie switches and DERs for critical load restoration. The restoration problem is first cast into the Markov decision process suitable for DRL. Then, the original soft actor critic (SAC) method for continuous actions has been extended to handle discrete and continuous actions. Numerical comparison results with other stochastic optimization-based approaches on the modified IEEE 33-bus system show that the proposed method can achieve fast critical load restoration in the presence of substation power outage while maintaining system voltage limit throughout the restoration process.

active distribution systems↗

Deep Gaussian process-based cost-aware batch Bayesian optimization for complex materials design campaigns

The accelerating pace and expanding scope of materials discovery demand optimization frameworks that efficiently navigate vast design spaces with complex response surfaces while judiciously allocating limited evaluation resources. We present a cost-aware, batch Bayesian optimization scheme powered by deep Gaussian process (DGP) surrogates and a heterotopic querying strategy. Our DGP surrogate, formed by stacking GP layers, models complex hierarchical relationships among high-dimensional compositional features and captures correlations across multiple target properties, propagating uncertainty through successive layers. We integrate evaluation cost into an upper-confidence-bound acquisition extension, which, together with heterotopic querying, proposes small batches of candidates in parallel, balancing exploration of under-characterized regions with exploitation of high-mean, low-variance predictions across correlated properties. Applied to refractory high-entropy alloys for high-temperature applications, our framework converges to optimal formulations in fewer iterations with cost-aware queries than conventional GP-based BO, highlighting the value of deep, uncertainty-aware, cost-sensitive strategies in materials campaigns.

36 MATERIALS SCIENCE↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Deep learning models have proven to be a powerful tool for the prediction of molecular properties for applications including drug design and the development of energy storage materials. However, in order to learn accurate and robust structure–property mappings, these models require large amounts of data which can be a challenge to collect given the time and resource-intensive nature of experimental material characterization efforts. Additionally, such models fail to generalize to new types of molecular structures that were not included in the model training data. The acceleration of material development through uncertainty-guided experimental design has the promise to significantly reduce the data requirements and enable faster generalization to new types of materials. To evaluate the potential of such approaches for electrolyte design applications, we perform comprehensive evaluation of existing uncertainty quantification methods on the prediction of two relevant molecular properties - aqueous solubility and redox potential. We develop novel evaluation methods to probe the utility of the uncertainty estimates for both in-domain and out-of-domain data sets. Finally, we leverage selected uncertainty estimation methods for active learning to evaluate their capacity to support experimental design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗