Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Exploiting the Photoelectric effect for X-ray Polarimetry using Time Projection Chamber

The promise of photoelectric X-ray polarimetry has now been realized in laboratory demonstrations and may soon be used for astrophysical observations. Photoelectric polarimetry in gas filled proportional counters achieves high sensitivity through a combination of broad band width and good modulation. The band can be tuned by careful choice of gas composition and pressure. The measurements rely on imaging the tracks of photoelectrons. The initial direction of each track carries information about the electric field of the X-ray photon, and an ensemble of such measurements thus measures the net polarization of the source. A novel readout geometry using time projection chambers (TPC) allows deep (i.e. high efficiency) detectors, albeit without the ability to image the sky. Polarimeters which exploit the TPC geometry can be optimized for use behind telescopes, to study faint persistent sources, or as wide field of view instruments, designed to study bright transient events such as gamma-ray bursts or solar flares. We present the conceptual design of both types of TPC polarimeter. Recent laboratory results demonstrate that these polarimeters can achieve substantial gains in the polarization sensitivity achievable in experiments of modest size.

Jahoda, Keith↗
DOE OSTI2022

TULIP: An RNA-seq-based Primary Tumor Type Prediction Tool Using Convolutional Neural Networks

Background: With cancer as one of the leading causes of death worldwide, accurate primary tumor type prediction is critical in identifying genetic factors that can inhibit or slow tumor progression. There have been efforts to categorize primary tumor types with gene expression data using machine learning, and more recently with deep learning, in the last several years. Methods In this paper, we developed four 1-dimensional (1D) Convolutional Neural Network (CNN) models to classify RNA-seq count data as one of 17 highly represented primary tumor types or 32 primary tumor types regardless of imbalanced representation. Additionally, we adapted the models to take as input either all Ensembl genes (60,483) or protein coding genes only (19,758). Unlike previous work, we avoided selection bias by not filtering genes based on expression values. RNA-seq count data expressed as FPKM-UQ of 9,025 and 10,940 samples from The Cancer Genome Atlas (TCGA) were downloaded from the Genomic Data Commons (GDC) corresponding to 17 and 32 primary tumor types respectively for training and validating the models. Results: All 4 1D-CNN models had an overall accuracy of 94.7% to 97.6% on the test dataset. Further evaluation indicates that the models with protein coding genes only as features performed with better accuracy compared to the models with all Ensembl genes for both 17 and 32 primary tumor types. For all models, the accuracy by primary tumor type was above 80% for most primary tumor types. Conclusions: We packaged all 4 models as a Python-based deep learning classification tool called TULIP (TUmor CLassIfication Predictor) for performing quality control on primary tumor samples and characterizing cancer samples of unknown tumor type. Further optimization of the models is needed to improve the accuracy of certain primary tumor types.

Jones, Sara↗
DOE OSTI2024

SPY: a conceptual design study of a magnet system for a high-pressure gaseous TPC neutrino detector

Here, we present a novel conceptual design for a magnet system that provides the magnetic field necessary for the analysis of tracks in a high-pressure gaseous argon TPC while simultaneously serving as a pressure vessel to contain the TPC gas volume. The magnet was developed within a Near Detector proposal for the Deep Underground Neutrino Experiment (DUNE). The high-pressure gaseous argon TPC is a component proposed to be one of the elements of an ensemble of near detectors that are needed for DUNE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2020

Linkage among Ice Crystal Microphysics, Mesoscale Dynamics and Cloud and Precipitation Structures Revealed By Collocated Microwave Radiometer and Multi-Frequency Radar Observations

Ice clouds and falling snow are ubiquitous globally and play important roles in the Earth’s radiation budget and precipitation processes. Ice particle microphysical properties (e.g., size, habit and orientation) are not only influenced by ambient environment’s dynamic and thermodynamic conditions, but also intimately connect to the cloud radiative effects and particle fall speeds, which therefore impact up to the future climate projection and down to the details of the surface precipitation (e.g., onset-time, location, type and strength). Our previous work revealed that high-frequency Polarimetric radiance Difference (PD) from passive microwave sensors is a good indicator of the bulk aspect ratio of horizontally oriented ice particles that are often occur inside anvil clouds and/or stratiform precipitations. In this current work, we further investigate the dynamic/thermodynamic mechanisms and cloud/precipitation structures associated with ice-phase microphysics corresponding to different PD signals. In order to do so, collocated CloudSat radar (W-band) and Global Precipitation Measurement Dual-frequency Precipitation Radar (GPM-DPR, Ku/Ka bands) observations as well as European Centre for Medium-Range Weather Forecasts (ECMWF) atmosphere background profiles are grouped according to the magnitude of PD for only stratiform precipitation and/or anvil cloud scenes. We found that horizontally-oriented snow aggregates or large snow particles are likely the major contributor to the high-PD signals at 166 GHz, while low-PD magnitudes can be attributed to small cloud ice, randomly oriented snow aggregates, riming snow or super-cooled water. Further, high (low) PD scenes are found to be associated with stronger (weaker) wind shear and higher (lower) ambient humidity, both of which help promote (prohibit) the growth of frozen particles and the organization of convective systems. An ensemble of squall line cases is studied at the end to demonstrate that the PD asymmetry in the leading and trailing edges of the deep convection line is closely tied to the anvil cloud and stratiform precipitation layers respectively, suggesting the potential usefulness of PD as a proxy of stratiform/convective precipitation flag, as well as a proxy of convection life stage.

Ice crystal microphysics↗
DOE OSTI2025

Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification" Willard et al. (2025).

This data release provides all data and code used in the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025)" to model stream temperature, evaluate, and assess results. The associated manuscript explores the effect of different ensemble construction techniques across different common machine learning (ML) architectures for predictions in unmonitored basins. Modeling was done using long short-term memory (LSTM), gated recurrent unit (GRU), temporal convolution network (TCN), and extreme gradient boosting (XGBoost) models, and stream site coverage spans 1362 locations across the conterminous United States. The ensemble construction techniques investigated include ensemble by random weight initialization, differing hyperparameters, different random subsets of training data, different subselections of input features, different architectures, and Monte Carlo Dropout. The data is organized into these items items:Code repository and data for the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025).Code: stream_temp_ml_regionalization.zip contains the code repositoryData to run the code:- data_dir.zip -- contains all files that should be moved to the "DATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- metadata_dir.zip -- contains all files that should be moved to the "METADATA_DIR" variable defined in the "set_env_vars.sh" script in the code repositoryData produced by the code and used in the paper:- outputs_dir.zip - contains model output and results (outputs_dir/results), model weights (outputs_dir/models), and all other outputs used for the paper including feature importances.To cite this code, please use the following BibTeX or MLA entries:bibtex:@misc{willard2025streamensembles,author = {Jared Willard and Charuleka Varadharajan},title = {Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification"},year = {2024},doi = {10.15485/2527393},publisher = {ESS-DIVE Repository},url = {https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2527393}}MLA: Willard, Jared, et al. Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification". 2025. ESS-DIVE Repository, doi:10.15485/2448016.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Active operator learning with predictive uncertainty quantification for partial differential equations

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. Here, we propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Influence of Shallow Cloud Populations on Transitions to Deep Convection in the Amazon

Abstract In this study, a pair of convection-permitting (2-km grid spacing), month-long, wet-season Weather Research and Forecasting (WRF) Model simulations with and without the eddy-diffusivity mass-flux (EDMF) scheme are performed for a portion of the Green Ocean Amazon (GoAmazon) 2014/15 field campaign period. EDMF produces an ensemble of subgrid-scale convective plumes that evolve in response to the boundary layer meteorological conditions and can develop into shallow clouds. The objective of this study is to determine how different treatments of shallow cumulus clouds (i.e., with and without EDMF) impact the total cloud population and precipitation across the Amazonian rain forest, with emphasis on impacts on the likelihood of shallow-to-deep convection transitions. Results indicate that the large-scale synoptic conditions in the EDMF and control simulations are nearly identical; however, on the local scale their rainfall patterns diverge drastically and the biases decrease in EDMF. The EDMF scheme significantly increases the frequency of shallow clouds, but the frequencies of deep clouds are similar between the simulations. Deep convective clouds are tracked using a cloud-tracking algorithm to examine the impact of shallow cumulus on the surrounding ambient environment where deep convective clouds initiate. Results suggest that a rapid increase of low-level cloudiness acts to cool and moisten the low to midtroposphere during the day, favoring the transition to deep convection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Deep energy-pressure regression for a thermodynamically consistent EOS model

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Inferring safety critical events from vehicle kinematics in naturalistic driving environment: Application of deep learning Algorithms

Advances in sensing technology has enabled the collection of countless terabytes of second-by-second kinematics data. Such data provides opportunities for real-time monitoring of driving behavior and identification of safety critical events (SCEs) including crashes and near crashes. The concept of volatility is relevant in this context, which identifies instability and erratic variations in driving behavior prior to involvement in SCEs. This study utilized vehicle kinematics from a large-scale naturalistic driving data to develop a deep learning approach based on 1D convolutional neural networks (CNN) for inferring SCEs. The data are unique in the sense that such accurate pre-crash data at high fidelity are not available in traditional crash repositories. This study contributes to the literature by providing a first attempt at predicting responses to SCEs by developing deep learning-based CNN architectures using novel driving volatility based kinematic thresholds for a sample of 9553 events. The key contribution lies in developing a volatility-based CNN input layout that is acceptable to CNN schemes and represents the motion kinematics such as speed, acceleration and volatility measures. Several 1D-CNN architectures were developed using layers, numbers of convolutions, layer patterns, and kernels. Shallow and deep architectures were tested, revealing higher accuracy of shallow architectures in detecting SCEs. The optimal number of epochs were identified using an early stopping method while the CNN performance was improved by increasing the number of epochs. The ensemble CNN had the highest predictive accuracy of 95.6% for detection of crashes and near crashes, which was 2.5% higher than the optimal CNN using 20% hold out test data. The ensemble CNN also outperformed classical machine learning models and model performance reported in past studies on detection of SCEs. Finally, these results have implications for identification of safety hotspots and providing real-time alerts and warnings in connected and highly automated vehicle environment including society of automotive engineers levels 3–5.

42 ENGINEERING↗
DOE OSTI2025

From clutter to clarity: Emergent neural operators via questionnaire metrics

Real-world datasets in chemical engineering and bioengineering processes—such as those from catalytic reactors, multiphase flows, polymerization reactors, bioreactors, and clinical trials—can often be unlabeled or disorganized, rendering the training of existing supervised learning models ineffective at learning the underlying dynamics. To salvage these datasets for decision-making, we first seek to obtain clarity from the cluttered data. Here, we present a framework for developing “structural” generative models, discovering emergent equations, and constructing efficient emulators from scrambled datasets by integrating unsupervised organizational learning techniques (Questionnaires) with advanced deep learning architectures (Deep Hidden Physics Models and Deep Operator Networks). Our approach is demonstrated on two illustrative model systems: (a) a 1D advection–diffusion partial differential equation representing a winding underground pipe and (b) an ensemble of Stuart–Landau oscillators, an agent-based system of coupled ordinary differential equations. In both cases, we successfully reconstruct meaningful spatial, temporal, and parameter embeddings from scrambled data, enabling good predictions of system dynamics. As a result, we highlight the framework’s potential for broader applications, enabling data-driven system identification in fields with inherently disorganized or hidden parameter spaces.

42 ENGINEERING↗
DOE OSTI2024

Summer Convective Precipitation Changes Over the Great Lakes Region Under a Warming Scenario

To understand future summer precipitation changes over the Great Lakes Region (GLR), we performed an ensemble of regional climate simulations through the Pseudo-Global Warming (PGW) approach. We found that different types of convective precipitation respond differently to the PGW signal. Isolated deep convection (IDC), usually concentrated in the southern domain, shows an increase in precipitation to the north of the GLR. Mesoscale convective systems (MCSs), usually concentrated upwind of the GLR, shift to the downwind region with increased precipitation. Thermodynamic variables such as convective available potential energy (CAPE) and convective inhibition energy (CIN) are found to increase across almost the entire studied domain, creating a potential environment more favorable for stronger convection systems and less favorable for weaker ones. Meanwhile, changes in the lifting condensation level (LCL) and level of free convection (LFC) show a strong correlation with variations in convective precipitation, highlighting the significance of these thermodynamic factors in controlling precipitation over the domain. Our results indicate that the decrease in LCL and LCF in areas with increased convective precipitation is mainly due to increased atmospheric moisture. In response to the prescribed warming perturbation, MCSs occur more frequently downwind, while localized IDCs exhibit more intense rain rates, longer durations, and larger rainfall area.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluation of WRF-Solar Cloud Forecast Using the NSRDB: Preprint

Cloud forecast is a crucial component in predicting solar irradiance from numerical weather prediction (NWP) models. Assessing cloud properties from the NWP models requires significant work due to the need for high-quality data, spatial analysis covering model extent, and detailed analysis of model performance for different types of clouds. This study presents an evaluation of the WRF-Solar cloud forecast using the National Solar Radiation Database (NSRDB). We propose an evaluation framework applied to a single model prediction as well as ensemble-based forecasts. Various cloud detection metrics are calculated when comparing with the satellite-derived dataset. The mismatched clouds from the WRF-Solar model are quantified using nine cloud types classified by cloud top height and cloud optical depth. The results based on the WRF-Solar forecasts covering the entire U.S. for the full year of 2018 shows mismatched cloud frequency in the range of 8% - 46% for thick and high-level (deep convective) to thin and low-level (cumulus) clouds.

cloud mask forecast↗
NASA NTRS1986

A study of the response of deep tropical clouds to mesoscale processes - Three-dimensional numerical experiments

A three-dimensional numerical cloud model is utilized to study the collective feedback effects of cloud systems on the large-scale environment. The characteristic features of the cloud ensemble model are described. The model is applied to a case of a well-defined ITCZ rainband over the eastern tropical Atlantic ocean. The location, number, and configuration of the clouds that formed in the model during the simulations are examined. The cloud heating and moistening, environmental wind shear, and vertical transports of momentum are analyzed. The collective feedbacks of cloud systems on the large-scale temperature, moisture, and horizontal momentum fields are computed after each simulation. The effect of the pressure gradient force on the v-momentum flux is investigated. It is observed that there is good correlation between the model simulations and the observed data.

Tao, Wei-Kuo↗
NASA NTRS2021

Groundwater Recharge Estimated by Land Surface Models: An Evaluation in the Conterminous U.S.

Estimating diffuse recharge of precipitation is fundamental to assessing groundwater sustainability. Diffuse recharge is also the process through which climate and climate change directly affect groundwater. In this study, we evaluated diffuse recharge over the conterminous U.S. simulated by a suite of land surface models (LSMs) that were forced using a common set of meteorological input data. Simulated annual recharge exhibited spatial patterns that were similar among the LSMs, with the highest values in the eastern U.S. and Pacific Northwest. However, the magnitudes of annual recharge varied significantly among the models and were associated with differences in simulated ET, runoff and snow. Evaluation against two independent datasets did not answer the question of whether the ensemble mean performs the best, due to inconsistency between those datasets. The amplitude and timing of seasonal maximum recharge differed among the models, influenced strongly by model physics governing deep soil moisture drainage rates and, in cold regions, snowmelt. Evaluation using in situ soil moisture observations suggested that true recharge peaks 1-3 months later than simulated recharge, indicating systematic biases in simulating deep soil moisture. However, recharge from lateral flows and through preferential flows cannot be inferred from soil moisture data, and the seasonal cycle of simulated groundwater storage actually compared well with in situ groundwater observations. Long-term trends in recharge were not consistently correlated with either precipitation trends or temperature trends. This study highlights the need to employ dynamic flow models in LSMs, among other improvements, to enable more accurate simulation of recharge.

snowmelt↗
DOE OSTI2025

Heterogeneous energetic material damage simulator (HEDS): A deep learning approach to simulate damage–sensitivity linkages

Damage in the microstructures of energetic materials (EMs), such as propellants and plastic bonded explosives (PBXs), can significantly alter their response to external loads. Both sensitization and desensitization can occur, causing concerns with safety and performance in the field; predictive models that connect damage and the sensitivity of EMs can enable design and provide confidence in their robustness and reliability. However, modeling of damage evolution is challenging for real microstructures of EMs; samples of damaged EMs are difficult to obtain, thereby hindering experiments and direct numerical simulations to determine the sensitivity of EMs at various stages of damage. Here, we develop an approach to generate synthetic, i.e., in silico produced, damaged microstructures for use in simulations to connect damage levels to sensitivity. The development of the present workflow to generate and impose varying levels of damage in microstructures, known as HEDS (Heterogeneous Energetic Material Damage Simulator), begins with a small set of images of damaged PBXs and combines a collection of deep neural network techniques to generate microstructures with varying levels of damage. By making the synthetic microstructures conform closely to those observed in available real, imaged microstructures, we develop an ensemble of damaged microstructures that can be used for in silico shock experiments. HEDS develops these microstructure ensembles as level set fields, which are directly employed in a sharp interface Eulerian hydrocode where shock simulations are performed to quantify the energy release rate from hotspot fields generated in the microstructure. These capabilities can be useful for the analysis and assessment of changes in the sensitivity of EMs and to design formulations that are less susceptible to damage-induced changes in sensitivity and performance.

Fang, Irene (ORCID:0009000844557122)↗
DOE OSTI2023

LES ARM Symbiotic Simulation and Observation Scenario for CACTI

The Large-Eddy Simulation (LES) Atmospheric Radiation Measurement (ARM) Symbiotic Simulation and Observation (LASSO) deep-convection scenario for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign. The LASSO-CACTI scenario consists of a library of mesoscale and LES simulations spanning grid spacings from 7.5 km to 100 m for convection near the Sierras de Córdoba mountain range, roughly centered on the ARM Mobile Facility. Supporting skill scores and observation comparisons complement the simulations in addition to subsets of the model output for various categories of model output variables. More information can be found at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Input files and WRF run directory for a LASSO-CACTI simulation

Tar file containing files necessary for reproducing a given Weather Research and Forecasting (WRF) simulation from the Large-Eddy Simulation (LES) Atmospheric Radiation Measurement (ARM) Symbiotic Simulation and Observation (LASSO) deep-convection scenario for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign. The LASSO-CACTI simulations span grid spacings from 7.5 km to 100 m for convection near the Sierras de Córdoba mountain range, roughly centered on the ARM Mobile Facility. More information can be found at https://www.arm.gov/capabilities/modeling/lasso. Types of files in this tar include the initial and boundary conditions, WRF namelist, and other files present in a WRF run directory.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Raw WRF model output files from a LASSO-CACTI simulation

The raw model output from a Weather Research and Forecasting (WRF) simulation from the Large-Eddy Simulation (LES) Atmospheric Radiation Measurement (ARM) Symbiotic Simulation and Observation (LASSO) deep-convection scenario for the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign. The LASSO-CACTI simulations span grid spacings from 7.5 km to 100 m through the use of four nested domains, labeled d1 through d4. The simulations are of convection near the Sierras de Córdoba mountain range, roughly centered on the ARM Mobile Facility. More information can be found at https://www.arm.gov/capabilities/modeling/lasso. The raw model output is in netCDF format as output by the WRF model, i.e., the “wrfout” files, with the files renamed for archival purposes.

54 ENVIRONMENTAL SCIENCES↗