Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Electrolytes play a critical role in designing next-generation battery systems, by allowing efficient ion transfer, preventing charge transfer, and stabilizing electrode-electrolyte interfaces. In this work, we develop a differentiable geometric deep learning (GDL) model for chemical mixtures, DiffMix, which is applied in guiding robotic experimentation and optimization towards fast charging battery electrolytes. In particular, we extend mixture thermodynamic and transport laws by creating GDL-learnable physical coefficients. We evaluate our model with mixture thermodynamics and ion transport properties, where we show improved prediction accuracy and model robustness of Diff-Mix than its purely data-driven variants. Furthermore, with a robotic experimentation setup, Clio, we improve ionic conductivity of electrolytes by over 18.8% within 10 experimental steps, via differentiable optimization built on DiffMix gradients. By combining GDL, mixture physics laws, and robotic experimentation, DiffMix expands the predictive modeling methods for chemical mixtures and enables efficient optimization in large chemical spaces.

25 - ENERGY STORAGE↗
DOE OSTI2023

Hybrid Attack Graph Generation with Graph Convolutional Deep-Q Learning

Critical infrastructures such as power grids have become increasingly complex, connected, and vulnerable to adverse scenarios, including cyber and physical attacks and faults. Effective risk mitigation for such cyber-physical energy systems (CPES), requires preemptive knowledge of likely adversarial attack scenarios. Hybrid Attack Graph (HAG) is a structured way to represent an adversarial scenario as an attack sequence using a threat model. However, the scarcity of documented attack sequences hinders analysts and CPES planners’ ability to identify credible attack scenarios for a given CPES. We propose a data-driven Graph Convolutional Deep-Q Network (GCDQ) to address this data challenge through generating HAGs. By leveraging limited real-world observations from the MITRE ATT&CK knowledge base, our GCDQ model synthesizes realistic graphs with the targeted attribute of minimum detectability via reinforcement learning. This generative model is the first step in creating a tool to substantially boost the attack sequence dataset and enhance the performance of CPS defense-related tasks by providing insights into likely attack sequences with given attributes.

deep learning, artificial intelligence↗
DOE OSTI2021

Predictive Data-driven Platform for Subsurface Energy Production

Subsurface energy activities such as unconventional resource recovery, enhanced geothermal energy systems, and geologic carbon storage require fast and reliable methods to account for complex, multiphysical processes in heterogeneous fractured and porous media. Although reservoir simulation is considered the industry standard for simulating these subsurface systems with injection and/or extraction operations, reservoir simulation requires spatio-temporal “Big Data” into the simulation model, which is typically a major challenge during model development and computational phase. In this work, we developed and applied various deep neural network-based approaches to (1) process multiscale image segmentation, (2) generate ensemble members of drainage networks, flow channels, and porous media using deep convolutional generative adversarial network, (3) construct multiple hybrid neural networks such as convolutional LSTM and convolutional neural network-LSTM to develop fast and accurate reduced order models for shale gas extraction, and (4) physics-informed neural network and deep Q-learning for flow and energy production. We hypothesized that physicsbased machine learning/deep learning can overcome the shortcomings of traditional machine learning methods where data-driven models have faltered beyond the data and physical conditions used for training and validation. We improved and developed novel approaches to demonstrate that physics-based ML can allow us to incorporate physical constraints (e.g., scientific domain knowledge) into ML framework. Outcomes of this project will be readily applicable for many energy and national security problems that are particularly defined by multiscale features and network systems.

58 GEOSCIENCES↗
DOE OSTI2023

Deep learning methods for drug response prediction in cancer: Predominant and emerging trends

Cancer claims millions of lives yearly worldwide. While many therapies have been made available in recent years, by in large cancer remains unsolved. Exploiting computational predictive models to study and treat cancer holds great promise in improving drug development and personalized design of treatment plans, ultimately suppressing tumors, alleviating suffering, and prolonging lives of patients. A wave of recent papers demonstrates promising results in predicting cancer response to drug treatments while utilizing deep learning methods. These papers investigate diverse data representations, neural network architectures, learning methodologies, and evaluations schemes. However, deciphering promising predominant and emerging trends is difficult due to the variety of explored methods and lack of standardized framework for comparing drug response prediction models. To obtain a comprehensive landscape of deep learning methods, we conducted an extensive search and analysis of deep learning models that predict the response to single drug treatments. A total of 61 deep learning-based models have been curated, and summary plots were generated. Based on the analysis, observable patterns and prevalence of methods have been revealed. This review allows to better understand the current state of the field and identify major challenges and promising solution paths.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1999

Diurnal Forcing of Planetary Atmospheres

This project investigated and developed models which will assist in developing an understanding of the diurnal forcings in the atmospheres of Mars, Venus, Earth and Jupiter. The differences in the temperatures during the day, and night, generate very deep diurnal boundary layers and strong slope-related winds. A general circulation model (GCM) was adapted for computation of Martian atmospheric dynamics, to simulate the global transport of these atmospheric tracers. The model was applied to the study of the Martian seasonal water cycle. The principles have been applied to venus. The region of study is the upper cloud level, and above rather than the area close to the surface. The model was also applied in efforts to study the evolution of volcanic clouds in the Earth's stratosphere. In particular this was used to model the dispersion of sulfuric acid particles in the atmosphere. A brief study of the application of the tidal theory to the planet Jupiter has been undertaken. The goal of the study is to deduce the source of the tidal dissipation which is thought to have led to the orbital resonances amongst the Galilean satellites and considerable heating of the interiors of Io, Europa, and Ganymede.

Houben, Howard C.↗
NASA NTRS2022

A Dynamo Simulation Generating Saturn-Like Small Magnetic Dipole Tilts

Abstract Among planetary dynamos, the magnetic field of Saturn stands out in its exceptional level of axisymmetry. One of its peculiar features is that the magnetic dipole mode is tilted with respect to the planetary rotation axis by only ≈0.007° or less. Numerical dynamo simulations performed in this context have had great difficulty in producing such small dipole tilt angles without introducing ad hoc ingredients such as a latitudinally varying heat flux pattern in the outer layers or stably stratified layers (SSLs). Here we present a numerical dynamo simulation that generates a highly axisymmetric dynamo with a dipole tilt of about ≈0.0008° on average. The model consists of a deep dynamo layer and an overlying low-conductivity layer but without any SSLs. We highlight a novel mechanism where strong differential rotation generated in the atmospheric layer penetrates into the dynamo region, helping to maintain a very small magnetic dipole tilt. Plain Language Summary Saturn's dipole-dominant magnetic field exhibits a very peculiar feature: the dipole component of the planetary magnetic field is tilted by less than ≈0.007° with respect to the planetary spin axis. Numerical simulations performed in this context suggest that if a spatial heat-flux variation is imposed, along with a stably stratified region, on top of an active dynamo layer, then small dipole tilt values can be realized. Here we present a model where extremely small dipole tilt values can be achieved without these ad hoc ingredients. Our simulations demonstrate that dynamo theory allows extremely small dipole tilt values in a relatively simple model configuration.

Rakesh Kumar Yadav↗
DOE OSTI2014

Extracting TMDs from CLAS12 data

We present studies of double longitudinal spin asymmetries in semi-inclusive deep inelastic scattering using a new dedicated Monte Carlo generator, which includes quark intrinsic transverse momentum within the generalized parton model based on the fully differential cross section for the process. Additionally we employ Bessel-weighting to the MC events to extract transverse momentum dependent parton distribution functions and also discuss possible uncertainties due to kinematic correlation effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Unified Wind-Wave Growth and Spectrum Functions for All Water Depths: Field Observations and Model Results

Abstract Wind-wave development is governed by the fetch- or duration-limited growth principle that is expressed as a pair of similarity functions relating the dimensionless elevation variance (wave energy) and spectral peak frequency to fetch or duration. Combining the pair of similarity functions, the fetch or duration variable can be removed to form a dimensionless function of elevation variance and spectral peak frequency, which is interpreted as the wave energy evolution with wave age. The relationship is initially developed for quasi-neural stability and quasi-steady wind forcing conditions. Further analyses show that the same fetch, duration, and wave-age similarity functions are applicable to unsteady wind forcing conditions, including rapidly accelerating and decelerating mountain gap wind episodes and tropical cyclone (TC) wind fields. Here it is shown that with the dimensionless frequency converted to dimensionless wavenumber using the surface wave dispersion relationship, the same similarity function is applicable in all water depths. Field data collected in shallow to deep waters and mild to TC wind conditions and synthetic data generated by spectrum model computations are assembled to illustrate the applicability. For the simulation work, the finite-depth wind-wave spectrum model and its shoaling function are formulated for variable spectral slopes. Given wind speed, wave age, and water depth, the measured and spectrum-computed significant wave heights and the associated growth parameters are in good agreement in forcing conditions from mild to TC winds and in all depths from deep ocean to shallow lake. Significance Statement This paper presents a growth function and spectrum model to describe wind-wave development in all water depths. Their applicability covers a wide range of wind forcing conditions including steady, accelerating, decelerating, and tropical cyclone events. Support for the unified spectrum model and growth function is presented with field observations and numerical computations.

Hwang, Paul A.↗
NASA NTRS2005

Simulator of Space Communication Networks

Multimission Advanced Communications Hybrid Environment for Test and Evaluation (MACHETE) is a suite of software tools that simulates the behaviors of communication networks to be used in space exploration, and predict the performance of established and emerging space communication protocols and services. MACHETE consists of four general software systems: (1) a system for kinematic modeling of planetary and spacecraft motions; (2) a system for characterizing the engineering impact on the bandwidth and reliability of deep-space and in-situ communication links; (3) a system for generating traffic loads and modeling of protocol behaviors and state machines; and (4) a system of user-interface for performance metric visualizations. The kinematic-modeling system makes it possible to characterize space link connectivity effects, including occultations and signal losses arising from dynamic slant-range changes and antenna radiation patterns. The link-engineering system also accounts for antenna radiation patterns and other phenomena, including modulations, data rates, coding, noise, and multipath fading. The protocol system utilizes information from the kinematic-modeling and link-engineering systems to simulate operational scenarios of space missions and evaluate overall network performance. In addition, a Communications Effect Server (CES) interface for MACHETE has been developed to facilitate hybrid simulation of space communication networks with actual flight/ground software/hardware embedded in the overall system.

Clare, Loren↗
DOE OSTI2025

Deep potential molecular dynamics simulations of low-temperature plasma-surface interactions

Machine learning approaches to potential generation for molecular dynamics (MD) simulations of low-temperature plasma-surface interactions could greatly extend the range of chemical systems that can be modeled. Empirical potentials are difficult to generalize to complex combinations of multiple elements with interactions that might include covalent, ionic, and metallic bonds. This work demonstrates that a specific machine learning approach, Deep Potential Molecular Dynamics (DeepMD), can generate potentials that provide a good model of plasma etching in the Si-Cl-Ar system. Comparisons are made between MD results using DeepMD models and empirical potentials, as well as experimental measurements. Pure Si properties predicted by the DeepMD model are in reasonable agreement with experimental results. Simulations of Si bombardment by Ar + ions demonstrate the ability of the DeepMD method to predict sputtering yields as well as the depth of the amorphous-crystalline interface. Etch yields as a function of flux ratio and ion energy for simultaneous Cl 2 and Ar + impacts are in good agreement with previous simulation results and experiment. Predictions of etch yields and etch products during plasma-assisted atomic layer etching of Si-Cl 2 -Ar are shown to be in good agreement with MD predictions using empirical potentials and with experiment. Finally, good agreement was also seen with measurements for the spontaneous etching of Si by Cl atoms at 300 K. Further, the demonstration that DeepMD can reproduce results from MD simulations using empirical potentials is a necessary condition to future efforts to extend the method to a much wider range of systems for which empirical potentials may be difficult or impossible to obtain.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018

This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

MARS: Malleable Actor-Critic Reinforcement Learning Scheduler

In this paper, we introduce MARS, a new scheduling system for HPC-cloud infrastructures based on a cost-aware, flexible reinforcement learning approach, which serves as an intermediate layer for next generation HPC-cloud resource manager. MARS ensembles the pre-trained models from heuristic workloads and decides on the most cost-effective strategy for optimization. A whole workflow application would be split into several optimizable dependent sub-tasks, then based on the pre- defined resource management plan, a reward will be generated after executing a scheduled task. Lastly, MARS updates the Deep Neural Network (DNN) model based on the reward. MARS is designed to optimize the existing models through reinforcement mechanisms. MARS adapts to the dynamics of workflow applications, selects the most cost-effective scheduling solution among pre-built scheduling strategies (backfilling, SJF, etc.) and self- learning deep neural network model at run-time. We evaluate MARS with different real-world workflow traces. MARS can achieve 5%-60% increased performance compare to state-of-the- art approaches.

Baheri, Betis↗
DOE OSTI2013

Predictive modeling of CO2 sequestration in deep saline sandstone reservoirs: Impacts of geochemical kinetics

One idea for mitigating the increase in fossil-fuel generated CO{sub 2} in the atmosphere is to inject CO{sub 2} into subsurface saline sandstone reservoirs. To decide whether to try such sequestration at a globally significant scale will require the ability to predict the fate of injected CO{sub 2}. Thus, models are needed to predict the rates and extents of subsurface rock-water-gas interactions. Several reactive transport models for CO{sub 2} sequestration created in the last decade predicted sequestration in sandstone reservoirs of ~17 to ~90 kg CO{sub 2} m{sup -3|. To build confidence in such models, a baseline problem including rock + water chemistry is proposed as the basis for future modeling so that both the models and the parameterizations can be compared systematically. In addition, a reactive diffusion model is used to investigate the fate of injected supercritical CO{sub 2} fluid in the proposed baseline reservoir + brine system. In the baseline problem, injected CO{sub 2} is redistributed from the supercritical (SC) free phase by dissolution into pore brine and by formation of carbonates in the sandstone. The numerical transport model incorporates a full kinetic description of mineral-water reactions under the assumption that transport is by diffusion only. Sensitivity tests were also run to understand which mineral kinetics reactions are important for CO{sub 2} trapping. The diffusion transport model shows that for the first ~20 years after CO{sub 2} diffusion initiates, CO{sub 2} is mostly consumed by dissolution into the brine to form CO{sub 2,aq} (solubility trapping). From 20-200 years, both solubility and mineral trapping are important as calcite precipitation is driven by dissolution of oligoclase. From 200 to 1000 years, mineral trapping is the most important sequestration mechanism, as smectite dissolves and calcite precipitates. Beyond 2000 years, most trapping is due to formation of aqueous HCO{sub 3}{sup -}. Ninety-seven percent of the maximum CO{sub 2} sequestration, 34.5 kg CO{sub 2} per m{sup 3} of sandstone, is attained by 4000 years even though the system does not achieve chemical equilibrium until ~25,000 years. This maximum represents about 20% CO{sub 2} dissolved as CO{sub 2},aq, 50% dissolved as HCO{sub 3}{sup -}{sub ,aq}, and 30% precipitated as calcite. The extent of sequestration as HCO{sub 3}{sup -} at equilibrium can be calculated from equilibrium thermodynamics and is roughly equivalent to the amount of Na+ in the initial sandstone in a soluble mineral (here, oligoclase). Similarly, the extent of trapping in calcite is determined by the amount of Ca2+ in the initial oligoclase and smectite. Sensitivity analyses show that the rate of CO{sub 2} sequestration is sensitive to the mineral-water reaction kinetic constants between approximately 10 and 4000 years. The sensitivity of CO{sub 2} sequestration to the rate constants decreases in magnitude respectively from oligoclase to albite to smectite.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Enhanced Data Efficiency Using Deep Neural Networks and Gaussian Processes for Aerodynamic Design Optimization

Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that can then be used in a gradient-based optimizer. This makes them very well suited for high-fidelity simulation based aerodynamic shape optimization of highly parametrized geometries such as aircraft wings. However, the development of adjoint-based solvers involve careful mathematical treatment and their implementation require detailed software development. Furthermore, they can become prohibitively expensive when multiple optimization problems are being solved, each requiring multiple restarts to circumvent local optima. In this work, we propose a machine learning enabled, surrogate-based framework that replaces the expensive adjoint solver, without compromising on predicting predictive accuracy. Specifically, we first train a deep neural network (DNN) from training data generated from evaluating the high-fidelity simulation model on a model-agnostic design of experiments on the geometry shape parameters. The optimum shape may then be computed by using a gradient-based optimizer coupled with the trained DNN. Subsequently, we also perform a gradient-free Bayesian optimization, where the trained DNN is used as the prior mean. We observe that the latter framework (DNN-BO) improves upon the DNN-only based optimization strategy for the same computational cost. Overall, this framework predicts the true optimum with very high accuracy, while requiring far fewer high-fidelity function calls compared to the adjoint-based method. Furthermore, we show that multiple optimization problems can be solved with the same machine learning model with high accuracy, to amortize the offline costs associated with constructing our models. Our methodology finds applications in the early stages of aerospace design. (C) 2021 Published by Elsevier Masson SAS.

Renganathan, S. Ashwin↗
DOE OSTI2023

Recurrent Convolutional Deep Neural Networks for Modeling Time-Resolved Wildfire Spread Behavior

The increasing incidence and severity of wildfires underscores the necessity of accurately predicting their behavior. While high-fidelity models derived from first principles offer physical accuracy, they are too computationally expensive for use in real-time fire response. Low-fidelity models sacrifice some physical accuracy and generalizability via the integration of empirical measurements, but enable real-time simulations for operational use in fire response. Machine learning techniques have demonstrated the ability to bridge these objectives by learning first-principles physics while achieving computational speedups. While deep learning approaches have demonstrated the ability to predict wildfire propagation over large time periods, time-resolved fire-spread predictions are needed for active fire management. Here, in this work, we evaluate the ability of deep learning approaches in accurately modeling the time-resolved dynamics of wildfires. We use an autoregressive process in which a convolutional recurrent deep learning model makes predictions that propagate a wildfire over 15 min increments. We apply the model to four simulated datasets of increasing complexity, containing both field fires with homogeneous fuel distribution as well as real-world topologies sampled from the California region of the United States. We show that even after 100 autoregressive predictions representing more than 24 h of simulated fire spread, the resulting models generate stable and realistic propagation dynamics, achieving a Jaccard score between 0.89 and 0.94 when predicting the resulting fire scar. The inference time of the deep learning models are examined and compared, and directions for future work are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Application of a Deep Learning Network to 3D Modeling of Nuclear Facilities - 19614

The ultimate goal of this study is to minimize (or eliminate) human intervention in the scanning and 3D CAD modeling process in the generation of 3D as-built model of nuclear facilities. This paper describes the application of the state-of-the-art deep learning technology in 3D point cloud data segmentation which is a part of the 3D modeling process. The baseline deep learning network chosen in this study is PointNet. We compare the deep learning approach with a conventional filtering approach, and show the feasibility and potential of deep learning technology. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Postclosure assessment modelling of a deep geologic repository for low and intermediate level radioactive waste in Ontario, Canada - 15145

In 2011, Ontario Power Generation (OPG) submitted an Environmental Impact Statement and a Preliminary Safety Report (PSR) to the federal authorities in Canada to support an application for a site preparation and construction licence for a Deep Geologic Repository (DGR) for low and intermediate level radioactive waste (L and ILW). The DGR, which is proposed to be located close to the existing Western Waste Management Facility (WWMF) at the Bruce nuclear site, would receive L and ILW arising from the operation and refurbishment of OPG's nuclear reactors; the wastes are currently stored safely at the WWMF. The PSR is supported by postclosure safety assessment modelling, including a total-systems level model implemented in the AMBER compartment modelling software that draws directly on detailed groundwater and coupled groundwater and gas modelling using the FRA3DVS-OPG and TOUGH2 codes. A full suite of calculation cases is managed within a single AMBER model, which aided efficient management of the calculation files and quality assurance. Assessment of expected/normal evolution cases results in maximum calculated effective doses to humans that are more than five orders of magnitude below associated criteria. Assessment of conservative disruptive and 'what if' scenarios results in maximum calculated doses that are higher than those for the normal evolution cases, but which, when the low likelihood of occurrence is taken into account, remain significantly below the associated risk criterion. The assessment demonstrates that deep geologic repositories can provide a safe disposal option and provides an example of evaluating the safety of projects on long time scales. It shows how results from detailed groundwater and gas codes can be incorporated into assessment-level codes such as AMBER, thereby providing a single systems model that can be used to efficiently evaluate a wide range of scenarios and associated calculation cases. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗