Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Applying deep learning methods to develop new models of molecular charge transfer, nonadiabatic dynamics, and nonlinear spectroscopy in the condensed phase

Photon- and field-induced charge transfer has central importance in the generation and storage of electricity, the novel properties of materials, photo-induced catalysis, and electro-optic activity (e.g., photovoltaic cells, fuel cells, and organic chromophores for use in optical fibers and light-emission diodes). These non-equilibrium electronic and chemical transformations are probed by ultrafast, nonlinear spectroscopies. Accurate simulations play a crucial role in our ability to understand, optimize, and control these transformations. This project applies modern deep learning and machine learning (ML) methods to dramatically improve models of electronic dynamics, electronic-nuclear dynamics, and spectroscopic measurements for improved simulations of chemistry in complex environments, far from equilibrium phenomena, and processes in extreme environments, such as materials exposed to strong or resonant fields. This project develops accurate neural net models that go beyond predictive capability to also provide new insight into the fundamental physics underlying electron and nuclear dynamics. To achieve its objectives, this project explores and develops customized versions of high-capacity deep learning algorithms/models. These techniques are developed with an emphasis on fundamental chemical insight, not just predictive accuracy, to assist the development of the next generation of quantum simulation methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Enhanced Data Efficiency Using Deep Neural Networks and Gaussian Processes for Aerodynamic Design Optimization

Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that can then be used in a gradient-based optimizer. This makes them very well suited for high-fidelity simulation based aerodynamic shape optimization of highly parametrized geometries such as aircraft wings. However, the development of adjoint-based solvers involve careful mathematical treatment and their implementation require detailed software development. Furthermore, they can become prohibitively expensive when multiple optimization problems are being solved, each requiring multiple restarts to circumvent local optima. In this work, we propose a machine learning enabled, surrogate-based framework that replaces the expensive adjoint solver, without compromising on predicting predictive accuracy. Specifically, we first train a deep neural network (DNN) from training data generated from evaluating the high-fidelity simulation model on a model-agnostic design of experiments on the geometry shape parameters. The optimum shape may then be computed by using a gradient-based optimizer coupled with the trained DNN. Subsequently, we also perform a gradient-free Bayesian optimization, where the trained DNN is used as the prior mean. We observe that the latter framework (DNN-BO) improves upon the DNN-only based optimization strategy for the same computational cost. Overall, this framework predicts the true optimum with very high accuracy, while requiring far fewer high-fidelity function calls compared to the adjoint-based method. Furthermore, we show that multiple optimization problems can be solved with the same machine learning model with high accuracy, to amortize the offline costs associated with constructing our models. Our methodology finds applications in the early stages of aerospace design. (C) 2021 Published by Elsevier Masson SAS.

Renganathan, S. Ashwin↗
DOE OSTI2023

Recurrent Convolutional Deep Neural Networks for Modeling Time-Resolved Wildfire Spread Behavior

The increasing incidence and severity of wildfires underscores the necessity of accurately predicting their behavior. While high-fidelity models derived from first principles offer physical accuracy, they are too computationally expensive for use in real-time fire response. Low-fidelity models sacrifice some physical accuracy and generalizability via the integration of empirical measurements, but enable real-time simulations for operational use in fire response. Machine learning techniques have demonstrated the ability to bridge these objectives by learning first-principles physics while achieving computational speedups. While deep learning approaches have demonstrated the ability to predict wildfire propagation over large time periods, time-resolved fire-spread predictions are needed for active fire management. Here, in this work, we evaluate the ability of deep learning approaches in accurately modeling the time-resolved dynamics of wildfires. We use an autoregressive process in which a convolutional recurrent deep learning model makes predictions that propagate a wildfire over 15 min increments. We apply the model to four simulated datasets of increasing complexity, containing both field fires with homogeneous fuel distribution as well as real-world topologies sampled from the California region of the United States. We show that even after 100 autoregressive predictions representing more than 24 h of simulated fire spread, the resulting models generate stable and realistic propagation dynamics, achieving a Jaccard score between 0.89 and 0.94 when predicting the resulting fire scar. The inference time of the deep learning models are examined and compared, and directions for future work are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Application of a Deep Learning Network to 3D Modeling of Nuclear Facilities - 19614

The ultimate goal of this study is to minimize (or eliminate) human intervention in the scanning and 3D CAD modeling process in the generation of 3D as-built model of nuclear facilities. This paper describes the application of the state-of-the-art deep learning technology in 3D point cloud data segmentation which is a part of the 3D modeling process. The baseline deep learning network chosen in this study is PointNet. We compare the deep learning approach with a conventional filtering approach, and show the feasibility and potential of deep learning technology. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Postclosure assessment modelling of a deep geologic repository for low and intermediate level radioactive waste in Ontario, Canada - 15145

In 2011, Ontario Power Generation (OPG) submitted an Environmental Impact Statement and a Preliminary Safety Report (PSR) to the federal authorities in Canada to support an application for a site preparation and construction licence for a Deep Geologic Repository (DGR) for low and intermediate level radioactive waste (L and ILW). The DGR, which is proposed to be located close to the existing Western Waste Management Facility (WWMF) at the Bruce nuclear site, would receive L and ILW arising from the operation and refurbishment of OPG's nuclear reactors; the wastes are currently stored safely at the WWMF. The PSR is supported by postclosure safety assessment modelling, including a total-systems level model implemented in the AMBER compartment modelling software that draws directly on detailed groundwater and coupled groundwater and gas modelling using the FRA3DVS-OPG and TOUGH2 codes. A full suite of calculation cases is managed within a single AMBER model, which aided efficient management of the calculation files and quality assurance. Assessment of expected/normal evolution cases results in maximum calculated effective doses to humans that are more than five orders of magnitude below associated criteria. Assessment of conservative disruptive and 'what if' scenarios results in maximum calculated doses that are higher than those for the normal evolution cases, but which, when the low likelihood of occurrence is taken into account, remain significantly below the associated risk criterion. The assessment demonstrates that deep geologic repositories can provide a safe disposal option and provides an example of evaluating the safety of projects on long time scales. It shows how results from detailed groundwater and gas codes can be incorporated into assessment-level codes such as AMBER, thereby providing a single systems model that can be used to efficiently evaluate a wide range of scenarios and associated calculation cases. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Learning macroscopic internal variables and history dependence from microscopic models

This paper concerns the study of history dependent phenomena in heterogeneous materials in a two-scale setting where the material is specified at a fine microscopic scale of heterogeneities that is much smaller than the coarse macroscopic scale of application. Here, we specifically study a polycrystalline medium where each grain is governed by crystal plasticity while the solid is subjected to macroscopic dynamic loads. The theory of homogenization allows us to solve the macroscale problem directly with a constitutive relation that is defined implicitly by the solution of the microscale problem. However, the homogenization leads to a highly complex history dependence at the macroscale, one that can be quite different from that at the microscale. In this paper, we examine the use of machine-learning, and especially deep neural networks, to harness data generated by repeatedly solving the finer scale model to: (i) gain insights into the history dependence and the macroscopic internal variables that govern the overall response; and (ii) to create a computationally efficient surrogate of its solution operator, that can directly be used at the coarser scale with no further modeling. We do so by introducing a recurrent neural operator (RNO), and show that: (i) the architecture and the learned internal variables can provide insight into the physics of the macroscopic problem; and (ii) that the RNO can provide multiscale, specifically FE 2 , accuracy at a cost comparable to a conventional empirical constitutive relation.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Residential heating, ventilation, and air conditioning (HVAC) has been considered as an important demand response resource. However, the optimization of residential HVAC control is no trivial task due to the complexity of the thermal dynamic models of buildings and uncertainty associated with both occupant-driven heat loads and weather forecasts. In this paper, we apply a novel model-free deep reinforcement learning (RL) method, known as the deep deterministic policy gradient (DDPG), to generate an optimal control strategy for a multi-zone residential HVAC system with the goal of minimizing energy consumption cost while maintaining the users’ comfort. Here, the applied deep RL-based method learns through continuous interaction with a simulated building environment and without referring to any prior model knowledge. Simulation results show that compared with the state-of-art deep Q network (DQN), the DDPG-based HVAC control strategy can reduce the energy consumption cost by 15% and reduce the comfort violation by 79%; and when compared with a rule-based HVAC control strategy, the comfort violation can be reduced by 98%. In addition, experiments with different building models and retail price models demonstrate that the well-trained DDPG-based HVAC control strategy has high generalization and adaptability to unseen environments, which indicates its practicability for real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2019

Deep Learning and Uncertainty Quantification for Climate Resilience

Modeling and monitoring of earth’s processes through physical models and satellite observations at high resolutions is crucial for ensuring society’s ability to adapt to climate change. Deep learning (DL) has been shown to be a valuable tool for generating high resolution data, emulating physical models, and detecting weather patterns which can then be used to inform stakeholders and decision makers. However, both the data and model parameters contain substantial uncertainties that may alter users’ decisions. In this work we present two DL applications on high-resolution climate and satellite datasets using Bayesian neural networks to generate well calibrated uncertainty estimates.

Vandal, Thomas↗
DOE OSTI2023

Texas A&M University Mobile Facility Measurements during TRACER (Field Campaign Report)

One of the main goals of the U.S Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Tracking Aerosol Convection Interactions Experiment (TRACER) near Houston, Texas is to improve understanding of how meteorology and aerosols impact storm dynamical and microphysical processes in deep convection to better constrain and improve their model representation. The Houston area is strongly influenced by sea- and bay-breeze circulations that generate convergence and help to initiate and organize deep convection. To properly isolate and understand the roles of varied meteorological conditions and cloud condensation nuclei (CCN) and ice nucleation particles (INP) distributions in different air masses, co-located thermodynamic, kinematic, and aerosol vertical profile observations are needed. The focus of this campaign was to provide key measurements in air masses both in front of and behind sea/bay breeze fronts moving through the greater Houston area to sample the airmass heterogeneity. The overarching scientific goal of this campaign is to understand how the vertical distributions of both CCN and INP correspond to the inflow layer of deep convection in maritime, background continental, and polluted continental air masses, and how these variations influence deep convection. To fully sample the heterogeneity in both meteorological conditions and aerosols across the sea-breeze front (SBF), Texas A&M University (TAMU) deployed a InterMet 3050A 403 MHz mobile unit launching iMet-4 radiosondes and the new Rapid Onsite Atmospheric Measurement Van (ROAM-V) for aerosol sampling during the TRACER intensive operational period (IOP) from June to September 2022. The suite of instruments deployed on ROAM-V included a condensation particle counter (CPC; GRIMM Model 5.403 CPC), scanning mobility particle sizer (SMPS; TSI 3750 detector, TSI 3082 classifier, TSI 3088 neutralizer, TSI 3081A differential mobility analyzer), cloud condensation nuclei counter (Droplet Measurement Technologies CCN counter), micropulse lidar (Droplet Measurement Technologies micropulse lidar [miniMPL]), and a Davis Rotating Uniform size-cut Monitor (DRUM; DRUMAir 4-DRUM). Before sampling at each location, the latitude and longitude were recorded using the Global Positioning System (GPS) on the phone application “My Altitude”. The DRUM data were collected as part of a closely related ARM field campaign and also supported by DOE Atmospheric System Research grant DE-SC0021047. The TAMU team sampled these airmass heterogeneities by strategically choosing deployment sites in a different airmass than the ARM fixed sites in La Porte and Guy, Texas. On days when the sea/bay breeze boundary was pushing inland, the TAMU team would usually sample the airmass on the maritime side of the SBF at a coastal site in Galveston, Texas in the early afternoon (1730-1900 UTC) and then move inland ahead of the SBF to sample the airmass on the continental side during late afternoon (2030-2230). Figure 1 shows the Galveston maritime site and the array of sites for the late afternoon continental measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Cyber-Attack Detection and Accommodation for the Energy Delivery System

The goals of this project were to create a software system with a suite of key algorithms for cyber-attack detection and accommodation providing domain layer protection for critical power generation assets. Example assets included gas and steam turbines, heat recovery steam generators, and electrical generators. The aggressive algorithm goals were aimed at reducing the false positive rates in threat detection to <1% using learnings from many evolving disciplines (power turbine and generator physics, power system modeling, modern control theory, system identification, machine learning, deep learning, mathematics and data science). Additional goals for the algorithms involved localizing threats on-the-fly to know in which monitoring node the effects of attacks are present, and then providing accommodation to keep the system running uninterrupted much of the time in the presence of the attack. Accommodation had a performance goal of providing resiliency when up to 50% of monitoring nodes are in an attack state.

cybersecurity, cyber-physical↗
NASA NTRS2020

Multi-Agent Motion Planning using Deep Learning for Space Applications

State-of-the-art motion planners cannot scale to a large number of systems. Motion planning for multiple agents is an NP (non-deterministic polynomial-time) hard problem, so the computation time increases exponentially with each addition of agents. This computational demand is a major stumbling block to the motion planner's application to future NASA missions involving the swarm of space vehicles. We applied a deep neural network to transform computationally demanding mathematical motion planning problems into deep learning-based numerical problems. We showed optimal motion trajectories can be accurately replicated using deep learning-based numerical models in several 2D and 3D systems with multiple agents. The deep learning-based numerical model demonstrates superior computational efficiency with plans generated 1000 times faster than the mathematical model counterpart.

Madani, Ramtin↗
DOE OSTI2017

On the energy spectrum of cosmogenic neutrons

The processes of the generation of cosmogenic neutrons (cg-neutrons) underground are considered. The neutrons produced by cosmic-ray muons in their interactions with matter are called cosmogenic. Deep-inelastic πA-collisions of pions in muon-induced hadronic showers are mainly their source at energies above 30 MeV. The characteristics of the energy spectrum for the generation of cg-neutrons have been determined by invoking the additive quark model of deep-inelastic soft processes and the mechanism for the interactions of high-energy nucleons in a nucleus. The three-component shape of the spectrum is explained, and the energy of the “knee” in the spectrum has been found to depend on the mass number A. The peculiarities of deep-inelastic πA-scattering lead to the conclusion that the spectrum of cg-neutrons steepens sharply at energies above 1 GeV. The calculated quantitative characteristics of the spectrum are compared with those obtained in measurements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2011

Formal methods for test case generation

The invention relates to the use of model checkers to generate efficient test sets for hardware and software systems. The method provides for extending existing tests to reach new coverage targets; searching *to* some or all of the uncovered targets in parallel; searching in parallel *from* some or all of the states reached in previous tests; and slicing the model relative to the current set of coverage targets. The invention provides efficient test case generation and test set formation. Deep regions of the state space can be reached within allotted time and memory. The approach has been applied to use of the model checkers of SRI's SAL system and to model-based designs developed in Stateflow. Stateflow models achieving complete state and transition coverage in a single test case are reported.

Rushby, John↗
DOE OSTI2026

ProtoDUNE-VD for Beyond the Standard Model Searches: Initial Studies and Future Prospects

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long-baseline neutrino program designed to address fundamental questions in neutrino and astroparticle physics. ProtoDUNE, operating at the CERN Neutrino Platform, serves as a full-scale prototype for the DUNE Far Detector. In particular, the ProtoDUNE Vertical Drift (ProtoDUNE-VD) detector provides a powerful testbed for validating reconstruction and event selection techniques for future DUNE operations. In addition to detector R&D, ProtoDUNE enables a novel parasitic beam-dump search for beyond-the-Standard-Model (BSM) particles. However, it faces several challenges. Most notably, the ProtoDUNE-VD modules operate on the surface and are consequently exposed to an intense flux of cosmic rays, which requires a dedicated trigger. In addition, standard neutrinos are also produced in the T2 target area from the decay of unstable mesons, constituting a relevant background, which needs to be well understood and characterized a priori. We present the first studies based on 2025 data taken with a trigger designed to identify neutrino candidates at ProtoDUNE-VD. ProtoDUNE-VD’s high-resolution LArTPC imaging allows detailed reconstruction of decay and scattering signatures. This work demonstrates the complementarity of traditional tools such as Pandora and modern machine-learning approaches, providing key input for atmospheric neutrino and rare-event searches in the DUNE Vertical Drift program.

Bagdu, Halit [U. Iowa, Iowa City]↗
DOE OSTI2019

Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems

Here, we present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a statistical inference framework that enables the end-to-end training of surrogate models on paired input–output observations that may be stochastic in nature, originate from different information sources of variable fidelity, or be corrupted by complex noise processes. The resulting surrogates can accommodate high-dimensional inputs and outputs and are able to return predictions with quantified uncertainty. Furthermore, the effectiveness our approach is demonstrated through a series of canonical studies, including the regression of noisy data, multi-fidelity modeling of stochastic processes, and uncertainty propagation in high-dimensional dynamical systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

This paper aims at developing a data-driven optimal control strategy for virtual synchronous generator (VSG) in the scenario where no expert knowledge or requirement for system model is available. Firstly, the optimal and adaptive control problem for VSG is transformed into a reinforcement learning task. Specifically, the control variables, i.e., virtual inertia and damping factor, are defined as the actions. Meanwhile, the active power output, angular frequency and its derivative are considered as the observations. Moreover, the reward mechanism is designed based on three preset characteristic functions to quantify the control targets: (1) maintaining the deviation of angular frequency within special limits; (2) preserving well-damped oscillations for both the angular frequency and active power output; (3) obtaining slow frequency drop in the transient process. Next, to maximize the cumulative rewards, a decentralized deep policy gradient algorithm, which features model-free and faster convergence, is developed and employed to find the optimal control policy. With this effort, a data-driven adaptive VSG controller can be obtained. By using the proposed controller, the inverter-based distributed generator can adaptively adjust its control variables based on current observations to fulfill the expected targets in model-free fashion. Finally, simulation results validate the feasibility and effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

UNNT: A novel Utility for comparing Neural Net and Tree-based models

The use of deep learning (DL) is steadily gaining traction in scientific challenges such as cancer research. Advances in enhanced data generation, machine learning algorithms, and compute infrastructure have led to an acceleration in the use of deep learning in various domains of cancer research such as drug response problems. In our study, we explored tree-based models to improve the accuracy of a single drug response model and demonstrate that tree-based models such as XGBoost (eXtreme Gradient Boosting) have advantages over deep learning models, such as a convolutional neural network (CNN), for single drug response problems. However, comparing models is not a trivial task. To make training and comparing CNNs and XGBoost more accessible to users, we developed an open-source library called UNNT (A novel Utility for comparing Neural Net and Tree-based models). The case studies, in this manuscript, focus on cancer drug response datasets however the application can be used on datasets from other domains, such as chemistry.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

Verification of the helioseismology travel-time measurement technique and the inversion procedure for sound speed using artificial data

We performed three-dimensional numerical simulations of the solar surface acoustic wave field for the quiet Sun and for three models with different localized sound-speed perturbations in the interior with deep, shallow, and two-layer structures. We used the simulated data generated by two solar acoustics codes that employ the same standard solar model as a background model, but utilize different integration techniques and different models of stochastic wave excitation. Acoustic travel times were measured using a time-distance helioseismology technique, and compared with predictions from ray theory frequently used for helioseismic travel-time inversions. It is found that the measured travel-time shifts agree well with the helioseismic theory for sound-speed perturbations, and for the measurement procedure with and without phase-speed filtering of the oscillation signals. This testing verifies the whole measuring-filtering-inversion procedure for static sound-speed anomalies with small amplitude inside the Sun outside regions of strong magnetic field. It is shown that the phase-speed filtering, frequently used to extract specific wave packets and improve the signal-to-noise ratio, does not introduce significant systematic errors. Results of the sound-speed inversion procedure show good agreement with the perturbation models in all cases. Due to its smoothing nature, the inversion procedure may overestimate sound-speed variations in regions with sharp gradients of the sound-speed profile.

79 ASTRONOMY AND ASTROPHYSICS↗