SEARCH · Search NASA

Results for “Deep Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

AI-Enhanced Computational Tools for Entry Systems Modeling

To advance the understanding of complex atmospheric entry phenomena, NASA’s Entry Systems Modeling (ESM) team [1] has developed high-fidelity computational tools addressing multiscale challenges, from material microstructures to full-scale heatshield response. This abstract highlights a subset of ESM tools, focusing on AI integration to enhance workflows and predictive modeling. - PuMA [2] computes effective material properties from high-resolution micro-CT scans, supporting TPS analysis for NASA missions. - TomoSAM [3] automates 3D tomography dataset segmentation for PuMA using the Segment Anything Model, reducing manual effort and improving accuracy. - PATO [4] models porous reactive materials under extreme conditions, with advancements such as unified solvers, mechanical erosion, and TPS coatings for NASA missions. - arcjetCV [5] employs deep learning to analyze arc jet test footage, measuring recession rates, shape changes, and shock standoff distances, bridging simulations, and experiments to reveal TPS ablation behavior. - ARCHeS [6] simulates arc heater plasma flows, modeling turbulence, radiation, and electromagnetic interactions to optimize arc heater performance, validate TPS under extreme conditions, and serve as a foundation for developing digital twins of arc heater facilities. - SPARTA [7] simulates rarefied hypersonic flows and gas-surface interactions for planetary entry missions, leveraging GPU architectures for scalable and efficient aerothermal and ablation analyses. AI-driven solutions, such as deep learning segmentation, have streamlined workflows in ESM tools and still hold significant potential to further accelerate processes and enhance automation in entry systems modeling. [1] Haskins, J.B. (2023), [2] Ferguson, J.C. (2018), [3] Meurisse, J.B.E. (2018), [4] Semeraro, F. (2023), [5] Quintart, A. (2024) [6] Meurisse, J.B.E. (2022), [7] Plimpton, S.J. (2019)

Predictive Modeling↗

DOE OSTI2025

WaveDenoiser

We developed a robust deep learning model to effectively reduce background noise in the time domain from seismic waveforms. The deep learning model processes a 57-second three-component seismogram to predict and generate a denoised seismogram. The training was conducted using the benchmark STEAD dataset, which comprises globally distributed earthquake signals recorded at local distances ranging from 0 to 350 kilometers.

Chai, Chengping [Oak Ridge National Laboratory (OR↗

DOE OSTI2025

An efficient surrogate model of secondary electron formation and evolution

This work extends the adjoint-deep learning framework for runaway electron (RE) evolution, developed by McDevitt et al. [Phys. Plasmas 32, 042503 (2025)], to account for large-angle collisions. By incorporating large-angle collisions, the framework allows the avalanche of REs to be captured, an essential component of RE dynamics. This extension is accomplished by using a Rosenbluth–Putvinski approximation to estimate the distribution of secondary electrons generated by large-angle collisions. By evolving both the primary and multiple generations of secondary electrons, the present formulation can capture both the detailed temporal evolution of a RE population beginning from an arbitrary initial momentum space distribution, along with providing approximations to the saturated growth and decay rates of the RE population. Predictions of the adjoint-deep learning framework are verified against a traditional RE solver, with good agreement present across a broad range of parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRSDate not supplied

Deep Learning-Based Negotiation Strategy Selection for Cooperative Conflict Resolution in Urban Air Mobility

This paper presents a collaborative conflict resolution technique using deep neural network-based intelligent search of the solution space. This approach offers a rapid convergence to a mutually acceptable solution for real-time conflict resolution, suitable for urban air mobility operations. Furthermore, the presented technique allows operational flexibility to the urban air mobility agents where these agents can collaboratively devise the solution via integrative negotiation, based on their local utility functions, as long as such a solution does not violate the global safety thresholds. The presented machine-to-machine negotiation method is built on our prior work on holistic assessment of the airspace and potential conflict detection implemented at-the-edge, onboard the unmanned aircraft systems. This paper extends the prior work to augment decision-making at-the-edge, thereby, promising a true distributed control architecture for urban air mobility. In this approach, each agent (a) builds a potential in-flight conflict map, (b) identifies the conflicting agents, (c) dynamically prepares a list of alternatives based on its current utility functions, (d) negotiates with the conflicting agents to pick one of these alternatives, and (e) implements the negotiated alternative to mutually resolve the conflict. Note that such an approach does not require a contingency plan to be made pre-flight, as the conflict resolution strategies are decided and negotiated in real time based on the present state of the agent. The contingency plan, if available, can serve as an input to the real-time conflict resolution strategy formulation, and also can be used as a fallback plan in case the negotiation fails and the impacted agents need to switch to a rule-based/supervisory resolution mode from the discussed distributed resolution mode. The presented collaborative negotiation-based conflict resolution technique incorporates a time-dependent reward function to catalyze collaborative resolution by incentivizing the agents with local and global rewards beneficial to their business operations.

Advanced Air Mobility↗

DOE OSTI2025

A generative artificial intelligence framework for long-time plasma turbulence simulations

Generative deep learning techniques are employed in a novel framework for the construction of surrogate models capturing the spatiotemporal dynamics of 2D plasma turbulence. The proposed Generative Artificial Intelligence Turbulence (GAIT) framework enables the acceleration of turbulence simulations for long-time transport studies. GAIT leverages a convolutional variational auto-encoder and a recurrent neural network to generate new turbulence data from existing simulations, extending the time horizon of transport studies with minimal computational cost. The application of the GAIT framework to plasma turbulence using the Hasegawa–Wakatani (HW) model is presented, evaluating its performance via various analyses. Very good agreement is found between the GAIT and the HW models in the spatiotemporal Fourier and Proper Orthogonal Decomposition spectra, the flow topology characterized by the Okubo–Weiss parameter, and the time autocorrelation function of turbulent fluctuations. Excellent agreement has also been obtained in the probability distribution function of particle displacements and the effective turbulent diffusivity. In-depth analyses of the latent space of turbulent states, choice of hyperparameters and alternative deep learning models for the time prediction are presented. Our results highlight the potential of Artificial Intelligence-based surrogate models to overcome the computational challenges in turbulence simulation, which can be extended to other situations such as geophysical fluid dynamics.

Artificial intelligence↗

DOE OSTI2025

Scale-up Unlearnable Examples Learning with High-performance Computing

Recent advancements in AI models, like ChatGPT, are structured to retain user interactions, which could inadvertently include sensitive healthcare data. In the healthcare field, particularly when radiologists use AI-driven diagnostic tools hosted on online platforms, there is a risk that medical imaging data may be repurposed for future AI training without explicit consent, spotlighting critical privacy and intellectual property concerns around healthcare data usage. Addressing these privacy challenges, a novel approach known as Unlearnable Examples (UEs) has been introduced, aiming to make data unlearnable to deep learning models. A prominent method within this area, called Unlearnable Clustering (UC), has shown improved UE performance with larger batch sizes but was previously limited by computational resources (e.g., a single workstation). To push the boundaries of UE performance with theoretically unlimited resources, we scaled up UC learning across various datasets using Distributed Data Parallel (DDP) training on the Summit supercomputer. Our goal was to examine UE efficacy at high-performance computing (HPC) levels to prevent unauthorized learning and enhance data security, particularly exploring the impact of batch size on UE’s unlearnability. Utilizing the robust computational capabilities of the Summit, extensive experiments were conducted on diverse datasets such as Pets, MedMNist, Flowers, and Flowers102. Our findings reveal that both overly large and overly small batch sizes can lead to performance instability and affect accuracy. However, the relationship between batch size and unlearnability varied across datasets, highlighting the necessity for tailored batch size strategies to achieve optimal data protection. The use of Summit’s high-performance GPUs, along with the efficiency of the DDP framework, facilitated rapid updates of model parameters and consistent training across nodes. Our results underscore the critical role of selecting appropriate batch sizes based on the specific characteristics of each dataset to prevent learning and ensure data security in deep learning applications. The source code is publicly available at https: // github. com/ hrlblab/ UE_ HPC .

Zhu, Yanfan [Vanderbilt University, Nashville, TN,↗

DOE OSTI2024

Deep unsupervised learning using spike-timing-dependent plasticity

Abstract Spike-timing-dependent plasticity (STDP) is an unsupervised learning mechanism for spiking neural networks that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a rate-based convolutional network, that can be deployed in a neuromorphic setting, is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve 24.56% higher accuracy and 3.5 × faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a k -means clustering approach.

Lu, Sen↗

NASA NTRSDate not supplied

Autoencoders for Denoising Atmospheric Profiles from ICESat-2

Abstract: The 2nd generation Ice, Cloud, and land Elevation Satellite (ICESat-2) is an altimetry mission designed primarily for measuring ice sheet elevation and sea ice thickness, provides atmospheric profiles of clouds and aerosols at 532 nm using a photo counting detection approach. While highly sensitive for the detection of tenuous aerosol and cloud features, during the day signal-to-noise-ratio (SNR) photon counting detectors are adversely impacted by solar contributions to the total signal. Averaging the data to coarser horizontal resolutions has been the standard way to increase SNR and thus allow clouds and aerosols to be more easily detectable. Recent work has demonstrated success in boosting SNR without decreasing resolution using advanced filtering techniques [Yorks et al., 2021], however, rapid advancements in Deep Learning based image denoising algorithms can further improve the SNR. Here, we present results using a state-of-the-art Deep Learning autoencoder applied to noisy ICESat-2 data to improve daytime SNR and discuss implications for atmospheric feature detection, classification, and optical property retrievals.

denoising↗

DOE OSTI2025

Testing CP properties of the Higgs boson coupling to τ leptons with heterogeneous graphs

In this paper we explore the possibility of utilizing Deep Learning in measuring the CP properties of the coupling of Higgs boson to τ leptons at the High Luminosity Large Hadron Collider. We employ three Deep Learning (DL) networks, Multi-Layer Perceptron (MLP), Graph Convolution Network (GCN), and Graph Transformer Network (GTN) to enhance signal-to-background separation. The angle between τ lepton decay planes at the detector level is CP-sensitive observables, and we develop Heterogeneous Graphs that integrate diverse node and edge structures to incorporate the CP-sensitive observable efficiently. Using simplified detector simulations we estimate the reconstruction accuracy of the angle between τ lepton planes at the detector level, considering hadronic τ decay modes and standard model backgrounds. With $\sqrt{s}$ = 14 TeV and $\mathcal{L}$ = 100 fb -1 , MLP excludes CP mixing angles above 20° at 68% confidence level (CL), while GCN and GTN achieve exclusions at 90% CL and 95% CL, respectively. The networks also achieve a 3σ significance in excluding a pure CP-odd state.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

A Deep Multimodal Representation Learning Framework for Accurate Molecular Properties Prediction

Drug discovery is a complex and challenging process, requiring the optimization of candidate compounds to identify those with the potential to become safe and effective drugs. Predicting molecular properties is an indispensable step in the drug discovery pipeline. Traditionally, this process is costly and time-intensive, involving multiple rounds of experiments and clinical trials, rendering it impractical for every candidate compound. Deep learning techniques have emerged as a promising approach to drug discovery to reduce the cost and time required to identify novel drugs. However, prevalent research in deep learning models focused on predicting molecular properties has primarily fixated on single-modal models, which utilize a single modality of data, neglecting the potential benefits of combining different data modalities. To overcome this limitation, we introduce MRL-Mol: a deep \textbf{M}ultimodal \textbf{R}epresentation \textbf{L}earning framework for accurate \textbf{Mol}ecular properties prediction. MRL-Mol harnesses three data modalities: sequence, graph, and image, augmenting the depth of comprehension. Leveraging a large-scale unlabeled dataset~($\sim$1M unique molecules), we pretrain MRL-Mol to extract inter- and intra-modal information. Our study demonstrates the superior performance of MRL-Mol in predicting molecular properties across six benchmark datasets, including both classification and regression tasks. Notably, MRL-Mol outperforms other state-of-the-art molecular properties prediction models. These findings suggest that by combining information from multiple data modalities, MRL-Mol can comprehend molecules better than single-modal deep learning models and identify molecular properties with better accuracy.

Yang, Yuxin↗

DOE OSTI2024

Optimal Coordination of Electric Vehicles for Grid Services using Deep Reinforcement Learning

Recent research has shown the effectiveness of reinforcement learning (RL) in coordinating electric vehicles (EVs) with vehicle-to-grid capabilities for grid services. However, many of these studies rely on lookup table and deep Q-network techniques, which can be impractical when dealing with continuous states and actions. In addition, existing RL designs inadequately account for battery aging effects, EV user satisfaction, uncertain departure and arrival time, and trip distance, which may compromise effective coordination. This paper aims to bridge these gaps by developing an innovative deep deterministic policy gradient-based RL framework for optimal coordination of EVs. Case studies were carried out using a test system with 100 EVs, and numerical analysis results showed that the proposed RL framework can effectively coordinate EVs to maximize economic benefits and user satisfaction while ensuring the expected battery lifespan.

Das, Avijit↗

DOE OSTI2025

Differential Seismic Phase Detection Probability as a Potential Discriminant of Explosions and Earthquakes

Deep learning models trained to estimate the probability of seismic P and S phases are rapidly expanding the scale of local event detections. Here, we evaluate the potential for deep learning model output phase detection probabilities to contribute to event‐type classification, particularly discrimination of single‐fired borehole explosions and earthquakes at local distances (<300 km). Motivated by the empirical success of P/S amplitude ratios, we consider the difference between P and S pick probability output from previously developed phase detection models, P prob −S prob ⁠, as a discriminant. Test data include M L ∼1–4 earthquakes and explosions observed by common seismographs in ten geologically diverse localities. Depending on the picking model and training data, binary classification using P prob −S prob with at least three stations can achieve approximately equivalent classification accuracy as P/S amplitude ratios without requiring any customization. Joint classification with P/S and P prob −S prob improves accuracy for most quality control scenarios. Pick probabilities are an efficient attribute to consider in explosion discrimination because they can be automated byproducts of event detection. They avoid the binary choice of picking or not picking weakly visible S waves common to explosions.

Duan, Chenglong [Rice Univ., Houston, TX (United S↗

DOE OSTI2024

Waveform retrieval for ultrafast applications based on convolutional neural networks

Electric field waveforms of light carry rich information about dynamical events on a broad range of timescales. The insight that can be reached from their analysis, however, depends on the accuracy of retrieval from noisy data. In this article, we present a novel approach for waveform retrieval based on supervised deep learning. We demonstrate the performance of our model by comparison with conventional denoising approaches, including wavelet transform and Wiener filtering. The model leverages the enhanced precision obtained from the nonlinearity of deep learning. The results open a path toward an improved understanding of physical and chemical phenomena in field-resolved spectroscopy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.↗

DOE OSTI2025

High‐Asymmetry Metasurface: A New Solution for Terahertz Resonance via Active Learning‐Augmented Diffusion Model

Terahertz (THz) metamaterials with high‐figure‐of‐merit (high‐FoM) performance resonance are essential for advancing sensors, detectors, and imagers. Conventional designs focus on symmetric or low‐asymmetry geometric structures, leaving high‐asymmetry designs largely unexplored due to the inefficiency of trial‐and‐error‐based rational design. Recent deep learning techniques offer automation and acceleration but are constrained by the need for large datasets inherent to their data‐driven nature. Here, a novel prior knowledge‐guided generative model augmented by a physics‐constrained active learning mechanism to design high‐asymmetry metamaterials. An advanced diffusion model learns features from a small set of classical structures with high‐FoM THz resonance and generates new high‐asymmetry structures. To mitigate the limited number of classical structures, the generated high‐asymmetry structures are actively selected and integrated into the initial training dataset based on their physical characteristics. Experimental results demonstrate the superior resonance performance of the generated high‐asymmetry metamaterials over classical designs, exhibiting improvements exceeding 30% in key resonance metrics. Remarkably, this performance is attained using only 68 classical structures as the initial training dataset, significantly reducing the data requirements for deep learning‐based metamaterial design. The proposed scheme for generating high‐asymmetry structures provides a new effective and efficient solution for high‐FoM resonance, expanding applications in high‐sensitivity THz metadevices.

diffusion model↗

NASA NTRS2022

Exploring Applications of Machine Learning for Wildfire Monitoring and Detection using Unmanned Aerial Vehicles

Wildfires are increasing in frequency and severity around the world, including the United States. The losses caused by wildfires could be mitigated if high-risk areas, hotspots, and flare-ups could be monitored continuously, such as through the use of Unmanned Aerial Vehicles (UAVs). This paper documents exploratory efforts using machine learning to determine efficient flight paths for UAVs and to detect wildfires using image classification. On path planning, three machine learning techniques—Genetic Algorithm, Simulated Annealing, and Dynamic Programming—were explored. Genetic Algorithm was found to be an effective approach for path planning for wildfire monitoring and surveillance by UAVs. For a scenario of 25 locations in a circular arrangement, the algorithm was able to return the optimal path. The accuracy and execution time was found to be sensitive to the algorithm hyperparameters selected, which was especially evident in scenarios with hundreds or thousands of locations. Simulated Annealing was also found to be an effective approach for UAV path planning, with a major benefit of avoiding getting trapped in local minima and being straightforward to implement. Like Genetic Algorithm, the performance of Simulated Annealing was also found to be sensitive to the algorithm hyperparameters selected. By comparison, Dynamic Programming guarantees optimality for any number of locations, but it was found to be less practical in terms of execution time for scenarios with more than about a couple dozen locations. On wildfire detection, image classification using deep learning with a convolutional neural network was explored. Transfer learning was found to be a useful technique to efficiently train deep learning models. Also, it was determined that GPU processing can increase training speed by an order of magnitude, which enables significantly faster development. For a validation test set of 500 images, there were only two false negatives and zero false positives. These results demonstrate that detecting wildfires in static cameras using machine learning is feasible and establish a baseline for using images captured by UAVs in flight for wildfire detection.

Wildfire management↗

NASA NTRSDate not supplied

Health Monitoring and Prognostics in Li-ion Batteries

Space applications need to overcome a very critical challenge of predicting remaining useful life of its critical systems/subsystems, with batteries being one of them. Batteries, power electronics conditioning system and motors and one of the most critical systems. Similarly in case of electric aircrafts, computing remaining flying time is safety-critical, since an aircraft that runs out of power (battery charge) while in the air will eventually lose control leading to catastrophe. To tackle and solve the prediction problem, it is essential to have awareness of the current state and health of the system, especially since it is necessary to perform condition-based predictions. To be able to accurately predict the future state of any system, it is required to possess knowledge of its current and future operations. Given models of the current and future system behavior, the general approach of model-based prognostics can be employed as a solution to the prior stated prediction problem. Two approaches are presented with battery prognostics application. The first approach presentation covers a physics based-modeling approach implemented for battery prognostics. Given models of the current and future system behavior, a general approach of model-based prognostics can be employed as a solution to the prediction problem and further for decision making. A second hybrid framework for fusing information from physics-based performance models along with deep learning algorithms for prognostics of complex safety critical systems i.e. batteries is presented. In this framework, physics-based performance models infer unobservable model parameters related to the system's components health solving a calibration problem in the deep learning approach.

Batteries↗

NASA NTRSDate not supplied

Health Monitoring and Prognostics in Li-ion Batteries

Battery Prognostics↗