Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗
NASA NTRS1991

Visual and near-IR spectrophotometry of asteroids

We have been continuing our studies of the spectral properties of dark asteroids in the solar system. From these studies we expect to learn about the distribution of volatile materials, such as water in clay materials (water of hydration) and how the asteroids may relate to the comets. Our most recent work has been concentrating on simultaneous visual and near infrared photometry near Earth, main belt, and trojan asteroids. We have made observations of some unusual asteroids such as Chiron, which has recently shown cometary activity, and 944 Hidalgo, which has a comet-like orbit. We have also begun studies of the small, dark satellites of Mars and Jupiter in order to understand better how they may relate to the steroids. Could they actually be captured asteroids or comets?

Lebofsky, Larry A.↗
NASA NTRS1992

Fault detection and diagnosis using neural network approaches

Neural networks can be used to detect and identify abnormalities in real-time process data. Two basic approaches can be used, the first based on training networks using data representing both normal and abnormal modes of process behavior, and the second based on statistical characterization of the normal mode only. Given data representative of process faults, radial basis function networks can effectively identify failures. This approach is often limited by the lack of fault data, but can be facilitated by process simulation. The second approach employs elliptical and radial basis function neural networks and other models to learn the statistical distributions of process observables under normal conditions. Analytical models of failure modes can then be applied in combination with the neural network models to identify faults. Special methods can be applied to compensate for sensor failures, to produce real-time estimation of missing or failed sensors based on the correlations codified in the neural network.

Kramer, Mark A.↗
NASA NTRS2003

The Meteoritic Component in Impact Deposits

This proposal requested support for a broad-based research program designed to understand the chemical and mineralogical record of accretion of extraterrestrial matter to the Earth. The primary goal of this research is to study the accretion history of the Earth, to understand how this accretion history reflects the long-term flux of comets, asteroids, and dust in the inner solar system and how this flux is related to the geological and biological history of the Earth. This goal is approached by seeking out the most significant projects that can be attacked utilizing the expertise of the PI and potential collaborators. The greatest expertise of the PI is the analysis of meteoritic components in terrestrial sediments. This proposal identifies three primary areas of research, involving impact events in the early Archean (3.2 Ga), the late Eocene (35 Ma) and the late Pliocene (2 Ma). In the early Archean we investigate sediments that contain the oldest recorded impacts on Earth. These are thick spherule beds, three of which were deposited within 20 m.y. If these are impact deposits the flux of objects to Earth at this time was much greater than predicted by current models. Earlier work used Cr isotopes to prove that one of these contain extraterrestrial matter, from a projectile with Cr isotopes similar to CV chondrites. We planned to expand this work to other spherule beds and to search for additional evidence of other impact events. With samples from D. Lowe (Stanford Univ.) the PI proposed to screen samples for high Ir and Cr so that appropriate samples can be provided to A. Shukolyukov for Cr-isotopic analyses. This work was expected to provide evidence that at least one interval in the early Archean was a period of intense bombardment and to characterize the composition of objects accreted. The late Eocene is also a period of intense bombardment with multiple spherule deposits and two large craters. Farley et al. (1998) demonstrated an increased (3)He flux to marine sediments that was attributed to an increase in interplanetary dust due to a shower of comets invading the inner solar system. We planned to detect a change in the Cr-isotopic composition in the flux of fine-grained extraterrestrial matter to ocean sediments. This would provide evidence for the comet shower hypothesis. We planned attempt to locate late Eocene impact deposits in a new high resolution, hi-latitude site that had the potential for excellent preservation and new information of the sources and effects of these impacts. Although most impacts on Earth occur in deep-ocean basins, only one such event is known - the late Pliocene impact of the Eltanin asteroid. The ejecta from this impact includes Ir- rich impact melt, spherules, and actual meteorites from the km-sized mesosiderite asteroid. Through a study of the ejecta, we can learn about the formation, distribution, alteration and preservation of Ir-rich deposits. We can also learn about meteorite survival during hypervelocity impacts and we can study pieces of a km-sized object to learn more about the mesosiderite parent body. Analyses of sediment cores and geophysical exploration of the impact site can further our understanding of the processes involved in deep-ocean impacts and potential effects on the terrestrial climate and biosphere. We planned analyses of this ejecta, a search for ejecta 5000 km distant from the impact area, and a new oceanographic expedition to study and sample the impact site. In addition to these three specific areas of research, the PI planned to remain flexible and available to exploit new opportunities presented by new discoveries, and to engage in new collaborations if other researchers require his expertise to develop new projects that fit within the objectives of the overall research program.

Kyte, Frank T.↗
NASA NTRS1996

Integrated Aeropropulsion Control System Design

%T Integrated Aeropropulsion Control System Design%A C-F. Lin%A Francis X. Hurley%A Jie Huang%A F. Y. Hadaegh%J International Conference on Control and Information(psi)995%C Hong Kong%D June 1995%K aeropropulsion, control, system%U http://jpltrs.jpl.nasa.gov/1995/95-0658.pdfAn integrated intelligent control approach is proposed to design a high performance control system for aeropropulsion systems based on advanced sensor processing, nonlinear control and neural fuzzy control integration. Our approach features the following innovations:??e complexity and uncertainty issues are addressed via the distributed parallel processing, learning, and online reoptimization properties of neural networks.??e nonlinear dynamics and the severe coupling can be naturally incorporated into the design framework.??e knowledge base and decision making logic furnished by fuzzy systems leads to a human intelligence enhanced control scheme.In addition, fault tolerance, health monitoring and reconfigurable control strategies will be accommodated by this approach to ensure stability, graceful degradation and reoptimization in the case of failures, malfunctions and damage.!.

aeropropulsion control systems↗
DOE OSTI2025

Temporal Forecasting of Distributed Temperature Sensing in a Thermal Hydraulic System With Machine Learning and Statistical Models

We benchmark performance of long-short term memory (LSTM) network machine learning model and autoregressive integrated moving average (ARIMA) statistical model in temporal forecasting of distributed temperature sensing (DTS). Data in this study consists of fluid temperature transient measured with two co-located Rayleigh scattering fiber optic sensors (FOS) in a forced convection mixing zone of a thermal tee. We treat each gauge of a FOS as an independent temperature sensor. We first study prediction of DTS time series using Vanilla LSTM and ARIMA models trained on prior history of the same FOS that is used for testing. The results yield maximum absolute percentage error (MaxAPE) and root mean squared percentage error (RMSPE) of 1.58% and 0.06% for ARIMA, and 3.14% and 0.44% for LSTM, respectively. Next, we investigate zero-shot forecasting (ZSF) with LSTM and ARIMA trained on history of the co-located FOS only, which is advantageous when limited training data is available. The ZSF MaxAPE and RMSPE values for ARIMA are comparable to those of the Vanilla use case, while the error values for LSTM increase. We show that in ZSF, performance of LSTM network can be improved by training on most correlated gauges between the two FOS, which are identified by calculating the Pearson correlation coefficient. The improved ZSF MaxAPE and RMSPE for LSTM are 4.4% and 0.33%, respectively. Performance of ZSF LSTM can be further enhanced through transfer learning (TL), where LSTM is re-trained on a subset of the FOS that is the target of forecasting. We show that LSTM pre-trained on correlated dataset and re-trained on 30% of testing target dataset achieves MaxAPE and RMSPE values of 2.32% and 0.28%, respectively.

ARIMA↗
DOE OSTI2025

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Federated Learning for Efficient Condition Monitoring and Anomaly Detection in Industrial Cyber-Physical Systems

Detecting and localizing anomalies in cyber-physical systems (CPS) has become increasingly challenging as systems grow in complexity, particularly due to varying sensor reliability and node failures in distributed environments. While federated learning (FL) offers a foundation for distributed model training, existing approaches lack mechanisms to handle these CPS-specific challenges. This paper presents an enhanced FL framework that introduces three key innovations: adaptive model aggregation based on sensor reliability, dynamic node selection for resource optimization, and Weibull-based checkpointing for fault tolerance. Our framework enables reliable condition monitoring while addressing the computational and reliability challenges of industrial CPS deployments. Experiments on NASA Bearing and Hydraulic System Datasets demonstrate superior performance over state-of-the-art FL methods, achieving 99.5% AUC-ROC in anomaly detection and maintaining accuracy under node failures. Statistical validation using Mann-Whitney (U) test confirms significant improvements (p < 0.05) in both detection accuracy and computational efficiency across diverse operational scenarios.1

Marfo, William [University of Texas at El Paso,Dep↗
DOE OSTI2024

Enhancing Power Distribution System Resilience with Fusion-GNN: A Dynamic Graph Representation Learning Approach

This paper explores the applications of Fusion Graph Neural Network (FuGNN) on power distribution systems. FuGNN effectively models dynamic networks with evolving topology and features. Applied to power system network reconfiguration, FuGNN demonstrates its feasibility in optimizing switch configurations to minimize unserved loads and operational costs during extreme events. Additionally, FuGNN supports various downstream tasks, such as node feature prediction, further enhancing its versatility and applicability in power system resilience.

Liu, Boming↗
DOE OSTI2024

Distributed Energy Resources as an Equity Asset: Lessons Learned from Deployments in Disadvantaged Communities

For an Energy System to be truly equitable, it should provide affordable and reliable energy services to disadvantaged and underserved populations. Disadvantaged communities often face a combination of economic, social, health, and environmental burdens and may be geographically isolated (e.g., rural communities), which systematically limits their opportunity to fully participate in aspects of economic, social, and civic life.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Meta-Learning Enhanced Physics-Informed Graph Attention Convolutional Network for Distribution Power System State Estimation

Promptly perceiving distribution system states is challenged by frequent topology changes and uncertain power injections. To address these issues, a Meta-learning enhanced physics-informed graph attention convolutional network (Meta-PIGACN) model is proposed to handle topological variability in distribution system state estimation (DSSE). Specifically, physics information is integrated into the graph convolutional network, enabling a physics-informed edge-weighting process that incorporates physical information to control the aggregation of neighboring nodes. Besides, the graph attention mechanism automatically adjusts the importance of different neighboring nodes, allowing the capture and preservation of inherent system features across varying topologies, thereby improving state estimation accuracy. Furthermore, meta-learning is proposed to acquire empirical knowledge across multiple topologies so that the model can rapidly adapt to new configurations through iterative gradient descent updates even in large-scale systems. In conclusion, the simulation results based on the 33/118/1746-node distribution systems show the high accuracy and efficiency of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Transfer Learning Trained LSTM Models for Household Load Profile Forecasting

Grid edge renewable energy resources, such as rooftop solar photovoltaics, closely interact with consumer load profiles. Therefore, forecasting future electricity demand, ideally at the individual household level, is indispensable. In this paper, we present a transfer learning enhanced household load profile forecasting method. First, we tune a long short-term memory forecasting model to perform day-ahead prediction of household electricity load profiles. Then we improve these individualized models using transfer learning, and we use k-means clustering to create optimal source data sets. We find average improvements of 4.38% (largest improvement of 10.71%) when the entire data set was used to train the source model and 2.45% (largest improvement of 11.57%) in the mean absolute error when households were first clustered and used to train separate source models for each cluster. We find that transfer learning with clustered data can effectively boost the forecasting performance of the LSTM models. We use realistic household power measurements for 148 real residential households in Austin, Texas.

deep learning↗
DOE OSTI2024

SDYN-GANs: Adversarial learning methods for multistep generative models for general order stochastic dynamics

We introduce adversarial learning methods for data-driven generative modeling of dynamics of nth-order stochastic systems. Our approach builds on Generative Adversarial Networks (GANs) with generative model classes based on stable m-step stochastic numerical integrators. From observations of trajectory samples, we introduce methods for learning long-time predictors and stable representations of the dynamics. Our approaches use discriminators based on Maximum Mean Discrepancy (MMD), training protocols using both conditional and marginal distributions, and methods for learning dynamic responses over different time-scales. We show how our approaches can be used for modeling physical systems to learn force-laws, damping coefficients, and noise-related parameters. Our adversarial learning approaches provide methods for obtaining stable generative models for dynamic tasks including long-time prediction and developing simulations for stochastic systems.

• Artificial intelligence (AI) / machine learning ↗
DOE OSTI2024

Deep learning-based temporal deconvolution for photon time-of-flight distribution retrieval

The acquisition of the time of flight (ToF) of photons has found numerous applications in the biomedical field. Over the last decades, a few strategies have been proposed to deconvolve the temporal instrument response function (IRF) that distorts the experimental time-resolved data. However, these methods require burdensome computational strategies and regularization terms to mitigate noise contributions. Herein, we propose a deep learning model specifically to perform the deconvolution task in fluorescence lifetime imaging (FLI). The model is trained and validated with representative simulated FLI data with the goal of retrieving the true photon ToF distribution. Its performance and robustness are validated with well-controlled in vitro experiments using three time-resolved imaging modalities with markedly different temporal IRFs. The model aptitude is further established with in vivo preclinical investigation. Overall, these in vitro and in vivo validations demonstrate the flexibility and accuracy of deep learning model-based deconvolution in time-resolved FLI and diffuse optical imaging.

Pandey, Vikas (ORCID:0000000154771095)↗
DOE OSTI2024

MassiveGNN: Efficient Training via Prefetching for Massively Connected Distributed Graphs

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle this, distributed-memory solutions such as partitioning the graph to concurrently train multiple replicas of GNNs are in practice. However, approaches requiring a partitioned graph usually suffer from communication overhead and load imbalance, even under optimal partitioning and communication strategies due to irregularities in the neighborhood minibatch sampling. This paper proposes practical trade-offs for improving the sampling and communication overheads for representation learn- ing on distributed graphs (using popular GraphSAGE architecture) by developing a parameterized prefetch and eviction scheme on top of the state-of-the-art Amazon DistDGL distributed GNN framework, demonstrating about 15–40% improvement in end-to-end training performance on the NERSC Perlmutter supercomputer for various OGB datasets.

Machine Leanring, high performance comptuing, grap↗