Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Neural network approximation of Bayesian models for the inference of ion and electron temperature profiles at W7-X

Here, we describe a method for training a neural network (NN) to approximate the full model Bayesian inference of plasma profiles from x-ray imaging diagnostic measurements. The modeling is carried out within the Minerva Bayesian modeling framework where models are defined as a set of assumptions, prior beliefs on parameter values and physics knowledge. The goal is to use NNs for fast ion and electron temperature profile inversion from measured image data. The NN is trained solely on artificial data generated by sampling from the joint distribution of the free parameters and model predictions. The training is carried out in such a way that the mapping learned by the network constitutes an approximation of the full model Bayesian inference. The analysis is carried out on images constituted of 20 × 195 pixels corresponding to binned lines of sight and spectral channels, respectively. Through the full model inference, it is possible to infer electron and ion temperature profiles as well as impurity density profiles. When the network is utilized for the inference of the temperature profiles, the analysis time can be reduced down to a few tens of microseconds for a single time point, which is a drastic improvement if compared to the ≈4 h long Bayesian inference. The procedure developed for the generation of the training set does not rely on diagnostic-specific features, and therefore it is in principle applicable to any other model developed within the Minerva framework. The trained NN has been tested on data collected during the first operational campaign at W7-X, and compared to the full model Bayesian inference results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

AutoEnRichness: A hybrid empirical and analytical approach for estimating the richness of galaxy clusters

ABSTRACT We introduce AutoEnRichness, a hybrid approach that combines empirical and analytical strategies to determine the richness of galaxy clusters (in the redshift range of 0.1 ≤ z ≤ 0.35) using photometry data from the Sloan Digital Sky Survey Data Release 16, where cluster richness can be used as a proxy for cluster mass. In order to reliably estimate cluster richness, it is vital that the background subtraction is as accurate as possible when distinguishing cluster and field galaxies to mitigate severe contamination. AutoEnRichness is comprised of a multistage machine learning algorithm that performs background subtraction of interloping field galaxies along the cluster line of sight and a conventional luminosity distribution fitting approach that estimates cluster richness based only on the number of galaxies within a magnitude range and search area. In this proof-of-concept study, we obtain a balanced accuracy of 83.20 per cent when distinguishing between cluster and field galaxies as well as a median absolute percentage error of 33.50 per cent between our estimated cluster richnesses and known cluster richnesses within r200. In the future, we aim for AutoEnRichness to be applied on upcoming large-scale optical surveys, such as the Legacy Survey of Space and Time and Euclid, to estimate the richness of a large sample of galaxy groups and clusters from across the halo mass function. This would advance our overall understanding of galaxy evolution within overdense environments as well as enable cosmological parameters to be further constrained.

79 ASTRONOMY AND ASTROPHYSICS↗

A 3D Implementation of Convolutional Neural Network for Fast Inference

Low latency inference has many applications in edge machine learning. In this paper, we present a run-time configurable convolutional neural network (CNN) inference ASIC design for low-latency edge machine learning. By implementing a 5-stage pipelined CNN inference model in a 3D ASIC technology, we demonstrate that the model distributed on two dies utilizing face-to-face (F2F) 3D integration achieves superior performance. Our experimental results show that the design based on 3D integration achieves 43% better energy-delay product when compared to the traditional 2D technology.

Miniskar, Narasinga Rao↗

A Probabilistic Reasoner Based on Bayes Risk for Damage Detection in Structural Systems

Structural health monitoring (SHM) systems are used to inform operation of structural systems subject to loads and environments that may affect their integrity. SHM systems rely on continuous monitoring of the structure to determine its health state. These systems are often coupled with a model of the deployed structure to determine the consequences of changes in the system by forecasting the response to future states. These models, which may be thought of as digital twins, need to be updated to reflect the latest state of the structural system. This work makes use of an uncertainty-aware machine learning model that enforces distance preservation of the original input space to determine deviations from the training data input space distributions. This workflow enables domain shift detection to determine whether damage is present in the structure. The uncertainty metrics generated by this network are then used in a Bayes risk framework to design an optimal damage detector given cost and risk considerations. The approach is demonstrated on a computational example with simulated damage.

Najera-Flores, David [ATA Engineering, Inc.]↗

Bayesian quantum state reconstruction with a learning-based tuned prior

We demonstrate machine-learning-enhanced Bayesian quantum state tomography on near-term intermediate-scale quantum hardware. Our approach to selecting prior distributions leverages pre-trained neural networks incorporating measurement data and enables improved inference times over standard prior distributions.

Regmi, Sangita↗

Modeling hadronization using machine learning

We present the first steps in the development of a new class of hadronization models utilizing machine learning techniques. We successfully implement, validate, and train a conditional sliced-Wasserstein autoencoder to replicate the Pythia generated kinematic distributions of first-hadron emissions, when the Lund string model of hadronization implemented in Pythia is restricted to the emissions of pions only. The trained models are then used to generate the full hadronization chains, with an IR cutoff energy imposed externally. The hadron multiplicities and cumulative kinematic distributions are shown to match the Pythia generated ones. We also discuss possible future generalizations of our results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Photovoltaic and Behind-the-Meter Battery Storage: Advanced Smart Inverter Controls and Field Demonstration

Electric utilities have little visibility of the electrical distribution system, and consequently, limited diagnostic capabilities. The distribution grid was designed for a unidirectional power flow, where energy is supplied by few large centralized power plants; however, this is set to change to meet California’s aggressive decarbonization goals. The large-scale deployment of distributed renewable generation, such as photovoltaics (PV), can have many negative effects on an unprepared grid. As illustrated in the California “duck curve,” PV generation modifies load profiles during the day, which causes steep ramping in the evening. This effect indicates the need to revise the electrical grid’s design and operation. This project sought to (a) create a centralized resource in California to test and validate distribution technology controls with industry standard PV, storage, and high-fidelity sensors, (b) support strategic and operational decisions for new grid architectures by providing simulation models, (c) promote new ways to control clusters of PV smart inverters, in accordance with California Rule 21, and (d) innovate, develop, and field test a predictive controller to maximize economic profit for the customer while supporting the grid. The controller was built using the state-of-the-art model predictive control methodology to optimally control behind-the-meter PV and battery storage. In consideration of the duck curve, the controller optimally controls the battery dispatch by charging during excess generation periods and discharging during the critical afternoon demand hours. The controller was evaluated in annual simulations and revealed the potential cost-effectiveness of behind-the-meter battery storage. The simulations showed that the annual electricity bill could be reduced by as much as 35 percent, with a payback period of the investment in battery storage in about 6 years – significantly shorter than the manufacturer’s 10-year warranty. All developed simulation models, the grid event library, and the MPC controller are open-source and available online.

Model Predictive control↗

A Comprehensive Analysis of PINNs for Power System Transient Stability

The integration of machine learning in power systems, particularly in stability and dynamics, addresses the challenges brought by the integration of renewable energies and distributed energy resources (DERs). Traditional methods for power system transient stability, involving solving differential equations with computational techniques, face limitations due to their time-consuming and computationally demanding nature. This paper introduces physics-informed Neural Networks (PINNs) as a promising solution for these challenges, especially in scenarios with limited data availability and the need for high computational speed. PINNs offer a novel approach for complex power systems by incorporating additional equations and adapting to various system scales, from a single bus to multi-bus networks. Our study presents the first comprehensive evaluation of physics-informed Neural Networks (PINNs) in the context of power system transient stability, addressing various grid complexities. Additionally, we introduce a novel approach for adjusting loss weights to improve the adaptability of PINNs to diverse systems. Our experimental findings reveal that PINNs can be efficiently scaled while maintaining high accuracy. Furthermore, these results suggest that PINNs significantly outperform the traditional ode45 method in terms of efficiency, especially as the system size increases, showcasing a progressive speed advantage over ode45.

97 MATHEMATICS AND COMPUTING↗

Community Planning for Solar: Conducting a Community Solar Survey

This guide is designed to assist community officials, volunteers, and regional planning agency staff in conducting a survey of residents to learn about attitudes and development preferences towards solar energy within the community. The guide will provide the key steps, timelines, distribution options, ethics, and considerations that should be made in developing a survey distribution strategy. The guide also contains an overview of various question types and response categories, with considerations for the type of data that are needed for the study. The guide concludes with recommendations for managing data and databases, data visualization, and reporting results. The appendix includes samples of materials used in a solar energy survey, from invitation letters to the survey. This document is intended to provide a practical guide for implementing a survey in communities that are proactively planning for solar development. The guide offers a practical “how-to” plan for conducting a survey. It may be advantageous to consult with an expert in survey development who will be familiar with any methods and techniques described in this guide, but this is not necessary. This guide offers basic considerations and examples of questions and analyses to help a community understand preferences of the community.

14 SOLAR ENERGY↗

Abstract for CRADA between NETL and Louisiana State University

The National Energy Technology Laboratory (NETL) and Louisiana State University (PARTICIPANT) will collaborate in developing and testing distributed optical fiber CO 2 sensors for CO 2 storage site monitoring. Safe and reliable monitoring of CO 2 storage sites and transport infrastructure is critical for ensuring the long-term effectiveness and integrity of carbon capture and storage (CCS). In this project, the objective is to develop a novel optical fiber-based distributed CO 2 sensor for long-term monitoring of CCS sites and CO 2 pipelines and also implement machine learning to automate leak and structural anomaly detection. This effort aligns with NETL’s mission in reliable and sustainable energy and decarbonization.

47 OTHER INSTRUMENTATION↗

A Comprehensive Analysis of PINNs for Power System Transient Stability

The integration of machine learning in power systems, particularly in stability and dynamics, addresses the challenges brought by the integration of renewable energies and distributed energy resources (DERs). Traditional methods for power system transient stability, involving solving differential equations with computational techniques, face limitations due to their time-consuming and computationally demanding nature. This paper introduces physics-informed Neural Networks (PINNs) as a promising solution for these challenges, especially in scenarios with limited data availability and the need for high computational speed. PINNs offer a novel approach for complex power systems by incorporating additional equations and adapting to various system scales, from a single bus to multi-bus networks. Our study presents the first comprehensive evaluation of physics-informed Neural Networks (PINNs) in the context of power system transient stability, addressing various grid complexities. Additionally, we introduce a novel approach for adjusting loss weights to improve the adaptability of PINNs to diverse systems. Our experimental findings reveal that PINNs can be efficiently scaled while maintaining high accuracy. Furthermore, these results suggest that PINNs significantly outperform the traditional ode45 method in terms of efficiency, especially as the system size increases, showcasing a progressive speed advantage over ode45.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Score-based deterministic density sampling

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density π given only its score ∇ log π. Our method approximates the Wasserstein gradient flow on KL($f_t$∥π) by learning the time-varying score ∇ log $f_t$ on the fly using score matching. While having the same marginal distribution as Langevin dynamics, our method produces smooth deterministic trajectories, resulting in monotone noise-free convergence. We prove that our method dissipates relative entropy at the same rate as the exact gradient flow, provided sufficient training. Numerical experiments validate our theoretical findings: our method converges at the optimal rate, has smooth trajectories, and is often more sample efficient than its stochastic counterpart. Experiments on high-dimensional image data show that our method produces high-quality generations in as few as 15 steps and exhibits natural exploratory behavior. The memory and runtime scale linearly in the sample size.

97 MATHEMATICS AND COMPUTING↗

Building intelligent systems - Artificial intelligence research at NASA Ames Research Center

The basic components that make up the goal of building autonomous intelligent systems are discussed, and ongoing work at the NASA Ames Research Center is described. It is noted that a clear progression of systems can be seen through research settings (both within and external to NASA) to Space Station testbeds to systems which actually fly on the Space Station. The starting point for the discussion is a 'truly' autonomous Space Station intelligent system, responsible for a major portion of Space Station control. Attention is given to research in fiscal 1987, including reasoning under uncertainty, machine learning, causal modeling and simulation, knowledge from design through operations, advanced planning work, validation methodologies, and hierarchical control of and distributed cooperation among multiple knowledge-based systems.

Friedland, Peter↗

Building intelligent systems: Artificial intelligence research at NASA Ames Research Center

The basic components that make up the goal of building autonomous intelligent systems are discussed, and ongoing work at the NASA Ames Research Center is described. It is noted that a clear progression of systems can be seen through research settings (both within and external to NASA) to Space Station testbeds to systems which actually fly on the Space Station. The starting point for the discussion is a truly autonomous Space Station intelligent system, responsible for a major portion of Space Station control. Attention is given to research in fiscal 1987, including reasoning under uncertainty, machine learning, causal modeling and simulation, knowledge from design through operations, advanced planning work, validation methodologies, and hierarchical control of and distributed cooperation among multiple knowledge-based systems.

Friedland, P.↗

The fate of organic carbon in marine sediments - New insights from recent data and analysis

Organic carbon in marine sediments is a critical component of the global carbon cycle, and its degradation influences a wide range of phenomena, including the magnitude of carbon sequestration over geologic timescales, the recycling of inorganic carbon and nutrients, the dissolution and precipitation of carbonates, the production of methane and the nature of the seafloor biosphere. Although much has been learned about the factors that promote and hinder rates of organic carbon degradation in natural systems, the controls on the distribution of organic carbon in modern and ancient sediments are still not fully understood. In this review, we summarize how recent findings are changing entrenched perspectives on organic matter degradation in marine sediments: a shift from a structurally-based chemical reactivity viewpoint towards an emerging acceptance of the role of the ecosystem in organic matter degradation rates. That is, organic carbon has a range of reactivities determined by not only the nature of the organic compounds, but by the biological, geochemical, and physical attributes of its environment. This shift in mindset has gradually come about due to a greater diversity of sample sites, the molecular revolution in biology, discoveries concerning the extent and limits of life, advances in quantitative modeling, investigations of ocean carbon cycling under a variety of extreme paleo-conditions (e.g. greenhouse environments, euxinic/anoxic oceans), the application of novel analytical techniques and interdisciplinary efforts. Adopting this view across scientific disciplines will enable additional progress in understanding how marine sediments influence the global carbon cycle.

Organic carbon↗

Multi-Scale Thermo-Mechanical Modeling of Porous 3D Woven TPS Materials

This work summarizes the process to compute and analyze the thermal conductivity and mechanical properties of 3D woven TPS materials such as 3MDCP (3D Mid-Density Carbon-Phenolic). The PuMA [1,2] software, developed at NASA Ames, was used to characterize different 3MDCP samples from their constituents' data, averaging their thermal conductivity and elastic properties in the three main directions to obtain their effective orthotropic thermo-mechanical properties. This was performed in multiple steps: firstly, TPS samples were digitally reconstructed using micro computed tomography (µCT) and their constituents were segmented; then, the porous matrix phase was analyzed at the micro-scale and these results were used, along with the fibers’ constituents information, to model the tows at the meso-scale; finally, results from the constituents were homogenized and used to model the thermo-mechanical behavior of the unit cell at the macro-scale. Additionally, to gain a better understanding of the tows’ morphology and distribution of the carbon-phenolic blended fibers, microscopy images of the tows’ cross-section were segmented using deep learning techniques and analyzed with PuMA. This workflow can be applied to any TPS material to computationally obtain its thermo-mechanical properties, enabling more informed TPS design and manufacturing choices.

Multi-Scale↗

Multi-Scale Thermo-Mechanical Modeling of Porous 3D Woven TPS Materials

This work summarizes the process to compute and analyze the thermal conductivity and mechanical properties of 3D woven TPS materials such as 3MDCP (3D Mid-Density Carbon-Phenolic). The PuMA software, developed at NASA Ames, was used to characterize different 3MDCP samples from their constituents' data, averaging their thermal conductivity and elastic properties in the three main directions to obtain their effective orthotropic thermo-mechanical properties. This was performed in multiple steps: firstly, TPS samples were digitally reconstructed using micro computed tomography (µCT) and their constituents were segmented; then, the porous matrix phase was analyzed at the micro-scale and these results were used, along with the fibers’ constituents information, to model the tows at the meso-scale; finally, results from the constituents were homogenized and used to model the thermo-mechanical behavior of the unit cell at the macro-scale. Additionally, to gain a better understanding of the tows’ morphology and distribution of the carbon-phenolic blended fibers, microscopy images of the tows’ cross-section were segmented using deep learning techniques and analyzed with PuMA. This workflow can be applied to any TPS material to computationally obtain its thermo-mechanical properties, enabling more informed TPS design and manufacturing choices.

Multi-Scale↗

A prediction interval method for uncertainty quantification of regression models

This paper considers calculation of prediction intervals (PIs) by neural networks (NNs) for quantifying uncertainty in regression tasks, so as to provide fast, accurate and robust emulators to accelerate scientific simulations. We propose a novel method to learn lower and upper bounds of the PI using independent NNs without defining an exclusive loss. Our method requires no distributional assumption, does not introduce extra hyper-parameters, and can effectively identify out-of-distribution samples and quantify their uncertainty. We demonstrate advantages of our method using a benchmark problem and two real-world scientific applications.

Zhang, Pei↗