Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Statistical methods and neural network approaches for classification of data from multiple sources

Statistical methods for classification of data from multiple data sources are investigated and compared to neural network models. A problem with using conventional multivariate statistical approaches for classification of data of multiple types is in general that a multivariate distribution cannot be assumed for the classes in the data sources. Another common problem with statistical classification methods is that the data sources are not equally reliable. This means that the data sources need to be weighted according to their reliability but most statistical classification methods do not have a mechanism for this. This research focuses on statistical methods which can overcome these problems: a method of statistical multisource analysis and consensus theory. Reliability measures for weighting the data sources in these methods are suggested and investigated. Secondly, this research focuses on neural network models. The neural networks are distribution free since no prior knowledge of the statistical distribution of the data is needed. This is an obvious advantage over most statistical classification methods. The neural networks also automatically take care of the problem involving how much weight each data source should have. On the other hand, their training process is iterative and can take a very long time. Methods to speed up the training procedure are introduced and investigated. Experimental results of classification using both neural network models and statistical methods are given, and the approaches are compared based on these results.

Benediktsson, Jon Atli↗
NASA NTRS2012

A Probabilistic Mass Estimation Algorithm for a Novel 7- Channel Capacitive Sample Verification Sensor

A document describes an algorithm created to estimate the mass placed on a sample verification sensor (SVS) designed for lunar or planetary robotic sample return missions. A novel SVS measures the capacitance between a rigid bottom plate and an elastic top membrane in seven locations. As additional sample material (soil and/or small rocks) is placed on the top membrane, the deformation of the membrane increases the capacitance. The mass estimation algorithm addresses both the calibration of each SVS channel, and also addresses how to combine the capacitances read from each of the seven channels into a single mass estimate. The probabilistic approach combines the channels according to the variance observed during the training phase, and provides not only the mass estimate, but also a value for the certainty of the estimate. SVS capacitance data is collected for known masses under a wide variety of possible loading scenarios, though in all cases, the distribution of sample within the canister is expected to be approximately uniform. A capacitance-vs-mass curve is fitted to this data, and is subsequently used to determine the mass estimate for the single channel s capacitance reading during the measurement phase. This results in seven different mass estimates, one for each SVS channel. Moreover, the variance of the calibration data is used to place a Gaussian probability distribution function (pdf) around this mass estimate. To blend these seven estimates, the seven pdfs are combined into a single Gaussian distribution function, providing the final mean and variance of the estimate. This blending technique essentially takes the final estimate as an average of the estimates of the seven channels, weighted by the inverse of the channel s variance.

Wolf, Michael↗
NASA NTRSDate not supplied

Simulation of the Aerosol Size Distribution Using a Neural Network Surrogate for the Modal Aerosol Module (MAM7)

One objective of atmospheric simulations is to quantify the distribution of aerosols and their properties. Accurate parameterizations of the processes governing aerosol mass, particle number, and particle size distribution are important for predicting the Earth’s net radiative balance and aerosol-cloud interactions. The Modal Aerosol Module (MAM7) is a two-moment aerosol model that simulates mass, number, and size distribution of seven modes comprised of internally mixed aerosol species. The two-moment scheme adds significant computational expense but allows for the prediction of varying particle size distribution relative to the bulk method which predicts only total mass. In this work, we developed a neural network surrogate model for MAM7 (MAMnet) to predict the aerosol number concentration in NASA’s Global Earth Observing System (GEOS) without adding prohibitive computational expense. MAMnet, can be driven by output from a single moment, mass-based, aerosol scheme (Goddard Chemistry Aerosol and Radiation model (GOCART)) or from reanalysis products (Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2)). MAMnet was trained using number concentrations from a 5-year GEOS/MAM7 simulation at 1-degree horizontal resolution and using the total mass calculated across modes as inputs, as well as temperature and air density. The model architecture for MAMnet was based on AlexNet, the 2012 winner of the ImageNet Large Scale Visual Recognition Challenge. While some modifications were necessary to accommodate our problem, important aspects of the network were preserved. MAMnet was able to reproduce zonal dynamics and spatial distributions of the aerosol number concentration however predictability in the upper troposphere was poor.

Katherine H Breen↗
DOE OSTI2024

Hydropower Black Start: A Guidebook for Retrofitting Grid Dependent Hydropower

Not all United States (US) hydropower plants were designed to provide black start, but they are increasingly needed to uphold resilience in the evolving electric grid. This guidance is designed to help understand the minimal retrofits required for grid dependent hydropower (GDH) plants behind the point of interconnection (POI). For distribution connected hydropower plants or those with dedicated cranking paths, such upgrades can be sufficient for the plant to provide black start. For others, more coordination with the transmission system operator will be needed. This guidebook answers a number of questions relevant to retrofitting hydropower plants with black start capabilities. For example, the guidebook answers: • How flexible do the wicket gate controls need to be? • Who needs to do hydro governor model validation, why, and how? • How robust and flexible do the excitation and AVR controls need to be? • What protection settings need to be adjusted? • What relay(s) will need to be bypassed or overridden and at what risk? • What is the electrical energy demand of the station load or auxiliary power systems? • What should the strategy to energize transformer(s) along cranking path to address inrush currents be? • How should the critical load restoration be sequenced? In addition to outlining the specifications that hydropower plants need to meet for each component to be able to perform black start, this guidebook provides a set of case studies for specific upgrades needed at actual plants. Between the case studies of plants that have already performed black start retrofits and the examples of how this guidebook can be applied to scope future retrofits, five key themes have been identified for retrofit needs. 1. Protection needs “black start” mode: hydropower plants that are not designed with black start capabilities will have protections that prevent them from interconnecting to a “dead bus.” These protections will need to be overridden in every retrofit case and a separate black start mode should be established so that operators can safely switch between black start and grid connected modes, minimizing the risk to the plant. 2. Wicket gates need modern controls: digital governors accelerate the parameter tuning process and gate position sensors improve controllability, so plants with mechanical governors should be upgraded. Furthermore, a black start and islanding mode should be established for controls to maximize plant performance. 3. Robust excitation support: the DC system or excitation generator needs to be reliable enough to form and sustain the rotor electromagnetic field. These systems are typically undersized in plants that were not designed for black start, so they will need to be upgraded. 4. Turbine-governor model validation and operator training: validation of a standard hydro governor model is needed to characterize the dynamic response (i.e., inertial and primary frequency response) of the GDH. This is required for control development and old hydropower plants often have outdated or incorrect models. Operator training is also typically required to ensure the hardware retrofits are utilized correctly during the black start process. 5. Transformer and cranking path energization: any upgradation and control adjustment in front of the POI will depend upon the existing interconnection. Coordination with the transmission or distribution operator may be required.

13 HYDRO ENERGY↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2025

Electrical Load Forecasting Over Multihop Smart Metering Networks With Federated Learning

Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) record household energy data. Traditional machine learning (ML) methods are often employed for load forecasting, but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. Here, this article presents a novel personalized FL (PFL) method for high-quality load forecasting in metering networks. A meta-learning-based strategy is developed to address data heterogeneity at local SMs in the collaborative training of local load forecasting models. Moreover, to minimize the load forecasting delays in our PFL model, we study a new latency optimization problem based on optimal resource allocation at SMs. A theoretical convergence analysis is also conducted to provide insights into FL design for federated load forecasting. Extensive simulations from real-world datasets show that our method outperforms existing approaches regarding better load forecasting and reduced operational latency costs.

Rahman, Ratun [Univ. of Alabama, Huntsville, AL (U↗
DOE OSTI2024

Hybrid Storage Solution

With the rise of artificial intelligence and machine learning, data sets used to train models have become increasingly large. The availability, accessibility and integrity of large data sets has become important to the research conducted at Los Alamos National Laboratory. Ceph is a storage solution suitable for use with critical data because of its distributed nature and ability to keep multiple copies of a file in different locations. The amount of data means that bandwidth, latency, and cost are important factors and the reason most storage solutions are on-premises. However, there are distinct advantages to hosting services in the cloud, namely scalability and ease-of-use. In this paper, we explore the possibility of provisioning a hybrid Ceph cluster that leverages the benefits of both cloud architectures and on-premise performance.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1993

Denver TMA assessment

This report describes the assessment of the Traffic Management Advisor (TMA) conducted at the Denver Center and TRACON, January 11-February 5, 1993. The assessment addressed the effectiveness of TMA for supporting various traffic management activities. At the Center, traffic management coordinators (TMC's) shadowed traffic operations, using TMA to make metering time and internal release decisions. At the TRACON, TMC's accessed TMA in an advisory mode for different planning activities such as staffing, distributing the traffic load, and changing the airport acceptance rate. These different opportunities for assessing TMA provide insight into TMA as a potential communication aid and planning tool. Findings from this assessment indicate that TMA can be used to support traffic management planning and decisions. TMC's at the center were able to use information provided by TMA to determine metering times as well as internal release times. At the TRACON, TMA supported decisions on airport configuration, airport acceptance rate, load distribution, proactive coordination with the center, and staffing. While findings of TMA use are generally positive, it must be kept in mind that this assessment is a snapshot in time. Not all TMA capabilities were assessed, nor were TMC's fully trained and knowledgeable on all features. Feature use will continue to evolve and strategies emerge as the TMC's gain experience with TMA over a variety of traffic situations and their understanding of TMA capabilities broadens with continued training.

Harwood, Kelly↗
NASA NTRS1996

Experimental and computational investigation of lift-enhancing tabs on a multi-element airfoil

An experimental and computational investigation of the effect of lift enhancing tabs on a two-element airfoil was conducted. The objective of the study was to develop an understanding of the flow physics associated with lift enhancing tabs on a multi-element airfoil. A NACA 63(sub 2)-215 ModB airfoil with a 30 percent chord Fowler flap was tested in the NASA Ames 7 by 10 foot wind tunnel. Lift enhancing tabs of various heights were tested on both the main element and the flap for a variety of flap riggings. Computations of the flow over the two-element airfoil were performed using the two-dimensional incompressible Navier-Stokes code INS2D-UP. The computer results predict all of the trends in the experimental data quite well. When the flow over the flap upper surface is attached, tabs mounted at the main element trailing edge (cove tabs) produce very little change in lift. At high flap deflections. however, the flow over the flap is separated and cove tabs produce large increases in lift and corresponding reductions in drag by eliminating the separated flow. Cove tabs permit high flap deflection angles to be achieved and reduce the sensitivity of the airfoil lift to the size of the flap gap. Tabs attached to the flap training edge (flap tabs) are effective at increasing lift without significantly increasing drag. A combination of a cove tab and a flap tab increased the airfoil lift coefficient by 11 percent relative to the highest lift tab coefficient achieved by any baseline configuration at an angle of attack of zero percent and the maximum lift coefficient was increased by more than 3 percent. A simple analytic model based on potential flow was developed to provide a more detailed understanding of how lift enhancing tabs work. The tabs were modeled by a point vortex at the training edge. Sensitivity relationships were derived which provide a mathematical basis for explaining the effects of lift enhancing tabs on a multi-element airfoil. Results of the modeling effort indicate that the dominant effects of the tabs on the pressure distribution of each element of the airfoil can be captured with a potential flow model for cases with no flow separation.

Ashby, Dale↗
NASA NTRS2014

Autonomous Mission Operations Roadmap

As light time delays increase, the number of such situations in which crew autonomy is the best way to conduct the mission is expected to increase. However, there are significant open questions regarding which functions to allocate to ground and crew as the time delays increase. In situations where the ideal solution is to allocate responsibility to the crew and the vehicle, a second question arises: should the activity be the responsibility of the crew or an automated vehicle function? More specifically, we must answer the following questions: What aspects of mission operation responsibilities (Plan, Train, Fly) should be allocated to ground based or vehicle based planning, monitoring, and control in the presence of significant light-time delay between the vehicle and the Earth?How should the allocated ground based planning, monitoring, and control be distributed across the flight control team and ground system automation? How should the allocated vehicle based planning, monitoring, and control be distributed between the flight crew and onboard system automation?When during the mission should responsibility shift from flight control team to crew or from crew to vehicle, and what should the process of shifting responsibility be as the mission progresses? NASA is developing a roadmap of capabilities for Autonomous Mission Operations for human spaceflight. This presentation will describe the current state of development of this roadmap, with specific attention to in-space inspection tasks that crews might perform with minimum assistance from the ground.

Mission Operations↗
NASA NTRSDate not supplied

A Decade of NASA Strategic Astrophysics Technology Investments: Technology Maturation, Infusion, and Other Benefits

NASA’s Astrophysics Division (APD) funds development of cutting-edge technology to enable its missions to achieve ambitious and groundbreaking science goals. These technology development efforts are managed by the Physics of the Cosmos (PCOS), Cosmic Origins (COR), and Exoplanet Exploration (ExE) Programs. The NASA Strategic Astrophysics Technology (SAT) Program was established in 2009 as a new technology maturation program to fill the gap in the Technology Readiness Level (TRL) range from 3 to 6. Since program inception, 100 SAT grants have been openly competed and awarded, along with dozens of direct-funded projects, leading to a host of technologies advancing their TRLs and/or being infused into space and suborbital missions and ground-based projects. We present the portfolio distribution in terms of specific technology areas addressed, including optics, detectors, coatings, coronagraphs, starshades, lasers, electronics, cooling systems, and micro-thruster subsystems. We show an analysis of the rate of TRL advances, infusion success stories, and other benefits such as training the future astrophysics workforce, including students and postdoctoral fellows hired by projects. Finally, we present APD’s current strategic technology maturation priorities for investment, enabling a range of future strategic astrophysics missions

NASA, astrophysics, technology development, optics↗
NASA NTRS2020

PPDIST, global 0.1° daily and 3-hourly precipitation probability distribution climatologies for 1979–2018

We introduce the Precipitation Probability DISTribution (PPDIST) dataset, a collection of global high-resolution (0.1°) observation-based climatologies (1979–2018) of the occurrence and peak intensity of precipitation (P) at daily and 3-hourly time-scales. The climatologies were produced using neural networks trained with daily P observations from 93,138 gauges and hourly P observations (resampled to 3-hourly) from 11,881 gauges worldwide. Mean validation coefficient of determination (R^(2)) values ranged from 0.76 to 0.80 for the daily P occurrence indices, and from 0.44 to 0.84 for the daily peak P intensity indices. The neural networks performed significantly better than current state-of-the-art reanalysis (ERA5) and satellite (IMERG) products for all P indices. Using a 0.1 mm 3 per h threshold, P was estimated to occur 12.2%, 7.4%, and 14.3% of the time, on average, over the global, land, and ocean domains, respectively. The highest P intensities were found over parts of Central America, India, and Southeast Asia, along the western equatorial coast of Africa, and in the intertropical convergence zone.

Hylke E. Beck↗
NASA NTRS2023

Fine particulate concentrations over East Asia derived from aerosols measured by the Advanced Himawari Imager using machine learning

Fine particulate matter with a diameter below 2.5 μm (PM 2.5 ) is deleterious to the cardiovascular and respiratory systems. It is often difficult to assess the effects of PM 2.5 on human health over regions with limited ground monitoring sites, especially in East Asia. As an alternative, we estimated near-surface PM 2.5 concentrations by analyzing Advanced Himawari Imager (AHI) Yonsei Aerosol Retrieval (YAER) products. This study incorporates daytime data for East Asia covering the Korean Peninsula, China, Japan, Southeast Asia, and southern Mongolia. We collocated AHI YAER product pixels with meteorological, land-cover, and other ancillary data for the period from March 2018 to February 2019. To estimate PM 2.5 concentrations over wide areas spanning many countries displaying various relationships between aerosol optical depth and PM 2.5 , monthly models were developed by considering both the spatial and temporal characteristics of ground-based PM 2.5 measurements. Random forest machine learning model estimated ground-level mass concentrations of PM 2.5 ; subsequent 10-fold cross validation (CV) yielded a CV R 2 value of 0.81 and a CV root mean squared error (RMSE) of 12.3 μg m -3 . We investigated the spatial pattern of PM 2.5 concentrations over multiple countries and seasonal variation in PM 2.5 concentrations. Diurnal variation of a severe PM 2.5 event in the Korean Peninsula was investigated as a case study. The model captured the extremely heterogeneous spatial distribution of PM 2.5 concentrations peaked around local noon. To measure the capability of the developed model to estimate PM 2.5 concentrations in areas with few in-situ data, its predictive performance was evaluated using a dataset independent of the training process with an R 2 of 0.60 and RMSE of 8.18 μg m −3 . This study demonstrates the potential for satellite-based PM 2.5 estimation for areas with insufficient measuring stations.

Pm2.5↗
NASA NTRSDate not supplied

From Simulation to Reality With Random Noise

The challenging environment of autonomous vehicle (AV) navigation necessitates certain functions be performed by deep neural networks. Optimizing these models involves collecting vast quantities of domain-specific training data and ensuring that the dataset is representative of expected conditions. High-fidelity simulation plays a vital role in making this process feasible, allowing a wide range of scenarios to be explored at low cost. However, learning from simulation introduces subtle biases into models, which can degrade real-world performance in unpredictable ways. This effect can be mitigated with learning schemes specialized to bridge distributional shifts (transfer learning). Given the complex nature of these methods, the underlying models, and their environments, meaningfully evaluating performance is notstraight forward. Many unrelated factors can effect an improvement in generalization accuracy, but a full ablation analysis is often difficult. To tease out signal from noise, it is necessary to understand how transfer learning performance is affected by noise itself. The goals of this paper are (i) to establish a domain randomization baseline for a simple classification transfer learning task and (ii) to validate the RRAV testbed as a platform for further research in sim-to-real learning. We generate imagery from a simulation of NASA Ames Research Center and train a small convolutional neural network (ConvNet) to classify position relative to a centerline. Further models are trained with different types of noise progressively added to the data. The models are deployed aboard the on-site test vehicle to test real-world performance. In our experiments, we find that such naive domain randomization raises sim-to-real accuracy from 64% to 79%, while training directly on real data yields an 89% accuracy ceiling. These results suggest that the isolated mechanism of domain randomization can significantly improve generalization.

simulation↗
DOE OSTI2024

Chapter 7: Learning Stable Local Volt/Var Controllers in Distribution Grids

This chapter describes a framework to synthesize provably stable local Volt/Var controllers for distributed energy resources (DERs) in power distribution grids (DGs). The goal is to control the reactive power injections of DERs to improve the system performance as quantified by a generic optimal reactive power flow (ORPF) problem. To achieve this, we jointly design for each DER the control function, which prescribes the reactive power update rule, and the equilibrium function, which approximates the ORPF solutions from local measurements of voltages and powers. We provide conditions on the equilibrium functions and the control parameters ensuring the stability of the closed-loop system. In particular, we discuss the trade-offs between each set of conditions accounting for practical considerations, like fully exploiting the DERs' generation capabilities and reducing the optimality gap. These conditions are then translated into learning constraints on the neural networks' parameters that are enforced in the training phase. We validate our framework with numerical simulations on the IEEE 37-bus network and through a comparison with an optimized version of standard piece wise linear control rules.

closed-loop asymptotic stability↗
DOE OSTI2026

Reducing systematic bias in machine learning applications to J/ψ signal extraction in high-energy nuclear physics

Machine learning techniques are increasingly used in high-energy nuclear physics because they can exploit multivariate correlations more efficiently than conventional cut-based analyses. A central challenge is the construction of training samples that faithfully reproduce the detector response observed in data. Signal samples are usually derived from detector simulations; therefore, mismatches between simulation and data can degrade classifier performance and introduce systematic biases. This work presents two practical correction procedures, namely cumulative distribution function (CDF) mapping and a shift-and-scale transformation, to align simulated signal features with those measured in data. Their performance is demonstrated with $J$/$\psi$ yield measurements in $\sqrt{s_{nn}}$ = 200 GeV Ru+Ru and Zr+Zr collisions recorded by STAR. A set of self-consistency tests shows that these procedures substantially suppress the systematic bias associated with data-simulation discrepancies in machine-learning-based signal extraction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

PUFFIn – A user friendly fast interface for calculating and visualizing the dose distribution in materials

This article describes a new graphical user interface that uses the PENELOPE Monte Carlo code to calculate dose distributions in materials. It is named PUFFIn, for the Penelope User-Friendly Fast Interface and was developed as an educational and scoping analysis tool for non-experts in radiation modeling. PUFFIn enables the user to visualize and compare the dose distributions in objects (e.g., sterilized healthcare products) irradiated with cobalt-60 gamma-rays, electron beam (E-beam) or X-rays. From such comparisons, the user can determine the most efficient product and/or packaging designs for any given radiation field – whether for conceptual or existing products and packaging. PUFFIn is distributed in a complete, self-contained package of software, including the PENELOPE radiation transport code, a standard graphics package, and a set of simple exercises. The package is available to any user at no cost and requires a minimal amount of training compared to other similar software. PUFFIn's capabilities are described, as well as validation measurements performed at Texas A&M University E-beam facility and the Aerial E-beam Facility in France.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Data-Driven Method for Groundwater-Level Mapping and Monitoring-Well Network Optimization at Hanford

This report summarizes the initial results and outcomes of a physics-informed, data-driven groundwater level (GWL) mapping capability for the Hanford Site. GWL mapping at Hanford is typically conducted annually and requires a significant amount of computational and expert resources, and it does not allow assessment of the informational value of specific monitoring wells. The proposed method produces spatially and temporally resolved fields consistent with sparse, irregularly sampled, and nonuniformly distributed well measurements. Implemented successfully, this capability will allow rapid mapping of groundwater levels and provide an opportunity to optimize monitoring activities (both location and sampling frequency) based on data information value evaluation. The approach integrates a diffusion-based generative model – trained on MODFLOW simulation data from the Plateau-to-River (P2R) model – with score-based data assimilation (SDA), allowing observation-conditioned mapping without retraining for each monitoring-network layout.

54 ENVIRONMENTAL SCIENCES↗