Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

In-Place Zero-Space Memory Protection for CNN

Convolutional Neural Networks (CNN) are being actively explored for safetycritical applications such as autonomous vehicles and aerospace, where it is essential to ensure the reliability of inference results in the presence of possible memory faults. Traditional methods such as error correction codes (ECC) and Triple Modular Redundancy (TMR) are CNN-oblivious and incur substantial memory overhead and energy cost. This paper introduces in-place zero-space ECC assisted with a new training scheme weight distribution-oriented training. The new method provides the first known zero space cost memory protection for CNNs without compromising the reliability offered by traditional ECC.

Guan, Hui↗

Differential-phase-shift quantum key distribution with segmented pulse trains

We present a modified scheme of differential-phase-shift (DPS) quantum key distribution (QKD) for improving its performance. A transmitter sends a weak coherent pulse train segmented with vacant pulses. Then, a receiver can find eavesdropping by monitoring the photon detection rate at particular time slots. Simulations show that the proposed scheme is robust against a sequential attack and a general individual attack.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cybersecurity Workforce Training for SMR Integration into Distribution Grids: A Competency Framework and Containerized Hands-On Lab for the SMR/DER/Microgrid Boundary

Small modular reactors (SMRs) and microreactors are entering the U.S. distribution grid as synchronous generation on feeders designed for loads and inverter-based distributed energy resources (DERs). No existing cybersecurity training program addresses this intersection of nuclear operations, DER management, and operational technology security. As subcontractor to Iowa State University on the CyDERMS Center, Argonne analyzed the relevant standards and training landscape, translated the resulting gaps into a twelve-objective competency framework across distribution-operator and graduate-analyst role tracks, and built a containerized training lab using a ∼400-bus composite grid model behind a realistically simulated Modbus TCP SCADA stack. The analysis isolates the balance-of-plant / energy-management-system (BOP/EMS) boundary as the critical jurisdictional seam where, as of March 2026, neither NRC nor NERC CIP cleanly claims cybersecurity responsibility for distribution-connected SMRs. The framework maps each objective across NIST CSF 2.0, ISA/IEC 62443, NIST NICE Task–Knowledge–Skill statements, and NRC RG 5.71 awareness-and-training controls. The training lab implements operator-recognition assessment scenarios spanning grid-side disturbances and telemetry-layer anomalies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reducing Communication in Graph Neural Network Training

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus higher communication costs compared to dense matrices, making GNNs harder to scale to high concurrencies than convolutional or fully-connected neural networks. Here, we introduce a family of parallel algorithms for training GNNs and show that they can asymptotically reduce communication compared to previous parallel GNN training methods. We implement these algorithms, which are based on 1D, 1. 5D, 2D, and 3D sparse-dense matrix multiplication, using torch.distributed on GPU-equipped clusters. Our algorithms optimize communication across the full GNN training pipeline. We train GNNs on over a hundred GPUs on multiple datasets, including a protein network with over a billion edges.

97 MATHEMATICS AND COMPUTING↗

DDStore: Distributed Data Store for Scalable Training of Graph Neural Networks on Large Atomistic Modeling Datasets

Graph neural networks (GNNs) are a class of Deep Learning models used in designing atomistic materials for effective screening of large chemical spaces. To ensure robust prediction, GNN models must be trained on large volumes of atomistic data on leadership class supercomputers. Even with the advent of modern architectures that consist of multiple storage layers that include node-local NVMe devices in addition to device memory for caching large datasets, extreme-scale model training faces I/O challenges at scale.We present DDStore, an in-memory distributed data store designed for GNN training on large-scale graph data. DDStore provides a hierarchical, distributed, data caching technique that combines data chunking, replication, low-latency random access, and high throughput communication. DDStore achieves near-linear scaling for training a GNN model using up to 1000 GPUs on the Summit and Perlmutter supercomputers, and reaches up to a 6.15x reduction in GNN training time compared to state-of-the-art methodologies.

Choi, Jong Youl↗

Fair Concurrent Training of Multiple Models in Federated Learning

Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be trained simultaneously, sharing clients’ computing resources, which we call Multiple-Model Federated Learning (MMFL). Current MMFL algorithms use naïve average-based client-task allocation schemes that often lead to unfair performance when FL tasks have heterogeneous difficulty levels, as the more difficult tasks may need more client participation to train effectively. Furthermore, in the MMFL setting, we face a further challenge that some clients may prefer training specific tasks to others, and may not even be willing to train other tasks, e.g., due to high computational costs, which may exacerbate unfairness in training outcomes across tasks. We address both challenges by firstly designing FedFairMMFL, a difficulty-aware algorithm that dynamically allocates clients to tasks in each training round, based on the tasks’ current performance levels. We provide guarantees on the resulting task fairness and FedFairMMFL’s convergence rate. We then propose novel auction designs that incentivizes clients to train multiple tasks, so as to fairly distribute clients’ training efforts across the tasks, and extend our convergence guarantees to this setting. Here, we finally evaluate our algorithm with multiple sets of learning tasks on real world datasets, showing that our algorithm improves fairness by improving the final model accuracy and convergence speed of the worst performing tasks, while maintaining the average accuracy across tasks.

Federated learning↗

A linear merging methodology for high-resolution precipitation products using spatiotemporal regression

Currently, the only viable option for a global precipitation product is the merger of several precipitation products from different modalities. In this article, we develop a linear merging methodology based on spatiotemporal regression. Four highresolution precipitation products (HRPPs), obtained through methods including the Climate Prediction Center's Morphing (CMORPH), Geostationary Operational Environmental Satellite-Based Auto-Estimator (GOES-AE), GOES-Based Hydro-Estimator (GOES-HE) and Self-Calibrating Multivariate Precipitation Retrieval (SCAMPR) algorithms, are used in this study. The merged data are evaluated against the Arkansas Red Basin River Forecast Center's (ABRFC's) ground-based rainfall product. The evaluation is performed using the Heidke skill score (HSS) for four seasons, from summer 2007 to spring 2008, and for two different rainfall detection thresholds. It is shown that the merged data outperform all the other products in seven out of eight cases. A key innovation of this machine learning method is that only 6% of the validation data are used for the initial training. The sensitivity of the algorithm to location, distribution of training data, selection of input data sets and seasons is also analysed and presented.

Turlapaty, Anish C↗

A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks

We consider the power allocation problem over shared spectrum for millimeter-Wave (mmWave) cellular downlink. Existing approaches usually find sub-optimal solutions by solving a non-convex optimization which leads to scalability issues due to centralized control. Therefore, distributed and adaptive approaches are desirable. Recently, model-free Deep Reinforcement Learning (DRL) has achieved success in such wireless resource management tasks. By modeling the radio environment as a Markov Decision Process (MDP) with the base stations (BSs) being the agents, power allocation can be automated at the agent level with comparable throughput performance to conventional centralized schemes. The multi-agent setting presents new challenges as the radio environment is impacted by the joint actions of the agents and is no longer stationary from any individual agent’s perspective. Existing literature bypasses this non-stationarity violation by ignoring it which may cause performance degradation. To tackle this issue, we propose a distributed continuous power allocation scheme based on a modified version of multi-agent Deep Deterministic Policy Gradient (MADDPG) that is tailored for the distributed multiple-agent setting. The proposed scheme employs a centralized-training distributed-execution framework where Q-functions are trained over subsets of BSs while each BS determines its transmit power based only on its own local observation. It admits constant per-BS communication and computation complexity and is thus scalable to large networks. Numerical evaluation shows that the proposed scheme adapts well to a wide range of interference conditions and can achieve comparable or better performance than several state-of-the-art non-learning approaches.

99 GENERAL AND MISCELLANEOUS↗

JELC-LITE: Unconventional Instructional Design for Special Operations Training

Current special operations staff training is based on the Joint Event Life Cycle (JELC). It addresses operational level tasks in multi-week, live military exercises which are planned over a 12 to 18 month timeframe. As the military experiences changing global mission sets, shorter training events using distributed technologies will increasingly be needed to augment traditional training. JELC-Lite is a new approach for providing relevant training between large scale exercises. This new streamlined, responsive training model uses distributed and virtualized training technologies to establish simulated scenarios. It keeps proficiency levels closer to optimal levels -- thereby reducing the performance degradation inherent in periodic training. It can be delivered to military as well as under-reached interagency groups to facilitate agile, repetitive training events. JELC-Lite is described by four phases paralleling the JELC, differing mostly in scope and scale. It has been successfully used with a Theater Special Operations Command and fits well within the current environment of reduced personnel and financial resources.

Friedman, Mark↗

X-57 Electromagnetic Interference Design, Integration, and Test Consideration

X-57 is NASA’s first all electric aircraft that utilizes existing airframe of Tecnam 2006P GA aircraft integrated with new all electric power train. The objective of the project was to deliver high performing distributed electric propulsion system while developing US industry in the area of EAP. The project was divided into three distinct flight mods, each serving as a risk reduction efforts to final mod where full distributed power train with highly modified wing structure would be tested in flight. Flight weight, efficient power electronics are enablers for distributed, electric aircraft propulsion systems, and GRC team has developed high power and highly efficient SiC based converters for both cruise and high lift systems on the aircraft. Both controller’s development efforts demonstrate a means to achieve an in-the-nacelle controller with purely passive cooling while maintaining high efficiency. This paper describes the lessons learned on design, integration, and testing challenges that X-57 faced while developing these novel technologies.

Power Train↗

Estimating luminosities and stellar masses of galaxies photometrically without determining redshifts

Large direct imaging surveys usually use a template-fitting technique to estimate photometric redshifts for galaxies, which are then applied to derive important galaxy properties such as luminosities and stellar masses. These estimates can be noisy and suffer from systematic biases because of the possible mis-selection of templates and the propagation of the photometric redshift uncertainty. We introduce an algorithm, the Direct Empirical Photometric method (DEmP), that can be used to directly estimate these quantities using training sets, bypassing photometric redshift determination. DEmP also applies two techniques to minimize the effects arising from the non-uniform distribution of training set galaxy redshifts from a flux-limited sample. First, for each input galaxy, fitting is performed using a subset of the training set galaxies with photometry and colors closest to those of the input galaxy. Second, the training set is artificially resampled to produce a flat distribution in redshift or other properties, e.g., luminosity. To test the performance of DEmP, we use a four filter-band mock catalog to examine its ability to recover redshift, luminosity, stellar mass, and luminosity and stellar mass functions. We also compare the results to those from two publicly available template-fitting methods, finding that the DEmP algorithm outperforms both. We find that resampling the training set to have a uniform redshift distribution produces the best results not only in photometric redshift, but also in estimating luminosity and stellar mass. The DEmP method is especially powerful in estimating quantities such as near-IR luminosities and stellar mass using only data from a small number of optical bands.

79 ASTRONOMY AND ASTROPHYSICS↗

An Examination of Diameter Density Prediction with k-NN and Airborne Lidar

While lidar-based forest inventory methods have been widely demonstrated, performances of methods to predict tree diameters with airborne lidar (lidar) are not well understood. One cause for this is that the performance metrics typically used in studies for prediction of diameters can be difficult to interpret, and may not support comparative inferences between sampling designs and study areas. To help with this problem we propose two indices and use them to evaluate a variety of lidar and k nearest neighbor (k-NN) strategies for prediction of tree diameter distributions. The indices are based on the coefficient of determination ( R 2 ), and root mean square deviation (RMSD). Both of the indices are highly interpretable, and the RMSD-based index facilitates comparisons with alternative (non-lidar) inventory strategies, and with projects in other regions. K-NN diameter distribution prediction strategies were examined using auxiliary lidar for 190 training plots distribute across the 800 km 2 Savannah River Site in South Carolina, USA. In conclusion, we evaluate the performance of k-NN with respect to distance metrics, number of neighbors, predictor sets, and response sets. K-NN and lidar explained 80% of variability in diameters, and Mahalanobis distance with k = 3 neighbors performed best according to a number of criteria.

60 APPLIED LIFE SCIENCES↗

Hierarchical Inference with Bayesian Neural Networks: An Application to Strong Gravitational Lensing

In the past few years, approximate Bayesian Neural Networks (BNNs) have demonstrated the ability to produce statistically consistent posteriors on a wide range of inference problems at unprecedented speed and scale. However, any disconnect between training sets and the distribution of real-world objects can introduce bias when BNNs are applied to data. This is a common challenge in astrophysics and cosmology, where the unknown distribution of objects in our universe is often the science goal. In this work, we incorporate BNNs with flexible posterior parameterizations into a hierarchical inference framework that allows for the reconstruction of population hyperparameters and removes the bias introduced by the training distribution. We focus on the challenge of producing posterior PDFs for strong gravitational lens mass model parameters given Hubble Space Telescope–quality single-filter, lens-subtracted, synthetic imaging data. We show that the posterior PDFs are sufficiently accurate (statistically consistent with the truth) across a wide variety of power-law elliptical lens mass distributions. We then apply our approach to test data sets whose lens parameters are drawn from distributions that are drastically different from the training set. We show that our hierarchical inference framework mitigates the bias introduced by an unrepresentative training set's interim prior. Simultaneously, we can precisely reconstruct the population hyperparameters governing our test distributions. Our full pipeline, from training to hierarchical inference on thousands of lenses, can be run in a day. The framework presented here will allow us to efficiently exploit the full constraining power of future ground- and space-based surveys (https://github.com/swagnercarena/ovejero).

79 ASTRONOMY AND ASTROPHYSICS↗

Improving Enzyme Optimum Temperature Prediction with Resampling Strategies and Ensemble Learning

Accurate prediction of the optimal catalytic temperature ( T opt ) of enzymes is vital in biotechnology, as enzymes with high T opt values are desired for enhanced reaction rates. Recently, a machine learning method (temperature optima for microorganisms and enzymes, TOME) for predicting T opt was developed. TOME was trained on a normally distributed data set with a median T opt of 37 °C and less than 5% of T opt values above 85 °C, limiting the method’s predictive capabilities for thermostable enzymes. Due to the distribution of the training data, the mean squared error on T opt values greater than 85 °C is nearly an order of magnitude higher than the error on values between 30 and 50 °C. Here, we apply ensemble learning and resampling strategies that tackle the data imbalance to significantly decrease the error on high T opt values (>85 °C) by 60% and increase the overall R 2 value from 0.527 to 0.632. The revised method, temperature optima for enzymes with resampling (TOMER), and the resampling strategies applied in this work are freely available to other researchers as Python packages on GitHub.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Distributed Stochastic Optimization of a Neural Representation Network for Time-Space Tomography Reconstruction

4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an important inverse problem in non-destructive evaluation. Conventional back-projection based reconstruction methods assume that the object remains static for the duration of several tens or hundreds of X-ray projection measurement images (reconstruction of consecutive limited-angle CT scans). However, this is an unrealistic assumption for many in-situ experiments that causes spurious artifacts and inaccurate morphological reconstructions of the object. To solve this problem, we propose to perform a 4D time-space reconstruction using a distributed implicit neural representation (DINR) network that is trained using a novel distributed stochastic training algorithm. Our DINR network learns to reconstruct the object at its output by iterative optimization of its network parameters such that the measured projection images best match the output of the CT forward measurement model. Here, we use a forward measurement model that is a function of the DINR outputs at a sparsely sampled set of continuous valued 4D object coordinates. Unlike previous neural representation architectures that forward and back propagate through dense voxel grids that sample the object's entire time-space coordinates, we only propagate through the DINR at a small subset of object coordinates in each iteration resulting in an order-of-magnitude reduction in memory and compute for training. DINR leverages distributed computation across several compute nodes and GPUs to produce high-fidelity 4D time-space reconstructions. We use both simulated parallel-beam and experimental cone-beam X-ray CT datasets to demonstrate the superior performance of our approach.

36 MATERIALS SCIENCE↗

Probability of Pinching Failure in PWR SNF after Long-Term Storage

A probabilistic assessment was performed on pinching failure of PWR SNF rod cladding under accidental SNF cask transport conditions. a set of 3,000 rod pinching scenarios was analyzed, with different geometrical, material, and loading parameters, using a Latin Hypercube Sampling (LHS). The investigated accidents include train derailments leading to cask collisions or cask drops. Pinching failure was related to cladding offset strain, defined as the plastic deformation interval in radial cladding direction normalized with respect to the outer cladding diameter. Finite element (FE) models were used to compute SNF rod deformations and the offset strain demand OSD in each of the assessed pinching scenarios. The numerical models account for the contribution of the degraded fuel pellets to rod pinching stiffness. The offset strain capacity OSC was computed using regression and interpolation models based on ring compression (RCT) test results, and account for hydride-related effects on cladding ductility. The results show a low probability of pinching failure. Hydride-related cladding embrittlement affects the structural integrity of PWR SNF rods after long-term dry storage of up to 300 years. Radial hydride patterns or large amounts of circumferentially oriented hydrides reduce the cladding ductile deformation capability when pinched at low material temperatures. The probability of hydride-related pinching failure of PWR cladding is estimated after long-term dry storage to address: How do PWR SNF rod conditions like hydrogen content, vacuum drying peak cladding hoop stress σ{sub θ}, and cladding material temperature affect cladding ductility? Is hydride-related cladding embrittlement a material degradation mechanism that affects the structural integrity of PWR SNF rods under pinching loading? What are the controlling parameters for deformation demands in PWR SNF rods under pinching loading? Is the pinching load amplitude an important parameter that controls the probability of pinching failure? How do parameters like pellet-cladding gap or fuel pellet degradation affect the pinching loading capacity of PWR SNF rods? Statistical modelling of PWR SNF rod conditions in U.S. inventory: A pseudo rod database was generated based on EIA database. Analysis of train accident scenarios: a probability density function (pdf) of a pinching load distribution P{sub 9m} of a 9-m cask drop is linearly scaled to generate a more representative: distribution P{sub AS}. The new distribution considers train collision velocities, cask drops for on- and off-bridge accidents, and cask impact orientation. LHS generates 3,000 rod pinching scenarios based on nine independent geometrical, material, and loading parameters. Probabilistic FE Analysis: The LHS realizations are used to generate 3,000 FE models. The FE analysis is conducted for P{sub 9m}, and P{sub AS}. The workflow is automatized. The OSC is computed with regression and interpolation models, as a function of the hydrogen content C{sub H}, vacuum drying peak σ{sub θ}, and SNF temperature T{sub FR}: The regression data was obtained in RCTs on PWR cladding. The OSD is derived from the cladding deformations in the FE models. Cladding failure was identified via a comparison of OSC and OSD. A 300 and a 30 years-of-dry-storage duration is investigated: The dry-storage period affects the expected SNF temperature and consequently, the OSC and the OSD. The material temperature LHS population is adapted to account for a SNF temperature variation. The probability of hydride-related, ductile cladding failure during a severe transportation accident is not significantly affected by the pinching load amplitude: The probability is slightly reduced from a range of less than 0.0333% to 0.1667% for P{sub 9m}, to a range of less than 0.0333% to 0.1333% for P{sub AS}, depending on the vacuum drying peak cladding hoop stress modelling assumptions. Further, the SNF dry-storage duration does not significantly affect the probability of ductile pinching failure. Based on available train accidents data, the pinching failure probability for a 5,000 km long transportation route ranges from less than 1.62 E-7 to a value of 6.47 E-7, depending on the vacuum drying peak cladding hoop stress modelling assumptions. The pinching load amplitude is not a controlling parameter for the probability of ductile cladding pinching failure, and does not control the cladding deformations once pellet-cladding contact is established, The pellet-cladding gap width, however, plays a key role. Fuel pellet degradation only affects the deformation capacity, if the pellet stiffness is significantly reduced (more than 90%). Only highly embrittled cladding is likely to fail. The deformation demands on the cladding under pinching loading are small.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗