Search NASA⌕ Search

SEARCH · Search NASA

Results for “Training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

GEONEX: Progressive Conditional Generative Adversarial Training Using Transfer learning

Obtaining accurate segmentation on large scale images is an open problem in deep learning. The main problem is the amount of labeled data that exists for large scale images. Traditionally, the common solution to this problem is to crop the large images into smaller images to increase the amount of available data and train a Conditional Generative Adversarial Network (CGAN). CGANs are currently the state of the art in image to image translation and provide better accuracy than the traditional method of training a encoder based conv-net architecture to minimize the loss at each pixel. This method can produce noisy and discontinuous images with inaccurate results. We seek to solve this problem by utilizing the concepts of transfer learning and progressive training to create a CGAN that can segment large scale images with a limited amount of labeled data. In transfer learning we recognize that many learned features are applicable to many classes from multiple domains. This introduces the concept of feature reusability, which is the basis for finetuning. Progressive training got its start in training models on the same images at different resolutions. In this work we instead train a GAN on increasing image scales by transferring the weights from the smaller scales to the larger scales. The learned features at the smaller scales are continually reused and applied to larger scales to create a CGAN that can perform accurate segmentation on large scale images. We apply this method to detect building footprints on very high-resolution overhead imagery (e.g Digital Globe and high resolution airborne platforms).

GEONEX↗
NASA NTRSDate not supplied

GL4U: Training the next generation of bioinformaticians, one omics datatype at a time

Spaceflight modifies gene expression in every organism examined to date, including humans. Understanding how these gene expression changes affect physiology is crucial for the development of countermeasures to enable long-duration manned missions. NASA’s GeneLab project provides researchers open access to multi-omics data, including genetic and gene expression data, from spaceflight experiments that can be mined to understand the effects of spaceflight on biological systems. To ensure new knowledge generation through data re-use, it is important to maximize the number of scientists who utilize GeneLab data. Training students on the GeneLab platform is the best way to create long-term adopters of this NASA database and its tools. Turning students into future instructors and advocates will also accelerate the dissemination of these data and tools to the broader scientific community. Therefore, in collaboration with the GeneLab Educational Working Group (EWG), GeneLab has created GeneLab for Colleges and Universities (GL4U). GL4U provides space biology-relevant training in bioinformatics to the next generation of scientists through direct and indirect approaches. The GeneLab team plans to host two annual data processing bootcamps, one for college-level students (direct) and one for college educators (indirect – training of trainers), in which participants learn to analyze GeneLab’s space-relevant omics data. During the bootcamp, educators will receive materials and training to enable them to run the bootcamp at their home institutions or alternatively to adapt the content to implement within existing courses, thereby extending the reach of this initiative. The GL4U direct training pilot program was conducted in June 2021 in collaboration with USRA and San Jose State University (SJSU). During the pilot, SJSU students participated in a week-long bootcamp consisting of space biology-specific lectures and hands-on instruction using Jupyter Notebooks to analyze RNA sequence data. This pilot demonstrates the capacity of GL4U for training young scientists and encouraging data re-use.

Jonathan Matthew Galazka↗
NASA NTRS2023

A Global Land Cover Training Dataset From 1984 to 2020

State-of-the-art cloud computing platforms such as Google Earth Engine (GEE) enable regional-to-global land cover and land cover change mapping with machine learning algorithms. However, collection of high-quality training data, which is necessary for accurate land cover mapping, remains costly and labor-intensive. To address this need, we created a global database of nearly 2 million training units spanning the period from 1984 to 2020 for seven primary and nine secondary land cover classes. Our training data collection approach leveraged GEE and machine learning algorithms to ensure data quality and biogeographic representation. We sampled the spectral-temporal feature space from Landsat imagery to efficiently allocate training data across global ecoregions and incorporated publicly available and collaborator-provided datasets to our database. To reflect the underlying regional class distribution and post-disturbance landscapes, we strategically augmented the database. We used a machine learning-based cross-validation procedure to remove potentially mis-labeled training units. Our training database is relevant for a wide array of studies such as land cover change, agriculture, forestry, hydrology, urban development, among many others.

Radost Stanimirova↗
DOE OSTI2025

GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism

Graph neural networks (GNNs), an emerging class of machine learning models for graphs, have gained popularity for their superior performance in various graph analytical tasks. Mini-batch training is commonly used to train GNNs on large graphs, and data parallelism is the standard approach to scale mini-batch training across multiple GPUs. Data parallel approaches contain redundant work as subgraphs sampled by different GPUs contain significant overlap. To address this issue, we introduce a hybrid parallel mini-batch training paradigm called Split parallelism. Split parallelism avoids redundant work by splitting the sampling, loading, and training of each mini-batch across multiple GPUs. Split parallelism, however, introduces communication overheads that can be more than the savings from removing redundant work. We further present a lightweight partitioning algorithm that probabilistically minimizes these overheads. We implement spllit parllelism in GSplit and show that it outperforms state-of-the-art mini-batch training systems like DGL, Quiver, and P3.

Lim, Seung-Hwan [ORNL] (ORCID:0000000194616866)↗
DOE OSTI2024

Grid-Ready Energy Analytics Training with Data (“GREAT with Data”)

GridEd is a collaborative educational initiative consisting of the Electric Power Research Institute (EPRI), 5 Partner Universities (Stony Brook University, The University of Texas at Austin, University of California – Riverside, Virginia Tech, Washington State University), and participating industry sponsors. This educational initiative focuses on developing and training the next generation of power engineers so they can help shape the electric grid of the future by anticipating and fulfilling the needs of changing electric industry requirements. GridEd is leveraging electric industry research to educate a future electric grid workforce by empowering new and continuing education students, not only to become competent and well-informed engineers, but also to participate and influence major technological, social, and policy decisions that address critical global challenges. GridEd’s activities are centered around four core pillars: Enhancement of university power systems engineering curricula; Professional development and training for a diverse electric industry workforce; Stimulating students to join the movement for the next generation of power engineers, and; Improve workforce development efforts in the electric utility industry. Major accomplishments over the course of the project were: Over 50 unique professional short courses were delivered by more than 30 instructors across the GridEd network; Over 3,600 unique learners, many who took multiple courses, received more than 27,000 professional development hours (PDH) and over 1,000 certificates of completion; Approximately 2,900 unique learners undertook a course that was offered LIVE online or in-person; Approximately 700 unique learners undertook a course that was offered as computer-based training (CBT); Over 35 unique university courses were delivered by more than 30 instructors to 1,500 university students across the GridEd network; One-hundred-and-fifty-seven (157) students were funded to completed 43 student projects in topics of power systems and data science, and; Six (6) Historically Black Colleges and Universities (HBCUs) recruited as Affiliate Universities via Utility Partners. The professional training initiative and workforce development activities launched by this project will be sustained through EPRI’s collaborative business model with industry. Stimulating students to join the power engineering workforce of the future and the enhancement of tertiary training may continue to need government support.

14 SOLAR ENERGY↗
NASA NTRS1995

Effect of training on blood volume and plasma hormone concentrations in the elderly

The purpose of this investigation was to determine the effects of 6 months of endurance training on resting plasma (PV) and blood volume (BV), and resting hormone and electrolyte concentrations in the elderly. Thirty-eight elderly men and women (ages 60-82 yr) were assigned to endurance exercise training (N = 29) or to control (N = 9) groups. Resting plasma levels of adrenocorticotropic hormone, vasopressin, aldosterone, norepinephrine, epinephrine, sodium, potassium, and protein were measured at the start (T1) and end (T2) of 26 wk of training. PV measurement was performed using the Evan's blue dye technique. Endurance training consisted of uphill treadmill walking or stairclimbing exercise 3 times.wk-1, 30-45 min.d-1, at 75-84% of maximal heart rate reserve. The exercise group increased VO2max by 11.2% (P < or = 0.05) and increased resting PV and BV by 11.2% and 12.7% (P < or = 0.05), respectively. Hormone and electrolyte levels in the exercise group remained unchanged; all variables were unchanged in the control group. These results are similar to findings in younger individuals. Because plasma hormone concentrations were maintained despite a chronically elevated BV, endurance training in healthy, elderly subjects may be associated with a resetting of volume receptors.

Clinical Trial↗
NASA NTRS1992

Effects of training on muscle O2 transport at VO2max

To quantify the relative contributions of convective and peripheral diffusive components of O2 transport to the increase in leg O2 uptake (VO2leg) at maximum O2 uptake (VO2max) after 9 wk of endurance training, 12 sedentary subjects (age 21.8 +/- 3.4 yr, VO2max 36.9 +/- 5.9 ml.min-1.kg-1) were studied. VO2max, leg blood flow (Qleg), and arterial and femoral venous PO2, and thus VO2leg, were measured while the subjects breathed room air, 15% O2, and 12% O2. The sequence of the three inspirates was balanced. After training, VO2max and VO2leg increased at each inspired O2 concentration [FIO2; mean over the 3 FIO2 values 25.2 +/- 17.8 and 36.5 +/- 33% (SD), respectively]. Before training, VO2leg and mean capillary PO2 were linearly related through the origin during hypoxia but not during room air breathing, suggesting that, at 21% O2, VO2max was not limited by O2 supply. After training, VO2leg and mean capillary PO2 at each FIO2 fell along a straight line with zero intercept, just as in athletes (Roca et al. J. Appl. Physiol. 67: 291-299, 1989). Calculated muscle O2 diffusing capacity (DO2) rose 34% while Qleg increased 19%. The relatively greater rise in DO2 increased the DO2/Qleg, which led to 9.9% greater O2 extraction. By numerical analysis, the increase in Qleg alone (constant DO2) would have raised VO2leg by 35 ml/min (mean), but that of DO2 (constant Qleg) would have increased VO2leg by 85 ml/min, more than twice as much. The sum of these individual effects (120 ml/min) was less (P = 0.013) than the observed rise of 164 ml/min (mean). This synergism (explained by the increase in DO2/Qleg) seems to be an important contribution to increases in VO2max with training.

NASA Discipline Musculoskeletal↗
NASA NTRS2016

Human Research Program: Long Duration, Exploration-Class Mission Training Design

This is a presentation to the International Training Control Board that oversees astronaut training for ISS. The presentation explains the structure of HRP, the training-related work happening under the different program elements, and discusses in detail the research plan for the Training Risk under SHFHSHFE. The group includes the crew training leads for all the space agencies involved in ISS: Japan, Europe, Russia, Canada, and the US.

crew training↗
NASA NTRSDate not supplied

Three-Dimensional Structure and Modeling of a Normal Bifurcated Shock Train from Experimental Measurements

An asymmetric, bifurcated normal shock train in a Mach 2 constant area, rectangular duct is investigated in the University of Michigan Direct Connect Isolator facility. High-speed schlieren imaging, wall static pressure measurements, surface oil flow visualization, and particle image velocimetry of a shock train are synthesized into a three-dimensional representation of shock train structure. This visualization is then used to inform the underlying flow physics of the distributed fluid dynamical processes along the structure. The detailed, three-dimensional morphology of the flow profile entering the shock train is shown to have a significant impact on the separated flow morphology of the shock train. This results in skewed supersonic core flow with alternating separation bubbles in the surrounding boundary layers. Finally, the efficacy of the prevailing pseudo-shock models in the literature is analyzed with the support of the available flow measurements. None are found to simultaneously model both the pressure and streamwise Mach number profile of the UMDCI pseudo-shock.

Hypersonics↗
NASA NTRSDate not supplied

Three-Dimensional Structure and Modeling of a Normal Bifurcated Shock Train from Experimental Measurements

An asymmetric, normal bifurcated shock train in a Mach 2 constant area, rectangular duct is investigated in the University of Michigan Direct Connect Isolator facility. High-speed schlieren imaging, wall static pressure measurements, surface oil flow visualization, and particle image velocimetry of the shock train are synthesized into a three-dimensional representation. This visualization is then used to inform the underlying flow physics of the distributed fluid dynamical processes along the shock train. The detailed, three-dimensional morphology of the flow profile entering the shock train is shown to have a significant impact on the separated flow morphology of the shock train. This results in a skewed supersonic core flow with alternating separation bubbles in the surrounding boundary layers. Finally, the efficacy of the prevailing pseudo-shock models in the literature is analyzed with the support of the available flow measurements. None are found to model both the pressure and streamwise Mach number profile of the UMDCI pseudo-shock. Note: This presentation is accompanied by the video presentation that can be downloaded for viewing and is formatted as an mp4 with a runtime of 10 min 15 secs.

Hypersonics↗
DOE OSTI2025

Biologically-informed excitatory and inhibitory ratio for robust spiking neural network training

Spiking neural networks drawing inspiration from biological constraints of the brain promise an energy-efficient paradigm for artificial intelligence. However, challenges exist in identifying guiding principles to train these networks in a robust fashion. In addition, training becomes an even more difficult problem when incorporating biological constraints of excitatory and inhibitory connections. In this work, we identify several key factors, such as low initial firing rates and diverse inhibitory spiking patterns, that determine the overall ability to train in the context of spiking networks with various ratios of excitatory to inhibitory neurons. The results indicate networks with biologically-realistic excitatory:inhibitory ratios can reliably train at low activity levels and in noisy environments. Additionally, the Van Rossum distance, a measure of spike train synchrony, provides insight into the importance of inhibitory neurons to increase network robustness to noise. This work supports further biologically-informed large-scale networks and energy efficient hardware implementations.

bio-inspired computing↗
DOE OSTI2024

Towards a High Fidelity Training Environment for Autonomous Cyber Defense Agents

Cyber defenders are overwhelmed by the frequency and scale of attacks against their networks. This problem will only be exacerbated as attackers leverage AI to automate their workflows. Autonomous cyber defense capabilities could aid defenders by automating operations and adapting dynamically to novel threats. However, existing training environments fall short in areas such as generalization, explainability, scalability, and transferability, making it intractable to train agents that will be effective in real networks. In this paper we take an important step towards creating autonomous cyber defense agents — we present a high fidelity training environment called Cyberwheel that includes both simulation and emulation capabilities. Cyberwheel simplifies customization of the training network and easily allows redefining the agent’s reward function, observation space, and action space to support rapid experimentation of novel approaches to agent design. It also provides visibility into agent behaviors necessary for agent evaluation and sufficient documentation / examples to lower the barrier to entry. As an example use case of Cyberwheel, we present initial results training an autonomous agent to deploy cyber deception strategies in simulation.

Oesch, T↗
DOE OSTI2025

ATTNChecker: Highly-Optimized Fault Tolerant Attention for Large Language Model Training

Large Language Models (LLMs) have demonstrated remarkable performance in various natural language processing tasks. However, the training of these models is computationally intensive and susceptible to faults, particularly in the attention mechanism, which is a critical component of transformer-based LLMs. In this paper, we investigate the impact of faults on LLM training, focusing on INF, NaN, and near-INF values in the computation results with systematic fault injection experiments. We observe the propagation patterns of these errors, which can trigger non-trainable states in the model and disrupt training, forcing the procedure to load from checkpoints. To mitigate the impact of these faults, we propose ATTNChecker, the first Algorithm-Based Fault Tolerance (ABFT) technique tailored for the attention mechanism in LLMs. ATTNChecker is designed based on fault propagation patterns of LLM and incorporates performance optimization to adapt to both system reliability and model vulnerability while providing lightweight protection for fast LLM training. Evaluations on four LLMs show that ATTNChecker on average incurs on average 7% overhead on training while detecting and correcting all extreme errors. Compared with the state-of-the-art checkpoint/restore approach, ATTNChecker reduces recovery overhead by up to 49×.

Liang, Yuhang [University of Alabama - Birmingham]↗
DOE OSTI2025

CAFE AU LAIT: Compute-Aware Federated Augmented Low-Rank AI Training

Federated finetuning is crucial for unlocking the knowledge embedded in pretrained Large Language Models (LLMs) when data are geographically distributed across clients. Unlike finetuning with data from a single institution, federated finetuning allows collaboration across multiple institutions, enabling the utilization of diverse and decentralized datasets while preserving data privacy. Given the high computing costs of LLM training and the emphasis on energy efficiency in Federated Learning (FL), Low-Rank Adaptation (LoRA) has emerged as a widely adopted algorithm due to its significantly reduced number of trainable parameters. However, this assumes that all data silos have the necessary computing resources to compute local updates of LLMs. Nevertheless, in practice, the computing resources across clients are highly heterogeneous: while some may have access to hundreds of GPUs, others might have limited or no GPU access. Recently, federated finetuning using synthetic data has been proposed, allowing clients to participate in a collaborative training run without training LLMs locally. However, our experimental results reveal a performance gap between models trained using synthetic data and those trained using local updates. Motivated by the observed heterogeneity in computing resources and the performance gap, we propose a novel two-stage algorithm that leverages the storage and computing capabilities of a strong server. In the first stage, under the coordination of the strong server, clients with limited computing resources collaborate to generate synthetic data, which is transferred to and stored on the strong server. In the second stage, the strong server uses this synthetic data on behalf of the resource-constrained clients to perform federated LoRA finetuning alongside clients with sufficient computing resources. This approach ensures that all clients can participate in the finetuning process. Experimental results demonstrate that incorporating local updates from even a small fraction of clients improves performance compared to using synthetic data for all clients. Furthermore, we incorporate the Gaussian mechanism in both stages to guarantee client-level differential privacy.

Wang, Jiayi [ORNL]↗
DOE OSTI2025

TorchBraid: High-Performance Layer-Parallel Training of Deep Neural Networks with MPI and GPU Acceleration

TorchBraid is a high-performance implementation of layer-parallel training for deep neural networks (DNNs) supporting MPI-based parallelism and GPU acceleration. Layer-parallel training has been developed to overcome the serialization inherent in forward and backward propagation of DNNs that limits utilization of computational resources in the strong scaling limit. To achieve this, TorchBraid integrates the PyTorch neural network framework with the state-of-the-art XBraid time-parallel library. Furthermore, this article presents the use and performance of TorchBraid, in addition to solutions for overcoming the algorithmic challenges inherent in combining automatic differentiation with layer-parallel. Results are presented with and without GPU acceleration for the Tiny ImageNet and MNIST image classification data sets, as well as recurrent neural networks. Overall, TorchBraid enables fast training of DNNs, both in a strong and weak scaling context. In addition to the TorchBraid software, several new advances in applying layer-parallel algorithms are detailed. Integration of layer-parallel with data-parallel algorithms is presented for the first time, showing the computational advantages of the combination. Standard deep learning techniques, like batch-normalization, are developed for layer-parallel training. Finally, a new approach combining layer-parallel with spatial coarsening in order to accelerate training for 3D image classification shows roughly a 10× speedup over serial execution.

Layer-parallel↗
DOE OSTI2024

Hyperparameter Studies for Vision Transformers Trained on High-Fidelity Simulations

This library is a collection of python modules that define, train, and analyze vision-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The training data for these models is hydrodynamic simulation output in the form of numpy arrays. This library contains code to train these ViT models on the hydrodynamic simulation output with a variety of hyperparameters, and to compare the results of such models. Furthermore, the library contains definitions of simple convolutional neural network (CNN) machine learning architectures which can be trained on the same hydrodynamic simulation output. These are included as a reference point to compare the ViT models to. Additionally, the library includes trained ViT and CNN models and example input data for demonstration purposes. The code is based on the PyTorch python library.

Callis, Skylar↗
DOE OSTI2025

Fiats: Functional inference and training for surrogates

Fiats provides a platform for research on the training and deployment of neural-network surrogate models for computational science. Fiats also supports exploring, advancing, and combining functional, object-oriented, and parallel programming patterns in Fortran 2023. As such, the Fiats name has dual expansions: “Functional Inference And Training for Surrogates” or “Fortran Inference And Training for Science.” Fiats inference and training procedures are pure and therefore satisfy a language constraint imposed on procedure invocations inside Fortran’s parallel loop construct: do concurrent. Furthermore, the Fiats training procedures are built around a do concurrent parallel reduction. Several compilers can automatically parallelize do concurrent on Central Processing Units (CPUs) or Graphics Processing Units (GPUs). Fiats thus aims to achieve performance portability through standard language mechanisms.

Rouson, Damian [Lawrence Berkeley National Laborat↗
DOE OSTI2024

EV Champion Training Webinar 1: ZEV and EV Charging Fundamentals [Slides]

The Electric Vehicle (EV) Champion Training Series, hosted by the National Renewable Energy Laboratory (NREL), is tailored for fleet managers, facility managers, and other stakeholders involved in the deployment of EVs and charging stations. This series equips participants with the skills and knowledge necessary to become subject matter experts in EV implementation. This is the first training in a four-part series and serves as an introductory training. This training covers fundamental topics such as EV and charging technology, utility basics, and financial considerations for EVs. Additionally, this session introduces the Federal Fleet ZEV Ready Center framework, a one-stop location for federal fleet electrification resources. Participants will gain a solid foundation to support the effective deployment and management of EVs and their infrastructure. Visit the Federal Fleet ZEV Ready Center website to learn more about the ZEV Ready Center process. EV Champion Training Webinar 1: ZEV and EV Charging Fundamentals will enable attendees to: Identify EV and EV charging technology fundamentals; Recognize EV market and GSA Schedule options; Identify utility basics, incentives, and rates as they relate to EV charging; and Identify methods to calculate life cycle costs for EVs and gasoline vehicles.

30 DIRECT ENERGY CONVERSION↗