Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Preventing Failures By Dataset Shift Detection in Safety-Critical Graph Applications

Dataset shift refers to the problem where the input data distribution may change over time (e.g., between training and test stages). Since this can be a critical bottleneck in several safety-critical applications such as healthcare, drug-discovery, etc., dataset shift detection has become an important research issue in machine learning. Though several existing efforts have focused on image/video data, applications with graph-structured data have not received sufficient attention. Therefore, in this paper, we investigate the problem of detecting shifts in graph structured data through the lens of statistical hypothesis testing. Specifically, we propose a practical two-sample test based approach for shift detection in large-scale graph structured data. Our approach is very flexible in that it is suitable for both undirected and directed graphs, and eliminates the need for equal sample sizes. Using empirical studies, we demonstrate the effectiveness of the proposed test in detecting dataset shifts. We also corroborate these findings using real-world datasets, characterized by directed graphs and a large number of nodes.

97 MATHEMATICS AND COMPUTING↗

Propagating Uncertainties in the SALT3 Model-training Process to Cosmological Constraints

Type Ia supernovae (SNe Ia) are standardizable candles that must be modeled empirically to yield cosmological constraints. To understand the robustness of this modeling to variations in the model-training procedure, we build an end-to-end pipeline to test the recently developed SALT3 model. We explore the consequences of removing pre-2000s low-z or poorly calibrated U-band data, adjusting the amount and fidelity of SN Ia spectra, and using a model-independent framework to simulate the training data. We find that the SALT3 model surfaces are improved by having additional spectra and U-band data, and can be shifted by ~5% if host-galaxy contamination is not sufficiently removed from SN spectra. We find that resulting measurements of w are consistent to within 2.5% for all of the training variants explored in this work, with the largest shifts coming from variants that add color-dependent calibration offsets or host-galaxy contamination to the training spectra and those that remove pre-2000s low-z data. These results demonstrate that the SALT3 model-training procedure is largely robust to reasonable variations in the training data, but that additional attention must be paid to the treatment of spectroscopic data in the training process. We also find that the training procedure is sensitive to the color distributions of the input data—the resulting w measurement can be biased by ~2% if the color distribution is not sufficiently wide. Future low-z data, particularly u-band observations and high signal-to-noise ratio SN Ia spectra, will help to significantly improve SN Ia modeling in the coming years.

79 ASTRONOMY AND ASTROPHYSICS↗

Landsat-D thematic mapper simulation in an urban area using aircraft multispectral scanner data

A simulation of imagery from the Landsat-D thematic mapper was conducted in order to determine its usefulness for urban land-use classification. Aircraft 24-channel multispectral scanner imagery of the Los Angeles area at 7.5-m resolution was processed digitally by means of matrix averaging and image smoothing techniques to simulate the 30-m resolution of the thematic mapper. Mean and standard deviation statistics of training sites for resolutions of 7.5, 15, 30 and 60 m were used to generate final classification maps. Plots of relative standard deviation showed that for larger training sites, as the resolution decreased, the distribution range of density values also decreased, while plots of relative classification accuracies showed that as resolution decreased, classification accuracies for three levels of standard deviation increased. A point of diminishing returns was indicated, however, confirming the utility of the resolution intended for Landsat-D.

Clark, J.↗

Investigations on the downwash behind a tapered wing with fuselage and propeller

The new downwash measurements behind a tapered wing with parallel center section described in the present report can be brought into good agreement with theoretical calculations if made on the basis of not-rolled-up vortex sheet and allowance is made for the lowering of the sheet. The test values are about 1 degree higher than the "upper limit" established for it, as against approximately 0.5 degrees in the earlier tests behind a rectangular and elliptical wing. The measurements on lateral axes, especially if lying below the wing on a level with the vortex train, disclosed in accord with the lift distribution, a marked change in angle over the span of the tail in contrast to the rectangular and elliptical wing.

Muttray, H↗

NASA A-Train and Terra Observations of the 2010 Russian Wildfires

Wildfires raged throughout western Russia and parts of Eastern Europe during a persistent heat wave in the summer of 2010. Anomalously high surface temperatures (35 - 41 C) and low relative humidity (9 - 25 %) from mid- June to mid-August 2010 shown by analysis of radiosonde data from multiple sites in western Russia were ideal conditions for the wildfires to thrive. Measurements of outgoing longwave radiation (OLR) from the Atmospheric Infrared Sounder (AIRS) over western Russian indicate persistent subsidence during the heat wave. Daily three-day back-trajectories initiated over Moscow reveal a persistent anticyclonic circulation for 18 days in August, coincident with the most intense period of fire activity observed by Moderate Resolution Imaging Spectroradiometer (MODIS). This unfortunate meteorological coincidence allowed transport of polluted air from the region of intense fires to Moscow and the surrounding area. We demonstrate that the 2010 Russian wildfires are unique in the record of observations obtained by remote-sensing instruments on-board NASA satellites: Aura and Aqua (part of the A-Train Constellation) and Terra. Analysis of the distribution of MODIS fire products and aerosol optical thickness (AOT), UV aerosol index (AI) and single-scattering albedo (SSA) from Aura's Ozone Monitoring Instrument (OMI), and total column carbon monoxide (CO) from Aqua s Atmospheric Infrared Sounder (AIRS) show that the region in the center of western Russia surrounding Moscow (52-58 deg N, 33 -43 deg E) is most severely impacted by wildfire emissions. Over this area, AIRS CO, OMI AI, and MODIS AOT are significantly enhanced relative to the historical satellite record during the first 18 days in August when the anti-cyclonic circulation persisted. By mid-August, the anti-cyclonic circulation was replaced with westerly transport over Moscow and vicinity. The heat wave

Witte, J. C.↗

A Risk-Informed Approach to Trustworthiness Assessment in Digital Twins-Based Autonomous Control

In autonomous control systems, digital twins (DTs) are used to perform diagnostic and prognostic functions. The trustworthiness of these DTs is dependent on quality and coverage of the training data, model accuracy and integrity of sensor data. This work introduces a methodology to determine the trustworthiness of a DT system given faulty sensor data using a risk informed approach. Bayesian Belief Networks (BBNs) are used to propagate uncertainties and determine the probability of trustable recommendations. The decision to trust the control action provided by the DT is based on the DT output, expert opinion, and severity of problems. The performance of DTs is reliant on the data they are trained on. When they encounter out of distribution data, the trustworthiness of the recommendations decreases. To address this issue, we include an expert component that provides input on sensor degradation. For this, we utilize a generative artificial intelligence (AI) model, such as Generative Pretrained Transformer (GPT). The GPT functions as an expert with broad knowledge. The GPT is fine-tuned to understand and discriminate sensor degradation scenarios using manufactured data. This methodology is demonstrated through a case study on a Nearly Autonomous Management and Control System (NAMAC) during a steady state scenario. Various sensor degradation types with different severity levels are considered. Degraded sensor data is processed by the DT system and the fine-tuned GPT. Finally, using the BBN, we combine the GPT information and the DT output with its sources of uncertainty. This provides an output regarding the trustworthiness of the DT recommendation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Search for top-quark production via flavor-changing neutral currents in W+1 jet events at CDF

We report on the first search for top-quark production via flavor-changing neutral-current (FCNC) interactions in the non-standard-model process u(c)+g {yields} t using p{bar p} collision data collected by the CDF II detector. The data set corresponds to an integrated luminosity of 2.2 fb{sup -1}. The candidate events feature the signature of semileptonic top-quark decays and are classified as signal-like or background-like by an artificial neural network trained on simulated events. The observed discriminant distribution is in good agreement with the one predicted by the standard model and provides no evidence for FCNC top-quark production, resulting in a Bayesian upper limit on the production cross section {sigma}(u(c)+g {yields} t) < 1.8 pb at the 95% confidence level. Using theoretical predictions we convert the cross-section limit to upper limits on FCNC branching ratios: {Beta}(t {yields} u + g) < 3.9 x 10{sup -4} and {Beta}(t {yields} c + g) < 5.7 x 10{sup -3}.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Investigation of Beam Loading Effects for the Neutrino Factory Muon Accelerator

The International design study (IDS) study showed that a Neutrino Factory [1] seems to be the most promising candidate for the next phase of high precision neutrino oscillation experiments. One part of the increased precision is due to the fact that in a Neutrino Factory the decay of muons produces a neutrino beam with narrow energy distribution and divergence. The effect of beam loading on the energy distribution of the muon beam in the Neutrino Factory decay rings has been investigated numerically. The simulations have been performed using the baseline accelerator design including cavities for different number of bunch trains and bunch train timing. A detailed analysis of the beam energy distribution expected is given together with a discussion of the energy spread produced by the gutter acceleration in the FFAG and the implications for the neutrino oscillation experiments will be presented.

43 PARTICLE ACCELERATORS↗

An expert system for a distributed real-time trainer

The problem addressed by this expert system concerns the expansion of capability of a Real Time Trainer for the Spacelab flight crew. As requirements for more models or fidelity are placed upon the system, expansion is necessary. The simulator can be expanded using a larger processor or by going to a distributed system and expand by adding additional processors. The distributed system is preferable because it is more economical and can be expanded in a more incremental manner. An expert system was developed to evaluate modeling and timing capability within a real time training simulator. The expert system is based upon a distributed configuration. Components of the modeled system are control tasks, network tasks, emulator tasks, processors, displays, and a network. The distributed module expert system (DMES) allows the configuring of processors, tasks, display use, keyboard use, and selection of alternate methods to update the data buffer. Modules can be defined with execution occurring in a specific processor on a network. The system consists of a knowledge front end editor to interactively generate or update the knowledge base, an inference engine, a display module, and a recording module.

Purinton, Steven C.↗

Reinforcement Learning for Distribution Grid Optimization (PyCIGAR) v0.1

PyCIGAR is a python software package that merges off-the-shelf reinforcement learning libraries (RLLib and Ray) with electric power distribution system simulation tools (OpenDSS and a custom power flow solver built by LBL). PyCIGAR enables the training of neural networks to optimize the behavior of different components in the electric distribution grid, such as control systems in photovoltaic rooftop solar inverters and electric battery storage systems. The software package has been used to train neural networks to update settings in photovoltaic rooftop solar inverter control systems to mitigate cyber attacks on other solar photovoltaic rooftop devices.

Arnold, Daniel↗

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗

A Machine‐Learning‐Assisted Stochastic Cloud Population Model as a Parameterization of Cumulus Convection

Abstract A machine‐learning‐assisted stochastic cloud population model is coupled with the Advanced Research Weather Research and Forecasting (WRF) model to represent fluctuations in the cloud‐base mass flux associated with the life cycles and interactions among cumulus convection cells. In this cloud population model, the size distribution and the associated cloud‐base mass flux of the convective cells are related to their previous state and to the change in the total convective area via a transition function. The convective area tendency in turn is assumed to depend on the cloud‐base mass flux that is resolved by the host WRF model. The transition function is represented by a single hidden‐layer neural network trained by the evolution of convective cell size distributions in a 1‐km grid‐spacing WRF simulation run over the Australian Monsoon region. At every grid point of the host model, the cloud population model predicts the cell size and cloud‐base mass flux distributions from which a random sample of cells is fed to an entraining parcel model that calculates precipitation as well as the associated liquid water potential temperature and total moisture tendencies. These tendencies are averaged over the cells and provided to the host model. Several regional simulations are performed over tropical and midlatitude domains to test this as a potential approach to scale‐aware parameterization. It is shown that such an approach could be a new promising path to simulating realistic precipitation statistics and propagation of precipitation associated with the Madden‐Julian Oscillation while maintaining realistic depictions of the diurnal cycle over both land and ocean.

54 ENVIRONMENTAL SCIENCES↗

Temperature Field Reconstruction of Surfaces Heated Through Radiative Heat Transfer Using Convolutional Neural Networks

Microreactors could play a crucial role in decarbonizing our energy portfolio. However, their development and implementation come with specific challenges, particularly regarding cost. Due to their compact size and the harsh operational environment, collecting real-time data on reactor operation can be challenging. Many probe designs are unable to withstand extreme conditions (e.g., temperature, radiation) in the reactor. In this context, using convolutional neural networks (CNNs) can pave the way for developing a nonintrusive approach that relies solely on ex-core sensors. A well-trained physics-informed CNN can reconstruct the distribution of a given physical quantity over a domain using only a few sensors, allowing us to reconstruct the desired field distribution even in a limited space or complex geometries where a large array of sensors is impractical. In this work, we present the initial steps toward developing a real-time tool for monitoring the thermal behavior of nuclear reactor pressure vessels. Based on an experimental setup, a computational model using the Multiphysics Object-Oriented Simulation Environment (moose) framework was built, where the Ray Tracing and Heat Conduction modules were used to evaluate the temperature distribution over a convex metal surface heated through radiative heat transfer. This metal surface represents a section of a heated nuclear reactor vessel wall. The model also accounts for solid mechanics physics through the moose Solid Mechanics module. In situ experimental data, acquired from a Texas A&M facility, were used to validate the computational model. Part of the data generated by the moose model was used to train the convolutional neural network to reconstruct the vessel wall's outer surface temperature. The CNN generalization was then compared against the experimental and computational data.

Aldeia Machado, Luiz Carlos↗

Machine learning assisted bayesian inference of mix and hot-spot conditions in NIF implosions

Experiments on the National Ignition Facility (NIF) have provided clear evidence of ablator material mixing into the Hot-Spot, leading to degraded performance. However, inferring the amount of mix and Hot-Spot conditions from typical experimental observations (e.g. x-ray spectra and images) is highly challenging. Here, we have developed an analysis method that utilizes machine learning assisted Bayesian inference to find the probability distributions of the Hot-Spot and mix conditions. This approach uses a neural network, trained on an idealized 2-dimensional representation of the Hot-Spot and mix distribution, and Bayesian inference to find the statistical distributions of Hot-Spot conditions that provide a match with observations. We have tested this method with synthetic data from simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Transferable predictions of energetic and structural properties for refractory solid solution alloys across chemical compositions

We present a data-efficient approach to train graph neural networks (GNNs) on density functional theory (DFT) data for accurate and transferable predictions of energetic and structural properties of refractory solid solution alloys in the niobium-tantalum-vanadium (Nb-Ta-V) chemical space. We start by training the GNN model only on DFT data that describes refractory binary alloys niobium-tantalum (Nb-Ta), niobium-vanadium (Nb-V), and tantalum-vanadium (Ta-V) to predict formation enthalpy and root mean squared displacement. Once trained, the GNN predictions are tested on DFT data describing refractory ternary alloys Nb-Ta-V. While, unsurprisingly, direct transferability from binary to ternary is not sufficiently accurate, augmenting the training with only 1% of the available ternary data (uniformly distributed across the entire range of chemical compositions) improves significantly the quality of the GNN predictions. For comparison, we assess the transferability in the opposite direction by training GNN models on ternary Nb-Ta-V data and making predictions on binaries Nb-Ta, Nb-V, and Ta-V, which exhibits notably higher predictive errors. The proposed methodology, which favors transferability from lower-component to higher-component alloys, offers an efficient path towards avoiding the curse of dimensionality incurred when collecting DFT data for discovery and design of multi-component disordered alloys.

Density functional theory calculations↗

Exploring the energy landscape of RBMs: reciprocal space insights into bosons, hierarchical learning and symmetry breaking

Deep generative models have become ubiquitous due to their ability to learn and sample from complex distributions. Despite the proliferation of various frameworks, the relationships among these models remain largely unexplored, a gap that hinders the development of a unified theory of AI learning. In this work, we address two central challenges: clarifying the connections between different deep generative models and deepening our understanding of their learning mechanisms. We focus on Restricted Boltzmann Machines (RBMs), a class of generative models known for their universal approximation capabilities for discrete distributions. By introducing a reciprocal space formulation for RBMs, we reveal a connection between these models, diffusion processes, and systems of coupled bosons. Our analysis shows that at initialization, the RBM operates at a saddle point, where the local curvature is determined by the singular values of the weight matrix, whose distribution follows the Marc̆enko-Pastur law and exhibits rotational symmetry. During training, this rotational symmetry is broken due to hierarchical learning, where different degrees of freedom progressively capture features at multiple levels of abstraction. This leads to a symmetry breaking in the energy landscape, reminiscent of Landau’s theory. This symmetry breaking in the energy landscape is characterized by the singular values and the weight matrix eigenvector matrix. We derive the corresponding free energy in a mean-field approximation. We show that in the limit of infinite size RBM, the reciprocal variables are Gaussian distributed. Our findings indicate that in this regime, there will be some modes for which the diffusion process will not converge to the Boltzmann distribution. To illustrate our results, we trained replicas of RBMs with different hidden layer sizes using the MNIST dataset. Our findings not only bridge the gap between disparate generative frameworks but also shed light on the fundamental processes underpinning learning in deep generative models.

97 MATHEMATICS AND COMPUTING↗

MO-E-18C-02: Hands-On Monte Carlo Project Assignment as a Method to Teach Radiation Physics

Purpose: To present a hands-on project on Monte Carlo methods (MC) recently added to the curriculum and to discuss the students' appreciation. Methods: Since 2012, a 1.5 hour lecture dedicated to MC fundamentals follows the detailed presentation of photon and electron interactions. Students also program all sampling steps (interaction length and type, scattering angle, energy deposit) of a MC photon transport code. A handout structured in a step-by-step fashion guides student in conducting consistency checks. For extra points, students can code a fully working MC simulation, that simulates a dose distribution for 50 keV photons. A kerma approximation to dose deposition is assumed. A survey was conducted to which 10 out of the 14 attending students responded. It compared MC knowledge prior to and after the project, questioned the usefulness of radiation physics teaching through MC and surveyed possible project improvements. Results: According to the survey, 76% of students had no or a basic knowledge of MC methods before the class and 65% estimate to have a good to very good understanding of MC methods after attending the class. 80% of students feel that the MC project helped them significantly to understand simulations of dose distributions. On average, students dedicated 12.5 hours to the project and appreciated the balance between hand-holding and questions/implications. Conclusion: A lecture on MC methods with a hands-on MC programming project requiring about 14 hours was added to the graduate study curriculum since 2012. MC methods produce “gold standard” dose distributions and slowly enter routine clinical work and a fundamental understanding of MC methods should be a requirement for future students. Overall, the lecture and project helped students relate crosssections to dose depositions and presented numerical sampling methods behind the simulation of these dose distributions. Research funding from governments of Canada and Quebec. PP acknowledges partial support by the CREATE Medical Physics Research Training Network grant of the Natural Sciences and Engineering Research Council (Grant number: 432290)

07 ISOTOPE AND RADIATION SOURCES↗

Human Factors in Training - Space Flight Resource Management Training

Accidents and incidents show that high workload-induced stress and poor teamwork skills lead to performance decrements and errors. Research on teamwork shows that effective teams are able to adapt to stressful situations, and to reduce workload by using successful strategies for communication and decision making, and through dynamic redistribution of tasks among team members. Furthermore, superior teams are able to recognize signs and symptoms of workload-induced stress early, and to adapt their coordination and communication strategies to the high workload, or stress conditions. Mission Control Center (MCC) teams often face demanding situations in which they must operate as an effective team to solve problems with crew and vehicle during onorbit operations. To be successful as a team, flight controllers (FCers) must learn effective teamwork strategies. Such strategies are the focus of Space Flight Resource Management (SFRM) training. SFRM training in MOD has been structured to include some classroom presentations of basic concepts and case studies, with the assumption that skill development happens in mission simulation. Integrated mission simulations do provide excellent opportunities for FCers to practice teamwork, but also require extensive technical knowledge of vehicle systems, mission operations, and crew actions. Such technical knowledge requires lengthy training. When SFRM training is relegated to integrated simulations, FCers can only practice SFRM after they have already mastered the technical knowledge necessary for these simulations. Given the centrality of teamwork to the success of MCC, holding SFRM training till late in the flow is inefficient. But to be able to train SFRM earlier in the flow, the training cannot rely on extensive mission-specific technical knowledge. Hence, the need for a generic SFRM training framework that would allow FCers to develop basic teamwork skills which are mission relevant, but without the required mission knowledge. Work on SFRM training has been conducted in collaboration with the Expedition Vehicle Division at the Mission Operations Directorate (MOD) and with United Space Alliance (USA) which provides training to Flight Controllers. The space flight resource management training work is part of the Human Factors in Training Directed Research Project (DRP) of the Space Human Factors Engineering (SHFE) Project under the Space Human Factors and Habitability (SHFH) Element of the Human Research Program (HRP). Human factors researchers at the Ames Research Center have been investigating team work and distributed decision making processes to develop a generic SFRM training framework for flight controllers. The work proposed for FY10 continues to build on this strong collaboration with MOD and the USA Training Group as well as previous research in relevant domains such as aviation. In FY10, the work focuses on documenting and analyzing problem solving strategies and decision making processes used in MCC by experienced FCers.

Bryne, Vicky↗