Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

TPSAS-NF1676L-14454-DND

FUN3D Core Capabilities - Established as a research code in late 1980’s; now supports numerous internal and external efforts across the speed range - Solves 2D/3D steady and unsteady Euler and RANS equations on node-based mixed element grids for compressible and incompressible flows - General dynamic mesh capability: any combination of rigid / overset / morphing grids, including 6-DOF effects - Aeroelastic modeling using mode shapes, full FEM, CC, etc. - Constrained / multipoint adjoint-based design and mesh adaptation - Distributed development team using agile/extreme software practices including 24/7 regression and performance testing - Capabilities fully integrated, online documentation, training videos, tutorials

Eric J Nielsen↗

Cybersecurity of DER Systems: Cybersecurity Training for State Commissions

NARUC regularly hosts multi-day cybersecurity training events for commissioners and their staff to gain knowledge of IT/OT technologies, understand the spectrum of state and federal approaches to cybersecurity, and explore cybersecurity cost recovery challenges and innovative solutions to address them. About 300 commissioners and staffers typically register for these virtual events.

cybersecurity cost recovery↗

Condition-Based Maintenance of a Circulating Water System of a Canadian Nuclear Power Plant using Machine Learning and Statistical Tools

Canada Deuterium Uranium pressurized-heavy-water reactors (PHWR) are a type of nuclear power plant that generate clean and reliable energy. The scope of this work is to automate data analysis methodologies to inform a condition-based maintenance strategy of a circulating water system (CWS) of a PHWR. The multiunit CWS provides a continuous supply of water to cool steam condensers, even during transient scenarios, thereby improving the thermal efficiency. This work aims to develop a machine learning (ML) based approach to detect anomalies in heterogeneous data of a CWS in a PHWR to help inform a predictive maintenance strategy. The heterogeneous data include textual and numeric time series data for a PHWR. Natural-language-processing (NLP)-based models are used to analyze textual data contained in work orders and operator logs and an event-timeseries correlation detection method is applied to assist anomalies diagnoses for CWS. An ML model Robust Linear Model (RLM) is also used to remove the seasonal variations in the system variable distributions based on distributions of environmental variables. A machine learning model, Density-Based Spatial Clustering of Applications with Noise (DBSCAN), trained on both original data and data without any seasonal variations will then be used to detect if an anomaly exists. Thus, by moving to an automated methodology to detect, classify, and forecast anomalies, the maintenance strategy would be based on component condition instead of a time-based schedule.

97 - MATHEMATICS AND COMPUTING↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Short-Term Distribution System State Forecast Based on Optimal Synchrophasor Sensor Placement and Extreme Learning Machine

This paper proposes an approach for distribution system state forecasting, which aims to provide an accurate and high speed state forecasting with an optimal synchrophasor sensor placement (OSSP) based state estimator and an extreme learning machine (ELM) based forecaster. Specifically, considering the sensor installation cost and measurement error, an OSSP algorithm is proposed to reduce the number of synchrophasor sensor and keep the whole distribution system numerically and topologically observable. Then, the weighted least square (WLS) based system state estimator is used to produce the training data for the proposed forecaster. Traditionally, the artificial neural network (ANN) and support vector regression (SVR) are widely used in forecasting due to their nonlinear modeling capabilities. However, the ANN contains heavy computation load and the best parameters for SVR are difficult to obtain. In this paper, the ELM, which overcomes these drawbacks, is used to forecast the future system states with the historical system states. The proposed approach is effective and accurate based on the testing results.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Blood Volume: Its Adaptation to Endurance Training

Expansion of blood volume (hypervolemia) has been well documented in both cross-sectional and longitudinal studies as a consequence of endurance exercise training. Plasma volume expansion can account for nearly all of the exercise-induced hypervolemia up to 2-4 wk; after this time expansion may be distributed equally between plasma and red cell volumes. The exercise stimulus for hypervolemia has both thermal and nonthermal components that increase total circulating plasma levels of electrolytes and proteins. Although protein and fluid shifts from the extravascular to intravascular space may provide a mechanism for rapid hypervolemia immediately after exercise, evidence supports the notion that chronic hypervolemia associated with exercise training represents a net expansion of total body water and solutes. This net increase of body fluids with exercise training is associated with increased water intake and decreased urine volume output. The mechanism of reduced urine output appears to be increased renal tubular reabsorption of sodium through a more sensitive aldosterone action in man. Exercise training-induced hypervolemia appears to be universal among most animal species, although the mechanisms may be quite different. The hypervolemia may provide advantages of greater body fluid for heat dissipation and thermoregulatory stability as well as larger vascular volume and filling pressure for greater cardiac stroke volume and lower heart rates during exercise.

Convertino, Victor A.↗

Unsupervised Learning for Equitable DER Control: Preprint

In the context of managing distributed energy resources (DERs) within distribution networks (DNs), this work focuses on the task of developing local controllers. We propose an unsupervised learning framework to train functions that can closely approximate optimal power flow (OPF) solutions. The primary aim is to establish specific conditions under which these learned functions can collectively guide the network towards desired configurations asymptotically, leveraging an incremental control approach. The flexibility of the proposed methodology allows to integrate fairness-driven components into the cost function associated with the OPF problem. This addition seeks to mitigate power curtailment disparities among DERs, thereby promoting equitable power injections across the network. To demonstrate the effectiveness of the proposed approach, power flow simulations are conducted using the IEEE 37-bus feeder. The findings not only showcase the guaranteed system stability but also underscore its improved overall performance.

asymptotic stability↗

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗

MODULATION OF LOW ENERGY BEAM TO GENERATE PREDEFINED BUNCH TRAINS FOR THE NSLS-II TOP-OFF INJECTION

The NSLS II linac will produce a bunch train, 80-150 bunches long with 2 ns bunch spacing. Having the ability to tailor the bunch train can lead to the smaller bunch to bunch charge variation in the storage ring. A stripline is planned to integrate into the linac baseline to achieve this tailoring. The stripline must have a fast field rise and fall time to tailor each bunch. The beam dynamics is minimally affected by including the extra space for the stripline. This paper discusses the linac beam dynamics with stripline, and the optimal design of the stripline. A stripline is to be integrated in the linac to match the storage ring uniform bunch charge requirement, which simplifies the gun pulser electronics and looses the edge uniform requirement. It is located at low energy to lower the stripline power supply requirement and limit the dumped electron radiation. By turning off the stripline, the beam dynamics through linac is comparable with the baseline design. More advanced ideas can be explored. If a DC corrector along with the stripline is used, the core bunch trains gets kick from the stripline while the head and the tail of bunch train just gets a DC kick. The stripline power supply waveform is a single flat top waveform with fast rise and drop and the pulse length is {approx}200 ns long or 100 bunches, which may be easier from the power supply view point. We are also considering the bunch by bunch charge manipulation to match the storage ring uniform bunch charge distribution requirement. By modulating the flat top waveform at 250 MHz with adjustable amplitude, each the bunch center is either at 45 degree or 135 degree. Only the head or tail of the bunch is trimmed out. Although each bunch center deviation from idea center is very different at low energy, it is gradually minimized with beam energy increase.

43 PARTICLE ACCELERATORS↗

Current Status of Human Resource Training Program for Fostering RIBiomics Professionals

RI-Biomics is a state-of-the-art radiation fusion technology for evaluating in-vivo dynamics such as absorption, distribution, metabolism and excretion (ADME) of new drug candidates and biomaterials using radioisotope (RI), and quantitative evaluation of their efficacy via molecular imaging techniques and animal models. The RI-Biomics center is the sole comprehensive research and experiment complex in Korea that can simultaneously perform the radio-synthesis of drug candidate with radioisotope, analysis, and molecular imaging evaluation with animal model. Molecular imaging techniques, including nuclear imaging (SPECT and PET), near-infrared fluorescent (NIRF) imaging, and magnetic resonance imaging (MRI), are the cutting-edge technologies for evaluating drug candidates. Since they allow in vivo real-time imaging of the diseased site, monitoring the biodistribution of drug and determining the optimal therapeutic efficacy following treatments, we have integrated RI-ADME and molecular imaging to provide useful information for drug evaluation and to accelerate the development of new drugs and biomaterials. The RI-Biomics center was established with total investment of 18 million $ during four years from 2009 to 2012 in order to develop a comprehensive analyzing system using RI for new drug development as an axis for national growth in the next generation. The RI-Biomics center has labeling synthesis facility for the radiosynthesis of drug candidate with radioisotope such as Tc-99m, I-125, I-131, F-18, H-3 and C-14 using hot cell. It also includes RI-general analysis facilities, such as Radio-HPLC, LC/MS, GC/MS, gamma counter that can analyzing the radio-synthesized materials, and animal image analysis facilities that developed small animal imaging equipment such as SPECT/PET/CT, 7 T MRI, in-vivo optical imaging system and others. In order to achieve the system to verify safety and effectiveness of the new drugs using RI, it is necessary to establish a human resource training program for fostering RI-Biomics professionals in the following key fields; (1) Radio-pharmaceuticals synthesis and labeled compound development, (2) Development of RI-ADME in the living object and image assessment technology. Personnel training program that carries out theoretical education and practical training in the field related to RI-Biomics in parallel is being conducted. Internship training for university students has been administered twice already while educational program for the existing professionals in the RI-Biomics field will be carried out during the summer of 2014. The human resource training program for combination of RIADME and different molecular imaging techniques can offer synergistic advantages to facilitate understanding RIADME and fostering RI-ADME professionals. (authors)

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A machine learning approach to galaxy properties: joint redshift–stellar mass probability distributions with Random Forest

We demonstrate that highly accurate joint redshift–stellar mass probability distribution functions (PDFs) can be obtained using the Random Forest (RF) machine learning (ML) algorithm, even with few photometric bands available. As an example, we use the Dark Energy Survey (DES), combined with the COSMOS2015 catalogue for redshifts and stellar masses. We build two ML models: one containing deep photometry in the griz bands, and the second reflecting the photometric scatter present in the main DES survey, with carefully constructed representative training data in each case. We validate our joint PDFs for 10 699 test galaxies by utilizing the copula probability integral transform and the Kendall distribution function, and their univariate counterparts to validate the marginals. Benchmarked against a basic set-up of the template-fitting code bagpipes, our ML-based method outperforms template fitting on all of our predefined performance metrics. In addition to accuracy, the RF is extremely fast, able to compute joint PDFs for a million galaxies in just under 6 min with consumer computer hardware. Such speed enables PDFs to be derived in real time within analysis codes, solving potential storage issues. As part of this work we have developed galpro 1, a highly intuitive and efficient python package to rapidly generate multivariate PDFs on-the-fly. galpro is documented and available for researchers to use in their cosmology and galaxy evolution studies.

79 ASTRONOMY AND ASTROPHYSICS↗

ThickBrick: optimal event selection and categorization in high energy physics. Part I. Signal discovery

We provide a prescription called ThickBrick to train optimal machine-learning-based event selectors and categorizers that maximize the statistical significance of a potential signal excess in high energy physics (HEP) experiments, as quantified by any of six different performance measures. For analyses where the signal search is performed in the distribution of some event variables, our prescription ensures that only the information complementary to those event variables is used in event selection and categorization. This eliminates a major misalignment with the physics goals of the analysis (maximizing the significance of an excess) that exists in the training of typical ML-based event selectors and categorizers. In addition, this decorrelation of event selectors from the relevant event variables prevents the background distribution from becoming peaked in the signal region as a result of event selection, thereby ameliorating the challenges imposed on signal searches by systematic uncertainties. Our event selectors (categorizers) use the output of machine-learning-based classifiers as input and apply optimal selection cutoffs (categorization thresholds) that are functions of the event variables being analyzed, as opposed to flat cutoffs (thresholds). These optimal cutoffs and thresholds are learned iteratively, using a novel approach with connections to Lloyd’s k-means clustering algorithm. We provide a public, Python implementation of our prescription, also called ThickBrick, along with usage examples.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Ultrasonic Measurements of Temperature Distribution in Extreme Environments: Results of Power Plant Testing

The most hardened insertion sensors do not perform reliably in extreme environmental conditions. We address this problem by developing an ultrasonic thermometry system for the measurements of segmental temperature distributions (MSTD) in solid materials and, specifically, across containments of energy conversion processes. The MSTD approach uses an echogenically segmented ultrasound propagation path, structured to contain engineered or naturally occurring echogenic features. In pulse-echo mode, these features produce a train of echoes in response to an external pulse of ultrasonic excitation created and acquired by a transducer located outside the extreme environment. The delays between the echoes encode the information on the temperature distribution in the corresponding segments of the ultrasonic propagation path, which we use to reconstruct an unknown temperature profile. This note describes the preliminary results and initial experience in applying the developed MSTD ultrasonic thermometry system to the measurements of temperatures in a utility-scale 500MW coal-fired boiler.

John, Mason↗

DGaaS: GPU as a Service on Distributed Computing System

In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.

97 MATHEMATICS AND COMPUTING↗

Primal-Dual Differentiable Programming for Distribution System Critical Load Restoration: Preprint

Swift and reliable critical load restoration (CLR) can help make a distribution system resilient towards extreme events. To optimally achieve that, alongside practical concerns such as limiting online computational burden, some studies leverage model-free reinforcement learning (RL) to train control policies. Despite the advantages provided by RL algorithms, these approaches suffer from two issues: 1) the lack of a proper mechanism for constraint enforcement, and 2) poor sample efficiency. Therefore, in this paper, a primal-dual differentiable programming (PDDP) method is developed for guiding the training leading to a constraint-satisfying policy. Additionally, the model-based nature of the proposed method aims at improving sample efficiency. The experiment on a CLR problem demonstrates that PDDP can effectively train a control policy that both achieves desirable performance and satisfies required constraints.

differentiable programming↗

MapReduceXMT v. Beta 0.1

The MapReduceXMT library ports the MapReduce framework onto the Cray XMT. MapReduce is a programming paradigm and an approach to data management for unstructured problems. It has gained relevance due to its ability to map serial operations onto parallel distributed architectures, significantly improving developer/analyst productivity. The MapReduceXMT implements the key aspects of MapReduce for the Cray XMT, a massively threaded system that is inherently difficult to program. MapReduceXMT allows users to utilize the machine effectively and efficiently without extensive training in multi-threaded programming. The MapReduceXMT library ports the MapReduce framework onto the Cray XMT. MapReduce is a programming paradigm and an approach to data management for unstructured problems. It has gained relevance due to its ability to map serial operations onto parallel distributed architectures, significantly improving developer/analyst productivity. The MapReduceXMT implements the key aspects of MapReduce for the Cray XMT, a massively threaded system that is inherently difficult to program. MapReduceXMT allows users to utilize the machine effectively and efficiently without extensive training in multi-threaded programming.

Goodman, Eric↗

MapReduceXMT v. Beta 0.1

The MapReduceXMT library ports the MapReduce framework onto the Cray XMT. MapReduce is a programming paradigm and an approach to data management for unstructured problems. It has gained relevance due to its ability to map serial operations onto parallel distributed architectures, significantly improving developer/analyst productivity. The MapReduceXMT implements the key aspects of MapReduce for the Cray XMT, a massively threaded system that is inherently difficult to program. MapReduceXMT allows users to utilize the machine effectively and efficiently without extensive training in multi-threaded programming. The MapReduceXMT library ports the MapReduce framework onto the Cray XMT. MapReduce is a programming paradigm and an approach to data management for unstructured problems. It has gained relevance due to its ability to map serial operations onto parallel distributed architectures, significantly improving developer/analyst productivity. The MapReduceXMT implements the key aspects of MapReduce for the Cray XMT, a massively threaded system that is inherently difficult to program. MapReduceXMT allows users to utilize the machine effectively and efficiently without extensive training in multi-threaded programming.

Goodman, Eric↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗