Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Robust anomaly detection for particle physics using multi-background representation learning

Abstract Anomaly, or out-of-distribution, detection is a promising tool for aiding discoveries of new particles or processes in particle physics. In this work, we identify and address two overlooked opportunities to improve anomaly detection (AD) for high-energy physics. First, rather than train a generative model on the single most dominant background process, we build detection algorithms using representation learning from multiple background types, thus taking advantage of more information to improve estimation of what is relevant for detection. Second, we generalize decorrelation to the multi-background setting, thus directly enforcing a more complete definition of robustness for AD. We demonstrate the benefit of the proposed robust multi-background AD algorithms on a high-dimensional dataset of particle decays at the Large Hadron Collider.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Flow annealed importance sampling bootstrap meets differentiable particle physics

High-energy physics requires the generation of large numbers of simulated data samples from complex but analytically tractable distributions called matrix elements. Surrogate models, such as normalizing flows, are gaining popularity for this task due to their computational efficiency. We adopt an approach based on flow annealed importance sampling bootstrap (FAB) that evaluates the differentiable target density during training and helps avoid the costly generation of training data in advance. We show that FAB reaches higher sampling efficiency with fewer target evaluations in high dimensions in comparison to other methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The stellar parameters and elemental abundances from low-resolution spectra – I. 1.2 million giants from LAMOST DR8

As a typical data-driven method, deep learning becomes a natural choice for analysing astronomical data. In this study, we built a deep convolutional neural network (NN) to estimate basic stellar parameters $T\rm {_{eff}}$, log g , metallicity ([M/H] and [Fe/H]) and [α/M] along with nine individual elemental abundances ([C/Fe], [N/Fe], [O/Fe], [Mg/Fe], [Al/Fe], [Si/Fe], [Ca/Fe], [Mn/Fe], and [Ni/Fe]). The NN is trained using common stars between the APOGEE survey and the LAMOST survey. We used low-resolution spectra from LAMOST survey as input, and measurements from APOGEE as labels. For stellar spectra with the signal-to-noise ratio in g band larger than 10 in the test set, the mean absolute error (MAE) is 29 K for $T\rm {_{eff}}$, 0.07 dex for log g , 0.03 dex for both [Fe/H] and [M/H], and 0.02 dex for [α/M]. The MAE of most elements is between 0.02 and 0.04 dex. The trained NN was applied to 1210 145 giants, including sub-giants, from LAMOST DR8 within the range of stellar parameters 3500 K < $T\rm {_{eff}}$ < 5500 K, 0.0 dex < log g < 4.0 dex, −2.5 dex < [Fe/H] < 0.5 dex. The distribution of our results in the chemical spaces is highly consistent with APOGEE labels and stellar parameters show consistency with external high-resolution measurements from GALAH. The results in this study allow us to further studies based on LAMOST data and deepen our understanding of the accretion and evolution history of the Milky Way. The electronic version of the value added catalog is available at http://www.lamost.org/dr8/v1.1/doc/vac.

79 ASTRONOMY AND ASTROPHYSICS↗

Continuous snow depth, ground interface temperature and shallow soil temperature measurements from 2021-10-1 to 2022-6-14, Seward Peninsula, Alaska

The dataset contains co-located snow depth, ground interface temperature, and shallow soil temperature measured at 98 discrete locations in a watershed located along the Nome-Teller road at mile marker 27 (referred to as T27), and at 53 discrete locations on a hillslope located along the Kougarok road at mile marker 64 (referred to as K64), in Seward Peninsula, Alaska. The dataset aims to understand the local heterogeneity of snow depth, snow temperature, and soil temperature dynamics and their interactions in a discontinuous permafrost region. The dataset is also valuable to train and evaluate machine learning and physical models to predict snow depth or the impact of snow depth on ground surface temperature. At each location, temperatures above and below the ground surface were measured by a pair of vertically deployed distributed temperature profiling probes designed based on Dafflon et al (2022). The probes have high precision temperature sensors spaced at 5 or 10 cm. The mean daily snow depth was estimated by identifying the pair of consecutive sensors with maximum drop of daily temperature high-frequency fluctuations. The ground interface temperature was measured by the sensor located 1-5 cm above the ground surface at 15-minute intervals. The shallow soil temperature was measured by the sensor located 1-5 cm below the ground surface at 15-minute intervals. The dataset includes a description of the probe locations in the "Probe_locations_*.csv" file and the 3 data files (Snow_depths_*.csv, Ground_interface_temperatures_*.csv, Shallow_soil_temperatures_*.csv). * is either T27 or K64, which are the two study sites. In each data file, each column corresponds to a measurement location. Metadata files include data descriptions (_dd.csv) for tabular data. All included files are listed and described in xxxx_flmd.csv. A more detailed description of data processing, along with an updated dataset incorporating multiple seasons and improved snow depth estimation is available at https://doi.org/10.15485/2480365 (Wang et al., 2025a, Wang et al., 2025b).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Toward Uncertainty Quantification for Supervised Classification

Our goal is to develop a general theoretical basis for quantifying uncertainty in supervised machine learning models. Current machine learning accuracy-based validation metrics indicate how well a classifier performs on a given data set as a whole. However, these metrics do not tell us a model's efficacy in predicting particular samples. We quantify uncertainty by constructing probability distributions of the predictions made by an ensemble of classifiers. This report details our initial investigations into uncertainty quantification for supervised machine learning. We apply an uncertainty analysis to the problem of malicious website detection. Machine learning models can be trained to find suspicious characteristics in the text of a website's Uniform Resource Locator (URL). However, given the vast numbers of URLs and the ever changing tactics of malicious actors, it will always be possible to find sets of websites which are outliers with respect to a model's hypothesis. Therefore, we seek to understand a model's per-sample reliability when classifying URL data. Acknowledgements This work was funded by the Sandia National Laboratories Laboratory Directed Research and Development (LDRD) program.

97 MATHEMATICS AND COMPUTING↗

Neural MUSE Analysis

Researchers at Oak Ridge National Laboratory (ORNL) created data as part of the MUSE (Multi-Agency Urban Search Experiment Detector and Algorithm Test Bed) project simulating illicit nuclear materials located in various buildings along a road. In the simulation, a truck containing a radiation detector drives down the road gathering listmode data (counting the and energy of incident gamma radiation). Building materials, source shielding, driving speed, truck direction, truck location on the road, source type, and source placement are all varied between runs of the data set. This data was created using deterministic neutron transport and Monte Carlo methods through a combination of SCALE, MAVRIC, MCNP, and GADRAS. As part of a follow-on NA-22 project, two Kaggle competitions were created to determine the best algorithms for finding and identifying gamma sources in this simulated urban environment. The winning algorithm was neural network-based and had a test accuracy of 76.4% accuracy for source identification. This work seeks to build upon this work and improve the results through the application of novel machine learning techniques. As a first step, the data was classified by a simple Convolutional Neural Network (CNN) To accomplish this, the data was first preprocessed into “waterfall plots.” These plots are composed of energy vs count plots that are stacked vertically to show progression in time. The horizontal axis indicating the particle energy incorporated user defined bin spacing with options for in linear-, logarithmic-, square root-, and user-spaced bins. The z or color dimension showed the number of counts corresponding the energy-time combination. This data was then used to generate more data, by generating a local estimate of the mean of the distribution for a bin and then randomly re-sampling that bin from a Poisson distribution. Once all of this data was generated, it was fed into a well-known CNN architecture, ResNet50. The output layer of this model was removed and replaced with layers corresponding to the shape desired isotope outputs. The provided training data was used to train the classifier and the remaining testing data was used to evaluate the model. Results are soon to be forthcoming.

61 RADIATION PROTECTION AND DOSIMETRY↗

Dynamic Topology Reconfiguration of Boltzmann Machines on Quantum Annealers

Boltzmann machines have useful roles in deep learning applications, such as generative data modeling, initializing weights for other types of networks, or extracting efficient representations from high-dimensional data. Most Boltzmann machines use restricted topologies that exclude looping connectivity, as such connectivity creates complex distributions that are difficult to sample. We have used an open-system quantum annealer to sample from complex distributions and implement Boltzmann machines with looping connectivity. Further, we have created policies mapping Boltzmann machine variables to the quantum bits of an annealer. These policies, based on correlation and entropy metrics, dynamically reconfigure the topology of Boltzmann machines during training and improve performance.

Liu, Jeremy (ORCID:0000000172299417)↗

PV inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Due to the limitations of the DC supply used, inverter is tested under 75%, 50%, 25% load conditions (This dataset does not contain 100% load condition). In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Type Ia Supernova Hubble Residuals and Host-Galaxy Properties

Kim et al. (2013) [K13] introduced a new methodology for determining peak- brightness absolute magnitudes of type Ia supernovae from multi-band light curves. We examine the relation between their parameterization of light curves and Hubble residuals, based on photometry synthesized from the Nearby Supernova Factory spec- trophotometric time series, with global host-galaxy properties. The K13 Hubble residual step with host mass is 0.013 ? 0.031 mag for a supernova subsample with data coverage corresponding to the K13 training; at ? 1?, the step is not significant and lower than previous measurements. Relaxing the data coverage requirement the Hubble residual step with host mass is 0.045 ? 0.026 mag for the larger sample; a calculation using the modes of the distributions, less sensitive to outliers, yields a step of 0.019 mag. The analysis of this article uses K13 inferred luminosities, as distinguished from previous works that use magnitude corrections as a function of SALT2 color and stretch param- eters: Steps at> 2? significance are found in SALT2 Hubble residuals in samples split by the values of their K13 x(1) and x(2) light-curve parameters. x(1) affects the light- curve width and color around peak (similar to the∆m15 and stretch parameters), and x(2) affects colors, the near-UV light-curve width, and the light-curve decline 20 to 30 days after peak brightness. The novel light-curve analysis, increased parameter set, and magnitude corrections of K13 may be capturing features of SN Ia diversity arising from progenitor stellar evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

ASGS - An Innovative Approach for Waste Characterization - From the First Study to Experimental Validation - 20260

For disposal of nuclear waste a clear identification of the nuclear inventory is mandatory. Since this waste is usually filled in drums, nuclear specific characterization methods using HPGe detectors usually require the understanding of the limitations of the method assumptions (such as the homogeneity criteria), and often results in applying high uncertainties to the result in waste that is not well known a priori. There are several methods and approaches such as Far-Field, Segmented Gamma Scans (SGS) or Tomographic Gamma Scans (TGS) available. The SGS allows measuring the waste drum in different segments (or 'layers') which allows getting more detailed information about the activity distribution inside a waste drum. In addition, with the transmission source used in tomographic scans, it is possible to also determine the material (and its homogeneity) composition inside a drum. Mirion Technologies developed in cooperation with Aachen Institute for Nuclear Training (AiNT) an innovative measurement approach which allows more accurate results and therefore applying lower uncertainties. This new measurement approach extends the concept of SGS by partitioning the drum into single drum sectors instead of segments. The goal is to perform measurements with high throughput and an accurate analysis based on the reconstruction of activities for each sector. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hydropower Black Start: A Guidebook for Retrofitting Grid Dependent Hydropower

Not all United States (US) hydropower plants were designed to provide black start, but they are increasingly needed to uphold resilience in the evolving electric grid. This guidance is designed to help understand the minimal retrofits required for grid dependent hydropower (GDH) plants behind the point of interconnection (POI). For distribution connected hydropower plants or those with dedicated cranking paths, such upgrades can be sufficient for the plant to provide black start. For others, more coordination with the transmission system operator will be needed. This guidebook answers a number of questions relevant to retrofitting hydropower plants with black start capabilities. For example, the guidebook answers: • How flexible do the wicket gate controls need to be? • Who needs to do hydro governor model validation, why, and how? • How robust and flexible do the excitation and AVR controls need to be? • What protection settings need to be adjusted? • What relay(s) will need to be bypassed or overridden and at what risk? • What is the electrical energy demand of the station load or auxiliary power systems? • What should the strategy to energize transformer(s) along cranking path to address inrush currents be? • How should the critical load restoration be sequenced? In addition to outlining the specifications that hydropower plants need to meet for each component to be able to perform black start, this guidebook provides a set of case studies for specific upgrades needed at actual plants. Between the case studies of plants that have already performed black start retrofits and the examples of how this guidebook can be applied to scope future retrofits, five key themes have been identified for retrofit needs. 1. Protection needs “black start” mode: hydropower plants that are not designed with black start capabilities will have protections that prevent them from interconnecting to a “dead bus.” These protections will need to be overridden in every retrofit case and a separate black start mode should be established so that operators can safely switch between black start and grid connected modes, minimizing the risk to the plant. 2. Wicket gates need modern controls: digital governors accelerate the parameter tuning process and gate position sensors improve controllability, so plants with mechanical governors should be upgraded. Furthermore, a black start and islanding mode should be established for controls to maximize plant performance. 3. Robust excitation support: the DC system or excitation generator needs to be reliable enough to form and sustain the rotor electromagnetic field. These systems are typically undersized in plants that were not designed for black start, so they will need to be upgraded. 4. Turbine-governor model validation and operator training: validation of a standard hydro governor model is needed to characterize the dynamic response (i.e., inertial and primary frequency response) of the GDH. This is required for control development and old hydropower plants often have outdated or incorrect models. Operator training is also typically required to ensure the hardware retrofits are utilized correctly during the black start process. 5. Transformer and cranking path energization: any upgradation and control adjustment in front of the POI will depend upon the existing interconnection. Coordination with the transmission or distribution operator may be required.

13 HYDRO ENERGY↗

A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers

Deep learning (DL) has become a key technique for solving complex problems in scientific research and discovery. DL training for science is substantially challenging because it has to deal with massive quantities of multi-dimensional data. High- performance computing (HPC) supercomputers are increasingly being employed for meeting the exponentially growing demand for DL. Multiple GPUs and high-speed interconnect network are needed for supporting DL on HPC systems. However, the excessive use of GPUs without considering effective benefits leads to inefficient resource utilization of these expensive setups. In this paper, we conduct a quantitative analysis to gauge the efficacy of DL workloads on the latest HPC system and identify viability of next-generation DL-optimized heterogeneous supercomputers for enabling researchers to develop more efficient resource management and distributed DL middleware. We evaluate well- known DL models with large-scale datasets using the popular TensorFlow framework, and provide a thorough evaluation in- cluding scalability, accuracy, variability, storage resource, GPU- GPU/GPU-CPU data transfer, and GPU utilization. Our analysis reveals that the latest heterogeneous supercomputing cluster shows varying performance trend as compared to the existing literature for single- and multi-node training. To the best of our knowledge, this is the first work to conduct such a quantitative and comprehensive study of DL training on a supercomputing system with multiple GPUs.

Han, Jingoo↗

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗

Machine learning for interpreting coherent X-ray speckle patterns

Speckle patterns produced by coherent X-ray have a close relationship with the internal structure of materials but quantitative inversion of the relationship to determine structure from speckle patterns is challenging. Here, in this work, we investigate the link between coherent X-ray speckle patterns and sample structures using a model 2D disk system and explore the ability of machine learning to learn aspects of the relationship. Specifically, we train a deep neural network to classify the coherent X-ray speckle patterns according to the disk number density in the corresponding structure. It is demonstrated that the classification system is accurate for both non-disperse and disperse size distributions.

36 MATERIALS SCIENCE↗

Z-Contrast Enhancement in Au–Pt Nanocatalysts by Correlative X-ray Absorption Spectroscopy and Electron Microscopy: Implications for Composition Determination

The properties of bimetallic nanoparticles (BNPs) vary widely as a function of their composition and size distributions. X-ray absorption fine structure analysis is commonly used to characterize their structure, but its application to elements that are close to each other in the periodic table is hampered by poor Z-contrast. For this study, we trained an artificial neural network to recognize the partial coordination numbers in AuPt NPs synthesized via peptide templating using their X-ray absorption near-edge structure spectra. This approach, combined with scanning transmission electron microscopy analysis, revealed unique details of this prototype catalytic system that has different forms of heterogeneities at both the intra- and inter-particle levels. Our method based on the enhancement of Z-contrast of metal species will have implications for compositional studies of BNPs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Acoustic Emission Source Location in Unidirectional Carbon-Fibre-Reinforced Plastic Plates Using Virtually Trained Artificial Neural Networks

Acoustic emission source location in a unidirectional carbon-fibre-reinforced plastic plate was attempted employing Artificial Neural Network (ANN) technology. The acoustic emission events were produced by a lead break, and the response wave received by piezoelectric sensors, type VS150-M resonant at 150 kHz. The waves were detected by a Vallen AMSY4 eight-channel instrumentation. The time of arrival, determined through the conventional threshold crossing technique, was used to measure the dependence of wave velocity on fibre orientation. A simple empirical formula, relying on classical lamination and suggested by wave propagation theory, was able to accurately model the experimental trend. Based on the formula, virtual training and testing data sets were generated for the case of a plate monitored by three transducers, and adopted to select two potentially effective ANN architectures. For final validation, experimental tests were carried out, positioning the source at predetermined points evenly distributed within the plate area. A very satisfactory correlation was found between the actual source locations and the ANN predictions.

36 MATERIALS SCIENCE↗

Resonant two- or three-photon ionization of noble-gas atoms captured by time-resolved photoelectron momentum spectroscopy

In this work, we present an all-electron, ab initio calculation of time-resolved photoelectron momentum distributions (PMDs) induced by resonant two-color, two- or three-photon ionization of helium and neon atoms, as recently measured by Villeneuve et al. [Science 356, 1150 (2017)] using a femtosecond infrared (IR) laser pulse and an attosecond pulse train (APT) produced with high harmonic generation as an extreme ultraviolet (XUV) photon source. In contrast to a monochromatic XUV pulse commonly used at the free-electron laser facilities, an APT is broadband and ultrashort (<1 fs), so that it could induce nonresonant one-photon transitions above ionization threshold as well as a resonantly excited state. They may interfere with each other upon subsequent absorption or emission of an IR photon, so that the resultant PMD loses clear orbital symmetry. Our time-dependent density functional calculation demonstrates that the selection of a particular excited state in the time-resolved PMD is nevertheless possible if energy and timing of an APT are adjusted properly.

74 ATOMIC AND MOLECULAR PHYSICS↗

Hybrid Entanglement Distribution between Remote Microwave Quantum Computers Empowered by Machine Learning

Superconducting microwave circuits with Josephson junctions, the major platform for quantum computing, can only reach the full capability when connected. This requires an efficient protocol to distribute microwave entanglement. While quantum computers typically use discrete-variable (DV) methods for information encoding, the entire continuous-variable (CV) degree of freedom in electromagnetic fields must be utilized to achieve the highest entanglement distribution rate. Here, we propose a hybrid protocol to resolve the incompatibility between DV microwave quantum computers and CV quantum communications. CV microwave entanglement is distributed using optical swapping of optical-microwave entanglement pairs. To interface with DV microwave quantum computers, we further design a hybrid circuit to simultaneously convert and distill high-quality DV entanglement from noisy CV entanglement. The hybrid circuit is trained with machine-learning algorithms, ensuring high entanglement fidelity and generation rate. In conclusion, our work not only provides a practical method to realize efficient quantum links for superconducting microwave quantum computers, but also opens avenues to bridge the gap between DV and CV quantum systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗