Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Frequency Event Categorization in Power Distribution Systems Using Micro PMU Measurements

Frequency is an important metric for power stability. To enhance the situational awareness in power distribution systems, this article proposes a data-driven approach that utilizes the data from micro phasor measurement units (μPMU) to categorize frequency events observed in distribution feeders. The proposed approach has three layers, each of which analyzes if a frequency event is propagated from the transmission system, formed inside a distribution feeder or falsely produced by instantaneous frequency (IF) estimation algorithms, respectively. In the first layer, the Granger causality is utilized to compare the causal relations from measurements across different locations to decide if an event is propagated from the transmission side. In the second layer, a trained sparse coding dictionary is utilized to unmix the physical causes of a frequency event. In the third layer, a moving z-score based event-pair detector is applied to identify if a frequency event is algorithm-induced. The proposed approach is tested using the μPMU measurements collected from Lawrence Berkeley National Laboratory (LBNL) and Riverside Public Utility (RPU).

24 POWER TRANSMISSION AND DISTRIBUTION↗

New avenue to the parton distribution functions: Self-organizing maps

Neural network algorithms have been recently applied to construct parton distribution function (PDF) parametrizations which provide an alternative to standard global fitting procedures. In this exploratory study we propose a technique using self-organizing maps (SOMs). SOMs are a class of clustering algorithms based on competitive learning among spatially ordered neurons. Our SOMs are trained on selections of stochastically generated PDF samples. The selection criterion for every optimization iteration is based on the features of the clustered PDFs. Our goal is a fitting procedure that, at variance with the standard neural network approaches, will allow for an increased control of the systematic bias by enabling user interaction in the various stages of the process.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Deformable segmentation of 3D MR prostate images via distributed discriminative dictionary and ensemble learning

Purpose: Automatic prostate segmentation from MR images is an important task in various clinical applications such as prostate cancer staging and MR-guided radiotherapy planning. However, the large appearance and shape variations of the prostate in MR images make the segmentation problem difficult to solve. Traditional Active Shape/Appearance Model (ASM/AAM) has limited accuracy on this problem, since its basic assumption, i.e., both shape and appearance of the targeted organ follow Gaussian distributions, is invalid in prostate MR images. To this end, the authors propose a sparse dictionary learning method to model the image appearance in a nonparametric fashion and further integrate the appearance model into a deformable segmentation framework for prostate MR segmentation. Methods: To drive the deformable model for prostate segmentation, the authors propose nonparametric appearance and shape models. The nonparametric appearance model is based on a novel dictionary learning method, namely distributed discriminative dictionary (DDD) learning, which is able to capture fine distinctions in image appearance. To increase the differential power of traditional dictionary-based classification methods, the authors' DDD learning approach takes three strategies. First, two dictionaries for prostate and nonprostate tissues are built, respectively, using the discriminative features obtained from minimum redundancy maximum relevance feature selection. Second, linear discriminant analysis is employed as a linear classifier to boost the optimal separation between prostate and nonprostate tissues, based on the representation residuals from sparse representation. Third, to enhance the robustness of the authors' classification method, multiple local dictionaries are learned for local regions along the prostate boundary (each with small appearance variations), instead of learning one global classifier for the entire prostate. These discriminative dictionaries are located on different patches of the prostate surface and trained to adaptively capture the appearance in different prostate zones, thus achieving better local tissue differentiation. For each local region, multiple classifiers are trained based on the randomly selected samples and finally assembled by a specific fusion method. In addition to this nonparametric appearance model, a prostate shape model is learned from the shape statistics using a novel approach, sparse shape composition, which can model nonGaussian distributions of shape variation and regularize the 3D mesh deformation by constraining it within the observed shape subspace. Results: The proposed method has been evaluated on two datasets consisting of T2-weighted MR prostate images. For the first (internal) dataset, the classification effectiveness of the authors' improved dictionary learning has been validated by comparing it with three other variants of traditional dictionary learning methods. The experimental results show that the authors' method yields a Dice Ratio of 89.1% compared to the manual segmentation, which is more accurate than the three state-of-the-art MR prostate segmentation methods under comparison. For the second dataset, the MICCAI 2012 challenge dataset, the authors' proposed method yields a Dice Ratio of 87.4%, which also achieves better segmentation accuracy than other methods under comparison. Conclusions: A new magnetic resonance image prostate segmentation method is proposed based on the combination of deformable model and dictionary learning methods, which achieves more accurate segmentation performance on prostate T2 MR images.

60 APPLIED LIFE SCIENCES↗

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

ResNet and CycleGAN for pulse shape discrimination of He-4 detector pulses: Recovering pulses conventional algorithms fail to label unanimously

Pulse shape discrimination (PSD) capable detectors, such as He-4, that respond to neutron and gamma-ray 7 interactions have a threshold deposited energy value below which n/γ discrimination vanishes when using 8 conventional PSD algorithms. Recent attempts in applying supervised learning based artificial neural 9 networks for PSD use the pulses in the separated regions to train the networks so they can be used to classify 10 another set of separated pulses. In doing so, pulses previously indistinguishable are not recovered for 11 classification, which would have increased the number of neutron and gamma-ray pulses that could be used 12 for further analysis. Assuming the reason why conventional PSD algorithms have unseparated regions is 13 because the parameter space of the algorithms fail to capture the intrinsic (but subtle) distinguishing 14 behavior of some of the neutron and gamma-ray pulses, a cycle-consistent generative adversarial network 15 (CycleGAN) was trained to amplify those differences and extract well separated neutron and gamma-ray 16 clusters. Results show that, once the network is trained with pulses from separated and unseparated regions, 17 it was able to transform the pulses in the unseparated region to improve the PSD. Subsequent n/γ 18 classification was performed using deep residual network (ResNet) that takes pulses with 512 data points 19 as an input. Two different ResNets were explored – simple ResNet and modified ResNet which takes 20 segmented pulse inputs in the first layer and the corresponding time axis values in the last hidden layer. 21 The later approach enables the network to extract time correlated pulse features to enhance its ability to 22 capture the pulse behaviors relevant for PSD. Although it achieves slightly lower accuracy, 99.41% versus 23 99.89%, based on simply counting the number of correct n/γ labels assigned, compared to the simple 24 ResNet, the modified ResNets architecture was able to decreases the cross-entropy loss function by half, 25 which implies that the correct n/γ labels assigned are less likely to be accidental. PSD parameter 26 distributions based on n/γ classification by ResNet before and after transforming unseparated pulses using 27 CycleGAN show that by enhancing the separation between neutrons and gamma-rays, the transformation 28 helps improve the performance of classifier networks that are trained using labeled dataset. The 29 enhancement of neutron and gamma-ray separation by the CycleGAN increased the PSD figure of merit 30 (FOM) by up to 70% in some regions. Here, the results show that, if a given detector achieves clear separation 31 between neutron and gamma-ray pulses in any energy region, such neural network approaches can help 32 lower the energy threshold for the separation and increasing the number of neutron and gamma-ray pulses 33 that can be used for further analysis.

4He↗

A segmented approach to modeling building height: Delineating high-rise and low-rise buildings for enhanced height estimation

Understanding building height is imperative to the overall study of energy efficiency, population distribution, urban morphologies, emergency response, among others. Currently, existing approaches for modeling building height at scale are hindered by two pervasive issues. First, there is no consistent approach to quantify what a high-rise building is at a macro scale, leaving researchers unable to accurately compare results across geographies and domains. Second, high-rise buildings represent a small fraction of the built environment, implying data imbalance challenges that negatively affect current approaches. This is a problem of practical relevance since information on high-rise buildings is important for studies on urban heat islands, population dynamics, and pollution dispersion. Here, we introduce a novel approach to map building height which first identifies two distinct distributions within the built environment, with one being composed of low-rise buildings and one composed of high-rise buildings. We then develop an ensemble scheme where discrete specialist models are trained for each subset of low-rise buildings and high-rise buildings to infer building height from morphology features. For experiments mapping heights of 4.85 million buildings in Japan, we show an increase of 34 % in accuracy within 3m error when compared to the current state-of-the-art when modeling high-rise buildings, which based on KNN experimentation we define as any building > 12m . Our findings show that such an ensemble framework outperforms the current state-of-the-art approaches, which is especially relevant in relation to inferring height for high-rise buildings, a prominent issue of existing approaches for mapping the built environment.

97 MATHEMATICS AND COMPUTING↗

Spatiotemporally dynamic implicit large eddy simulation using machine learning classifiers

In this article, we utilize machine learning to dynamically determine if a point on the computational grid requires implicit numerical dissipation for large eddy simulation (LES). The decision making process is learnt through a priori training on quantities derived from direct numerical simulation (DNS) data. In particular, we compute eddy-viscosities obtained through the coarse-graining of DNS quantities and utilize their projection onto a Gaussian distribution to categorize areas that may require dissipation. If our learning determines that closure is necessary, an upwinded scheme is utilized for computing the non-linear Jacobian. In contrast, if it is determined that closure is unnecessary, a symmetric and second-order accurate energy and enstrophy preserving Arakawa scheme is utilized instead. This results in a closure framework that precludes the specification of any model-form for the small scale contributions of turbulence but deploys an appropriate numerical dissipation from explicit closure driven hypotheses. Here, this methodology is deployed for the Kraichnan turbulence test-case and assessed through various statistical quantities such as angle-averaged kinetic energy spectra and vorticity structure functions. Our framework thus establishes a link between the use of explicit LES ideologies for closure and numerical dissipation-based modeling of turbulence leading to improved statistical fidelity of a posteriori simulations.

42 ENGINEERING↗

Node-degree aware edge sampling mitigates inflated classification performance in biomedical random walk-based graph representation learning

Motivation: Graph representation learning is a family of related approaches that learn low-dimensional vector representations of nodes and other graph elements called embeddings. Embeddings approximate characteristics of the graph and can be used for a variety of machine-learning tasks such as novel edge prediction. For many biomedical applications, partial knowledge exists about positive edges that represent relationships between pairs of entities, but little to no knowledge is available about negative edges that represent the explicit lack of a relationship between two nodes. For this reason, classification procedures are forced to assume that the vast majority of unlabeled edges are negative. Existing approaches to sampling negative edges for training and evaluating classifiers do so by uniformly sampling pairs of nodes. Results: We show here that this sampling strategy typically leads to sets of positive and negative examples with imbalanced node degree distributions. Using representative heterogeneous biomedical knowledge graph and random walk-based graph machine learning, we show that this strategy substantially impacts classification performance. If users of graph machine-learning models apply the models to prioritize examples that are drawn from approximately the same distribution as the positive examples are, then performance of models as estimated in the validation phase may be artificially inflated. We present a degree-aware node sampling approach that mitigates this effect and is simple to implement. Availability and implementation: Our code and data are publicly available at https://github.com/monarch-initiative/negativeExampleSelection.

59 BASIC BIOLOGICAL SCIENCES↗

Convolutional Variational Autoencoder-based Unsupervised Learning for Power Systems Faults

Classification of power system event data is a growing need, particularly where non-protective relaying-based sensors are used to monitor grid performance. Given the high burden of obtaining event data with appropriate labeling, an unsupervised approach is highly valuable. This approach enables using event data without labeling, which is far easier to obtain. This paper presents an unsupervised learning method to classify and label transients observed in the distribution grid. A Convolutional Variational Autoencoder (CVAE) was developed for this purpose. We demonstrate the efficacy of our approach using the transient data generated from the simulations. The simulation data is used to train the CVAE that identifies different faults as different clusters in the latent space. The clusters are then used as the foundation model to categorize the real-world data.

Alam, Maksudul↗

Simplified Model and Approach to Transform Infrared Surface Temperature to Film Effectiveness in a Conjugate Heat Transfer Experiment

In the pursuit of more efficient gas turbines, film cooling is a critical technology. This article describes a simplified engineering model based on a one-dimensional thermal resistance network. The model is used to relate film-cooling effectiveness and heat transfer augmentation to local overall cooling effectiveness in a conjugate flat plate experiment. Here, this article presents experimental proof-of-concept data to demonstrate the potential for this model. In contrast to previous approaches, neither the wall heat flux nor the adiabatic wall temperature is required to estimate the local film-cooling performance parameters. The model predicts surface temperatures that are within the experimental uncertainties over the range for which the model is trained and to within five percent when the model is extrapolated to higher coolant channel Reynolds numbers. This article is relevant to conjugate test rigs that can measure the hot-surface temperature distribution with and without film cooling. This information may also be relevant to designers as a method to approximate surface temperatures or used as an approximate heat transfer model for optimization studies.

advanced turbines↗

Analysis of Fission Products on the AGR-1 Capsule Components

The components of the AGR-1 irradiation capsules were analyzed to determine the retained inventory of fission products in order to determine the extent of in-pile fission product release from the fuel compacts. This includes analysis of (1) the metal capsule components, (2) the graphite fuel holders, (3) the graphite spacers, and (4) the gas exit lines. The fission products most prevalent in the components were Ag-110m, Cs-134, Cs-137, Eu-154, and Sr-90, and the most common location was the metal capsule components and the graphite fuel holders. Gamma scanning of the graphite fuel holders was also performed to determine spatial distribution of Ag-110m and radiocesium. Silver was released from the fuel components in significant fractions. The total Ag-110m inventory found in the capsules ranged from 1.2×10 -2 (Capsule 3) to 3.8×10 -1 (Capsule 6). Ag-110m was not distributed evenly in the graphite fuel holders, but tended to concentrate at the axial ends of the graphite holders in Capsules 1 and 6 (located at the top and bottom of the test train) and near the axial center in Capsules 2, 3, and 5 (in the center of the test train). The Ag-110m further tended to be concentrated around fuel stacks 1 and 3, the two stacks facing the ATR reactor core and location of higher burnup, neutron fluence, and temperatures compared with Stack 2. Detailed correlation of silver release with fuel type and irradiation temperatures is problematic at the capsule level due to the large range of temperatures experienced by individual fuel compacts in each capsule. A comprehensive Ag-110m mass balance for the capsules was performed using measured inventories of individual compacts and the inventory on the capsule components. For most capsules, the mass balance was within 11% of the predicted inventory. The Ag-110m release from individual compacts often exhibited a very large range within a particular capsule.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Deploying Adversarial Attacks in Super-Resolution Models

Reliable super-resolution methods are crucial for applications like remote sensing, grid resilience and disaster impact analysis, and standoff biometrics. These methods infuse additional high-frequency information into reconstructions, allowing for better contextualization and image intelligence. However, super-resolution models can also introduce hallucinations or other unseen vulnerabilities that could be exploited by an adversary. This is further compounded by the prominence of deep learning in these models, as models are often blindly applied on out-of-distribution images. In this work, we implement adversarial attacks in common open-source super-resolution models and examine their impact on reconstructions and downstream classification tasks. We find that an adversarially trained super-resolution model can produce high-quality reconstructions that degrade downstream classifications. Moreover, these attacks do not require access to low-resolution imagery or class labels at inference time. These results demonstrate the vulnerability of super-resolution methods to malicious actors and motivates the development of a detector for super-resolution adversarial attacks. Further exploration of adversarial attacks in this domain is required to ensure trustworthiness and robustness of super-resolution models for national security applications.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Reconstruction of Six-Dimensional Phase Space

A phase space is a mathematical representation of all possible physical states of a system. Particle beams at Fermilab exist within a six-dimensional (6D) phase space defined by three positional components, (x, y, z) and three momentum components, (px, py, pz). To reconstruct this space implies taking measurement data from detectors and mapping out particle behavior using computational methods. The beam detectors, however, are only able to detect spatial distribution among the events of the beam, therefore being limited to positional data. Also, due to the vast number of events in a particle beam, it is extremely difficult to analyze and differentiate every single one’s behavior. However, with Machine Learning (ML), which can distinguish between patterns and map out particle behavior more efficiently. We first used the particle beam software, G4beamline, to simulate a 10,000-event muon beam, adjusting parameters such as initial momentum magnitude (p¬0) and virtual detector position. Using ten virtual detectors, we analyzed p0 values such that minimum 9,990 events were analyzed by every detector. We then input the data from these beam simulations to a C++ program, that randomly selects 100 events, and creates a 2D histogram based on spatial distribution, detector position, and event intensity. This process is repeated 100 times to create 100 histograms per p0 value. These images were then input to a modified ResNet18 Convolutional Neural Network (CNN) for training, and to predict p0 from some unseen set of histograms. The model was accurate when trained on momentum increments of 5 MeV/c and provided with denser training samples around highly variable test values. These results displayed machine learning being able to accurately predict p0 from being trained on different particle behaviors.

Shirlee, Jermain [Fermilab]↗

Deep Learning without Global Optimization by Random Fourier Neural Networks

Here we introduce a new training algorithm for deep neural networks that utilize random complex exponential activation functions. Our approach employs a Markov chain Monte Carlo sampling procedure to iteratively train network layers, avoiding global and gradient-based optimization while maintaining error control. It consistently attains the theoretical approximation rate for residual networks with complex exponential activation functions, determined by network complexity. Additionally, it enables efficient learning of multiscale and high-frequency features, producing interpretable parameter distributions. Despite using sinusoidal basis functions, we do not observe Gibbs phenomena in approximating discontinuous target functions.

97 MATHEMATICS AND COMPUTING↗

What Are Medical Students in the United States Learning About Radiation Oncology? Results of a Multi-Institutional Survey

Purpose: The purposes of this study were to assess the exposure that medical students (MSs) have to radiation oncology (RO) during the course of their medical school career, as evidenced by 2 time points in current medical training (ie, first vs fourth year; MS1s and MS4s, respectively) and to assess the knowledge of MS1s, MS4s, and primary care physicians (PCPs) about the appropriateness of RT in cancer management in comparison with RO attendings. Methods: We developed and beta tested an electronic survey divided into 3 parts: RO job descriptions, appropriateness of RT, and toxicities of RT. The surveys were distributed to 7 medical schools in the United States. A concordance of >90% (either yes or no) among RO attendings in an answer was necessary to determine the correct answer and to compare with other subgroups using a χ{sup 2} test (P<.05 was significant). Results: The overall response rate for ROs, MS1s, MS4s, and PCPs was 26%; n (22 + 315 + 404 + 43)/3004. RT misconceptions decreased with increasing level of training. More than 1 of 10 MSs did not believe that RT alone could cure cancer. Emergent oncologic conditions for RT (eg, spinal cord compression, superior vena cava syndrome) could not be identified by >1 of 5 respondents. Multiple nontoxicities of RT (eg, emitting low-level radiation from the treatment site) were incorrectly identified as toxicities by >1 of 5 respondents. MS4s/PCPs with an RO rotation in medical school had improved scores in all prompts. Conclusions: Although MS knowledge of general RT principles improves from the first to the fourth year, a large knowledge gap still exists between MSs, current PCPs, and ROs. Some basic misconceptions of RT persist among a minority of MSs and PCPs. We recommend implementing formal education in RO fundamentals during the core curriculum of medical school.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Adaptive Learning for Concept Drift in Application Performance Modeling

Supervised learning is a promising approach for modeling the performance of applications running on large HPC systems. A key assumption in supervised learning is that the training and testing data are obtained under the same conditions. However, in production HPC systems these conditions might not hold because the conditions of the platform can change over time as a result of hardware degradation, hardware replacement, software upgrade, and configuration updates. These changes could alter the data distribution in a way that affects the accuracy of the predictive performance models and render them less useful; this phenomenon is referred to as concept drift. Ignoring concept drift can lead to suboptimal resource usage and decreased efficiency when those performance models are deployed for tuning and job scheduling in production systems. To address this issue, we propose a concept-drift-aware predictive modeling approach that comprises two components: (1) an online Bayesian changepoint detection method that can automatically identify the location of events that lead to concept drift in near-real time and (2) a moment-matching transformation inspired by transfer learning that converts the training data collected before the drift to be useful for retraining. We use application input/output performance data collected on Cori, a production supercomputing system at the National Energy Research Scientific Computing Center, to demonstrate the effectiveness of our approach. The results show that concept-drift-aware models obtain significant improvement in accuracy; the median absolute error of the best-performing Gaussian process regression improved by 58.8% when the proposed approaches were used.

adaptive learning↗

Real Time-Optimal Power Flow-Based Distributed Energy Resource Management System (DERMS)

This project aims to promote lab-proven clean energy technology to commercially scalable versions of the technology, integrate the technology with broader systems, provide extended performance data, and validate the manufacturability and reliability of the technology. The lab-proven technology, RT-OPF DERMS, was developed and validated through previous U.S. Department of Energy-funded efforts, including Advanced Research Projects Agency-Energy funding under the Network Optimized Distributed Energy Systems program and Holy-Cross Energy High Impact Project. In the Advanced Research Projects Agency-Energy Network Optimized Distributed Energy Systems project, the RT-OPF DERMS was developed and implemented in multiple hardware platforms, demonstrating its performance and capabilities in the lab and field environments. The technology was also evaluated and matured via a participation in the U.S. Department of Energy I-Corps program, whose goal is to pair teams of researchers with industry mentors for an intensive 2-month training in which the researchers define technology value propositions, conduct customer discovery interviews, and develop viable market pathways for their technologies. These activities indicate the high technology maturity and Technology Readiness Level of the RT-OPF DERMS.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Upper troposphere dust belt formation processes vary seasonally and spatially in the Northern Hemisphere

Dust aerosols impact global energy balance substantially by acting as efficient ice nuclei to alter cold cloud properties. However, the estimate of dust indirect effect remains uncertain due to simulating dust distributions poorly and lacking reliable dust observations, especially in the upper-troposphere. Here, we characterize and understand upper-troposphere dust sources and transport with an improved dust dataset derived from A-train satellite lidar and radar measurements and an air parcel trajectory model. The distinct upper-troposphere dust belt over the northern hemisphere has seasonally varying base and top heights of 3.65 ± 2.84 and 8.35 ± 1.50 km above mean sea level and its column loading is strongest during spring (March-April-May). The out-of-phase annual cycles of mid-level dust concentration and westerly wind over source regions control the seasonal upper-tropospheric dust loading variations. African deserts contribute the most (46.3%) to the upper-troposphere dust belt in spring and the synoptic trough is the leading (49%) dust lifting mechanism.

54 ENVIRONMENTAL SCIENCES↗