Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Machine learning pipeline for denoising low signal-to-noise ratio and out-of-distribution transmission electron microscopy datasets

High-resolution transmission electron microscopy (HRTEM) is crucial for observing material’s structural and morphological evolution at Angstrom scales, but the electron beam can alter these processes. Devices such as CMOS-based direct-electron detectors operating in electron-counting mode can be utilized to substantially reduce the electron dosage. However, the resulting images often lead to a low signal-to-noise ratio, which requires frame integration that sacrifices temporal resolution. Several machine learning (ML) models have been recently developed to successfully denoise HRTEM images. Yet, these models are often computationally expensive, and their inference speeds on GPUs are outpaced by the imaging speed of advanced detectors, precluding in situ analysis. Furthermore, the performance of these denoising models on datasets with imaging conditions that deviate from the training datasets has not been evaluated. To mitigate these gaps, we propose a new self-supervised ML denoising pipeline specifically designed for time-series HRTEM images. This pipeline integrates a blind-spot convolution neural network with pre-processing and post-processing steps, including drift correction and low-pass filtering. Results demonstrate that our model outperforms various other ML and non-ML denoising methods in noise reduction and contrast enhancement, leading to improved visual clarity of atomic features. Additionally, the model is drastically faster than U-Net-based ML models and demonstrates excellent out-of-distribution generalization. The model’s computational inference speed is in the order of milliseconds per image, rendering it suitable for application in in-situ HRTEM experiments.

36 MATERIALS SCIENCE↗

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Artificial Intelligence for Energy Systems Cybersecurity

Artificial intelligence and machine learning systems have the potential to influence the future design and implementation of cybersecurity systems for the power grid. These systems may enhance the overall operation of the power system by leveraging and making sense of massive amounts of data. However, we must also understand how AI/ML will need to be protected from cyber threat actors. We discuss the existing insights the NREL team has developed using AI/ML systems and then present resources including ESIF and the Cyber Energy Emulation Platform that can be used to generate training data and insights. We end by offering suggestions on priority research paths for AI in cybersecurity.

artificial intelligence↗

From Bombs to Breast Cancer Imaging: Los Alamos National Laboratory

In the United States, one in eight women will be affected by breast cancer. According to the American Cancer Society, breast cancer is the most commonly diagnosed - as well as the second most fatal - cancer in American women. It is estimated that there will be nearly 200,000 diagnoses of breast cancer this year; more than 40,000 of these will be fatal. Although advances in medical technologies have greatly increased the odds of surviving the disease, the increase in screenings has not resulted in a significant reduction in the breast cancer mortality rate. Moreover, recent studies have even suggested that an increase in these methods might, in itself, cause cancer. A new tool for early detection and diagnosis of breast cancer, supported by an award from the Breast Cancer Research Program (BCRP) of the Congressionally Directed Medical Research Programs of Department of Defense, could give women a new advantage in the fight against breast cancer. This LANL-led project will integrate ultrasound tomography (UST) with recent discoveries in the field of cell and tissue biomechanics to improve breast cancer detection and characterization. UST uses ultrasound waves instead of X-rays to identify and characterize breast tumors. This technology reveals small mechanical-property changes within the breast. These changes are often the earliest signs of breast cancer. Additionally, UST is effective for women with dense breast tissue, who have a higher risk of developing breast cancer. Because the technology does not use radiation, UST can also be used as frequently as needed for women with a high risk of developing breast cancer. In contrast, mammography, the only routine breast-cancer screening tool currently available, is not effective for women with dense breast tissue and may come with unwanted side-effects caused by ionizing radiation. UST has great potential to become an alternative breast-cancer screening tool because of UST's advantages and benefits over mammography. Currently, there is fierce debate surrounding the age at which breast cancer screening should begin, and once begun, how often it should occur. The American Cancer Society recommends yearly mammograms starting at age 40. On the other hand, the U.S. Preventive Services Task Force recommends against routine so early. Rather, the Task Force recommends biennial mammography screening for women aged 50 to 74 years. The ten-year discrepancy in the onset of screening results from recent data suggesting that the frequent use of X-ray radiation during screenings could potentially increase the likelihood of developing cancer. This danger is increased by the low sensitivity and accuracy of mammograms, which sometimes require multiple screenings to yield results. Furthermore, mammograms are often not only inaccurate, but average appalling misdiagnoses rates: about 80% false positives and 15% false negatives. These misdiagnoses lead to unwarranted biopsies at an estimated health care cost of $2 billion per year, while at the same time, resulting in excessive cases of undetected cancer. As such, the National Cancer Institute recommends more studies on the advantages of types and frequency of screenings, as well as alternative screening options. The UST technology developed at LANL could be an alternative option to greatly improve the specificity and sensitivity of breast cancer screening without using ionizing radiation. LANL is developing high-resolution ultrasound tomography algorithms and a clinical ultrasound tomography scanner to conduct patient studies at the UNM Hospital. During UST scanning, the patient lies face-down while her breast, immersed in a tank of warm water, is scanned by phased-transducer arrays. UST uses recorded ultrasound signals to reconstruct a high-resolution three-dimensional image of the breast, showing the spatial distribution of mechanical properties within the breast. Breast cancers are detected by higher values of mechanical properties compared to surrounding tissues. Thus, high-resolution breast images obtained using LANL's novel UST algorithms have the potential to detect breast cancer at its earliest stage. The goal of this Multi-Team Award project is two-fold: (1) develop a novel, safe and cost-effective breast-imaging technique, and (2) improve the specificity and sensitivity of breast cancer imaging. The project is expected to integrate basic research with clinical studies, perform substantive cross-disciplinary training among scientists on the teams and involve participation of consumer advocates. Those involved in the project are optimistic about future developments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Generalized representative structures for atomistic systems

A new method is presented to generate atomic structures that reproduce the essential characteristics of arbitrary material systems, phases, or ensembles. Previous methods allow one to reproduce the essential characteristics (e.g. the chemical disorder) of a large random alloy within a small crystal structure. The ability to generate small representations of random alloys, along with the restriction to crystal systems, results from using the fixed-lattice cluster correlations to describe structural characteristics. A more general description of the structural characteristics of atomic systems is obtained using complete sets of atomic environment descriptors. These are used within for generating representative atomic structures without restriction to fixed lattices. A general data-driven approach is provided here utilizing the atomic cluster expansion (ACE) basis. The N-body ACE descriptors are a complete set of atomic environment descriptors that span both chemical and spatial degrees of freedom and are used within for describing atomic structures. The generalized representative structure (GRS) method presented within generates small atomic structures that reproduce ACE descriptor distributions corresponding to arbitrary structural and chemical complexity. It is shown that systematically improvable representations of crystalline systems on fixed parent lattices, amorphous materials, liquids, and ensembles of atomic structures may be produced efficiently through optimization algorithms. With the GRS method, we highlight reduced representations of atomistic machine-learning training datasets that contain similar amounts of information and small 40–72 atom representations of liquid phases. The ability to use GRS methodology as a driver for informed novel structure generation is also demonstrated. The advantages over other data-driven methods and state-of-the-art methods restricted to high-symmetry systems are highlighted.

atomic cluster expansion↗

DESI luminous red galaxy samples for cross-correlations

We present two galaxy samples, selected from DESI Legacy Imaging Surveys (LS) DR9, with approximately 20,000 square degrees of coverage and spectroscopic redshift distributions designed for cross-correlations such as with CMB lensing, galaxy lensing, and the Sunyaev-Zel'dovich effect. The first sample is identical to the DESI Luminous Red Galaxy (LRG) sample, and the second sample is an extended LRG sample with 2–3 times the DESI LRG density. We present the improved photometric redshifts, tomographic binning and their spectroscopic redshift distributions and imaging systematics weights, and magnification bias coefficients. The catalogs and related data products will be made publicly available. The cosmological constraints using this sample and Planck lensing maps are presented in a companion paper. Here, we also make public the new set of general-purpose photometric redshifts trained using DESI spectroscopic redshifts, which are used in this work, for all galaxies in LS DR9.

79 ASTRONOMY AND ASTROPHYSICS↗

The miniJPAS survey quasar selection – I. Mock catalogues for classification

In this series of papers, we employ several machine learning (ML) methods to classify the point-like sources from the miniJPAS catalogue, and identify quasar candidates. Since no representative sample of spectroscopically confirmed sources exists at present to train these ML algorithms, we rely on mock catalogues. In this first paper, we develop a pipeline to compute synthetic photometry of quasars, galaxies, and stars using spectra of objects targeted as quasars in the Sloan Digital Sky Survey . To match the same depths and signal-to-noise ratio distributions in all bands expected for miniJPAS point sources in the range 17.5 ≤ r < 24, we augment our sample of available spectra by shifting the original r-band magnitude distributions towards the faint end, ensure that the relative incidence rates of the different objects are distributed according to their respective luminosity functions, and perform a thorough modelling of the noise distribution in each filter, by sampling the flux variance either from Gaussian realizations with given widths, or from combinations of Gaussian functions. Finally, we also add in the mocks the patterns of non-detections which are present in all real observations. Although the mock catalogues presented in this work are a first step towards simulated data sets that match the properties of the miniJPAS observations, these mocks can be adapted to serve the purposes of other photometric surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep Convolutional Neural Networks for Distribution System Fault Classification

Faults happen very frequently in distribution systems. Identifying fault types and phases are of critical importance for outage management, fault location, and service restoration. However, this task becomes very challenging due to measurement scarcity in distribution systems. This paper is among the first few that applies deep learning techniques in distribution system fault classification. Specifically, a sequential Convolutional Neural Network(CNN)-based classifier is developed to identify fault buses and phases. The input to the CNN is the steady-state voltage and current data measured at substations. The fault identification is modeled as a multi-label classification problem. Training data under various fault scenarios are obtained in OpenDSS and Gaussian noises are added to mimic measurement errors. A case study in IEEE 13-feeder test system is conducted with single and multiple bus faults scenarios. Numerical results demonstrate the high accuracy and fast computation of the proposed deep CNN-based fault classification.

Tian, Guanyu↗

Design of a Large 5 T Superconducting Magnet for Polarized Target for JLAB Hall B 12 GeV Upgrade Clas12 Detector

Hall B at Jefferson Laboratory (JLAB) will need a 5 T, 78 cm bore polarized target magnet with a field uniformity of {Delta}B/B{sub 0} <; 10{sup -4} in a useful cylinder of the dimensions 0.04 m long x 0.02 m in diameter. The large magnet is designed with a superconducting coil that provides the solenoid with nearly perfect self shielding in order to reduce the fringe field at nearby photo multiplier tubes (PMTs) to less than 3.5 mT. Because the solenoid is also very close to the Clas12 Torus, the nearly perfect shielding provided by the self shielded solenoid greatly reduces force, field, and torque interactions with the six-coil Torus magnet. The solenoid coil consists of 18 coil modules which are made of coils mounted in aluminum plate discs. Each coil module consists of dual double pancake coils with main coils and shield coil partitioned into separate winding cavities in the aluminum plate discs to distribute and reduce radial hoop load and radial coil forces. Each coil module is effectively an enclosed aluminum box and this serves to partition the axial load and thus reduces coil axial forces. Since overall coil forces within each coil module are reduced, this will greatly reduce the number coil training quenches. This is a very important consideration for this solenoid coil because the coil cooling is adiabatic, using in-direct conduction cooling by 4.5 K supercritical helium, which will provide only a relatively small temperature stability margin. Super critical helium is used as per JLAB specification. Detail design of the coil structure, coil assembly, cold mass, and cryogenic control will be presented. The magnet protection system shall be capable of the following features: (1) quench and fault detection, (2) fast discharge of the magnet, (3) limit fault voltages to safe values, (4) monitor interlock signals to prevent unsafe operation, and (5) provide control logic necessary for safe operation of the solenoid. The instrument systems shall be capable of the following features: (1) monitors and display temperatures within the solenoid magnet, (2) measure loads or stress on the magnet suspension, (3) monitor voltages within the solenoid magnet and charging bus, (4) monitor pressures and (5) use data logging system to save all sensor data. These systems will be described and a quench analysis presented.

43 PARTICLE ACCELERATORS↗

Bayesian network ensemble as a multivariate strategy to predict radiation pneumonitis risk

Purpose: Prediction of radiation pneumonitis (RP) has been shown to be challenging due to the involvement of a variety of factors including dose–volume metrics and radiosensitivity biomarkers. Some of these factors are highly correlated and might affect prediction results when combined. Bayesian network (BN) provides a probabilistic framework to represent variable dependencies in a directed acyclic graph. The aim of this study is to integrate the BN framework and a systems’ biology approach to detect possible interactions among RP risk factors and exploit these relationships to enhance both the understanding and prediction of RP. Methods: The authors studied 54 nonsmall-cell lung cancer patients who received curative 3D-conformal radiotherapy. Nineteen RP events were observed (common toxicity criteria for adverse events grade 2 or higher). Serum concentration of the following four candidate biomarkers were measured at baseline and midtreatment: alpha-2-macroglobulin, angiotensin converting enzyme (ACE), transforming growth factor, interleukin-6. Dose-volumetric and clinical parameters were also included as covariates. Feature selection was performed using a Markov blanket approach based on the Koller–Sahami filter. The Markov chain Monte Carlo technique estimated the posterior distribution of BN graphs built from the observed data of the selected variables and causality constraints. RP probability was estimated using a limited number of high posterior graphs (ensemble) and was averaged for the final RP estimate using Bayes’ rule. A resampling method based on bootstrapping was applied to model training and validation in order to control under- and overfit pitfalls. Results: RP prediction power of the BN ensemble approach reached its optimum at a size of 200. The optimized performance of the BN model recorded an area under the receiver operating characteristic curve (AUC) of 0.83, which was significantly higher than multivariate logistic regression (0.77), mean heart dose (0.69), and a pre-to-midtreatment change in ACE (0.66). When RP prediction was made only with pretreatment information, the AUC ranged from 0.76 to 0.81 depending on the ensemble size. Bootstrap validation of graph features in the ensemble quantified confidence of association between variables in the graphs where ten interactions were statistically significant. Conclusions: The presented BN methodology provides the flexibility to model hierarchical interactions between RP covariates, which is applied to probabilistic inference on RP. The authors’ preliminary results demonstrate that such framework combined with an ensemble method can possibly improve prediction of RP under real-life clinical circumstances such as missing data or treatment plan adaptation.

60 APPLIED LIFE SCIENCES↗

Time-Based CAN Intrusion Detection Benchmark

Modern vehicles are complex cyber-physical systems made of hundreds of electronic control units (ECUs) that communicate over controller area networks (CANs). This inherited complexity has expanded the CAN attack surface by the injection of malicious messages that vary their time-based characteristics. To detect these malicious messages, time-based intrusion detection systems (IDS) have been proposed. However, time-based IDS are usually trained and tested on low-fidelity datasets with unrealistic labeled attacks. This makes difficult the task of evaluating, comparing, and validating IDS. Here we detail and benchmark four time-based IDS in a dataset with real and advanced attacks. We found that methods with strong assumptions regarding the distribution of inter-arrival times have lower performance than distribution agnostic based methods. In particular, distribution agnostic based methods outperform distribution based methods at least on $55\%$ in area under the precision-recall (AUC-PR) curve. Our results expand the body of knowledge of CAN time-based IDS by providing details of these methods and reporting their results when tested on datasets with real and advanced attacks. We describe limitations, open challenges, and how lessons learnt from this research can inform the design of deployable time-based IDS in modern vehicles.

Blevins, Deborah↗

A Data-Driven Framework for Automated Detection of Aircraft-Generated Signals in Seismic Array Data Using Machine Learning

Abstract Ground motions associated with aircraft overflights can cover a significant portion of the seismic data collected by shallowly emplaced seismometers, such as new nodal and Distributed Acoustic Sensing systems. This article describes the first published framework for automated detection of aircraft on single channel and multichannel seismic data. The seismic data are converted to spectrograms in a sliding time window and classified as aircraft or nonaircraft in each window using a deep convolutional neural network trained with analyst-labeled data. A majority voting scheme is used to convert the output from the sequence of sliding time windows onto a decision time sequence for each channel and to combine the binary classifications on the decision time sequences across multiple channels. Precision, recall, and F-score are used to quantify the detection performance of the algorithm on nodal data using fourfold time-series cross validation. By applying our framework to data from the Sage Brush Flats nodal array in Southern California, we provide a benchmark performance and demonstrate the advantage of using an array of sensors.

Geochemistry & Geophysics↗

Classification of Broad Absorption Line Quasars with a Convolutional Neural Network

Quasars that exhibit blueshifted, broad absorption lines (BAL QSOs) are an important probe of black hole feedback on galaxy evolution. Yet the presence of BALs is also a complication for large spectroscopic surveys that use quasars as cosmological probes because the BAL features can affect redshift measurements and contaminate information about the matter distribution in the Lyα forest. We present a new BAL QSO catalog for quasars in the Sloan Digital Sky Survey (SDSS) Data Release 14 (DR14). As the SDSS DR14 quasar catalog has over 500,000 quasars, we have developed an automated BAL classifier with a Convolutional Neural Network (CNN). We trained our CNN classifier on the C IV λ 1549 region of a sample of quasars with reliable human classifications, and compared the results to both a dedicated test sample and visual classifications from the earlier SDSS DR12 quasar catalog. Our CNN classifier correctly classifies over 98% of the BAL quasars in the DR12 catalog, which demonstrates comparable reliability to human classification. The disagreements are generally for quasars with lower signal-to-noise ratio spectra and/or weaker BAL features. Our new catalog includes the probability that each quasar is a BAL, the strength, blueshifts and velocity widths of the troughs, and similar information for any Si IV λ 1398 BAL troughs that may be present. We find significant BAL features in 16.8% of all quasars with 1.57 < z < 5.56 in the SDSS DR14 quasar catalog.

79 ASTRONOMY AND ASTROPHYSICS↗

Battery inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 30 kW off-the-shelf grid following battery inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.9 to 1.1 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59 Hz to 61 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Coastal Zone Classification from Satellite Imagery

The author has identified the following significant results. Studies of cover distribution along Delaware's coast, especially in tidal wetlands, were made utilizing semi-automated analysis of LANDSAT-1 MSS digital data. Cover maps with eleven vegetation and other cover categories were produced with accuracy of identification above 80% in all categories. Recent studies have tested a new technique for training automated analysis which uses ground measured reflectance and atmospheric correction techniques to derive signatures for specific categories in preference to the relative radiance signatures derived from training sets within the LANDSAT data itself. Initial tests using a four category scheme indicate that training data based on absolute measured reflectance and atmospheric correction of LANDSAT data can produce comparable accuracy of categorization to that achieved using more conventional relative radiance training.

Klemas, V.↗

Coastal zone classification from satellite imagery

The author has identified the following significant results. Studies of cover distribution along Delaware's coast, especially in tidal wetlands, were made, utilizing semi-automated analysis of LANDSAT-1 MSS digital data. Cover maps with eleven vegetation and other cover categories were produced with accuracy of identification above 80% in all categories. Recent studies have tested a new technique for training automated analysis which uses ground measured reflectance and atmospheric correction techniques to derive signatures for specific categories in preference to the relative radiance signatures derived from training sets within LANDSAT data itself. Initial tests using a four category scheme indicate that training data based on absolute measured reflectance and atmospheric correction of LANDSAT data can produce comparable accuracy of categorization to that achieved using more conventional relative radiance training. The analysis of the same four categories produced average categorization accuracies of 82.1% by conventional reflative radiance training and 81.9% by use of absolute reflectance signatures.

Klemas, V.↗

NATO Human View Architecture and Human Networks

The NATO Human View is a system architectural viewpoint that focuses on the human as part of a system. Its purpose is to capture the human requirements and to inform on how the human impacts the system design. The viewpoint contains seven static models that include different aspects of the human element, such as roles, tasks, constraints, training and metrics. It also includes a Human Dynamics component to perform simulations of the human system under design. One of the static models, termed Human Networks, focuses on the human-to-human communication patterns that occur as a result of ad hoc or deliberate team formation, especially teams distributed across space and time. Parameters of human teams that effect system performance can be captured in this model. Human centered aspects of networks, such as differences in operational tempo (sense of urgency), priorities (common goal), and team history (knowledge of the other team members), can be incorporated. The information captured in the Human Network static model can then be included in the Human Dynamics component so that the impact of distributed teams is represented in the simulation. As the NATO militaries transform to a more networked force, the Human View architecture is an important tool that can be used to make recommendations on the proper mix of technological innovations and human interactions.

Handley, Holly A. H.↗