Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Circumventing data imbalance in magnetic ground state data for magnetic moment predictions

Abstract Magnetic materials play a crucial role in the transition to more sustainable forms of energy and electric vehicles. There is an anticipated shortage in magnetic materials in the future, and as a result there is an urgent need to discover and design new magnetic materials. Computational magnetic material design using density functional theory is daunting because of the challenge in identifying magnetic ground states from a combinatorially large set of possibilities. Machine learning offers a path forward by enabling efficient surrogate models that can more readily enumerate these states, but there is a dearth of training data available, and what is available tends to be imbalanced with too much non-magnetic data. In this work we show that the discrete and previously tackled data imbalance that exists at the level of the magnetic ordering leads to an imbalanced continuous distribution with many zeros when the data is unraveled at the atomic magnetic moment level, which subsequently leads to models with low accuracy for magnetic properties. We mitigate this by using a two-part model framework. Our scheme is able to classify atoms into magnetic and non-magnetic with an F1 score and Matthew’s correlation coefficient (MCC) of ~91% and then to provide an implicit embedding representation that maps directly onto the magnitude of the magnetic moment with a mean absolute error of 0.1 μ B . Beyond screening for new magnetic materials, we demonstrate an additional practical use case of our scheme: the provision of good initial guesses for magnetic moments in first-principles electronic relaxations. Such initialization is shown to lead to faster convergence to configurations that lie closer to the ground state.

Computer Science↗

The macroevolution of filamentation morphology across the Saccharomycotina yeast subphylum

Saccharomycotina is a subphylum of ascomycete fungi with diverse asexual growth morphologies. Filamentous growth can comprise linear and branched budding cells that do not undergo cell separation, termed pseudohyphae, or tubular filaments with septa that perforate allowing movement of organelles, termed true hyphae. We integrated phenotypic, genomic, metabolic, and environmental data on isolation sources from 1051 species to examine the variation and evolutionary history of filamentation across Saccharomycotina and determine whether these data could predict filamentation types. We found that 63.37% of strains can form filaments; 6.56% true hyphae, 42.40% pseudohyphae, and 14.39% both true hyphae and pseudohyphae. The distributions of species that can produce true hyphae or filament were more strongly correlated with the yeast phylogeny than the distribution of species with pseudohyphae. Ancestral state reconstruction suggested that true hyphal and pseudohyphal morphologies evolved several times, that most yeast ancestors likely produced pseudohyphae or lacked filaments, and that the Saccharomycotina last common ancestor likely produced pseudohyphae but not true hyphae. Machine learning models trained on genomic and metabolic features predicted filament morphologies with ∼70% accuracy. Connecting the evolution of morphologies to their genomic, physiological, and ecological characteristics will enrich our understanding of how the diversity of lifestyles evolved in Saccharomycotina.

Saccharomycotina↗

Weakly supervised anomaly detection for resonant new physics in the dijet final state using proton-proton collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

An anomaly detection search for narrow-width resonances beyond the Standard Model that decay into a pair of jets is presented. The search is based on 139 fb −1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded during 2015–2018 with the ATLAS detector at the Large Hadron Collider. The analysis is optimized without a particular signal model and aims to be sensitive to a broad range of new physics. It uses two different machine learning strategies to estimate the background in different signal regions. In each region, a weakly supervised classifier is trained to distinguish this background model from data. The analysis focuses on events with high transverse momentum jets reconstructed as large-radius jets. The mass and substructure of these jets are used as inputs to the classifiers. After a classifier-based selection, the distribution of the invariant mass of the two jets is used to search for potential local excesses. The model-independent results of both the anomaly detection methods show no signs of significant local excesses. In addition to model-independent results, a representative set of signal models is injected into the data, and the sensitivity of the methods to these scenarios is reported.

Aad, G. [Aix-Marseille Université] (ORCID:00000002↗

Dual heuristic dynamic programing control of grid-connected synchronverters

A new approach to control a grid-connected synchronverter by using a dual heuristic dynamic programing (DHP) design is presented. The disadvantages of conventional synchronverter controller such as the challenges to cope with nonlinearity, uncertainties, and non-inductive grids are discussed. To deal with the aforementioned challenges a neural network–based adaptive critic design is introduced to optimize the associated cost function. The characteristic of the neural networks facilitates the performance under uncertainties and unknown parameters (e.g. different power angles). The proposed DHP design includes three neural networks: system NN, action NN, and critic NN. The simulation results compare the performance of the proposed DHP with a traditional PI-based design and with a neural network predictive controller. It is shown a well-trained DHP design performs in a trajectory, which is more optimal compared to the other two controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Warming Pattern over the Northern Hemisphere Midlatitudes in Boreal Summer 1979–2020

Abstract Significant surface air temperature warming during summer 1979–2020 is not uniformly distributed in the northern midlatitudes over land but rather is confined to several longitudinal sectors including Europe, central Siberia and Mongolia, and both coasts of North America. These hot spots are accompanied by a chain of high pressure ridges from an anomalous, circumglobal Rossby wave train in the upper troposphere. From reanalysis data and several baseline experiments from phase 6 of the Coupled Model Intercomparison Project (CMIP6), we find that the circulation trend pattern is associated with fluctuations of the Atlantic multidecadal variability (AMV) and the interdecadal Pacific oscillation. The phase shift of AMV in the 1990s is particularly noteworthy for accelerating warming averaged over the northern midlatitude land. The amplitude of the observed trend in both surface air temperature and the upper-level geopotential height generally falls beyond the range of multidecadal trends simulated by the CMIP6 preindustrial control runs, supporting the likelihood that anthropogenic forcing played a critical role in the observed trend. On the other hand, the fidelity of the simulated low-frequency modes of variability and their teleconnections, especially on multidecadal time scales, is difficult to assess because of the relatively short observational records. Our mechanistic modeling results indicate that synoptic eddy–mean flow interaction is a key to the formation of the anomalous wave train but how the multidecadal modes can modulate the synoptic eddies through atmosphere–ocean and atmosphere–land interactions remains poorly understood. This gap in our knowledge makes it challenging to quantify the roles of the low-frequency modes and external forcings in causing the observed multidecadal trends.

54 ENVIRONMENTAL SCIENCES↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks. Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Bridging the Gap between Cosmological Simulations with Graph Neural Networks and Domain Adaptation

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross dataset tasks (up to 28% better relative error and up to almost an order of magnitude better χ 2 ). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

97 MATHEMATICS AND COMPUTING↗

CESER I-Corps (Final Report)

Energy I-Corps is a U.S. Department of Energy (DOE) sponsored entrepreneurial training program for laboratory researchers aimed at accelerating the commercialization of lab-developed technologies. The program, developed and managed by DOE's Office of Technology Commercialization (OTC) in partnership with the National Laboratory of the Rockies (NLR), uses a customized curriculum built on the Lean Launch Methodology and delivers a rigorous 10- to 12-week training program to selected laboratory-based teams. The Energy I-Corps team at NLR worked with the DOE's OTC and Office of Cybersecurity, Energy Security, and Emergency Response (CESER) to develop and implement commercialization programming for awardees of the CESER Cybersecurity for Distributed Energy Resources Research, Development, and Demonstration Research Call, funded under Provision 40125(b) of the Infrastructure Investment and Jobs Act (IIJA). 40125(b) Projects were overseen by a technical monitor at the National Energy Technology Laboratory (NETL). The CESER Energy I-Corps Program is considered an Energy I-Corps "lite" or "mini" program, with a lighter lift to accommodate scheduling and funding per participant. This final report describes the CESER I-Corps program and provides recommendations on behalf of OTC to CESER to consider if CESER were to run an I-Corps program in future.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Radiation Signature Training Device Gamma Equivalent Spheres

Radiation signature training device sources are a continuation of a previous effort to produce a highly enriched uranium equivalent sphere. The original research was designed and motivated to produce a Department of Transportation special form source that emulated the passive gamma signature of a solid metal highly enriched uranium sphere. In addition, the mass reduction (i.e., of the 235 U) minimized logistical costs (security, criticality safety, radiological safety and transportation requirements). Radiation signature training device sources expand on the original concept, redesigning the encapsulation in a modular fashion that allows a variety of loadings. The result is a reconfigurable special nuclear material source set that can vary greatly in the magnitude of the gamma flux and the isotopic distribution. Use of the source to test a variety of standards (N42.34-2015, N42.38-2015, N42.43-2015, N42.53-2018, N42.48-2018, DHS-TCS Backpack Based Radiation Detection Systems, DHS-TCS Handheld Instruments Used for the Detection and Identification of Radionuclides, DHS-TCS Vehicle Mounted Mobile Systems) will be discussed.

Blessinger, Christopher S.↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $\chi^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

In-Situ Acoustic Measurements of Temperature Profile in Extreme Environments

A gasifier’s temperature is the primary characteristic that must be monitored to ensure its performance and the longevity of its refractory. One of the key technological challenges impacting the reliability and economics of coal and biomass gasification is the lack of temperature sensors that are capable of providing accurate, reliable, and long-life performance in an extreme gasification environment. This research has proposed, demonstrated, and validated a novel approach that uses a noninvasive ultrasound method that provides real-time temperature distribution monitoring across the refractory, especially the hot face temperature of the refractory. The essential idea of the ultrasound measurements of segmental temperature distribution is to use an ultrasound propagation waveguide across a refractory that has been engineered to contain multiple internal partial reflectors at known locations. When an ultrasound excitation pulse is introduced on the cold side of the refractory, it will be partially reflected from each scatterer in the US propagation path in the refractory wall and returned to the receiver as a train of partial echoes. The temperature in the corresponding segment can be determined based on recorded ultrasonic waveform and experimentally defined relationship between the speed of sound and temperature. The ultrasound measurement method offers a powerful solution to provide continuous real time temperature monitoring for the occasions that conventional thermal, optical and other sensors are infeasible, such as the impossibility of insertion of temperature sensor, harsh environment, unavailable optical path, and more. Our developed ultrasound system consists of an ultrasound engineered waveguide, ultrasound transducer/receiver, and data acquisition, logging, interpretation, and online display system, which is simple to install on the existing units with minimal modification on the gasifier or use with new units. This system has been successfully tested with a 100 kW pilot scale down flow oxyfuel combustor, capturing in real time temperature changes during all relevant combustion process changes. The ultrasound measurements have excellent agreement with thermo- couple measurements, and appear to be more sensitive to temperature changes before the thermocouples response, which is believed to be the first demonstration of ultrasound measurements segmental temperature distribution across refractories.

47 OTHER INSTRUMENTATION↗

A Survey on Sustainable Software Ecosystems to Support Experimental and Observational Science at Oak Ridge National Laboratory

In the search for a sustainable approach for software ecosystems that supports experimental and observational science (EOS) across Oak Ridge National Laboratory (ORNL), we conducted a survey to understand the current and future landscape of EOS software and data. This paper describes the survey design we used to identify significant areas of interest, gaps, and potential opportunities, followed by a discussion on the obtained responses. The survey formulates questions about project demographics, technical approach, and skills required for the present and the next five years. The study was conducted among 38 ORNL participants between June and July of 2021 and followed the required guidelines for human subjects training. We plan to use the collected information to help guide a vision for sustainable, community-based, and reusable scientific software ecosystems that need to adapt effectively to: i) the evolving landscape of heterogeneous hardware in the next generation of instruments and computing (e.g. edge, distributed, accelerators), and ii) data management requirements for data-driven science using artificial intelligence.

Bernholdt, David↗

Layered CAD/CSG geometry for spatially complex radiation transport scenarios

Many spatially complex fission, fusion, and national security Monte Carlo (MC) radiation transport scenarios involve combining computer-aided design (CAD) models with constructive solid geometry (CSG) models. A layered geometry method has been implemented in the Shift MC code to address this need. With layered geometry, multiple CAD and/or CSG models can be clipped, translated, rotated, and placed in overlapping layers to form transport-ready geometries. Here, the utility of this method is demonstrated with two problems: (1) a fixed-source simulation with a layered geometry consisting of a LiDAR-generated CAD model of the Combined Arms Collective Training Facility urban environment overlaid with CSG models of a mock hotel and a detector apparatus, and (2) a k-eigenvalue calculation using a layered geometry model of the Transformational Challenge Reactor consisting of CAD fuel elements placed in a CSG core. Tallied particle flux distributions match expectations, but tracking robustness must be improved prior to general-purpose use.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Results of the Association of Directors of Radiation Oncology Programs (ADROP) Survey of Radiation Oncology Residency Program Directors

Purpose: To survey the radiation oncology residency program directors on the topics of departmental and institutional support systems, residency program structure, Accreditation Council for Graduate Medical Education (ACGME) requirements, and challenges as program director. Methods: A survey was developed and distributed by the leadership of the Association of Directors of Radiation Oncology Programs to all radiation oncology program directors. Summary statistics, medians, and ranges were collated from responses. Results: Radiation oncology program directors had implemented all current required aspects of the ACGME Outcome Project into their training curriculum. Didactic curricula were similar across programs nationally, but research requirements and resources varied widely. Program directors responded that implementation of the ACGME Outcome Project and the external review process were among their greatest challenges. Protected time was the top priority for program directors. Conclusions: The Association of Directors of Radiation Oncology Programs recommends that all radiation oncology program directors have protected time and an administrative stipend to support their important administrative and educational role. Departments and institutions should provide adequate and equitable resources to the program directors and residents to meet increasingly demanding training program requirements.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Experiential findings for sustainable software ecosystems to support experimental and observational science

In the search for a sustainable approach for software ecosystems that supports experimental and observational science (EOS) across Oak Ridge National Laboratory (ORNL), we conducted a survey to understand the current and future landscape of EOS software and data. This paper describes the survey design we used to identify significant areas of interest, gaps, and potential opportunities, followed by a discussion on the obtained responses. The survey formulates questions about project demographics, technical approach, and skills required for the present and the next five years. Here, the study was conducted among 38 ORNL participants between June and July of 2021 and followed the required guidelines for human subjects training. We plan to use the collected information to help guide a vision for sustainable, community-based, and reusable scientific software ecosystems that need to adapt effectively to: (i) the evolving landscape of heterogeneous hardware in the next generation of instruments and computing (e.g. edge, distributed, accelerators), and (ii) data management requirements for data-driven science using artificial intelligence.

97 MATHEMATICS AND COMPUTING↗

Machine-Learning Prediction of CO Adsorption in Thiolated, Ag-Alloyed Au Nanoclusters

Here we propose a machine-learning model, based on the random-forest method, to predict CO adsorption in thiolate protected nanoclusters. Two phases of feature selection and training, based initially on the Au 25 nanocluster, are utilized in our model. One advantage to a machine-learning approach is that correlations in defined features disentangle relationships among the various structural parameters. For example, in Au 25 , we find that features based on the distribution of Ag atoms relative to the CO adsorption site are the most important in predicting adsorption energies. Our machine-learning model is easily extended to other Au-based nanoclusters, and we demonstrate predictions about CO adsorption on Ag-alloyed Au 36 and Au 133 nanoclusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hierarchical Testing of a Hybrid Machine Learning‐Physics Global Atmosphere Model

Machine learning (ML)-based models have demonstrated high skill and computational efficiency, often outperforming conventional physics-based models in weather and subseasonal predictions. While prior studies have assessed their fidelity in capturing synoptic-scale atmospheric dynamics, their performance across timescales and under out-of-distribution forcing, such as +3K or +4K uniform-warming forcings, and the sources of biases remain elusive, to establish the model's reliability for Earth science. Here, we design three sets of experiments targeting synoptic-scale phenomena, interannual variability, and out-of-distribution uniform-warming forcings. We evaluate the Neural General Circulation Model (NeuralGCM), a hybrid model integrating a dynamical core with ML-based component, against observations and physics-based Earth system models (ESMs). At the synoptic scale, NeuralGCM captures the evolution and propagation of extratropical cyclones with performance comparable to ESMs. At the interannual scale, when forced by El Niño-Southern Oscillation sea surface temperature (SST) anomalies, NeuralGCM successfully reproduces associated teleconnection patterns but exhibits deficiencies in capturing nonlinear response. Under out-of-distribution uniform-warming forcings, NeuralGCM simulates similar responses in global-average temperature and precipitation and reproduces large-scale tropospheric circulation features similar to those in ESMs. Notable weaknesses include overestimating the tracks and spatial extent of extratropical cyclones, biases in the teleconnected wave train triggered by tropical SST anomalies, and differences in upper-level warming and stratospheric circulation responses to SST warming compared to physics-based ESMs. The causes of these weaknesses were explored. Despite the noted weaknesses, NeuralGCM reproduces responses across experiments reasonably and performs comparably to ESMs. By integrating a dynamical core with ML, NeuralGCM shows potential for developing ML-based ESMs.

global warming↗

Solving Seismic Wave Equations on Variable Velocity Models With Fourier Neural Operator

Here, in the study of subsurface seismic imaging, solving the acoustic wave equation is a pivotal component in existing models. The advancement of deep learning (DL) enables solving partial differential equations (PDEs), including wave equations, by applying neural networks to identify the mapping between the inputs and the solution. This approach can be faster than traditional numerical methods when numerous instances are to be solved. Previous works that concentrate on solving the wave equation by neural networks consider either a single velocity model or multiple simple velocity models, which is restricted in practice. Instead, inspired by the idea of operator learning, this work leverages the Fourier neural operator (FNO) to effectively learn the frequency domain seismic wavefields under the context of variable velocity models. We also propose a new framework paralleled FNO (PFNO) for efficiently training the FNO-based solver given multiple source locations and frequencies. Numerical experiments demonstrate the high accuracy of both FNO and PFNO with complicated velocity models in the OpenFWI datasets. Furthermore, the cross-dataset generalization test verifies that PFNO adapts to out-of-distribution velocity models. Finally, PFNO admits higher computational efficiency on large-scale testing datasets than the traditional finite-difference method. The aforementioned advantages endow the FNO-based solver with the potential to build powerful models for research on seismic waves.

58 GEOSCIENCES↗