Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Conditional Experts for Improved Building Damage Assessment Across Satellite Imagery View Angles

Rapid building damage assessment (BDA) is vital in guiding disaster response missions and estimating population distribution across impacted areas. While commercial satellite imagery providers have enabled near-daily monitoring of the Earth, near-realtime assessment of disaster scenarios frequently requires analysis of off-nadir imagery, as satellites are often far from impacted areas for at-nadir post-event imaging to occur Such scenarios are, however, underrepresented in existing BDA datasets and methodologies. With this motivation, we investigate generalization capabilities of current BDA practices across overhead view-angles and strategies for their improvement. Using a labeled dataset of images capturing conflict-related damages, we first train a baseline BDA architecture using imbalanced and balanced datasets with respect to view-angle. Then, we explore conditional convolutions parameterized on image features, image nadir, and their combination as a mechanism for conditioning on view-angles. Experiments demonstrate the limitations of current practice and the potential of conditional mechanisms to increase model robustness to view-angle variations.

Ambrozio Dias, Philipe↗

ML-Based Power System Stability Assessment Considering Network Topology Changes: WECC 20,000+ Bus System Case Study

Modern power grids are fast-changing and thus require real-time monitoring and online stability assessment. With the rapid development of machine learning (ML) techniques, using data-driven models to provide fast and accurate estimations of power system stability marginal information, such as frequency nadir for frequency stability and critical clearing time (CCT) for transient stability, have become possible. However, despite the numerous research on ML-based methods for frequency nadir and CCT prediction, there is limited work on the impact of different network topology changes. Furthermore, most previous studies only focused on small or synthetic systems, and there is a lack of research on actual large power system models. In this paper, the above issues are addressed by studying the actual U.S. Western Electricity Coordinating Council (WECC) system model with more than 20,000 buses. Massive simulations are conducted in PowerWorld Simulator to study the impact of various topology change scenarios on both frequency stability and transient stability. System operating information is extracted from the success dispatch cases of various network topologies to generate a comprehensive dataset for ML-based models. Two ML methods, random forest (RF) and multilayer perceptron (MLP) neural network, are trained and tested for both frequency nadir prediction and CCT prediction. Test results have proven the models are capable of online stability assessment for large power networks such as the WECC system with sufficient accuracy.

critical clearing time↗

PreMevE Update: Forecasting Ultra-Relativistic Electrons Inside Earth's Outer Radiation Belt

Energetic electrons inside Earth's Van Allen belts pose a major radiation threat to spaceborne electronics that often play vital roles in modern society. Ultra-relativistic electrons with energies greater than or equal to two megaelectron-volt (MeV) are of particular interest, and thus forecasting these ≥2 MeV electrons has a significant meaning to all space sectors. Here, we update the latest development of the predictive model for MeV electrons in the outer radiation belt. The new version, called PREdictive MEV Electron (PreMevE)-2E, forecasts ultra-relativistic electron flux distributions across the outer belt, with no need for in situ measurements of the trapped MeV electron population except at the geosynchronous orbit (GEO). Model inputs include precipitating electrons observed in low-Earthorbits by NOAA satellites, upstream solar wind speeds and densities from solar wind monitors, as well as ultra-relativistic electrons measured by one Los Alamos GEO satellite. We evaluated 32 supervised machine learning models that fall into four different classes of linear and neural network architectures, and successfully tested ensemble forecasting by using groups of top-performing models. All models are individually trained, validated, and tested by in situ electron data from NASA's Van Allen Probes mission. It is shown that the final ensemble model outperforms individual models at most L-shells, and this PreMevE-2E model can provide 25-h (~1-day) and 50-h (~2-day) forecasts with high mean performance efficiency and correlation values. Our results also suggest that this new model is dominated by nonlinear components at L-shells <~4 for ultra-relativistic electrons, different from the dominance of linear components for 1 MeV electrons as previously discovered.

79 ASTRONOMY AND ASTROPHYSICS↗

GridDS: Data Science Toolkit for Energy Grid Data

According to the U.S. Energy Information Administration (EIA), the demand for energy is expected to increase 50% by the year 20501. While energy standards, such as the Institute of Electrical and Electronics Engineers (IEEE) Standard 1547, (Basso 2015) and monitoring with wide area management systems (WAMS) (Liu 2017, Zhou 2016) have enabled large scale data collection and storage, the application of this data in mitigating costs associated with increased consumer demand is an ongoing focus for energy research. This ubiquitous data collection presents a promising opportunity for machine learning and data science to improve efficiency of distributed energy resources (DERs). The GridDS software toolkit is designed to leverage advanced metering infrastructure (AMI), outage management systems data (OMS), Supervisory control Data Acquisition (SCADA), and geographic information systems (GIS) to forecast future energy demands and detect incipient grid failures. GridDS is a python software library designed to be modular and generalizable to data recorded by DERs. In adapting to disparate datasets recorded by various WAMS, GridDS provides a range of unique functionality not presently implemented in current WAMS which have highly specific software infrastructure by design. GridDS functionality ranges from data specification and preparation, to training and validation for state of the art machine learning, to interactive data visualization. For data intake, GridDS combines: Pandera: a library for creating data specifications. TimeScaleDB: a postgresSQL database infrastructure for efficient storage of timeseries data. Dataset class: A custom dataset class / interface that ensures modularity between a range of synthetic and live recorded datasets. Is

Ladd, Alexander↗

HyMARC Seedling: Optimized Hydrogen Adsorbents via Machine Learning and Crystal Engineering

This final report is presented in two parts: In Part 1, the H 2 capacities of a diverse set of 918,734 metal-organic frameworks (MOFs) sourced from 19 databases is predicted via machine learning (ML). Using only 7 structural features as input, ML identifies 8,282 MOFs with the potential to exceed the capacities of state-of-the-art materials. The identified MOFs are predominantly hypothetical compounds having low densities (<0.31 g/cm3) in combination with high surface areas (>5,300 m2/g), void fractions ($0.90), and pore volumes (>3.3 cm3/g). The relative importance of the input features are characterized, and dependencies on the ML algorithm and training set size are quantified. The most important features for predicting H 2 uptake are pore volume (for gravimetric capacity) and void fraction (for volumetric capacity). The ML models are available on the web, allowing for rapid and accurate predictions of the hydrogen capacities of MOFs from limited structural data; the simplest models require only a single crystallographic feature. In part 2, ways to improve the poor powder packing density of MOFs is discussed. More specifically, a strategy that improves packing efficiency and volumetric hydrogen gas storage density dramatically through engineered morphologies and controlled-crystal size distributions is presented that holds promise for maximizing storage capacity for a given MOF. The packing density improvement, demonstrated for the benchmark sorbent MOF-5, leads to a significant enhancement of volumetric hydrogen storage performance relative to commercial MOF-5. System model projections demonstrate that engineering of crystal morphology/size or use of a bimodal distribution of cubic crystal sizes in tandem with system optimization can surpass the 25 g/L volumetric capacity of a typical 700 bar compressed storage system and exceed the DOE targets 2020 volumetric capacity (30 g/L). Finally, a critical link between improved powder packing density and reduced damage upon compaction is revealed leading to sorbents with both high surface area and high density.

08 HYDROGEN↗

On the Verification of Deep Reinforcement Learning Solution for Intelligent Operation of Distribution Grids

Capabilities of deep reinforcement learning (DRL) in obtaining fast decision policies in high dimensional and stochastic environments have led to its extensive use in operational research, including the operation of distribution grids with high penetration of distributed energy resources (DER). However, the feasibility and robustness of DRL solutions are not guaranteed for the system operator, and hence, those solutions may be of limited practical value. This paper proposes an analytical method to find feasibility ellipsoids that represent the range of multi-dimensional system states in which the DRL solution is guaranteed to be feasible. Empirical studies and stochastic sampling determine the ratio of the discovered to the actual feasible space as a function of the sample size. In addition, the performance of logarithmic, linear, and exponential penalization of infeasibility during the DRL training are studied and compared in order to reduce the number of infeasible solutions

Hosseini, Mohammad Mehdi↗

Effect of CLIQ on Training of HL-LHC Quadrupole Magnets

The high-luminosity LHC upgrade requires stronger than LHC low-beta quadrupole magnets to reach the luminosity goals of the project. The project is well advanced and HL-LHC quadrupole magnets are currently being commissioned in US Labs (MQXFA magnets) and CERN (MQXFB magnets). Those are the first Nb 3 Sn magnets to be used in any large particle accelerator. At development stages, many Nb 3 Sn accelerator sub-scale models showed relatively slow training and MQXFA magnets were projected to have low tens of quenches before reaching operational field. Recently it was shown that dedicated capacitor-based de-vices can affect Nb 3 Sn magnet training, and it was suggested that CLIQ, a capacitor-based device intended for quench protection, can do too. Here, the present paper investigates effects on training likely induced by CLIQ, using the base fact that only half the coils in a quadrupole experience upward current modulation at quench because of capacitor discharge. The study encompasses all MQXFA production magnets trained at BNL to date. No other high-statistics data from identical magnets (series) with CLIQ protection exist so far. Implications and opportunities stemming from data analysis are discussed and conclusions drawn.

43 PARTICLE ACCELERATORS↗

Modeling Capabilities to Quantify the Benefits of DERMS (Cooperative Research and Development Final Report)

The funds-in under the CRADA will fund a team of National Renewable Energy Laboratory (NREL) researchers to participate in Energy I-Corps (formerly known as Lab-Corps). Energy I-Corps pairs teams of researchers with industry mentors for an intensive two-month training where the researchers define technology value propositions, conduct customer discovery interviews, and develop viable market pathways for their technologies. FedIMPACT, LLC and its affiliate IP Group, Inc., will evaluate the work completed at Energy I-Corps to determine whether it would like to pursue further commercialization and development of related technologies and background intellectual property.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗

FY23 Update: Aerosol Sampling for the Canister Deposition Field Demonstration

This report describes the results of preliminary testing of aerosol monitoring equipment that will be used to continuously monitor the aerosol source term for the multi-year Canister Deposition Field Demonstration (CDFD). These data are required inputs for the development and validation of models for the deposition of dust and potentially corrosive salts on the surface of spent nuclear fuel (SNF) dry storage canisters. Surface salt loads correlate with the extent of corrosion damage on a metal surface, and potentially to the likelihood and timing of initiation of stress corrosion cracks. Aerosols will be monitored at the CDFD site using three instruments. A Dekati ® ELPI+ cascade impactor will be used for real-time monitoring of aerosol particle sizes. It will also collect dust in 14 size bins on impactor targets that can be chemically analyzed to determine the soluble salts present as a function of particle size. However, this instrument can only measure dried aerosols, with a diameter of <10 µm. The second instrument is a Topas laser particle size spectrometer, which provides real-time monitoring of aerosol particle sizes up to ~40 µm in size. It monitors both the ambient (potentially deliquesced) aerosol particle size distributions required for the dust deposition models and the distributions of the equivalent dried particles, allowing correlation with the Dekati ® data. However, it does not discriminate between inert dust particles and salt aerosols, and it does not retain samples of the different particle sizes for later analysis. The third instrument that will monitor aerosols at the CDFD site is a Clean Air Status and Trends Network (CASTNET) tower, which uses a multiple canister system to collect weekly samples for analysis to total suspended aerosol particle compositions and atmospheric gas concentrations. This status report describes work in FY23 to develop the capabilities for using these tools. In two training exercises, the cascade impactor and laser particle sizer were deployed in two different testing environments, one indoor and one outdoor. For the cascade impactor, the tests provided opportunities for the operators to familiarize themselves with impactor substrate preparation, and post-test sample removal and analysis. For the laser particle sizer, the tests were used to evaluate different instrument parameters, to determine the most appropriate settings for capturing transient events. Data and samples were collected for weeks to months for each test, and the results are presented here. In addition to the preliminary testing, contracts were developed with WSP Analytical Labs for sample preparation and analysis of the cascade impactor samples. The impactor tower from outdoor test was delivered to WSP and used to train the staff there in disassembly, sample extraction, sample analysis, and tower reassembly with new target substrates. These are tasks that WSP will be performing routinely for the CDFD project. The CASTNET system cannot be purchased or tested until an actual site has been selected for the CDFD test. Work for this FY has been restricted to preparation of contracts for purchasing the CASTNET tower, and for sample analysis, once the tower is in operation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Exascale granular microstructure reconstruction in 3D volumes of arbitrary geometries with generative learning

Reconstructing 3D granular microstructures within volumes of arbitrary geometries from limited 2D image data is crucial for predicting the material properties, as well as performances of structural components accounting for material microstructural effects. We present a novel generative learning framework that enables exascale reconstruction of granular microstructures within complex 3D geometric volumes. Building upon existing transfer learning techniques using pre-trained convolutional neural networks (CNN), we introduce several key innovations to overcome the difficulties inherent in arbitrary geometries. Our framework incorporates periodic boundary conditions using circular padding techniques, ensuring continuity and representativeness of the reconstructed microstructures. We also introduce a novel seamless transition reconstruction (STR) method that creates statistically equivalent transition zones to integrate multiple pre-existing 3D microstructure volumes. Based on STR, we propose a cost-effective strategy for reconstructing microstructures within complex geometric volumes, minimizing computational waste. Validation through numerical experiments using kinetic Monte Carlo simulations demonstrates accurate reproduction of grain statistics, including grain size distributions and morphology. A case study involving the reconstruction of a 4-blade propeller microstructure illustrates the method’s capability to efficiently handle complex geometries. In conclusion, the proposed framework significantly reduces computational demands while maintaining high reconstruction quality, paving the way for scalable microstructure reconstruction in materials design and analysis.

36 MATERIALS SCIENCE↗

Coherent population trapping in {sup 87}Rb atoms induced by the optical frequency comb excitation

The excitation of room-temperature four-level {sup 87}Rb atoms by a train of ultrashort pulses is investigated theoretically in the conditions when the pulse repetition period is shorter than the characteristic atomic relaxation times. It is shown that coherent accumulation of excitation leads to coherent population trapping and electromagnetically induced transparency of the excitation pulses when the pulse repetition rate is a subharmonic of the ground-state hyperfine splitting. It is illustrated how the judicious choice for the frequency comb parameters can provide a means to effectively control the degree of coherence between the ground-state hyperfine levels for selective atomic groups, and even transfer the whole atomic distribution to the dark state with up to 95% efficiency.

74 ATOMIC AND MOLECULAR PHYSICS↗

Isotope effects in molecular structures and electronic properties of liquid water via deep potential molecular dynamics based on the SCAN functional

Here, Feynman path-integral deep potential molecular dynamics (PI-DPMD) calculations have been employed to study both light (H 2 O) and heavy water (D 2 O) within the isothermalisobaric ensemble. In particular, the deep neural network is trained based on ab initio data obtained from the strongly constrained and appropriately normed (SCAN) exchange-correlation functional. Because of the lighter mass of hydrogen than deuteron, the properties of light water are more influenced by nuclear quantum effect than those of heavy water. Clear isotope effects are observed and analyzed in terms of hydrogen-bond structure and electronic properties of water that are closely associated with experimental observables. The molecular structures of both liquid H 2 O and D 2 O agree well with the data extracted from scattering experiments. The delicate isotope effects on radial distribution functions and angular distribution functions are well reproduced as well. Our approach demonstrates that deep neural network combined with SCAN functional based ab initio molecular dynamics provides an accurate theoretical tool for modeling water and its isotope effects.

36 MATERIALS SCIENCE↗

Copula based Damage Detection for Structural Health Monitoring

This project utilizes copulas for damage detection in a Structural Health Monitoring (SHM) application. A copula-based system was chosen for the benefit of multivariate joint distribution with a goal to detect damage based on how the system as a whole reacts rather than one or two sensors by themselves. Copulas are commonly used in the field of finance for risk modeling based on two or more random inputs. A few applications in the field of SHM and Non-Destructive Evaluation (NDE) have been researched mostly on risk or reliability of the structure. The goal of this project is to determine if a copula-based approach can be used for damage detection. An unsupervised learning method was desired to reduce the dimensionality, minimal training, and be a faster evaluation method than other unsupervised methods. If a copula method can be used to detect damage what additional information on the damage can be interpreted. The remainder of this report will go over the background needed, SHM methodology, SHM applications, conclusions, and future developments.

47 OTHER INSTRUMENTATION↗

TU-CD-BRA-05: Atlas Selection for Multi-Atlas-Based Image Segmentation Using Surrogate Modeling

Purpose: The growing size and heterogeneity in training atlas necessitates sophisticated schemes to identify only the most relevant atlases for the specific multi-atlas-based image segmentation problem. This study aims to develop a model to infer the inaccessible oracle geometric relevance metric from surrogate image similarity metrics, and based on such model, provide guidance to atlas selection in multi-atlas-based image segmentation. Methods: We relate the oracle geometric relevance metric in label space to the surrogate metric in image space, by a monotonically non-decreasing function with additive random perturbations. Subsequently, a surrogate’s ability to prognosticate the oracle order for atlas subset selection is quantified probabilistically. Finally, important insights and guidance are provided for the design of fusion set size, balancing the competing demands to include the most relevant atlases and to exclude the most irrelevant ones. A systematic solution is derived based on an optimization framework. Model verification and performance assessment is performed based on clinical prostate MR images. Results: The proposed surrogate model was exemplified by a linear map with normally distributed perturbation, and verified with several commonly-used surrogates, including MSD, NCC and (N)MI. The derived behaviors of different surrogates in atlas selection and their corresponding performance in ultimate label estimate were validated. The performance of NCC and (N)MI was similarly superior to MSD, with a 10% higher atlas selection probability and a segmentation performance increase in DSC by 0.10 with the first and third quartiles of (0.83, 0.89), compared to (0.81, 0.89). The derived optimal fusion set size, valued at 7/8/8/7 for MSD/NCC/MI/NMI, agreed well with the appropriate range [4, 9] from empirical observation. Conclusion: This work has developed an efficacious probabilistic model to characterize the image-based surrogate metric on atlas selection. Analytical insights lead to valid guiding principles on fusion set size design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Facility Cybersecurity Framework Best Practices

Federal facilities are increasingly adopting automation and connecting to the Internet creating an energy-internet-of-things environment that converges operational technology (OT) and information technology (IT). Today's buildings increasingly weave together networked sensors and cyber and physical systems that enable data to be collected, aggregated, exchanged, stored and monetized in new ways. Building technological advances have created new energy technology, services, markets and value creation opportunities (e.g. transactive energy, two-way grid communications, machine learning, and increased use of renewable and distributed energy resources). But as larger data sets are being exchanged at faster speeds between an increasing number of OT systems, it becomes more difficult to protect the security of the data lifecycle and the physical equipment it interacts with. These challenges are especially difficult to overcome because the economic and environmental gain (interoperability, big data, social networks and ubiquitous information sharing) are driving these prominent trends in the digital age. Often cybersecurity is an afterthought. The U.S. Department of Energy’s (DOE) Federal Energy Management Program (FEMP) funded the Pacific Northwest National Laboratory (PNNL) to develop various cybersecurity tools, trainings, and reports to aid federal facility managers – and other building owners and operators – in better applying frameworks and lessons learned from the National Institute of Standards and Technology (NIST) Cybersecurity Framework (CSF), risk management framework (RMF), DOE’s cybersecurity capability maturity model (C2M2), and a wide variety of industry best practices and guidance documents (i.e., NIST 800 series, Department of Defense United Facilities Criteria). This set of tools, collectively known as the FEMP Facility-Related Control System Cyber Toolkit (FRCS Cyber Toolkit)2, is focused on cybersecurity concerns from facility-related control systems and other operational technology (OT), such as industrial control systems (ICS). The FRCS Cyber Toolkit can be applied across six of the sixteen critical infrastructure sectors designated by the Department of Homeland Security, including government facilities, healthcare and public health, commercial facilities (e.g., public assembly, offices, lodging), financial services (e.g., banking and insurance), emergency services (e.g., fire and police stations), and information technology. With increasingly converged IT and OT systems, it is crucial to address OT cybersecurity considerations and assess how the seam of these two systems could impact the overall cybersecurity posture of a facility. The objective of this report is to provide an overview of the best possible method to use FRCS Cyber Toolkit (section 2.0) and distilled cybersecurity best practices for the federal facilities to address growing non-linear cyber threats (section 3.0). Recommendations in this document are aggregated from several NIST and other documents (see Appendix A for additional details).

97 MATHEMATICS AND COMPUTING↗

Quantitative Insight to Fission Gas Pores Distribution in Irradiated Annular U-10Zr Metallic Fuel Using Machine Learning

Metallic fuels, particularly U-10Zr and its performance in reactor irradiation conditions, have been thoroughly investigated and are a promising candidate for next-generation sodium-cooled fast spectrum nuclear reactors. Irradiation in reactors can lead to the formation of fission gas and increased pore formation which can significantly impact fuel performance. Due to the large number of pores and various phases formed in metallic fuel during irradiation, a quantitative description of fission gas pores as a function of irradiation conditions is not yet available, undermining the fidelity of fuel performance modeling to support fuel qualification. It has been difficult to clearly detect pore boundaries and distinguish matrix phases from fission gas pores using optical microscopy by using simple threshold methods working with low magnification images. The pre-trained deep learning model for fission gas pore detection was applied to ~10,260 high magnification scanning electron microscopy images. The model increased the accuracy of fission gas pore segmentation to obtain statistical features, which cannot be processed manually. A pre-trained decision tree model was used to classify pores as isolated or connected pores, providing new insight into the correlation between the movement of lanthanides, solid fission products, and the radial temperature gradient developed in fuel irradiation conditions. This paper emphasizes the potential that artificial intelligence-based machine learning models have to accelerate qualification and support nuclear fuel development.

36 MATERIALS SCIENCE↗

Simulation for Wind Turbine Generators: With FAST and MATLAB-Simulink Modules

This report presents the work done to develop generator and gearbox models in the Matrix Laboratory (MATLAB) environment and couple them to the National Renewable Energy Laboratory's Fatigue, Aerodynamics, Structures, and Turbulence (FAST) program. The goal of this project was to interface the superior aerodynamic and mechanical models of FAST to the excellent electrical generator models found in various Simulink libraries and applications. The scope was limited to Type 1, Type 2, and Type 3 generators and fairly basic gear-train models. Future work will include models of Type 4 generators and more-advanced gear-train models with increased degrees of freedom. As described in this study, implementation of the developed drivetrain model enables the software tool to be used in many ways. Several case studies are presented as examples of the many types of studies that can be performed using this tool.

17 WIND ENERGY↗