Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Learning likelihood ratios with neural network classifiers

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called “likelihood ratio trick,” approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE's) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and helping users access data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data. This paper provides an update on recent improvements made to the GDR's data lakes and automated data pipelines, including: (1) streamlining the data lake intake process, (2) better educating users on the process and requirements through a new data lakes page, (3) adding data lake direct access links to GDR data lake submission pages, (4) implementing a DAS data pipeline to convert DAS data uploaded in SEG-Y format to a standardized hierarchical data format v5 (HDF5), (5) extending this pipeline to encompass data in the GDR data lake, (6) adding metadata requirements for geospatial data, (7) making user interface/user experience (UX) enhancements to the data pipelines' documentation pages, and (8) improving the GDR's data standards and pipelines pages to better guide users in ensuring that their data is standardized by the GDR's automated data pipelines. 2024 Geothermal Resources Council. All rights reserved.

accessibility↗

MO-A-BRD-07: Feasibility of X-Ray Acoustic Computed Tomography as a Tool for Calibration and In Vivo Dosimetry of Radiotherapy Electron and Photon Beams

Purpose: This work simulates radiation-induced acoustic waves to assess the feasibility of x-ray acoustic computed tomography (XACT) as a dosimeter. XACT exploits the phenomenon that acoustic waves with amplitude proportional to the dose deposited are induced following a radiation pulse. After detecting these acoustic waves with an ultrasound transducer, an image of the dose distribution can be reconstructed in realtime. Methods: Monte Carlo was used to simulate the dose distribution for monoenergetic 6 MeV photon and 9 MeV electron beams incident on a water tank. The dose distribution for a prostate patient planned with a photon 4-field box technique was calculated using clinical treatment planning software. All three dose distributions were converted into initial pressure distributions, and transportation of the induced acoustic waves was simulated using an open-source toolkit. Ideal transducers were placed around the circumference of the target to detect the acoustic waves, and a time reversal reconstruction algorithm was used to obtain an XACT image of the dose for each radiation pulse. Results: For the photon water tank relative dosimetry case, it was found that the normalized acoustic signal amplitude agreed with the normalized dose at depths from 0 cm to 10 cm, with an average percent difference of 0.5%. For the reconstructed in-plane dose distribution of an electron water tank irradiation, all pixels passed a 3%–3 mm 2D gamma test. The reconstructed prostate dose distribution closely resembled the plan, with 89% of pixels passing a 3%–3 mm 2D gamma test. For all situations, the amplitude of the induced acoustic waves ranged from 0.01 Pa to 1 Pa. Conclusion: Based on the amplitude of the radiation-induced acoustic waves and accuracy of the reconstructed dose distributions, XACT is a feasible technique for dosimetry in both calibration and in vivo environments for photon and electron beams and merits further investigation. Funding from NSERC, CIHR and McGill University. SH acknowledges partial support by the CREATE Medical Physics Research Training Network grant of the Natural Sciences and Engineering Research Council (Grant number: 432290)

60 APPLIED LIFE SCIENCES↗

Hydrogen carriers: Production, transmission, decomposition, and storage

Recognizing the potential role of liquid hydrogen carriers in overcoming the inherent limitations in transporting and storing gaseous and liquid hydrogen, a complete production and use scenario is postulated and analyzed for perspective one-way and two-way carriers. The carriers, methanol, ammonia and toluene/MCH (methylcyclohexane), are produced at commercially viable scales in a central location, transmitted by rail or pipelines for 2000 miles, and decomposed near city gates to generate fuel-cell quality hydrogen for distribution to refueling stations. In terms of the levelized cost of H 2 distributed to the stations, methanol is less expensive to produce (1.22 dollars per kg-H 2 ) than MCH (1.35 dollars per kg-H 2 ) or ammonia (2.20 dollars per kg-H 2 ). Levelized train transmission cost is smaller for methanol (0.63 dollars per kg-H 2 ) than ammonia (1.29 dollars per kg-H 2 ) or toluene/MCH system (2.07 dollars per kg-H 2 ). Levelized decomposition cost is smaller for ammonia (0.30-1.06 dollars per kg-H 2 ) than MCH (0.54-1.22 dollars per kg-H 2 ) or methanol (0.43-1.12 dollars per kg-H 2 ). Over the complete range of demand investigated, 10-350 tpd-H 2 , the levelized cost of H2 distributed to stations is aligned as methanol « ammonia ~ MCH. With pipelines at much larger scale, 6000 tpd-H 2 , the levelized cost decreases by ~1 dollar per kg-H 2 for ammonia and MCH and much less for methanol. Methanol is a particularly attractive low-risk carrier in the transition phase with lower than 50-tpd H 2 demand.

08 HYDROGEN↗

SU-E-T-163: Characterization of a Novel High Resolution 1D Silicon Monolithic Array for Small Field Commissioning and Quality Assurance

Purpose: To study the suitability of a novel 1D silicon monolithic array for dosimetry of small radiation fields and for QA of high dose gradient treatment modalities (IMRT and SBRT). Methods: A 1D array composed of 4 monolithic silicon modules of 64 mm length and 1 mm pixel pitch was developed by IBA Dosimetry. Measurements were carried out for 6MV and 15MV photons on two commercial different linacs (TrueBeam and Clinac iX, Varian Medical Systems, Palo Alto, CA) and for a CyberKnife G4 (Accuray Inc., Sunnyvale, CA). The 1D array was used to measure output factors (OF), profiles and off axis correction factors (OACF) for the Iris CyberKnife variable collimator (5–60 mm). In addition, dose profiles (at the isocenter plane) were measured for multiple IMRT and SBRT treatment plans and compared with those obtained using EDR2radiographic film (Carestream Health, Rochester NY), a commercial 2D diode array and with the dose distribution calculated using a commercial TPS (Eclipse, Varian Medical Systems, Palo Alto, CA). Results: Due to the small pixel pitch of the detector, IMRT and SBRT plan profiles deviate from film measurements by less than 2%. Similarly, the 1D array exhibits better performance than the 2D diode array due to the larger (7 mm) pitch of that device. Iris collimator OFs measured using the 1D silicon array are in good agreement with the commissioning values obtained using a commercial stereotactic diode as well as with published data. Maximum deviations are < 3% for the smallest field (5 and 7.5mm) and below 1% for all other dimensions. Conclusion: We have demonstrated good performances of the array for commissioning of small photon fields and in patient QA, compared with diodes and film typically used in these clinical applications. The technology compares favorably with existing commercial solutions The presenting author is founded by a Marie Curie Early Initial Training Network Fellowship of the European Communitys Seventh Framework Programme under contract number (PITN-GA-2011-289198-ARDENT). The research activity is hosted by IBA Dosimetry, Gmbh.

60 APPLIED LIFE SCIENCES↗

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗

Coherency-Aware Learning Control of Inverter-Dominated Grids: A Distributed Risk-Constrained Approach

Here, this letter investigates the importance of integrating the coherency knowledge for designing controllers to dampen sustained oscillations in wide-area power networks with significant penetration of inverter-interfaced resources. Coherency is a fundamental property of power systems, where time-scale separation in frequency dynamics leads to clustered behavior among generators of different groups. Large-scale penetration of inverter-driven low inertia resources replacing conventional synchronous generators (SGs) can lead to perturbation in the coherent partitioning; hence, integrating such information is of utmost importance for oscillation control designs. We present the coherency-aware design of a distributed output feedback-based reinforcement learning method that additionally incorporates risk constraints to capture the uncertainties related to net-load fluctuations. The use of domain-aware coherency information has produced improved training and oscillation performance than the coherency-agnostic control design, hence proving to be effective in controller design. Finally, we validated the proposed method with numerical experiments on the benchmark IEEE 68-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Density estimation via measure transport: Outlook for applications in the biological sciences

Abstract One among several advantages of measure transport methods is that they allow or a unified framework for processing and analysis of data distributed according to a wide class of probability measures. Within this context, we present results from computational studies aimed at assessing the potential of measure transport techniques, specifically, the use of triangular transport maps, as part of a workflow intended to support research in the biological sciences. Scenarios characterized by the availability of limited amount of sample data, which are common in domains such as radiation biology, are of particular interest. We find that when estimating a distribution density function given limited amount of sample data, adaptive transport maps are advantageous. In particular, statistics gathered from computing series of adaptive transport maps, trained on a series of randomly chosen subsets of the set of available data samples, leads to uncovering information hidden in the data. As a result, in the radiation biology application considered here, this approach provides a tool for generating hypotheses about gene relationships and their dynamics under radiation exposure.

gene expression data↗

Application of Failure Mode and Effects Analysis to Intraoperative Radiation Therapy Using Mobile Electron Linear Accelerators

Purpose: Failure mode and effects analysis (FMEA) represents a prospective approach for risk assessment. A multidisciplinary working group of the Italian Association for Medical Physics applied FMEA to electron beam intraoperative radiation therapy (IORT) delivered using mobile linear accelerators, aiming at preventing accidental exposures to the patient. Methods and Materials: FMEA was applied to the IORT process, for the stages of the treatment delivery and verification, and consisted of three steps: 1) identification of the involved subprocesses; 2) identification and ranking of the potential failure modes, together with their causes and effects, using the risk probability number (RPN) scoring system, based on the product of three parameters (severity, frequency of occurrence and detectability, each ranging from 1 to 10); 3) identification of additional safety measures to be proposed for process quality and safety improvement. RPN upper threshold for little concern of risk was set at 125. Results: Twenty-four subprocesses were identified. Ten potential failure modes were found and scored, in terms of RPN, in the range of 42-216. The most critical failure modes consisted of internal shield misalignment, wrong Monitor Unit calculation and incorrect data entry at treatment console. Potential causes of failure included shield displacement, human errors, such as underestimation of CTV extension, mainly because of lack of adequate training and time pressures, failure in the communication between operators, and machine malfunctioning. The main effects of failure were represented by CTV underdose, wrong dose distribution and/or delivery, unintended normal tissue irradiation. As additional safety measures, the utilization of a dedicated staff for IORT, double-checking of MU calculation and data entry and finally implementation of in vivo dosimetry were suggested. Conclusions: FMEA appeared as a useful tool for prospective evaluation of patient safety in radiotherapy. The application of this method to IORT lead to identify three safety measures for risk mitigation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Advanced surrogate model for electron-scale turbulence in tokamak pedestals

We derive an advanced surrogate model for predicting turbulent transport at the edge of tokamaks driven by electron temperature gradient (ETG) modes. Our derivation is based on a recently developed sensitivity-driven sparse grid interpolation approach for uncertainty quantification and sensitivity analysis at scale, which informs the set of parameters that define the surrogate model as a scaling law. Our model reveals that ETG-driven electron heat flux is influenced by the safety factor q, electron beta β e and normalized electron Debye length λ D , in addition to well-established parameters such as the electron temperature and density gradients. To assess the trustworthiness of our model's predictions beyond training, we compute prediction intervals using bootstrapping. The surrogate model's predictive power is tested across a wide range of parameter values, including within-distribution testing parameters (to verify our model) as well as out-of-bounds and out-of-distribution testing (to validate the proposed model). Overall, validation efforts show that our model competes well with, or can even outperform, existing scaling laws in predicting ETG-driven transport.

fusion plasma↗

Angularly resolved photoionization dynamics in atoms and molecules combining temporally and spectrally resolved experiments at ATTOLab and Synchrotron SOLEIL

We report results for XUV-IR two-photon ionization of Ar, Ne, NO, and O2, where an XUV attosecond pulse train is superimposed with a synchronized IR pulse, obtained at the ATTOLab laser facility using electron–ion coincidence 3D momentum spectroscopy. Temporally resolved photoelectron angular distributions providing angle-resolved time-delays for np ionization of Ar and Ne, achieved by reconstruction of attosecond beating by interference of two-photon transitions through a unified formalism (Joseph et al. in J Phys B At Mol Opt Phys 53:184007, 2020), are summarized. For inner valence XUV-IR dissociative photoionization of NO and O2 molecules, we report electron–ion kinetic energy correlation diagrams and disentangle the dissociative photoionization processes relying on parallel XUV experiments at Synchrotron SOLEIL. For ionization into the NO+(c3Π) ionic state, extending the formalism developed for single-photon ionization, we focus on photoelectron angular distributions averaged on the delay between the XUV and the IR field in the field frame, molecular frame, and electron frame of reference.

Joseph, J↗

Physics-Informed Machine Learning with Application to Solid Oxide Fuel Cell System Modeling and Optimization

Traditional data-driven machine learning (ML) techniques were combined with the physics-based SOFC-MP model toward improving SOFC system-level performance prediction. Four different physics-informed ML methods were proposed to demonstrate better prediction accuracy compared with traditional ML methods. First, it was preferred that the existing Kriging-based surrogate model not be entirely abandoned, so errors between Kriging regression prediction and true solution are learned using ML. The goal was to find the pattern of the error distribution as a function of model input so discrepancies between the Kriging prediction and true solution could be reduced by adding the additional ML-trained error term to the existing prediction. Second, deep neural networks (DNN) coupled with the mass balance model (MBM) have been developed to significantly decrease the reduced order model (ROM) prediction error with fewer training data compared to the traditional Kriging-based ROM and traditional DNN regression approaches. Third, DNN regression coupled with a neural networks (NN) classifier and MBM was developed. It provides superior performance on classifying the physically operational conditions for natural gas fuel cell (NGFC) than traditional classification approaches. Finally, two kinds of DNN transferring were studied and tested. One was transferring DNN for low-fidelity model data to a high-fidelity model. The second one was transferring DNN from state-of-the-art NGFC to advanced NGFC. These physic-informed ML frameworks can serve as a solid foundation for estimating U.S. Department of Energy-targeted fuel cell performance and exhibit great potential to be employed to other engineering applications.

30 DIRECT ENERGY CONVERSION↗

Probabilistic predictions and uncertainty estimation for radiological and nuclear effects modeling

Better characterization of meteorological uncertainty is needed to predict the effects of radiological and nuclear releases in the atmosphere. Multi-physics ensembles of atmospheric simulations can estimate uncertainty of physical processes, but they are often limited for computational reasons. Because weather uncertainty is important for emergency response applications, but the conventional way of running multi-physics ensembles is infeasible, we have developed new machine learning-based methods that quickly estimate and identify key sources of meteorological uncertainty. Machine learning accelerates the analysis of weather uncertainty by iteratively learning about model physics options that affect plume predictions. We have demonstrated the power of machine learning by creating a large multi-physics weather and dispersion ensemble dataset containing 1,200 simulations for two hypothetical radiological release scenarios. By training on less than 10% of the ensemble, we can quickly and accurately predict different outcomes, including the mass of radiological material deposited and spatial distribution and extent of contaminated areas.

54 ENVIRONMENTAL SCIENCES↗

Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing

In Hezaveh et al. (2017) we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for obtaining the uncertainties of these parameters. We review the framework of variational inference to obtain approximate posteriors of Bayesian neural networks and apply it to a network trained to estimate the parameters of the Singular Isothermal Ellipsoid plus external shear and total flux magnification. We show that the method can capture the uncertainties due to different levels of noise in the input data, as well as training and architecture-related errors made by the network. To evaluate the accuracy of the resulting uncertainties, we calculate the coverage probabilities of marginalized distributions for each lensing parameter. By tuning a single hyperparameter, the dropout rate, we obtain coverage probabilities approximately equal to the confidence levels for which they were calculated, resulting in accurate and precise uncertainty estimates. Our results suggest that neural networks can be a fast alternative to Monte Carlo Markov Chains for parameter uncertainty estimation in many practical applications, allowing more than seven orders of magnitude improvement in speed.

Perreault Levasseur, Laurence↗

Hyperspectral remote sensing-based plant community map for region around NGEE-Arctic intensive research watersheds at Seward Peninsula, Alaska, 2017-2019

Using airborne hyperspectral remote sensing data from NASA Airborne Visible-Infrared Imaging Spectrometer- Next Generation (AVIRIS-NG) platforms in a region near NGEE-Arctic intensive watersheds at Seward peninsula of Alaska, high resolution (5m) maps of plant community distribution were developed and included in this data collected. AVIRIS-NG data collected over 2017-2019 period were used to develop deep neural networks, trained using vegetation plot observations collected at NGEE-Arctic watersheds at Kougarok, Council and Teller. A hierarchical vegetation classification scheme consisting of six classes at Level I, and 16 classes at Level II contained in two .txt files were used to developed the plant community maps for the region. Two geospatial raster data files (.tif) at both thematic levels are shared in this data collection. Data files in this collection use Alaska Albers Equal Area projection. Readme files available in three formats (*.html, *.md, *.pdf) and one *.png visualization map.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Tangible Solutions for Grid Operation Upgrade

Many countries worldwide are setting clean energy targets to decarbonize the energy sector and add higher wind and solar capacities. Given their distributed nature, variable renewable energy (VRE) assets can have unique grid integration considerations, and require grid operation practices to be modernized. When transitioning to higher renewable energy levels, many system operators configure a dedicated renewable energy desk to manage renewable energy resource operation in the system control center. Further, system operation planning is conducted with VRE and load forecasting to enable reliable real-time system operation. NREL has partnered with many system operators in the region to identify appropriate technology and grid modernization solutions. NREL and partners from system operators in the region will present on the challenges and some solutions that have been applied and share best practices such as energy management system upgrades, VRE forecasting framework, grid flexibility improvements, and staff training.

emerging economies↗

DSP Implementation of a Novel Recurrent Neural Network Controller into a TI Solar Microinverter

Single-phase grid-tied inverters are widely used to integrate small-scale renewable energy sources and distributed generations to the utility grid. A novel Recurrent Neural Network (RNN) current controller is introduced to solve the resonant problem associated with LCL based inverters. The well-trained RNN controller was validated through a Texas Instruments (TI) LCL filter based solar microinverter kit that contains a C2000 TI microcontroller. The inverter closed current loop test without the grid connection was conducted in a laboratory setup to verify the RNN contoller functionality. The laboratory waveform results verified that the RNN current controller produced the strong tracking of the measured inverter AC current to its reference value even at a low sampling frequency of 5KHz. The proposed RNN current controller also proved to perform better than the built-in three-pole-three-zero (3P3Z) current controller provided by TI and produce lower values of Total Harmonic Distortion (THD).

digital signal processor↗

Spatial Mapping of Riverbed Grain-Size Distribution Using Machine Learning

Recent alluvial sediments in riverbeds play a significant role in controlling hydrologic exchange flows (HEFs) in river systems. The alluvial layer is usually associated with strong heterogeneity in physical properties (e.g., permeability and hydraulic conductivity), which affects local HEFs and therefore biogeochemical processes. The spatial distribution of these physical properties needs to be determined to inform the numerical models used to reveal the realistic hydro-biogeochemical behaviors. Such information can be obtained based on the intrinsic link between sediment grain-size distribution and hydraulic properties where sediment texture information is available. However, grain-size measurements are usually spatially sparse and do not have adequate coverage and resolution, particularly for a relatively large domain such as the Hanford Reach of the Columbia River. In this paper, we adopted machine learning (ML) approaches for categorizing and mapping the spatial distributions of riverbed substrate grain size and filling in missing areas of substrate data using the ML models along the reach. Such ML models for substrate size mapping were trained at 13,372 locations using measured substrate sizes along with observed and simulated attributes, including bathymetric attributes (e.g., elevation, slope, and aspect ratio) from LIDAR and bathymetric surveys, and hydrodynamic properties (e.g., water depth, velocity, shear stress, and their statistical moments). An ensemble bagging-based ML technique, Random Forest, was adopted to identify the most influential factors as predictors to develop the predictive models with over-fitting issues addressed. The models were evaluated with respect to each individual substrate size class and the lumped group, and then used to generate the final substrate size maps covering all the grid cells in the numerical modeling domain.

54 ENVIRONMENTAL SCIENCES↗