Search NASA⌕ Search

SEARCH · Search NASA

Results for “NN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Projection of Future Fire Emissions Over the Contiguous US Using Explainable Artificial Intelligence and CMIP6 Models

Abstract Increasing temperature and water cycle changes due to warming climate may increase the frequency and intensity of wildfires. Fire emission projections are useful for informing strategies for adaptation and mitigation of fire impacts on societies and ecosystems. Here, we construct a neural network (NN) model explained by the Shapley Additive explanation to predict fire PM 2.5 emissions change and understand their drivers over the contiguous US (CONUS) in the mid‐21st century under a high greenhouse gas emissions scenario (SSP5‐8.5). Using future meteorology and leaf area index (LAI) simulated by eight global climate models from the Coupled Model Intercomparison Project Phase 6, future population density, and present‐day land use and land cover (LULC) as input to the NN model, the total fire PM 2.5 emissions over CONUS are projected to increase by 4%–75% (model spread). Among different regions, fire emissions in the western US are projected to increase more significantly in June‐July‐August than in other seasons and regions, with the median ratios of future to present‐day fire emissions ranging from 1.67 to 2.86. The increases in fire emissions are mainly driven by increasing normalized temperature (23%–29%) and decreasing soil moisture (2%–10%) in the future. When future LULC change is considered, the projected fire emissions further increase by 58%–83% over the western US compared to projections without LULC change because of future increases in vegetation fraction. The results highlight the important role of warmer temperature, decreasing soil moisture, and LULC change in increasing fire emissions in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data Imbalance, Uncertainty Quantification, and Transfer Learning in Data‐Driven Parameterizations: Lessons From the Emulation of Gravity Wave Momentum Transport in WACCM

Abstract Neural networks (NNs) are increasingly used for data‐driven subgrid‐scale parameterizations in weather and climate models. While NNs are powerful tools for learning complex non‐linear relationships from data, there are several challenges in using them for parameterizations. Three of these challenges are (a) data imbalance related to learning rare, often large‐amplitude, samples; (b) uncertainty quantification (UQ) of the predictions to provide an accuracy indicator; and (c) generalization to other climates, for example, those with different radiative forcings. Here, we examine the performance of methods for addressing these challenges using NN‐based emulators of the Whole Atmosphere Community Climate Model (WACCM) physics‐based gravity wave (GW) parameterizations as a test case. WACCM has complex, state‐of‐the‐art parameterizations for orography‐, convection‐, and front‐driven GWs. Convection‐ and orography‐driven GWs have significant data imbalance due to the absence of convection or orography in most grid points. We address data imbalance using resampling and/or weighted loss functions, enabling the successful emulation of parameterizations for all three sources. We demonstrate that three UQ methods (Bayesian NNs, variational auto‐encoders, and dropouts) provide ensemble spreads that correspond to accuracy during testing, offering criteria for identifying when an NN gives inaccurate predictions. Finally, we show that the accuracy of these NNs decreases for a warmer climate (4 × CO 2 ). However, their performance is significantly improved by applying transfer learning, for example, re‐training only one layer using ∼1% new data from the warmer climate. The findings of this study offer insights for developing reliable and generalizable data‐driven parameterizations for various processes, including (but not limited to) GWs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Using Machine Learning to Generate a GISS ModelE Calibrated Physics Ensemble (CPE)

A neural network (NN) surrogate of the NASA GISS ModelE atmosphere (version E3) is trained on a perturbed parameter ensemble (PPE) spanning 45 physics parameters and 36 outputs. The NN is leveraged in a Markov Chain Monte Carlo (MCMC) Bayesian parameter inference framework to generate a second posterior constrained ensemble coined a “calibrated physics ensemble,” or CPE. The CPE members are characterized by diverse parameter combinations and are, by definition, close to top-of-atmosphere radiative balance, and must broadly agree with numerous hydrologic, energy cycle and radiative forcing metrics simultaneously. Global observations of numerous cloud, environment, and radiation properties (provided by global satellite products) are crucial for CPE generation. The inference framework explicitly accounts for discrepancies (or biases) in satellite products during CPE generation. We demonstrate that product discrepancies strongly impact calibration of important model parameter settings (e.g., convective plume entrainment rates; fall speed for cloud ice). Structural improvements new to E3 are retained across CPE members (e.g., stratocumulus simulation). Notably, the framework improved the simulation of shallow cumulus and Amazon rainfall while not degrading radiation fields, an upgrade that neither default parameters nor Latin Hypercube parameter searching achieved. Analyses of the initial PPE suggested several parameters were unimportant for output variation. However, many “unimportant” parameters were needed for CPE generation, a result that brings to the forefront how parameter importance should be determined in PPEs. From the CPE, two diverse 45-dimensional parameter configurations are retained to generate radiatively-balanced, auto-tuned atmospheres that were used in two E3 submissions to CMIP6.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Solving the structure of “single-atom” catalysts using machine learning – assisted XANES analysis

We show that "single-atom” catalysts (SACs) have demonstrated excellent activity and selectivity in challenging chemical transformations such as photocatalytic CO 2 reduction. For heterogeneous photocatalytic SAC systems, it is essential to obtain sufficient information of their structure at the atomic level in order to understand reaction mechanisms. In this work, a SAC was prepared by grafting a molecular cobalt catalyst on a light-absorbing carbon nitride surface. Due to the sensitivity of the X-ray absorption near edge structure (XANES) spectra to subtle variances in the Co SAC structure in reaction conditions, different machine learning (ML) methods, including principal component analysis, K-means clustering, and neural network (NN), were utilized for in situ Co XANES data analysis. As a result, we obtained quantitative structural information of the SAC nearest atomic environment thereby extending the NN-XANES approach previously demonstrated for nanoparticles and size-selective clusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Data-driven design of novel halide perovskite alloys

The great tunability of the properties of halide perovskites presents new opportunities for optoelectronic applications as well as significant challenges associated with exploring combinatorial chemical spaces. Here, in this work, we develop a framework powered by high-throughput computations and machine learning for the design and prediction of mixed cation halide perovskite alloys. In a chemical space of ABX 3 perovskites with a selected set of options for A, B, and X species, pseudo-cubic structures with B-site mixing are simulated using density functional theory (DFT) and several properties are computed, including stability, lattice constant, band gap, vacancy formation energy, refractive index, and optical absorption spectrum, using both semi-local and hybrid functionals. Neural networks (NN) are used to train predictive models for every property using tabulated elemental properties of A, B, and X site species as descriptors. Starting from a DFT dataset of 229 points, we use the trained NN models to predict the structural, energetic, electronic, and optical properties of an extensive dataset of 17955 compounds, and perform high-throughput screening in terms of stability, band gap, and defect tolerance, to obtain 392 promising compounds that are ranked as potential absorbers according to their photovoltaic figure of merit. Compositional trends in the screened set of attractive mixed cation halide perovskites are revealed and additional computations are performed on selected compounds. The data-driven design framework developed here is promising for designing novel mixed compositions and can be extended to a wider perovskite chemical space in terms of A, B, and X species, different kinds of mixing at the A, B, or X sites, non-cubic phases, and other properties of interest.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Scaling Properties of φ -Meson and Light Charged Hadron Production in Small and Large Systems at PHENIX

Recent results on the identified charged-hadron (π ± , K ± , p, p¯) production vat midrapidity region (|η| < 0.35) have been measured by the PHENIX experiment in p + Al, 3 He + Au, Cu + Au collisions at $\sqrt{s_{NN}}$ = 200 GeV and U + U collisions at $\sqrt{s_{NN}}$ = 193 GeV. These measurements are presented through the invariant transverse-momentum (p T ) and transverse-mass (m T ) spectra for different collision centralities. The averaged freeze-out temperature value for different systems was found to be 166.1 ± 2.2 MeV, and do not exhibit any dependence on the collision centrality and $\langle$N parti $\rangle$ values. The particle ratios of K/π and p/π have been measured in different centrality ranges of large and small collision systems. The values of K/π ratios measured in all considered collision systems were found to be consistent with those measured in p+p collisions. Furthermore, the identified charged-hadron nuclear-modification factors (R AB ) are also presented. Enhancement of proton R AB values over meson R AB values was observed in central 3 He+Au, Cu+Au, and U+U collisions. The proton R AB values measured in p+Al collision system were found to be consistent with R AB values of Φ, π ± , K ± , and π 0 mesons, suggesting that the size of the system produced in p+Al collisions is too small for recombination to cause a noticeable increase in proton production.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Bond order predictions using deep neural networks

Machine learning is an extremely powerful tool for the modern theoretical chemist since it provides a method for bypassing costly algorithms for solving the Schrödinger equation. Already, it has proven able to infer molecular and atomic properties such as charges, enthalpies, dipoles, excited state energies, and others. Most of these machine learning algorithms proceed by inferring properties of individual atoms, even breaking down total molecular energy into individual atomic contributions. In this paper, we introduce a modified version of the Hierarchically Interacting Particle Neural Network (HIP-NN) capable of making predictions on the bonds between atoms rather than on the atoms themselves. We train the modified HIP-NN to infer bond orders for a large number of small organic molecules as computed via the Natural Bond Orbital package. We demonstrate that the trained model is extensible to molecules much larger than those in the training set by studying its performance on the COMP6 dataset. This method has applications in cheminformatics and force field parameterization and opens a promising future for machine learning models to predict other quantities that are defined between atoms such as density matrix elements, Hamiltonian parameters, and molecular reactivities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

Potential energy surfaces for high-energy N + O 2 collisions

Potential energy surfaces for high-energy collisions between an oxygen molecule and a nitrogen atom are useful for modeling chemical dynamics in shock waves. In the present work, we present doublet, quartet, and sextet potential energy surfaces that are suitable for studying collisions of O 2 ( 3 Σ$^{–}_{g}$) with N( 4 S) in the electronically adiabatic approximation. Two sets of surfaces are developed, one using neural networks (NNs) with permutationally invariant polynomials (PIPs) and one with the least-squares many-body (MB) method, where a two-body part is an accurate diatomic potential and the three-body part is expressed with connected PIPs in mixed-exponential-Gaussian bond order variables (MEGs). We find, using the same dataset for both fits, that the fitting performance of the PIP-NN method is significantly better than that of the MB-PIP-MEG method, even though the MB-PIP-MEG fit uses a higher-order PIP than those used in previous MB-PIP-MEG fits of related systems (such as N 4 and N 2 O 2 ). However, the evaluation of the PIP-NN fit in trajectory calculations requires about 5 times more computer time than is required for the MB-PIP-MEG fit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Machine-learning accelerated geometry optimization in molecular simulation

Geometry optimization is an important part of both computational materials and surface science because it is the path to finding ground state atomic structures and reaction pathways. These properties are used in the estimation of thermodynamic and kinetic properties of molecular and crystal structures. This process is slow at the quantum level of theory because it involves an iterative calculation of forces using quantum chemical codes such as density functional theory (DFT), which are computationally expensive and which limit the speed of the optimization algorithms. It would be highly advantageous to accelerate this process because then one could do either the same amount of work in less time or more work in the same time. Here, we provide a neural network (NN) ensemble based active learning method to accelerate the local geometry optimization for multiple configurations simultaneously. We illustrate the acceleration on several case studies including bare metal surfaces, surfaces with adsorbates, and nudged elastic band for two reactions. In all cases, the accelerated method requires fewer DFT calculations than the standard method. In addition, we provide an Atomic Simulation Environment (ASE)-optimizer Python package to make the usage of the NN ensemble active learning for geometry optimization easier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Data-Driven RANS Turbulence Closures for Forced Convection Flow in Reactor Downcomer Geometry

Recent progress in data-driven turbulence modeling has shown its potential to enhance or replace traditional equation-based Reynolds-averaged Navier-Stokes (RANS) turbulence models. Here, this work utilizes invariant neural network (NN) architectures to model Reynolds stresses and turbulent heat fluxes in forced convection flows (when the models can be decoupled). As the considered flow is statistically one dimensional, the invariant NN architecture for the Reynolds stress model reduces to the linear eddy viscosity model. To develop the data-driven models, direct numerical and RANS simulations in vertical planar channel geometry mimicking a part of the reactor downcomer are performed. Different conditions and fluids relevant to advanced reactors (sodium, lead, unitary-Prandtl-number fluid, and molten salt) constitute the training database. The models enabled accurate predictions of velocity and temperature, and compared to the baseline k–τ turbulence model with the simple gradient diffusion hypothesis, do not require tuning of the turbulent Prandtl number. The data-driven framework is implemented in the open-source graphics processing unit–accelerated spectral element solver nekRS and has shown the potential for future developments and consideration of more complex mixed convection flows.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Characterizing the acceleration time of laser-driven ion acceleration with data-informed neural networks

Peak ion energy is an important figure-of-merit in short-pulse, laser-driven ion acceleration and is dependent on an associated acceleration time. Standard metrics for these quantities depend on analytical results such as the self-similar fluid model or empirical models based on relatively small experimental and simulation datasets. In this work we attempt to use a data-informed neural network (NN) as a surrogate model for a large ensemble of PIC simulations to investigate an effective acceleration time. We explore the application of a stacked convolutional and recurrent NN architecture for improved regression by incorporating the time dependencies of the data into the training process. Of particular note is how pretraining a network on lower fidelity data, e.g. 1D analytical results, greatly improves the network's ability to learn more complex, higher fidelity data. Finally, the dependency of the acceleration time on various laser and plasma parameters is explored.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Design of flexible proton beam imaging energy spectrometers (PROBIES)

A simple repeating step-filtered structure has been designed and deployed for the detection of MeV-energy proton beams produced from high-intensity short-pulse laser-driven experiments. Due to the diagnostic's ability to recover energy-resolved images of proton beams, it is called the proton beam imager and energy spectrometer (or PROBIES). The flexible design has two useful applications. First, it can be fielded in a configuration with a scintillator and imaging setup in order to collect proton beam information in high-repetition rate experiments. Here we show a configuration that collects the equivalent of a nine-film radiochromic film (RCF) stack, and a technique for using a neural network (NN) to rapidly analyze the images on millisecond time-scales. Second, when using RCF stacks as the detector, the energy resolution capability is greatly increased compared to traditional RCF stacks, while simultaneously reducing the total number of films required to make each measurement. We demonstrate a configuration that provides up to 90 spatially- and energy-resolved datapoints using just ten films. Both designs presented here can be easily customized for anticipated experimental outputs and manufactured at low cost. Such designs allow for rapid prototyping using modern high-accuracy 3D printers or on-demand computer numerical control machining to reduce the reliance on time-consuming film media, analysis, or bulky electro-magnetically dispersing spectrometers. The analysis of data is discussed and a methodology for constructing a NN that is capable of rapidly analyzing data on-the-fly with greater than 95% accuracy is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

A Self-learning Neural Network Approach for Radio Frequency Interference Detection and Removal in Radio Astronomy

In this work, we present a novel neural network (NN) method for the detection and removal of radio frequency interference (RFI) from the raw digitized signal in the signal processing chain of a typical radio astronomy experiment. The main advantage of our method is that it does not require a training set. Instead, our method relies on the fact that the true signal of interest coming from astronomical sources is thermal and therefore described as a Gaussian random process, which cannot be compressed. We employ a variational encoder/decoder network to find the compressible information in the data stream that can explain the most variance with the fewest degrees of freedom. We demonstrate it on a set of toy problems and stored ring buffers from the Baryon Mapping eXperiment prototype. We find that the RFI subtraction is effective at cleaning simulated time streams: While we find that the power spectra of the RFI-cleaned time streams output by the NN suffer from extra signal consistent with additive noise, we find that it is generally around percent level across the band and sub 10% in contaminated spectral channels even when RFI power is an order of magnitude larger than the signal. We discuss the advantages and limitations of this method and possible implementation in the front end of future radio experiments.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Surrogate models for plasma displacement and current in 3D perturbed magnetohydrodynamic equilibria in tokamaks

Abstract A numerical database of over one thousand perturbed three-dimensional (3D) equilibria has been generated, constructed based on the MARS-F (Liu et al 2000 Phys. Plasmas 7 3681) computed plasma response to the externally applied 3D field sources in multiple tokamak devices. Perturbed 3D equilibria with the n = 1–4 ( n is the toroidal mode number) toroidal periodicity are computed. Surrogate models are created for the computed perturbed 3D equilibrium utilizing model order reduction (MOR) techniques. In particular, retaining the first few eigenstates from the singular value decomposition (SVD) of the data is found to produce reasonably accurate MOR-representations for the key perturbed quantities, such as the perturbed parallel plasma current density and the plasma radial displacement. SVD also helps to reveal the core versus edge plasma response to the applied 3D field. For the database covering the conventional aspect ratio devices, about 95% of data can be represented by the truncated SVD-series with inclusion of only the first five eigenstates, achieving a relative error (RE) below 20%. The MOR-data is further utilized to train neural networks (NNs) to enable fast reconstruction of perturbed 3D equilibria, based on the two-dimensional equilibrium input and the 3D source field. The best NN-training is achieved for the MOR-data obtained with a global SVD approach, where the full set of samples used for NN training and testing are stretched and form a large matrix which is then subject to SVD. The fully connected multi-layer perceptron, with one or two hidden layers, can be trained to predict the MOR-data with less than 10% RE. As a key insight, a better strategy is to train separate NNs for the plasma response fields with different toroidal mode numbers. It is also better to apply MOR and to subsequently train NNs separately for conventional and low aspect ratio devices, due to enhanced toroidal coupling of Fourier spectra in the plasma response in the latter case.

3D equilibrium↗
DOE OSTI2025

Investigating performance and variability of NIF ICF experiments with deep learning

The parameter space involved in designing an inertial confinement fusion shot at the National Ignition Facility (NIF) is massively multi-dimensional and the cost of a single shot makes a comprehensive set of sensitivity studies in the laboratory impractical. The use of machine learning to overcome these challenges has gained popularity and has had several successful applications by the scientific community. We extend on these efforts by training a neural network (NN) on information about the experimental design, engineering elements, and drive asymmetry to predict with uncertainty the neutron yield of an experiment. We find the measured and model predicted values are in good agreement, with an R 2 value of 0.91 for a randomly selected test dataset. Almost all the predicted 95% credible intervals contain the corresponding measured value for both training and test datasets. We identify correlations picked up by the NN between the shot design, yield, and variability and use them to motivate shot sensitivity studies. The first shot to exceed the Lawson-like ignition criteria (N210808) was conducted at the NIF and subsequent shots studied the design’s robustness. In a follow-up shot to N210808, our model predicts capsule quality to be the main performance degradation mechanism that prevented the shot from repeating previous performance levels. Shot N221204 was the first shot to exceed a target energy gain of 1. Our model predicts increased yield with reduced coast time for a N221204 study and greater variability for designs with lower peak powers at constant yield. The model’s fast prediction speed and uncertainty prediction are useful for identifying interesting design paths that could warrant further investigation with conventional simulations to search for robust high yield designs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Development of a data-driven neural network model for electron thermal transport in NSTX

A data-driven electron thermal transport neural network (ETT-NN) model, trained on TRANSP interpretative analysis results of National Spherical Torus Experiment (NSTX), was developed to enable faster and more accurate ETT computation for spherical tokamaks (STs). The model incorporates both convolutional NNs and recurrent NNs, allowing it to simultaneously account for the spatial and temporal non-localities and multi-scale features of turbulent transport, which have been considered only in a limited manner in conventional models. The model was validated through interpretative analysis and predictive simulations using Tokamak Reactor Integrated Automated Suite for Simulation and Computation, demonstrating relatively high accuracy. Additionally, parameter scans were performed on test discharges known to exhibit specific turbulent modes, such as microtearing mode, trapped electron mode, kinetic ballooning mode, and electron temperature gradient mode. The scanning results revealed that the ETT-NN model exhibits the same trends as those observed in conventional gyrokinetic simulations or theories, while also capturing the global nature of turbulent transport, indicating that the data-driven model accurately reflects the underlying physical characteristics. Furthermore, due to the dimensionless nature of the model, we can feasibly expand its applicability by incorporating data from other devices and uncovering the characteristics of ETT in STs in the future.

NSTX↗
DOE OSTI2022

Centrality determination in heavy-ion collisions with the LHCb detector

The centrality of heavy-ion collisions is directly related to the created medium in these interactions. A procedure to determine the centrality of collisions with the LHCb detector is implemented for lead-lead collisions at √ s NN = 5 TeV and lead-neon fixed-target collisions at √ s NN = 69 GeV. The energy deposits in the electromagnetic calorimeter are used to determine and define the centrality classes. The correspondence between the number of participants and the centrality for the lead-lead collisions is in good agreement with the correspondence found in other experiments, and the centrality measurements for the lead-neon collisions presented here are performed for the first time in fixed-target collisions at the LHC.

47 OTHER INSTRUMENTATION↗