Search NASA⌕ Search

SEARCH · Search NASA

Results for “NN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Inference of the optical depth to reionization τ from Planck CMB maps with convolutional neural networks

The optical depth to reionization, τ, is the least constrained parameter of the cosmological Λ cold dark matter (ΛCDM) model. To date, its most precise value is inferred from large-scale polarized cosmic microwave background (CMB) power spectra from the High Frequency Instrument (HFI) aboard the Planck satellite. These maps are known to contain significant contamination by residual non-Gaussian systematic effects, which are hard to model analytically. Therefore, robust constraints on τ are currently obtained through an empirical cross-spectrum likelihood built from simulations. In this paper, we present a likelihood-free inference of τ from polarized Planck HFI maps which, for the first time, is fully based on neural networks (NNs). NNs have the advantage of not requiring an analytical description of the data and can be trained on state-of-the-art simulations, combining the information from multiple channels. By using Gaussian sky simulations and Planck SRoll2 simulations, including CMB, noise, and residual instrumental systematic effects, we trained, tested, and validated NN models considering different setups. We inferred the value of τ directly from Stokes Q and U maps at ~4° pixel resolution, without computing angular power spectra. On Planck data, we obtained τ NN = 0.0579 ± 0.0082, which is compatible with current EE cross-spectrum results but with a ~30% larger uncertainty, which can be assigned to the inherent nonoptimality of our estimator and to the retraining procedure applied to avoid biases. While this paper does not improve on current cosmological constraints on τ, our analysis represents a first robust application of NN-based inference on real data, and highlights its potential as a promising tool for complementary analysis of near-future CMB experiments, also in view of the ongoing challenge to achieve the first detection of primordial gravitational waves.

79 ASTRONOMY AND ASTROPHYSICS↗

Impact of in situ nuclear networks and atomic opacities on neutron star merger ejecta dynamics, nucleosynthesis, and kilonovae

Context. Binary neutron star merger (BNSM) ejecta are key sites of rapid neutron capture (r-process) nucleosynthesis and they produce kilonovae powered by the radioactive decay of freshly synthesized nuclei. Modeling their evolution requires multi-physics simulations involving hydrodynamics, nuclear reactions, and radiative processes. The impact of nuclear burning and atomic opacity is poorly understood and often treated with simplified prescriptions. Aims. We systematically investigate different treatments of nuclear heating, particle thermalization, and atomic opacities in radiation-hydrodynamics simulations of BNSM ejecta and kilonova light curves. Methods. Ejecta profiles from long-term numerical-relativity simulations of asymmetric neutron star binaries with a massive neutron star remnant were evolved to ∼30 days using a 2D ray-by-ray approach. We compared simplified heating-rate and thermalization prescriptions with in situ Nuclear reaction Network (NN) calculations that track nuclear energy deposition and include a composition-dependent thermalization scheme. We also contrasted various gray opacity models with a frequency-dependent treatment based on atomic calculations. Results. Coupling NN and hydrodynamics significantly affects nucleosynthesis and kilonova emission. Assuming homologous expansion alters abundance evolution and produces a narrower, less populated second r-process peak and a third peak shifted to higher mass numbers. The back-reaction of nuclear heating affects the temperature evolution enough to delay and redden the early (t∼ hours) kilonova peaks. A constant thermalization efficiency underestimates and reddens the early emission while overestimating the late-time luminosity compared to the composition-dependent treatment. Analytical opacity prescriptions yield a more extended, colder photosphere, resulting in dimmer, redder kilonovae at early times (t≲ hour), while the delayed recession of the photosphere prolongs the red emission at t ≳ 5 days. Conclusions. Coupling hydrodynamics to an in situ NN is crucial for reliable nucleosynthesis and kilonova predictions. Resolving the first several hundred milliseconds of the hydrodynamics is essential for robust nucleosynthesis calculations. Composition-dependent thermalization and frequency-dependent, atomic-physics-based opacities are needed to accurately capture the temperature evolution of the ejecta and the brightness and color evolution of the kilonova. Calibrated analytic nuclear-power fits with simplified thermalization and opacity prescriptions can still reproduce the density and temperature evolution of the ejecta.

74 ATOMIC AND MOLECULAR PHYSICS↗

Statistical data analysis of x-ray spectroscopy data enabled by neural network accelerated Bayesian inference

Bayesian inference applied to x-ray spectroscopy data analysis enables uncertainty quantification necessary to rigorously test theoretical models. However, when comparing to data, detailed atomic physics and radiation transfer calculations of x-ray emission from non-uniform plasma conditions are typically too slow to be performed in line with statistical sampling methods, such as Markov Chain Monte Carlo sampling. Furthermore, differences in transition energies and x-ray opacities often make direct comparisons between simulated and measured spectra unreliable. Here, we present a spectral decomposition method that allows for corrections to line positions and bound–bound opacities to best fit experimental data, with the goal of providing quantitative feedback to improve the underlying theoretical models and guide future experiments. In this work, we use a neural network (NN) surrogate model to replace spectral calculations of isobaric hot-spots created in Kr-doped implosions at the National Ignition Facility. The NN was trained on calculations of x-ray spectra using an isobaric hot-spot model post-processed with Cretin, a multi-species atomic kinetics and radiation code. The speedup provided by the NN model to generate x-ray emission spectra enables statistical analysis of parameterized models with sufficient detail to accurately represent the physical system and extract the plasma parameters of interest.

47 OTHER INSTRUMENTATION↗

Neural network based prediction of no-wall β N limits due to ideal external kink instabilities

Multi-layer perceptron based neural networks (NNs) are trained to predict the Troyon no-wall beta limits due to the onset of low-n (n = 1 – 3, n is the toroidal mode number) ideal external kink instabilities in tokamak plasmas. It is revealed that a well-trained NN can predict the n = 1 no-wall beta limit within 10% relative error. The NN performance is somewhat worse for the n = 2 and 3 no-wall beta limits, but still a relative error within 20% is achievable. The trained NNs well reproduce the known dependences of the no-wall beta limits on the plasma pressure (pressure peaking factor) and current (plasma internal inductance) profiles. Other scalings are further easily established with NNs, for parametric dependences such as on the aspect ratio, the elongation and triangularity of the plasma boundary shape. These NN-based Troyon beta limit predictors can be incorporated into integrated modeling platforms, or directly implemented as a real time stability estimator for the purpose of disruption avoidance or mitigation during experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamics of argon metastables in Ar–CH 4 radio frequency capacitively-coupled plasma: real-time monitoring with neural network-augmented broadband optical emission spectroscopy

In moderate-pressure radio frequency (RF) capacitively coupled plasmas generated in argon–methane mixtures, the density of argon metastable atoms (Ar 1 s 5 ) exhibits a non-monotonic dependence on methane (CH 4 ) concentration. Laser-induced fluorescence (LIF) was used to measure and compare local Ar 1 s 5 densities in Ar and Ar–CH 4 plasmas at 2.6 Torr and RF powers of 17–117 W. The addition of 1% CH 4 increases the metastable density, and 2% CH 4 triggers a strong depletion by an order of magnitude, compared to 1% CH 4 case. This non-monotonic behavior demonstrates the sensitivity of metastable populations to small gas admixtures, which is critical for processes where metastables drive precursor dissociation. For real-time monitoring of metastable population, broadband optical emission spectroscopy (OES) is augmented with a feedforward neural network (NN) to predict Ar s1 5 densities from spectral features. When trained on LIF data, the NN replicates the absolute densities and the dynamic trends of Ar 1 s 5 density variation. The NN-augmented broadband OES approach can be used as a simple and cost-effective tool for tracking Ar metastables in Ar-rich plasmas, facilitating industrial-scale optimization.

Yatom, Shurik [Princeton Plasma Physics Laboratory↗

Initial testing of Alfvén eigenmode feedback control with machine-learning observers on DIII-D

A first of its kind fully data-driven system has been developed and implemented into the DIII-D plasma control system to detect and control Alfvén eigenmodes (AE) in real-time. Susceptibility to fast ion-induced AE is a challenge in fully non-inductive tokamak operation, which significantly reduces fast-particle confinement and results in degraded fusion gain. Controlling AEs in real-time to improve fast-ion confinement is, hence, important for future advanced tokamak fusion reactors. The models were implemented and tested in experiments which showed that neural networks (NN) are highly effective in detecting 5 types of AE (BAE, EAE, LFM, RSAE, TAE) using high resolution ECE. To estimate the neutron deficit, a NN has been trained that outputs the classical neutron rate using similar inputs to NUBEAM. Also a preliminary ML-based proportional control has been designed and gone through initial testing in experiment to use feedback-control on the neutral beam power to achieve desired amplitude of AE modes and neutron deficits. The effect of AEs on fast-ion confinement is measured by analysing the gap in classical neutron rate from the proposed NN-based NUBEAM and the measured neutron rate.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Differentiable Earth mover’s distance for data compression at the high-luminosity LHC

Abstract The Earth mover’s distance (EMD) is a useful metric for image recognition and classification, but its usual implementations are not differentiable or too slow to be used as a loss function for training other algorithms via gradient descent. In this paper, we train a convolutional neural network (CNN) to learn a differentiable, fast approximation of the EMD and demonstrate that it can be used as a substitute for computing-intensive EMD implementations. We apply this differentiable approximation in the training of an autoencoder-inspired neural network (encoder NN) for data compression at the high-luminosity LHC at CERN The goal of this encoder NN is to compress the data while preserving the information related to the distribution of energy deposits in particle detectors. We demonstrate that the performance of our encoder NN trained using the differentiable EMD CNN surpasses that of training with loss functions based on mean squared error.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SymbolNet: neural symbolic regression with adaptive dynamic pruning for compression

Abstract Compact symbolic expressions have been shown to be more efficient than neural network (NN) models in terms of resource consumption and inference speed when implemented on custom hardware such as field-programmable gate arrays (FPGAs), while maintaining comparable accuracy (Tsoi et al 2024 EPJ Web Conf. 295 09036). These capabilities are highly valuable in environments with stringent computational resource constraints, such as high-energy physics experiments at the CERN Large Hadron Collider. However, finding compact expressions for high-dimensional datasets remains challenging due to the inherent limitations of genetic programming (GP), the search algorithm of most symbolic regression (SR) methods. Contrary to GP, the NN approach to SR offers scalability to high-dimensional inputs and leverages gradient methods for faster equation searching. Common ways of constraining expression complexity often involve multistage pruning with fine-tuning, which can result in significant performance loss. In this work, we propose S y m b o l N e t , a NN approach to SR specifically designed as a model compression technique, aimed at enabling low-latency inference for high-dimensional inputs on custom hardware such as FPGAs. This framework allows dynamic pruning of model weights, input features, and mathematical operators in a single training process, where both training loss and expression complexity are optimized simultaneously. We introduce a sparsity regularization term for each pruning type, which can adaptively adjust its strength, leading to convergence at a target sparsity ratio. Unlike most existing SR methods that struggle with datasets containing more than O ( 10 ) inputs, we demonstrate the effectiveness of our model on the LHC jet tagging task (16 inputs), MNIST (784 inputs), and SVHN (3072 inputs).

Tsoi, Ho Fung (ORCID:0000000225502184)↗

SIDDA: SInkhorn Dynamic Domain Adaptation for image classification with equivariant neural networks

Modern neural networks (NNs) often do not generalize well in the presence of a ‘covariate shift’; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels given the data remains unchanged. In such cases, NN generalization can be reduced to a problem of learning more robust, domain-invariant features. Domain adaptation (DA) methods include a broad range of techniques aimed at achieving this; however, these methods have struggled with the need for extensive hyperparameter tuning, which then incurs significant computational costs. In this work, we introduce SInkhorn Dynamic Domain Adaptation (SIDDA), an out-of-the-box DA training algorithm built upon the Sinkhorn divergence, that can achieve effective domain alignment with minimal hyperparameter tuning and computational overhead. We demonstrate the efficacy of our method on multiple simulated and real datasets of varying complexity, including simple shapes, handwritten digits, real astronomical observations, and remote sensing data. These datasets exhibit covariate shifts due to noise, blurring, differences between telescopes, and variations in imaging wavelengths. SIDDA is compatible with a variety of NN architectures, and it works particularly well in improving classification accuracy and model calibration when paired with symmetry-aware equivariant NNs (ENNs). We find that SIDDA consistently enhances the generalization capabilities of NNs, achieving up to a ${\approx}40\%$ improvement in classification accuracy on unlabeled target data, while also providing a more modest performance gain of $\lesssim 1\%$ on labeled source data. We also study the efficacy of DA on ENNs with respect to the varying group orders of the dihedral group DN, and find that the model performance improves as the degree of equivariance increases. Finally, if SIDDA achieves proper domain alignment, it also enhances model calibration on both source and target data, with the most significant gains in the unlabeled target domain—achieving over an order of magnitude improvement in the expected calibration error and Brier score. SIDDA’s versatility across various NN models and datasets, combined with its automated approach to domain alignment, has the potential to significantly advance multi-dataset studies by enabling the development of highly generalizable models.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmological cross-correlations and nearest neighbour distributions

ABSTRACT Cross-correlations between data sets are used in many different contexts in cosmological analyses. Recently, k-nearest neighbour cumulative distribution functions (kNN-CDF) were shown to be sensitive probes of cosmological (auto) clustering. In this paper, we extend the framework of NN measurements to describe joint distributions of, and correlations between, two data sets. We describe the measurement of joint kNN-CDFs, and show that these measurements are sensitive to all possible connected N-point functions that can be defined in terms of the two data sets. We describe how the cross-correlations can be isolated by combining measurements of the joint kNN-CDFs and those measured from individual data sets. We demonstrate the application of these measurements in the context of Gaussian density fields, as well as for fully non-linear cosmological data sets. Using a Fisher analysis, we show that measurements of the halo-matter cross-correlations, as measured through NN measurements are more sensitive to the underlying cosmological parameters, compared to traditional two-point cross-correlation measurements over the same range of scales. Finally, we demonstrate how the NN cross-correlations can robustly detect cross-correlations between sparse samples – the same regime where the two-point cross-correlation measurements are dominated by noise.

79 ASTRONOMY AND ASTROPHYSICS↗

The stellar parameters and elemental abundances from low-resolution spectra – I. 1.2 million giants from LAMOST DR8

As a typical data-driven method, deep learning becomes a natural choice for analysing astronomical data. In this study, we built a deep convolutional neural network (NN) to estimate basic stellar parameters $T\rm {_{eff}}$, log g , metallicity ([M/H] and [Fe/H]) and [α/M] along with nine individual elemental abundances ([C/Fe], [N/Fe], [O/Fe], [Mg/Fe], [Al/Fe], [Si/Fe], [Ca/Fe], [Mn/Fe], and [Ni/Fe]). The NN is trained using common stars between the APOGEE survey and the LAMOST survey. We used low-resolution spectra from LAMOST survey as input, and measurements from APOGEE as labels. For stellar spectra with the signal-to-noise ratio in g band larger than 10 in the test set, the mean absolute error (MAE) is 29 K for $T\rm {_{eff}}$, 0.07 dex for log g , 0.03 dex for both [Fe/H] and [M/H], and 0.02 dex for [α/M]. The MAE of most elements is between 0.02 and 0.04 dex. The trained NN was applied to 1210 145 giants, including sub-giants, from LAMOST DR8 within the range of stellar parameters 3500 K < $T\rm {_{eff}}$ < 5500 K, 0.0 dex < log g < 4.0 dex, −2.5 dex < [Fe/H] < 0.5 dex. The distribution of our results in the chemical spaces is highly consistent with APOGEE labels and stellar parameters show consistency with external high-resolution measurements from GALAH. The results in this study allow us to further studies based on LAMOST data and deepen our understanding of the accretion and evolution history of the Milky Way. The electronic version of the value added catalog is available at http://www.lamost.org/dr8/v1.1/doc/vac.

79 ASTRONOMY AND ASTROPHYSICS↗

Application of deep learning methods for beam size control during user operation at the Advanced Light Source

Past research at the Advanced Light Source (ALS) provided a proof-of-principle demonstration that deep learning methods could be effectively employed to compensate for the significant perturbations to the transverse electron beam size induced by user-controlled adjustments of the insertion devices. However, incorporating these methods into the ALS’ daily operations has faced notable challenges. The complexity of the system’s operational requirements and the significant upkeep demands has restricted their sustained application during user operation. Here, we introduce the development of a more robust neural network (NN)-based algorithm that utilizes a novel online fine-tuning approach and its systematic integration into the day-to-day machine operations. Our analysis emphasizes the process of NN model selection, demonstrates the superior performance of the NN-based method over traditional feedback methods, and examines the effectiveness and resilience of the new algorithm during user-operation scenarios. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

Predicting impurity spectral functions using machine learning

The Anderson Impurity Model (AIM) is a canonical model of quantum many-body physics. Here we investigate whether machine learning models, both neural networks (NN) and kernel ridge regression (KRR), can accurately predict the AIM spectral function in all of its regimes, from empty orbital, to mixed valence, to Kondo. To tackle this question, we construct two large spectral databases containing approximately 410 000 and 600 000 spectral functions of the single-channel impurity problem. We show that the NN models can accurately predict the AIM spectral function in all of its regimes, with pointwise mean absolute errors down to 0.003 in normalized units. We find that the trained NN models outperform models based on KRR and enjoy a speedup on the order of 10 5 over traditional AIM solvers. Finally, the required size of the training set of our model can be significantly reduced using farthest point sampling in the AIM parameter space, which is important for generalizing our method to more complicated multichannel impurity problems of relevance to predicting the properties of real materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Molecular dynamics simulation of Fe-Si alloys using a neural network machine learning potential

Interatomic potential development using machine learning (ML) approaches has attracted a lot of attention in recent years because these potentials can effectively describe the structural and dynamical properties of complex materials at the atomistic level. Here, in this work, we present the development of a neural network (NN) deep ML interatomic potential for Fe-Si alloys, and we demonstrate the effectiveness of the NN-ML potential in predicting the structures and energies of liquid and crystalline phases of Fe-Si alloys in comparison with the results from ab initio molecular dynamics simulations or experimental data. The developed NN-ML potential is also used to perform molecular dynamics simulations to study the structures of Fe-Si alloys with various compositions under rapid solidification conditions. The short-ranged orders in the rapidly solidified Fe-Si alloys are also analyzed by a cluster alignment method.

36 MATERIALS SCIENCE↗

Disentangling contributions to small-system collectivity via scans of light nucleus-nucleus collisions

The observation of multiparticle azimuthal correlations in high-energy small-system collisions has led to intense debate on its origin and the possible coexistence from two competing theoretical scenarios: one based on initial-state intrinsic momentum anisotropy, and the other based on final-state interaction model (FSM) collective response to the collision geometry. To complement the previous scan of asymmetric collision systems ( p +Au, d +Au, and He+Au), we propose a scan of small symmetric collision systems at the Brookhaven National Laboratory Relativistic Heavy Ion Collider, such as C+C, O+O, Al+Al, and Ar+Ar$\sqrt{s_\text{NN}}$ = 0.2 TeV , to provide further insights in disentangling contributions from these two scenarios. These symmetric small systems have the advantage of providing a better controlled initial geometry dominated by the average shape of the overlap region as opposed to fluctuation-driven geometries in asymmetric systems. In this work, a transport model is employed to investigate the expected geometry response in the FSM scenario. Different trends of elliptic flow with increasing charge particle multiplicity are observed between symmetric and asymmetric systems, whereas triangular flow appears to show a similar behavior. Furthermore, a comparison of O+O collisions at $\sqrt{s_\text{NN}}$ = 0.2 TeV and at $\sqrt{s_\text{NN}}$ = 2.76 ₋ 7 TeV as proposed at the CERN Large Hadron Collider, provides a unique opportunity to disentangle the collision geometry effects at the nucleon level from those arising from subnucleon fluctuations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Enhanced production of strange baryons in high-energy nuclear collisions from a multiphase transport model

Here, we introduce additional coalescence factors for the production of strange baryons in a multiphase transport (AMPT) model in order to describe the enhanced production of multistrange hadrons observed in Pb + Pb collisions at $\sqrt{s_{NN}}$ = 2.76 TeV at the Large Hadron Collider (LHC) and Au + Au collisions at $\sqrt{s_{NN}}$ = 200 GeV at Relativistic Heavy-Ion Collider (RHIC). This extended AMPT model is found to also give a reasonable description of the multiplicity dependence of the strangeness enhancement observed in high multiplicity events in $\textit{pp}$ collisions at $\sqrt{s}$ = 7 TeV and $\textit{p}$-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV. We find that the coalescence factors depend on the system size but not much on whether the system is produced from A + A or $\textit{p}$ + A collisions. Here, the extended AMPT model thus provides a convenient way to model the mechanism underlying the observed strangeness enhancement in collisions of both small and large systems at RHIC and LHC energies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sensitivity study with a $\textit{D}$ and $\textit{B}$ mesons modular simulation code of heavy flavor $R_{AA}$ and azimuthal anisotropies based on beam energy, initial conditions, hadronization, and suppression mechanisms

Heavy flavor probes provide important information about the in-medium properties of the quark-gluon plasma produced in heavy-ion collisions. In this work, we investigate the effects of 2D + 1 event-by-event fluctuating hydrodynamic backgrounds on the nuclear suppression factor and momentum anisotropies of heavy flavor mesons and nonphotonic electrons. Using the state-of-the-art $\textit{D}$ and $\textit{B}$ mesons modular simulation code (called “DAB-MOD”), we perform a systematic comparison of different transport equations in the same background, including a few energy-loss models—with and without energy-loss fluctuations—and a relativistic Langevin model with different drag parametrizations. We present the resulting $\textit{D}$ and $\textit{B}$ mesons $R_{A A}, v_2, v_3,$ and $v_4$ as well as multiparticle cumulants, in AuAu collisions at $\sqrt{s_{NN}}$ = 200 GeV and PbPb collisions at $\sqrt{s_{NN}}$ = 2.76 TeV and $\sqrt{s_{NN}}$ = 5.02 TeV , and compare them to the available experimental data. The $v_2${4}/$v_2${2} ratio, which is known to be a powerful probe of the initial conditions and flow fluctuations in the soft sector, is also studied in the context of heavy flavor. We also investigate the correlations between the transverse anisotropies of heavy mesons and all charged particles to better understand how heavy quarks couple to the hydrodynamically expanding quark-gluon plasma. Finally, we study the influence that different initial conditions and the implementation of heavy-light quark coalescence has on our results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Beam-energy dependence of the directed flow of deuterons in Au+Au collisions

Here, we present a measurement of the first-order azimuthal anisotropy v 1 of deuterons from Au + Au collisions at $\sqrt{s_{NN}}$ = 7.7 , 11.5, 14.5, 19.6, 27, and 39 GeV recorded with the STAR experiment at the Relativistic Heavy Ion Collider (RHIC). The energy dependence of the v 1 (y) slope, $dv_1/dy|_{y=0}$, for deuterons, where y is the rapidity, is extracted for semicentral collisions (10%–40% centrality) and compared with that of protons. While the v 1 (y) slopes of protons are generally negative for $\sqrt{s_{NN}}$ > 10 GeV , those for deuterons are consistent with zero, a strong enhancement of the v 1 (y) slope of deuterons is seen at the lowest collision energy (the largest baryon density) at $\sqrt{s_{NN}}$ = 7.7 GeV . In addition, we report the transverse momentum dependence of v 1 for protons and deuterons. The experimental results are compared with transport and coalescence models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗