Search NASA⌕ Search

SEARCH · Search NASA

Results for “physically informed neural network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

The expressivity of classical and quantum neural networks on entanglement entropy

Abstract Analytically continuing the von Neumann entropy from Rényi entropies is a challenging task in quantum field theory. While then-th Rényi entropy can be computed using the replica method in the path integral representation of quantum field theory, the analytic continuation can only be achieved for some simple systems on a case-by-case basis. In this work, we propose a general framework to tackle this problem using classical and quantum neural networks with supervised learning. We begin by studying several examples with known von Neumann entropy, where the input data is generated by representing$${\text {Tr}}\rho _A^n$$ Tr ρ A n with a generating function. We adopt KerasTuner to determine the optimal network architecture and hyperparameters with limited data. In addition, we frame a similar problem in terms of quantum machine learning models, where the expressivity of the quantum models for the entanglement entropy as a partial Fourier series is established. Our proposed methods can accurately predict the von Neumann and Rényi entropies numerically, highlighting the potential of deep learning techniques for solving problems in quantum information theory.

Physics↗

A nearsighted force-training approach to systematically generate training data for the machine learning of large atomic structures

A challenge of atomistic machine-learning (ML) methods is ensuring that the training data are suitable for the system being simulated, which is particularly challenging for systems with large numbers of atoms. Most atomistic ML approaches rely on the nearsightedness principle (“all chemistry is local”), using information about the position of an atom’s neighbors to predict a per-atom energy. Here, in this work, we develop a framework that exploits the nearsighted nature of ML models to systematically produce an appropriate training set for large structures. We use a per-atom uncertainty estimate to identify the most uncertain atoms and extract chunks centered around these atoms. It is crucial that these small chunks are both large enough to satisfy the ML’s nearsighted principle (that is, filling the cutoff radius) and are large enough to be converged with respect to the electronic structure calculation. We present data indicating when the electronic structure calculations are converged with respect to the structure size, which fundamentally limits the accuracy of any nearsighted ML calculator. These new atomic chunks are calculated in electronic structures, and crucially, only a single force—that of the central atom—is added to the growing training set, preventing the noisy and irrelevant information from the piece’s boundary from interfering with ML training. The resulting ML potentials are robust, despite requiring single-point calculations on only small reference structures and never seeing large training structures. We demonstrated our approach via structure optimization of a 260-atom structure and extended the approach to clusters with up to 1415 atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Measurement of the muon neutrino charged-current mesonless cross section in the NOvA near detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab. Its physics goals include precision neutrino oscillation measurements, neutrino interaction cross-section measurements and beyond Standard Model explorations. We present a measurement of muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement is performed as a function of the kinematics of the final state muon. Our chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and it provides handles for constraining the cross section systematic uncertainties in oscillation analyses in present and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA Near detector. This allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. We study strategies for constraining the remaining charged-pion background via Michel electron information in a template fitting approach. The main experimental result is a two-dimensional differential cross section as a function of final-state muon kinetic energy and polar angle. The parameters of this measurement, including binning and unfolding, were optimized to reduce the expected systematic uncertainty in the total cross section. The final result shows good agreement with the main GENIE-based simulation framework that was independently fine-tuned in NOvA. We finally propose improvements and subsequent steps that build on this analysis and further dissect the final states of neutrino interactions. This work has been supported by US DOE grant DE-SC0015684.

Sánchez Falero, Sebastián Jesús [Iowa State U.]↗

Turbulent field fluctuations in gyrokinetic and fluid plasmas

A key uncertainty in the design and development of magnetic confinement fusion energy reactors is predicting edge plasma turbulence. An essential step in overcoming this uncertainty is the validation in accuracy of reduced turbulent transport models. Drift-reduced Braginskii two-fluid theory is one such set of reduced equations that has for decades simulated boundary plasmas in experiment, but significant questions exist regarding its predictive ability. To this end, using a novel physics-informed deep learning framework, we demonstrate the first ever direct quantitative comparisons of turbulent field fluctuations between electrostatic two-fluid theory and electromagnetic gyrokinetic modeling with good overall agreement found in magnetized helical plasmas at low normalized pressure. This framework presents a new technique for the numerical validation and discovery of reduced global plasma turbulence models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Measurement of the Electroweak Single Top Quark Production Cross Section and the CKM Matrix Element $|V_{tb}|$ at CDF Run II

The establishment of the electroweak single top quark production at CDF is experimentally challenging. The small single top signal hidden under large uncertain background processes makes it necessary an excellent understanding of the detector and a detailed study of the processes involved. Moreover, simple counting experiments are not sufficient to extract enough information from the candidate event sample and multivariate analysis techniques are crucial to distinguish signal from background. This thesis presents the world’s most sensitive individual search, together with CDF’s Neural Network analysis, for the combined s- and t-channel single top production. This analysis uses a dataset that corresponds to an integrated luminosity of 3.2fb -1 , and is based on a Boosted Decision Tree method that combines information from several input variables to construct a final powerful discriminant, reaching a sensitivity to the combined single top quark production equivalent to 5.2σ. The measured combined single top quark production cross section is 2.1 +0.7 -0.6 pb assuming a top quark mass of 175 GeV/c 2 . The probability that this result comes from a background-only fluctuation (p-value) is 0.0002, which corresponds to 3.5σ.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Delivery Ring Spill Characterization and Impulse Study

High-intensity particle physics experiments require uniform beam extraction to prevent instantaneous rate spikes from overwhelming detector systems. By analyzing accelerator parameters and extracted beam dynamics, we directly inform spill regulation systems that make real-time adjustments to minimize non-uniformity. This Department of Energy Visiting Faculty Program project transitioned from characterizing Main Injector half-integer slow extraction for SpinQuest to Delivery Ring third-integer slow extraction for Mu2e. Working alongside the Fast Adaptive Neural Control (FANC) group, we developed an automated pipeline that aligns asynchronous instrument channels, embeds quality metrics, and isolates clean spill populations. Analyzing baseline spills alongside a dedicated quadrupole impulse study allowed us to quantify noise structures while mapping time-varying beam response and transit-delay dynamics. These empirical measurements directly ground digital twin models, supporting FANC’s deployment of real-time, FPGA-based neural network controllers in the Mu2e Spill Regulation System.

Dolen, James William [Purdue U., West Lafayette] (↗

SAM-ML: Integrating data-driven closure with nuclear system code SAM for improved modeling capability

Advanced reactors often involve complicated thermal-fluid (T-F) phenomena. Modeling such phenomena with the traditional one-dimensional (1-D) system code is a challenging task. The System Analysis Module (SAM), a modern nuclear system code, has developed a coarse mesh multi-dimensional (multi-D) flow model to capture the spatial effect of T-F phenomena in advanced reactors. As a coarse mesh solver, constitutive relations are required for SAM's multi-D model for unresolved fine-scale physics, such as turbulence. Here this work presents a novel approach that integrates neural networks as data-driven closure for SAM's multi-D flow model. The data-driven closure is trained with fine-resolution data to ensure its accuracy while maintaining a coarse mesh setup to ensure its efficiency and consistency with SAM. We demonstrate the applicability of this SAM-ML capability in an open volume thermal stratification problem, where a neural network model serves as the eddy viscosity closure. A customized interface between the neural network and SAM is developed to ensure flexible and efficient data exchange. The SAM-ML results demonstrate superior performance compared to SAM's built-in zero-equation eddy viscosity closure. The case study shows that although the generalization capability of the data-driven closure still needs to be improved for different transient case or different geometric setup, SAM -ML demonstrates good potential for challenging simulation problems with improved accuracy and computational efficiency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neural network approach for characterizing structural transformations by X-ray absorption fine structure

The knowledge of coordination environment around various atomic species in many functional materials provides a key for explaining their properties and working mechanisms. Many structural motifs and their transformations are difficult to detect and quantify in the process of work (operando conditions), due to their local nature, small changes, low dimensionality of the material, and/or extreme conditions. Here we use artificial neural network approach to extract the information on the local structure and its in-situ changes directly from the X-ray absorption fine structure spectra. We illustrate this capability by extracting the radial distribution function (RDF) of atoms in ferritic and austenitic phases of bulk iron across the temperature-induced transition. Integration of RDFs allows us to quantify the changes in the iron coordination and material density, and to observe the transition from body-centered to face-centered cubic arrangement of iron atoms. Furthermore, this method is attractive for a broad range of materials and experimental conditions

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Zentropy Theory for Transformative Functionalities of Magnetic and Superconducting Materials

The proposed research developed the zentropy theory through applications to complex magnetic materials and superconductors under the hypothesis that the emergent properties of complex magnetic materials and superconductors can be predicted by statistical mechanics of ergodic microstates with their partition functions computed from DFT-predicted free energies. The key objective is to develop approaches to systematically determine the types and number of microstates and the supercell size in DFT-based calculations through convergency of macroscopic functionalities, with the incorporation of our mixed-space approach accounting for the interactions between periodic supercells. In addition to use scientific intuitions to guide the design of important microstates, the key innovation of the proposed research is to integrate the domain knowledge and the material-property-descriptor database (MPDD) with 4 million microstates, which is supported by our deep neural network machine learning models (SIPFENN: structure-informed prediction of formation energy using neural networks) and integrated with our high throughput DFT Tool Kit (DFTTK). For complex magnetic materials, one of the objectives is to develop approaches to calculate short-range ordering from the statistical distribution of each microstate. For superconductors, the divergency of quasiparticle effective mass at a quantum critical point will be investigated, and the superconducting and non-superconducting microstates will be delineated through analysis of electronic band structure, density of states, charge density, and Fermi surface.

36 MATERIALS SCIENCE↗

A Reconfigurable Neural Network ASIC for Detector Front-End Data Compression at the HL-LHC

Despite advances in the programmable logic capabilities of modern trigger systems, a significant bottleneck remains in the amount of data to be transported from the detector to off-detector logic where trigger decisions are made. We demonstrate that a neural network (NN) autoencoder model can be implemented in a radiation-tolerant application-specific integrated circuit (ASIC) to perform lossy data compression alleviating the data transmission problem while preserving critical information of the detector energy profile. For our application, we consider the high-granularity calorimeter from the Compact Muon Solenoid (CMS) experiment at the CERN Large Hadron Collider. The advantage of the machine learning approach is in the flexibility and configurability of the algorithm. By changing the NN weights, a unique data compression algorithm can be deployed for each sensor in different detector regions and changing detector or collider conditions. To meet area, performance, and power constraints, we perform quantization-aware training to create an optimized NN hardware implementation. The design is achieved through the use of high-level synthesis tools and the hls4ml framework and was processed through synthesis and physical layout flows based on a low-power (LP)-CMOS 65-nm technology node. The flow anticipates 200 Mrad of ionizing radiation to select gates and reports a total area of 3.6 mm 2 and consumes 95 mW of power. The simulated energy consumption per inference is 2.4 nJ. Furthermore, this is the first radiation-tolerant on-detector ASIC implementation of an NN that has been designed for particle physics applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Search for standard model Higgs boson production in association with a W boson using a neural network discriminant at CDF

We present a search for standard model Higgs boson production in association with a W boson in proton-antiproton collisions (pp{yields}W{sup {+-}}H{yields}l{nu}bb) at a center of mass energy of 1.96 TeV. The search employs data collected with the CDF II detector that correspond to an integrated luminosity of approximately 1.9 fb{sup -1}. We select events consistent with a signature of a single charged lepton (e{sup {+-}}/{mu}{sup {+-}}), missing transverse energy, and two jets. Jets corresponding to bottom quarks are identified with a secondary vertex tagging method, a jet probability tagging method, and a neural network filter. We use kinematic information in an artificial neural network to improve discrimination between signal and background compared to previous analyses. The observed number of events and the neural network output distributions are consistent with the standard model background expectations, and we set 95% confidence level upper limits on the production cross section times branching fraction ranging from 1.2 to 1.1 pb or 7.5 to 102 times the standard model expectation for Higgs boson masses from 110 to 150 GeV/c{sup 2}, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Inverse Mapping of the Collision Kernel and Wall Flux Scaling in a Tall Convection‐Cloud Chamber Using Local Sensors and Knowledge‐Informed Deep Learning

Droplet collision–coalescence is a crucial process in cloud physics, but accurately representing this process under different dynamical conditions remains challenging. A proposed future convective‐cloud chamber aims to investigate this key process, but the method for observing it remains unclear, even though it is theoretically established that collision‐coalescence will occur. This study serves as a proof‐of‐concept demonstration of how knowledge‐informed deep learning, combined with measurement data from local sensors in the chamber, can be used to estimate the collision kernels, which determine how the droplet size distribution evolves during collision‐coalescence. In addition to estimating the collision kernel, we also address wall fluxes, another uncertain but important process that acts as a source of heat and moisture in the chamber. Ensemble runs of large‐eddy simulations are conducted by scaling the wall fluxes and the collision kernel, while the measured flow and cloud properties are used as inputs for a neural network. Results indicate that this approach successfully maps the scaling of wall fluxes and the collision kernel with biases of approximately 1% or less relative to the range of the target data. This proof‐of‐concept lays the groundwork for future applications; when the real measurements are available, real sensor data combined with the trained model presented in this work will enable estimation of the actual wall fluxes and collision kernel.

cloud chamber↗

Predictive Integrated Modeling of Heated Tokamak Plasmas (Final Technical Report)

The research carried out by the Lehigh University fusion group during this reporting period: (1) Self-consistent predictive core-pedestal ITER scenario modeling; (2) Microtearing instabilities and electron thermal transport in standard and spherical tokamak discharges; (3) Neural network model of the Multi-Mode anomalous transport module; (4) Anomalous transport in KSTAR, JET, EAST, Alcator C-Mod and DIII-D discharges; (5) Theory for transport in magnetized plasmas; (6) Control-oriented modeling of the q-profile dynamic response in preparation for advanced scenario control in KSTAR and in EAST; (7) Modeling of edge harmonic oscillation in DIII-D QH mode discharges; (8) Elucidating plasma dynamics in Hasegawa-Wakatani turbulence by information geometry; (9) Non-linear Langevin and Fractional Fokker–Planck equations for anomalous diffusion by Levy stable processes; and (10) Investigation of the plasma shaping effects on the H-mode pedestal structure.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Neural network representation of electronic structure from ab initio molecular dynamics

Despite their rich information content, electronic structure data amassed at high volumes in ab initio molecular dynamics simulations are generally under-utilized. Here we introduce a transferable high-fidelity neural network representation of such data in the form of tight-binding Hamiltonians for crystalline materials. This predictive representation of ab initio electronic structure, combined with machine-learning boosted molecular dynamics, enables efficient and accurate electronic evolution and sampling. When it is applied to a one-dimension charge-density wave material, carbyne, we are able to compute the spectral function and optical conductivity in the canonical ensemble. The spectral functions evaluated during soliton-antisoliton pair annihilation process reveal significant renormalization of low-energy edge modes due to retarded electron-lattice coupling beyond the Born–Oppenheimer limit. The availability of an efficient and reusable surrogate model for the electronic structure dynamical system will enable calculating many interesting physical properties, paving the way to previously inaccessible or challenging avenues in materials modeling.

74 ATOMIC AND MOLECULAR PHYSICS↗

Using Machine Learning to Predict Future Temperature Outputs in Geothermal Systems

Optimizing the power output, and economic value, of geothermal power plants over decades of operation is a major challenge in renewable energy. Optimizing the output requires the ability to predict the mass flow rates and the output temperatures of production wells based on the inputs of injection wells, as well as the time history of the system. Machine Learning (ML) that incorporates the known physics of geothermal systems is one possible solution to this challenge. In this work, we explore the ability of ML algorithms to predict future temperature outputs based on historical data. Considering the challenges with obtaining an empirical dataset from field data that is large enough to enable reliable ML, we propose an alternate approach: developing a high-fidelity reservoir model and using computational resources to build a dataset that enables ML. As a first step towards achieving this goal, we present preliminary results from applying ML to predict the temperature timeseries of simple modeled geothermal systems. We describe the application of relevant state-of-the-art ML approaches, such as the Long Short-Term Memory (LSTM) networks and Convolutional Neural Networks (CNN), to extract temporal structures in the model data. We assess the accuracy of the forecasts we obtain, compare the selected approaches, and share the lessons learned that would inform the process of training and utilizing ML algorithms for larger and more complex geothermal systems.

GEOTHERMAL ENERGY↗

Integrated Cyber/Physical Grid Resiliency Modeling

This project explored coupling modeling and analysis methods from multiple domains to address complex hybrid (cyber and physical) attacks on mission critical infrastructure. Robust methods to integrate these complex systems are necessary to enable large trade-space exploration including dynamic and evolving cyber threats and mitigations. Reinforcement learning employing deep neural networks, as in the AlphaGo Zero solution, was used to identify "best" (or approximately optimal) resilience strategies for operation of a cyber/physical grid model. A prototype platform was developed and the machine learning (ML) algorithm was made to play itself in a game of 'Hurt the Grid'. This proof of concept shows that machine learning optimization can help us understand and control complex, multi-dimensional grid space. A simple, yet high-fidelity model proves that the data have spatial correlation which is necessary for any optimization or control. Our prototype analysis showed that the reinforcement learning successfully improved adversary and defender knowledge to manipulate the grid. When expanded to more representative models, this exact type of machine learning will inform grid operations and defense - supporting mitigation development to defend the grid from complex cyber attacks! This same research can be expanded to similar complex domains.

97 MATHEMATICS AND COMPUTING↗

Using Computationally-Determined Properties for Machine Learning Prediction of Self-Diffusion Coefficients in Pure Liquids

The ability to predict transport properties of liquids quickly and accurately will greatly improve our understanding of fluid properties both in bulk and complex mixtures, as well as in confined environments. Such information could then be used in the design of materials and processes for applications ranging from energy production and storage to manufacturing processes. As a first step, we consider the use of machine learning (ML) methods to predict the diffusion properties of pure liquids. Recent results have shown that Artificial Neural Networks (ANNs) can effectively predict the diffusion of pure compounds based on the use of experimental properties as the model inputs. In the current study, a similar ANN approach is applied to modeling diffusion of pure liquids using fluid properties obtained exclusively from molecular simulations. A diverse set of 102 pure liquids is considered, ranging from small polar molecules (e.g., water) to large nonpolar molecules (e.g., octane). Self-diffusion coefficients were obtained from classical molecular dynamics (MD) simulations. Since nearly all the molecules are organic compounds, a general set of force field parameters for organic molecules was used. The MD methods are validated by comparing physical and thermodynamic properties with experiment. Computational input features for the ANN include physical properties obtained from the MD simulations as well as molecular properties from quantum calculations of individual molecules. Furthermore, fluid properties describing the local liquid structure were obtained from center of mass radial distribution functions (COM-RDFs). Feature sensitivity analysis revealed that isothermal compressibility, heat of vaporization, and the thermal expansion coefficient were the most impactful properties used as input for the ANN model to predict the MD simulated self-diffusion coefficients. The MD-based ANN successfully predicts the MD self-diffusion coefficients with only a subset (2 to 3) of the available computationally determined input features required. A separate ANN model was developed using literature experimental self-diffusion coefficients as model targets. Although this second ML model was not as successful due to a limited number of data points, a good correlation is still observed between experimental and ML predicted self-diffusion coefficients.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Probabilistic Nanomagnetic Memories for Uncertain and Robust Machine Learning

This project evaluated the use of emerging spintronic memory devices for robust and efficient variational inference schemes. Variational inference (VI) schemes, which constrain the distribution for each weight to be a Gaussian distribution with a mean and standard deviation, are a tractable method for calculating posterior distributions of weights in a Bayesian neural network such that this neural network can also be trained using the powerful backpropagation algorithm. Our project focuses on domain-wall magnetic tunnel junctions (DW-MTJs), a powerful multi-functional spintronic synapse design that can achieve low power switching while also opening the pathway towards repeatable, analog operation using fabricated notches. Our initial efforts to employ DW-MTJs as an all-in-one stochastic synapse with both a mean and standard deviation didn’t end up meeting the quality metrics for hardware-friendly VI. In the future, new device stacks and methods for expressive anisotropy modification may make this idea still possible. However, as a fall back that immediately satisfies our requirements, we invented and detailed how the combination of a DW-MTJ synapse encoding the mean and a probabilistic Bayes-MTJ device, programmed via a ferroelectric or ionically modifiable layer, can robustly and expressively implement VI. This design includes a physics-informed small circuit model, that was scaled up to perform and demonstrate rigorous uncertainty quantification applications, up to and including small convolutional networks on a grayscale image classification task, and larger (Residual) networks implementing multi-channel image classification. Lastly, as these results and ideas all depend upon the idea of an inference application where weights (spintronic memory states) remain non-volatile, the retention of these synapses for the notched case was further interrogated. These investigations revealed and emphasized the importance of both notch geometry and anisotropy modification in order to further enhance the endurance of written spintronic states. In the near future, these results will be mapped to effective predictions for room temperature and elevated operation DW-MTJ memory retention, and experimentally verified when devices become available.

77 NANOSCIENCE AND NANOTECHNOLOGY↗