Search NASA⌕ Search

SEARCH · Search NASA

Results for “Q learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Variational preparation of the thermofield double state of the Sachdev-Ye-Kitaev model

Here, we provide an algorithm for preparing the thermofield double (TFD) state of the Sachdev-Ye-Kitaev (SYK) model without the need for an auxiliary bath. Following previous work, the TFD can be cast as the approximate ground state of a Hamiltonian, H TFD . Using variational quantum circuits, we propose and implement a gradient-based algorithm for learning parameters that find this ground state, an application of the variational quantum eigensolver. Concretely, we find shallow quantum circuits that prepare the ground state of H TFD for the q = 4 SYK model for N = 8 Majoranas per side. For N = 12, we achieve a variational energy within 1% of the true ground-state energy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Status of the LCLS-II-HE Project at Jefferson Lab

The Linac Coherent Light Source II High Energy (LCLS-II-HE) upgrade at the SLAC National Accelerator Laboratory is being constructed in partnership with the Thomas Jefferson National Accelerator Facility (JLab) and the Fermi National Accelerator Laboratory (FNAL). The cryomodule production scope consists of the design, procurement, construction, and acceptance testing of 24 eight-cavity, 1.3 GHz cryomodules, as well as R&D activities necessary to develop the required technology. To achieve this, JLab and FNAL are also contributing to SLAC’s effort to develop the cavity recipe and production processes necessary to meet the LCLS-II-HE goal of 20.8 MV/m and average Q₀ of 2.7·10¹⁰. This paper details the JLab scope, focusing on the project initiation phase, in particular technology development and prototyping, project development and planning, and implementation of lessons learned from LCLS-II.

Wilson, K. M.↗

Confinement performance predictions for a high field axisymmetric tandem mirror

This paper presents Hammir tandem mirror confinement performance analysis based on Realta Fusion's first-of-a-kind model for axisymmetric magnetic mirror fusion performance. This model uses an integrated end plug simulation model including, heating, equilibrium, and transport combined with a new formulation of the plasma operation contours (POPCONs) technique for the tandem mirror central cell. Using this model in concert with machine learning optimization techniques, it is shown that an end plug utilizing high temperature superconducting magnets and modern neutral beams enables a classical tandem mirror pilot plant producing a fusion gain Q > 5. The approach here represents an important advance in tandem mirror design. The high fidelity end plug model enables calculations of heating and transport in the highly non-Maxwellian end plug to be made more accurately. The detailed end plug modelling performed in this work has highlighted the importance of classical radial transport and neutral beam absorption efficiency on end plug viability. The central cell POPCON technique allows consideration of a wide range of parameters in the relatively simple near-Maxwellian central cell, facilitating the selection of more optimal central cell plasmas. These advances make it possible to find more conservative classical tandem mirror fusion pilot plant operating points with lower temperatures, neutral beam energies, and end plug performance requirements than designs in the literature. Despite being more conservative, it is shown that these operating points have sufficient confinement performance to serve as the basis of a viable fusion pilot plant provided that they can be stabilized against MHD and trapped particle modes.

FOS: Physical sciences↗

Deeply learning deep inelastic scattering kinematics

We study the use of deep learning techniques to reconstruct the kinematics of the neutral current deep inelastic scattering (DIS) process in electron–proton collisions. In particular, we use simulated data from the ZEUS experiment at the HERA accelerator facility, and train deep neural networks to reconstruct the kinematic variables Q 2 and x. Our approach is based on the information used in the classical construction methods, the measurements of the scattered lepton, and the hadronic final state in the detector, but is enhanced through correlations and patterns revealed with the simulated data sets. We show that, with the appropriate selection of a training set, the neural networks sufficiently surpass all classical reconstruction methods on most of the kinematic range considered. Rapid access to large samples of simulated data and the ability of neural networks to effectively extract information from large data sets, both suggest that deep learning techniques to reconstruct DIS kinematics can serve as a rigorous method to combine and outperform the classical reconstruction methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine Learning Characterization of Alfvénic and Sub-Alfvénic Chirping and Correlation With Fast-Ion Loss at NSTX

Abrupt large events in the Alfvenic and sub-Alfvenic frequency bands in tokamaks are typically correlated with increased fast ion loss. Here, machine learning is used to speed up the laborious process of characterizing the behaviour of magnetic perturbations from corresponding frequency spectrograms that are typically identified by humans. Analysis allows for comparison between different mode character (such as quiescent, fixedfrequency, chirping, avalanching) and plasma parameters obtained from the TRANSP code such as the ratio of the neutral beam injection (NBI) velocity and the Alfven velocity (v inj. /v A ), the q-profile, and the ratio of the neutral beam beta and the total plasma beta (β beam,i /β). In agreement with previous work by Fredrickson et al., in this work, we find correlation between β beam,i and mode character. In addition, previously unknown correlations are found between moments of the spectrograms and mode character. Character transition from quiescent to non-quiescent behaviour for magnetic fluctuations in the 50 - 200 kHz frequency band is observed along the boundary v Φ ≲ (1/4) (v inj. - 3v A ) where v Φ is the rotation

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Physics-Informed Deep Learning-Based Proof-of-Concept Study of a Novel Elastohydrodynamic Seal for Supercritical CO 2 Turbomachinery

Supercritical carbon dioxide (sCO 2 ) power cycles show promising potential of higher plant efficiencies and power densities for a wide range of power generation applications such as fossil fuel power plants, nuclear power production, solar power, and geothermal power generation. sCO 2 leakage through the turbomachinery has been one of the main concerns in such applications. To offer a potential solution, we propose an elastohydrodynamic (EHD) seal that can work at elevated pressures and temperatures with low leakage and minimal wear. The EHD seal has a very simple, sleeve-like structure, wrapping on the rotor with minimal initial clearance at micron levels. Here, in this work, a proof-of-concept study for the proposed EHD seal was presented by using the simplified Reynolds equation and Lame’s formula for the fluid flow in the clearance and for seal deformation, respectively. The set of nonlinear equations was solved by using both the conventional Prediction–Correction (PC) method and modern Physics-Informed Neural Network (PINN). It was shown that the physics-informed deep learning method provided good computational efficiency in resolving the steep pressure gradient in the clearance with good accuracy. The results showed that the leakage rates increased quadratically with working pressures and reached a steady-state at high-pressure values of 15~20 MPa, where Q = 300 g/s at 20 MPa for an initial seal clearance of 255 μm. This indicates that the EHD seal could be tailored to become a potential solution to minimize the sCO 2 discharge in power plants.

30 DIRECT ENERGY CONVERSION↗

Hierarchical Reinforcement Learning of a Short-Range Bond-Order Potential for Silica: Analytic Embedding of Coordination with Classical Efficiency

Reinforcement learning (RL) has recently emerged as a data-efficient strategy to parametrize short-range interatomic potentials. Building on our past RL optimization of pairwise silica models, we extend the framework to a bond-order (Tersoff-type) potential that provides an analytic embedding of local coordination through a three-body term. A hierarchical RL workflow combining continuous-action Monte Carlo Tree Search and property-based rewards efficiently explores the 26-dimensional parameter space, sequentially optimizing lattice parameters, densities, angles, and cohesive energies of 21 silica polymorphs. The resulting models, Q-Tersoff and ML-Tersoff, reproduce the energetic ordering of low-energy phases and capture the angular correlations and amorphous structure factors of silica with improved fidelity over pairwise force fields, while remaining orders of magnitude faster than high-dimensional machine-learned potentials. Both models underperform for elastic constants and high-energy frameworks, delineating the limits of the current analytic form. The approach establishes a general and interpretable route to angle-aware, short-range potentials that bridge physics-based and machine-learned descriptions of silicate materials.

36 MATERIALS SCIENCE↗

Machine Learning Characterization of Alfvénic and Sub-Alfvénic Chirping and Correlation With Fast-Ion Loss at NSTX

Abrupt large events in the Alfvenic and sub-Alfvenic frequency bands in tokamaks are typically correlated with increased fast-ion loss. Here, machine learning is used to speed up the laborious process of characterizing the behavior of magnetic perturbations from corresponding frequency spectrograms that are typically identified by humans. The analysis allows for comparison between different mode character (such as quiescent, fixed frequency, and chirping, avalanching) and plasma parameters obtained from the TRANSP code, such as the ratio of the neutral beam injection (NBI) velocity and the Alfven velocity (v_inj./v_A), the q-profile, and the ratio of the neutral beam beta and the total plasma beta (beta_beam,i / beta). In agreement with the previous work by Fredrickson et al., we find a correlation between beta_beam,i and mode character. In addition, previously unknown correlations are found between moments of the spectrograms and mode character. Character transition from quiescent to nonquiescent behavior for magnetic fluctuations in the 50200-kHz frequency band is observed along the boundary v_phi ~ (1/4)(v_inj. - 3v_A), where v_phi is the rotation velocity.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Search for supersymmetry in final states with a single electron or muon using angular correlations and heavy-object identification in proton-proton collisions at $ \sqrt{s} $ = 13 TeV

A search for supersymmetry is presented in events with a single charged lepton, electron or muon, and multiple hadronic jets. The data correspond to an integrated luminosity of 138 fb –1 of proton-proton collisions at a center-of-mass energy of 13 TeV, recorded by the CMS experiment at the CERN LHC. The search targets gluino pair production, where the gluinos decay into final states with the lightest supersymmetric particle (LSP) and either a top quark-antiquark ($\text{t}\bar{\text{t}}$ pair, or a light-flavor quark-antiquark ($\text{q}\bar{\text{q}}$ pair and a virtual or on-shell W boson. The main backgrounds, $\text{t}\bar{\text{t}}$ pair and W+jets production, are suppressed by requirements on the azimuthal angle between the momenta of the lepton and of its reconstructed parent W boson candidate, and by top quark and W boson identification based on a machine-learning technique. The number of observed events is consistent with the expectations from standard model processes. Limits are evaluated on supersymmetric particle masses in the context of two simplified models of gluino pair production. Exclusions for gluino masses reach up to 2120 (2050) GeV at 95% confidence level for a model with gluino decay to a $\text{t}\bar{\text{t}}$ pair (a $\text{q}\bar{\text{q}}$ pair and a W boson) and the LSP. For the same models, limits on the mass of the LSP reach up to 1250 (1070) GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fast neural Poincaré maps for toroidal magnetic fields

Poincaré maps for toroidal magnetic fields are routinely employed to study gross confinement properties in devices built to contain hot plasmas. In most practical applications, evaluating a Poincaré map requires numerical integration of a magnetic field line, a process that can be slow and that cannot be easily accelerated using parallel computations. We propose a novel neural network architecture, the HénonNet, and show that it is capable of accurately learning realistic Poincaré maps from observations of a conventional field-line-following algorithm. After training, such learned Poincaré maps evaluate much faster than the field-line integration method. Moreover, the HénonNet architecture exactly reproduces the primary physics constraint imposed on field-line Poincaré maps: flux preservation. Furthermore, this structure-preserving property is the consequence of each layer in a HénonNet being a symplectic map. We demonstrate empirically that a HénonNet can learn to mock the confinement properties of a large magnetic island by using coiled hyperbolic invariant manifolds to produce a sticky chaotic region at the desired island location. This suggests a novel approach to designing magnetic fields with good confinement properties that may be more flexible than ensuring confinement using KAM tori.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Application of Systems Engineering Principles and Techniques in Biological Big Data Analytics: A Review

In the past few decades, we have witnessed tremendous advancements in biology, life sciences and healthcare. These advancements are due in no small part to the big data made available by various high-throughput technologies, the ever-advancing computing power, and the algorithmic advancements in machine learning. Specifically, big data analytics such as statistical and machine learning has become an essential tool in these rapidly developing fields. As a result, the subject has drawn increased attention and many review papers have been published in just the past few years on the subject. Different from all existing reviews, this work focuses on the application of systems, engineering principles and techniques in addressing some of the common challenges in big data analytics for biological, biomedical and healthcare applications. Specifically, this review focuses on the following three key areas in biological big data analytics where systems engineering principles and techniques have been playing important roles: the principle of parsimony in addressing overfitting, the dynamic analysis of biological data, and the role of domain knowledge in biological data analytics.

dynamic analysis↗

SU-F-P-20: Predicting Waiting Times in Radiation Oncology Using Machine Learning

Purpose: Waiting times remain one of the most vexing patient satisfaction challenges facing healthcare. Waiting time uncertainty can cause patients, who are already sick or in pain, to worry about when they will receive the care they need. These waiting periods are often difficult for staff to predict and only rough estimates are typically provided based on personal experience. This level of uncertainty leaves most patients unable to plan their calendar, making the waiting experience uncomfortable, even painful. In the present era of electronic health records (EHRs), waiting times need not be so uncertain. Extensive EHRs provide unprecedented amounts of data that can statistically cluster towards representative values when appropriate patient cohorts are selected. Predictive modelling, such as machine learning, is a powerful approach that benefits from large, potentially complex, datasets. The essence of machine learning is to predict future outcomes by learning from previous experience. The application of a machine learning algorithm to waiting time data has the potential to produce personalized waiting time predictions such that the uncertainty may be removed from the patient’s waiting experience. Methods: In radiation oncology, patients typically experience several types of waiting (eg waiting at home for treatment planning, waiting in the waiting room for oncologist appointments and daily waiting in the waiting room for radiotherapy treatments). A daily treatment wait time model is discussed in this report. To develop a prediction model using our large dataset (with more than 100k sample points) a variety of machine learning algorithms from the Python package sklearn were tested. Results: We found that the Random Forest Regressor model provides the best predictions for daily radiotherapy treatment waiting times. Using this model, we achieved a median residual (actual value minus predicted value) of 0.25 minutes and a standard deviation residual of 6.5 minutes. This means that the majority of our estimates are within 6.5 minutes of the actual wait time. Conclusion: The goal of this project was to define an appropriate machine learning algorithm to estimate waiting times based on the collective knowledge and experience learned from previous patients. Our results offer an opportunity to improve the information that is provided to patients and family members regarding the amount of time they can expect to wait for radiotherapy treatment at our centre. AJ acknowledges support by the CREATE Medical Physics Research Training Network grant of the Natural Sciences and Engineering Research Council (Grant number: 432290) and from the 2014 Q+ Initiative of the McGill University Health Centre.

60 APPLIED LIFE SCIENCES↗

TH-B-204-00: Implanted Markers for Radiation Therapy and TG 199 Update

Implanted markers as target surrogates have been widely used for treatment verification, as they provide safe and reliable monitoring of the inter- and intra-fractional target motion. The rapid advancement of technology requires a critical review and recommendation for the usage of implanted surrogates in current field. The symposium, also reporting an update of AAPM TG 199 - Implanted Target Surrogates for Radiation Treatment Verification, will be focusing on all clinical aspects of using the implanted target surrogates for treatment verification and related issues. A wide variety of markers available in the market will be first reviewed, including radiopaque markers, MRI compatible makers, non-migrating coils, surgical clips and electromagnetic transponders etc. The pros and cons of each kind will be discussed. The clinical applications of implanted surrogates will be presented based on different anatomical sites. For the lung, we will discuss gated treatments and 2D or 3D real-time fiducial tracking techniques. For the prostate, we will be focusing on 2D-3D, 3D-3D matching and electromagnetic transponder based localization techniques. For the liver, we will review techniques when patients are under gating, shallow or free breathing condition. We will review techniques when treating challenging breast cancer as deformation may occur. Finally, we will summarize potential issues related to the usage of implanted target surrogates with TG 199 recommendations. A review of fiducial migration and fiducial derived target rotation in different disease sites will be provided. The issue of target deformation, especially near the diaphragm, and related suggestions will be also presented and discussed. Learning Objectives: Knowledge of a wide variety of markers Knowledge of their application for different disease sites Understand of issues related to these applications Z. Wang: Research funding support from Brainlab AG Q. Xu: Consultant for Accuray; Q. Xu, I am a consultant for Accuray planning service.

60 APPLIED LIFE SCIENCES↗

TH-B-204-01: Real-Time Tracking with Implanted Markers

Implanted markers as target surrogates have been widely used for treatment verification, as they provide safe and reliable monitoring of the inter- and intra-fractional target motion. The rapid advancement of technology requires a critical review and recommendation for the usage of implanted surrogates in current field. The symposium, also reporting an update of AAPM TG 199 - Implanted Target Surrogates for Radiation Treatment Verification, will be focusing on all clinical aspects of using the implanted target surrogates for treatment verification and related issues. A wide variety of markers available in the market will be first reviewed, including radiopaque markers, MRI compatible makers, non-migrating coils, surgical clips and electromagnetic transponders etc. The pros and cons of each kind will be discussed. The clinical applications of implanted surrogates will be presented based on different anatomical sites. For the lung, we will discuss gated treatments and 2D or 3D real-time fiducial tracking techniques. For the prostate, we will be focusing on 2D-3D, 3D-3D matching and electromagnetic transponder based localization techniques. For the liver, we will review techniques when patients are under gating, shallow or free breathing condition. We will review techniques when treating challenging breast cancer as deformation may occur. Finally, we will summarize potential issues related to the usage of implanted target surrogates with TG 199 recommendations. A review of fiducial migration and fiducial derived target rotation in different disease sites will be provided. The issue of target deformation, especially near the diaphragm, and related suggestions will be also presented and discussed. Learning Objectives: Knowledge of a wide variety of markers Knowledge of their application for different disease sites Understand of issues related to these applications Z. Wang: Research funding support from Brainlab AG Q. Xu: Consultant for Accuray; Q. Xu, I am a consultant for Accuray planning service.

60 APPLIED LIFE SCIENCES↗

TH-B-204-02: Application of Implanted Markers in Proton Therapy

Implanted markers as target surrogates have been widely used for treatment verification, as they provide safe and reliable monitoring of the inter- and intra-fractional target motion. The rapid advancement of technology requires a critical review and recommendation for the usage of implanted surrogates in current field. The symposium, also reporting an update of AAPM TG 199 - Implanted Target Surrogates for Radiation Treatment Verification, will be focusing on all clinical aspects of using the implanted target surrogates for treatment verification and related issues. A wide variety of markers available in the market will be first reviewed, including radiopaque markers, MRI compatible makers, non-migrating coils, surgical clips and electromagnetic transponders etc. The pros and cons of each kind will be discussed. The clinical applications of implanted surrogates will be presented based on different anatomical sites. For the lung, we will discuss gated treatments and 2D or 3D real-time fiducial tracking techniques. For the prostate, we will be focusing on 2D-3D, 3D-3D matching and electromagnetic transponder based localization techniques. For the liver, we will review techniques when patients are under gating, shallow or free breathing condition. We will review techniques when treating challenging breast cancer as deformation may occur. Finally, we will summarize potential issues related to the usage of implanted target surrogates with TG 199 recommendations. A review of fiducial migration and fiducial derived target rotation in different disease sites will be provided. The issue of target deformation, especially near the diaphragm, and related suggestions will be also presented and discussed. Learning Objectives: Knowledge of a wide variety of markers Knowledge of their application for different disease sites Understand of issues related to these applications Z. Wang: Research funding support from Brainlab AG Q. Xu: Consultant for Accuray; Q. Xu, I am a consultant for Accuray planning service.

60 APPLIED LIFE SCIENCES↗

TH-B-204-03: TG-199: Implanted Markers for Radiation Treatment Verification

Implanted markers as target surrogates have been widely used for treatment verification, as they provide safe and reliable monitoring of the inter- and intra-fractional target motion. The rapid advancement of technology requires a critical review and recommendation for the usage of implanted surrogates in current field. The symposium, also reporting an update of AAPM TG 199 - Implanted Target Surrogates for Radiation Treatment Verification, will be focusing on all clinical aspects of using the implanted target surrogates for treatment verification and related issues. A wide variety of markers available in the market will be first reviewed, including radiopaque markers, MRI compatible makers, non-migrating coils, surgical clips and electromagnetic transponders etc. The pros and cons of each kind will be discussed. The clinical applications of implanted surrogates will be presented based on different anatomical sites. For the lung, we will discuss gated treatments and 2D or 3D real-time fiducial tracking techniques. For the prostate, we will be focusing on 2D-3D, 3D-3D matching and electromagnetic transponder based localization techniques. For the liver, we will review techniques when patients are under gating, shallow or free breathing condition. We will review techniques when treating challenging breast cancer as deformation may occur. Finally, we will summarize potential issues related to the usage of implanted target surrogates with TG 199 recommendations. A review of fiducial migration and fiducial derived target rotation in different disease sites will be provided. The issue of target deformation, especially near the diaphragm, and related suggestions will be also presented and discussed. Learning Objectives: Knowledge of a wide variety of markers Knowledge of their application for different disease sites Understand of issues related to these applications Z. Wang: Research funding support from Brainlab AG Q. Xu: Consultant for Accuray; Q. Xu, I am a consultant for Accuray planning service.

60 APPLIED LIFE SCIENCES↗

Towards a unified nonlocal, peridynamics framework for the coarse-graining of molecular dynamics data with fractures

Molecular dynamics (MD) has served as a powerful tool for designing materials with reduced reliance on laboratory testing. However, the use of MD directly to treat the deformation and failure of materials at the mesoscale is still largely beyond reach. In this work, we propose a learning framework to extract a peridynamics model as a mesoscale continuum surrogate from MD simulated material fracture data sets. Firstly, we develop a novel coarse-graining method, to automatically handle the material fracture and its corresponding discontinuities in the MD displacement data sets. Inspired by the weighted essentially non-oscillatory (WENO) scheme, the key idea lies at an adaptive procedure to automatically choose the locally smoothest stencil, then reconstruct the coarse-grained material displacement field as the piecewise smooth solutions containing discontinuities. Then, based on the coarse-grained MD data, a two-phase optimization-based learning approach is proposed to infer the optimal peridynamics model with damage criterion. In the first phase, we identify the optimal nonlocal kernel function from the data sets without material damage to capture the material stiffness properties. Then, in the second phase, the material damage criterion is learnt as a smoothed step function from the data with fractures. As a result, a peridynamics surrogate is obtained. As a continuum model, our peridynamics surrogate model can be employed in further prediction tasks with different grid resolutions from training, and hence allows for substantial reductions in computational cost compared with MD. We illustrate the efficacy of the proposed approach with several numerical tests for the dynamic crack propagation problem in a single-layer graphene. Our tests show that the proposed data-driven model is robust and generalizable, in the sense that it is capable of modeling the initialization and growth of fractures under discretization and loading settings that are different from the ones used during training.

97 MATHEMATICS AND COMPUTING↗

Forming a database to study reversed magnetic shear from the National Spherical Torus eXperiment using machine learning

Achieving a long-lived reversed magnetic shear (RMS) target plasma in the National Spherical Torus eXperiment Upgrade will require developing various sustainment scenarios. To help with the ongoing plasma control efforts, the development of a new analysis for the motional Stark effect (MSE) diagnostic using a machine learning algorithm, namely, MSE-ML, is described. MSE-ML will be used to identify patterns during RMS discharges, some of which suffer magnetohydrodynamic (MHD) events resulting in current redistribution and monotonic q-profiles. A database consisting of q and magnetic shear profiles is being constructed primarily based on the existing National Spherical Torus eXperiment data with equilibrium reconstructions constrained by the magnetic field pitch angle profile measured using the multi-channel MSE diagnostic. An unsupervised k-means clustering of the data is developed to study the RMS formation as a function of time. The initial clustering from the q-profiles shows significant differences in both amplitude and the duration of the RMS period. As a goal, the clustering results that detect and distinguish shots with substantial and sustained RMS are to be used as a preprocessing step in a supervised algorithm to identify the underlying conditions that lead to long-lasting improved confinement with RMS. Another aim of the MSE-ML study is to identify precursors of RMS-destroying MHD events in either derived data such as the q-profile or directly measured data such as the magnetic field pitch angle profile.

Uzun-Kaymak, I. U. (ORCID:0000000276251493)↗