Search NASA⌕ Search

SEARCH · Search NASA

Results for “Current Controllers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Developing and Implementing New Waste Chemistry Controls for Hanford's Double-Shell Tanks - 20041

Waste chemistry controls for the Hanford double-shell tanks (DSTs) were established in the 1980's in response to tank failures caused by stress corrosion cracking (SCC) at the Savannah River Site (SRS). The controls were established based on a combination of SRS chemistry limits and corrosion testing results. Conditions in the Hanford DSTs have changed over time, with the temperature in the majority of the DSTs dropping below 50 deg. C. Testing indicated that the original chemistry control specification and SCC testing performed in 2010 did not protect against pitting corrosion mechanisms - what is believed to have caused the failure of tank 241-AY-102. New waste chemistry controls are necessary to protect the DSTs from both SCC and pitting corrosion. Savannah River National Laboratory (SRNL), with input from the Tank Integrity Expert Panel (TIEP) Corrosion Subgroup (CSG), performed a statistically based investigation of nitrate and halide ion induced pitting corrosion. The investigation was intended to develop a comprehensive waste chemistry envelope that minimizes the risk of both SCC and pitting caused by halide and nitrate ions. The waste chemistry envelope needed to be robust enough to address future waste retrieval and process changes which could significantly change the waste composition of the DSTs. The experimental design allowed the statistically significant ions and their effect on pitting corrosion to be determined. SRNL developed the 'pitting factor' which is an empirical relationship between the statistically significant inhibitive species (hydroxide, and nitrite), and pitting inducing species (nitrate, chloride, and fluoride). The coefficients are weighted factors that show the degree of influence the species have on the propensity for pitting. New waste chemistry control limits were recommended by SRNL, and concurred with by the TIEP CSG, that incorporated the pitting factor along with other limits. The controls developed to reduce the risk of pitting corrosion were evaluated to determine if they also protected against SCC. Hundreds of test results were reviewed and compared against the proposed limits. With the exception of one test result, instances where cracking was observed corresponded to chemistry that was outside of the proposed limits - indicating that the chemistry controls developed for pitting also adequately addressed SCC concerns. Existing tank composition estimates were evaluated against the new chemistry controls - three current tank chemistries are suspect, and may not meet the new chemistry control requirements. These included the interstitial liquid (liquid associated with solids) of DSTs 241-AN-102, 241-AN-106, 241-AN-107, and 241-AY-101. Measures are ongoing to evaluate the tanks with the suspect chemistry. These include varying combinations of: performing additional evaluations (history of use, modeling); DST specific laboratory testing; and, pursuing core samples of the DSTs. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

TRANSP-based closed-loop simulations of current profile optimal regulation in NSTX-Upgrade

Active control of the toroidal current density profile is critical for the upgraded National Spherical Torus eXperiment device (NSTX-U) to maintain operation at the desired high-performance, MHD-stable, plasma regime. Initial efforts towards current density profile control have led to the development of a control-oriented, physics-based, plasma-response model, which combines the magnetic diffusion equation with empirical correlations for the kinetic profiles and the non-inductive current sources. The developed control-oriented model has been successfully tailored to the NSTX-U geometry and actuators. Moreover, a series of efforts have been made towards the design of model-based controllers, including a linear-quadratic-integral optimal control strategy that can regulate the current density profile around a prescribed target profile while rejecting disturbances. In this work, the tracking performance of the proposed current-profile optimal controller is tested in numerical simulations based on the physics-oriented code TRANSP. These high-fidelity closed-loop simulations, which are a critical step before experimental implementation and testing, are enabled by a flexible framework recentlydeveloped to perform feedback control design and simulation in TRANSP.

current profile control↗

TRANSP-based closed-loop simulations of current profile optimal regulation in NSTX-Upgrade

Active control of the toroidal current density profile is critical for the upgraded National Spherical Torus eXperiment device (NSTX-U) to maintain operation at the desired high-performance, MHD-stable, plasma regime. Initial efforts towards current density profile control have led to the development of a control-oriented, physics-based, plasma-response model, which combines the magnetic diffusion equation with empirical correlations for the kinetic profiles and the non-inductive current sources. The developed control-oriented model has been successfully tailored to the NSTX-U geometry and actuators. Moreover, a series of efforts have been made towards the design of model-based controllers, including a linear-quadratic-integral optimal control strategy that can regulate the current density profile around a prescribed target profile while rejecting disturbances. In this work, the tracking performance of the proposed current-profile optimal controller is tested in numerical simulations based on the physics-oriented code TRANSP. Furthermore, these high-fidelity closed-loop simulations, which are a critical step before experimental implementation and testing, are enabled by a flexible framework recently developed to perform feedback control design and simulation in TRANSP.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Effect of hexagonal patterned arrays and defect geometry on the critical current of superconducting films

Understanding the effect of pinning on the vortex dynamics in superconductors is a key factor towards controlling critical current values. Large-scale simulations of vortex dynamics can provide a rational approach to achieve this goal. Here, we use the time-dependent Ginzburg-Landau equations to study thin superconducting films with artificially created pinning centers arranged periodically in hexagonal lattices. We calculate the critical current density for various geometries of the pinning centers—varying their size, strength, and density. Furthermore, we shed light upon the influence of pattern distortion on the magnetic-field-dependent critical current. We compare our result directly with available experimental measurements on patterned molybdenum-germanium films, obtaining good agreement. In conclusion, our results give important systematic insights into the mechanisms of pinning in these artificial pinning landscapes and open a path for tailoring superconducting films with desired critical current behavior.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Comparison of wind farm control strategies under realistic offshore wind conditions: turbine quantities of interest

Abstract. Wind farm flow control is a strategy to increase the efficiency and therefore lower the levelized cost of energy of a wind farm. This is done using turbine settings such as the yaw angle, blade pitch angles, or generator torque to manipulate the flow behind the turbine, affecting downstream turbines in the farm. Two inherently different wind farm flow control methods have been identified in the literature: wake steering and wake mixing. This paper focuses on comparing the turbine quantities of interest between these methods for a simple two-turbine wind farm setup, while a companion article (Brown et al., 2025) focuses on the wake quantities of interest for a single wind turbine setup. Both papers use the same set of wind farm simulations based on high-fidelity large-eddy simulations (LESs) coupled with OpenFAST turbine models. First, precursor simulations are executed in order to match wind conditions measured with lidars in an offshore wind farm off the east coast of the USA. These measurements show general wind conditions that exhibit substantially higher vertical wind shear and veer than any of the LES studies performed with wind farm flow control strategies currently available in the literature. The precursors are used to evaluate the effectiveness of the control methods. In the LES, the wind veer leads to highly skewed wakes, which have considerable influence on the power uplift of wind farm flow control strategies. In addition to a baseline controller, four different control strategies, each of which uses either pitch or yaw control, are performed on the upstream turbine of a simple two-turbine wind farm. Assuming that the wind direction is known and constant over time, the simulations show that wake steering is generally the superior wind farm flow control strategy, considering both wind farm power production and turbine damage equivalent loads when substantial wind veer is present. This result is consistent over different wind speeds and wind directions. On the other hand, for similar wind conditions with lower veer, wake mixing was found to yield the highest power production, although at the expense of generally higher loads. This leads us to conclude that the effect of wind veer, which has so far not usually been considered, can not be neglected when determining the optimal wind farm flow control strategy.

17 WIND ENERGY↗

Equivalent-Circuit Models for Grid-Forming Inverters under Unbalanced Steady-State Operating Conditions: Preprint

Positive- and negative-sequence equivalent-circuit models are put forth to capture the operation of grid-forming (GFM) inverters in unbalanced steady-state operating conditions acknowledging the impact of current limiting. The particular control architecture examined adopts droop control (for primary control), nested inner-current and outer-voltage control (in the stationary reference frame), and it is adaptable to two different types of current limiting (current-reference saturation and virtual-impedance limiting). We anticipate the proposed models to be of interest in modeling, analysis, and simulation of GFM inverters in unbalanced settings that may arise, e.g., in the face of faults. Validation of the equivalent-circuit models is pursued via comparison with full-order electromagnetic-transient (EMT) simulations for representative balanced and unbalanced faults.

equivalent-circuit models↗

Enhanced Confinement Scenarios Without Large Edge Localized Modes in Tokamaks: Control, Performance, and Extrapolability Issues for ITER

Large edge localized modes (ELMs) typically accompany good H-mode confinement in fusion devices, but can present problems for plasma facing components because of high transient heat loads. Here the range of techniques for ELM control deployed in fusion devices is reviewed. The two baseline strategies in the ITER baseline design are emphasized: rapid ELM triggering and peak heat flux control via pellet injection, and the use of magnetic perturbations to suppress or mitigate ELMs. While both of these techniques are moderately well developed, with reasonable physical bases for projecting to ITER, differing observations between multiple devices are also discussed to highlight the needed community R & D. In addition, recent progress in ELM-free regimes, namely Quiescent H-mode, I-mode, and Enhanced Pedestal H-mode is reviewed, and open questions for extrapolability are discussed. Finally progress and outstanding issues in alternate ELM control techniques are reviewed: supersonic molecular beam injection, edge electron cyclotron heating, lower hybrid heating and/or current drive, controlled periodic jogs of the vertical centroid position, ELM pace-making via periodic magnetic perturbations, ELM elimination with lithium wall conditioning, and naturally occurring small ELM regimes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Positive-Sequence Phasor Modeling of Droop-Controlled, Grid-Forming Inverters with Fault Current Limiting Function

Traditional positive-sequence phasor models of droop-controlled, grid-forming inverters do not have the fault current limiting function. During a short-circuit fault the model generates unrealistic high fault current making the simulation results less practical. This paper develops a fault current limiting function for the positive-sequence phasor model of droop-controlled, grid-forming inverters, which can effectively limit the inverter output current at the predefined maximum during faults. A user-written model has been developed for the commercially-available software Siemens/PTI PSS/E. Fault studies on a modified IEEE 39-bus system with all grid-forming inverters verify the effectiveness of the developed fault current limiting function. The proposed model can be used to evaluate how the limited fault currents of droop-controlled, grid-forming inverters impact the bulk power system transient stability under fault conditions.

Du, Wei↗

Global patterns and controls of soil organic carbon dynamics as simulated by multiple terrestrial biosphere models. Current status and future directions

Soil is the largest organic carbon (C) pool of terrestrial ecosystems, and loss from soil accounts for a large pro portion of land-atmosphere C exchange. Due to large pool size and variable residence time from years to millennia, even small changes in soil organic C(SOC) have substantial effects on the terrestrial C budget, thereby affecting atmospheric carbon dioxide (CO2)concentration and climate change. In the past decades, a wide variety of studies have been conducted to quantify global SOC stocks and soil exchange with the atmosphere through site measurements, inventories, and empirical/process-based modeling. However, these estimates are highly uncertain and identifying major driving forces controlling soil C storage and fluxes remains a key research challenge his study has compiled century-long (1901-2010)estimates of SOC storage and heterotrophic respiration (Rh) from ten terrestrial biosphere models (TBMs) in the Multi-scale Synthesis and Terrestrial Model Intercomparison Project (MsTMIP) and two observation based datasets. The ten-TBM ensemble shows that global SOC estimate range from 4 to 2111 Pg C (1 Pg = 10 15 g) with a median value of 1158 Pg C33 in 2010. Modeling approach estimates a broad range of Rh from 35 to 69 Pg C yr -1 with a median value of 51Pg C yr -1 during 200–2010. The largest uncertainty in SOC stocks exists in the 40–65°N latitude band while Rh differences are the largest in the tropics. All the models agreed that climate and land use changes have decreased SOC stocks while elevated CO 2 and atmospheric nitrogen deposition have increased SOC stocks though the response varied significantly among models. Model representations of temperature and moisture sensitivity,nutrient limitation and land use partially explain the divergent estimates of global SOC stocks and soil fluxes in this study. In addition, major sources of uncertainty from model estimation include exclusion of SOC storage in wetlands and peatlands as well as C storage in deep soil layers.

54 ENVIRONMENTAL SCIENCES↗

Deciphering Reaction Mechanisms of Molecular Proton Reduction Catalysts with Cyclic Voltammetry: Kinetic vs Thermodynamic Control

The kinetics and thermodynamics of elementary reaction steps involved in the catalytic reduction of protons to hydrogen define the reaction landscape for catalysis. The mechanisms can differ in the order of the elementary proton transfer, electron transfer, and bond-forming steps and can be further differentiated by the sites at which protons and electrons localize. Access to fully elucidated mechanistic, kinetic, and thermochemical details of molecular catalysts is crucial to facilitate the development of new catalysts that operate with optimal efficiency, selectivity, and durability. The mechanism by which a catalyst operates, as well as the kinetics and thermodynamics associated with the individual steps, can often be accessed through electroanalytical studies. Here, this Account details the application of cyclic voltammetry to interrogate reaction mechanisms and quantify the kinetics and thermodynamics of elementary reaction steps for a series of molecular catalysts that mediate electrochemical proton reduction. I distinguish the limiting scenarios wherein a catalyst operates under kinetic control vs thermodynamic control, with a focus on detecting how cyclic voltammetry features shift with proton source strength and concentration, as well as scan rate. For systems that operate under kinetic control, catalytic currents are observed at, or slightly positive toward, the formal potential for the redox process that triggers catalysis. Under thermodynamic control, catalytic responses shift as a function of the proton source pKa and effective pH of the solution. After drawing this distinction, we introduce the appropriate voltammetry experiments and accompanying analytical expressions for extracting key metrics from the data. To illustrate analytical strategies to quantify elementary reaction steps of catalysts operating under kinetic control, I describe our studies of proton reduction catalysts Co(dmgBF 2 ) 2 (CH 3 CN) 2 (dmgBF 2 = difluoroboryl-dimethylglyoxime) and [Ni(P 2 Ph N 2 Ph ) 2 ] 2+ (P 2 Ph N 2 Ph = 1,5-phenyl-3,7-phenyl-1,5-diaza-3,7-diphosphacyclooctane). Here, peak shift analysis, foot-of-the-wave analysis, and plateau current analysis are applied to data sets wherein voltammetric response are recorded as a function of catalyst concentration, proton source concentration, proton source strength, and scan rate to quantify rate constants for elementary proton transfer and bond-forming steps in a catalytic cycle. Further, the case study of [Ni(P 2 Ph N 2 Ph ) 2 ] 2+ illustrates how complementary spectroscopic methods can bolster the mechanistic assignment. Collectively, these two studies showcase how detailed mechanistic studies inform on rate-limiting elementary steps in catalysis and other key processes underpinning catalysis. Second, I present analytical strategies to interrogate catalysts operating under thermodynamic control, centered on the case study of [Ni II (P 2 Ph N 2 Bn ) 2 ] 2+ (P 2 Ph N 2 Bn = 1,5-dibenzyl-3,7-diphenyl-1,5-diaza-3,7-diphosphacyclooctane). Here, the application of nonaqueous Pourbaix theory to extract thermodynamic information is introduced, and the construction of a coupled Pourbaix diagram is detailed. This study identifies ligand-based protonation as the key process that places catalysis under thermodynamic control and influences the reaction mechanism. Together, the work detailed in this Account showcases the utility of electroanalytical methods to disentangle complex reaction mechanisms and extract key thermochemical and kinetic parameters for elementary steps of catalysis. Through detailed presentation of the key analytical expressions that underpin these analyses, this Account seeks to facilitate the adoption of cyclic voltammetry by the community to fully extract kinetic, thermochemical, and mechanistic information on electrochemical small-molecule activation.

catalysts↗

Polarization-dependent photocurrents in polar stacks of van der Waals solids

Monolayers of semiconducting van der Waals solids, such as transition metal dichalcogenides, acquire significant electric polarization normal to the layers when placed on a substrate or in a heterogeneous stack. This causes a linear coupling of electrons to electric fields normal to the layers. Irradiation at oblique incidence at frequencies above the gap causes interband transitions due to coupling to both normal and in-plane ac electric fields. The interference between the two processes leads to sizable in-plane photocurrents and valley currents. The direction and magnitude of the currents are controlled by light polarization and are determined by their helical or nonhelical components. The helicity-dependent ballistic current arises due to asymmetric photogeneration. The nonhelical current has a ballistic contribution (dominant in sufficiently clean samples) caused by asymmetric scattering of photoexcited carriers, and a side-jump contribution. Here, a magneto-induced photocurrent is due to the Lorentz force or due to an intrinsic magnetic moment related to Berry curvature.

Lyanda-Geller, Y. B.↗

Chalcogenide phase-change material advances programmable terahertz metamaterials: a non-volatile perspective for reconfigurable intelligent surfaces

Terahertz (THz) waves have gained considerable attention in the rising 6G communication due to their large bandwidth. However, the cost and power consumption become the major constraints for the commercialization of 6G THz systems as the frequency increases. Reconfigurable intelligent surface (RIS) comprising active metasurfaces and digital controllers has been proposed for beamforming in the 6G multiple-input-multiple-output systems, showing good potential to suppress the system size, weight, and power consumption (SWaP). Currently, their controlling diodes can hardly work up to THz frequencies. Therefore, several active stimuli have been investigated as alternatives. Among them, chalcogenide phase-change material Ge 2 Sb 2 Te 5 (GST) addresses large modulation depth, picosecond switching speed, and non-volatile properties. Notably, the non-volatile GST may enable RIS systems with memory and low control power. This work briefly reviews the advances of GST-tuned THz metamaterials (MTMs), discusses the current obstacles to overcome, and gives a perspective of GST applications in the rising 6G communications.

6G↗

Application Characterization at Scale: Lessons learned from developing a distributed Open Community Runtime system for High Performance Computing

Since 2012, the U.S. Department of Energy’s X-Stack program has been developing solutions including runtime systems, programming models, languages, compilers, and tools for the Exascale system software to address crucial performance and power requirements. Fine grain programming models and runtime systems show a great potential to efficiently utilize the underlying hardware. Thus, they are essential to many X-Stack efforts. An abundant amount of small tasks can better utilize the vast parallelism available on current and future machines. Moreover, finer tasks can recover faster and adapt better, due to a decrease in state and control. Nevertheless, current applications have been written to exploit old paradigms (such as Communicating Sequential Processor and Bulk Synchronous Parallel processing). To fully utilize the advantages of these new systems, applications need to be adapted to these new paradigms. As part of the applications’ porting process, in-depth characterization studies, focused on both application characteristics and runtime features, need to take place to fully understand the application performance bottlenecks and how to resolve them. This paper presents a characterization study for a novel high performance runtime system, called the Open Community Runtime, using key HPC kernels as its vehicle. This study has the following contributions: one of the first high performance, fine grain, distributed memory runtime system implementing the OCR standard (version 0.99a); and a characterization study of key HPC kernels in terms of runtime primitives running on both intra and inter node environments. Running on a general purpose cluster, we have found up to 1635x relative speed-up for a parallel tiled Cholesky Kernels on 128 nodes with 16 cores each and a 1864x relative speed-up for a parallel tiled Smith-Waterman kernel on 128 nodes with 30 cores.

Application characterization↗

A Reinforcement Learning Approach to Augment Conventional PID Control in Nuclear Power Plant Transient Operation

The ability of nuclear reactors to operate their power conversion cycles more flexibly will enhance their value to energy grids with variable pricing. Current nuclear control systems are typically classical controllers that are often based on proportional-integral-derivative (PID) control. This paper presents a method of augmenting the existing PID control for difficult transient operations in nuclear power plants using a reinforcement learning–derived feedforward signal applied in real time. The agents, which are trained on a test thermal load-following problem, are designed to improve steam generator outlet temperature control for a range of fast load-following scenarios covering ramp rates from 9%/min to 15%/min. Several reinforcement learning algorithms were initially investigated for the training of the feedforward agents with deep Q-learning (DQN) and proximal policy optimization (PPO) networks, which were found to be the most promising. The DQN controllers utilize discrete actions, giving them a better disturbance rejection at steady state but inconsistent response to initial temperature deviations. In contrast, PPO-trained agents, which take continuous actions except for a dead zone around zero, were shown to have the best combination of high disturbance rejection at steady state and good tracking of the desired temperature value. The ability of the PPO agent was also examined, with the average time of decision making found to be on the order of 1 ms. The fault properties of the controller under the loss of the reinforcement learning agent feedforward signal were also examined. The controller showed strong performance in situations of “no-signal” faults. but was less good at handling “stuck-at” faults, where the feedforward signal remains at a set value. In both cases, however, the PID was able to successfully maintain stability, eventually returning the system to a steady state. It is hoped that this work will allow for the proposed control architecture to be examined for more difficult control problems such that it may eventually be used to adapt existing nuclear plants for more aggressive load-following on grids of the future.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Structure and Electronic Properties of InSb Nanowires Grown in Flexible Polycarbonate Membranes

A dense array of vertically aligned indium antimonide (InSb) nanowires with high aspect ratio (diameter 150 nm, length 20 μ m) were grown in the pores of a track-etched polycarbonate membrane via a one-step electrochemical method. There are several reports on InSb nanowire growth in the pores of a mechanically rigid, nano-channel alumina template (NCA), where nanowire growth occurs in the pores of the NCA. This work on InSb nanowire growth in pores of track-etched polycarbonate (PC) membrane sheds light on the various factors that affect nucleation and nanowire growth. The average length and diameter of the as-grown nanowires was about 10 μ m and 150 nm, respectively. Two possible mechanisms accounting for two different morphologies of the as-grown nanowires are proposed. The polycrystallinity observed in some of the nanowires is explained using the 3D ‘nucleation-coalescence’ mechanism. On the other hand, single crystal nanowires with a high density of twin defects and stacking faults grow epitaxially by a two-dimensional (2D) nucleation/growth mechanism. To assess the electrical quality of the nanowires, two- and four-terminal devices were fabricated using a single InSb nanowire contacted by two Ni electrodes. It was found that, at low bias, the ohmic current is controlled by charge diffusion from the bulk contacts. On the other hand, at high bias, the effects of space charge limited current (SCLC) are evident in the current–voltage behavior, characteristic of transport through structures with reduced electrostatic screening. A cross-over from ohmic to SCLC occurs at about 0.14 V, yielding a free carrier concentration of the order of 10 14 cm -3 .

36 MATERIALS SCIENCE↗

Purification and expression of a novel bacteriocin, JUQZ-1, against Pseudomonas syringae pv. Actinidiae (PSA), secreted by Brevibacillus laterosporus Wq-1, isolated from the rhizosphere soil of healthy kiwifruit

Kiwifruit canker, caused by Pseudomonas syringae pv. actinidiae (PSA), has led to significant losses in the kiwifruit industry each year. Due to the drug resistance feature of PSA, biological control is currently the most promising method. Developing biocontrol bacteria against PSA could help solve the issue of drug resistance generated during the chemical control of PSA to a certain extent. In this research, a Wq-1 strain that demonstrated excellent inhibitory activity against PSA was isolated from the rhizosphere soil of healthy kiwifruit. Based on the morphological characteristics and phylogenetic analysis of the 16S rRNA gene sequence, the isolated strain was identified as Brevibacillus laterosporus Wq-1. Bacteriostatic proteins were isolated from the cell-free culture filtrate of strain Wq-1 and were found to have a molecular weight of approximately 12 kDa, as determined by sodium dodecyl sulfate-polyacrylamide gel electrophoresis (SDS-PAGE). Liquid chromatography–tandem mass spectrometry (LC–MS/MS) detection revealed that there were several peptides in the target band that were consistent with protein 01021 in the genome. The gene of the 01021 protein was cloned into the plasmid pPICZa, and the recombinant bacteriocin was successfully expressed using the Pichia pastoris X33 expression system. The recombinant protein 01021 effectively inhibited the growth of PSA. This is the first report of the protein’s antimicrobial activity, distinguishing it from previously identified bacteriocins. Therefore, we named this bacteriocin JUQZ-1. In addition, our results showed that the protein JUQZ-1 not only exhibited a broad bacteriostatic spectrum but also high thermal and pH stability suitable for harsh environmental conditions., JUQZ-1, a protein with antimicrobial properties and strong environmental tolerance, may serve as a promising alternative to antibiotics.

Shuai, Yang↗

Beyond PID Controllers: PPO with Neuralized PID Policy for Proton Beam Intensity Control in Mu2e

We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an automated controller capable of providing real-time feedback and calibration of the Spill Regulation System (SRS) parameters on a millisecond timescale. We treat the Mu2e accelerator system as a Markov Decision Process suitable for Reinforcement Learning (RL), utilizing PPO to reduce bias and enhance training stability. A key innovation in our approach is the integration of a neuralized Proportional-Integral-Derivative (PID) controller into the policy function, resulting in a significant improvement in the Spill Duty Factor (SDF) by 13.6%, surpassing the performance of the current PID controller baseline by an additional 1.6%. This paper presents the preliminary offline results based on a differentiable simulator of the Mu2e accelerator. It paves the groundwork for real-time implementations and applications, representing a crucial step towards automated proton beam intensity control for the Mu2e experiment.

43 PARTICLE ACCELERATORS↗