Search NASA⌕ Search

SEARCH · Search NASA

Results for “PI control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Genesis Solar Wind Sample Curation Documentation

Introduction: A scientist with experience as a sample science analyst, provider of flight hardware for multiple missions, and senior engineer in an ISO 2000-rated manufacturing plant has described the timeline of key participants in any PI-led sample return mission, the breadth of the organizations involved [1,2], and, of interest to this meeting, choosing the types of data to preserve and issues of future data accessibility. This work broadens that perspective by giving similar lessons from Genesis sample curation point-of-view. Curation participation regarding data gathering was part of the mission review process from the beginning. Genesis’ story illustrates outcome of several choices about types of data to record and preserve. Precision analysis of solar wind atoms captured in pure, ultraclean substrates is the driving science goal; therefore, detailed documentation was captured from all mission and curation phases and from investigator laboratories because these processes affect the final analytical results [3]. Pre-flight: Design and fabrication of the spacecraft. Like many modern small sample return missions, Genesis was a tightly managed team integrated across science, engineering and curation. Communication across the team was excellent, and, for the most part, the hands-on engineering technicians understood the impacts of “small choices” they routinely make, and the eyes-on oversight of manufacturing processes by scientists was mindful of details. The payload was designed by the Jet Propulsion Laboratory and the spacecraft by Lockheed Martin. Solar wind collectors and instruments were fabricated by multiple vendors and laboratories. The main portion of the payload was assembled at JSC. Fabrication procedures and contamination-control data (with witness coupons) were stored primarily at JSC. The original composition, dimensions and configuration of components, results of thermal testing, etc. are still needed for interpretation of analytical data. At times, these must be estimated from secondary information acquired pre-flight. Moreover, some files (e.g., original 3-D models and early Powerpoint) cannot be opened using software. Archived curation data includes 2-D drawings, material usage lists, QA documentation and analyses of consumables used during fabrication. Important chemical information still resides in archived hardware, paints and lubricants, material coupons, cleaning coupons, environmental witness plates and reference materials from manufacturing facilities. Purity and cleanliness of collector substrates. Semi-conductor vendors provided surface cleanliness data and some purity data. Purity for specific elements of interest was verified by science team members in their laboratories [4]. Curation archived procurement and shipping records, analysis reports, and non-proprietary fabrication data. A physical archive of flight collector reference materials is maintained for future use so additional data can be collected as analytical techniques improve. These are of increased value due to the hard landing upon re-entry. Cleaning and cleanliness assessments of flight hardware. Cleaning of the science canister payload was performed at JSC in a dedicated ISO 4 cleanroom using ultrapure water (UPW). The cleanliness of this UPW was monitored throughout processing. The archive for the clean lab also includes airborne particle counts, airborne molecular and inorganic contamination measurements as well as cleanroom construction material coupons and witness coupons. Hardware cleanliness was assessed by particle counts in rinse water batches. This information is recorded in batch cleaning forms and logbooks, and are, perhaps, of decreased value due to the hard landing. Post-flight: Curation-generated data. The curation handling history of each Genesis sample is documented in a typical astromaterials sample database which captures sample location, physical description and characterization data. Samples have a “shelf life”. Crucial to the preservation of samples is ongoing documentation of the sample environment, initially under curatorial control but is now a separate facility function with requires coordination. PI-generated data. Data on sample characterization and cleaning techniques continues to be generated by sample users [5]. These are often captured in LPSC abstracts, but these “engineering” results often are not publishable as stand-alone papers. We are actively looking for ways to make this information more accessible to users. Ion implants into samples have aided science return and can be shared among investigators. These (and similar) materials should be added to the curatorial collection with appropriate process and characterization data generated externally. Summary: Complete data archives for returned astromaterial samples must be broad in types and formats, and inclusive of environmental monitoring.

Genesis↗

Feedforward-feedback ammonia control at a water resource recovery facility based on a digital twin with hybrid model

Ammonia-based aeration control (ABAC) at full-scale Water Resource Recovery Facilities (WRRFs) can be challenged by diurnal loading and transport delays. This work addressed these challenges using a hybrid feedforward–feedback controller built on Activated Sludge Model 1 (ASM1), marking the first full-scale deployment to pair a mechanistic feedforward core with data-driven corrections. The objectives were to improve ammonia setpoint tracking, assess performance of the mechanistic model when enhanced with data-driven corrections, and document full-scale operation. The hybrid model incorporates two data-driven components: (1) a Mechanistic Error Forecasting Engine (MEFE), consisting of a multivariate linear regressor and a long short-term memory (LSTM) ensemble. Defying expectations, low-parameter models outperformed more complex alternatives, reducing the mechanistic error by 71%. (2) A Residual Oscillation Forecasting Engine (ROFE), based on Fast Fourier Transform, reduced the remaining error by another 35%. Two proportional–integral (PI) feedback loops further (i) trim the feedforward output and (ii) eliminate residual controller error in the final aerobic zone. In full-scale operation, the controller reduced mean-squared error (MSE) by 94% over the baseline and produced more stable dissolved oxygen (DO) setpoints. Overall, it was proven that layering multi-timescale data-driven models on a mechanistic core can yield reliable ABAC performance at WRRFs.

54 ENVIRONMENTAL SCIENCES↗

Studying Microbial Adaptation in the Laboratory: Sensor & Control Upgrades for an Experimental Evolution Biofluidics System

Experimental evolution (EE) involves iteratively exposing a microbial community to specific stressors to study its response to changes in environment over time. EE work is commonly done manually in the laboratory, but, when there are many environmental variables to measure and adjust, it is highly labor intensive, prone to human error, and challenging to scale. Single-purpose automated continuous culturing chambers exist, but implement only limited stressor types. A more general-purpose design is desirable. The BeING Lab at Ames Research Center created the prototype Automated Adaptive Directed Evolution Chamber (AADEC) to address these problems, beginning with Escherichia coli tolerance of short-wave ultraviolet (UV-C) radiation and of temperature. In newer versions, AADEC monitors microbial activity and can adjust the UV-C and temperature levels automatically. An optical density measurement is used to determine how many cells are present in the growth medium—over time, this corresponds to how many survive and reproduce. Oxidation-reduction potential provides information on consumed metabolic energy, and pH and electrical conductivity on metabolic products. Dissolved oxygen content is used to determine aerobic vs anaerobic growth. A Raspberry Pi computer processes all this data to set the UV-C stressor level. AADEC’s auxiliary systems include peristaltic pumps to change media and agitation to counteract cell settling. These actuators can also act as additional stressors. With the Raspberry Pi monitoring sensors and adjusting actuators in real time, AADEC takes measurements and controls the environment much more accurately than can be done with a manual EE implementation. The third and latest AADEC iteration is the first to simplify design and usage with circuits on PCBs and the ability to pre-program experimental protocols. Still planned is expansion to a multi-well design for the study of varying cell cultures in parallel, which will enable researchers to retain and re-inoculate cultures exhibiting the desired trait most strongly while flushing out others. AADEC’s special capabilities make it a valuable tool for studying life under multiple stressors, enabling scientists to replicate changes in climate on microbes for study in a lab setting.

Microbial Adaptation↗

Internalisation and multiple phosphorylation of γ-Conglutin, the lupin seed glycaemia-lowering protein, in HepG2 cells

Highlights: •A glycaemia-reducing lupin seed protein is internalized by HepG2 cells. •The protein accumulates in the cytosol in an intact form. •The internalized protein is multiply phosphorylated. -- Abstract: Lupin seed γ-Conglutin is a protein capable of reducing glycaemia in mammalians and increasing glucose uptake by model cells. This work investigated whether γ-Conglutin is internalised into the target cells and undergoes any covalent change during the process, as a first step to understanding its mechanism of action. To this purpose, γ-Conglutin-treated and untreated HepG2 cells were submitted to confocal and transmission electron microscopy. Immune-revelation of γ-Conglutin at various intervals revealed its accumulation inside the cytosol. In parallel, 2D-electrophoresis of the cell lysates and antibody reaction of the blotted maps showed the presence of the protein intact subunits inside the treated cells, whilest no trace of the protein was found in the control cells. However, γ-Conglutin-related spots with an unexpectedly low pI were also observed in the maps. These spots were excised, trypsin-treated and submitted to MS/MS spectrometric analysis. The presence of phosphorylated amino acids was detected. These findings, by showing that γ-Conglutin is internalised by HepG2 cells in an intact form and is modified by multiple phosphorylation, open the way to the understanding of the lupin γ-Conglutin insulin-mimetic activity.

60 APPLIED LIFE SCIENCES↗

Designing a Convection‐Cloud Chamber for Collision‐Coalescence Using Large‐Eddy Simulation With Bin Microphysics

Abstract Collisional growth of cloud droplets is an essential yet uncertain process for drizzle and precipitation formation. To improve the quantitative understanding of this key component of cloud‐aerosol‐turbulence interactions, observational studies of collision‐coalescence in a controlled laboratory environment are needed. In an existing convection‐cloud chamber (the Pi Chamber), collisional growth is limited by low liquid water content and short droplet residence times. In this work, we use numerical simulations to explore various configurations of a convection‐cloud chamber that may intensify collision‐coalescence. We employ a large‐eddy simulation (LES) model with a size‐resolved (bin) cloud microphysics scheme to explore how cloud properties and the intensity of collision‐coalescence are affected by the chamber size and aspect ratio, surface roughness, side‐wall wetness, side‐wall temperature arrangement, and aerosol injection rate. Simulations without condensation and evaporation within the domain are first performed to explore the turbulence dynamics and wall fluxes. The LES wall fluxes are used to modify the Scalar Flux‐budget Model, which is then applied to demonstrate the need for non‐uniform side‐wall temperature (two side walls as warm as the bottom and the two others as cold as the top) to maintain high supersaturation in a tall chamber. The results of LES with full cloud microphysics reveal that collision‐coalescence is greatly enhanced by employing a taller chamber with saturated side walls, non‐uniform side‐wall temperature, and rough surfaces. For the conditions explored, although lowering the aerosol injection rate broadens the droplet size distribution, favoring collision‐coalescence, the reduced droplet number concentration decreases the frequency of collisions.

54 ENVIRONMENTAL SCIENCES↗

Nanoscale Ferroelectric Control of Novel Electronic States in Layered Two-Dimensional Materials (Final Report)

In this DOE Early Career project “Nanoscale Ferroelectric Control of Novel Electronic States in Layered Two-Dimensional Materials,” the PI’s group has combined ferroelectric field effect with nanoscale domain imaging and writing to design the electronic and optical properties of two-dimensional (2D) van der Waals materials, including graphene and transition metal dichalcogenides MoS2 and ReS2. The van der Waals materials have been prepared into field effect transistor (FET) devices with ferroelectric gates. Through domain patterning in a ferroelectric polymer PVDF-TrEF top-gate via conductive atomic force microscopy, the team has created programmable Schottky junctions in monolayer MoS 2 , where both barrier height and I-V rectifying polarity can be reconfigured. The transport anisotropy of monolayer to few-layer ReS 2 has been mapped out by defining the entire channel into an insulating state and creating nanoscale conducting paths along different directions through domain writing in the ferroelectric top-gate. The result shows that the conductivity along and perpendicular to the Re-chain can differ by >5.5x10 4 . Theoretical modeling points to the band origin of the transport anomaly and reveals the emergence of a flat band in few-layer ReS 2 . The interfacial epitaxial relation between ReS 2 and PVDF-TrFE further promotes the formation of close-packed, highly ordered PVDF-TrFE nanowires with width of 35 nm and 10 nm. Nonvolatile modulation of quantum Hall effect has been achieved in graphene FETs with a ferroelectric oxide Ba 0.4 Sr 0.6 TiO 3 back-gate. Scattering from the remote surface optical phonon in Ba 0.4 Sr 0.6 TiO 3 limits the room temperature mobility of graphene to be about 3x10 4 cm 2 /Vs. Steep-slope switching has been achieved in MoS 2 FETs back-gated by polycrystalline Pb(Zr,Ti)O 3 , which signals a static-state negative capacitance mode without involving an additional dielectric layer. Piezoresponse force microscopy studies show that the sub-threshold swing can be well correlated with the domain wall density in Pb(Zr,Ti)O 3 . The team also observes an unconventional filtering effect of the second harmonic generation response at the MoS 2 /Pb(Zr,Ti)O 3 heterointerface, which can be accounted for by the alignment between one of the polar axes of MoS 2 and the chiral dipole rotation at the surface of domain wall in Pb(Zr,Ti)O 3 . The research supported by this DOE grant has significantly advanced the fundamental understanding and functional design of ferroelectric/2D van der Waals heterostructures for their implementation towards energy applications.

36 MATERIALS SCIENCE↗

A Prototype {sup 212}Pb Medical Dose Calibrator for Alpha Radioimmunotherapy

AREVA Med, an AREVA group subsidiary, is developing innovative cancer-fighting therapies involving the use of {sup 212}Pb for alpha radioimmunotherapy. Canberra Industries, the nuclear measurement subsidiary of AREVA, has been working with AREVA Med to develop a prototype measurement system to assay syringes containing a {sup 212}Pb solution following production by an elution system. The relative fraction of emitted radiation from the source associated directly with the {sup 212}Pb remains dynamic for approximately 6 hours after the parent is chemically purified. A significant challenge for this measurement application is that the short half-life of the parent nuclide requires assay prior to reaching equilibrium with progeny nuclides. A gross counting detector was developed to minimize system costs and meet the large dynamic range of source activities. Prior to equilibrium, a gross counting system must include the period since the {sup 212}Pb was pure to calculate the count rate attributable to the parent rather than the progeny. The dynamic state is determined by solving the set of differential equations, or Bateman equations, describing the source decay behavior while also applying the component measurement efficiencies for each nuclide. The efficiencies were initially estimated using mathematical modeling (MCNP) but were then benchmarked with source measurements. The goal accuracy of the system was required to be within 5%. Independent measurements of the source using a high resolution spectroscopic detector have shown good agreement with the prototype system results. The prototype design was driven by cost, compactness and simplicity. The detector development costs were minimized by using existing electronics and firmware with a Geiger-Mueller tube derived from Canberra's EcoGamma environmental monitoring product. The acquisition electronics, communications and interface were controlled using Python with the EcoGamma software development kit on a Raspberry Pi Linux computer mounted inside a standard project box. The results of initial calibration measurements are presented. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Spin-wave storage using chirped control fields in atomic frequency comb-based quantum memory

It has been shown that an inhomogeneously broadened optical transition shaped into an atomic frequency comb can store a large number of temporal modes of the electromagnetic field at the single-photon level without the need to increase the optical depth of the storage material. The readout of light modes is made efficient thanks to the rephasing of the optical-wavelength coherence similar to photon-echo-type techniques, and the reemission time is given by the comb structure. For on-demand readout and long storage times, two control fields are used to transfer the optical coherence back and forth into a spin wave. Here, we present a detailed analysis of the spin-wave storage based on chirped adiabatic control fields. In particular, we verify that chirped fields require significantly weaker intensities than {pi} pulses. The price to pay is a reduction of the multimode storage capacity that we quantify for realistic material parameters associated with solids doped with rare-earth-metal ions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

National Spherical Torus Experiment Upgrade Collaborative Research on Configuration Optimization of Advanced Operating Scenarios and Control Including Macroscopy Stability EOG for Period 3/1/14 through 2/28/18

General Atomics has collaborated with PPPL since 1999 in support of NSTX and NSXT-U by leveraging DIII-D program expertise. John Ferron was the principal investigator (PI) for the first nine years (to 2008) and Rob La Haye since then. The research effort evolved over a number of three-year grants and originally included both the core (control, stability, resonant error fields) and the boundary (ELMs, divertor, error fields). In 2014 the current and last grant extension was stretched to four years and split into a core grant (advanced scenarios and control, macroscopic plasma stability and extending 3D magnetics diagnostics) and a boundary grant. Todd Evans is the PI for the new boundary grant which while also for four years expires later than the core grant; a separate end of grant (EOG) report for that is due in July 2018.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Combining dynamical decoupling with optimal control for improved QIP.

Constructing high-fidelity control pulses that are robust to control and system/environment fluctuations is a crucial objective for quantum information processing (QIP). We combine dynamical decoupling (DD) with optimal control (OC) to identify control pulses that achieve this objective numerically. Previous DD work has shown that general errors up to (but not including) third order can be removed from {pi}- and {pi}/2-pulses without concatenation. By systematically integrating DD and OC, we are able to increase pulse fidelity beyond this limit. Our hybrid method of quantum control incorporates a newly-developed algorithm for robust OC, providing a nested DD-OC approach to generate robust controls. Motivated by solid-state QIP, we also incorporate relevant experimental constraints into this DD-OC formalism. To demonstrate the advantage of our approach, the resulting quantum controls are compared to previous DD results in open and uncertain model systems.

99 GENERAL AND MISCELLANEOUS↗

Model-free adaptive control for MHTGR-based nuclear steam supply systems - 144

Modular high temperature gas-cooled reactor (MHTGR) uses helium as coolant and graphite as both moderator and structural materials. Due to its inherent safety feature, MHTGR has been regarded as an important candidate for next generation of nuclear plants. By coupling with the once-through steam generator (OTSG), MHTGR can be utilized to form the nuclear steam supply system (NSSS) for producing superheated steam, which can be adopted for nuclear plants with high efficiency. Power-level control of is important for the stable and efficient operation of the MHTGR-based NSSS, and it is necessary to develop the power-level control law that is robust to physical and thermal parameters and can guarantee the closed-loop stability in normal and even abnormal conditions. In this paper, a model-free adaptive power-level control law is developed for the MHTGR-based NSSS, which is free from physical and thermal-hydraulic parameters, takes the simple forms of proportional-integral (PI) or proportional-differential (PD) feedback law, and can provide globally asymptotic closed-loop stability. Then, it is applied to the NSSS control of the two modular high temperature gas-cooled nuclear plant HTR-PM. Numerical simulation results in normal power maneuver and some typical abnormal cases show that this new control law can provide satisfactory closed-loop stability as well as transient performance. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Miniaturized Magnetoelastic Sensor System

This article describes the design, assembly, and implementation of a hand-held, magnetic-field-based sensor system that can be adapted for a variety of sensing applications. The miniaturized system is based on Chemical Identification by Magneto-Elastic Sensing (ChIMES) technology, which uses three concentric solenoid coils to wirelessly interrogate a sensor body comprised of a response material coupled to a magnetoelastic wire. The response material expands when it encounters a target, imposing mechanical stress on the wire and altering its magnetic permeability. The sensor bodies are passive, requiring no external power source, and they are small, measuring about 15 mm in length and 3.0 mm in diameter. Up to four sensor bodies can be configured as an evenly-spaced linear array. The sensor system operates by applying a low-frequency, current-stabilized, filtered triangle wave to a uniform-density excitation coil to switch the magnetic domains within the wire. Further, the responses from the sensors are picked up by a detection coil as stress-induced changes in the Faraday voltage, and the strong magnetic field induced by the excitation coil in the detection coil is nullified by a cancellation coil reverse-wound in series with the detection coil. The responses of the sensors in an array are separated in time by a linear gradient dc biasing coil. The sensors can be interrogated through metallic and nonmetallic barriers. The signals from the detection coil and the excitation coil are digitized by a pair of bipolar analog-to-digital converters (ADCs). A Raspberry Pi single-board computer (SBC) and associated software perform data acquisition and control all aspects of the sensor system hardware. The program allows the user to select the number of sensors in the array, the type of signal that is being collected, and the number of samples to take. The program also allows for signal processing of the sensor data, such as baseline correction. The program can differentiate sensor peaks from each other and calculate the magnitude of each sensor response with less than 1% error. The data are then displayed along with a graph of the signal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Final Technical Report DE-FG02-02ER45999

Over the course of this period of funding, the PI published 62 papers and graduated 15 Ph.D. students supported by the grant. In addition 17 undergraduate students, 10 postdocs and 16 Visiting Scholars were also involved in this research. Over 150 talks at national and international conferences on the topic were given by the PI and her research group. Research topics included the following: geometrical and electronic control of anisotropy in mononuclear complexes, incorporation of titanium ions into magnetic materials, trans-dicyanide building blocks for chains, cyanometallate chemistry of highly anisotropic metal ions, and compounds with dianionic organocyanide ligands.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fiber-Optic Bolometer and Calorimeter Arrays for Magnetically Confined Plasmas Final Technical Report

Exhaust control is critical for sustained and safe operation of magnetic confinement fusion (MCF), which requires bolometers to measure the radiations converted from the exhaust power. Traditional bolometers are based on a radiation absorber and a resistive temperature sensor and their performance is greatly compromised by the strong electromagnetic interference (EMI). Previously, we have demonstrated a fiber-optic bolometer that has the promise to overcome the challenges related to the strong EMI in the MCF environment. However, it shows relatively large noise that limits its usefulness in MCF applications. In this project, we reduced the noise by more than 20 times through novel sensor design and signal demodulation. The availability of such bolometers will help to better understand and control the exhaust control strategies in MCF. The original project duration was three years. Because the PI moved to another institution on 1/1/2018, the project was closed after four months and a new grant was awarded to the PI in his new institution to continue the work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development and Implementation of Fault-Correction Algorithms in Fault Detection and Diagnostics Tools

A fault detection and diagnostics (FDD) tool is a type of energy management and information system that continuously identifies the presence of faults and efficiency improvement opportunities through a one-way interface to the building automation system and the application of automated analytics. Building operators on the leading edge of technology adoption use FDD tools to enable median whole-building portfolio savings of 8%. Although FDD tools can inform operators of operational faults, currently an action is always required to correct the faults to generate energy savings. A subset of faults, however, such as biased sensors, can be addressed automatically, eliminating the need for staff intervention. Automating this fault “correction” can significantly increase the savings generated by FDD tools and reduce the reliance on human intervention. Doing so is expected to advance the usability and technical and economic performance of FDD technologies. This paper presents the development of nine innovative fault auto-correction algorithms for Heating, Ventilation, and Air Conditioning pi(HVAC) systems. When the auto-correction routine is triggered, it overwrites control setpoints or other variables to implement the intended changes. It also discusses the implementation of the auto-correction algorithms in commercial FDD software products, the integration of these strategies with building automation systems and their preliminary testing.

field testing↗

Nonlinear systems approach to control system design

Consider some of the control system design methods for plants with nonlinear dynamics. If the nonlinearity is weak relative to the size of the operating region, then the linear methods apply directly. Fixed-gain design may be feasible even for significant nonlinearities. It may be possible to find a single gain which provides adequate control of the linear models at several perturbation points. If the nonlinearity is restricted to a sector, that fact may be used to obtain a fixed-gain controller. Otherwise, a gain may have to be associated with each perturbation point Pi. A gain schedule K(p(v)) is obtained by connecting the perturbation points by a function, say p(v), of the scheduling parameter v (i.e., speed). When the scheduling parameter must be multidimensional, this approach is difficult; the objective is to develop an easier procedure.

Meyer, G.↗

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

actuated signal control↗

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

42 ENGINEERING↗