Engineering topics

Maldonado, Bryan P.

Publications and source records attributed to Maldonado, Bryan P..

3 records

DOE OSTI2024

Reinforcement learning applied to dilute combustion control for increased fuel efficiency

To reduce the modeling burden for control of spark-ignition engines, reinforcement learning (RL) has been applied to solve the dilute combustion limit problem. Q-learning was used to identify an optimal control policy to adjust the fuel injection quantity in each combustion cycle. A physics-based model was used to determine the relevant states of the system used for training the control policy in a data-efficient manner. The cost function was chosen such that high cycle-to-cycle variability (CCV) at the dilute limit was minimized while maintaining stoichiometric combustion as much as possible. Experimental results demonstrated a reduction of CCV after the training period with slightly lean combustion, contributing to a net increase in fuel conversion efficiency of 1.33%. To ensure stoichiometric combustion for three-way catalyst compatibility, a second feedback loop based on an exhaust oxygen sensor was incorporated into the fuel quantity controller using a slow proportional-integral (PI) controller. The closed-loop experiments showed that both feedback loops can cooperate effectively, maintaining stoichiometric combustion while reducing combustion CCV and increasing fuel conversion efficiency by 1.09%. Finally, a modified cost function was proposed to ensure stoichiometric combustion with a single controller. In addition, the learning period was shortened by half to evaluate the RL algorithm performance on limited training time. Experimental results showed that the modified cost function could achieve the desired CCV targets, however, the learning time was reduced by half and the fuel conversion efficiency increased only by 0.30%.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

Evaluation of residual gas fraction estimation methods for cycle-to-cycle combustion variability analysis and modeling

Cycle-to-cycle combustion variability in spark-ignition engines during normal operation is mainly caused by random perturbations of the in-cylinder conditions such as the flow velocity field, homogeneity of the air-fuel distribution, spark energy discharge, and turbulence intensity of the flame front. Such perturbations translate into the variability of the energy released observed at the end of the combustion process. During normal operating conditions, the cycle-to-cycle variability (CCV) of the energy release behaves as random uncorrelated noise. However, during diluted combustion, in either the form of exhaust gas recirculation (EGR) or excess air (lean operation), the CCV tends to increase as dilution increases. Moreover, when the ignition limit is reached at high dilution levels, the combustion CCV is exacerbated by sporadic occurrences of incomplete combustion events, and the uncorrelation assumption no longer holds. The low or null energy released by partial burns and misfires has an impact on the following combustion event due to the residual gas that carries burned and unburned gases, which contributes to the deterministic coupling between engine cycles. Many residual gas fraction estimation methods, however, only address the nominal case where complete combustion occurs and combustion events are uncorrelated. Here we evaluate the efficacy of such methods on capturing the effects of partial burns and misfires on the residual gas estimate for high-EGR operation. The advantages and disadvantages of each method are discussed based on their ability to generate cycle-to-cycle estimates. Finally, a comparison between the different estimation techniques is presented based on their usefulness for control-oriented modeling.

42 ENGINEERING↗

DOE OSTI2020

Learning reference governor for cycle-to-cycle combustion control with misfire avoidance in spark-ignition engines at high exhaust gas recirculation–diluted conditions

Cycle-to-cycle feedback control is employed to achieve optimal combustion phasing while maintaining high levels of exhaust gas recirculation by adjusting the spark advance and the exhaust gas recirculation valve position. The control development is based on a control-oriented model that captures the effects of throttle position, exhaust gas recirculation valve position, and spark timing on the combustion phasing. Under the assumption that in-cylinder pressure information is available, an adaptive extended Kalman filter approach is used to estimate the exhaust gas recirculation rate into the intake manifold based on combustion phasing measurements. The estimation algorithm is adaptive since the cycle-to-cycle combustion variability (output covariance) is not known a priori and changes with operating conditions. A linear quadratic regulator controller is designed to maintain optimal combustion phasing while maximizing exhaust gas recirculation levels during load transients coming from throttle tip-in and tip-out commands from the driver. During throttle tip-outs, however, a combination of a high exhaust gas recirculation rate and an overly advanced spark, product of the dynamic response of the system, generates a sequence of misfire events. In this work, an explicit reference governor is used as an add-on scheme to the closed-loop system in order to avoid the violation of the misfire limit. The reference governor is enhanced with model-free learning which enables it to avoid misfires after a learning phase. Experimental results are reported which illustrate the potential of the proposed control strategy for achieving an optimal combustion process during highly diluted conditions for improving fuel efficiency.

42 ENGINEERING↗