Search NASA⌕ Search

Engineering topics

Jin, Ming

Publications and source records attributed to Jin, Ming.

Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration

The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.

complexity theory↗

Certifiably Robust Neural ODE With Learning-Based Barrier Function

Neural Ordinary Differential Equations (ODEs) have gained traction in many applications. While recent studies have focused on empirically increasing the robustness of neural ODEs against natural or adversarial attacks, certified robustness is still lacking. In this work, we propose a framework for training a neural ODE using barrier functions and demonstrate improved robustness for classification problems. Finally, we further provide the first generalization guarantee of robustness against adversarial attacks using a wait-and-judge scenario approach.

97 MATHEMATICS AND COMPUTING↗

District EnErgy Planner (DEEP) v2

The District EnErgy Planner - DEEP is an Mixed Integer Linear Programming (MILP) optimization software tool to solve district energy system, technology configuration, operation strategies, and energy retail business schemes. DEEP takes user input energy demand on heating, cooling and electricity demand. Energy loss through pipeline is calculated for heating and cooling from central plants. The optimal system configuration to minimize the district energy system life cycle cost or minimize CO2 emission is calculated based on energy balance equations and various constraints. The recent update on DEEP include a feature of waste heat utilization energy balance based optimization to take into accounts of different temperature bands of heat into account to maximize system efficiency. Another feature is to optimize district energy retail by provide optimal pricing scheme for heating, cooling and electricity to end users to incorporate district to grid demand response.

Feng, Wei↗

Towards Off-policy Evaluation as a Prerequisite for Real-world Reinforcement Learning in Building Control

We present an initial study of off-policy evaluation (OPE), a problem prerequisite to real-world reinforcement learning (RL), in the context of building control. OPE is the problem of estimating a policy's performance without running it on the actual system, using historical data from the existing controller. It enables the control engineers to ensure a new, pretrained policy satisfies the performance requirements and safety constraints of a real-world system, prior to interacting with it. While many methods have been developed for OPE, no study has evaluated which ones are suitable for building operational data, which are generated by deterministic policies and have limited coverage of the state-action space. After reviewing existing works and their assumptions, we adopted the approximate model (AM) method. Furthermore, we used bootstrapping to quantify uncertainty and correct for bias. In a simulation study, we evaluated the proposed approach on 10 policies pretrained with imitation learning. On average, the AM method estimated the energy and comfort costs with 1.84% and 14.1% error, respectively.

Chen, B↗

Solvent-Free Synthesis of CuO/HKUST-1 Composite and Its Photocatalytic Application

A metal–organic framework (MOF) is one kind of crystalline microporous material and is increasingly used as a host of catalytically active guests. Nanostructured materials supported on MOFs have presented enhanced catalytic activity and stability. Templates or several steps are essential to the synthesis of MOF composites. Simple and effective MOF synthesis methods are still challenging. In this work, nanosized copper oxide particles in MOF composites, described as nanosized CuO@HKUST-1, were prepared by a facile solvent-free reaction. These series of CuO@HKUST-1 composites exhibited excellent photocatalytic activity for production of hydrogen and methylene blue (MB) degradation under visible light. This synthesis method provides an effective way to fabricate MOF-related nanocomposite catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cascade energy optimization for waste heat recovery in distributed energy systems

The efficiency of distributed energy systems can be significantly increased through waste heat recovery from industry or power generation. The technologies used for this process are typically dependent on the quality and temperature grades of waste heat. To maximize the efficiency of cascade heat utilization, it is important to optimize the choice of waste heat recovery technologies and their operation. Here, a detailed mixed integer linear programming optimization model is proposed for waste heat recovery in a district-scale microgrid. The model can distinguish waste heat quality for planning and operation optimization of distributed energy systems. Heat utilization technologies are formulated in this developed model and categorized in different temperature grades. The developed model is validated using four typical cases under different settings of system operation and business models. It is found that the optimization model, by distinguishing waste heat temperature, can increase energy cost savings by around 5%, compared to models that do not consider waste heat temperature grades. Additionally, the results indicate that the developed model can provide more realistic configuration and technologies dispatch.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A review of microgrid development in the United States – A decade of progress on policies, demonstrations, controls, and software tools

Microgrids have become increasingly popular in the United States. Supported by favorable federal and local policies, microgrid projects can provide greater energy stability and resilience within a project site or community. Here, we review major federal, state, and utility-level policies driving microgrid development in the United States. Representative U.S. demonstration projects are selected and their technical characteristics and non-technical features are introduced. The paper discusses trends in the technology development of microgrid systems as well as microgrid control methods and interactions within the electricity market. Software tools for microgrid design, planning, and performance analysis are illustrated with each tool's core capability. Finally, the paper summarizes the successes and lessons learned during the recent expansion of the U.S. microgrid industry that may serve as a reference for other countries developing their own microgrid industries.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Microgrid to enable optimal distributed energy retail and end-user demand response

In the face of unprecedented challenges in environmental sustainability and grid resilience, there is an increasingly held consensus regarding the adoption of distributed and renewable energy resources such as microgrids (MGs), and the utilization of flexible electric loads by demand response (DR) to potentially drive a necessary paradigm shift in energy production and consumption patterns. However, the potential value of distributed generation and demand flexibility has not yet been fully realized in the operation of MGs. This study investigates the pricing and operation strategy with DR for a MG retailer in an integrated energy system (IES). Based on co-optimizing retail rates and MG dispatch formulated as a mixed integer quadratic programming (MIQP) problem, our model devises a dynamic pricing scheme that reflects the cost of generation and promotes DR, in tandem with an optimal dispatch plan that exploits spark spread and facilitates the integration of renewables, resulting in improved retailer profits and system stability. Main issues like integrated energy coupling and customer bill reduction are addressed during pricing to ensure rates competitiveness and customer protection. By evaluating on real datasets, the system is demonstrated to optimally coordinate storage, renewables, and combined heat and power (CHP), reduce carbon dioxide emission while maintaining profits, and effectively alleviate the PV curtailment problem. Finally, the model can be used by retailers and MG operators to optimize their operations, as well as regulators to design new utility rates in support of the ongoing transformation of energy systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A PC-Based Free Text DSS for Health Care

A free Decision Support System(DST) has been constructed for health care professional that allows the analysis of complex medical cases and the creation of diagnostic list of potential diseases for clinical evaluation.The system uses a PC-based text management system specifically designed for desktop operation. The texts employed in the decision support package include the Merck Manual (published by Merck Sharpe & Dohme) and Control of Communicable Diseas in Man (published by the American Public Health Association). The background and design of the database are discussed along with a structured analysis procedure for handling free text DSS system. A case study is presented to show the application of this technology and conclusions are drawn in the summary that point to expanded areas of professional intention and new frontiers yet to be explored in this rapidly progressing field.

Grams, Ralph R.↗