Search NASA⌕ Search

SEARCH · Search NASA

Results for “power engineering computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

High Flux Isotope Reactor Low Enriched Uranium U-10Mo Fuel Design Parameters

Activities to convert the HFIR from HEU to LEU are ongoing as part of the US Department of Energy (DOE) National Nuclear Security Administration (NNSA) nuclear nonproliferation mission. Design activities to study the conversion of HFIR from HEU to LEU fuel explored different fuel design features and shapes with a uranium-molybdenum (U-10Mo) monolithic alloy fuel. This high-density alloy contains 90 wt % uranium and 10 wt % molybdenum and has a uranium density of 15.318gU/cm 3 . The goal of these studies is to generate several candidate HFIR LEU fuel designs of varying fuel fabrication complexity that meet the current HEU performance metrics and safety requirements. Recent advancements in modeling and simulation tools and design methods enabled a thorough analysis of the available design space with U-10Mo fuel. A surrogate model used this analysis as training data to quickly determine the performance of a design given specific design parameters. An optimization module used this surrogate model to quickly search this multidimensional search space given specific desired performance characteristics. This approach was made possible by the large available design space with U-10Mo fuel. Shift, a Monte Carlo tool optimized for high-performance computing (HPC) architectures, was used for faster calculation and better data management for reactor physics simulations. Once most of these design studies were complete, a new suite called the Python HFIR Analysis and Measurement Engine (PHAME) was developed to connect all fuel design analysis steps, making design studies more efficient and reproducible. The post-processing capabilities of these new tools are leveraged for the information provided herein. Leveraging these tools, several candidate fuel designs were selected with varying levels of feature complexity and reactor performance. This report provides design feature details for four selected HFIR LEU U-10Mo fuel designs and their corresponding performance and safety metrics. Nominal best-estimate design parameters and irradiation conditions, including fission rate densities, power densities, heat fluxes, and cumulative fission densities, are provided. Simulations show that the high uranium density of U-10Mo fuel provides a large potential design space that enables various LEU designs to meet HEU core performance metrics and safety requirements with a power increase from 85 MW (HEU) to 95 MW or 100 MW (LEU).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High-frequency, high-power performance of AlGaN-channel high-electron-mobility transistors: an RF simulation study [High-frequency high power performance of AlGaN channel HEMTs: an RF simulation study]

The emerging Al-rich AlGaN-channel Al x Ga 1–x N/Al y Ga 1–y N high-electron-mobility transistors (HEMTs) with 0.7 ≤ y < x ≤ 1.0 have the potential to greatly exceed the power handling capabilities of today's GaN HEMTs, possibly by five times. This projection is based on the expected 4× enhancement of the critical electric field, the 2× enhancement of sheet carrier density, and the parity of the electron saturation velocity for Al-rich AlGaN-channel HEMTs relative to GaN-channel HEMTs. In this paper, the expected increased RF power density in Al-rich AlGaN-channel HEMTs is calculated by theoretical analysis and computer simulations, based on existing data on long-channel AlGaN devices. It is shown that a saturated power density of 18 W mm –1 , a power-added efficiency of 55% and an output third-order intercept point over 40 dB can be achieved for this technology. Furthermore, the method for large-signal RF performance estimation presented in this paper is generic and can be applied to other novel high-power device technologies at the early stages of development.

42 ENGINEERING↗

Interpreting and designing microbial communities for bioprocess applications, from components to interactions to emergent properties

Interest in microbial communities for bioprocessing has surged in recent years based on the potential to optimize multiple tasks simultaneously and to enhance process productivity and stability. The presence and magnitude of these desirable system properties often result from interactions between functionally distinct community members. The importance of interactions, while appreciated by some disciplines for decades, has gained interest recently due to the development of ‘omics techniques, polymicrobial culturing approaches, and computational methods which has made the systems-level analysis of interacting components more tractable. This review defines and categorizes natural and engineered system components, interactions, and emergent properties, as well as presents three ecological theories relevant to microbial communities. Case studies are interpreted to illustrate components, interactions, emergent properties and agreement with theoretical concepts. A general foundation is laid to facilitate interpretation of current systems and to aid in future design of microbial systems for the next generation of bioprocesses.

community↗

Experimental and CFD Analysis of Advanced Convective Cooling Systems

The objective of this project is to study the fundamental physical phenomena in the reactor cavity cooling system (RCCS) of very high-temperature reactors (VHTRs). One of the primary design objectives is to assure that RCCS acts as an ultimate heat sink capable of maintaining thermal integrity of the fuel, vessel, and equipment within the reactor cavity for the entire spectrum of postulated accident scenarios. Since construction of full-scale experimental test facilities to study these phenomena is impractical, it is logical to expect that computational fluid dynamics (CFD) simulations will play a key role in the RCCS design process. An important question then arises: To what extent are conventional CFD codes able to accurately capture the most important flow phenomena, and how can they be modified to improve their quantitative predictions? Researchers are working to tackle this problem in two ways. First, in the experimental phase, the research team plans to design and construct an innovative platform that will provide a standard test setting for validating CFD codes proposed for the RCCS design. This capability will significantly advance the state of knowledge in both liquid-cooled and gas-cooled (e.g., sodium fast reactor) reactor technology. This work will also extend flow measurements to micro-scale levels not obtainable in large-scale test facilities, thereby revealing previously undetectable phenomena that will complement the existing infrastructure. Second, in the computational phase of this work, numerical simulation of the flow and temperature profiles will be performed using advanced turbulence models to simulate the complex conditions of flows in critical zones of the cavity. These models will be validated and verified so that they can be implemented into commercially available CFD codes. Ultimately, the results of these validation studies can then be used to enable a more accurate design and safety evaluation of systems in actual nuclear power applications (both during normal operation and accident scenarios).

42 ENGINEERING↗

The Fusion Nuclear Science Pathways Assessment

With the strong commitment of the US to the success of the ITER burning plasma mission, and the project overall, it is prudent to consider how to take the most advantage of this investment. The production of energy from fusion has been a long sought goal, and the subject of several programmatic investigations and time line proposals. The nuclear aspects of fusion research have largely been avoided experimentally for practical reasons, resulting in a strong emphasis on plasma science. Meanwhile, ITER has brought into focus how the interface between the plasma and engineering/technology, presents the most challenging problems for design. In fact, this situation is becoming the rule and no longer the exception. ITER will demonstrate the deposition of 0.5 GW of neutron heating to the blanket, deliver a heat load of 10-20 MW/m 2 or more on the divertor, inject 50-100 MW of heating power to the plasma, all at the expected size scale of a power plant. However, in spite of this, and a number of other technologies relevant power plant, ITER will provide a low neutron exposure compared to the levels expected to a fusion power plant, and will purchase its tritium entirely from world reserves accumulated from decades of CANDU reactor operations. Such a decision for ITER is technically well founded, allowing the use of conventional materials and water coolant, avoiding the thick tritium breeding blankets required for tritium self-sufficiency, and allowing the concentration on burning plasma and plasma-engineering interface issues. The neutron fluence experienced in ITER over its entire lifetime will be ~ 0.3 MW-yr/m 2 , while a fusion power plant is expected to experience 120-180 MW-yr/m 2 over its lifetime. ITER utilizes shielding blanket modules, with no tritium breeding, except in test blanket modules (TBM) located in 3 ports on the midplane, which will provide early tests of the fusion nuclear environment with very low tritium production (a few g per year).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NREL Computer Models Integrate Wind Turbines with Floating Platforms (Fact Sheet)

Far off the shores of energy-hungry coastal cities, powerful winds blow over the open ocean, where the water is too deep for today's seabed-mounted offshore wind turbines. For the United States to tap into these vast offshore wind energy resources, wind turbines must be mounted on floating platforms to be cost effective. Researchers at the National Renewable Energy Laboratory (NREL) aresupporting that development with computer models that allow detailed analyses of such floating wind turbines.

17 WIND ENERGY↗

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Ultralight Door Design, Development and Demonstration Project (Final Scientific Report)

The project objectives associated with the Ultralight Door Project were to develop a lightweight driver's side door, 42.5% lighter than a current model year high-volume baseline door, at an incremental cost not to exceed $ \$ $ 5 per pound saved, while maintaining equivalent functionality, safety, corrosion, durability and sound transmission performance of the baseline vehicle. The project approach included the selection of a door architecture, development of a key performance target matrix and incremental cost model. Several unique door structures were developed and evaluated using computer-aided engineering (CAE) and cost modeling tools. The aluminum-intensive door structure was the only design capable of meeting both the performance and cost criteria objectives. The door module, glass, interior trim, latch and electrical subsystems were functionally integrated with the aluminum door structure, enabling additional mass reduction beyond material substitution. The lightweight door design was prototyped, integrated with baseline vehicles and tested to validate equivalent functionality and performance. The project results demonstrate a mass reduction of 15.2 kg (40%) at an incremental cost of $ \$ $2.81 per pound saved, while maintaining functionality and performance of the baseline door. The environmental benefit associated with the Ultralight Door enables a 6g CO 2 eq. per kilometer environmental benefit, for a 4-door vehicle powered by a downsized fuel injected gasoline combustion engine. The project results were presented and published in the 2018 SAE International Conference proceedings and in the Journal of Life Cycle Assessment.

36 MATERIALS SCIENCE↗

PHELIX

Explore the source record for details and available documents.

Rousculp, Christopher L↗

A learning-augmented approach for AC optimal power flow

Because of the high nonlinearity of AC optimal power flow (OPF), numerous efforts have been made in recent decades to find efficient methods. Machine learning (ML) has proven to significantly reduce the computational costs in many real-world problems. Thus, this paper develops a learning-augmented method for solving AC OPF, which integrates both power network equations and ML to yield near-optimal solutions. More specifically, ML models are developed to first predict bus voltage magnitudes and angles. Then, physics-based network equations are employed to calculate the power injection at different buses. Three ML algorithms, i.e., random forest, multi-target decision tree, and extreme learning machine, are explored and compared. To evaluate the efficiency of the proposed learning-augmented AC OPF solver, the MATPOWER Interior Point Solver is adopted as a baseline. Case studies on both 500-bus and 4918-bus test networks show that the proposed learning-augmented method has reduced the computational time by 15–100 times depending on the network size with a minimal loss in optimality.

42 ENGINEERING↗

Volumetric Additive Manufacturing of Polymer Structures by Holographically Projected Light Fields

As additive manufacturing technologies proliferate and mature, overcoming some of their process limitations becomes increasingly important for the continued expansion of practical applications. Two such limitations that arise from layer-based fabrication are slow speed and geometric constraints (which include poor surface quality and challenges fabricating span, cantilever, and overhang elements). Moving beyond point-by-point and layer-by-layer approaches, the ability to generate a complex 3D volume as a unit operation has the potential to overcome these limitations. Since holography has been extensively studied as a means for storage and retrieval of 3D geometrical information, this dissertation explores the use of holographically-shaped light fields for producing three-dimensional structures in a “volume at once” approach. Leveraging advances in spatial light modulator (SLM) technology, phase-controlled light fields are projected into photopolymer resin to cure a desired geometry. By overlapping multiple sub-regions of a single light field within the target volume, the successful fabrication of non-periodic complex 3D geometries is demonstrated by single exposures on timescales of seconds. This dissertation presents a complete prototype platform that makes this approach possible, comprising a suitable hardware configuration along with the computational algorithms necessary to calculate and optimize the required optical fields. A study of the photopolymerization kinetics is also carried out, to determine the boundaries of usable process parameters such as resin absorbance and available light intensity. The results indicate that low-absorbing resins containing ~0.1% photoinitiator, illuminated at modest powers (~10-100 mW) may be used to produce full 3D structures from 1-10 second exposures, with volume build rates exceeding 100 cm3/hr, without layering and with no need for a substrate or support material.

36 MATERIALS SCIENCE↗

The Advanced Dimensional Depletion for Engineering of Reactors (ADDER) Software for Depletion and Fuel Management

The Advanced Dimensional Depletion for Engineering of Reactors (ADDER) software is being developed in the Research and Test Reactor (RTR) Program at Argonne National Laboratory to meet the reactor design and analysis needs of the Conversion Program. ADDER is a flexible tool that (1) provides a depletion capability through coupling external neutronics codes with a built-in CRAM solver or external depletion code and (2) provides a user-friendly interface to perform fuel management and criticality search operations. The ADDER software is a Python 3 application written using modern software development practices subject to a compliant implementation of NQA-1 and applicable Department of Energy software quality assurance standards. This report is the user guide for the software release referred to as ADDER v1.1.0. The motivation for a software to have flexible capabilities that ADDER possesses is the need to support a wide variety of geometries that are commonly required in analysis of research and test reactors. These reactors can have complex fuel, experiment, or control material shuffling patterns that persist over several years with many fuel management and partial refueling intervals. The scale of fuel management analysis can require tracking of an inventory that is multiple times the core loading. Many reactors, both power and non-power reactors of various types, will find the features of ADDER useful to facilitate key tasks that a fuel or core design engineer must perform with the convenience of concise input and validated functionality.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A new APDS approach - alarm processing based on alarm prioritization - 201

We take for granted that the advances in technology bring improvements to the conditions in which humans perform activities associated to them. Is that the case for digital alarm systems in nuclear power plants? The answer is not that simple. A review of the related literature, shows that still, the single most significant problem with alarm systems, is the large number of alarm messages presented to the operator at once. This is an issue that affects analog I and C control rooms with conventional annunciators and gets aggravated in digital I and C based control rooms. Digital alarm systems present the alarms in the form of lists in computer screens. This kind of presentation forces the operator to scroll or navigate pages to review the active alarms. Also, the alarm lists do not allow the operator to apply the pattern recognition practices acquired during training when using with fixed position alarm systems. An Alarm Processing and Diagnostic System (APDS) facilitates the alarm monitoring task by applying alarm reduction techniques based on alarm priorities. It allows the operators to focus on the most important alarms during plant upsets. A new generation of APDS should be based in an improved alarm analysis methodology. To develop such methodology, Tecnatom reviewed applicable standards and our own alarm analysis experiences. This paper documents the process and conclusions of the methodology development. (authors)

42 ENGINEERING↗

An Integrated Tool for Functional Requirements Analysis, Function Allocation and Task Analysis

The software application is called "HFE-Trace". This is an integrated method and tool for the management of Human Factors Engineering analyses and related data. Its primary purpose is to support the coherent and consistent application of the nuclear industry's best practices for human factors engineering work. The software is a custom Microsoft® Access® application. The application is used (in conjunction with other tools such as spreadsheets, checklists and normal documents where necessary) to collect data on the design of a new nuclear power plant from subject matter experts and other sources. This information is then used to identify potential system and functional breakdowns of the intended power plant design. This information is expanded by developing extensive descriptions of all functions, as well as system performance parameters, operating limits and constraints, and operational conditions. Once these have been verified, the human factors elements are added to each function, including intended operator role, function allocation considerations, prohibited actions, primary task categories, and primary work station. In addition, the application includes a computational method to assess a number of factors such as system and process complexity, workload, environmental conditions, procedures, regulations, etc.) that may shape operator performance. This is a unique methodology based upon principles described in NUREG/CR-3331 ("A methodology for allocating nuclear power plant control functions to human or automatic control") and it results in a semi-quantified allocation of functions to three or more levels of automation for a conceptual automation system. The aggregate of all this information is then linked to the Task Analysis section of the application where the existing information on all operator functions is transformed into task information and ultimately into design requirements for Human-System Interfaces and Control Rooms. This final step includes assessment of methods to prevent potential operator errors.

Hugo, Jacques↗

Development and Demonstration of a Fuel-Efficient, Class 8 Tractor & Trailer Engine System (SuperTruck II)

Navistar presents the SuperTruck II (ST II) Final Report to the Unites States Department of Energy (US DOE), which covers the five Budget Periods (BPs) from 10-1-2016 through 6-30-2022. For ST II, Navistar built on the achievements of the SuperTruck I (ST I) Program as a catalyst to continue critical research, design and development, testing, and operations to reach the ambitious goals of the ST II project. This approach allowed Navistar to continue contributing to the essential needs of our nation for safe, efficient, and cost-effective delivery of goods and services, as we reduced negative environmental effects and improved operational productivity. This document contains information specified in DOE F 4600.2, Final Scientific/Technical Report DOE F 241.3, B. SCIENTIFIC/TECHNICAL REPORTS, explaining how we met and exceeded program requirements. Throughout this Final Report, Navistar extracted information from documents prepared during the project that represent our management, design and development, building, and testing efforts to meet and exceed SuperTruck II project goals. Navistar followed Plan requirements to achieve / exceed Project Objectives: a) >100% improvement in vehicle freight efficiency (FE) (on ton-MPG basis) relative to 2009 baseline with stretch goal of 140% improvement [actual: 170%); b) >55% engine brake thermal efficiency (BTE) demonstrated in operational engine at a 65-mph cruise point on a dynamometer – ≥31% increase from 2009 baseline [actual: 55.20% of combined BTE) ; and c) development and implementation of commercially cost effective technologies (in terms of a simple payback). Technology selection / development path focused on developing technologies applicable for production within 3-year approach, while ensuring technology readiness and cost of ownership for end users. The Program was organized into five budget periods: Requirements / Technology Assessment and Initial Hardware Testing; Technology Development and Concept Readiness Demonstration; Technology Finalization and Validation Tractor / Trailer Fabrication, Integration and Commissioning Demonstration; and Fuel Economy (FE) and Brake Thermal Efficiency (BTE) and Program Completion. Leadership was provided by DOE, with tasks performed by laboratories (Argonne National Laboratory, Lawrence Livermore National Laboratory); partners at Bosch, TPI, Dana, and J.B. Hunt; , and support from University of Michigan and Clemson University. Navistar lead this team with Principal Investigator / Contracting Officer; Project Manager (PM); Vehicle, Engine, and Aftertreatment Engineers; Finance Manager, Technical Program Leads, and Legal/IP; and other key personnel. Work also included personnel in risk management; funding / budget / finance. Work involved analysis, development, testing, and down selection of individual/system engine, aftertreatment, and vehicle technologies, with integration of selected technologies into a prototype vehicle for demonstration of fuel-efficiency gain. Work also included component/integrated system level development of truck and trailer aerodynamics, base engine efficiency, advanced aftertreatment, combustion efficiency, waste heat recovery, hybrid powertrain, reduced rolling resistance, weight reduction, idle reduction, and driver feedback. As ST II progressed, Navistar performed computer-based modeling / simulations of technologies focused on the primary operational areas: Engine, Aftertreatment, and Vehicle. During the ST II Program, the COVID Virus outbreak unexpectedly challenged by the effects of, which affected staffing, scheduling, design, supplies, availability of materials, production procedures, and testing. The DOE responded by extending the program by three quarters to ensure that project tasks were completed for this vital project. Focus continued on analyzing, developing, testing, and down selecting individual-/system-level engine and vehicle technologies for integration of the final selected technologies into a prototype vehicle that would demonstrate fuel-efficiency gains made possible through these technologies. This included component/integrated system-level development of truck and trailer aerodynamics, base engine efficiency, advanced aftertreatment, combustion efficiency, waste heat recovery, solar power, distributed and intelligent vehicle power, hybrid powertrain, reduced rolling resistance, weight reduction, idle reduction, and driver feedback. Throughout the program, function, reliability, and performance at all levels were ensured through testing. Proof of this approach was demonstrated in multiple, on-road demonstrations: Scenario A (Flatland) Fuel Economy, Scenario B (Hilly) Fuel Economy, and City Cycle Tests. Other benefits derived from ST II included new/improved products, publications, patents, and next-step capabilities related to electric/hydrogen vehicles and autonomous driving.

Zukouski, Russ↗

Advanced Drying Cycle Simulator Thermal Response to Commercial Drying Conditions

The purpose of this report is to document updates on testing of the apparatus built to simulate commercial drying procedures for spent nuclear fuel at the Nuclear Energy Work Complex at Sandia National Laboratories. Validation of the extent of water removal in a dry spent nuclear fuel storage system based on drying procedures used at nuclear power plants is needed to close existing technical gaps. Operational conditions leading to incomplete drying may have potential impacts on the fuel, cladding, and other components in the system during subsequent storage and disposal. A general lack of data suitable for model validation of commercial nuclear canister drying processes necessitates well-designed investigations of drying process efficacy and water retention that incorporate relevant physics and well-controlled boundary conditions. This report documents testing updates for the Advanced Drying Cycle Simulator (ADCS). This apparatus was built to simulate commercial drying procedures and quantify the amount of residual water remaining in a pressurized water reactor (PWR) fuel assembly after drying. The ADCS was constructed with a prototypic 17×17 PWR fuel skeleton and waterproof heater rods to simulate decay heat. These waterproof heaters are the next generation design to heater rods developed and tested at Sandia National Laboratories in FY20. This report describes preliminary testing of the ADCS through measurement and analysis of the thermal response of the system to a subset of commercial drying conditions that exclude the introduction of water, namely simulated decay heats and pressures relevant to commercial drying. This test series, referred to as a “dry” test series in this report, spans three uniform waterproof heater rod powers (representing spent fuel decay heats), four helium fill pressures, and six vacuum levels. This test series was conducted to cover the range of expected ADCS testing conditions for upcoming “wet” testing, where water will be introduced and a simulated commercial drying cycle will be performed. The dry test conditions were derived from the commercial drying conditions seen in the High Burnup Demonstration and the vacuum drying conditions chosen for a smaller scale Dashpot Drying Apparatus tested at Sandia National Laboratories in FY22. For a given uniform power and pressure/vacuum level, the ADCS was operated at constant power and pressure and allowed to reach steady state conditions. The thermal data obtained from these tests were analyzed, and the results can inform computational models built to simulate commercial drying processes by providing baseline thermal data prior to the introduction of water. Following the preliminary dry tests, a test plan for the ADCS will be developed to implement a drying procedure that begins with the introduction of water to the system and is based on measurements from the drying process used for the High Burnup Demonstration Project. While applying power to the simulated fuel rods, this procedure is expected to consist of filling the ADCS vessel with water, draining the water with applied pressure and multiple helium blowdowns, evacuating additional water with a vacuum drying sequence at successively lower pressures, and backfilling the vessel with helium. Additional investigations are expected to feature failed fuel rod simulators with engineered cladding defects and guide tubes with obstructed dashpots to challenge the drying system with multiple water retention sites. The data from these investigations is expected to inform the efficacy of commercial drying operations through the quantification of residual water in a prototypic-length dry storage canister.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Computer-Aided Engineering of Automotive Batteries (Presentation)

NREL and partners will investigate the reuse of retired lithium ion batteries for plug-in hybrid, hybrid, and electric vehicles in order to reduce vehicle costs and emissions and curb our dependence on foreign oil. A workshop to solicit industry feedback on the process is planned. Analyses will be conducted, and aged batteries will be tested in two or three suitable second-use applications. Theproject is considering whether retired PHEV/EV batteries have value for other applications; if so, what are the barriers and how can they be overcome?

25 ENERGY STORAGE↗

Chapter Nine - Automated Optimal Control in Energy Systems: The Reinforcement Learning Approach

With the development of smart grid technologies an increasing number of new devices and participants have joined modern energy systems and are inevitably making them more complicated and interdependent than ever. Optimally controlling such a complex energy system and maintaining its operation in a high-efficient, secure, and resilient manner are challenging tasks to the system operators. Fortunately, the revolution in deep learning and artificial intelligence (AI), both from hardware and algorithms perspectives, has provided new ideas and solutions to many previously intractable problems. As a result, this advance in computer science also sparked great research interests in utilizing AI in solving engineering problems related to the modern energy systems. Among many AI techniques, deep reinforcement learning (DRL) has demonstrated great potential for solving sequential optimization problems, which are very common in the engineering domains. Its ability to handle nonlinearity and stochasticity in controlled systems has out-competed many traditional optimal control algorithms. Therefore in this chapter, we focus on the state-of-the-art of DRL concepts and related algorithms, compare their pros and cons with traditional optimal control approaches and discuss the typical workflow for leveraging RL in solving complex problems in modern energy systems.

artificial intelligence↗