Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

LOCOMOTIVES - Comprehensive Impact and Cost Assessment Framework of Carbon Lowering Approaches for the US Rail Freight System

The goal of this project is to develop a tool to aid railroads and other stakeholders assess and approach the decarbonization of freight rail operations by identifying new, viable low-carbon energy storage and conversion systems for future locomotive systems and how they should be deployed on the existing US freight rail network. In the first quarter, the project focused on collecting data, establishing a simulation workflow, and engaging industry through the creation of the Industry Advisory Board (IAB). In the second quarter, the project focused on selecting fuel pathways and powertrain technologies, setting performance targets, conducting a techno-economic analyses, and developing the simulation framework that would serve as the backbone of the future toolhead. The third quarter involved developing an industry-oriented interactive dashboard powered by a five-step sequential framework, as well as holding industry advisory board meetings as per the initial technology-to-market plan. In the remaining project quarters, the NUFRIEND dashboard were fine-tuned with the help of IAB member feedback and in-depth scenario analyses were conducted to support the techno-economic analysis of energy sources. Additionally, dashboard documentation, project insights, and open-source code on GitHub were prepared and released. Throughout the project, the team completed testing and analysis of all model components, integrated all initial test scenarios, and conducted stakeholder engagement. Lower-carbon drop-in fuels can be deployed as admixtures and are considered uniform across the network at a desired penetration rate, while hydrogen and battery-electric technology deployment poses a more complex problem as they require significant investments to be made in the siting of refueling/charging facilities and the replacement of locomotive fleets. Thus, strategies for locating and sizing refueling/charging facilities on a railroad’s network to meet their energy demands were developed to inform deployment decisions. To address this challenge, the Northwestern University Freight Rail Infrastructure & Energy Network Decarbonization (NUFRIEND) framework presents a five-step sequential framework to select O-D paths, locate facilities, reroute flows, size facilities, and evaluate the deployment for alternative energy sources that require locomotive powertrains to be converted and new refueling infrastructure to be deployed. The NUFRIEND Framework is an industry-oriented tool for simulating the deployment of new energy technologies across the US freight rail network. The framework provides a comprehensive network-level optimization and scenario simulation tool for decarbonizing the freight rail sector, addressing the uncertainties surrounding technological developments by supporting sensitivity analyses for different operational and technological parameters through a transparent and flexible input module. It offers practical alternatives to diesel locomotives and can be applied for any railroad considering the specific network structure and freight demand, outputting evaluation metrics for the associated emissions and costs relative to diesel operations. A number of relevant simulation scenarios were run and analyzed for key insights on the value of different alternative technologies for freight rail decarbonization. The project developments and findings have been presented at numerous conferences and events.

08 HYDROGEN↗

Towards a Circular Economy for PET Bottles in the U.S. - 4P Framework

The United States generates the most plastic waste of any country. Along with that GHG emissions from the global plastic economy are expected to increase to 15% of the global carbon budget by 2050. It is imperative that plastic recycling is made a reality to reduce both plastic pollution in the environment and GHG emissions. A portfolio of end-of-life strategies must be implemented to minimize environmental impacts and retain valuable plastic material, but it is challenging to compare options that generate products with different utility and lifetime. Plastic use reduction, reuse and recycling are thus increasingly important, but making informed policy and research decisions within this space can be challenging given the diverse range of available solutions. The novel analysis framework, Plastic Parallel Pathways Platform (4P) has been equipped with consequential life cycle assessment, techno-economic analysis, and a plastic circularity indicator to estimate the greenhouse gas (GHG) emissions, circularity, and cost of polyethylene terephthalate (PET) down-cycling to lower-quality resin, closed-loop recycling to food-grade PET bottles, up-cycling to fiber-reinforced plastic (FRP), and conversion to non-plastic products (electricity, oil) on a United States economy-wide basis. Integrating system dynamics into this robust plastics model that already incorporates techno-economics, circularity, and environmental impacts will enable identification of key bottlenecks between manufacturers, waste sorters, and reclaimers that currently prevent rapid decarbonization of the plastics economy. System dynamics (SD) explore the evolution of activities and technologies based on changed macro parameters such as plastic demand and supply, market shifts, and cross-sectoral interactions. This project particularly aims to explore the interplay between, waste collection, plastic waste sorting, recycling, and manufacturing, as well as the effect of plastic bale quality and plastic reuse initiatives on the surrounding process stages. This functionality will facilitate combinatory analysis in which a portfolio of end-of-life pathways are assessed simultaneously, with the exact makeup of that portfolio affected by parameters such as technology scales, resource constraints, and waste mitigation efforts. Integrating SD with the 4P framework enables analyzing the effect of increased revenue and reinvestment into improving process efficiencies, sorting and collection quantities. Through that, market effects of increased recycled resin availability can be studied for the plastics systems model for the US. The results will help identify technical or economic bottlenecks that currently limit efforts to decarbonize the U.S. plastics economy.

circular economy↗

Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method

Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Error Detection and Error Classification: Failure Awareness in Data Transfer Scheduling

Data transfer in distributed environment is prone to frequent failures resulting from back-end system level problems, like connectivity failure which is technically untraceable by users. Error messages are not logged efficiently, and sometimes are not relevant/useful from users point-of-view. Our study explores the possibility of an efficient error detection and reporting system for such environments. Prior knowledge about the environment and awareness of the actual reason behind a failure would enable higher level planners to make better and accurate decisions. It is necessary to have well defined error detection and error reporting methods to increase the usability and serviceability of existing data transfer protocols and data management systems. We investigate the applicability of early error detection and error classification techniques and propose an error reporting framework and a failure-aware data transfer life cycle to improve arrangement of data transfer operations and to enhance decision making of data transfer schedulers.

97 MATHEMATICS AND COMPUTING↗

A Framework for Quantitative Assessment of Impacts Related to Energy and Mineral Resource Development

Natural resource planning at all scales demands methods for assessing the impacts of resource development and use, and in particular it requires standardized methods that yield robust and unbiased results. Building from existing probabilistic methods for assessing the volumes of energy and mineral resources, we provide an algorithm for consistent, reproducible, quantitative assessment of resource development impacts. The approach combines probabilistic input data with Monte Carlo statistical methods to determine probabilistic outputs that convey the uncertainties inherent in the data. For example, one can utilize our algorithm to combine data from a natural gas resource assessment with maps of sage grouse leks and pinon-juniper woodlands in the same area to estimate possible future habitat impacts due to possible future gas development. As another example: one could combine geochemical data and maps of lynx habitat with data from a mineral deposit assessment in the same area to determine possible future mining impacts on water resources and lynx habitat. The approach can be applied to a broad range of positive and negative resource development impacts, such as water quantity or quality, economic benefits, or air quality, limited only by the availability of necessary input data and quantified relationships among geologic resources, development alternatives, and impacts. In conclusion, the framework enables quantitative evaluation of the trade-offs inherent in resource management decision-making, including cumulative impacts, to address societal concerns and policy aspects of resource development.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A valuation framework for customers impacted by extreme temperature-related outages

Extreme temperature outages can lead to not just economic losses but also various non-energy impacts (NEI), such as increased mortality rates, property damage, and reduced productivity, due to significant degradation of indoor operating conditions caused by service disruptions. However, existing resilience assessment approaches lack specificity for extreme temperature conditions. They often overlook temperature-related mortality and neglect the customer characteristics and grid response in the calculation, despite the significant influence of these factors on NEI-related economic losses. This paper aims to address these gaps by introducing a comprehensive framework to estimate the impact of resilience enhancement not only on the direct economic losses incurred by customers but also on potential NEI, including mortality and the value of statistical life during extreme temperature-related outages. The proposed resilience valuation integrates customer characteristics and grid response variables based on a scalable grid simulation environment. This study adopts a holistic approach to quantify customer-oriented economic impacts, utilizing probabilistic loss scenarios that incorporate health-related factors and damage/loss models as a function of exposure for valuation. The proposed methodology is demonstrated through comparative resilient outage planning, using grid response models emulating a Texas weather zone during the 2021 winter storm Uri. The case study results show that enhanced outage planning with hardened infrastructure can improve the system resilience and thereby reduce the relative risk of mortality by 16% and save the total costs related to non-energy impacts by 74%. In conclusion, these findings underscore the efficacy of the framework by assessing the financial implications of each case, providing valuable insights for decision-makers and stakeholders involved in extreme-weather related resilience planning for risk management and mitigation strategies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Winds of fortune? Understanding the geographic, sociodemographic, and temporal distribution of benefit mechanisms from land-based wind projects in the United States

Despite decades of research on factors shaping local responses to wind development, there is relatively little known about benefit mechanisms (e.g., agreements, funds, donations) used by developers in the U.S. land-based wind sector. To address this gap, we collected benefit mechanism data across all current utility-scale land-based wind projects installed between 1982 and 2024 (n = 1047), finding that just under one-third of projects had a benefit mechanism attached to them. We find the use of benefit mechanisms has become more common over time, is associated with larger projects, and varies by region. In terms of host community characteristics, the use of benefit mechanisms is associated with characteristics like higher education level, higher percent white, higher percent Republican, higher decision-making capacity, lower unemployment rate, and higher poverty rate. Building on a theoretical framework of purposes, we discuss what these findings could suggest about the motivations driving developers' use of these mechanisms, such as increasing local acceptance of a wind project or supporting distributive fairness. This first-of-its-kind study builds a comprehensive understanding of how benefit mechanisms have been used in the U.S. wind industry throughout its history, which can inform future approaches to benefit-sharing across sectors.

17 WIND ENERGY↗

Impacts of Observational Constraints Related to Sea Level on Estimates of Climate Sensitivity

Reduced complexity climate models are necessary tools for quantifying decision-relevant uncertainties, given their flexibility, computational efficiency, and suitability for large-ensemble frameworks necessary for statistical estimation using resampling techniques (e.g. Markov chain Monte Carlo—MCMC). Here we document a new version of the simple, open-source, global climate model Hector, coupled with a one-dimensional diffusive heat and energy balance model (Diffusion Ocean Energy balance CLIMate model; DOECLIM) and a sea-level change module (Building blocks for Relevant Ice and Climate Knowledge; BRICK) that also represents contributions from thermal expansion, glaciers and ice caps, and polar ice sheets. We apply a Bayesian calibration approach to quantify model uncertainties surrounding 39 model parameters with prescribed radiative forcing, using observational information from global surface temperature, ocean heat uptake, and sea-level change. Furthermore, we find sea-level change as an observational constraint sharpens inference for the upper tail of posterior climate sensitivity estimates (the 97.5 percentile is tightened from 6.5 K to 5.3 K). The addition of sea-level change as an observational constraint also has implications for probabilistic projections of global surface temperature (the 97.5 percentile for RCP8.5 2100 temperature decreases 0.3 K) and sea-level rise (the 97.5 percentile for RCP8.5 2100 sea level decreases 0.5 m).

54 ENVIRONMENTAL SCIENCES↗

Advancing Asset Management in Water Infrastructure Systems

Aging water system infrastructure, including drinking water, wastewater, and stormwater, poses a growing challenge for utilities and municipalities. These water systems have well documented challenges with respect to their age, condition, and level of service. ASCE annual report cards consistently rate these infrastructure systems in the United States as underfunded, overcapacity, or past service life (ASCE 2025 Report Card). For example, Chini and Stillwell (2017) estimated that the mean water loss in drinking water systems, i.e., non-revenue water, is approximately 16% across the United States. These concerns are not just relegated to the United States, with Courtenay, British Columbia, identifying 17% of their water main pipes as in a ‘poor’ condition state, defined as a category condition 5 out of 5 (City of Courtenay, 2024). These cases illustrate the challenges utilities are facing to manage extensive networks of infrastructure to deliver a consistent and high level of service. For buried infrastructure such as water systems, studies suggest that preventative interventions can lead to lower maintenance costs and fewer service disruptions (Mazumder et al, 2018; Li et al, 2014). The demonstrated need and benefit of appropriately applied asset management is juxtaposed against the relatively sparse literature that evaluates water systems within an asset management construct. Since 2020, just 37 papers specifically reference asset management in the Journal of Water Resources Planning and Management. Of those, only a few specifically look to develop strategies for improved asset management. Therefore, we highlight four key research areas that represent opportunities for advancement of asset management research for water systems. First, advances in condition assessment and forecasting are needed to better estimate asset deterioration using diverse datasets. Second, machine learning (ML) and artificial intelligence (AI) hold promise for predictive maintenance and investment prioritization, though questions of generalizability and model transparency remain. Third, applying a value of information framework can guide utilities in making cost-effective sensor deployment and data collection decisions, to direct monitoring strategies towards data-informed asset management decisions. Finally, integrated infrastructure management is critical, requiring coordinated planning with other infrastructure systems and stakeholder engagement to reduce costs and enhance service delivery.

Chini, Christopher M.↗

Machine Learning-Based Temperature Prediction for Runtime Thermal Management Across System Components

Elevated temperatures limit the peak performance of systems because of frequent interventions by thermal throttling. Non-uniform thermal states across system nodes also cause performance variation within seemingly equivalent nodes leading to significant degradation of overall performance. In this paper we present a framework for creating a lightweight thermal prediction system suitable for run-time management decisions. We pursue two avenues to explore optimized lightweight thermal predictors. First, we use feature selection algorithms to improve the performance of previously designed machine learning methods. Second, we develop alternative methods using neural network and linear regression-based methods to perform a comprehensive comparative study of prediction methods. We show that our optimized models achieve improved performance with better prediction accuracy and lower overhead as compared with the Gaussian process model proposed previously. Specifically we present a reduced version of the Gaussian process model, a neural network-based model, and a linear regression-based model. Using the optimization methods, we are able to reduce the average prediction errors in the Gaussian process from 4: 2 degrees C to 2: 9 degrees C. We also show that the newly developed models using neural network and Lasso linear regression have average prediction errors of 2: 9 degrees C and 3: 8 degrees C respectively. The prediction overheads are 0.22, 0.097, and 0.026 ms per prediction for reduced Gaussian process, neural network, and Lasso linear regression models, respectively, compared with 0.57 ms per prediction for the previous Gaussian process model. We have implemented our proposed thermal prediction models on a two-node system configuration to help identify the optimal task placement. The task placement identified by the models reduces the average system temperature by up to 11: 9 degrees C without any performance degradation. Furthermore, these models respectively achieve 75, 82.5, and 74.17 percent success rates in correctly pointing to those task placements with better thermal response, compared with 72.5 percent success for the original model in achieving the same objective. Lastly, we extended our analysis to a 16-node system and we were able to train models and execute them in real time to guide task migration and achieve on average 17 percent reduction in the overall system cooling power.

97 MATHEMATICS AND COMPUTING↗

Velo: Riding the Knowledge Management Wave for Simulation and Modeling

Modern scientific enterprises are inherently knowledge-intensive. In general, scientific studies in domains such as geosciences, climate, and biology require the acquisition and manipulation of large amounts of experimental and field data in order to create inputs for large-scale computational simulations. The results of these simulations must then be analyzed, leading to refinements of inputs and models and further simulations. Further, these results must be managed and archived to provide justifications for publications and regulatory decisions that are based on these models. In this paper we describe our Velo framework that is designed as a reusable, domain independent knowledge management infrastructure for modeling and simulation. Velo leverages, integrates, and extends open source collaborative and content management technologies to create a scalable and flexible core platform that can be tailored to specific scientific domains. In this paper we describe the architecture of Velo for managing and associating the various types of data that are used and created in modeling and simulation projects, as well as the framework for integrating domain-specific tools. To demonstrate a realization of Velo, we describe the Geologic Sequestration Software Suite (GS3) that has been developed to support geologic sequestration modeling. This provides a concrete example of the inherent extensibility and utility of our approach.

99 GENERAL AND MISCELLANEOUS↗

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗

Microreactor Optimization Using Simulation And Economics (mouse)

Microreactor Optimization Using Simulation and Economics (MOUSE) is a tool that integrates both nuclear microreactor design and reactor economics to provide comprehensive evaluations and optimizations. This tool enables stakeholders to explore the interplay between technical and economic variables, guiding them towards effective and competitive microreactor solutions. For the reactor core simulations, MOUSE leverages the OpenMC Monte Carlo Particle Transport Code to perform detailed core simulations for various microreactor designs. The included OpenMC models are 2D core designs of a Liquid Metal Thermal Microreactor (LMTR), a Gas-Cooled TRISO-Fueled Microreactor (GCMR), and a Heat Pipe Microreactor. Beyond core design, MOUSE includes simplified calculations for: - Calculating the masses of heat exchangers within the system. - Mechanical power of pumps. - Estimating the area occupied by various buildings within the nuclear plant. For the economic analysis, MOUSE provides detailed bottom-up cost estimates, encompassing a wide range of costs including preconstruction costs, direct costs, indirect costs, training costs, financial costs, operation & maintenance (O&M) costs, and fuel costs. These cost estimations are developed using data from the MARVEL project and additional literature sources, enabling the calculation of total capital costs and levelized cost of energy for both first-of-a-kind and nth-of-a-kind microreactors. MOUSE also enables analysis of the cost drivers and competitiveness in the electricity market. MOUSE allows users to modify a wide array of technical and economic parameters to evaluate different scenarios and their impacts. Examples of these parameters include: Fuels, coolants, or reflector materials Enrichment levels Control drum materials and geometry Fuel pin geometry and materials Moderator pin geometry and materials Reactor core and reflector dimensions Packing factor for the TRISO particles Nuclear reactor power and reactor burnup Number of sensors Shielding thickness Reactor vessel and guard vessel dimensions Operational staff requirements Number of emergency shutdowns Levelization period Interest rate Construction duration Since MOUSE is powered by the WATTS toolkit, it supports optimization studies, parametric analyses, and uncertainty calculations/propagation. The optimization techniques enable users to identify optimal design and economic configurations. The parametric analysis tools allow users to explore the sensitivity of various parameters, while uncertainty propagation helps quantify the impact of uncertainties on overall performance and cost. User Interface and Workflow: Currently, MOUSE is a command-line-based tool. Users can input various reactor design or economic parameters, modify the designs, run simulations, and visualize results through comprehensive data visualization and reporting capabilities. The typical workflow involves setting up the reactor model, defining economic parameters, running simulations, and analyzing the results to make informed decisions. By combining advanced design calculations with detailed economic modeling, MOUSE provides a robust framework for optimizing nuclear microreactor technologies, enhancing their competitiveness, and guiding stakeholders towards innovative and cost-effective solutions.

Hanna, Botros [Idaho National Laboratory (INL), Id↗

Grid Resiliency using Hydro-based Microgrids During Wildfires

The primary objective of this project is to assess the techno-economic viability of hydropower resources with supplementary investments, including microgrid controllers, storage solutions, load banks, additional generation like diesel generators, communication links, and transmission infrastructure. The aim is to enable these systems to operate autonomously (in islanded mode) and ensure grid resiliency during and after wildfire events. The project seeks to establish a comprehensive framework for setting up hydropower-based microgrids, from risk estimation to final investment decisions. These microgrids can provide critical support during emergencies and offer additional grid stability and revenue opportunities during regular operations and other system contingencies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Techno-Economic Evaluation of Electrified Vehicle Options in Drayage Fleets

The electrification of drayage fleets offers potential economic and operational benefits, but the financial viability of electrified vehicles remains sensitive to battery cost, energy price, and fleet usage patterns. While total cost of ownership (TCO) is a useful benchmark, fleet operators and investors are equally concerned with investment performance metrics such as payback period (PB) and Internal Rate of Return (IRR), which better reflect financial risks and investment return timelines. This study develops a unified techno-economic framework that jointly evaluates TCO, PB, and IRR to determine when electrified trucks become cost-effective alternatives to diesel trucks. Building on a previously developed cost modeling tool and using real-world telematics data from a Class 8 drayage fleet at the Port of Savannah, the analysis incorporates projected battery cost trajectories, electricity and diesel price trends, vehicle efficiency improvements, and multiple battery capacities. Parameter ranges reflect widely cited projections and observed drayage-duty-cycle variability. A surrogate-modeling method approximates economic performance across thousands of battery cost–electricity price combinations, enabling high-resolution identification of conditions that achieve TCO parity, acceptable PB thresholds, and target IRR levels. Additionally, the study estimates the evolving share of the fleet that can feasibly electrify over time under multiple economic metrics. This integrated framework offers a novel, data-driven approach to inform risk-aware decision-making for fleet electrification and supports investment planning under evolving cost and operational conditions.

Sun, Ruixiao [ORNL] (ORCID:0000000341768676)↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

The Cybersecurity Value-at-Risk Framework

Hydropower remains one of the strongest forms of renewable energy generation methods. It is crucial to address the increasing risks associated with the rapid digitization. The push towards decarbonization also factors in the need to ensure security and resilience for grid-connected renewable energy resources. This report summarizes the U.S. Department of Energy's Water Power Technologies Office's effort to develop a cybersecurity valuation methodology that assists hydropower stakeholders in assessing risks associated with plan operations and gathers valuation guidance through a web-based applicaiton. The Hydropower Cybersecurity Value-at-Risk Framework delivers a platform for industry members to perform self assessments and make informed decisions on their cybersecurity investments.

CVF↗