Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗
DOE OSTI2020

Advancing Diagnostic Model Evaluation to Better Understand Water Shortage Mechanisms in Institutionally Complex River Basins

Abstract Water resources systems models enable valuable inferences on consequential system stressors by representing both the geophysical processes determining the movement of water and the human elements distributing it to its various competing uses. This study contributes a diagnostic evaluation framework that pairs exploratory modeling with global sensitivity analysis to enhance our ability to make inferences on water scarcity vulnerabilities in institutionally complex river basins. Diagnostic evaluation of models representing institutionally complex river basins with many stakeholders poses significant challenges. First, it needs to exploit a large and diverse suite of simulations to capture important human‐natural system interactions as well as institutionally aware behavioral mechanisms. Second, it needs to have performance metrics that are consequential and draw on decision‐relevant model outputs that adequately capture the multisector concerns that emerge from diverse basin stakeholders. We demonstrate the proposed model diagnostic framework by evaluating how potential interactions between changing hydrologic conditions and human demands influence the frequencies and durations of water shortages of varying magnitudes experienced by hundreds of users in a subbasin of the Colorado River. We show that the dominant factors shaping these effects vary both across users and, for an individual user, across percentiles of shortage magnitude. These differences hold even for users sharing diversion locations, demand levels or water right seniority. Our findings underline the importance of detailed institutional representation for such basins, as institutions strongly shape how dominant factors of stakeholder vulnerabilities propagate through the complex network of users.

Hadjimichael, Antonia↗
DOE OSTI2022

Computational Tools and Workflows for Quantitative Risk Assessment and Decision Support for Geologic Carbon Storage Sites: Progress and Insights from the U.S. DOE’s National Risk Assessment Partnership

The 2005 Intergovernmental Panel on Climate Change (IPCC) Special Report on CCS raised the profile of CO2 capture and storage (CCS) as an important technology for reducing greenhouse gas (GHG) emissions. CCS is now recognized as a key component of most climate change mitigation scenarios. Since publication of that report the international research, development, and deployment (RD&D) community has advanced key technical aspects, clarified regulatory requirements, explored value chain and infrastructure solutions, and developed incentive paradigms to enable and promote large-scale deployment of CCS. These efforts have included research to better characterize geologic storage resources, to improve injection performance and storage efficiency, to assess and manage subsurface environmental risks, and to advance monitoring technologies to assure system conformance. These efforts have helped to build confidence in the viability of geologic carbon storage (GCS), but stakeholder concerns about long-term risks and liability associated with GCS remain a hurdle to broad acceptance and large-scale deployment of CCS. Since 2010, the U.S. DOE’s National Risk Assessment Partnership (NRAP) – a research collaboration between five contributing national laboratories – has worked to establish and demonstrate methods and tools to quantify and manage the subsurface environmental risks associated with GCS, amidst uncertainty. This work supports the Office of Fossil Energy and Carbon Management Carbon Transport and Storage Program’s goal of advancing safe and secure commercial-scale GCS deployment. To address the technical challenge of simulating the physical response of the GCS site to large-scale CO2 injection, NRAP has adopted an approach that relies on coupling computationally efficient reduced-order and/or data-driven proxy models of important system components (i.e., storage reservoir, sealing caprock, leakage pathways, intermediate formations, overlying groundwater aquifers, and the atmosphere) in integrated assessment framework. That integrated model of the physical system is complemented with fit-for purpose functionality to support site characterization and risk-related decisions. The recently released NRAP Phase II toolset includes the Open-Source Integrated Assessment Model (NRAP-Open-IAM) for evaluation of trends in leakage risk and potential impact, tools to support monitoring design optimization (Designs for Risk Evaluation and Management – DREAM v3.0 and Passive Seismic Monitoring Tool - PSMT), and tools for state of stress evaluation (State-of-Stress Analysis Tool - SOSAT) and forecasting induced seismicity risk. The NRAP team has also released a pair of reports describing conceptual workflows to incorporate physics-based, quantitative risk assessment into many of the design, planning, operation, and closure decisions for GCS projects. An online catalogue highlights published studies where these tools and methods are demonstrated. In this presentation, the utility of these products to assess risks and address key stakeholder questions will be highlighted through examples, and related insights about the safety and security of geologic carbon storage in qualified storage sites will be discussed. The prospect of rapid, large-scale deployment of GCS technology to aggressively reduce anthropogenic CO2 emissions requires careful consideration of interference between multiple commercial-scale storage projects within a basin. Going forward, NRAP is expanding and adapting site-scale risk quantification tools and methods to enable assessment of risks and inform management decisions for basin-scale deployment. Increasingly, this work will leverage next-generation approaches for surrogate modelling, fast prediction, and advanced visualization enabled by machine learning and artificial intelligence to promote virtual learning, scenario evaluation, and augment risk-based decision making.

quantitative risk assessment, geologic carbon stor↗
DOE OSTI2020

Airport Traffic Management and Planning Framework

Initial results from the Athena project show that high-performance computing and high-fidelity traffic simulation can help guide airport traffic management decisions and understand operating bottlenecks.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Theoretical foundations of waste factor and waste figure with applications to fixed wireless access and relay systems

The growing energy demands of next-generation wireless systems call for unified, system-level metrics to evaluate and optimize energy efficiency. This paper advances the concept of the Waste Factor (W), or Waste Figure (WF) in decibel scale, as a general framework for modeling power loss across cascaded communication components. By integrating W into the Consumption Factor (CF)–the ratio of data rate to consumed power–we reveal how component inefficiencies influence the minimum achievable energy per bit. Closed-form expressions are derived for energy-per-bit consumption in both direct and relay-assisted links, along with a decision rule for selecting the more energy-efficient path. While not explicitly modeled, Reflective Intelligent Surfaces (RIS) are shown to fit naturally within this framework. The analysis is further applied to a Fixed Wireless Access (FWA) scenario, where asymmetries in traffic direction and hardware inefficiencies are jointly considered, demonstrating the utility of the Waste Factor in guiding energy-aware system design.

Sevim, Nurullah [Texas A&M University, College Sta↗
DOE OSTI2021

Farmer characteristics and decision-making: A model for bioenergy crop adoption

We report the commercial development of biofuels and bioproducts depends on whether renewable biomass feedstock is available while not directly competing with the production of food. Farmers are one of the most important stakeholders in the biofuel supply chain and confront a range of uncertainties while entering the bioenergy market. Their decision-making process is extremely complex and rarely purely rational. Modeling farmer behavior requires considering a wide range of individual-level factors, socio-temporal dynamics, institutional settings, and their interactions. These characteristics make agent-based modeling a suitable framework for evaluating such systems. We developed a model to simulate farmer bioenergy crop adoption behavior across a 50-county study region in Nebraska, Kansas, and Colorado. The analysis considers adoption decisions for two bioenergy feedstocks, crop residues and energy crops. We examine the influence of individual and farm characteristics, market structure, social networks, and media influence on farmer adoption decisions. Our results indicate that different factors can have varied impacts on the speed of adoption for the crop residues and energy crops. Identifying levers that have the most impact on grower adoption can inform the design of interventions both from policy and private sector standpoints with important implications for the future the bioenergy industry.

09 BIOMASS FUELS↗
DOE OSTI2023

Optimal Strategies for Hybrid Battery‐Storage Systems Design

As stationary hybrid energy‐storage systems (HESS) for power systems applications have recently drawn interest due to their enhanced performance and decreasing cost, developing systematic approaches for HESS design while considering controls is gaining traction. Herein, a method is presented to optimally design hybrid battery storage by proposing a mathematical modeling framework, formulated as a mixed integer linear programming model. The optimization is capable of handling multiple subsystems of batteries, considering their economic and technological performance. Decisions involve sizing of the batteries, optimal temporal and strategic dispatch to end uses, and energy sources for charging each battery. The applicability of the model is tested on four case studies for three battery chemistries representing distinct objectives: high‐power, high‐energy, and second life. Compared to traditionally designed battery storage with a homogeneous battery, optimally designed hybrid systems can save 12%–26% of system costs, depending on the nature of the dispatch profile. Findings point to design preference toward the second life battery supplemented with some high‐power or high‐energy battery capacity, or both. With the utilized electricity price structure, customers can experience approximately 10%–35% reduction in their bills.

Koleva, Mariya↗
DOE OSTI2023

Bi-Level Adaptive Storage Expansion Strategy for Microgrids Using Deep Reinforcement Learning

Battery energy storage (BES) is a versatile resource for the secure and economic operation of microgrids (MGs). Prevailing stochastic optimization-based approaches for BES expansion planning for MGs are computationally complicated. This work proposes a data-driven bi-level multi-period BES expansion planning framework to determine the siting, sizing, and timing of BES installations. The proposed planning framework unifies deep reinforcement learning (DRL) and linear programming, thereby decoupling the determinations for the integer and continuous decision variables in two time scales, respectively. In the upper level, a rainbow DRL agent with quantile regression is trained to provide dynamic planning policies to accommodate stochastic renewable energy resources (RESs), load, and battery price changes efficiently. Further, the lower level computes the optimal operation of MGs with frequency constraints to hedge the islanding contingency. The two levels communicate with one another by exchanging storage configuration and operating expenses in order to accomplish the shared goal of minimizing investment and operation costs. Comparative case studies on an MG are carried out to demonstrate the superiority of the proposed DRL-based solution to the mixed-integer linear programming counterpart on efficiency, scalability, and adaptability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗
DOE OSTI2020

Climate Influences on Capacity Expansion Planning with Application to the Western U.S

Electric power system planners utilize a variety of planning tools to inform decisions concerning generation and transmission additions to the electric grid, the need for operational changes, and to evaluate potential stressors on the system. Numerous factors contribute to the planning process including projected fuel and technology costs, policy and load profiles. There is also a growing recognition of the interdependency of the electric grid with other natural and engineered systems. Here we explore how future climate change and hydropower operability might influence decisions related to electricity capacity expansion planning and operations. To do so we assemble a multi-model framework. Specifically, water resource modeling is used to simulate climate impacts on future water supply for thermoelectric and hydropower generation. Separately, temperature impacts on electricity load are evaluated. Together, these climate factors spatially constrain a capacity expansion model that projects generation and transmission additions to the grid. The projected new capacity-builds are then evaluated on their operations, reliability, and cost under average and extreme climate conditions using production cost modeling. This coupled framework is demonstrated on the electric grid in the Western U.S., supporting capacity expansion planning by WECC, the North American Electric Reliability Corporation (NERC) regional entity responsible for reliability assurance of the Western Interconnection. This region was selected in part because the West is unique in that it has high potential for renewable penetrations and is experiencing large retirements/displacements of baseload resources, primarily coal, leading to possible operational challenges in terms of changing resource mix and the need for resource flexibility. Toward this challenge, planning scenarios encompass a range of alternative energy, climate and drought futures. In this context we explore answers to two strategic questions: 1) How does changing climate influence electricity expansion planning (generation and transmission) and future operations, including type and capacity of new builds, system reliability, cost and environmental impacts? 2) How does the representation of hydropower in the modeling framework influence the evaluation of bulk power system operations? Results indicate that climate has a measurable influence on recommendations concerning the capacity, type and location of new generation and transmission additions, with up to 17 GW additional capacity needed by 2038 to meet peak loads (~6.6% increase over capacity-builds based on historical climate). The extent of additional infrastructure needs is strongly influenced by future water availability for hydropower and the potential deployment of demand response technologies. Systems designed for future climate conditions were found to maintain high system reliability under a range of electricity and water availability scenarios (including significant drought), with minimal system curtailments. Additional capacity needs due to higher load tend to increase cumulative 20-year investment and operating costs by $\$$5-$\$$17 billion and generation costs increase by 9 to 19%. Finally, changing the representation of hydropower flexibility has a relatively small influence on capacity expansion in the Western Interconnection through 2038, but hydropower flexibility impacts generation costs to a similar extent as climate.

13 HYDRO ENERGY↗
DOE OSTI2024

Enhancing Building Energy Efficiency through Advanced Sizing and Dispatch Methods for Energy Storage

Energy storage and electrification of buildings hold great potential for future decarbonization. However, there are several technical and economic barriers that prevent large-scale adoption and integration of energy storage in buildings. These barriers include integration with building control systems, high capital costs, and the necessity to identify and quantify value streams for different stakeholders. To overcome these obstacles, it is crucial to develop advanced sizing and dispatch methods to assist planning and operational decision-making for integrating energy storage in buildings. This work develops simple and flexible optimal sizing and dispatch framework for thermal energy storage (TES) and battery energy storage (BES) systems in large-scale office building. The optimal sizes of TES, BES, as well as other building assets are determined in a joint manner instead of sequentially to avoid sub-optimal solutions. The interaction between the sizing at the planning stage and hourly or sub-hourly dispatch at the operating stage is explicitly modeled. The solution is determined considering both capital costs in optimal sizing and operational benefits in optimal dispatch. Comprehensive assessments are performed using simulation studies to quantify potential energy, economic, and emission benefits by different utility tariffs and climate locations, to improve our understanding of the techno-economic performance of different TES and BES systems, and to identify barriers for adopting energy storage for buildings. Finally, the proposed framework will provide guidance to a broad range of stakeholders to properly design energy storage in buildings and maximizes potential benefits, thereby advancing affordable building energy storage deployment and helping us accelerating the transition towards a cleaner and more equitable energy economy.

Yu, Mingyung↗
DOE OSTI2020

Charging and Repositioning Decision Making for Fully Automated Ride-Hailing Fleet

This is the presentation profile for 2020 DOE Vechicle Technologies Office Annual Merit Review. It introduces the research results in the project "Charging and Repositioning Decision Making for Fully Automated Ride-Hailing Fleet". These results come from the work of developing a framework for integrated dispatching and charging management of an autonomous electric vehicle ride-hailing fleet, and a case study in New York City was conducted to investigate the benefits of systematic optimization approach comparing to a heuristic approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Stochastic Thermo-Hydro Modeling and Neural Network Surrogate Development for Thermal Resource Assessment of the Galleries-to-Calories Geobattery

The Galleries-to-Calories Geobattery concept explores the use of abandoned coal mine workings for large-scale thermal energy transport and storage. The system involves injecting waste heat from a supercomputing facility into flooded mine galleries, where groundwater flow can store and transport thermal energy for potential recovery in downgradient district heating and cooling applications. To evaluate the feasibility and performance of the Geobattery under geological and operational uncertainty, we developed a suite of stochastic thermo-hydrological (TH) simulations using Monte Carlo sampling of key uncertain parameters (e.g., permeability, porosity, thermal conductivity, specific heat capacity) and operating conditions (e.g., injection rate, injection temperature). Results identified injection rate and temperature as the most influential parameters governing thermal front propagation, while the geometry of the room-and-pillar structure played a critical role in directing the extent and orientation of thermal advancement. Optimal combinations of material properties for maximizing heat recovery were also determined. To address the high computational cost of coupled-process stochastic modeling, we trained a neural network surrogate model on 24,000 physics-based realizations, achieving an R² > 0.99 and MAE < 0.1 for temperature predictions at monitoring locations. This surrogate enabled an additional 100,000 realizations for global sensitivity analysis and probabilistic thermal resource assessment. The integrated stochastic physics–surrogate modeling framework offers a computationally efficient tool for quantifying uncertainty, identifying key drivers, and informing early-stage design decisions for Geobattery systems.

15 - GEOTHERMAL ENERGY↗
DOE OSTI2023

Reman Co-Design: A Combined Design and Remanufacturing Optimization Framework for the Sustainable Design of High-Value Components

Remanufacturing is a process that returns end-of-life equipment to as-new conditions and offers numerous environmental and economic benefits. To fully capitalize on remanufacturing, its synergistic interactions with design must be fully realized and addressed during the design stage. Although this fact is widely recognized in the literature, most of the current studies focus primarily either on the design or remanufacturing aspects of design for remanufacturing (DfRem). In an effort to offer a more integrated DfRem approach than those reported in the literature, we propose a new combined design and remanufacturing optimization (reman co-design) framework that takes a holistic approach by leveraging the intricate interplay between design and remanufacturing. Here, the aim of this formulation is to identify the optimal decisions that maximize the benefits of remanufacturing throughout the entire lifespan of a product. To showcase the utility of the new formulation, we are using a case study of a hydraulic manifold, (re)manufactured by John Deere. Using this industry example, we compare the results of reman co-design to the ones from a decoupled remanufacturing design approach. Results reveal that remanufacturing benefits are better realized and improved upon when using the developed reman co-design approach.

design for X↗
DOE OSTI2020

Situation awareness and dynamic ensemble forecasting of abnormal behavior in cyber-physical system

A plurality of monitoring nodes may each generate a time-series of current monitoring node values representing current operation of a cyber-physical system. A feature-based forecasting framework may receive the time-series of and generate a set of current feature vectors using feature discovery techniques. The feature behavior for each monitoring node may be characterized in the form of decision boundaries that separate normal and abnormal space based on operating data of the system. A set of ensemble state-space models may be constructed to represent feature evolution in the time-domain, wherein the forecasted outputs from the set of ensemble state-space models comprise anticipated time evolution of features. The framework may then obtain an overall features forecast through dynamic ensemble averaging and compare the overall features forecast to a threshold to generate an estimate associated with at least one feature vector crossing an associated decision boundary.

Abbaszadeh, Masoud↗
DOE OSTI2024

Integrating ytopt and libEnsemble to autotune OpenMC

Ytopt is a Python machine-learning-based autotuning software package developed within the ECP PROTEAS-TUNE project. The ytopt software adopts an asynchronous search framework that consists of sampling a small number of input parameter configurations and progressively fitting a surrogate model over the input-output space until exhausting the user-defined maximum number of evaluations or the wall-clock time. libEnsemble is a Python toolkit for coordinating workflows of asynchronous and dynamic ensembles of calculations across massively parallel resources developed within the ECP PETSc/TAO project. libEnsemble helps users take advantage of massively parallel resources to solve design, decision, and inference problems and expands the class of problems that can benefit from increased parallelism. In this paper we present our methodology and framework to integrate ytopt and libEnsemble to take advantage of massively parallel resources to accelerate the autotuning process. Specifically, we focus on using the proposed framework to autotune the ECP ExaSMR application OpenMC, an open source Monte Carlo particle transport code. OpenMC has seven tunable parameters some of which have large ranges such as the number of particles in-flight, which is in the range of 100,000 to 8 million, with its default setting of 1 million. Setting the proper combination of these parameter values to achieve the best performance is extremely time-consuming. Therefore, we apply the proposed framework to autotune the MPI/OpenMP offload version of OpenMC based on a user-defined metric such as the figure of merit (FoM) (particles/s) or energy efficiency energy-delay product (EDP) on Crusher at Oak Ridge Leadership Computing Facility. In conclusion, the experimental results show that we achieve the improvement up to 29.49% in FoM and up to 30.44% in EDP.

Autotuning↗
DOE OSTI2020

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗