SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Modeling nuclear energy’s future role in decarbonized energy systems

Increased attention has been focused on the potential role of nuclear energy in future electricity markets and energy systems as stakeholders target rapid and deep decarbonization and reductions in fossil fuel use. This paper examines models of electric sector planning and broader energy systems optimization to understand the prospective roles of nuclear energy and other technologies. In this perspective, we survey modeling challenges in this environment, illustrate opportunities to propagate best practices, and highlight insights from the deep decarbonization literature on the range of visions for nuclear energy's role. Nuclear energy deployment is highest with combinations of stringent emissions policies, nuclear cost reductions, and constraints on the deployment of other technologies, which underscores model dimensions related to these areas. New modeling capabilities are needed to adequately address emerging issues, including representing characteristics and applications of nuclear energy in systems models, and to ensure the relevance of models for policy and planning as deeper decarbonization is explored.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2014

Emissions Implications of Future Natural Gas Production and Use in the U.S. and in the Rocky Mountain Region

Enhanced prospects for natural gas production raise questions about the balance of impacts on air quality, as increased emissions from production activities are considered alongside the reductions expected when natural gas is burned in place of other fossil fuels. This study explores how trends in natural gas production over the coming decades might affect emissions of greenhouse gases (GHG), volatile organic compounds (VOCs) and nitrogen oxides (NOx) for the United States and its Rocky Mountain region. The MARKAL (MARKet ALlocation) energy system optimization model is used with the U.S. Environmental Protection Agency's nine-region database to compare scenarios for natural gas supply and demand, constraints on the electricity generation mix, and GHG emissions fees. Through 2050, total energy system GHG emissions show little response to natural gas supply assumptions, due to offsetting changes across sectors. Policy-driven constraints or emissions fees are needed to achieve net reductions. In most scenarios, wind is a less expensive source of new electricity supplies in the Rocky Mountain region than natural gas. U.S. NOx emissions decline in all the scenarios considered. Increased VOC emissions from natural gas production offset part of the anticipated reductions from the transportation sector, especially in the Rocky Mountain region.

emissions↗

DOE OSTI2019

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine

In the past, precision medicine involves classifying patients to identify subpopulations that respond favorably to specific therapeutics. We discuss precision medicine as a dynamic feedback control problem, where treatment administered to a patient is guided by measurements taken during the course of treatment. We consider sepsis, a life-threatening condition in which dysregulation of the immune system causes tissue damage. We leverage an existing simulation of the innate immune response to infection and apply deep reinforcement learning (DRL) to discover an adaptive personalized treatment policy that specifies effective multicytokine therapy to simulated sepsis patients based on systemic measurements. The learned policy achieves a dramatic reduction in mortality rate over a set of 500 simulated patients relative to standalone antibiotic therapy. Advantages of our approach are threefold: (1) the use of simulation allows exploring therapeutic strategies beyond clinical practice and available data, (2) advances in DRL accommodate learning complex therapeutic strategies for complex biological systems, and (3) optimized treatments respond to a patient's individual disease progression over time, therefore, capturing both differences across patients and the inherent randomness of disease progression within a single patient. We believe that this work motivates both considering adaptive personalized multicytokine mediation therapy for sepsis and exploiting simulation with DRL for precision medicine more broadly.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Performance Evaluation of Adaptive Routing on Dragonfly-based Production Systems

Performance of applications in production environments can he sensitive to network congestion. Cray Aries supports adaptively routing each network packet independently based on the load or congestion encountered as a packet traverses the network. Software can dictate different routing policies, adjusting between minimal and non-minimal bias, for each posted message. We have extensively evaluated the sensitivity of the routing bias selection on application performance as well as whole system performance in both production and controlled conditions. We show that the default routing bias used in Aries-based systems is often sub-optimal and that using a higher bias towards minimal routes will not only reduce the congestion effects on the application but also will decrease the overall congestion on the network. This routing scheme results in not only improved mean performance (by up to 12%) of most production applications hut also reduced run-to-run variability. Our study prompted the two supercomputing facilities (ALCF and NERSC) to change the default routing mode on their Aries-based systems. We present the substantial improvement measured in the overall congestion management and interconnect performance in production after making this change.

Chunduri, Sudheer↗

DOE OSTI2014

DOE SBIR Phase II Final Technical Report - Assessing Climate Change Effects on Wind Energy

Specialized Vertum Partners software tools were prototyped, tested and commercialized to allow wind energy stakeholders to assess the uncertainties of climate change on wind power production and distribution. This project resulted in three commercially proven products and a marketing tool. The first was a Weather Research and Forecasting Model (WRF) based resource evaluation system. The second was a web-based service providing global 10m wind data from multiple sources to wind industry subscription customers. The third product addressed the needs of our utility clients looking at climate change effects on electricity distribution. For this we collaborated on the Santa Ana Wildfire Threat Index (SAWTi), which was released publicly last quarter. Finally to promote these products and educate potential users we released “Gust or Bust”, a graphic-novel styled marketing publication.

17 WIND ENERGY↗

DOE OSTI2016

Nuclear-Renewable Hybrid Energy Systems: 2016 Technology Development Program Plan

The United States is in the midst of an energy revolution, spurred by advancement of technology to produce unprecedented supplies of oil and natural gas. Simultaneously, there is an increasing concern for climate change attributed to greenhouse gas (GHG) emissions that, in large part, result from burning fossil fuels. An international consensus has concluded that the U.S. and other developed nations have an imperative to reduce GHG emissions to address these climate change concerns. The global desire to reduce GHG emissions has led to the development and deployment of clean energy resources and technologies, particularly renewable energy technologies, at a rapid rate. At the same time, each of the major energy sectors—the electric grid, industrial manufacturing, transportation, and the residential/commercial consumers— is increasingly becoming linked through information and communications technologies, advanced modeling and simulation, and controls. Coordination of clean energy generation technologies through integrated hybrid energy systems, as defined below, has the potential to further revolutionize energy services at the system level by coordinating the exchange of energy currency among the energy sectors in a manner that optimizes financial efficiency (including capital investments), maximizes thermodynamic efficiency (through best use of exergy, which is the potential to use the available energy in producing energy services), reduces environmental impacts when clean energy inputs are maximized, and provides resources for grid management. Rapid buildout of renewable technologies has been largely driven by local, state, and federal policies, such as renewable portfolio standards and production tax credits that incentivize investment in these generation sources. A foundational assumption within this program plan is that renewable technologies will continue to be major contributors to the future U.S. energy infrastructure. While increased use of clean renewable technologies will aid in achieving reduced GHG emissions, it also presents new challenges to grid management that must be addressed. These challenges primarily derive from the fundamental characteristics of variable renewable generators, such as wind and solar: non-dispatchability, variable production, and reduced electromechanical inertia. This document presents a preliminary research and development (R&D) plan for detailed dynamic simulation and analysis of nuclear-renewable hybrid energy systems (N-R HES), coupled with integrated energy system design, component development, and integrated systems testing. N-R HES are cooperatively-controlled systems that dynamically apportion thermal and/or electrical energy to provide responsive generation to the power grid.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

The need for carbon-emissions-driven climate projections in CMIP7

Abstract. Previous phases of the Coupled Model Intercomparison Project (CMIP) have primarily focused on simulations driven by atmospheric concentrations of greenhouse gases (GHGs), for both idealized model experiments and climate projections of different emissions scenarios. We argue that although this approach was practical to allow parallel development of Earth system model simulations and detailed socioeconomic futures, carbon cycle uncertainty as represented by diverse, process-resolving Earth system models (ESMs) is not manifested in the scenario outcomes, thus omitting a dominant source of uncertainty in meeting the Paris Agreement. Mitigation policy is defined in terms of human activity (including emissions), with strategies varying in their timing of net-zero emissions, the balance of mitigation effort between short-lived and long-lived climate forcers, their reliance on land use strategy, and the extent and timing of carbon removals. To explore the response to these drivers, ESMs need to explicitly represent complete cycles of major GHGs, including natural processes and anthropogenic influences. Carbon removal and sequestration strategies, which rely on proposed human management of natural systems, are currently calculated in integrated assessment models (IAMs) during scenario development with only the net carbon emissions passed to the ESM. However, proper accounting of the coupled system impacts of and feedback on such interventions requires explicit process representation in ESMs to build self-consistent physical representations of their potential effectiveness and risks under climate change. We propose that CMIP7 efforts prioritize simulations driven by CO2 emissions from fossil fuel use and projected deployment of carbon dioxide removal technologies, as well as land use and management, using the process resolution allowed by state-of-the-art ESMs to resolve carbon–climate feedbacks. Post-CMIP7 ambitions should aim to incorporate modeling of non-CO2 GHGs (in particular, sources and sinks of methane and nitrous oxide) and process-based representation of carbon removal options. These developments will allow three primary benefits: (1) resources to be allocated to policy-relevant climate projections and better real-time information related to the detectability and verification of emissions reductions and their relationship to expected near-term climate impacts, (2) scenario modeling of the range of possible future climate states including Earth system processes and feedbacks that are increasingly well-represented in ESMs, and (3) optimal utilization of the strengths of ESMs in the wider context of climate modeling infrastructure (which includes simple climate models, machine learning approaches and kilometer-scale climate models).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2002

Program and Project Management Framework

The primary objective of this project was to develop a framework and system architecture for integrating program and project management tools that may be applied consistently throughout Kennedy Space Center (KSC) to optimize planning, cost estimating, risk management, and project control. Project management methodology used in building interactive systems to accommodate the needs of the project managers is applied as a key component in assessing the usefulness and applicability of the framework and tools developed. Research for the project included investigation and analysis of industrial practices, KSC standards, policies, and techniques, Systems Management Office (SMO) personnel, and other documented experiences of project management experts. In addition, this project documents best practices derived from the literature as well as new or developing project management models, practices, and techniques.

Butler, Cassandra D.↗

DOE OSTI2024

A portable application framework for energy management and information systems (EMIS) solutions using Brick semantic schema

This paper introduces a portable framework for developing, scaling and maintaining energy management and information systems (EMIS) applications using an ontology-based approach. Key contributions include an interoperable layer based on Brick schema, the formalization of application constraints pertaining metadata and data requirements, and a field demonstration. The framework allows for querying metadata models, fetching data, preprocessing, and analyzing data, thereby offering a modular and flexible workflow for application development. Its effectiveness is demonstrated through a case study involving the development and implementation of a data-driven anomaly detection tool for the photovoltaic systems installed at the Politecnico di Torino, Italy. During eight months of testing, the framework was used to tackle practical challenges including: (i) developing a machine learning-based anomaly detection pipeline, (ii) replacing data-driven models during operation, (iii) optimizing model deployment and retraining, (iv) handling critical changes in variable naming conventions and sensor availability (v) extending the pipeline from one system to additional ones.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Savings in Action: Lessons from Observed and Modeled Residential Solar Plus Storage Systems

The electric grid is rapidly evolving as small-scale, demand-side resources play increasingly important roles in grid operations and decarbonization. Maximizing the potential of demand-side resources involves incentivizing electricity customers to use those resources in ways that benefit the broader electrical grid. These incentives depend largely on the electricity cost savings that customers can realize from demand-side resource adoption. Determining these potential cost savings is a complex task. Cost savings depend on numerous factors, including the characteristics of different technologies, the algorithms that control these devices, system performance, customer behavior, electricity rate structures, and climatic factors. Another challenge is that estimated cost savings are frequently based on modeled rather than observed system performance, particularly in the academic literature. In this study, we begin to fill the gap in empirical research of demand-side resources using data from a new construction residential community equipped with rooftop solar and storage (S+S) in Arizona. We use these data to analyze the factors that determine customer electricity cost savings and emissions impacts of S+S in the real world. We then compare these data to modeled system performance to understand how models deviate from real-world outcomes. Based on these findings, we explore ways to improve such models and, conversely, use modeled results to suggest improvements to actual S+S deployment. The results of these analyses can be summarized in four key findings: 1) rate structures play a central role in the grid and customer value of demand-side resources; 2) certain customers can benefit more from demand-side resource adoption than others; 3) modeled battery dispatch and sizing reveals opportunities for additional cost savings; and 4) optimal dispatches can reduce grid emissions while maximizing bill savings.

14 SOLAR ENERGY↗

DOE OSTI2025

Unpacking Modeling Analysis for the Circular Economy

This session will cover: (1) How models simulate material recovery, recycling, product life cycles and waste management. (2) Using life cycle analysis (LCA) to measure environmental impacts across product life cycles and guide decision-making. (3) Optimizing resource use, reducing energy consumption and minimizing waste in recycling systems. (4) Evaluating EPR and other interventions through scenario analysis to make informed decisions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS2018

Temperature Constraints on the Storage and Curation of Volatile-Rich Samples from the Lunar Poles

Final Document is attached. Introduction: NASA's Lunar Exploration Campaign includes Lunar sample return efforts beginning in the mid-2020's and human landed missions in the late 2020's-early 2030's. Volatile-rich samples from the Lunar poles will be high-priority targets due to their resource potential for human explorers and high science value. In order to precisely characterize the nature of these polar volatile materials upon return to Earth, they will need to be transported and curated under conditions that minimize their chemical and physical alteration. NASA Policy Directive (NPD) 7100.10F mandates the preservation of existing extraterrestrial samples with minimal alteration, extensive and quantitative documentation of alteration that is provided to investigators, and "the development of long-range plans" for samples yet to be acquired. This abstract summarizes new efforts by the Astromaterials Acquisition and Curation Office at JSC to assess the optimal

Mitchell, J. L.↗

DOE OSTI2026

Optimizing Transportation Networks for E-Waste Reverse Logistics: A Multi-Modal Cost Allocation and Pricing Strategy

The exponential growth of electronic waste (e-waste) poses critical challenges for sustainable reverse logistics and transportation network optimization. This study develops a dual-channel transportation framework for e-waste logistics that integrates dynamic freight pricing, cost allocation mechanisms, and game-theoretic coordination. The model captures interactions between centralized hubs and distributed processing networks, accounting for freight rate elasticity, volume allocation, and capacity constraints. Using Stackelberg game theory and cost-sharing strategies, the framework optimizes transportation efficiency and profit distribution across logistics channels. Numerical simulations show that the dual-channel structure increases centralized hub profit by 226.8% compared to baseline single-channel operations, while boosting total transported volume by 1.2% and nearly doubling freight collector profit under cost-sharing. Scenario analyses across regional infrastructures reveal that network density, policy incentives, and logistics costs shape routing efficiency and profit allocation. These findings suggest that coordinated strategies combining dynamic pricing, targeted infrastructure investment, and strategic cost allocation are needed to design efficient, resilient, and regionally adaptable e-waste transportation systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency

Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Packetized Energy Management: Coordinating Transmission and Distribution (Final Report)

The project Packetized Energy Management (PEM): Coordinating Transmission and Distribution was part of the ARPA-E NODES program from 2015 to 2023. The high-level goal of the project was to develop and demonstrate novel, scalable, and impactful technologies related to the coordination of networked distributed energy resources (DERs). By demonstrating responsive means by which fleets of DERs could be coordinated to enhance grid operation and reliability, the U.S. could accelerate renewable integration and electrification efforts and meet decarbonization goals.

25 ENERGY STORAGE↗

DOE OSTI2024

New opportunities in produced water management: A market-based approach to produced water trading

Produced water (PW) is a byproduct of oil and gas (O&G) production. Obtained alongside the more valuable energy products, PW is usually characterized by high levels of salinity and often contains many contaminants (chemicals, soluble and insoluble oil, organics, etc.) making it unsuitable for release without substantial treatment. Couple this with the fact that PW is typically obtained at multiple times the rate of oil or gas, and the added transport, treatment, and disposal costs become a serious challenge for operators. These realities have led to ad-hoc practices including cooperation between industry competitors to recycle, share, or otherwise mitigate PW costs. The National Energy Technology Laboratory (NETL) in partnership with the Ground Water Protection Council (GWPC) is pursuing novel technology solutions to address PW issues that complement or improve ad-hoc practices adopted by operators. In this paper, we observe that well-established market management practices used in electrical power generation have natural analogues in the PW supply chain. These parallels open up a new line of research where we view PW management as a market equilibrium problem, and explore solutions that foster active and data-based collaboration among operators through market structures similar to power markets, with the ultimate objective of improving PW management costs and recycling rates. Here, we make a case for our observations, present a PW market clearing optimization model that shows how such a market system could operate in the O&G space, and provide an illustrative case study for demonstration.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Photovoltaic and Cost Analysis for Winston-Salem, North Carolina

This study assesses the feasibility of solar installations at various sites in Winston-Salem, focusing on factors such as solar resource availability, electricity costs, and rooftop area for photovoltaic systems. The analysis begins by estimating daily energy requirements based on annual electricity use, followed by adjusting for seasonal and operational fluctuations. Using regional solar data from the National Solar Radiation Database (NSRDB), we calculate average peak sun hours to determine effective system sizing. A parametric approach using the System Advisor Model (SAM) refines this sizing process, incorporating a safety margin of 1.2 to address demand peaks. Each PV system is designed to fit available rooftop space, and a coverage threshold of 70% is identified as optimal for maximizing cost savings and sustainability. This threshold allows installations to meet substantial energy demands, supporting energy resilience and enhancing economic returns.

14 SOLAR ENERGY↗

DOE OSTI2019

Rethinking HVAC temperature setpoints in commercial buildings: The potential for zero-cost energy savings and comfort improvement in different climates, Building and Environment

Heating, Ventilation, and Air Conditioning (HVAC) systems are responsible for a significant share of the energy consumed in commercial buildings. While energy system retrofits have been found to reduce buildings' carbon footprint substantially, these measures are often hindered by financial, regulatory or design constraints. Recent research sheds light on energy management approaches to energy conservation such as energy-efficient settings of HVAC temperature setpoints. While existing case studies confirm the significant energy saving potential of efficient HVAC operation, there is scarcity of studies quantifying energy savings from optimal HVAC temperature setpoints comprehensively, while controlling for important factors, such as guaranteeing tenant thermal comfort levels and the impact of different climate conditions on the results. In this work, we apply simulation-based multi-objective optimization to fine-tune heating and cooling setpoints of large “typical” office buildings with respect to energy consumption and occupant thermal comfort. We apply the framework in seven climate zones across the US in an effort to examine spatial variations in the energy savings potential due to different climate conditions and propose targeted energy-saving strategies and policies. We show that locations with mild climates, such as San Francisco, CA, can realize up to 60% of annual HVAC-related energy savings without compromising the occupants' thermal comfort. This untapped potential to simultaneously improve building performance and occupants’ comfort drives the discussion on revisiting HVAC setpoint configuration standards in commercial buildings, either as part of individual building retrofit planning or as part of energy policy regulations.

Papadopoulos, Sokratis↗