Search NASA⌕ Search

SEARCH · Search NASA

Results for “policy framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems: Preprint

We present the PowerGridworld software package to provide users with a light-weight, modular, and customizable framework for creating power systems-focused, multi-agent gym environments that readily integrate with existing training frameworks for reinforcement learning (RL). While many frameworks exist for training multi-agent (MA) RL policies, none exist to rapidly prototype and develop the environments themselves, especially in the context of heterogeneous (composite, multi-device) power systems where power flow solutions are required to define grid-level variables and costs. PowerGridworld is an open-source software package that helps to fill this gap. To highlight PowerGridworld's key features, we present two case studies and demonstrate learning multi-agent RL policies using both OpenAI's MADDPG and RLLib's PPO algorithms where, in both cases, at least some subset of agents incorporate elements of the power flow solution at each time step as part of their reward (negative cost) structures.

MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Novel LDPP-MADDPG Approach for Distributed Power Allocation in mmWave Cellular Networks

This paper considers the problem of distributed beam scheduling and power allocation problem in millimeter- Wave (mmWave) cellular networks, in which multiple Base Stations (BSs) operate as individual operators over a shared spectrum. We propose a novel learning-aided approach that integrates the Lyapunov Drift-Plus-Penalty (LDPP) framework and Multi-agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithms. This offers a powerful approach to learning stable and constraint-aware policies, reaping the joint benefit of both LDPP and MADDPG, in complex multiagent environments. The major challenge for this approach is to integrate these two approaches in a meaningful and effective manner. The key idea to solve this problem is to introduce a novel feature of local observation that incorporates potential negative value of the reward function due to the stochastic constraints introduced by the LDPP framework. Empirical results demonstrate that our proposed scheme outperforms the baseline methods under various conditions.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗
NASA NTRS2012

Communicating the Needs of Climate Change Policy Makers to Scientists

This chapter will describe the challenges that earth scientists face in developing science data products relevant to decision maker and policy needs, and will describe strategies that can improve the two-way communication between the scientist and the policy maker. Climate change policy and decision making happens at a variety of scales - from local government implementing solar homes policies to international negotiations through the United Nations Framework Convention on Climate Change. Scientists can work to provide data at these different scales, but if they are not aware of the needs of decision makers or understand what challenges the policy maker is facing, they are likely to be less successful in influencing policy makers as they wished. This is because the science questions they are addressing may be compelling, but not relevant to the challenges that are at the forefront of policy concerns. In this chapter we examine case studies of science-policy partnerships, and the strategies each partnership uses to engage the scientist at a variety of scales. We examine three case studies: the global Carbon Monitoring System pilot project developed by NASA, a forest biomass mapping effort for Silvacarbon project, and a forest canopy cover project being conducted for forest management in Maryland. In each of these case studies, relationships between scientists and policy makers were critical for ensuring the focus of the science as well as the success of the decision-making.

Brown, Molly E.↗
DOE OSTI2024

Multi-agent voltage control in distribution systems using GAN-DRL-based approach

Active distribution grids can experience voltage fluctuations and violations due to the high penetration of variable distributed energy resources (DERs). These problems might occur because of the uncertain and variable generation natures of these resources, especially solar photovoltaic resources, during panel shadowing scenarios. Volt-VAR control (VVC) is an efficient method that controls the reactive power set-points of the inverters to regulate the voltage of distribution grids. Although several VVC approaches have been proposed recently, the performance of these approaches degrades significantly if behind-the-meter solar generation data are unobservable/missing. Therefore, it is necessary to impute missing/unobservable PV data accurately to be utilized in VVC approaches. Further, this paper proposes a model-free, data-driven, centrally trained, and decentrally executed multi-agent deep reinforcement learning-based VVC architecture to regulate the voltage of distribution networks. A generative adversarial network (GAN) is incorporated to impute the unobservable PV data accurately, which improves the performance of the proposed control architecture. The proposed multi-agent-soft-actor–critic algorithm (MASAC)-based VVC technique utilizes the actual PV dataset as well as the imputed dataset from the GAN framework to learn the optimal coordinated control policy for controlling the optimal reactive power set-points of PV inverters. The effectiveness of the proposed approach is analyzed on a modified IEEE 34-bus test case with added PV inverters. The results are compared and analyzed with a base case model with no VVC and VVC with a local droop control approach, genetic algorithm optimization, and a centralized soft actor–critic-based approach. Moreover, the performance of the proposed approach is compared with that of a multi-agent VVC framework without using the PV generation data and load information as the system state. The results illustrate that the proposed method with more state input improves the voltage profile and reduces the power loss of the network across various loading and PV generation scenarios.

14 SOLAR ENERGY↗
NASA NTRS2014

Agent Based Modeling of Air Carrier Behavior for Evaluation of Technology Equipage and Adoption

As part of ongoing research, the National Aeronautics and Space Administration (NASA) and LMI developed a research framework to assist policymakers in identifying impacts on the U.S. air transportation system (ATS) of potential policies and technology related to the implementation of the Next Generation Air Transportation System (NextGen). This framework, called the Air Transportation System Evolutionary Simulation (ATS-EVOS), integrates multiple models into a single process flow to best simulate responses by U.S. commercial airlines and other ATS stakeholders to NextGen-related policies, and in turn, how those responses impact the ATS. Development of this framework required NASA and LMI to create an agent-based model of airline and passenger behavior. This Airline Evolutionary Simulation (AIRLINE-EVOS) models airline decisions about tactical airfare and schedule adjustments, and strategic decisions related to fleet assignments, market prices, and equipage. AIRLINE-EVOS models its own heterogeneous population of passenger agents that interact with airlines; this interaction allows the model to simulate the cycle of action-reaction as airlines compete with each other and engage passengers. We validated a baseline configuration of AIRLINE-EVOS against Airline Origin and Destination Survey (DB1B) data and subject matter expert opinion, and we verified the ATS-EVOS framework and agent behavior logic through scenario-based experiments. These experiments demonstrated AIRLINE-EVOS's capabilities in responding to an input price shock in fuel prices, and to equipage challenges in a series of analyses based on potential incentive policies for best equipped best served, optimal-wind routing, and traffic management initiative exemption concepts..

Horio, Brant M.↗
DOE OSTI2024

Building a Clean Energy Workforce: An Evaluation Framework for State Energy Office Workforce Programs

This fact sheet is a summary of the workforce evaluation framework that was first proposed in the white paper, An Evaluation Framework for State Energy Offices' Energy Efficiency and Clean Energy Workforce Program. This evaluation framework was developed to guide State Energy Offices (SEOs) in assessing and enhancing the workforce development programs the manage, fund, or partner on. By following this step-by-step framework, SEOs can evaluate program components, identify areas for improvement, and optimize program outcomes for greater impact.

clean energy↗
DOE OSTI2024

A Strategic Condition Framework for Energy Innovation

Building upon previous work in innovation, technology, and economic fields, we propose a conceptual framework to address the interplay dynamics of public policy and the value chains of clean energy technology innovation systems, by focusing on market structural and strategic conditions in relation to the rate and direction of knowledge diffusion within activity-based value chains. Our framework extends beyond socio-technical transition models by considering such nuances as: 1) the implications of geography, 2) the locus of knowledge types, 3) the dynamics of financial and knowledge flow, and 4) emphasizing the importance of both market structure and institutional conditions. At the firm level, we consider dynamics of interactions between suppliers and customers, innovation activities, the competitive environment, and the firm’s broader strategic relationship to governance activities and structures; we allow for the fact that each of these aspects of a firm’s identity may have a strategically relevant geographic dimension (e.g., service territories, locational concentration of input resources, etc.). We provide a proof-of-concept application of the U.S. utility-scale solar photovoltaic (PV) and onshore wind sectors, including their interactions with the U.S. power market, which we in present in a web-based information platform (Energy I-SPARK, ei-spark.lbl.gov).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

A data-driven operational model for traffic at the Dallas Fort Worth International Airport

Airports are on the front line of significant innovations, allowing the movement of more people and goods faster, cheaper, and with greater convenience. As air travel continues to grow, airports will face challenges in responding to increasing passenger vehicle traffic, which leads to lower operational efficiency, poor air quality, and security concerns. This paper evaluates methods for traffic demand forecasting combined with traffic microsimulation, which will allow airport operations staff to accurately predict traffic and congestion. Using two years of detailed data describing individual vehicle arrivals and departures, aircraft movements, and weather at Dallas-Fort Worth (DFW) International Airport, we evaluate multiple prediction methods including the Auto Regressive Integrated Moving Average (ARIMA) family of models, traditional machine learning models, and DeepAR, a modern recurrent neural network (RNN). We find that these algorithms are able to capture the diurnal trends in the surface traffic, and all do very well when predicting the next 30 minutes of demand. Longer forecast horizons are moderately effective, demonstrating the challenge of this problem and highlighting promising techniques as well as potential areas for improvement. Traffic demand is not the only factor that contributes to terminal congestion, because temporary changes to the road network, such as a lane closure, can make benign traffic demand highly congested. Combining a demand forecast with a traffic microsimulation framework provides a complete picture of traffic and its consequences. The result is an operational intelligence platform for exploring policy changes, as well as infrastructure expansion and disruption scenarios. To demonstrate the value of this approach, we present results from a case study at DFW Airport assessing the impact of a policy change for vehicle routing in high demand scenarios. This framework can assist airports like DFW as they tackle daily operational challenges, as well as explore the integration of emerging technology and expansion of their services into long term plans.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Policy Reforms to Unleash Domestic Critical Minerals Mining and Processing

The United States faces growing strategic and economic risks due to its limited ability to mine, process, and refine the minerals required for national defense, energy systems, advanced manufacturing, and emerging technologies. Although the country possesses significant geological resources, development has been slowed by long and unpredictable permitting timelines, fragmented regulatory responsibilities, limited midstream processing capacity, and a shrinking technical workforce. These structural barriers have created supply chain vulnerabilities that constrain industrial growth and reduce national resilience. This report presents a comprehensive set of reforms intended to modernize the nation’s approach to critical minerals. The recommendations address federal permitting, environmental review processes, the legal framework governing mining activities, interagency coordination, domestic processing and refining capacity, and the education and workforce systems needed to support long term industry development. The analysis emphasizes practical steps to shorten project timelines, improve regulatory clarity, expand processing infrastructure, enable recovery from both conventional and nontraditional sources, and update outdated requirements that hinder the development of essential materials. Taken together, the recommended reforms would strengthen domestic supply chains, improve investment certainty, and reduce dependence on external minerals and processing infrastructure. By aligning policy, regulatory frameworks, and workforce capabilities with national needs, the United States can build a more resilient and secure critical minerals ecosystem that supports long term economic competitiveness and technological leadership.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

The Colorado East River Community Observatory Data Collection

Abstract The U.S. Department of Energy's (DOE) Colorado East River Community Observatory (ER) in the Upper Colorado River Basin was established in 2015 as a representative mountainous, snow‐dominated watershed to study hydrobiogeochemical responses to hydrological perturbations in headwater systems. The ER is characterized by steep elevation, geologic, hydrologic and vegetation gradients along floodplain, montane, subalpine, and alpine life zones, which makes it an ideal location for researchers to understand how different mountain subsystems contribute to overall watershed behaviour. The ER has both long‐term and spatially‐extensive observations and experimental campaigns carried out by the Watershed Function Scientific Focus Area (SFA), led by Lawrence Berkeley National Laboratory, and researchers from over 30 organizations who conduct cross‐disciplinary process‐based investigations and modelling of watershed behaviour. The heterogeneous data generated at the ER include hydrological, genomic, biogeochemical, climate, vegetation, geological, and remote sensing data, which combined with model inputs and outputs comprise a collection of datasets and value‐added products within a mountainous watershed that span multiple spatiotemporal scales, compartments, and life zones. Within 5 years of collection, these datasets have revealed insights into numerous aspects of watershed function such as factors influencing snow accumulation and melt timing, water balance partitioning, and impacts of floodplain biogeochemistry and hillslope ecohydrology on riverine geochemical exports. Data generated by the SFA are managed and curated through its Data Management Framework. The SFA has an open data policy, and over 70 ER datasets are publicly available through relevant data repositories. A public interactive map of data collection sites run by the SFA is available to inform the broader community about SFA field activities. Here, we describe the ER and the SFA measurement network, present the public data collection generated by the SFA and partner institutions, and highlight the value of collecting multidisciplinary multiscale measurements in representative catchment observatories.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Deep Reinforcement Learning From Demonstrations to Assist Service Restoration in Islanded Microgrids

Microgrids can be operated in island mode during utility grid outages to support service restoration and improve system resilience. To schedule and dispatch distributed energy resources (DERs) in an islanded microgrid, conventional model-based methods rely on accurate distribution network models and lack generalization and adaptability. Data-driven methods are promising for DER coordination but face practical challenges such as potential hazards to microgrids during online training and insufficient online training opportunities due to low outage rates. This paper presents a novel two-stage learning framework that builds on the deep deterministic policy gradient from demonstrations to identify an optimal restoration strategy. At the pre-training stage, imitation learning is applied to equip the control agent with expert experiences to guarantee acceptable initial performance. At the online training stage, action clipping, reward shaping, and expert demonstrations are leveraged to ensure safe exploration while accelerating the training process. In conclusion, the proposed method is illustrated using the IEEE 123-node system and compared with a representative model-based method and the standard deep deterministic policy gradient method to prove solution accuracy and demonstrate increased computational efficiency.

Du, Yan↗
NASA NTRS2007

NASA Hypersonic Propulsion: Overview of Progress from 1995 to 2005

Hypersonic propulsion work supported by the United States National Aeronautics and Space Administration had a primary focus on Space Transportation during the period from 1995 to 2005. The framework for these advances was established by policy and pursued with substantial funding. Many noteworthy advances were made, highlighted by the pinnacle flights of the X-43. This paper reviews and summarizes the programs and accomplishments of this era. The accomplishments are compared to the goals and objectives to lend an overarching perspective to what was achieved. At least dating back to the early days of the Space Shuttle program, NASA has had the objective of reducing the cost of access to space and concurrently improving safety and reliability. National Space Transportation Policy in 1994 coupled with a base of prior programs such as the National Aerospace Plane and the need to look beyond the Space Shuttle program set the stage for NASA to pursue Space Transportation Advances. Programs defined to pursue the advances represented a broad approach addressing classical rocket propulsion as well as airbreathing propulsion in various combinations and forms. The resulting portfolio of activities included systems analysis and design studies, discipline research and technology, component technology development, propulsion system ground test demonstration and flight demonstration. The types of propulsion systems that were pursued by these programs included classical rocket engines, "aerospike" rocket engines, high performance rocket engines, scram jets, rocket based combined cycles, and turbine based combined cycles. Vehicle architectures included single and two stage vehicles. Either single types of propulsion systems or combinations of the basic propulsion types were applied to both single and two stage vehicle design concepts. Some of the propulsion system design concepts were built and tested at full scale, large scale and small scale. Many flight demonstrators were conceptually defined, fewer designed and some built and one flown to demonstrate several technical advancements including propulsion. The X-43 flights were a culmination of these efforts for airbreathing propulsion. During the course of that period, there was a balance of funding and emphasis toward rocket propulsion but still very substantial airbreathing propulsion effort. The broad objectives of these programs were to both advance and test the state of the art so as to provide a basis for options to be pursued for broad space transportation needs, most importantly focused on crew carrying capability. NASA cooperated with the Department of Defense in planning and implementation of these programs to make efficient use of objectives and capabilities where appropriate. Much of the work was conducted in industry and academia as well as Government laboratories. Many test articles and data-bases now exist as a result of this work. At the conclusion of the period, the body of work made it clear that continued research and technology development was warranted, because although not ready for a NASA system development decision, results continued to support the promise of air-breathing propulsion for access to space.

Cikanek, Harry A., III↗
NASA NTRS2011

Observation of Hydrological Processes Using Remote Sensing: Volume 2: The Science of Hydrology - Chapter 2.14

Improving water management can make a significant contribution to achieving most of the Millennium Development Goals established by the UN General Assembly in 2000, especially those related to poverty, hunger, and major diseases. The World Summit on Sustainable Development (WSSD) in 2002 recognized this need. Water and sanitation in particular received great attention from the Summit. The Johannesburg Plan of Implementation recommended to improve water resources management and scientific understanding of the water cycle through joint cooperation and research. For this purpose, it is recommended to promote knowledge sharing, provide capacity building, and facilitate the transfer of technology including remote-sensing (RS) and satellite technologies, especially to developing countries and countries with economies in transition, and to support these countries in their efforts to monitor and assess the quantity and quality of water resources, for example, by establishing and/or further developing national monitoring networks and water resources databases and by developing relevant national indicators. The Johannesburg Plan also adopted integrated water resources management as the overarching concept in addressing and solving water-related issues. As a result of the commitments made in the Johannesburg Plan of Implementation, several global and regional initiatives have emerged. Current international initiatives such as the Global Monitoring for Environment and Security (GMES) program of the European Commission and the European Space Agency (ESA), and the Global Earth Observation System of Systems (GEOSS) 10-Year Implementation Plan, have all identified Earth observation (EO) of the water cycle as the key in helping to solve the world s water problems. The availability of spatial information on water quantity and quality will also enable closure of the water budget at river basin and continental scales to the point where effective water management is essential (e.g., as requested by the European Union s Water Framework Directive (WFD), as well as national policies). Geo-information science and EO are vital in achieving a better understanding of the water cycle and better monitoring, analysis, prediction, and management of the world s water resources. The major components of the water cycle of the Earth system and their possible observations are presented. Such observations are essential to understand the global water cycle and its variability, both spatially and temporally, and can only be achieved consistently by means of EOs. Additionally, such observations are essential to advance our understanding of coupling between the terrestrial, atmospheric, and oceanic branches of the water cycle, and how this coupling may influence climate variability and predictability. Water resources management directly interferes with the natural water cycle in the forms of building dams, reservoirs, water transfer systems, and irrigation systems that divert and redistribute part of the water storages and fluxes on land. The water cycle is mainly driven and coupled to the energy cycle in terms of phase changes of water (changes among liquid, water vapor, and solid phases) and transport of water by winds in addition to gravity and diffusion processes. The water-cycle components can be observed with in situ sensors as well as airborne and satellite sensors in terms of radiative quantities. Processing and conversion of these radiative signals are necessary to retrieve the water-cycle components.

Wilder, Peter↗
DOE OSTI2021

Relative Cost-Effectiveness of Electricity and Transportation Policies as a Means to Reduce CO2 Emissions in the United States: A Multi-Model Assessment

Two common energy policy instruments in the United States are tax incentives and technology standards. Although these instruments have been shown to be less cost-effective as a means to reduce CO2 emissions than direct emissions pricing mechanisms, it can be challenging to compare the CO2 emissions reduction costs of such policies across sectors, given the wide range in estimates for any given policy and inconsistencies in how such estimates are constructed across studies. This study addresses this analytical gap by simultaneously comparing the cost-effectiveness of policies across the electricity and transportation sectors using three publicly available US energy system models (EM-NEMS, ReEDS, and GCAM-USA). Four policies are explicitly compared: wind and solar tax credits, a renewable portfolio standard (RPS), a renewable fuel standard (RFS), and an electric vehicle (EV) tax credit. An economy-wide carbon tax is used as a benchmark for cost-effectiveness. Results from this study confirm prior insights about the cost-effectiveness of economy-wide carbon pricing relative to sectoral instruments but also reveal several novel insights about particular sectoral policies. Specifically, this study finds that (1) current electricity tax incentives provide uneven support for wind and solar technologies, (2) despite known inefficiencies, renewable energy policies in the electricity sector are less expensive than earlier estimates due to technology advancement and changes in market conditions, (3) within transportation, an expanded RFS with increasing advanced biofuel targets is more cost-effective than an EV tax credit extension under plausible assumptions, (4) EV incentives lead to a rebound in conventional vehicle fuel economy that further erodes cost-effectiveness, and (5) the change in policy costs over time is not known a priori, but the relative cost ordering among these policies does not depend on the timeframe of analysis. These results are largely robust to the underlying modeling framework, increasing the confidence with which they can be applied to climate policy evaluation.

economics↗
DOE OSTI2025

NARUC Resilience Framework

The NARUC Resilience Framework provides state regulators and other key stakeholders with a structured approach to considering policies and programs that will enhance grid resilience amid evolving technological, environmental and economic challenges. This Framework consolidates insights from nationwide workshops and peer discussions into six actionable components: (1) setting goals and objectives, (2) leveraging use cases, (3) establishing shared definitions, (4) ensuring inclusive process leadership, (5) addressing critical design questions, and (6) guiding implementation. This Framework is intended as a strategic tool for regulators to navigate resilience investments, prioritize affordability, integrate stakeholder needs, and foster collaboration across agencies, all while balancing cost-effectiveness with societal and economic resilience outcomes. By presenting a structured approach to decision-making rather than prescriptive solutions, the Framework supports nuanced, jurisdiction-specific resilience planning and is adaptable to the dynamic demands of modern energy systems

24 POWER TRANSMISSION AND DISTRIBUTION↗