SEARCH · Search NASA

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

LandScan mosaic enables high-resolution gridded population estimates with explicit uncertainty

Gridded population datasets represent high-resolution distributions of human occupancy, enabling informed decision-making across a broad range of fields. These data products are valuable for assessing environmental risk, urban development, disaster preparedness and resource allocation—areas where accurate population estimates directly enhance policy effectiveness and optimize resource distribution. Despite the importance of gridded population datasets, traditional population modeling approaches often overlook inherent uncertainties in the estimation process. This limitation can create a false sense of certainty in population estimates, potentially leading to flawed decisions by those who rely on the data. To address this methodological gap, we introduce a probabilistic machine learning modeling framework, LandScan Mosaic, that explicitly incorporates uncertainty into the population modeling process. Our approach systematically quantifies uncertainty in three key modeling parameters of the LandScan HD gridded population dataset: building use types, floor counts, and occupancy rates. By employing Monte Carlo simulations, we propagate these uncertainties through the modeling process, yielding probability distributions of population counts in place of deterministic point estimates. We demonstrate the practical application of this framework in Iloilo City, Philippines, using structured decision-making techniques and our probabilistic estimates to identify and prioritize areas most affected by projected flooding, supporting targeted interventions that address both economic and social risks. In doing so, we propose a population-specific approach for incorporating confidence into structured decision making processes. Through a comparative analysis with conventional deterministic approaches and point estimate approaches, including LandScan HD and WorldPop, we evaluate how the incorporation of machine learning and uncertainty influences decision rankings. This research advances population distribution modeling by offering a robust, quantitative approach that explicitly accounts for uncertainty in the underlying data, along with guidance for how users can apply uncertainty in their decision-making.

Environmental sciences↗

NASA NTRS1990

Optimal dynamic remapping of data parallel computations

A large class of data parallel computations is characterized by a sequence of phases, with phase changes occurring unpredictably. Dynamic remapping of the workload to processors may be required to maintain good performance. The problem considered, for which the utility of remapping and the future behavior of the workload are uncertain, arises when phases exhibit stable execution requirements during a given phase, but requirements change radically between phases. For these situations, a workload assignment generated for one phase may hinder performance during the next phase. This problem is treated formally for a probabilistic model of computation with at most two phases. The authors address the fundamental problem of balancing the expected remapping performance gain against the delay cost, and they derive the optimal remapping decision policy. The promise of the approach is shown by application to multiprocessor implementations of an adaptive gridding fluid dynamics program and to a battlefield simulation program.

Nicol, David M.↗

NASA NTRS2000

Empirical Evaluation of Local Search Methods for Adapting Planning Policies in a Stochastic Environment

Optimization of expected values in a stochastic domain is common in real world applications.

Stochastic Environment Empirical Evaluation Local ↗

NASA NTRS1983

Control of a heterogeneous two-server exponential queueing system

A dynamic control policy known as 'threshold queueing' is defined for scheduling customers from a Poisson source on a set of two exponential servers with dissimilar service rates. The slower server is invoked in response to instantaneous system loading as measured by the length of the queue of waiting customers. In a threshold queueing policy, a specific queue length is identified as a 'threshold,' beyond which the slower server is invoked. The slower server remains busy until it completes service on a customer and the queue length is less than its invocation threshold. Markov chain analysis is employed to analyze the performance of the threshold queueing policy and to develop optimality criteria. It is shown that probabilistic control is suboptimal to minimize the mean number of customers in the system. An approximation to the optimum policy is analyzed which is computationally simple and suffices for most operational applications.

Larsen, R. L.↗

DOE OSTI2025

Reimagining Energy Efficiency Resource Standards

Energy Efficiency Resource Standards (EERS) are a long-standing policy used to advance state goals and priorities, such as reliability, affordability and decarbonization. They ensure cost-effective energy efficiency is used to lower energy consumption, reduce peak demand, and enable grid flexibility. Adapting EERS through strategic design, and integrating EERS into broader energy plans and policies, can help states optimize their approach to meet modern and evolving power system needs and achieve sustainable energy outcomes. This report examines how states consider energy efficiency in the context of four policy priorities: providing grid benefits, addressing load growth, reducing emissions, and promoting affordability. It provides examples of states that are pursuing these priorities, reviews the role of energy efficiency in them and identifies opportunities to further promote energy efficiency alongside the priorities. Decisionmakers and stakeholders can draw directly from these examples and findings to design an EERS that maximizes co-benefits, captures synergies, and promotes consideration of the all the possible solutions to advance their goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS2003

Route Monopolie and Optimal Nonlinear Pricing

To cope with air traffic growth and congested airports, two solutions are apparent on the supply side: 1) use larger aircraft in the hub and spoke system; or 2) develop new routes through secondary airports. An enlarged route system through secondary airports may increase the proportion of route monopolies in the air transport market.The monopoly optimal non linear pricing policy is well known in the case of one dimension (one instrument, one characteristic) but not in the case of several dimensions. This paper explores the robustness of the one dimensional screening model with respect to increasing the number of instruments and the number of characteristics. The objective of this paper is then to link and fill the gap in both literatures. One of the merits of the screening model has been to show that a great varieD" of economic questions (non linear pricing, product line choice, auction design, income taxation, regulation...) could be handled within the same framework.VCe study a case of non linear pricing (2 instruments (2 routes on which the airline pro_ddes customers with services), 2 characteristics (demand of services on these routes) and two values per characteristic (low and high demand of services on these routes)) and we show that none of the conclusions of the one dimensional analysis remain valid. In particular, upward incentive compatibility constraint may be binding at the optimum. As a consequence, they may be distortion at the top of the distribution. In addition to this, we show that the optimal solution often requires a kind of form of bundling, we explain explicitly distortions and show that it is sometimes optimal for the monopolist to only produce one good (instead of two) or to exclude some buyers from the market. Actually, this means that the monopolist cannot fully apply his monopoly power and is better off selling both goods independently.We then define all the possible solutions in the case of a quadratic cost function for a uniform distribution of agent types and explain the implications for airlines in terms of service differentiation.

Tournut, Jacques↗

NASA NTRS2008

Problems With Deployment of Multi-Domained, Multi-Homed Mobile Networks

This document describes numerous problems associated with deployment of multi-homed mobile platforms consisting of multiple networks and traversing large geographical areas. The purpose of this document is to provide insight to real-world deployment issues and provide information to groups that are addressing many issues related to multi-homing, policy-base routing, route optimization and mobile security - particularly those groups within the Internet Engineering Task Force.

Ivancic, William D.↗

DOE OSTI2024

A tri-level optimization model for interdependent infrastructure network resilience against compound hazard events

Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel policy-guided tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks – encompassing one realistic network; one fictitious, yet realistic network; as well as networks drawn from three synthetic distributions. Mathematically, our approach takes the form of a defender-attacker-defender (DAD) model—a multi-agent tri-level optimization, comprised of a defender, attacker, and an operator acting in sequence. Here, in this study, our notional operator may choose proxy actions to operate an interdependent system comprised of fuel terminals and gas stations (functioning as supplies) and a transportation network with traffic flow (functioning as demand) to minimize unmet demand at gas stations. A notional attacker aims to hypothetically disrupt normal operations by reducing supply at the supply terminals, and the notional defender aims to identify best proxy defense policy options which include hardening supply terminals or allowing alternative distribution methods such as trucking reserve supplies. We solve our DAD formulation at a metropolitan scale and present practical defense policy insights against hypothetical compound hazards. We demonstrate the generalizability of our framework by presenting results for a realistic network; a fictitious, yet realistic network; as well as for three networks drawn from synthetic distributions. Additionally, we demonstrate the scalability of the framework by investigating runtime performance as a function of the network size. Steps for future research are also discussed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS1981

Spacecraft computer resource margin management

The conduction of the Project Galileo Orbiter, with 18 microcomputers and the equivalent of 360K 8-bit bytes of memory contained within two major engineering subsystems and eight science instruments, requires that the key onboard computer system resources be managed in a very rigorous manner. Attention is given to the rationale behind the project policy, the development stage, the preliminary design stage, the design/implementation stage, and the optimization or 'scrubbing' stage. The implementation of the policy is discussed, taking into account the development of the Attitude and Articulation Control Subsystem (AACS) and the Command and Data Subsystem (CDS), the reporting of margin status, and the response to allocation oversubscription.

Larman, B. T.↗

DOE OSTI2026

A transfer learning approach to energy-efficient control of small and medium-sized commercial buildings

Model-free reinforcement learning (RL) provides a data-driven and adaptive approach to optimize building energy use while satisfying occupant comfort. This powerful tool does not need any prior knowledge about the environment and system it is optimizing and can adapt its policy based on the changes in captures. Like any other data-driven tool, it faces high training costs due to the extensive agent-environment interactions required to capture long-term building dynamics and user comfort. Transfer learning, particularly policy distillation, offers a promising way to accelerate training by leveraging pretrained RL agents in different building and system types. Here, this study investigates online student distillation, in which the student model updates its neural network weights using outputs from teacher models. The work introduces a student distillation strategy designed for efficient knowledge transfer, along with a teacher selection method that ensures high-quality guidance. The approach is validated using a highly calibrated whole building energy model for a small/medium commercial building test facility. Results show substantial reductions in training time and data requirements while surpassing the performance of ASHRAE Guideline 36, an advanced rule-based control strategy. The distilled RL model required 45% less data and achieved 20% higher cumulative rewards than a state-of-the-art RL model, with faster convergence and lower energy consumption. These outcomes demonstrate that effective transfer learning enables a scalable and data-efficient energy management solution for commercial buildings.

ASHRAE guideline 36↗

NASA NTRS2022

Scheduling For Urban Air Mobility Using Safe Learning

This work considers the scheduling problem for Urban Air Mobility (UAM) vehicles travelling between origin-destination pairs with both hard and soft trip deadlines. Each route is described by a discrete probability distribution over trip completion times (or delay) and over interarrival times of requests (or demand) for the route along with a fixed hard or soft deadline. Soft deadlines carry a cost that is incurred when the deadline is missed. An online, safe scheduler is developed that ensures that hard deadlines are never missed and that average cost of missing soft deadlines is minimized. The system is modelled as a Markov Decision Process (MDP) and safe model based learning is used to find the probabilistic distributions over route delays and demand. Monte Carlo Tree Search (MCTS) Earliest Deadline First (EDF) is used to safely explore the learned models in an online fashion and develop a near-optimal non-preemptive scheduling policy. These results are compared with Value Iteration (VI) and MCTS (Random) scheduling solutions.

Urban Air Mobility↗

NASA NTRSDate not supplied

Scheduling for Urban Air Mobility using Safe Learning

Urban Air Mobility↗

DOE OSTI2025

Designing robust energy policy packages under deep uncertainty: A multi-metric decision support framework

The complexity of transitioning to sustainable energy systems requires policy frameworks capable of balancing multiple objectives while addressing deep uncertainty. However, existing approaches often lack systematic methods to identify combinations of policy levers that remain effective across a wide range of uncertain futures. This paper presents a novel decision support framework that guides the selection of robust policy packages based on their performance across multiple objectives under uncertainty. Our method leverages a large ensemble of scenarios and applies scenario discovery techniques to identify influential policy levers. Here, we introduce new indicators to assess the robustness of policies by evaluating their ability to mitigate adverse outcomes across metrics. These indicators support an iterative process to build a robust policy package. Finally, we map the technological and energy pathways associated with the robust policy package by leveraging an energy system optimization model. We illustrate the application of this framework to the Spanish energy system, providing insights into how specific combinations of policy levers shape decarbonization pathways under uncertainty.

Decision-support method↗

DOE OSTI2025

Valued peaks: Sustainable water allocation for small hydropower plants in an era of explicit ecological needs

Optimizing hydropower operations to balance economic profitability and support functioning ecosystem services is integral to river management policy. In this article, we propose a dynamic, constrained optimization framework for small hydropower plants (SHPs) to evaluate trade-offs between economic profitability and socio-ecological requirements. Specifically, we examine the balance between short-term losses in hydropower generation and the potential for compensatory benefits in the form of revenue from recreational ecosystem services, irrespective of the direct beneficiary. Our framework integrates a fish habitat model, a hydropower optimization model, and a recreational ecosystem service estimate to evaluate different environmental flow scenarios. The optimization process gives three outflow release scenarios, informed by previous streamflow realisations (dam inflow), and designed environmental flow constraints. The framework is applied and tested for the river Kuusinkijoki in North-eastern Finland, which is a habitat for migratory brown trout and grayling populations. We show that the revenue loss due to the environmental flow constraints arises through a reduction in revenue per generated energy unit and through a reduction in turbine efficiency. Additionally, the simulation results reveal that all the designed environmental flow constraints cannot be met simultaneously. Under the environmental flow scenario with both minimum flow and flow ramping rate constraints, the annual hydropower revenue decreases by 16.5 %. An annual increase of 8 % in recreational fishing visits offsets the revenue loss. In conclusion, the developed framework provides knowledge of the costs and benefits of hydropower environmental flow constraints and guides the prioritizing process of environmental measures.

13 HYDRO ENERGY↗

NASA NTRS2005

Cognitive Functioning in Space Exploration Missions: A Human Requirement

Solving cognitive issues in the exploration missions will require implementing results from both Human Behavior and Performance, and Space Human Factors Engineering. Operational and research cognitive requirements need to reflect a coordinated management approach with appropriate oversight and guidance from NASA headquarters. First, this paper will discuss one proposed management method that would combine the resources of Space Medicine and Space Human Factors Engineering at JSC, other NASA agencies, the National Space Biomedical Research Institute, Wyle Labs, and other academic or industrial partners. The proposed management is based on a Human Centered Design that advocates full acceptance of the human as a system equal to other systems. Like other systems, the human is a system with many subsystems, each of which has strengths and limitations. Second, this paper will suggest ways to inform exploration policy about what is needed for optimal cognitive functioning of the astronaut crew, as well as requirements to ensure necessary assessment and intervention strategies for the human system if human limitations are reached. Assessment strategies will include clinical evaluation and fitness-to-perform evaluations. Clinical intervention tools and procedures will be available to the astronaut and space flight physician. Cognitive performance will be supported through systematic function allocation, task design, training, and scheduling. Human factors requirements and guidelines will lead to well-designed information displays and retrieval systems that reduce crew time and errors. Means of capturing process, design, and operational requirements to ensure crew performance will be discussed. Third, this paper will describe the current plan of action, and future challenges to be resolved before a lunar or Mars expedition. The presentation will include a proposed management plan for research, involvement of various organizations, and a timetable of deliverables.

Fiedler, Edan↗

NASA NTRS2013

It's the Heat AND the Humidity -- Assessment of Extreme Heat Scenarios to Enable the Assessment of Climate Impacts on Public Health

In the United States, extreme heat is the most deadly weather-related hazard. In the face of a warming climate and urbanization, which contributes to local-scale urban heat islands, it is very likely that extreme heat events (EHEs) will become more common and more severe in the U.S. In a NASA-funded project supporting the National Climate Assessment, we are providing historical and future measures of extreme heat to enable assessments of the impacts of heat on public health over the coterminous U.S. We use atmospheric temperature and humidity information from meteorological reanalysis and from Global Climate Models (GCMs) to provide data on past and future heat events. The project s emphasis is on providing assessments of the magnitude, frequency and geographic distribution of extreme heat in the U.S. to facilitate public health studies. In our approach, long-term climate change is captured with GCM output, and the temporal and spatial characteristics of short-term extremes are represented by the reanalysis data. Two future time horizons, 2040 and 2090, are the focus of future assessments; these are compared to the recent past period of 1981-2000. We are characterizing regional-scale temperature and humidity conditions using GCM output for two climate change scenarios (A2 and A1B) defined in the Special Report on Emissions Scenarios (SRES). For each future period, 20 years of multi-model GCM output have been analyzed to develop a heat stress climatology based on statistics of extreme heat indicators. Differences between the two future and past periods have been used to define temperature and humidity changes on a monthly time scale and regional spatial scale. These changes, combined with hourly historical meteorological data at a spatial scale (12 km) much finer than that of GCMs, enable us to create future climate realizations, from which we compute the daily heat stress measures and related spatially-specific climatological fields. These include the mean annual number of days above certain thresholds of maximum and minimum air temperatures, heat indices and a new heat stress variable that gives an integrated measure of heat stress (and relief) over the course of a day. Comparisons are made between projected (2040 and 2090) and past (1990) heat stress statistics. All output is being provided at the 12 km spatial scale and will also be aggregated to the county level, which is a popular scale of analysis for public health researchers. County-level statistics will be made available by our collaborators at the Centers for Disease Control and Prevention (CDC) via the Wide-ranging Online Data for Epidemiologic Research (WONDER) system. CDC WONDER makes the information resources of the CDC available to public health professionals and the general public. This addition of heat stress measures to CDC WONDER will allow decision and policy makers to assess the impact of alternative approaches to optimize the public health response to EHEs. It will also allow public health researchers and policy makers to better include such heat stress measures in the context of national health data available in the CDC WONDER system. The users will be able to spatially and temporally query public health and heat-related data sets and create county-level maps and statistical charts of such data across the coterminous U.S.

Crosson, William L↗

DOE OSTI2025

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Optimal Coordination of Electric Vehicles for Grid Services using Deep Reinforcement Learning

Recent research has shown the effectiveness of reinforcement learning (RL) in coordinating electric vehicles (EVs) with vehicle-to-grid capabilities for grid services. However, many of these studies rely on lookup table and deep Q-network techniques, which can be impractical when dealing with continuous states and actions. In addition, existing RL designs inadequately account for battery aging effects, EV user satisfaction, uncertain departure and arrival time, and trip distance, which may compromise effective coordination. This paper aims to bridge these gaps by developing an innovative deep deterministic policy gradient-based RL framework for optimal coordination of EVs. Case studies were carried out using a test system with 100 EVs, and numerical analysis results showed that the proposed RL framework can effectively coordinate EVs to maximize economic benefits and user satisfaction while ensuring the expected battery lifespan.

Das, Avijit↗