SEARCH · Search NASA

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2024

ML based control systems for nuclear physics experiments

The Experimental Physics Software and Computing Infrastructure (EPSCI) group at Jefferson Lab is leading the use of machine learning (ML) to enhance control systems in nuclear physics experiments. Collaborating closely with domain experts and data scientists, we have developed an ML-based control system that uses a Gaussian process to dynamically adjust the high voltage of the GlueX Central Drift Chamber. This results in stable detector performance by adapting to environmental changes, thereby reducing the offline calibration effort. Furthermore, we are developing ML-driven systems for optimizing the polarization of photon beams and polarized cryotargets. These systems will maintain the optimal microwave frequency in cryogenic targets and make real-time adjustments to diamond radiators for polarized photon sources, tasks traditionally handled by human operators. By automating these functions, we aim to optimize the polarization, reduce downtime, and minimize human error. This talk will highlight the development of reliable ML-based control systems and the policies to ensure they are both effective and trustworthy.

Jeske, Torri↗

DOE OSTI2025

Hierarchical Resilience Planning for Networked Microgrids: A Case Study of Puerto Rico

Microgrids can be designed to enhance the energy resilience of communities and critical infrastructures, such as hospitals, data centers, and communication networks, which are vulnerable to frequent weather-related disruption. Coordinating multiple microgrids in a network can leverage the geographical diversity of load and generation resources while enabling resilient and cost-effective planning of the distribution system. Designing a networked microgrid is complex, involving intricate technical assessment, cost-benefit analysis, site-specific requirements, and the evaluation of existing resources. Therefore, this paper proposes a hierarchical resilience planning framework and performs an extensive techno-economic analysis for the design of a networked microgrid. Hierarchical resilience planning involves technology sizing at an individual community level to meet the critical load and satisfy resilience criteria, and resource optimization at networked microgrid level to provide a higher level of resilience and energy adequacy. A real-world case of Puerto Rico's cooperative microgrid “Microrred de la Montaña” is investigated considering localized electricity tariffs, site-specific demand profiles, solar generation, and existing hydro resources. Multiple optimization scenarios are developed based on the resiliency requirement to estimate the capacity of solar photovoltaic and battery energy storage (BES) to be installed at each substation. The results provide the optimal sizing for individual community and networked microgrid to withstand 1day and 3-day outages along with the criteria for critical load.

13 - HYDRO ENERGY↗

DOE OSTI1978

Plant Engineers Solar Energy Handbook: Southern California Region

Discussed in order after the introduction are solar components and systems (collectors, storage, service hot water systems, space heating with liquid and air systems, space cooling, heat pumps and controls); computer programs for system optimization; local solar and weather data; a description of buildings and plants in Southern California applying solar technology; current Federal and California solar legislation; standards, codes and performance testing information; a listing of manufacturers, distributors, and professional services available in Southern California region; and information access. Finally, solar design check lists for those engineers who wish to design their own systems. The program for the Solar Workshop for the Plant Engineer, March 30, 1978, Los Angeles, California is included.

14 SOLAR ENERGY↗

DOE OSTI2026

Using Flory–Huggins-informed human-in-the-loop Bayesian optimization to map the phase diagram of polymer blends

Mapping the phase diagram of polymer blends is an essential step in controlling the structure–property relationship of polymer-based materials. However, traditional grid-based approaches are inefficient and rely on subjective judgements for terminating the experimental campaign. Artificial intelligence-guided experimentation offers a compelling alternative, especially when data-driven decision-making is interfaced with established polymer thermodynamics to improve efficiency and interpretability. Here, we introduce a physics-informed Bayesian optimization approach to guide the mapping of the phase diagram of a model blend containing poly(methyl methacrylate) and poly(styrene-ran-acrylonitrile). Physical information is derived from a Flory–Huggins representation of the spinodal curve, which is integrated into the Bayesian optimization process as a structured prior mean that acts as a soft constraint. Implemented as a human-in-the-loop workflow, the approach leverages optical imaging of film cloudiness with iterative Gaussian process surrogate modeling and a parameter selection decision policy to identify the composition-temperature conditions for sequential iterations. Convergence of kernel and Flory–Huggins-based hyperparameters provided a stopping criterion, ensuring an objective and interpretable termination of the experimental campaign. The framework recovered the known lower critical solution temperature (∼160 °C), while increasing material efficiency through targeted sampling. This work establishes a proof-of-concept for the application of Bayesian optimization workflows to study polymer blend miscibility.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The future of the grid will be powered by AI—or undermined by it. Artificial intelligence is rapidly reshaping grid operations, improving fault detection, forecasting accuracy, and real-time optimization. As AI systems move closer to operational decision loops, however, they introduce new consequence pathways: expanded attack surfaces, model integrity risks, regulatory exposure, and human-automation challenges. This talk presents a consequence-driven framework for deploying AI responsibly in the electric grid. Attendees will gain practical strategies to strengthen resilience, boost reliability, and deploy AI securely — ensuring the grid of the future is not only smarter but safer.

25 - ENERGY STORAGE↗

DOE OSTI2025

Safe Physics-Informed Machine Learning for Dynamics and Control

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques enhance the modeling and control of complex dynamical systems, ensuring safety and stability remains a critical challenge, especially in safety-critical applications like autonomous vehicles, robotics, medical decision-making, and energy systems. We explore various approaches for embedding and ensuring safety constraints, including structural priors, Lyapunov and Control Barrier Functions, predictive control, projections, and robust optimization techniques. Additionally, we delve into methods for uncertainty quantification and safety verification, including reachability analysis and neural network verification tools, which help validate that control policies remain within safe operating bounds even in uncertain environments. The paper includes illustrative examples demonstrating the implementation aspects of safe learning frameworks that combine the strengths of data-driven approaches with the rigor of physical principles, offering a path toward the safe control of complex dynamical systems.

Drgona, Jan↗

DOE OSTI2025

HD ADOPT: Heavy-Duty Vehicle Choice Model Documentation

HD ADOPT is a logit consumer vehicle choice and stock model that analyzes the Class 8 tractor market. The model projects future technology shares, fuel consumption, and greenhouse gas (GHG) emissions under input assumptions of technology progress, energy prices, and policies. ADOPT is distinguished from other vehicle choice models through inclusion of non-linear and heterogenous consumer preferences and characterization of the full range of market options rather than use of composite vehicles. In addition, ADOPT has integrated vehicle simulation capabilities that enable performance assessment and optimization of endogenous technology evolution. Optionally, the model is able to adjust this evolution to enforce compliance with fuel economy and GHG emissions regulations. Primary results include projection of technology shares and future in-use fleet energy demand, petroleum consumption, and GHG emissions. This enables analysis and comparison of future scenarios of technology improvements, economic conditions, and national policies. Recent new features for the HD modeling also enable examination of different on-board hydrogen fuel storage technologies from the lens of consumer preferences for vehicle cost and range. This report documents current ADOPT capabilities and methodologies.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Optimal Electric Vehicle Charging and Discharging Strategies Under DER Compensation Programs: Preprint

The adoption of electric vehicles (EVs) is becoming increasingly popular because of environmental concerns, the greater availability of models, and increased cost-competitiveness with gas vehicles. Because EVs have both charging and discharging capabilities, they provide great potential to help electric utilities with grid operation. When the grid demand is high, EVs can discharge to the grid to reduce the peak load, and vice versa; therefore, electric utilities have designed different policies to encourage EV charging station operators to charge or discharge at certain time periods. The New York State Public Service Commission established the Value of Distributed Energy Resources (VDER), or the Value Stack, to compensate for energy created by distributed energy resources, including EVs. This paper presents an optimization-based approach to identify the "golden hours" and "golden spots," i.e., the effective time periods and geographic locations for EV charging station operators to charge or discharge under the VDER program that can provide them the highest benefit. The proposed methodology can be applied to other compensation mechanisms and distribution systems as well. By working with industry partner NineDot Energy, realistic charging station information is used in this study, and the proposed approach is tested on a distribution feeder. The results from this study can help electric utilities and EV charging station operators determine the ideal charging/discharging time and the ideal locations for the charging station(s) in their distribution systems to achieve maximized benefit.

electric vehicle↗

DOE OSTI2025

Resilient State Recovery Using Prior Measurement Support Information

Resilient state recovery of cyber-physical systems has attracted much research attention due to the unique challenges posed by the tight coupling between communication, computation, and the underlying physics of such systems. By modeling attacks as additive adversary signals to a sparse subset of measurements, this resilient recovery problem can be formulated as an error correction problem. To achieve exact state recovery, most existing results require less than 50% of the measurement nodes to be compromised, which limits the resiliency of the estimators. In this paper, we show that observer resiliency can be further improved by incorporating data-driven prior information. Here, we provide an analytical bridge between the precision of prior information and the resiliency of the estimator. By quantifying the relationship between the estimation error of the weighted ℓ 1 observer and the precision of the support prior, this quantified relationship provides guidance for the estimator’s weight design to achieve optimal resiliency. Several numerical simulations and an application case study are presented to validate the theoretical claims.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

A framework and tool for designing cost-effective, resilient, and circular net-zero supply chains under uncertainty with an application to multilayer plastic films

While 55% of Fortune 500 companies have committed to achieving net-zero emissions and/or zero-waste operations by 2035, only 2% are currently on track, revealing a critical gap between ambition and action. Designing supply chains that reduce both emissions and waste is a complex non-intuitive, multi-objective challenge, compounded by the high costs of new technologies and the need for resilient, profitable solutions. This paper aims to address this challenge by presenting a generic framework and multi-objective optimization formulation for designing cost-effective, circular, and resilient supply chains under uncertainty, implemented through a user-friendly decision-support tool with intuitive data visualization capabilities, enabling communication of results to both technical and non-technical stakeholders. We demonstrate the application of this framework in the context of multilayer plastic films (barrier films), which are widely used in food packaging and composite materials. The model quantifies trade-offs across three objectives: minimizing global warming potential, maximizing circularity, and minimizing cost. A key contribution of this work is the explicit modeling of technological resilience, the ability of supply chains to maintain function under disruption. In the cost-minimization case, the resilience constraint makes the design approximately three times more expensive in the short-term metric, but shifts the system from relying on a single recovery pathway to a portfolio of four recovery pathways, improving the robustness of the optimization solution under uncertainty. Lastly, we introduce TranZero, a decision-support tool that integrates material flow analysis, hotspot identification, and optimization-based scenario planning to support net-zero and circularity decisions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

Agent-based Modeling for the Multi-objective Optimization of Energy Production Pathways: Integrated Techno-Economics and Life Cycle Assessment

This project developed an integrated modeling framework to evaluate how purpose-grown bioenergy feedstocks could support large-scale sustainable aviation fuel production in the United States. Led by Colorado State University with project partners, the work combined geographically resolved analysis, techno-economic assessment, life cycle assessment, multi-objective optimization, and agent-based modeling to examine feedstock performance, deployment potential, land-use implications, and adoption dynamics. The overall goal was to identify practical and sustainable pathways for producing aviation fuel from feedstocks such as energy crops, woody crops, oilseeds, and algae while helping inform policy, investment, and research needs tied to national SAF goals. In essence, the project provides a systems-level assessment of the opportunities and constraints associated with scaling bioenergy-based aviation fuels in the U.S.

09 BIOMASS FUELS↗

DOE OSTI2024

Towards Sustainable Post-Exascale Leadership Computing

As computing systems approach the limits of traditional silicon technology, the diminishing returns in performance per watt present a significant barrier to sustaining growth in HPC. From a large-scale scientific supercomputing facility point of view, we propose a multifaceted strategy toward specialized hardware and architectures that are optimized for energy efficiency in specific applications. We also emphasize the need for integrating energy-aware practices across all levels of HPC, from system design and software development to operational policies. We discuss strategic opportunities such as the adoption of application-specific accelerators, the development of energy-efficient algorithms, and the implementation of data-driven operational analytics. Our goal is to develop a comprehensive roadmap ensuring that future leadership systems at OLCF can meet scientific demands while operating within stringent energy budgets, thereby supporting sustainable computing growth.

Shin, Woong↗

DOE OSTI2024

Spatial inequities in access to medications for treatment of opioid use disorder highlight scarcity of methadone providers under counterfactual scenarios

Access to treatment and medication for opioid use disorder (MOUD) is essential in reducing opioid use and associated behavioral risks, such as syringe sharing among persons who inject drugs (PWID). Syringe sharing among PWID carries high risk of transmission of serious infections such as hepatitis C and HIV. MOUD resources, such as methadone provider clinics, however, are often unavailable to PWID due to barriers like long travel distance to the nearest methadone provider and the required frequency of clinic visits. The goal of this study is to examine the uncertainty in the effects of travel distance in initiating and continuing methadone treatment and how these interact with different spatial distributions of methadone providers to impact co-injection (syringe sharing) risks. A baseline scenario of spatial access was established using the existing locations of methadone providers in a geographical area of metropolitan Chicago, Illinois, USA. Next, different counterfactual scenarios redistributed the locations of methadone providers in this geographic area according to the densities of both the general adult population and according to the PWID population per zip code. We define different reasonable methadone access assumptions as the combinations of short, medium, and long travel distance preferences combined with three urban/suburban travel distance preference. Our modeling results show that when there is a low travel distance preference for accessing methadone providers, distributing providers near areas that have the greatest need (defined by density of PWID) is best at reducing syringe sharing behaviors. However, this strategy also decreases access across suburban locales, posing even greater difficulty in regions with fewer transit options and providers. As such, without an adequate number of providers to give equitable coverage across the region, spatial distribution cannot be optimized to provide equitable access to all PWID. Our study has important implications for increasing interest in methadone as a resurgent treatment for MOUD in the United States and for guiding policy toward improving access to MOUD among PWID.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Transforming Agricultural Productivity with AI-Driven Forecasting: Innovations in Food Security and Supply Chain Optimization

Global food security is under significant threat from climate change, population growth, and resource scarcity. This review examines how advanced AI-driven forecasting models, including machine learning (ML), deep learning (DL), and time-series forecasting models like SARIMA/ARIMA, are transforming regional agricultural practices and food supply chains. Through the integration of Internet of Things (IoT), remote sensing, and blockchain technologies, these models facilitate the real-time monitoring of crop growth, resource allocation, and market dynamics, enhancing decision making and sustainability. The study adopts a mixed-methods approach, including systematic literature analysis and regional case studies. Highlights include AI-driven yield forecasting in European hydroponic systems and resource optimization in southeast Asian aquaponics, showcasing localized efficiency gains. Furthermore, AI applications in food processing, such as plasma, ozone and Pulsed Electric Field (PEF) treatments, are shown to improve food preservation and reduce spoilage. Key challenges—such as data quality, model scalability, and prediction accuracy—are discussed, particularly in the context of data-poor environments, limiting broader model applicability. The paper concludes by outlining future directions, emphasizing context-specific AI implementations, the need for public–private collaboration, and policy interventions to enhance scalability and adoption in food security contexts.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Future marine biofuels in the port of Seattle region

Marine transportation, a vital global sector, emits 3% of global annual greenhouse gas emissions, which are predicted to increase in the future. Marine biofuels derived from biomass or waste sources like wood residue, waste oil and municipal solid waste can be used for decarbonization. However, limited studies have explored if sufficient marine biofuels could be produced and supplied to major regional ports given feedstock, supply chain and technological constraints. We fill this gap by evaluating the feasibility of supplying marine biofuels to the Port of Seattle. The Regional Bio-Economy Model (RBEM) and the Freight and Fuel Transportation Optimization Tool (FTOT) are used to build scenarios for simulating marine biofuel production in the Port region. We harmonized technoeconomic assumptions for RBEM and FTOT, input FTOT feedstock utilization and routing outputs into RBEM, and modelled conversion, feedstock, and policy scenario variations in RBEM. In RBEM, overall biofuel production was constrained primarily by the biofuel cost, and then by feedstock availability. Providing policy incentives and reducing permitting time frames alleviated these constraints and spurred the buildout of a robust industry through industrial learning dynamics in the initial years. With these measures in place, the RBEM results show that 100% of fuel demand at the Port can be supplied by biofuels with policy incentives and suitable technoeconomic conditions, but the addition of transportation cost considerations using FTOT led to 27.8% of demand being able to be met by biofuels at reasonable fuel delivery cost.

09 BIOMASS FUELS↗

DOE OSTI2025

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗

DOE OSTI2026

Strategizing emission cuts in China to mitigate short-term warming from clean air policies

Aerosol-cloud interactions remain one of the largest sources of uncertainty in estimates of anthropogenic climate forcing. Reducing aerosols to achieve air quality improvement and climate goals can cause unintended warming due to the weakening of aerosol cooling. Here we investigate the climate impacts of spatially optimized sulfur dioxide (SO 2 ) emission reduction under a carbon-neutral pathway in China. We find that targeting reduction in highly polluted regions in China significantly suppresses the rise in effective radiative forcing due to aerosol-cloud interactions (ERF aci ) during 2020–2060. Owing to the nonlinear aerosol-cloud interaction, the optimized emission reduction strategy limits the regional average increase in ERF aci of more than 0.89 W m −2 to less than 0.13 W m −2 in the short-term future during 2020–2040 and weakens the ERF aci increase by two-thirds in 2060 over China. These findings demonstrate the critical role of targeted emission control in mitigating short-term climate risks while pursuing air quality goals.

Zhu, Yitong [Nanjing Univ. of Information Science ↗

DOE OSTI2024

HPC Resource Allocation Under Energy Constraints

We discuss the new problem faced by High-Performance Computing (HPC) facilities in allocating resources to users of their facilities: while facilities once allocated a single finite resource—node-hours—now facilities must also concurrently allocate a second scarce resource: electrical energy, which is bounded within each facility's annual operations budget. Current application optimization practices encourage conservation of the first resource, but can be potentially unaffordably wasteful of the second. We describe a framework for reasoning about such allocations that can be utilized by facilities to articulate policy, while encouraging scientific application developers to write code mindfully of both constraints. We outline the requirements on facilities, on developers, and on hardware vendors and integrators that are necessary to enable the implementation of this framework.

97 MATHEMATICS AND COMPUTING↗