SEARCH · Search NASA

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Transmission Interface Limits for High-Spatial Resolution Capacity Expansion Modeling

Large-scale capacity expansion models typically rely on estimates of the power transfer limits between modeled zones. Accurate estimation of these interface transfer limits (ITLs) requires modeling the underlying transmission network. Here we expand on a maximum flow optimization method that uses linearized power flow to estimate transfer limits. We apply this method to a data set of the U.S. transmission network to estimate ITLs between U.S. counties. By calculating ITLs using different subsets of the network, we evaluate how the size of the network used in the estimation affects the results. The results show diminishing returns to ITL accuracy after six hops, suggesting that a network subset can reasonably be used to approximate ITLs. The county-level estimates produced in this study will support more spatially resolved capacity expansion modeling and will help inform policy making at local and national levels.

capacity planning↗

DOE OSTI2024

Deep reinforcement learning for optimal control of induction welding process

Optimizing induction welding (IW) process parameters for the application of joining thermoplastic composites is challenging as it requires achieving complex spatiotemporal thermal characteristics along the weld-line to obtain desired weld quality. We formulate an optimal control problem which captures these requirements and seeks to optimize the IW coil speed using a fast-acting dynamic IW process model. We develop a novel Deep Reinforcement Learning (DRL) framework to solve this computationally challenging control problem and demonstrate via simulation study that the learned DRL feedback control policy results in better spatiotemporal thermal characteristics as compared to the current state-of-the-art.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Zero-Emissions Roadmap for Oakland County

This document outlines a strategic pathway for Oakland County, Michigan to achieve zero emissions by 2050 under the Clean Energy to Communities (C2C) Program. The report encompasses analyses and high-level modeling to guide Oakland County in its emission reduction goals. Key methods include establishing an emissions inventory baseline with ongoing evaluation of future projects’ emissions impacts. Core elements include decommissioning old infrastructure, enhancing energy efficiency, deploying hybrid and ground-source heat pumps, and transitioning to electric fleets. It is proposed to structure the planning process into 5-year strategic plans to make the decarbonization process manageable. The document also emphasizes the need for reassessment of goals and periodic updates to remain adaptive to technological advancements and funding considerations. A matrixed approach for evaluating projects by cost and emissions savings is suggested to optimize decision-making given finite resources.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS2010

Managing the Risk for Early Onset Osteoporosis in Long-Duration Astronauts Due to Spaceflight

Early Onset Osteoporosis is probably the most recognized but poorly understood long-term health risk due to spaceflight. Osteoporosis management is primarily prophylactic and clinical interventions rely upon the ability to predict fractures which is currently determined by surrogate measures of bone strength. The RMAT for Early Onset Osteoporosis identified some open issues related to the fact that long-duration astronauts compose a unique group of subjects for which clinical approaches for osteoporosis management do not apply. Long-duration astronauts are healthy, young (25 to 55 years of age), predominantly male, and physical fit relative to the typical osteoporosis patient. Moreover, during prolonged space missions (typically 6-month missions) the skeleton not only adapts to weightlessness, but is influenced by numerous risk factors induced by operational constraints, e.g., inability to maintain preflight weight-bearing and aerobic activities, sub-optimal dietary intake (e.g., high sodium content for food stability, lack of fresh fruit and vegetables), suppression of vitamin D metabolism by uv shielding, and remote medicine care. Moreover, adaptation results in novel changes to astronauts bones that cannot be detected by current medically-useful measures. Consequently, a panel of clinicians (recognized leaders and policy-makers in osteoporosis) was convened to review the dataset of bone measures and bone loss risk factors in long-duration astronauts. Driven by the queries in the RMAT, the panel was charged to determine 1) if an intervention is required to prevent this risk, 2) what type and at what time would intervention be optimal, 3) what is the clinical trigger that would require a medical response from flight surgeons and 4) how should research data be used in the clinical care of astronauts. Hence, the RMAT determined that a bone health policy need to be formulated specific for this unique cohort subjected to a novel skeletal condition

Sibonga, Jean D.↗

DOE OSTI2024

ML based control systems for nuclear physics experiments

The Experimental Physics Software and Computing Infrastructure (EPSCI) group at Jefferson Lab is leading the use of machine learning (ML) to enhance control systems in nuclear physics experiments. Collaborating closely with domain experts and data scientists, we have developed an ML-based control system that uses a Gaussian process to dynamically adjust the high voltage of the GlueX Central Drift Chamber. This results in stable detector performance by adapting to environmental changes, thereby reducing the offline calibration effort. Furthermore, we are developing ML-driven systems for optimizing the polarization of photon beams and polarized cryotargets. These systems will maintain the optimal microwave frequency in cryogenic targets and make real-time adjustments to diamond radiators for polarized photon sources, tasks traditionally handled by human operators. By automating these functions, we aim to optimize the polarization, reduce downtime, and minimize human error. This talk will highlight the development of reliable ML-based control systems and the policies to ensure they are both effective and trustworthy.

Jeske, Torri↗

NASA NTRS1978

A preference-ordered discrete-gaming approach to air-combat analysis

An approach to one-on-one air-combat analysis is described which employs discrete gaming of a parameterized model featuring choice between several closed-loop control policies. A preference-ordering formulation due to Falco is applied to rational choice between outcomes: win, loss, mutual capture, purposeful disengagement, draw. Approximate optimization is provided by an active-cell scheme similar to Falco's obtained by a 'backing up' process similar to that of Kopp. The approach is designed primarily for short-duration duels between craft with large-envelope weaponry. Some illustrative computations are presented for an example modeled using constant-speed vehicles and very rough estimation of energy shifts.

Kelley, H. J.↗

DOE OSTI2025

Hierarchical Resilience Planning for Networked Microgrids: A Case Study of Puerto Rico

Microgrids can be designed to enhance the energy resilience of communities and critical infrastructures, such as hospitals, data centers, and communication networks, which are vulnerable to frequent weather-related disruption. Coordinating multiple microgrids in a network can leverage the geographical diversity of load and generation resources while enabling resilient and cost-effective planning of the distribution system. Designing a networked microgrid is complex, involving intricate technical assessment, cost-benefit analysis, site-specific requirements, and the evaluation of existing resources. Therefore, this paper proposes a hierarchical resilience planning framework and performs an extensive techno-economic analysis for the design of a networked microgrid. Hierarchical resilience planning involves technology sizing at an individual community level to meet the critical load and satisfy resilience criteria, and resource optimization at networked microgrid level to provide a higher level of resilience and energy adequacy. A real-world case of Puerto Rico's cooperative microgrid “Microrred de la Montaña” is investigated considering localized electricity tariffs, site-specific demand profiles, solar generation, and existing hydro resources. Multiple optimization scenarios are developed based on the resiliency requirement to estimate the capacity of solar photovoltaic and battery energy storage (BES) to be installed at each substation. The results provide the optimal sizing for individual community and networked microgrid to withstand 1day and 3-day outages along with the criteria for critical load.

13 - HYDRO ENERGY↗

DOE OSTI1978

Plant Engineers Solar Energy Handbook: Southern California Region

Discussed in order after the introduction are solar components and systems (collectors, storage, service hot water systems, space heating with liquid and air systems, space cooling, heat pumps and controls); computer programs for system optimization; local solar and weather data; a description of buildings and plants in Southern California applying solar technology; current Federal and California solar legislation; standards, codes and performance testing information; a listing of manufacturers, distributors, and professional services available in Southern California region; and information access. Finally, solar design check lists for those engineers who wish to design their own systems. The program for the Solar Workshop for the Plant Engineer, March 30, 1978, Los Angeles, California is included.

14 SOLAR ENERGY↗

NASA NTRS2018

Engineering Elegant Systems: Postulates, Principles, and Hypotheses of Systems Engineering

Systems engineering integrated both the system and the organizational engineering disciplines to produce an elegant system. The NASA Systems Engineering Research Consortium has developed systems engineering postulates, principles, and hypotheses defining the physical and social aspects of systems engineering. This paper presents an overview of the current revision of this basis for systems engineering. This basis addresses several key aspects of systems engineering including system specific approach, organizational influences, policy and law impacts, application across the system life cycle, the mathematical basis of systems engineering, decision making, clearly distinguishing verification from validation, and system optimization.

Watson, Michael D.↗

NASA NTRS2018

Engineering Elegant Systems: Postulates, Principles, and Hypotheses of Systems Engineering

Watson, Michael D.↗

DOE OSTI2026

Using Flory–Huggins-informed human-in-the-loop Bayesian optimization to map the phase diagram of polymer blends

Mapping the phase diagram of polymer blends is an essential step in controlling the structure–property relationship of polymer-based materials. However, traditional grid-based approaches are inefficient and rely on subjective judgements for terminating the experimental campaign. Artificial intelligence-guided experimentation offers a compelling alternative, especially when data-driven decision-making is interfaced with established polymer thermodynamics to improve efficiency and interpretability. Here, we introduce a physics-informed Bayesian optimization approach to guide the mapping of the phase diagram of a model blend containing poly(methyl methacrylate) and poly(styrene-ran-acrylonitrile). Physical information is derived from a Flory–Huggins representation of the spinodal curve, which is integrated into the Bayesian optimization process as a structured prior mean that acts as a soft constraint. Implemented as a human-in-the-loop workflow, the approach leverages optical imaging of film cloudiness with iterative Gaussian process surrogate modeling and a parameter selection decision policy to identify the composition-temperature conditions for sequential iterations. Convergence of kernel and Flory–Huggins-based hyperparameters provided a stopping criterion, ensuring an objective and interpretable termination of the experimental campaign. The framework recovered the known lower critical solution temperature (∼160 °C), while increasing material efficiency through targeted sampling. This work establishes a proof-of-concept for the application of Bayesian optimization workflows to study polymer blend miscibility.

36 MATERIALS SCIENCE↗

NASA NTRSDate not supplied

Understanding Resilience Optimization Architectures With an Optimization Problem Repository

Optimizing a system’s resilience can be challenging, especially when it involves considering both the inherent resilience of a robust design and the active resilience of a health management system to a set of computationally-expensive hazard simulations. While prior work has developed specialized architectures to effectively and efficiently solve combined design and resilience optimization problems, the comparison of these architectures has been limited to a single case study. To further study resilience optimization formulations, this work develops a problem repository which includes previously-developed resilience optimization problems and additional problems presented in this work: a notional system resilience model, a pandemic response model, and a cooling tank hazard prevention model. This work then uses models in the repository at large to understand the characteristics of resilience optimization problems and study the applicability of optimization architectures and decomposition strategies. Based on the comparisons in the repository, applying an optimization architecture effectively requires understanding the alignment and coupling relationships between the design and resilience models, as well as the efficiency characteristics of the algorithms. While alignment determines the necessity of a surrogate of resilience cost in the upper-level design problem, coupling determines the overall applicability of a sequential, alternating, or bilevel structure. Additionally, the application of decomposition strategies is dependent on there being limited interactions between variable sets, which often does not hold when a resilience policy is parameterized in terms of actions to take in hazardous model states rather than specific given scenarios.

Resilience↗

DOE OSTI2026

Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The future of the grid will be powered by AI—or undermined by it. Artificial intelligence is rapidly reshaping grid operations, improving fault detection, forecasting accuracy, and real-time optimization. As AI systems move closer to operational decision loops, however, they introduce new consequence pathways: expanded attack surfaces, model integrity risks, regulatory exposure, and human-automation challenges. This talk presents a consequence-driven framework for deploying AI responsibly in the electric grid. Attendees will gain practical strategies to strengthen resilience, boost reliability, and deploy AI securely — ensuring the grid of the future is not only smarter but safer.

25 - ENERGY STORAGE↗

NASA NTRS1972

An approximate method for the synthesis of optimal control of distributed systems.

An approximate method is presented for the synthesis of an optimal control of distributed parameter systems, based on a combination of the ideas of Lyapunov's direct method and those of Bellman's successive approximation in policy space. The method is such that the approximate equation is improved after each iteration in the sense of the performance index being used.

Park, K. E.↗

DOE OSTI2025

Safe Physics-Informed Machine Learning for Dynamics and Control

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques enhance the modeling and control of complex dynamical systems, ensuring safety and stability remains a critical challenge, especially in safety-critical applications like autonomous vehicles, robotics, medical decision-making, and energy systems. We explore various approaches for embedding and ensuring safety constraints, including structural priors, Lyapunov and Control Barrier Functions, predictive control, projections, and robust optimization techniques. Additionally, we delve into methods for uncertainty quantification and safety verification, including reachability analysis and neural network verification tools, which help validate that control policies remain within safe operating bounds even in uncertain environments. The paper includes illustrative examples demonstrating the implementation aspects of safe learning frameworks that combine the strengths of data-driven approaches with the rigor of physical principles, offering a path toward the safe control of complex dynamical systems.

Drgona, Jan↗

DOE OSTI2025

HD ADOPT: Heavy-Duty Vehicle Choice Model Documentation

HD ADOPT is a logit consumer vehicle choice and stock model that analyzes the Class 8 tractor market. The model projects future technology shares, fuel consumption, and greenhouse gas (GHG) emissions under input assumptions of technology progress, energy prices, and policies. ADOPT is distinguished from other vehicle choice models through inclusion of non-linear and heterogenous consumer preferences and characterization of the full range of market options rather than use of composite vehicles. In addition, ADOPT has integrated vehicle simulation capabilities that enable performance assessment and optimization of endogenous technology evolution. Optionally, the model is able to adjust this evolution to enforce compliance with fuel economy and GHG emissions regulations. Primary results include projection of technology shares and future in-use fleet energy demand, petroleum consumption, and GHG emissions. This enables analysis and comparison of future scenarios of technology improvements, economic conditions, and national policies. Recent new features for the HD modeling also enable examination of different on-board hydrogen fuel storage technologies from the lens of consumer preferences for vehicle cost and range. This report documents current ADOPT capabilities and methodologies.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Optimal Electric Vehicle Charging and Discharging Strategies Under DER Compensation Programs: Preprint

The adoption of electric vehicles (EVs) is becoming increasingly popular because of environmental concerns, the greater availability of models, and increased cost-competitiveness with gas vehicles. Because EVs have both charging and discharging capabilities, they provide great potential to help electric utilities with grid operation. When the grid demand is high, EVs can discharge to the grid to reduce the peak load, and vice versa; therefore, electric utilities have designed different policies to encourage EV charging station operators to charge or discharge at certain time periods. The New York State Public Service Commission established the Value of Distributed Energy Resources (VDER), or the Value Stack, to compensate for energy created by distributed energy resources, including EVs. This paper presents an optimization-based approach to identify the "golden hours" and "golden spots," i.e., the effective time periods and geographic locations for EV charging station operators to charge or discharge under the VDER program that can provide them the highest benefit. The proposed methodology can be applied to other compensation mechanisms and distribution systems as well. By working with industry partner NineDot Energy, realistic charging station information is used in this study, and the proposed approach is tested on a distribution feeder. The results from this study can help electric utilities and EV charging station operators determine the ideal charging/discharging time and the ideal locations for the charging station(s) in their distribution systems to achieve maximized benefit.

electric vehicle↗

NASA NTRS1992

Optimal routing and buffer allocation for a class of finite capacity queueing systems

The problem of routing jobs to K parallel queues with identical exponential servers and unequal finite buffer capacities is considered. Routing decisions are taken by a controller which has buffering space available to it and may delay routing of a customer to a queue. Using ideas from weak majorization, it is shown that the shorter nonfull queue delayed (SNQD) policy minimizes both the total number of customers in the system at any time and the number of customers that are rejected by that time. The SNQD policy always delays routing decisions as long as all servers are busy. Only when all the buffers at the controller are occupied is a customer routed to the queue with the shortest queue length that is not at capacity. Moreover, it is shown that, if a fixed number of buffers is to be distributed among the K queues, then the optimal allocation scheme is the one in which the difference between the maximum and minimum queue capacities is minimized, i.e., becomes either 0 or 1.

Towsley, Don↗