Search NASA⌕ Search

SEARCH · Search NASA

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

A robust model predictive control algorithm for uncertain nonlinear systems that guarantees resolvability

A robustly stabilizing MPC (model predictive control) algorithm for uncertain nonlinear systems is developed that guarantees resolvability. With resolvability, initial feasibility of the finite-horizon optimal control problem implies future feasibility in a receding-horizon framework. The control consists of two components; (i) feed-forward, and (ii) feedback part. Feed-forward control is obtained by online solution of a finite-horizon optimal control problem for the nominal system dynamics. The feedback control policy is designed off-line based on a bound on the uncertainty in the system model. The entire controller is shown to be robustly stabilizing with a region of attraction composed of initial states for which the finite-horizon optimal control problem is feasible. The controller design for this algorithm is demonstrated on a class of systems with uncertain nonlinear terms that have norm-bounded derivatives and derivatives in polytopes. An illustrative numerical example is also provided.

feed - forward↗
NASA NTRS2005

Small Body GN&C Research Report: A Robust Model Predictive Control Algorithm with Guaranteed Resolvability

A robustly stabilizing MPC (model predictive control) algorithm for uncertain nonlinear systems is developed that guarantees the resolvability of the associated finite-horizon optimal control problem in a receding-horizon implementation. The control consists of two components; (i) feedforward, and (ii) feedback part. Feed-forward control is obtained by online solution of a finite-horizon optimal control problem for the nominal system dynamics. The feedback control policy is designed off-line based on a bound on the uncertainty in the system model. The entire controller is shown to be robustly stabilizing with a region of attraction composed of initial states for which the finite-horizon optimal control problem is feasible. The controller design for this algorithm is demonstrated on a class of systems with uncertain nonlinear terms that have norm-bounded derivatives, and derivatives in polytopes. An illustrative numerical example is also provided.

model predictive control algorithm (MPC)↗
NASA NTRS2022

SatNet: A Benchmark for Satellite Scheduling Optimization

Satellites provide essential services such as networking and weather tracking, and the number of near-earth and deep space satellites are expected to grow rapidly in the coming years. Communications with terrestrial ground stations is one of the critical functionalities of any space mission. Satellite scheduling is a problem that has been scientifically investigated since the 1970s. A central aspect of this problem is the need to consider resource contention and satellite visibility constraints as they require line of sight. Due to the combinatorial nature of the problem, prior solutions such as linear programs and evolutionary algorithms require extensive compute capabilities to output a feasible schedule for each scenario. Machine learning based scheduling can provide an alternative solution by training a model with historical data and generating a schedule quickly with model inference. We present SatNet, a benchmark for satellite scheduling optimization based on historical data from the NASA Deep Space Network. We propose formulation of the satellite scheduling problem as a Markov Decision Process and use reinforcement learning (RL) policies to generate schedules. The nature of constraints imposed by SatNet differ from other combinatorial optimization problems such as vehicle routing studied in prior literature. Our initial results indicate that RL is an alternative optimization approach that can generate candidate solutions of comparable quality to existing state-of-the-practice results. However, we also find that RL policies overfit to the training dataset and do not generalize well to new data, thereby necessitating continued research on reusable and generalizable agents.

Wilson, Brian↗
NASA NTRS1982

Economic modeling of fault tolerant flight control systems in commercial applications

This paper describes the current development of a comprehensive model which will supply the assessment and analysis capability to investigate the economic viability of Fault Tolerant Flight Control Systems (FTFCS) for commercial aircraft of the 1990's and beyond. An introduction to the unique attributes of fault tolerance and how they will influence aircraft operations and consequent airline costs and benefits is presented. Specific modeling issues and elements necessary for accurate assessment of all costs affected by ownership and operation of FTFCS are delineated. Trade-off factors are presented, aimed at exposing economically optimal realizations of system implementations, resource allocation, and operating policies. A trade-off example is furnished to graphically display some of the analysis capabilities of the comprehensive simulation model now being developed.

Finelli, G. B.↗
NASA NTRS1992

Neurocontrol and neurobiology - New developments and connections

At McDonnell-Douglas, controllers which combine adaptive critic networks with the use of backpropagation in real time have solved difficult control problems crucial to the feasibility of building the National Aerospace Plane (NASP) able to reach earth orbit. As details emerged, parallels to neurobiology have grown stronger and have begun to lead to empirical possibilities of importance to neuroscience. This has led to thoughts of institutional collaboration facilitating what could become a Newtonian revolution in neuroscience, with cognitive implications as well. The authors elaborate on each of these points. The topics discussed are recent progress in neurocontrol; progress in optimization and reinforcement learning; implications for neurobiology and science policy; and a new view of the brain.

Werbos, Paul J.↗
NASA NTRS1996

Distributed Large Data-Object Environments: End-to-End Performance Analysis of High Speed Distributed Storage Systems in Wide Area ATM Networks

We have developed and deployed a distributed-parallel storage system (DPSS) in several high speed asynchronous transfer mode (ATM) wide area networks (WAN) testbeds to support several different types of data-intensive applications. Architecturally, the DPSS is a network striped disk array, but is fairly unique in that its implementation allows applications complete freedom to determine optimal data layout, replication and/or coding redundancy strategy, security policy, and dynamic reconfiguration. In conjunction with the DPSS, we have developed a 'top-to-bottom, end-to-end' performance monitoring and analysis methodology that has allowed us to characterize all aspects of the DPSS operating in high speed ATM networks. In particular, we have run a variety of performance monitoring experiments involving the DPSS in the MAGIC testbed, which is a large scale, high speed, ATM network and we describe our experience using the monitoring methodology to identify and correct problems that limit the performance of high speed distributed applications. Finally, the DPSS is part of an overall architecture for using high speed, WAN's for enabling the routine, location independent use of large data-objects. Since this is part of the motivation for a distributed storage system, we describe this architecture.

Johnston, William↗
NASA NTRS1971

Optimum impulsive midcourse guidance with control dependent errors.

The problem of determining the optimum guidance policy for an interplanetary spacecraft is treated as a stochastic optimal control problem. An algorithm for computing the optimum velocity correction and the optimum execution time (with allowance for correction-dependent errors) is derived in the case of a single midcourse correction. The performance index was chosen to be an upper bound for the probability that the mission fails, and it is defined as a function of the maximum allowable velocity correction and the maximum allowable deviation of the terminal state. Numerical results obtained for a Jupiter fly-by mission indicate that the execution errors have a significant influence on the performance index, but an acceptably small upper bound on the probability of mission failure can be obtained for sufficiently small execution errors.

Tapley, B. D.↗
NASA NTRS2013

Future Extreme Heat Scenarios to Enable the Assessment of Climate Impacts on Public Health over the Coterminous U.S.

In the United States, extreme heat is the most deadly weather-related hazard. In the face of a warming climate and urbanization, which contributes to local-scale urban heat islands, it is very likely that extreme heat events (EHEs) will become more common and more severe in the U.S. This research seeks to provide historical and future measures of climate-driven extreme heat events to enable assessments of the impacts of heat on public health over the coterminous U.S. We use atmospheric temperature and humidity information from meteorological reanalysis and from Global Climate Models (GCMs) to provide data on past and future heat events. The focus of research is on providing assessments of the magnitude, frequency and geographic distribution of extreme heat in the U.S. to facilitate public health studies. In our approach, long-term climate change is captured with GCM outputs, and the temporal and spatial characteristics of short-term extremes are represented by the reanalysis data. Two future time horizons for 2040 and 2090 are compared to the recent past period of 1981- 2000. We characterize regional-scale temperature and humidity conditions using GCM outputs for two climate change scenarios (A2 and A1B) defined in the Special Report on Emissions Scenarios (SRES). For each future period, 20 years of multi-model GCM outputs are analyzed to develop a 'heat stress climatology' based on statistics of extreme heat indicators. Differences between the two future and the past period are used to define temperature and humidity changes on a monthly time scale and regional spatial scale. These changes are combined with the historical meteorological data, which is hourly and at a spatial scale (12 km), to create future climate realizations. From these realizations, we compute the daily heat stress measures and related spatially-specific climatological fields, such as the mean annual number of days above certain thresholds of maximum and minimum air temperatures, heat indices and a new heat stress variable developed as part of this research that gives an integrated measure of heat stress (and relief) over the course of a day. Comparisons are made between projected (2040 and 2090) and past (1990) heat stress statistics. Outputs are aggregated to the county level, which is a popular scale of analysis for public health interests. County-level statistics are made available to public health researchers by the Centers for Disease Control and Prevention (CDC) via the Wideranging Online Data for Epidemiologic Research (WONDER) system. This addition of heat stress measures to CDC WONDER allows decision and policy makers to assess the impact of alternative approaches to optimize the public health response to EHEs. Through CDC WONDER, users are able to spatially and temporally query public health and heat-related data sets and create county-level maps and statistical charts of such data across the coterminous U.S

Quattrochi, Dale A.↗
NASA NTRS2014

Linking Excessive Heat with Daily Heat-Related Mortality over the Coterminous United States

In the United States, extreme heat is the most deadly weather-related hazard. In the face of a warming climate and urbanization, which contributes to local-scale urban heat islands, it is very likely that extreme heat events (EHEs) will become more common and more severe in the U.S. This research seeks to provide historical and future measures of climate-driven extreme heat events to enable assessments of the impacts of heat on public health over the coterminous U.S. We use atmospheric temperature and humidity information from meteorological reanalysis and from Global Climate Models (GCMs) to provide data on past and future heat events. The focus of research is on providing assessments of the magnitude, frequency and geographic distribution of extreme heat in the U.S. to facilitate public health studies. In our approach, long-term climate change is captured with GCM outputs, and the temporal and spatial characteristics of short-term extremes are represented by the reanalysis data. Two future time horizons for 2040 and 2090 are compared to the recent past period of 1981- 2000. We characterize regional-scale temperature and humidity conditions using GCM outputs for two climate change scenarios (A2 and A1B) defined in the Special Report on Emissions Scenarios (SRES). For each future period, 20 years of multi-model GCM outputs are analyzed to develop a 'heat stress climatology' based on statistics of extreme heat indicators. Differences between the two future and the past period are used to define temperature and humidity changes on a monthly time scale and regional spatial scale. These changes are combined with the historical meteorological data, which is hourly and at a spatial scale (12 km) much finer than that of GCMs, to create future climate realizations. From these realizations, we compute the daily heat stress measures and related spatially-specific climatological fields, such as the mean annual number of days above certain thresholds of maximum and minimum air temperatures, heat indices, and a new heat stress variable developed as part of this research that gives an integrated measure of heat stress (and relief) over the course of a day. Comparisons are made between projected (2040 and 2090) and past (1990) heat stress statistics. Outputs are aggregated to the county level, which is a popular scale of analysis for public health interests. County-level statistics are made available to public health researchers by the Centers for Disease Control and Prevention (CDC) via the Wide-ranging Online Data for Epidemiologic Research (WONDER) system. This addition of heat stress measures to CDC WONDER allows decision and policy makers to assess the impact of alternative approaches to optimize the public health response to EHEs. Through CDC WONDER, users are able to spatially and temporally query public health and heat-related data sets and create county-level maps and statistical charts of such data across the coterminous U.S.

Quattrochi, Dale A.↗
NASA NTRS2015

Holiday in Lights: Tracking Cultural Patterns in Demand for Energy Services

Successful climate change mitigation will involve not only technological innovation, but also innovation in how we understand the societal and individual behaviors that shape the demand for energy services. Traditionally, individual energy behaviors have been described as a function of utility optimization and behavioral economics, with price restructuring as the dominant policy lever. Previous research at the macro-level has identified economic activity, power generation and technology, and economic role as significant factors that shape energy use. However, most demand models lack basic contextual information on how dominant social phenomenon, the changing demographics of cities, and the sociocultural setting within which people operate, affect energy decisions and use patterns. Here we use high-quality Suomi-NPP VIIRS nighttime environmental products to: (1) observe aggregate human behavior through variations in energy service demand patterns during the Christmas and New Year's season and the Holy Month of Ramadan and (2) demonstrate that patterns in energy behaviors closely track sociocultural boundaries at the country, city, and district level. These findings indicate that energy decision making and demand is a sociocultural process as well as an economic process, often involving a combination of individual price-based incentives and societal-level factors. While nighttime satellite imagery has been used to map regional energy infrastructure distribution, tracking daily dynamic lighting demand at three major scales of urbanization is novel. This methodology can enrich research on the relative importance of drivers of energy demand and conservation behaviors at fine scales. Our initial results demonstrate the importance of seating energy demand frameworks in a social context.

VIIRS night sky↗
NASA NTRS1996

Decision-Aiding and Optimization for Vertical Navigation of Long-Haul Aircraft

Most decisions made in the cockpit are related to safety, and have therefore been proceduralized in order to reduce risk. There are very few which are made on the basis of a value metric such as economic cost. One which can be shown to be value based, however, is the selection of a flight profile. Fuel consumption and flight time both have a substantial effect on aircraft operating cost, but they cannot be minimized simultaneously. In addition, winds, turbulence, and performance x,ary widely with altitude and time. These factors make it important and difficult for pilots to (a) evaluate the outcomes associated with a particular trajectory before it is flown and (b) decide among possible trajectories. The two elements of this problem considered here are (1) determining, what constitutes optimality, and (2) finding optimal trajectories. Pilots and dispatchers from major U.S. airlines were surveyed to determine which attributes of the outcome of a flight they considered the most important. Avoiding turbulence-for passenger comfort topped the list of items which were not safety related. Pilots' decision making about the selection of flight profile on the basis of flight time, fuel burn, and exposure to turbulence was then observed. Of the several behavioral and prescriptive decision models invoked to explain the pilots' choices, utility maximization is shown to best reproduce the pilots' decisions. After considering more traditional methods for optimizing trajectories, a novel method is developed using a genetic algorithm (GA) operating on a discrete representation of the trajectory search space. The representation is a sequence of command altitudes, and was chosen to be compatible with the constraints imposed by Air Traffic Control, and with the training given to pilots. Since trajectory evaluation for the GA is performed holistically, a wide class of objective functions can be optimized easily. Also, using the GA it is possible to compare the costs associated with different airspace design and air traffic management policies. A decision aid is proposed which would combine the pilot's notion of optimility with the GA-based optimization, provide the pilot with a number of alternative pareto-optimal trajectories, and allow him to consider un-modelled attributes and constraints in choosing among them. A solution to the problem of displaying alternatives in a multi-attribute decision space is also presented.

Patrick, Nicholas J. M.↗
NASA NTRS2002

The Aeronautical Data Link: Taxonomy, Architectural Analysis, and Optimization

The future Communication, Navigation, and Surveillance/Air Traffic Management (CNS/ATM) System will rely on global satellite navigation, and ground-based and satellite based communications via Multi-Protocol Networks (e.g. combined Aeronautical Telecommunications Network (ATN)/Internet Protocol (IP)) to bring about needed improvements in efficiency and safety of operations to meet increasing levels of air traffic. This paper will discuss the development of an approach that completely describes optimal data link architecture configuration and behavior to meet the multiple conflicting objectives of concurrent and different operations functions. The practical application of the approach enables the design and assessment of configurations relative to airspace operations phases. The approach includes a formal taxonomic classification, an architectural analysis methodology, and optimization techniques. The formal taxonomic classification provides a multidimensional correlation of data link performance with data link service, information protocol, spectrum, and technology mode; and to flight operations phase and environment. The architectural analysis methodology assesses the impact of a specific architecture configuration and behavior on the local ATM system performance. Deterministic and stochastic optimization techniques maximize architectural design effectiveness while addressing operational, technology, and policy constraints.

Morris, A. Terry↗
NASA NTRS2019

A Learning-Based Guidance Selection Mechanism for a Formally Verified Sense and Avoid Algorithm

This paper describes a learning-based strategy for selecting conflict avoidance maneuvers for autonomous unmanned aircraft systems. The selected maneuvers are provided by a formally verified algorithm and they are guaranteed to solve any impending conflict under general assumptions about aircraft dynamics. The decision-making logic that selects the appropriate maneuvers is encoded in a stochastic policy encapsulated as a neural network. The network’s parameters are optimized to maximize a reward function. The reward function penalizes loss of separation with other aircraft while rewarding resolutions that result in minimum excursions from the nominal flight plan. This paper provides a description of the technique and presents preliminary simulation results.

Balachandran, Swee↗
NASA NTRS2011

TPSAS-NF1676L-12441-DND

The increasing presence of airport surface surveillance technologies has spawned a strong interest in airport surface traffic management research; the vast majority has assumed that the airport’s runway configuration is known and constant. Tactical Runway Configuration Management (TRCM), one component of NASA’s System Oriented Runway Management concept, plans the airport configuration to optimize traffic efficiency for the forecast weather, traffic, and other factors. While planning runway configuration can provide benefit and is required by other automation concepts, larger benefits are possible by planning other airport configuration decisions, such as runway assignment policies, that are currently made manually by controllers. A laboratory prototype of the TRCM algorithm which selects optimal airport configuration schedules has been implemented and studied within a simulation environment. The presentation will describe simulation results for several airports, under various weather and traffic conditions. The sequence of airport configurations recommended by TRCM result in significantly less delay than the airport configurations that were actually used by controllers, illustrating both the potential benefit from airport configuration optimization and the ability of TRCM to provide effective airport configuration schedules. The application to several, distinct airports demonstrates the approach is capable of handling the differences between airports with a common algorithm, while providing decision support that respects the current procedures at those airports. Consequently, TRCM is able to be deployed to any airport within the current National Airspace System. The TRCM algorithmic approach is also extensible to future operational scenarios. NASA is in the process of transferring the initial TRCM technology to the FAA. Future research will extend the concept and algorithm to provide coordinated plans for metroplex airports and study NextGen applications.

Stephen Atkins↗
NASA NTRS2011

TPSAS-NF1676L-12263-DND

The increasing presence of airport surface surveillance technologies has spawned a strong interest in airport surface traffic management research; the vast majority has assumed that the airport’s runway configuration is known and constant. Tactical Runway Configuration Management (TRCM), one component of NASA’s System Oriented Runway Management concept, plans the airport configuration to optimize traffic efficiency for the forecast weather, traffic, and other factors. While planning runway configuration can provide benefit and is required by other automation concepts, larger benefits are possible by planning other airport configuration decisions, such as runway assignment policies, that are currently made manually by controllers. A laboratory prototype of the TRCM algorithm which selects optimal airport configuration schedules has been implemented and studied within a simulation environment. The presentation will describe simulation results for several airports, under various weather and traffic conditions. The sequence of airport configurations recommended by TRCM result in significantly less delay than the airport configurations that were actually used by controllers, illustrating both the potential benefit from airport configuration optimization and the ability of TRCM to provide effective airport configuration schedules. The application to several, distinct airports demonstrates the approach is capable of handling the differences between airports with a common algorithm, while providing decision support that respects the current procedures at those airports. Consequently, TRCM is able to be deployed to any airport within the current National Airspace System. The TRCM algorithmic approach is also extensible to future operational scenarios. NASA is in the process of transferring the initial TRCM technology to the FAA. Future research will extend the concept and algorithm to provide coordinated plans for metroplex airports and study NextGen applications.

Stephen Atkins↗
NASA NTRS2010

NASA Tech Briefs, April 2010

Topics covered include: Active and Passive Hybrid Sensor; Quick-Response Thermal Actuator for Use as a Heat Switch; System for Hydrogen Sensing; Method for Detecting Perlite Compaction in Large Cryogenic Tanks; Using Thin-Film Thermometers as Heaters in Thermal Control Applications; Directional Spherical Cherenkov Detector; AlGaN Ultraviolet Detectors for Dual-Band UV Detection; K-Band Traveling-Wave Tube Amplifier; Simplified Load-Following Control for a Fuel Cell System; Modified Phase-meter for a Heterodyne Laser Interferometer; Loosely Coupled GPS-Aided Inertial Navigation System for Range Safety; Sideband-Separating, Millimeter-Wave Heterodyne Receiver; Coaxial Propellant Injectors With Faceplate Annulus Control; Adaptable Diffraction Gratings With Wavefront Transformation; Optimizing a Laser Process for Making Carbon Nanotubes; Thermogravimetric Analysis of Single-Wall Carbon Nanotubes; Robotic Arm Comprising Two Bending Segments; Magnetostrictive Brake; Low-Friction, Low-Profile, High-Moment Two-Axis Joint; Foil Gas Thrust Bearings for High-Speed Turbomachinery; Miniature Multi-Axis Mechanism for Hand Controllers; Digitally Enhanced Heterodyne Interferometry; Focusing Light Beams To Improve Atomic-Vapor Optical Buffers; Landmark Detection in Orbital Images Using Salience Histograms; Efficient Bit-to-Symbol Likelihood Mappings; Capacity Maximizing Constellations; Natural-Language Parser for PBEM; Policy Process Editor for P(sup 3)BM Software; A Quality System Database; Trajectory Optimization: OTIS 4; and Computer Software Configuration Item-Specific Flight Software Image Transfer Script Generator.

Source record↗
NASA NTRS2007

Cross Cutting Structural Design for Exploration Systems

The challenge of our new National Space Policy and NASA's Vision for Space Exploration (VSE) is keyed to the development of more effective space access and transportation systems. Optimizing in-space systems through innovative cross cutting structural designs that reduce mass, combine functional requirements and improve performance can significantly advance spacecraft designs to meet the ever growing demands of our new National Space Policy. Dependence on limited structural designs is no longer an option. We must create robust materials, forms, function and evolvable systems. We must advance national policy objectives in the design, development, test and operation of multi-billion dollar new generation crew capsules by enabling them to evolve in meeting the requirements of long duration missions to the moon and mars. This paper discusses several current issues and major design drivers for consideration in structural design of advanced spacecraft systems. Approaches to addressing these multifunctional requirements is presented as well as a discussion on utilizing Functional Analysis System Technique (FAST) in developing cross cutting structural designs for future spacecraft. It will be shown how easy it is to deploy such techniques in any conceptual architecture definition or ongoing preliminary design. As experts in merging mission, safety and life support requirements of the frail human existence into robust vehicle and habitat design, we will conquer the final frontier, harness new resources and develop life giving technologies for mankind through more innovative designs. The rocket equation tells us that a reduction in mass optimizes our propulsive results. Primary and secondary structural elements provide for the containment of gases, fluids and solids; translate and sustain loads/impacts; conduct/radiate thermal energy; shield from the harmful effects of radiation; provide for grounding/bonding of electrical power systems; compartmentalize operational functions; and provide physical interface with multiple systems. How can we redefine, combine, substitute, rearrange and otherwise modify our structural systems to reduce mass? New technologies will be needed to fill knowledge gaps and propagate new design methods. Such an integrated process is paramount in maintaining U.S. leadership and in executing our national policy goals. The cross cutting process can take many forms, but all forms will have a positive affect on the demanding design environment through initial radical thinking. The author will illustrate such cross cutting results achievable through a formal process called FAST. The FAST example will be used to show how a multifunctional structural system concept for long duration spacecraft might be generated.

Semmes, Edmund B.↗