Study of non-linear optimization techniques
Nonlinear optimization techniques in dynamic programming and solution of ordinary nonlinear differential equations by Runge-Kutta method
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Nonlinear optimization techniques in dynamic programming and solution of ordinary nonlinear differential equations by Runge-Kutta method
Finite dimensional approximations of optimal nonlinear filters for class of large-noise, nonlinear, continuous-time problems
Design study for optimal nonlinear receiver demodulator
Recent work with NASA's Jet Propulsion Laboratory has allowed for external access to five of JPL's real-world requirements models, anonymized to conceal proprietary information, but retaining their computational nature. Experimentation with these models, reported herein, demonstrates a dramatic speedup in the computations performed on them. These models have a well defined goal: select mitigations that retire risks which, in turn, increases the number of attainable requirements. Such a non-linear optimization is a well-studied problem. However identification of not only (a) the optimal solution(s) but also (b) the key factors leading to them is less well studied. Our technique, called KEYS, shows a rapid way of simultaneously identifying the solutions and their key factors. KEYS improves on prior work by several orders of magnitude. Prior experiments with simulated annealing or treatment learning took tens of minutes to hours to terminate. KEYS runs much faster than that; e.g for one model, KEYS ran 13,000 times faster than treatment learning (40 minutes versus 0.18 seconds). Processing these JPL models is a non-linear optimization problem: the fewest mitigations must be selected while achieving the most requirements. Non-linear optimization is a well studied problem. With this paper, we challenge other members of the PROMISE community to improve on our results with other techniques.
This paper outlines a suite of energy-management problems for inverter-based power networks from the vantage point of optimal control and (non)linear optimization. The problems are categorized based on timescales dictated by the network dynamics, and organized methodologically based on the problem complexity. A growing body of literature has addressed problems in this domain, albeit, with poorly motivated assumptions and behavioral models that obscure precise device behavior. With a combination of circuit- and control-theoretic lenses, we establish appropriate dynamic models for the networked resources, illustrate how common engineering assumptions arise, uncover how problems are linked, and postulate open challenges.
Power system black start readiness is part of the system planning. Utility planners perform periodic studies to assess if their power system is capable of total restoration following a black out. Hydro and diesel generators are the most commonly used black start capable resources by power utilities. However, with increasing penetration of solar generation, inverter-based resources can be considered to provide black start capability. Since the solar inverters can be located at multiple locations throughout the power system, and in view of their unique characteristics, an optimal real-time capable plan is helpful for system operators for faster black start. Black start optimization is a multi stage mixed-integer non-linear optimization which is extremely hard to solve. In this paper, we propose an optimal black start methodology that is easier to solve and scalable in real-time. We demonstrate the proposed methodology on two test systems and illustrate how inverter-based resources can contribute and improve power system restoration.
Moment-of-fluid (MOF) methods for interface reconstruction approximate the region occupied by material in each mesh element only through reference to its geometric moments. Here, we present a 3D MOF method that represents the material (POM) in each cell as the convex intersection of the cell and multiple half-spaces, each selected to minimize the least-squares error between computed moments of the approximated material and provided reference moments. This optimization problem is highly non-linear and non-convex, making the numerical result very sensitive to the initial guess. To create an effective initial guess in each cell, we construct an ellipsoid from 0th–2nd order reference moments such that its shape corresponds with that of the POM. Within this ellipsoid we inscribe a polyhedron, and initialize the minimization problem with the half-spaces defined by each of its faces. The inscribed polyhedron has minimally 4 faces, and using up to 3rd order moments permits optimization over up to 20 unknown values. We therefore define MOF methods that utilize 4, 5, or 6 half-spaces, correspondingly initialized with the faces of a single inscribed tetrahedron, triangular prism, or hexahedron. Stability of the non-linear optimization is further improved with a prepossessing step that normalizes the reference moments according to the axes of the reference ellipsoid. Using this approach, the non-linear least-squares solver reliably converges to a near-global minimum from a single initial guess. We demonstrate accuracy and robustness using single-cell and multi-cell examples over a wide spectrum of geometry. In particular, we demonstrate our ability to exactly reproduce several important and complex features defined by up to four half-spaces, such as corners, filaments, filament tips, and embedded material in the cell.
Telban and Cardullo have developed and successfully implemented the non-linear optimal motion cueing algorithm at the Visual Motion Simulator (VMS) at the NASA Langley Research Center in 2005. The latest version of the non-linear algorithm performed filtering of motion cues in all degrees-of-freedom except for pitch and roll. This manuscript describes the development and implementation of the non-linear optimal motion cueing algorithm for the pitch and roll degrees of freedom. Presented results indicate improved cues in the specified channels as compared to the original design. To further advance motion cueing in general, this manuscript describes modifications to the existing algorithm, which allow for filtering at the location of the pilot's head as opposed to the centroid of the motion platform. The rational for such modification to the cueing algorithms is that the location of the pilot's vestibular system must be taken into account as opposed to the off-set of the centroid of the cockpit relative to the center of rotation alone. Results provided in this report suggest improved performance of the motion cueing algorithm.
Here we introduce an inverse design framework based on artificial neural networks, genetic algorithms, and tight-binding calculations, capable to optimize the very large configuration space of nanoelectronic devices. Our non-linear optimization procedure operates on trial Hamiltonians through superoperators controlling growth policies of regions of distinct doping. We demonstrate that our algorithm optimizes the doping of graphene-based three-terminal devices for valleytronics applications, monotonously converging to synthesizable devices with high merit functions in a few thousand evaluations (out of similar or equal to ≃ 2 3800 possible configurations). The best-performing device allowed for a terminal-specific separation of valley currents with similar or equal to ≃ 96% (≃ 94%) K(K') valley purity. Importantly, the devices found through our non-linear optimization procedure have both a higher merit function and higher robustness to defects than the ones obtained through geometry optimization.
Signal and noise problem as solution to nonlinear stochastic differential equations
A new technique which converts a constrained optimization problem to an unconstrained one where conflicting figures of merit may be simultaneously considered has been combined with a complex mission analysis system. The method is compared with existing single and multiobjective optimization methods. A primary benefit from this new method for multiobjective optimization is the elimination of separate optimizations for each objective, which is required by some optimization methods. A typical wide body transport aircraft is used for the comparative studies.
Several parallel-vector computational improvements to the unconstrained optimization procedure are described which speed up the structural analysis-synthesis process. A fast parallel-vector Choleski-based equation solver, pvsolve, is incorporated into the well-known SAP-4 general-purpose finite-element code. The new code, denoted PV-SAP, is tested for static structural analysis. Initial results on a four processor CRAY 2 show that using pvsolve reduces the equation solution time by a factor of 14-16 over the original SAP-4 code. In addition, parallel-vector procedures for the Golden Block Search technique and the BFGS method are developed and tested for nonlinear unconstrained optimization. A parallel version of an iterative solver and the pvsolve direct solver are incorporated into the BFGS method. Preliminary results on nonlinear unconstrained optimization test problems, using pvsolve in the analysis, show excellent parallel-vector performance indicating that these parallel-vector algorithms can be used in a new generation of finite-element based structural design/analysis-synthesis codes.
During phase-I, the project team led by Echogen Power Systems (EPS) had two primary objectives based on investigating the application of gas turbines with supercritical carbon dioxide (sCO 2 ) power cycles. The first objective was to improve the overall efficiency and performance of a hybrid gas turbine/sCO 2 power system through a joint optimization of the two subsystems (gas turbine and sCO 2 power cycle) using non-linear optimization techniques that simultaneously evaluate thermal performance of the combined cycle. The hybrid power system included several points of interaction, including (but not limited to) gas turbine exhaust, fuel heating, inlet chilling and turbine cooling. The second objective was to establish a baseline transient response model of the hybrid power system and a notional microgrid and begin steps to integrate the control systems of the three major elements (gas turbine, sCO 2 cycle and grid controller). The project team established a baseline performance for a combined cycle power plant using a production gas turbine and scaled sCO 2 power cycle only utilizing exhaust heat recovery. Echogen’s non-linear techno-economic optimization code was extended by adding gas turbine component models derived from a in-house developed gas turbine design code. With the two cycles coupled by the gas turbine exhaust, design parameters of both cycles were allowed to vary simultaneously to determine performance opportunity versus isolated designs. Returning to the baseline gas turbine/sCO 2 power cycle transient models: Echogen had in-house developed sCO 2 cycle transient model in GT-Suite system simulation software, and had partnered with Siemens Finspång for gas turbine transient model, and Siemens PTI group to provide micro-grid load profile as well as hybrid power cycle generated load (power and frequency) analysis. The transient model for the SGT-750 Siemens gas turbine was a “black-box” functional mock-up interface (FMI) model developed by Siemens Industrial Turbomachinery in Finspång, Sweden. The SGT-750 is a twin-shaft gas turbine that produces 40 MW electricity with an efficiency of about 40% at ISO conditions. At 100% gas turbine throttle (load), the SGT-750 has average exhaust conditions of 114.6 kg/s and 469.8°C. The transient model for sCO 2 power cycle was developed by Echogen in GT-SUITE 1D system simulation software platform. The basic CO 2 flow circuit has single-shaft turbomachinery with net 11.5 MW electrical power output at design conditions. The power turbine has a double-ended shaft with one end connected to synchronous generator through a fixed-ratio gearbox. The other end of power turbine is connected to the compressor through a continuously variable transmission. The major components of the sCO 2 power cycle modeled include air cooled condenser/cooler, CO 2 compressor, recuperator, two waste heat exchanger coils, power turbine, continuous variable transmission, gearbox and generator. Integration of SGT-750 transient model and sCO 2 power cycle transient model was done in Matlab Simulink. In the integrated model, the gas turbine and sCO 2 power cycle interacted at two points, first one being the gas turbine exhaust gas flow rate and temperature, which were inputs to sCO 2 power cycle model. The second point was the distribution of micro-grid load demand signal between the SGT-750 generator and sCO 2 cycle generator. For a given combined-cycle load demand, the gas turbine load demand was equal to the total demand minus the sCO 2 cycle power generated. In the present study the integrated model was simulated for two cases of grid load demand: (i) for a step change, both positive-step and negative-step, in grid load demand (ii) for a micro-grid load demand curve provided by Siemens PTI group. Finally, the time series plots representing load demand versus integrated system response were presented including the sCO 2 power cycle control system performance plots. The actual generated power and frequency of both the generators, gas turbine and sCO 2 power cycle, was supplied to Siemens PTI group for dynamic grid assessment, results of which are provided in appendices.
There are indications that persistent contrails can lead to adverse climate change, although the complete effect on climate forcing is still uncertain. A flight trajectory optimization algorithm with fuel and contrails models, which develops alternative flight paths, provides policy makers the necessary data to make tradeoffs between persistent contrails mitigation and aircraft fuel consumption. This study develops an algorithm that calculates wind-optimal trajectories for cruising aircraft while avoiding the regions of airspace prone to persistent contrails formation. The optimal trajectories are developed by solving a non-linear optimal control problem with path constraints. The regions of airspace favorable to persistent contrails formation are modeled as penalty areas that aircraft should avoid and are adjustable. The tradeoff between persistent contrails formation and additional fuel consumption is investigated, with and without altitude optimization, for 12 city-pairs in the continental United States. Without altitude optimization, the reduction in contrail travel times is gradual with increase in total fuel consumption. When altitude is optimized, a two percent increase in total fuel consumption can reduce the total travel times through contrail regions by more than six times. Allowing further increase in fuel consumption does not seem to result in proportionate decrease in contrail travel times.
Aircraft flying over the airspace of different countries are subject to over-flight charges. These charges vary from country to country. Airspace charges, while necessary to support the communication, navigation and surveillance services, may lead to aircraft flying routes longer than wind-optimal routes and produce additional carbon dioxide and other gaseous emissions. This paper develops an optimal route between city pairs by modifying the cost function to include an airspace cost whenever an aircraft flies through a controlled airspace without landing or departing from that airspace. It is assumed that the aircraft will fly the trajectory at a constant cruise altitude and constant speed. The computationally efficient optimal trajectory is derived by solving a non-linear optimal control problem. The operational strategies investigated in this study for minimizing aircraft fuel burn and emissions include flying fuel-optimal routes and flying cost-optimal routes that may completely or partially reduce airspace charges en route. The results in this paper use traffic data for transatlantic flights during July 2012. The mean daily savings in over-flight charges, fuel cost and total operation cost during the period are 17.6 percent, 1.6 percent, and 2.4 percent respectively, along the cost- optimal trajectories. The transatlantic flights can potentially save $600,000 in fuel cost plus $360,000 in over-flight charges daily by flying the cost-optimal trajectories. In addition, the aircraft emissions can be potentially reduced by 2,070 metric tons each day. The airport pairs and airspace regions that have the highest potential impacts due to airspace charges are identified for possible reduction of fuel burn and aircraft emissions for the transatlantic flights. The results in the paper show that the impact of the variation in fuel price on the optimal routes is to reduce the difference between wind-optimal and cost-optimal routes as the fuel price increases. The additional fuel consumption is quantified using the 30 percent variation in fuel prices during March 2014 to March 2015.
In this work, we develop a Pyomo-based non-linear optimization strategy that includes rigorous MVR models. The detailed desalination unit is integrated into the multiperiod produced water network problem using the trust region filter (TRF) method. TRF decomposes the integrated problem into a master problem consisting of the network variables and a simplified surrogate model for the detailed desalination unit. The surrogate is updated using zero and first-order corrections from the optimal solution of the detailed models at every iteration. This framework allows us to co-optimize the design of the desalination units and operating policy for the multiperiod network. A common design is ensured across all periods using global capacity constraints. We validate the solution obtained using the TRF method by solving the full integrated problem for small network instances and show our results on real case studies on produced water networks from the Permian and Appalachian basins. In this work, we describe our TRF formulation, give details on our implementation in Pyomo, and analyze the results obtained by solving the optimization problem using IPOPT. We also present a discussion on the computational efficiency and scaling using the TRF approach against a full-scale integration of the rigorous models within the water network.
The applicability and usefulness of several classical and other methods for solving the two-point boundary-value problem which arises in non-linear singularly perturbed optimal control are assessed. Specific algorithms of the Picard, Newton and averaging types are formally developed for this class of problem. The computational requirements associated with each algorithm are analysed and compared with the computational requirement of the method of matched asymptotic expansions. Approximate solutions to a linear and a non-linear problem are obtained by each method and compared.
We address problem of on-line scheduling of the aircraft descent and approach trajectory. We formulate a general multiphase optimal control problem for optimization of the descent trajectory and review available methods of its solution. We develop a fast algorithm for solution of this problem using two key components: (i) fast inference of the dynamical and control variables of the descending trajectory from the low dimensional flight profile data and (ii) efficient local search for the resulting reduced dimensionality non-linear optimization problem. We compare the performance of the proposed algorithm with numerical solution obtained using optimal control toolbox General Pseudospectral Optimal Control Software. We present results of the solution of the scheduling problem for aircraft descent using novel fast algorithm and discuss its future applications.