Search NASA⌕ Search

SEARCH · Search NASA

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Domain Aware Deep-learning Algorithms Integrated with Scientific-computing Technologies (DADAIST)

This technical report summarized the contribution of the DADAIST project funded by the Data Model Convergence Initiative via the Laboratory Directed Research and Development (LDRD) investments at Pacific Northwest National Laboratory (PNNL). Specifically, we report the development of the NeuroMANCER (Neural Modules with Adaptive Nonlinear Constraints and Efficient Regularizations), a new open-source Scientific Machine Learning library for formulating and solving parametric constrained optimization problems, physics-informed system identification, and parametric optimal control problems. NeuroMANCER is using differentiable programming to combine modern data-driven models and optimization modeling language into a coherent algorithmic and software framework. NeuroMANCER is a Pytorch-based framework and adopts much of its philosophy focused on research and development, rapid prototyping, and streamlined deployment. Strong emphasis is given to extensibility, interoperability with the PyTorch ecosystem, and quick adaptability to custom domain problems. Neuromancer repository contains a comprehensive library of differentiable modules, including custom activation functions, matrix factorizations, deep learning architectures, neural differential equations, differential equation solvers, implicit layers such as iterative solvers, high-level API for symbolic expressions, API for modeling and control of dynamical systems, and extensive set of tutorial code examples in the form of python scripts and jupyter notebooks.

97 MATHEMATICS AND COMPUTING↗

grim: A Flexible, Conservative Scheme for Relativistic Fluid Theories

Hot, diffuse, relativistic plasmas such as sub-Eddington black-hole accretion flows are expected to be collisionless, yet are commonly modeled as a fluid using ideal general relativistic magnetohydrodynamics (GRMHD). Dissipative effects such as heat conduction and viscosity can be important in a collisionless plasma and will potentially alter the dynamics and radiative properties of the flow from that in ideal fluid models; we refer to models that include these processes as Extended GRMHD. Here we describe a new conservative code, grim, that enables all of the above and additional physics to be efficiently incorporated. grim combines time evolution and primitive variable inversion needed for conservative schemes into a single step using an algorithm that only requires the residuals of the governing equations as inputs. This algorithm enables the code to be physics agnostic as well as flexibility regarding time-stepping schemes. grim runs on CPUs, as well as on GPUs, using the same code. We formulate a performance model and use it to show that our implementation runs optimally on both architectures. grim correctly captures classical GRMHD test problems as well as a new suite of linear and nonlinear test problems with anisotropic conduction and viscosity in special and general relativity. As tests and example applications, we resolve the shock substructure due to the presence of dissipation, and report on relativistic versions of the magneto-thermal instability and heat flux driven buoyancy instability, which arise due to anisotropic heat conduction, and of the firehose instability, which occurs due to anisotropic pressure (i.e., viscosity). Finally, we show an example integration of an accretion flow around a Kerr black hole, using Extended GRMHD.

79 ASTRONOMY AND ASTROPHYSICS↗

MOOSE Framework Speed and Memory Optimizations

The Multiphysics Object Oriented Simulation Environment (MOOSE) framework has been developed to solve a variety of complex simulations ranging from groundwater flows to full reactor simulations. MOOSE excels at solving fully-implicit, fully-coupled, highly nonlinear models using the Jacobian Free Newton-Krylov (JFNK) method relying on years of expertise in several dependent packages including PETSc, libMesh, Hypre and many others. The modular design of MOOSE enables the rapid development of new physics models that can be coupled with relative ease within the framework for building up simulations of different levels of complexity. With the ongoing adoption of MOOSE to new application areas along with streamlining of existing simulations, the priorities must be adjusted to include code optimizations. This includes both execution speed and the memory footprint of MOOSE-based simulations. These two categories can be further broken down into ''micro-optimizations'' or source code optimizations and algorithmic optimizations where source code is restructured to accomplish the same tasks through a more efficient means. However, before any code optimizations can occur, one must have robust way of measuring these critical simulation properties to identify the best candidates for optimizations along with having a way to identify the effectiveness of proposed optimizations to the framework. This report discusses the preliminary work towards the implementation of a robust execution baseline of the framework and derivative applications under a variety of different simulations. In addition, several potential optimization target areas in both the MOOSE framework and dependent libraries have been identified. An implementation strategy and potential benefits are discussed.

97 MATHEMATICS AND COMPUTING↗

Variational Self-Consistent Theory for Beam-Loaded Cavities

A new variational theory is presented for beam loading in microwave cavities. The beam{field interaction is formulated as a dynamical interaction whose stationarity according to Hamilton’s principle will naturally lead to steady-state solutions that indicate how a cavity’s resonant frequency, Q and optimal coupling coefficient will detune as a result of the beam loading. A driven cavity Lagrangian is derived from first principles, including the effects of cavity wall losses, input power and beam interaction. The general formulation is applied to a typical klystron input cavity to predict the appropriate detuning parameters required to maximize the gain (or modulation depth) in the average Lorentz factor boost, (Δ γ). Numerical examples are presented, showing agreement with the general detuning trends previously observed in the literature. The developed formulation carries several advantages for beam-loaded cavity structures. It provides a self-consistent model for the dynamical (nonlinear) beam{field interaction, a procedure for maximizing gain under beam-loading conditions, and a useful set of parameters to guide cavity-shape optimization during the design of beam-loaded systems. Enhanced clarity of the physical picture underlying the problem seems to be gained using this approach, allowing straightforward inclusion or exclusion of different field configurations in the calculation and expressing the final results in terms of measurable quantities. Two field configurations are discussed for the klystron input cavity, using finite magnetic confinement or no confinement at all. Formulating the problem in a language that is directly accessible to the powerful techniques found in Hamiltonian dynamics and canonical transformations may potentially carry an additional advantage in terms of analytical computational gains, under suitable conditions

43 PARTICLE ACCELERATORS↗

Direct X-B mode conversion for high-β national spherical torus experiment in nonlinear regime

Electron Bernstein wave (EBW) can be effective for heating and driving currents in spherical tokamak plasmas. Power can be coupled to EBW via mode conversion of the extraordinary (X) mode wave. The most common and successful approach to study the conditions for optimized mode conversion to EBW was evaluated analytically and numerically using a cold plasma model and an approximate kinetic model. The major drawback in using radio frequency waves was the lack of continuous wave sources at very high frequencies (above the electron plasma frequency), which has been addressed. A future milestone is to approach high power regime, where the nonlinear effects become significant, exceeding the limits of validity for present linear theory. Therefore, one appropriate tool would be particle in cell (PIC) simulation. The PIC method retains most of the nonlinear physics without approximations. In this work, we study the direct X-B mode conversion process stages using PIC method for incident wave frequency f{sub 0} = 15 GHz, and maximum amplitude E{sub 0} = 10{sup 5 }V/m in the national spherical torus experiment (NSTX). The modelling shows a considerable reduction in X-B mode conversion efficiency, C{sub modelling} = 0.43, due to the presence of nonlinearities. Comparison of system properties to the linear state reveals predominant nonlinear effects; EBW wavelength and group velocity in comparison with linear regime exhibit an increment around ∼36% and 17%, respectively.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Synergistic Integration of Multiple Wave Energy Converters with Adaptive Resonance and Offshore Floating Wind Turbines through Bayesian Optimization

We developed a synergistic ocean renewable system where an array of Wave Energy Converters (WEC) with adaptive resonance was collocated with a Floating Offshore Wind Turbine (FOWT) such that the WECs, capturing wave energy through the resonance adapting to varying irregular waves, consequently reduced FOWFT loads and turbine motions. Combining Surface-Riding WECs (SR-WEC) individually designed to feasibly relocate their natural frequency at the peak of the wave excitation spectrum for each sea state, and to obtain the highest capture width ratio at one of the frequent sea states for annual average power in a tens of kilowatts scale with a 15 MW FOWT based on a semi-submersible, Bayesian Optimization is implemented to determine the arrangement of WECs that minimize the annual representation of FOWT’s wave excitation spectra. The time-domain simulation of the system in the optimized arrangement is performed, including two sets of interactions: one set is the wind turbine dynamics, mooring lines, and floating body dynamics for FOWT, and the other set is the nonlinear power-take-off dynamics, linear mooring, and individual WECs’ floating body dynamics. Those two sets of interactions are further coupled through the hydrodynamics of diffraction and radiation. For sea states comprising Annual Energy Production, we investigate the capture width ratio of WECs, wave excitation on FOWT, and nacelle acceleration of the turbine compared to their single unit operations. We find that the optimally arranged SR-WECs reduce the wave excitation spectral area of FOWT by up to 60% and lower the turbine’s peak nacelle acceleration by nearly 44% in highly occurring sea states, while multiple WECs often produce more than the single operation, achieving adaptive resonance with a larger wave excitation spectra for those sea states. The synergistic system improves the total Annual Energy Production (AEP) by 1440 MWh, and we address which costs of Levelized Cost Of Energy (LCOE) can be reduced by the collocation.

Engineering↗

Modeling the Yaw Behavior of Tail Fins for Small Wind Turbines: November 22, 2021 - May 21, 2024

This report describes the aerodynamic modelling of the yaw behavior of tail fins for small wind turbines (SWTs). The analysis is based on unsteady slender body theory (USBT) and is formulated to be used with the proposed tail fin module to be added to OpenFAST. Linearized USBT, which has been applied in the past to SWT tail fins, is developed in three main ways. First, USBT is extended to high yaw angles and aspect ratios by modelling the associated nonlinear vortex dynamics and the chordwise load distribution respectively. Second, we consider the effect of time-varying wind speed. The extended theory is compared to recent unpublished measurements at the University of Perugia, Italy, for the yaw behavior of delta, elliptical, and rectangular tail fins without a rotor and nacelle. The fins were released from initial yaw angles of -40 degrees and -80 degrees ; the latter is of sufficient magnitude to show the importance of the nonlinear yaw dynamics. Further, the friction in the model tail fin bearings was measured and modelled. The constants in the aerodynamic models were taken from the literature but significant improvement in accuracy is achieved by using system identification techniques to optimize the values. This leads to the third main finding: extended USBT is accurate for all generic tail fin shapes that we considered and is, therefore, very suitable for inclusion in aeroelastic codes for SWTs. The final development is of a general nonlinear equation for yaw response that is simpler than the extended USBT and is also suitable for inclusion in OpenFAST. The two nonlinear models are used to highlight the geometric requirements for good tail fin design.

distributed wind↗

Causal control design for wave energy converters with finite stroke

Control design is of central importance in the optimization of power generation from ocean wave energy converters (WECs). The problem is made challenging by the fact that the resource is vibratory and stochastic, with a low quality factor. It has recently been shown that when constrained to causality, the optimal feedback controller for a WEC is solvable in closed-form as a sign-indefinite LQG problem, for the case in which the WEC exhibits linear dynamics and quadratic power transmission dissipation. However, most WECs exhibit stroke limits, which must be explicitly accounted for in control design to avoid end-stop collisions. This is important because such collisions lead to damage, and also because the introduction of unmodeled stroke limits can actually destabilize the otherwise-optimal closed loop. We illustrate a control design technique to address this issue, which consists of two design steps. In the first step, LMI techniques are used to optimize the mean power harvested from waves with a known power spectral density, subject to several competing objectives. In the second step, the controller is augmented via a nonlinear passivity-based outer-loop design which guarantees to prevent stroke saturation while also guaranteeing to preserve closed-loop stability. Furthermore, the technique is illustrated using a model of a simple heaving point absorber, and verified in simulation.

16 TIDAL AND WAVE POWER↗

Principles of the radiative ablation modeling

Indirectly driven inertial confinement fusion (ICF) rests on the setting up of a radiation temperature within a laser cavity and on the optimization of the capsule implosion ablated by this radiation. In both circumstances, the ablation of an optically thick medium is at work. The nonlinear radiation conduction equations that describe this phenomenon admit different kinds of solutions called generically Marshak waves. In this paper, a completely analytic model is proposed to describe the ablation in the subsonic regime relevant to ICF experiments. This model approximates the flow by a deflagrationlike structure where Hugoniot relations are used in the stationary part from the ablation front up to the isothermal sonic Chapman-Jouguet point and where the unstationary expansion from the sonic point up to the external boundary is assumed quasi-isothermal. It uses power law matter properties. It can also accommodate arbitrary boundary conditions provided the ablation wave stays very subsonic and the surface temperature does not vary too quickly. These requirements are often met in realistic situations. Interestingly, the ablated mass rate, the ablation pressure, and the absorbed radiative energy depend on the time history of the surface temperature, not only on the instantaneous temperature values. The results compare very well with self-similar solutions and with numerical simulations obtained by hydrodynamic code. This analytic model gives insight into the physical processes involved in the ablation and is helpful for optimization and sensitivity studies in many situations of interest: radiation temperature within a laser cavity, acceleration of finite size medium, and ICF capsule implosion, for instance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A trust region algorithm for PDE-constrained optimization with bound constraints using reduced order modeling

This paper presents a novel trust region algorithm that relies on proper orthogonal de-composition techniques to construct accurate reduced order models during optimization.The algorithm samples high fidelity snapshots to compute the POD functions that are used to generate reduced order models. The reduced order models are used to replace the computationally intensive high fidelity finite element evaluations during optimization.The proposed algorithm employs a trust region framework to detect loss in predictive ac-curacy in the reduced order model and automatically update the POD functions during optimization. The trust region framework allows the algorithm to use sound mathematical metrics to effectively improve the accuracy and robustness of the reduced order models during optimization. The algorithm also employs a projected gradient algorithm to model bound constraints and compute optimal and feasible controls.This paper also presents an accurate Hessian formulation for topology optimization problems. The proposed trust region framework relies on a quadratic model to update the control. This quadratic model needs reliable second order derivative information to predict the behavior of the objective function within a suitable trust region. If a nonlinear Hessian formulation is used, the computational effort increases due to additional finite element evaluations. The proposed linear Hessian formulation reduces the computational effort and enables the calculation of the second order derivative information without additional finite element model evaluations. Examples in topology optimization are presented to demonstrate the applicability of the proposed algorithm and linear Hessian formulation for large-scale PDE-constrained optimization.

bound constraints↗

Models and Strategies for Optimal Demand Side Management in the Chemical Industries

Deregulation and the increase of renewable electricity generation from wind and solar photovoltaics have transformed the U.S. electricity market. Economic and environmental benefits notwithstanding, the presence of renewables has increased variability and uncertainty on the supply side of the grid. Managing demand, rather than generation – a strategy referred to as “demand response (DR)” – is an attractive approach for mitigating this imbalance. DR efforts aim to reduce electricity usage during peak demand times, lessening stress on the grid. Industrial users are particularly attractive entities for DR participation since they present large, localized loads that can provide significant relief on grid demand and –unlike other large loads, such as buildings – are minimally dependent on human needs and preferences. In this project, we accomplished three main objectives. (1) We developed data-driven low-order DR scheduling-relevant dynamic models of chemical processes. Concurrently, we studied the formulation and solution of the associated optimal DR production scheduling problems. (a) A prototype air separation unit (ASU) model was used to generate simulated operating data for initial modeling efforts, which enabled the later use of industrial data for data-driven modeling. (b) We utilized Hammerstein-Wiener (HW) and Finite Step Response (FSR) models to represent nonlinear plant dynamics. (c) The HW models were linearized using exact linearization so they could potentially be embedded in power system models, which are formulated as mixed integer linear programs (MILPs). (d) We solved DR optimization problems under uncertainty and found that even naïve predictions of electricity price and product demand led to significant cost savings benefits. (2) Our DR scheduling optimization problem formulations are amenable to real-time solution. (a) We utilized Lagrangian Relaxation (LR) to efficiently solve the optimization problem by decoupling subproblems linked by complicating constraints. (b) We have achieved computation times for the 3-day DR scheduling problem of an ASU as low as 1.88 minutes. (3) Our representations of the DR behavior of chemical process as grid-level batteries were embedded in power system models. (a) For a small-scale grid, we found that incorporating the dynamics of the chemical plant in the optimal power flow calculations resulted in better resource management leading to up to 15% and 46% cost reduction for the grid and chemical plant operations, respectively, during periods of power line congestion. We have published several works dedicated to modeling and solving DR optimization problems from the user side. These were published in top peer-reviewed journals and are summarized in this report. The most recent work (and papers in preparation) considers DR scheduling from the grid side. Future efforts will consider networked plants (e.g., air separation units operating on a common pipeline) for DR participation, which is expected to amplify the capabilities of industrial DR participants to perform load-shifting. Our consideration of uncertainty in DR has inspired future directions in this area as well: we plan to develop multistage methods to fully account for the effects of uncertainty in DR scheduling.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The mimetic finite difference method for elliptic and parabolic problems with a staggered discretization of diffusion coefficient

Numerical schemes for nonlinear parabolic equations based on the harmonic averaging of cell-centered diffusion coefficients break down when some of these coefficients go to zero or their ratio grows. To tackle this problem, we propose new mimetic finite difference schemes that use a staggered discretization of the diffusion coefficient. The primary mimetic operator approximates div (k•); the derived (dual) mimetic operator approximates - ∇(•). The new mimetic schemes preserve symmetry and positive-definiteness of the continuum problem which allows us to use algebraic solvers with optimal complexity. We perform detailed numerical analysis of the new schemes for linear elliptic problems and a specially designed linear parabolic problem that has solution dynamics typical for nonlinear problems. We also show that the new schemes are competitive with the state-of-the-art schemes for steady-state problems but provide much more accurate solution dynamics for the transient problem.

97 MATHEMATICS AND COMPUTING↗

Deep Learning enabled spectral energy conversion for in situ exposure measurements

A detector-specific deep learning (DL) approach is presented for spectra-to-exposure conversion using large-format sodium iodide (NaI(Tl)) detectors deployed for in situ environmental radiation measurements in emergency response scenarios. Accurate determination of exposure from NaI spectra is challenging due to poor energy resolution, partial energy absorption, and the strong sensitivity of traditionally deployed analytical conversion methods to calibrated source geometry and pre-deployment assumptions. Here, to address these limitations, a multi-layer perceptron model was trained on a hybrid in situ /Monte Carlo dataset constructed to span a broad range of photon energies, spatial extents, and realistic deployment variability, representative of general in situ emergency response conditions. The DL model was evaluated against commonly fielded analytical approaches under matched simulation conditions, including a single-factor method, a G-function method, and a modeled pressurized ion chamber (PIC) baseline. This study was intentionally computational in scope to enable controlled, like-for-like comparisons between conversion techniques while minimizing confounding real-world variability. Comparison to the modeled PIC provides contextual benchmarking and is not intended as a field inter-comparison with deployed instruments. Across the evaluated 20 keV to 3 MeV energy range, the DL approach consistently exhibited higher accuracy and reduced variance relative to the analytical methods against a deterministically calculated exposure. This may indicate improved robustness to spectral complexity without reliance on source-, geometric-, or spectral region-specific optimization. While results do not represent real-world validation, the presented work demonstrates that deep learning may effectively learn the nonlinear detector response-to-exposure relationship for asymmetric NaI(Tl) detectors and offers a promising pathway for improving in situ exposure estimation using spectroscopic systems already integrated into initial real-time emergency response operations.

61 RADIATION PROTECTION AND DOSIMETRY↗

Discarding Information from Previous Iterations in an Optimal Way To Solve the Coupled Cluster Amplitude Equations

The direct inversion of the iterative subspace (DIIS) convergence acceleration algorithm is used in most electronic structure programs to solve the nonlinear coupled cluster amplitude equations. When the DIIS algorithm is used, the storage of previous trial vectors may become a bottleneck and the discarding of trial vectors may lead to a degradation of the convergence or even divergence. Here, we discuss an alternative way of storing information from trial vectors where only the last three trial vectors are needed to maintain the convergence of the full set of previous trial vectors, and which requires only minor modifications of an existing DIIS code

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stoichiometrically-informed symbolic regression for extracting chemical reaction mechanisms from data

A data-driven computational method is introduced to extract chemical reaction mechanisms from time series chemical concentration data. It is realized through the use of dynamic symbolic regression in which a sparse analytical form for a dynamical system is discoverable from the underlying data. We specifically develop the stoichiometrically-informed symbolic regression (SISR) method to address a standing challenge in complex chemical reaction networks: given a time-series dataset of concentrations of several components, what is the mechanism and the associated rate constants? SISR finds the optimal mechanism, kinetic equations and rate constants by combining differential optimization with a genetic optimization approach that searches a symbolic space of possible reaction mechanisms. Use of SISR in several paradigmatic examples spanning linear and nonlinear reaction schemes results in excellent agreement between true and predicted mechanisms, including when the method is applied to noisy data. The advantages of a stoichiometrically-informed approach such as SISR to address reaction discovery is illustrated through comparison with the use of generic state-of-the-art data-driven approaches.

36 MATERIALS SCIENCE↗

Asymptotic solution for heat convection-radiation equation

In this paper, we employ a new approximate analytical method called the optimal homotopy asymptotic method (OHAM) to solve steady state heat transfer problem in slabs. The heat transfer problem is modeled using nonlinear two-point boundary value problem. Using OHAM, we obtained the approximate analytical solution for dimensionless temperature with different values of a parameter ε. Further, the OHAM results for dimensionless temperature have been presented graphically and in tabular form. Comparison has been provided with existing results from the use of homotopy perturbation method, perturbation method and numerical method. For numerical results, we used Runge-Kutta Fehlberg fourth-fifth order method. It was found that OHAM produces better approximate analytical solutions than those which are obtained by homotopy perturbation and perturbation methods, in the sense of closer agreement with results obtained from the use of Runge-Kutta Fehlberg fourth-fifth order method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Adaptive PID Gain Scheduling Control for Hydropower Turbine Using Neural CDE and Stochastic Distribution Shaping

This paper introduces a gain-scheduling PID controller design strategy for hydroturbine frequency control mode. This scheme first uses real data to learn the nonlinear dynamics of the hydroturbine using neural controlled differential equations and then perturbs the obtained nonlinear system at different equilibrium points, based on which a static output feedback adaptive dynamic programming algorithm is then used to optimize the PID gains for each equilibrium point. Moreover, a continuous-time version of stochastic distribution control is proposed to further fine-tune the optimized PID gains. Finally, the controller is obtained by implementing linear interpolation between the optimized PID control gains. The simulation results show that the proposed gain-scheduling PID controller can control a larger range of operation points compared with the given fixed PID controller and the baseline method. Compared with the given fixed PID controller, the proposed gain-scheduling PID controller can regulate hydroturbine frequency against disturbances induced by power-load variation with over 50% less overshoot for some operation points.

13 HYDRO ENERGY↗