Search NASA⌕ Search

SEARCH · Search NASA

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Plasma assisted NH 3 /H 2 /air ignition in nanosecond discharges with non-equilibrium energy transfer

Ammonia (NH 3 ), with its high energy density and easiness to store and transport as a hydrogen carrier, has become a promising alternative green fuel. However, its adoption in power generation is hindered by challenges such as low burning velocity, slow low-temperature oxidation, high NO x emissions, and ignition difficulty. Here, this work computationally investigates the effects of non-equilibrium energy transfer by nanosecond discharges on NH 3 ignition and flame propagation in an NH 3 /H 2 /air flow at 700 K and 1 atm. The simulation results demonstrate that NH 3 /air mixtures require a large ignition energy due to their large critical ignition radius. It is shown that adding 30 % hydrogen significantly reduces the critical ignition radius and minimum ignition energy. Two-dimensional modeling further shows a non-monotonic dependence of ignition kernel volume on the applied voltage and reduced electric field. The optimum ignition enhancement occurs at 200 Td where the generation of electronically excited species and radicals including N 2 (B), O( 1 D) and OH becomes most efficient. Higher voltages divert electron energy toward ionization, which makes it less effective for NH 3 ignition. The study also identifies an optimal electrode gap size for a given pulse energy. Smaller gap sizes increase deposited energy density, raising temperature and radical concentrations. However, excessive reduction of the gap distance reduces flame propagation speed due to the flame stretch effect in rich mixtures with the effective Lewis number greater than unity. A nonlinear relationship between pulse repetition frequency and ignition kernel volume is observed in a nanosecond pulsed high frequency discharge (NPHFD). An optimal frequency range of 200 kHz to 2 MHz is found when two pulses are used. In addition, an optimal number of pulses exists for each pulse repetition frequency, with higher frequencies requiring more pulses to maximize the overlap region. These findings provide critical insights on developing controlled plasma discharge techniques for efficient NH 3 ignition in reactive flows within internal combustion engines and gas turbines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling and analysis of mixed convection stagnation point flow of nanofluid towards a stretching surface: OHAM and FEM approach

A theoretical study of mixed convection stagnation point flow towards a stretching surface is presented. The governing boundary layer equations are transformed into a set of highly nonlinear ordinary differential equations using suitable similarity transforms. The semi-analytical solution is obtained using optimal homotopy analysis method (OHAM) and the numerical solution is obtained via finite element method (FEM). Solutions obtained via two different approaches are in excellent agreement, which validates the accuracy of present analysis. In a special case, the present OHAM solution is also validated with the earlier available results. Effect of pertinent flow parameters on the skin friction coefficient and Nusselt number is presented in tabular form, whereas the velocity, temperature and nanoparticle distribution are presented in graphical forms. Further, a quadratic multiple regression analysis on numeric data of skin friction coefficient and Nusselt number is performed. The findings suggest that velocity slip assists the fluid motion in presence of buoyancy forces, whereas it exhibits a retarding nature on fluid motion when no buoyancy forces exist.

97 MATHEMATICS AND COMPUTING↗

Optimal design and dispatch of a system of diesel generators, photovoltaics and batteries for remote locations

Renewable energy technologies, specifically, solar photovoltaic cells, combined with battery storage and diesel generators, form a hybrid system capable of independently powering remote locations, i.e., those isolated from larger grids. If sized correctly, hybrid systems reduce fuel consumption compared to diesel generator-only alternatives. We present an optimization model for establishing a hybrid power design and dispatch strategy for remote locations, such as a military forward operating base, that models the acquisition of different power technologies as integer variables and their operation using nonlinear expressions. Our cost-minimizing, nonconvex, mixed-integer, nonlinear program contains a detailed battery model. Due to its complexities, we present linearizations, which include exact and convex under-estimation techniques, and a heuristic, which determines an initial feasible solution to serve as a “warm start” for the solver. We determine, in a few hours at most, solutions within 5% of optimality for a candidate set of technologies; these solutions closely resemble those from the nonlinear model. Lastly, our instances contain real data spanning a yearly horizon at hour fidelity and demonstrate that a hybrid system could reduce fuel consumption by as much as 50% compared to a generator-only solution.

14 SOLAR ENERGY↗

A collision timing monitor for SuperKEKB

The analysis of beamstrahlung radiation, emitted from a beam of charged particles due to the electromagnetic interaction with a second beam of charged particles, provides a diagnostic tool that can be used to monitor beam–beam collisions in a e + e - storage ring. In this paper we show that the beamstrahlung time profile is related to the timing of the collisions and the length of the beams, and how its measurement can be used to monitor and optimize collisions at the interaction point of the SuperKEKB collider. The method has a unique passive monitor capability, since it allows to monitor the timing of the collision without disturbing (scanning) the beam–beam timing, which needs to be measured to unprecedented accuracy at SuperKEKB. To measure the time dependence of beamstrahlung, here we describe a method based on nonlinear frequency mixing in a nonlinear crystal of beamstrahlung radiation with photons from a pulsed laser. We demonstrate that the method allows to measure and optimize the relative timing and length of the colliding bunches with 3% accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Real-time Optimal Dispatch of Behind-the-Meter DERs for Secondary Frequency Regulation

Active distribution networks (ADNs) can provide grid services such as peak load shaving, loss reduction, VoltNar control, congestion management, and frequency regulation. The fast response of inverter-based distributed energy resources (DERs) and battery storage systems enables them to provide ramping support and frequency control. This paper proposes a real-time optimization approach for behind-the-meter DERs to participate in the secondary frequency regulation. The proposed approach determines optimal set-points of output power of DERs to respond to requests from system operators (SOs) in realtime to maintain the frequency of the system at the nominal value. To satisfy the real-time requirement for the secondary frequency control, the nonlinear AC power flow model is linearized considering power losses in the system to achieve both high computational speed and acceptable accuracy. The optimization problem is rerun in a closed loop manner until the mismatch between the requested power by the system operators and actual delivered power at the substation reaches an acceptable tolerance. Furthermore, the proposed approach is validated using modified versions of the IEEE 33-bus and IEEE 69-bus distribution systems. Although the contribution of a single distribution system in the frequency regulation may not be significant, stacked and coordinated contributions from several distribution systems can provide frequency regulation and other grid services at scale.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Probing dense plasmas for HEDS and ICF*

This paper is a retrospective of almost four decades of conceptualization and development of active x-ray probing of dense plasmas, involving multiple teams. In hindsight it was a surprisingly nonlinear and nonsystematic progression, with cycles of key epiphanies followed by multi-step technique optimization, spanning years.Further, each new idea or endeavor, whether or not realized / successful, spawned the next, and not necessarily in order of difficulty. The journey can be summarized by adapting/paraphrasing what Edward Teller said about NIF, that we develop new capabilities precisely because we don't know what those capabilities will enable.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Effect of nonlinear chirped Gaussian laser pulse on plasma wake field generation

An ultrashort laser pulse propagating in plasma can excite a nonlinear plasma wake field which can accelerate charged particles up to GeV energies within a compact space compared to the conventional accelerator devices. In this paper, the effect of different kinds of nonlinear chirped Gaussian laser pulse on wake field generation is investigated. The numerical analysis of our results depicts that the excitation of plasma wave with large and highly amplitude can be accomplished by nonlinear chirped pulses. The maximum amplitude of excited wake in nonlinear chirped pulse is approximately three times more than that of linear chirped pulse. In order to achieve high wake field generation, chirp parameters and functions should be set to optimal values.

36 MATERIALS SCIENCE↗

Frequency stabilization of spin-torque-driven oscillations by coupling with a magnetic nonlinear resonator

The fundamental function of any oscillator is to produce a waveform with a stable frequency. Here, we show a method of frequency stabilization for spin-torque nano-oscillators (STNOs) that relies on coupling with an adjacent nanomagnet through the magnetic dipole–dipole interaction. It is numerically demonstrated that highly stable oscillations occur as a result of mutual feedback between an STNO and a nanomagnet. The nanomagnet acts as a nonlinear resonator for the STNO. This method is based on the nonlinear behavior of the resonator and can be considered as a magnetic analogue of an optimization scheme in nanoelectromechanical systems. The oscillation frequency is most stabilized when the nanomagnet is driven at a special feedback point at which the feedback noise between the STNO and resonator is completely eliminated.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Development of New Magnetron Sputter Deposition Processes for Laser Target Fabrication

Magnetron sputter deposition is an enabling technology for laser target fabrication. Solutions are readily available for the deposition of most sub-micron-thick elemental films on planar substrates. However, major challenges still remain for the development of robust deposition processes in regimes of ultrathick (over ~10 μm) coatings and nonplanar substrates. These challenging deposition regimes are directly relevant to laser target applications, including both sphero-cylindrical hohlraums and spherical ablators for inertial confinement fusion (ICF) targets. Understanding underlying physical mechanisms for a specific material system is crucial for process development, given the overall complexity of the deposition process, its nonlinear dependence on deposition parameters, and a very large process space, often precluding conventional process optimization approaches. Here, we describe our approach to developing new deposition processes and give practical advice with examples of new results from our ongoing studies of glassy boron carbide ceramics for next-generation ICF ablators and nonequilibrium gold-tantalum alloys for hohlraums for magnetized ICF schemes. Emphasis is given to two major challenges of ultrathick coatings related to achieving process stability and reducing residual stress.

36 MATERIALS SCIENCE↗

Design and simulation of the snowflake divertor control for NSTX-U

This study presents the development of a physics-based multiple-input-multiple-output algorithm for real-time feedback control of snowflake divertor (SFD) configurations on the National Spherical Torus eXperiment Upgrade (NSTX-U). A model of the SFD configuration response to applied voltages on the divertor control coils is first derived and then used, in conjunction with multivariable control synthesis techniques, to design an optimal state feedback controller for the configuration. To demonstrate the capabilities of the controller, a nonlinear simulator for axisymmetric shape control was developed for NSTX-U which simultaneously evolves the currents in poloidal field coils based upon a set of feedback-computed voltage commands, calculates the induced currents in passive conducting structures, and updates the plasma equilibrium by solving the free-boundary Grad-Shafranov problem. Closed-loop simulations demonstrate that the algorithm enables controlled operations in a variety of SFD configurations and provides capabilities for accurate tracking of time-dependent target trajectories for the divertor geometry. In particular, simulation results suggest that a time-varying controller which can properly account for the evolving SFD dynamical response is not only desirable but necessary for achieving acceptable control performance. The algorithm presented in this paper has been implemented in the NSTX-U Plasma Control System in preparation for future control and divertor physics experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Adiabatic splitting, transport, and self-trapping of a Bose-Einstein condensate in a double-well potential

We show that the adiabatic dynamics of a Bose-Einstein condensate (BEC) in a double-well potential can be described in terms of a dark variable resulting from the combination of the population imbalance and the spatial atomic coherence between the two wells. By means of this dark variable, we extend, to the nonlinear matter-wave case, the recent proposal by Vitanov and Shore [Phys. Rev. A 73, 053402 (2006)] on adiabatic passage techniques to coherently control the population of two internal levels of an atom or molecule. We investigate the conditions to adiabatically split or transport a BEC as well as to prepare an adiabatic self-trapping state by the optimal delayed temporal variation of the tunneling rate via either the energy bias between the two wells or the BEC nonlinearity. The emergence of nonlinear eigenstates and unstable stationary solutions of the system as well as their role in the breaking down of the adiabatic dynamics is investigated in detail.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Self-replication with magnetic dipolar colloids

Colloidal self-replication represents an exciting research frontier in soft matter physics. Currently, all reported self-replication schemes involve coating colloidal particles with stimuli-responsive molecules to allow switchable interactions. In this paper, we introduce a scheme using ferromagnetic dipolar colloids and preprogrammed external magnetic fields to create an autonomous self-replication system. Interparticle dipole-dipole forces and periodically varying weak-strong magnetic fields cooperate to drive colloid monomers from the solute onto templates, bind them into replicas, and dissolve template complexes. We present three general design principles for autonomous linear replicators, derived from a focused study of a minimalist sphere-dimer magnetic system in which single binding sites allow formation of dimeric templates. We show via statistical models and computer simulations that our system exhibits nonlinear growth of templates and produces nearly exponential growth (low error rate) upon adding an optimized competing electrostatic potential. Lastly, we devise experimental strategies for constructing the required magnetic colloids based on documented laboratory techniques. We also present qualitative ideas about building more complex self-replicating structures utilizing magnetic colloids.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Strategies for the in-orbit gain tracking using the modulated X-ray sources for the Resolve microcalorimeter spectrometer on the X-ray Imaging and Spectroscopy Mission

Accurate and precise correction of the gain drift is the key to achieve the required energy resolution of the Resolve microcalorimeter spectrometer on the X-ray Imaging and Spectroscopy Mission (XRISM). Therefore, Resolve is equipped with highly configurable X-ray sources called the modulated X-ray source (MXS). The pulsed nature allows us to separate calibration and astrophysical X-rays by time interval selections. However, undesirable characteristics of the MXS, such as the afterglow X-rays, restrict the allowed configuration range. Moreover, the nonlinear and discontinuous behaviors of the calibration line count rate make the determination of the optimal setting highly complex. The MXS count rate model has been established using measurements in the spacecraft thermal vacuum test with the flight detector and MXS. A trade-off study using the model enables us to choose a few settings for the continuous use of the MXS optimized for different ranges of target gain tracking intervals. An alternative approach, where the MXS is used only intermittently, has also been developed and implemented. This new mode enables us to reconstruct the drift without having most of the undesirable effects in science data. This also forms the basis of the gain tracking under the current Resolve configuration with the closed gate valve.

Astronomy and AstroPhysics↗

Design and simulation of the snowflake divertor control for NSTX-U

This paper presents the development of a physics-based multiple-input-multiple-output algorithm for real-time feedback control of snowflake divertor (SFD) configurations on the National Spherical Torus eXperiment Upgrade (NSTX-U). A model of the SFD configuration response to applied voltages on the divertor control coils is first derived and then used, in conjunction with multivariable control synthesis techniques, to design an optimal state feedback controller for the configuration. To demonstrate the capabilities of the controller, a nonlinear simulator for axisymmetric shape control was developed for NSTX-U which simultaneously evolves the currents in poloidal field coils based upon a set of feedback-computed voltage commands, calculates the induced currents in passive conducting structures, and updates the plasma equilibrium by solving the free-boundary Grad-Shafranov problem. Closed-loop simulations demonstrate that the algorithm enables controlled operations in a variety of SFD configurations and provides capabilities for accurate tracking of time-dependent target trajectories for the divertor geometry. In particular, simulation results suggest that a time-varying controller which can properly account for the evolving SFD dynamical response is not only desirable but necessary for achieving acceptable control performance. The algorithm presented in this paper has been implemented in the NSTX-U Plasma Control System in preparation for future control and divertor physics experiments.

snowflake divertor, MIMO feedback control, nonline↗

Progressive transfer learning for low-frequency data prediction in full waveform inversion

To effectively overcome the cycle-skipping issue in full waveform inversion (FWI), we developed a deep neural network (DNN) approach to predict the absent low-frequency components by exploiting the hidden physical relation connecting the low- and the high-frequency data. To efficiently solve this challenging nonlinear regression problem, two novel strategies were proposed to design the DNN architecture and to optimize the learning process: (1) dual data feed structure; (2) progressive transfer learning. With the dual data feed structure, not only the high-frequency data, but also the corresponding beat tone data are fed into the DNN to relieve the burden of feature extraction. The second strategy, progressive transfer learning, enables us to train the DNN using a single evolving training dataset. Within the framework of the progressive transfer learning, the training dataset continuously evolves in an iterative manner by gradually retrieving the subsurface information through the physics-based inversion module, progressively enhancing the prediction accuracy of the DNN and propelling the inversion process out of the local minima. Here, the synthetic numerical experiments suggest that, without any a priori geological information, the low-frequency data predicted by the progressive transfer learning are sufficiently accurate for an FWI engine to produce reliable subsurface velocity models free of cycle-skipping artifacts.

02 PETROLEUM↗

Solution of monotone complementarity and general convex programming problems using a modified potential reduction interior point method

We present a homogeneous algorithm equipped with a modified potential function for the monotone complementarity problem. We show that this potential function is reduced by at least a constant amount if a scaled Lipschitz condition (SLC) is satisfied. A practical algorithm based on this potential function is implemented in a software package named iOptimize. The implementation in iOptimize maintains global linear and polynomial time convergence properties, while achieving practical performance. It either successfully solves the problem, or concludes that the SLC is not satisfied. When compared with the mature software package MOSEK (barrier solver version 6.0.0.106), iOptimize solves convex quadratic programming problems, convex quadratically constrained quadratic programming problems, and general convex programming problems in fewer iterations. Moreover, several problems for which MOSEK fails are solved to optimality. In addition, we also find that iOptimize detects infeasibility more reliably than the general nonlinear solvers Ipopt (version 3.9.2) and Knitro (version 8.0).

97 MATHEMATICS AND COMPUTING↗

Development of the Technical Basis of a Unified Viscoplastic Model of 316H Stainless Steel for Incorporation into ASME Division 5

This report describes the development of a unified viscoplastic model describing the deformation of 316 stainless steel. The model was developed for incorporation into Section III, Division 5 of the ASME Boiler and Pressure Vessel Code covering the design and fabrication of Class A high temperature nuclear reactor components. The current version of the Code does not provide reference inelastic models, leaving the responsibility of defining an adequate model up to either the plant owner or designer. This approach represents a substantial barrier to using the ASME design by inelastic analysis methods. As historical practice demonstrates these methods produce much more efficient designs, compared to the design by elastic analysis methods, eliminating this barrier could result in safer, more effective, and more efficient structural designs thereby lowering the cost of future advanced reactors. This report summarizes the process of gathering experimental data, calibrating the candidate inelastic model against that data, and validating the model. The report also summarizes work on a new method of calculating the sensitivities of history dependent nonlinear constitutive models that was used to calibrate the 316H model using gradient-based optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗