Search NASA⌕ Search

SEARCH · Search NASA

Results for “Numerical Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Stable and efficient momentum-space solutions of the time-dependent Schrödinger equation for one-dimensional atoms in strong laser fields

One-dimensional model systems have a particular role in strong-field physics when gaining physical insight by computing data over a large range of parameters, or when performing numerous time propagations within, e.g., optimal control theory. Here we derive a scheme that removes a singularity in the one-dimensional Schrödinger equation in momentum space for a particle in the commonly used soft-core Coulomb potential. By using this scheme we develop two numerical approaches to the time-dependent Schrödinger equation in momentum space. The first approach employs the expansion of the momentum-space wave function over the eigenstates of the field-free Hamiltonian, and it is shown to be more efficient for laser parameters usual in strong field physics. The second approach employs the Crank–Nicolson scheme or the method of lines for time-propagation. The both methods are readily applicable for large-scale numerical simulations in one-dimensional model systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Application of Partially coherent Wavefront Propagation Calculations for Design of Coherence-Preserving Synchrotron Radiation Beamlines

Ultra-low emittance third-generation synchrotron radiation (SR) sources, such as NSLS-II and MAX-IV, will offer excellent opportunities for further development of experimental techniques exploiting X-ray coherence. However, even in these new SR sources, the radiation produced by relativistic electrons (in undulators, wigglers and bending magnets) will remain only partially coherent in the X-ray spectral range. 'Extraction' of 'coherent portion' of the radiation flux and its transport to sample without loss of coherence must be performed by dedicated SR beamlines, optimized for particular types of experiments. Detailed quantitative prediction of partially coherent X-ray beam properties at propagation through optical elements, which is required for the optimization of such beamlines, can only be obtained from accurate and efficient physical-optics based numerical simulations. Examples of such simulations, made for NSLS-II beamlines, using 'Synchrotron Radiation Workshop' (SRW) computer code, are presented. Special attention is paid to the numerical analysis of the basic properties of partially coherent undulator radiation beam and its distinctions from the Gaussian beam. Performance characteristics of importance for particular beamlines, such as radiation spot size and flux at sample vs size of secondary source aperture for high-resolution microscopy beamlines, are predicted by the simulations.

43 PARTICLE ACCELERATORS↗

Base Station Antenna Uptilt Optimization for Cellular-Connected Drone Corridors

Reliable wireless coverage in drone corridors is critical to enable a connected, safe, and secure airspace. To support beyond visual line of sight (BVLOS) operations of aerial vehicles in a drone corridor, cellular base stations (BSs) can serve as a convenient infrastructure as they are widely deployed to provide seamless wireless coverage. However, antennas in the existing cellular networks are down-tilted to optimally serve their ground users, which results in coverage holes at higher altitudes when they are used to serve drones. In this paper, we consider the use of additional uptilted antennas at each cellular BS and optimize the uptilt angle to maximize the wireless coverage probability across a given drone corridor. Through numerical results, we can characterize the optimal value of the antenna uptilt angle for a given antenna pattern as well as the minimum/maximum altitudes of the drone corridor.

42 ENGINEERING↗

Thermal Property Estimation of Fibrous Insulation: Heat Transfer Modeling and the Continuous Genetic Algorithm

Thermal properties of high-temperature fibrous insulation materials were estimated from transient thermal tests using an inverse heat transfer technique. Transient temperature data from an experimental set up was collected and a simple, one-dimensional numerical model was constructed to replicate the temperatures within the test assembly. The Continuous Genetic Algorithm optimization technique in conjunction with a numerical thermal model and transient test data was used to estimate coefficients of a functional representation of the thermal property. The thermal properties, i.e., thermal conductivity and specific heat, of an alumina insulation felt were estimated over the temperature range of 300 K to 1700 K at various constant static pressures in nitrogen gas and compared with published data. The resulting thermal property estimates were within 10% of published values over the entire temperature range at various pressures. The methodology, application, and results are presented.

Frye, Elora↗

Application of partially coherent wavefront propagation calculations for design of coherence-preserving synchrotron radiation beamlines

Ultra-low emittance third-generation synchrotron radiation (SR) sources, such as NSLS-II and MAX-IV, will offer excellent opportunities for further development of experimental techniques exploiting X-ray coherence. However, even in these new SR sources, the radiation produced by relativistic electrons (in undulators, wigglers and bending magnets) will remain only partiallycoherent in the X-ray spectral range. 'Extraction' of 'coherent portion' of the radiation flux and its transport to sample without loss of coherence must be performed by dedicated SR beamlines, optimized for particular types of experiments. Detailed quantitative prediction of partially coherent X-ray beam properties at propagation through optical elements, which is required for the optimization of such beamlines, can only be obtained from accurate and efficient physical-optics based numerical simulations. Examples of such simulations, made for NSLS-II beamlines, using 'Synchrotron Radiation Workshop' (SRW) computer code, are presented. Special attention is paid to the numerical analysis of the basic properties of partially coherent undulator radiation beam and its distinctions from the Gaussian beam. Performance characteristics of importance for particular beamlines, such as radiation spot size and flux at sample vs size of secondary source aperture for high-resolution microscopy beamlines, are predicted by the simulations.

43 PARTICLE ACCELERATORS↗

Extended Newton-type method for nonlinear functions with values in a cone

In this paper, we consider the problem of finding solutions of nonlinear inclusion problems in Banach space. Using convex optimization techniques introduced by Robinson (Numer Math 19:341–347, 1972), a convergence theorem for Kantorovich-like methods is given, which improves the results of Yamamoto (Jpn J Appl Math 3(2):295–313, 1986; Numer Math 51(5):545–557, 1987) and Robinson (Numer Math 19:341–347, 1972). The result is compared with previously known results. Numerical examples further justify the theoretical results.

97 MATHEMATICS AND COMPUTING↗

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in A Mach 4.5 Boundary Layer

We use deep learning, an ensemble variationaltechnique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (Deep-ONets), which have the known ability to learn com-plex nonlinear operators within dynamical systems,are used for machine learning. For the baseline config-uration of a smooth flat plate, the second-mode wavesat the DNS inflow cause a quick nonlinear breakdownof the high-speed boundary layer within the computa-tional domain. Results reported in the present studyvalidate the ability of DeepONets to model the tran-sition delay via a given topography of the roughnesselement. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substan-tially lowered by the DeepONets-based reduced-ordermodel. In comparison to the baseline method of EnVaroptimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition pastthe outflow boundary of the computational domainwhile utilizing almost 5–6 times fewer DNS.

Machine Learning↗

Fast Numerical Methods for the Design of Layered Photonic Structures with Rough Interfaces

Modified boundary conditions (MBC) and a multilayer approach (MA) are proposed as fast and efficient numerical methods for the design of 1D photonic structures with rough interfaces. These methods are applicable for the structures, composed of materials with arbitrary permittivity tensor. MBC and MA are numerically validated on different types of interface roughness and permittivities of the constituent materials. The proposed methods can be combined with the 4x4 scattering matrix method as a field solver and an evolutionary strategy as an optimizer. The resulted optimization procedure is fast, accurate, numerically stable and can be used to design structures for various applications.

Komarevskiy, Nikolay↗

Multiobjective optimization to a TB-HIV/AIDS coinfection optimal control problem

We consider a recent coinfection model for Tuberculosis (TB), Human Immunodeficiency Virus (HIV) infection, and Acquired Immunodeficiency Syndrome (AIDS) proposed in Silva and Torres (Discr Contin Dyn Syst 35(9):4639–4663, 2015). We introduce and analyze a multiobjective formulation of an optimal control problem, where the two conflicting objectives are minimization of the number of HIV-infected individuals with AIDS clinical symptoms and coinfected with AIDS and active TB; and costs related to prevention and treatment of HIV and/or TB measures. The proposed approach eliminates some limitations of previous works. The results of the numerical study provide comprehensive insights about the optimal treatment policies and the population dynamics resulting from their implementation. Some nonintuitive conclusions are drawn. Overall, the simulation results demonstrate the usefulness and validity of the proposed approach.

97 MATHEMATICS AND COMPUTING↗

Efficient phase-factor evaluation in quantum signal processing

Quantum signal processing (QSP) is a powerful quantum algorithm to exactly implement matrix polynomials on quantum computers. Asymptotic analysis of quantum algorithms based on QSP has shown that asymptotically optimal results can in principle be obtained for a range of tasks, such as Hamiltonian simulation and the quantum linear system problem. A further benefit of QSP is that it uses a minimal number of ancilla qubits, which facilitates its implementation on near-to-intermediate term quantum architectures. However, there is so far no classically stable algorithm allowing computation of the phase factors that are needed to build QSP circuits. Existing methods require the use of variable precision arithmetic and can only be applied to polynomials of a relatively low degree. We present here an optimization-based method that can accurately compute the phase factors using standard double precision arithmetic operations. We demonstrate the performance of this approach with applications to Hamiltonian simulation, eigenvalue filtering, and quantum linear system problems. Furthermore, our numerical results show that the optimization algorithm can find phase factors to accurately approximate polynomials of a degree larger than 10000 with errors below 10 -12 .

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in a Mach 4.5 Boundary Layer

We use deep learning, an ensemble variational technique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (DeepONets), which have the known ability to learn complex nonlinear operators within dynamical systems, are used for machine learning. For the baseline configuration of a smooth flat plate, the second-mode waves at the DNS inflow cause a quick nonlinear breakdown of the high-speed boundary layer within the computational domain. Results reported in the present study validate the ability of DeepONets to model the transition delay via a given topography of the roughness element. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substantially lowered by the DeepONets-based reduced-order model. In comparison to the baseline method of EnVar optimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition past the outflow boundary of the computational domain while utilizing almost 5–6 times fewer DNS.

Machine Learning↗

Structural optimization with approximate sensitivities

Computational efficiency in structural optimization can be enhanced if the intensive computations associated with the calculation of the sensitivities, that is, gradients of the behavior constraints, are reduced. Approximation to gradients of the behavior constraints that can be generated with small amount of numerical calculations is proposed. Structural optimization with these approximate sensitivities produced correct optimum solution. Approximate gradients performed well for different nonlinear programming methods, such as the sequence of unconstrained minimization technique, method of feasible directions, sequence of quadratic programming, and sequence of linear programming. Structural optimization with approximate gradients can reduce by one third the CPU time that would otherwise be required to solve the problem with explicit closed-form gradients. The proposed gradient approximation shows potential to reduce intensive computation that has been associated with traditional structural optimization.

Patnaik, S. N.↗

Optimized Renewable Energy Integration for EV High-Power Dynamic Wireless Charging Systems

Dynamic wireless charging for electric vehicles is an emerging technology to reduce on-board battery size and extend driving range. Due to its unique characteristic of vehicle-speed-related pulse-like load profile, the high-power dynamic wireless charging system (DWCS) introduces high stress to the utility grid. In this paper, an optimization model for renewable energy integration in the DWCS is proposed to mitigate the grid impact and minimize the operation costs of the whole system. As the load profile of DWCS is related to the traffic volume and various approaching vehicle speeds, the annual average daily traffic data and a stochastic model are used to develop 24-hour load profile of DWCS. To find a tradeoff between grid impact mitigation and operation costs minimization, relationships among power demand from power grid, photovoltaic (PV) capacity, wind energy (WE) capacity and energy storage (ES) capacity are analyzed, and the optimization objective and constraints are developed. Numerical simulation results demonstrate that energy storage integration can greatly mitigate the grid impact of DWCS, and optimal ratio of PV and WE can significantly reduce the operation cost of DWCS.

Zeng, Rong↗

Optimal moving grids for time-dependent partial differential equations

Various adaptive moving grid techniques for the numerical solution of time-dependent partial differential equations were proposed. The precise criterion for grid motion varies, but most techniques will attempt to give grids on which the solution of the partial differential equation can be well represented. Moving grids are investigated on which the solutions of the linear heat conduction and viscous Burgers' equation in one space dimension are optimally approximated. Precisely, the results of numerical calculations of optimal moving grids for piecewise linear finite element approximation of partial differential equation solutions in the least squares norm.

Wathen, A. J.↗

Optimal moving grids for time-dependent partial differential equations

Various adaptive moving grid techniques for the numerical solution of time-dependent partial differential equations were proposed. The precise criterion for grid motion varies, but most techniques will attempt to give grids on which the solution of the partial differential equation can be well represented. Moving grids are investigated on which the solutions of the linear heat conduction and viscous Burgers' equation in one space dimension are optimally approximated. Precisely, the results of numerical calculations of optimal moving grids for piecewise linear finite element approximation of PDE solutions in the least-squares norm are reported.

Wathen, A. J.↗

Laser induced deflection technique for absolute thin film absorption measurement: optimized concepts and experimental results

Using experimental results and numerical simulations, two measuring concepts of the laser induced deflection (LID) technique are introduced and optimized for absolute thin film absorption measurements from deep ultraviolet to IR wavelengths. For transparent optical coatings, a particular probe beam deflection direction allows the absorption measurement with virtually no influence of the substrate absorption, yielding improved accuracy compared to the common techniques of separating bulk and coating absorption. For high-reflection coatings, where substrate absorption contributions are negligible, a different probe beam deflection is chosen to achieve a better signal-to-noise ratio. Various experimental results for the two different measurement concepts are presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

FY 2008 Miniature Spherical Retroreflectors – Final Report

Through the duration of the NNSA Office of Nuclear Nonproliferation Research and Development (NA-22) Miniature Spherical Retroreflectors lifecycle project, our research team focused on developing solutions to the fabrication bottleneck that has inhibited development and deployment of wide-angle optically interrogated chemical and radiological remote sensing technology. Our team advanced the concept of step-index clad retroreflectors to approximate an optimized, but yet unrealized spherical gradient index design. An intensive numerical simulation effort was undertaken that resulted in optimized step-index optical designs for mid-infrared applications. Geometric optics ray trace modeling was performed to better understand the geometrical dependencies of the miniature spherical retroreflector application. We adopted and advanced the concept of optical cross section, a metric that provides relative performance comparisons between different retroreflector designs and our cross-section analysis demonstrated that our step-index design provided 90% of the range capacity of the ideal spherical index design.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗