Search NASA⌕ Search

SEARCH · Search NASA

Results for “derivative free optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Computing the shape gradient of stellarator coil complexity with respect to the plasma boundary

Coil complexity is a critical consideration in stellarator design. The traditional two-step optimization approach, in which the plasma boundary is optimized for physics properties and the coils are subsequently optimized to be consistent with this boundary, can result in plasma shapes which cannot be produced with sufficiently simple coils. To address this challenge, we propose a method to incorporate considerations of coil complexity in the optimization of the plasma boundary. Coil complexity metrics are computed from the current potential solution obtained with the REGCOIL code (Landreman, Nucl. Fusion , vol. 57, 2017, 046003). While such metrics have previously been included in derivative-free fixed-boundary optimization (Drevlak et al. , Nucl. Fusion , vol. 59, 2018, 016010), we compute the local sensitivity of these metrics with respect to perturbations of the plasma boundary using the shape gradient (Landreman & Paul, Nucl. Fusion , vol. 58, 2018, 076023). We extend REGCOIL to compute derivatives of these metrics with respect to parameters describing the plasma boundary. In keeping with previous research on winding surface optimization (Paul et al. , Nucl. Fusion , vol. 58, 2018, 076015), the shape derivatives are computed with a discrete adjoint method. In contrast with the previous work, derivatives are computed with respect to the plasma surface parameters rather than the winding surface parameters. To further reduce the resolution required to compute the shape gradient, we present a more efficient representation of the plasma surface which uses a single Fourier series to describe the radial distance from a coordinate axis and a spectrally condensed poloidal angle. This representation is advantageous over the standard cylindrical representation used in the VMEC code (Hirshman & Whitson, Phys. Fluids , vol. 26, 1983, pp. 3553–3568), as it provides a uniquely defined poloidal angle, eliminating a null space in the optimization of the plasma surface. In comparison with previous spectral condensation methods (Hirshman & Breslau, Phys. Plasmas , vol. 5, 1998, p. 2664), the modified poloidal angle is obtained algebraically rather than through the solution of a nonlinear optimization problem. The resulting shape gradient highlights features of the plasma boundary that are consistent with simple coils and can be used to couple coil and fixed-boundary optimization.

Physics↗
DOE OSTI2026

Adaptive Sampling Trust Region Method for Bi-fidelity Simulation Optimization [SWR-25-166]

Adaptive Sampling Trust Region Method for Bi-fidelity Simulation Optimization aims to demonstrate the effect of adaptive sampling-based bi-fidelity stochastic trust region method (ASTRO-BFDF). ASTRO-BFDF, derived from a derivative-free adaptive sampling trust-region optimization (ASTRO-DF) (Shashaani et al. 2018, Ha and Shashaani 2023), intended to efficiently solve the bi-fidelity simulation optimization.

Mueller, Juliane [National Laboratory of the Rocki↗
DOE OSTI2020

BODIPY based A-D-A molecules: Effect of CF3 group substitution at meso phenyl group

Two pairs of A-D-A molecules have been created with fluorene and benzodithiophene as the central donor subunits and terminal BODIPY units, functionalized with either a 4-methylphenyl or 4-trifluoromethylphenyl group at the meso position. The effect of the para substituent of the meso phenyl group on the photophysical properties of these molecules is studied through steady state absorption and fluorescence spectroscopy as well as femtosecond transient absorption and time resolved fluorescence spectroscopy techniques. Applicability of these molecules as donors in solution processed solar cell active layers was investigated through time resolved microwave conductivity measurements on blends with PC60BM acceptor, which shows a varying yield of charge transfer with choice of substituent. Transient absorption spectroscopy is then employed to investigate the role of the 4-trifluoromethylphenyl group in altering the efficiency of charge transfer from these A-D-A molecules to PC60BM. The results show a consistent picture of picosecond charge transfer and a component of a few hundred ps geminate recombination that results in a small yield of long-lived free charges optimized for the methylphenyl derivatives.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Scalable computations for nonstationary Gaussian processes

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be very slow to converge when estimating many spatially varying parameters. In this paper, we present a computational framework which couples an algebraic block diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

HFBTHO-AD: Differentiation of a nuclear energy density functional code

The HFBTHO code implements a nuclear energy density functional solver to model the structure of atomic nuclei. HFBTHO has previously been used to calibrate energy functionals and perform sensitivity analysis by using derivative-free methods. To enable derivative-based optimization and uncertainty quantification approaches, we must compute the derivatives of HFBTHO outputs with respect to the parameters of the energy functional, which are a subset of all input parameters of the code. Here, we use the algorithmic/automatic differentiation (AD) tool Tapenade to differentiate HFBTHO. We compare the derivatives obtained using AD against finite-difference approximation and examine the performance of the derivative computation.

Algorithmic differentiation↗
DOE OSTI2020

Black-Box Optimization for Design of Concentrating Solar Power and Photovoltaic Hybrid Systems with Optimal Dispatch Decisions

The hybridization of concentrating solar power (CSP) and photovoltaics (PV) can enable dispatchable renewable electricity generation at a lower price than current stand-alone CSP systems. However, designing a CSP-PV hybrid system can be challenging because of the many degrees of freedom in design that affect the internal and external system interactions and trade-offs. We develop a methodology to determine optimal designs for CSP-PV hybrids by implementing NLopt's derivative-free, or “black-box,” algorithms around pre-existing CSP-PV hybrid simulation software that utilizes the National Renewable Energy Laboratory’s System Advisor Model (SAM); we then employ a dispatch optimization model to determine operational decisions that maximize a plant’s profits. We present optimal designs for CSP-PV hybrid systems dispatching against four time-of-delivery (ToD) pricing structures. NLopt’s algorithms can improve the base case design’s power purchase agreement (PPA) price by 15% to 21%, depending on the ToD pricing structure. In addition, we present the resulting optimal CSP-PV hybrid design’s annual performance metrics, which tend to have capacity factors between 50% and 62%, but are able to generate electricity during the year’s highest-valued periods about 90% of the time. Lastly, we investigate the trade-offs between capacity factor and PPA price using Pareto fronts and demonstrate that, for some ToD pricing structures, the system capacity factor can increase by 20% but at the expense of a 2% increase in PPA price.

black-box↗
DOE OSTI2025

Maximizing Free Energy Gain

Maximizing the amount of work harvested from an environment is important for a wide variety of biological and technological processes, from energy-harvesting processes such as photosynthesis to energy storage systems such as fuels and batteries. Here, we consider the maximization of free energy—and by extension, the maximum extractable work—that can be gained by a classical or quantum system that undergoes driving by its environment. We consider how the free energy gain depends on the initial state of the system while also accounting for the cost of preparing the system. We provide simple necessary and sufficient conditions for increasing the gain of free energy by varying the initial state. We also derive simple formulae that relate the free energy gained using the optimal initial state rather than another suboptimal initial state. Finally, we demonstrate that the problem of finding the optimal initial state may have two distinct regimes, one easy and one difficult, depending on the temperatures used for preparation and work extraction. We illustrate our results on a simple model of an information engine.

Physics↗
DOE OSTI2020

A Generalized Stress Inversion Approach With Application to Residual Stress Estimation

In this work develop a generalized stress inversion technique (or the generalized inversion method) capable of recovering stresses in linear elastic bodies subjected to arbitrary cuts. Specifically, given a set of displacement measurements found experimentally from digital image correlation (DIC), we formulate a stress estimation inverse problem as a partial differential equation-constrained optimization problem. We use gradient-based optimization methods, and we accordingly derive the necessary gradient and Hessian information in a matrix-free form to allow for parallel, large-scale operations. By using a combination of finite elements, DIC, and a matrix-free optimization framework, the generalized inversion method can be used on any arbitrary geometry, provided that the DIC camera can view a sufficient part of the surface. We present numerical simulations and experiments, and we demonstrate that the generalized inversion method can be applied to estimate residual stress.

42 ENGINEERING↗
DOE OSTI2021

Manifold Sampling for Optimizing Nonsmooth Nonconvex Compositions

Here we propose a manifold sampling algorithm for minimizing a nonsmooth composition $f= h\circ F$, where we assume $h$ is nonsmooth and may be inexpensively computed in closed form and $F$ is smooth but its Jacobian may not be available. We additionally assume that the composition $h\circ F$ defines a continuous selection. Manifold sampling algorithms can be classified as model-based derivative-free methods, in that models of $F$ are combined with particularly sampled information about $h$ to yield local models for use within a trust-region framework. We demonstrate that cluster points of the sequence of iterates generated by the manifold sampling algorithm are Clarke stationary. We consider the tractability of three particular subproblems generated by the manifold sampling algorithm and the extent to which inexact solutions to these subproblems may be tolerated. Numerical results demonstrate that manifold sampling as a derivative-free algorithm is competitive with state-of-the-art algorithms for nonsmooth optimization that utilize first-order information about $f$.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Spectral-partitioned Kohn-Sham density functional theory

Here we introduce a general, variational scheme for systematic approximation of a given Kohn-Sham free-energy functional by partitioning the density matrix into distinct spectral domains, each of which may be spanned by an independent diagonal representation without requirement of mutual orthogonality. It is shown that by generalizing the entropic contribution to the free energy to allow for independent representations in each spectral domain, the free energy becomes an upper bound to the exact (unpartitioned) Kohn-Sham free energy, attaining this limit as the representations approach Kohn-Sham eigenfunctions. A numerical procedure is devised for calculation of the generalized entropy associated with spectral partitioning of the density matrix. The result is a powerful framework for Kohn-Sham calculations of systems whose occupied subspaces span multiple energy regimes. As a case in point, we apply the proposed framework to warm- and hot-dense matter described by finite-temperature density functional theory, where at high energies the density matrix is represented by that of the free-electron gas, while at low energies it is variationally optimized. We derive expressions for the spectral-partitioned Kohn-Sham Hamiltonian, atomic forces, and macroscopic stresses within the projector-augmented wave (PAW) and the norm-conserving pseudopotential methods. It is demonstrated that at high temperatures, spectral partitioning facilitates accurate calculations at dramatically reduced computational cost. Moreover, as temperature is increased, fewer exact Kohn-Sham states are required for a given accuracy, leading to further reductions in computational cost. Finally, it is shown that standard multiprojector expansions of electronic orbitals within atomic spheres in the PAW method lack sufficient completeness at high temperatures. Spectral partitioning provides a systematic solution for this fundamental problem.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Enabling Scale-Up Through Multi-Fidelity Adaptive Computing

We present ideas from our ongoing work in adaptive computing - an optimization framework that allows us to strategically deploy various fidelity level experiments and simulations to guide decision making. The framework aims to enable uncertainty quantified scale-up of simulations and experiments, which causes increased complexity. A key feature of the framework is the integration of user-specified local model trustworthiness estimates. Adaptive sampling strategies allow us to optimally exploit the multiple fidelity level information and trustworthiness measures to arrive at the best decisions within a highly limited budget of objective function evaluations.

adaptive sampling↗
DOE OSTI2021

Combined plasma–coil optimization algorithms

Combined plasma–coil optimization approaches for designing stellarators are discussed and a new method for calculating free-boundary equilibria for multiregion relaxed magnetohydrodynmics (MRxMHD) is proposed. Four distinct categories of stellarator optimization, two of which are novel approaches, are the fixed-boundary optimization, the generalized fixed-boundary optimization, the quasi-free-boundary optimization, and the free-boundary (coil) optimization. These are described using the MRxMHD energy functional, the Biot–Savart integral, the coil-penalty functional and the virtual casing integral and their derivatives. The proposed free-boundary equilibrium calculation differs from existing methods in how the boundary-value problem is posed, and for the new approach it seems that there is not an associated energy minimization principle because a non-symmetric functional arises. We propose to solve the weak formulation of this problem using a spectral-Galerkin method, and this will reduce the free-boundary equilibrium calculation to something comparable to a fixed-boundary calculation. In our discussion of combined plasma–coil optimization algorithms, we emphasize the importance of the stability matrix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Absence of Barren Plateaus and Scaling of Gradients in the Energy Optimization of Isometric Tensor Network States

Abstract Vanishing gradients can pose substantial obstacles for high-dimensional optimization problems. Here we consider energy minimization problems for quantum many-body systems with extensive Hamiltonians and finite-range interactions, which can be studied on classical computers or in the form of variational quantum eigensolvers on quantum computers. Barren plateaus correspond to scenarios where the average amplitude of the energy gradient decreases exponentially with increasing system size. This occurs, for example, for quantum neural networks and for brickwall quantum circuits when the depth increases polynomially in the system size. Here we prove that the variational optimization problems for matrix product states, tree tensor networks, and the multiscale entanglement renormalization ansatz are free of barren plateaus. The derived scaling properties for the gradient variance provide an analytical guarantee for the trainability of randomly initialized tensor network states (TNS) and motivate certain initialization schemes. In a suitable representation, unitary tensors that parametrize the TNS are sampled according to the uniform Haar measure. We employ a Riemannian formulation of the gradient based optimizations which simplifies the analytical evaluation.

Barthel, Thomas↗
DOE OSTI2024

Feedback-based quantum algorithms for ground state preparation

The ground state properties of quantum many-body systems are a subject of interest across chemistry, materials science, and physics. Thus, algorithms for finding ground states can have broad impacts. Variational quantum algorithms are one class of ground state algorithms that has received significant attention in recent years. These algorithms utilize a hybrid quantum-classical computing framework to prepare ground states on quantum computers. However, this requires solving a classical optimization problem that can become prohibitively expensive in high dimensions. Here, we develop formulations of feedback-based quantum algorithms for ground state preparation that can be used to address this challenge for two broad classes of Hamiltonians: Fermi-Hubbard Hamiltonians, and molecular Hamiltonians represented in second quantization. Feedback-based quantum algorithms are optimization-free; in place of classical optimization, quantum circuit parameters are set according to a deterministic feedback law derived from quantum Lyapunov control principles. This feedback law guarantees a monotonic improvement in solution quality with respect to the depth of the quantum circuit. A variety of numerical illustrations are provided that analyze the convergence and robustness of feedback-based quantum algorithms for these problem classes. Published by the American Physical Society 2024

Larsen, James B. (ORCID:000000020777440X)↗
DOE OSTI2021

Optimized finite-build stellarator coils using automatic differentiation

A new stellarator coil design code is introduced that optimizes the position and winding pack orientation of finite-build coils. The new code, called flexible optimized curves in space using automatic differentiation (AD) and finite build (FOCUSADD), performs gradient-based optimization in a high-dimensional, non-convex space. The derivatives with respect to parameters of finite-build coils are easily and efficiently computed using AD. FOCUSADD parametrizes coil positions in free space using a Fourier series and uses a multi-filament approximation to the coil winding pack. The orientation of the winding pack is parametrized with a Fourier series and can be optimized as well. Optimized finite-build coils for a Wendelstein 7-X (W7-X)-like stellarator are found, and compared with filamentary coil results. The final positions of optimized finite-build W7-X-like coils are shifted, on average, by approximately 2.5 mm relative to optimized filamentary coils. These results suggest that finite-build effects should be accounted for in the optimization of stellarators with low coil tolerances.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Nonlinear post-compression in multi-pass cells in the mid-IR region using bulk materials

We numerically investigate the regime of nonlinear pulse compression at mid-IR wavelengths in a multi-pass cell (MPC) containing a dielectric plate. This post-compression setup allows for ionization-free spectral broadening and self-compression while mitigating self-focusing effects. We find that self-compression occurs for a wide range of MPC and pulse parameters and derive scaling rules that enable its optimization. We also reveal the solitonic dynamics of the pulse propagation in the MPC and its limitations and show that spatiotemporal/spectral couplings can be mitigated for appropriately chosen parameters. In addition, we reveal the formation of spectral features akin to quasi-phase matched degenerate four-wave mixing. Finally, we present two case studies of self-compression at 3-μm and 6-μm wavelengths using pulse parameters compatible with driving high-field physics experiments. The simulations presented in this paper set a framework for future experimental work using few-cycle pulses at mid-IR wavelengths.

Carlson, D. (ORCID:0000000346836463)↗
DOE OSTI2023

Mechanistic Insights into Cell-Free Gene Expression through an Integrated -Omics Analysis of Extract Processing Methods

Cell-free systems derived from crude cell extracts have developed into tools for gene expression, with applications in prototyping, biosensing, and protein production. Key to the development of these systems is optimization of cell extract preparation methods. However, the applied nature of these optimizations often limits investigation into the complex nature of the extracts themselves, which contain thousands of proteins and reaction networks with hundreds of metabolites. In this report we sought to uncover the black box of proteins and metabolites in Escherichia coli cell-free reactions based on different extract preparation methods. We assess changes in transcription and translation activity from σ70 promoters in extracts prepared with acetate or glutamate buffer and the common post-lysis processing steps of a runoff incubation and dialysis. We then utilize proteomic and metabolomic analyses to uncover potential mechanisms behind these changes in gene expression, highlighting the impact of cold shock-like proteins and the role of buffer composition.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Use of Captured CO2 for Production of Sustainable Polyurethane Foams in Automotive Applications

Captured CO2 has been investigated as a feedstock for the production of polyurethane (PU) foams for automotive applications. Previous work has shown successful incorporation of CO2 into polyols via three distinct reaction pathways. These CO2-derived polyols, as well as several commercially available polyols with varying CO2 content, were used to produce PU foams for automotive seating and NVH (noise, vibration, and harshness) applications. Foam formulations were optimized to maximize sustainable content while maintaining manufacturability constraints and performance requirements for each end use application. PU foams were first formulated at lab scale to confirm free rise and molded foam properties, then scaled up to pilot and industrial scales to evaluate production manufacturing feasibility. Finally, CO2-derived foams were used to produce molded components for end use product validation. Life cycle assessment (LCA) was used to quantify the environmental impact of using captured CO2 and bio-renewable content into polyols and PU foams through the metrics of global warming potential and embodied energy. Tradeoffs among environmental impacts, energy usage, manufacturability, and PU foam performance from the incorporation of CO2 and bio-renewable content will be discussed.

Lee, Ellen [Ford Motor Company]↗