SEARCH · Search NASA

Results for “gradient based optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Can Simple Machine Learning Tools Extend and Improve Temperature-Based Methods to Infer Streambed Flux?

Temperature-based methods have been developed to infer 1D vertical exchange flux between a stream and the subsurface. Current analyses rely on fitting physically based analytical and numerical models to temperature time series measured at multiple depths to infer daily average flux. These methods have seen wide use in hydrologic science despite strong simplifying assumptions including a lack of consideration of model structural error or the impacts of multidimensional flow or the impacts of transient streambed hydraulic properties. We performed a “perfect-model experiment” investigation to examine whether regression trees, with and without gradient boosting, can extract sufficient information from model-generated subsurface temperature time series, with and without added measurement error, to infer the corresponding exchange flux time series at the streambed surface. Using model-generated, synthetic data allowed us to assess the basic limitations to the use of machine learning; further examination of real data is only warranted if the method can be shown to perform well under these ideal conditions. We also examined whether the inherent feature importance analyses of tree-based machine learning methods can be used to optimize monitoring networks for exchange flux inference.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model

This paper proposes a new method that combines checkpointing methods with error-controlled lossy compression for large-scale high-performance full-waveform inversion (FWI), an inverse problem commonly used in geophysical exploration. This combination can significantly reduce data movement, allowing a reduction in run time as well as peak memory. In the exascale computing era, frequent data transfer (e.g., memory bandwidth, PCIe bandwidth for GPUs, or network) is the performance bottleneck rather than the peak FLOPS of the processing unit. Like many other adjoint-based optimization problems, FWI is costly in terms of the number of floating-point operations, large memory footprint during backpropagation, and data transfer overheads. Past work for adjoint methods has developed checkpointing methods that reduce the peak memory requirements during backpropagation at the cost of additional floating-point computations. Combining this traditional checkpointing with error-controlled lossy compression, we explore the three-way tradeoff between memory, precision, and time to solution. We investigate how approximation errors introduced by lossy compression of the forward solution impact the objective function gradient and final inverted solution. Empirical results from these numerical experiments indicate that high lossy-compression rates (compression factors ranging up to 100) have a relatively minor impact on convergence rates and the quality of the final solution.

58 GEOSCIENCES↗

NASA NTRS2006

Multiclass Reduced-Set Support Vector Machines

There are well-established methods for reducing the number of support vectors in a trained binary support vector machine, often with minimal impact on accuracy. We show how reduced-set methods can be applied to multiclass SVMs made up of several binary SVMs, with significantly better results than reducing each binary SVM independently. Our approach is based on Burges' approach that constructs each reduced-set vector as the pre-image of a vector in kernel space, but we extend this by recomputing the SVM weights and bias optimally using the original SVM objective function. This leads to greater accuracy for a binary reduced-set SVM, and also allows vectors to be 'shared' between multiple binary SVMs for greater multiclass accuracy with fewer reduced-set vectors. We also propose computing pre-images using differential evolution, which we have found to be more robust than gradient descent alone. We show experimental results on a variety of problems and find that this new approach is consistently better than previous multiclass reduced-set methods, sometimes with a dramatic difference.

reduced set methods↗

DOE OSTI2020

Optimal control of coupled quantum systems based on the first-order Magnus expansion: Application to multiple dipole-dipole-coupled molecular rotors

This paper presents a method for performing approximate optimal control simulations for quantum systems with multiple coupled degrees of freedom. In this work, the time evolution is simulated using the first-order Magnus expansion in the interaction picture, where the couplings between different degrees of freedom are treated as the perturbation. A numerical implementation procedure is presented that leverages upon pairwise couplings and the separability of the zeroth-order time evolution operator to achieve a reduced computational cost, which is analyzed with respect to the number of degrees of freedom. The formulation is compatible with gradient-free methods to optimize the control field, and a stochastic hill climbing algorithm is adopted for this purpose. As illustrations, optimal control simulations are performed for systems of two and three dipole-dipole-coupled molecular rotors under the influence of a control field. For the two-rotor system, the field is optimized to achieve either orientation or entanglement objectives. For the three-rotor system, the field is optimized either to orient all three rotors in the same direction or to orient one rotor in a particular direction while the other two rotors point in the opposite direction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

Uncertainty amplification due to density/refractive index gradients in background-oriented schlieren experiments

Here, we theoretically analyze the effect of density/refractive index gradients on the measurement precision of background-oriented schlieren (BOS) experiments by deriving the Cramer–Rao lower bound (CRLB) for the 2D centroid estimation process. A model is derived for the diffraction limited image of a dot viewed through a medium containing density gradients that includes the effect of the experimental parameters such as the magnification and f-number. It is shown using the model that nonlinearities in the density gradient field lead to blurring of the dot image. This blurring amplifies the effect of image noise on the centroid estimation process, leading to an increase in the CRLB and a decrease in the measurement precision. The ratio of position uncertainties of a dot in the reference and gradient images is shown to be a function of the ratio of the dot diameters and dot intensities. We termed this parameter the amplification ratio (A F ), and a methodology for reporting position uncertainties in tracking-based BOS measurements is proposed. The theoretical predictions of the dot position estimation variance from the CRLB are compared to ray tracing simulations, and agreement is obtained. The uncertainty amplification is also demonstrated on experimental BOS images of flow induced by a spark discharge, where it is seen that regions of high amplification ratio correspond to regions of density gradients. This analysis elucidates the dependence of the position uncertainty on density and refractive index gradient-induced distortion parameters, provides a methodology for accounting its effect on uncertainty quantification and provides a framework for optimizing experiment design.

42 ENGINEERING↗

DOE OSTI2022

Connected and automated vehicles, driving systems, and control logic for info-rich eco-autonomous driving

A method for controlling automated driving operations of a vehicle includes determining vehicle origin and destination data, and generating a graphical representation of a road network with multiple candidate routes between the vehicle's origin and destination. Road-level data, including speed, turn angle, and/or gradient data, is received for each candidate route, and respective total energy uses are estimated for the vehicle to traverse across the candidate routes. Multiple candidate driving strategies, each having respective speed and acceleration profiles, are determined for the candidate route with the lowest estimated total energy use. An optimal candidate driving strategy is selected through a cost evaluation of the associated speed and acceleration profiles and forward movement simulations of the vehicle over a prediction horizon. Command signals are transmitted to the vehicle's steering and/or powertrain systems to execute control operations based on the optimal driving strategy and the candidate route with the lowest energy use.

Zhao, Junfeng↗

DOE OSTI2023

Variational actor-critic algorithms,

We introduce a class of variational actor-critic algorithms based on a variational formulation over both the value function and the policy. The objective function of the variational formulation consists of two parts: one for maximizing the value function and the other for minimizing the Bellman residual. Besides the vanilla gradient descent with both the value function and the policy updates, we propose two variants, the clipping method and the flipping method, in order to speed up the convergence. We also prove that, when the prefactor of the Bellman residual is sufficiently large, the fixed point of the algorithm is close to the optimal policy.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Challenges in simulating beam dynamics of dielectric laser acceleration

Dielectric Laser Acceleration (DLA) achieves the highest gradients among structure-based electron accelerators. The use of dielectrics increases the breakdown field limit, and thus the achievable gradient, by a factor of at least 10 in comparison to metals. Experimental demonstrations of DLA in 2013 led to the Accelerator on a Chip International Program (ACHIP), funded by the Gordon and Betty Moore Foundation. In ACHIP, our main goal is to build an accelerator on a silicon chip, which can accelerate electrons from below 100 keV to above 1 MeV with a gradient of at least 100 MeV/m. For stable acceleration on the chip, magnet-only focusing techniques are insufficient to compensate the strong acceleration defocusing. Thus, spatial harmonic and Alternating Phase Focusing (APF) laser-based focusing techniques have been developed. Additionally, we have developed the simplified symplectic tracking code DLAtrack6D, which makes use of the periodicity and applies only one kick per DLA cell, which is calculated by the Fourier coefficient of the synchronous spatial harmonic. Due to coupling, the Fourier coefficients of neighboring cells are not entirely independent and a field flatness optimization (similarly as in multi-cell cavities) needs to be performed. The simulation of the entire accelerator on a chip by a Particle In Cell (PIC) code is possible, but impractical for optimization purposes. Finally, we have also outlined the treatment of wake field effects in attosecond bunches in the grating within DLAtrack6D, where the wake function is computed by an external solver.

43 PARTICLE ACCELERATORS↗

DOE OSTI2024

VAN-DAMME: GPU-accelerated and symmetry-assisted quantum optimal control of multi-qubit systems

We present an open-source software package, VAN-DAMME (Versatile Approaches to Numerically Design, Accelerate, and Manipulate Magnetic Excitations), for massively-parallelized quantum optimal control (QOC) calculations of multi-qubit systems. To enable large QOC calculations, the VAN-DAMME software package utilizes symmetry-based techniques with custom GPU-enhanced algorithms. This combined approach allows for the simultaneous computation of hundreds of matrix exponential propagators that efficiently leverage the intra-GPU parallelism found in high-performance GPUs. In addition, to maximize the computational efficiency of the VAN-DAMME code, we carried out several extensive tests on data layout, computational complexity, memory requirements, and performance. These extensive analyses allowed us to develop computationally efficient approaches for evaluating complex-valued matrix exponential propagators based on Padé approximants. To assess the computational performance of our GPU-accelerated VAN-DAMME code, we carried out QOC calculations of systems containing 10 - 15 qubits, which showed that our GPU implementation is 18.4× faster than the corresponding CPU implementation. Our GPU-accelerated enhancements allow efficient calculations of multi-qubit systems, which can be used for the efficient implementation of QOC applications across multiple domains.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Enhanced descriptor identification and mechanism understanding for catalytic activity using a data-driven framework: revealing the importance of interactions between elementary steps

We report accurate identification of descriptors for catalytic activities has long been essential to the in-depth understanding of catalysis and recently to set the basis for catalyst screening. However, commonly used methods suffer from low accuracy in predictability. This study reports an enhanced approach to accurately identify the descriptors from a kinetic dataset using a machine learning (ML) surrogate model. CO hydrogenation to methanol over Cu-based catalysts was taken as a case study. Our model captures not only the contribution from individual elementary steps but also the interaction between relevant steps within a reaction network, which was found to be essential for high accuracy. As a result, six effective descriptors are identified, which are accurate enough to ensure the trained gradient boosted regression (GBR) model for good prediction of the methanol turnover frequency (TOF) over metal (M)-doped Cu(111) model surfaces (M = Au, Cu, Pd, Pt, Ni). More importantly, going beyond the purely mathematical ML model, the catalytic role of each identified descriptor can be revealed by using model-agnostic interpretation tools, which enhances the insight into the promoting effect of alloying. The trained GBR model outperforms the conventional derivative-based methods in terms of both the predictability and the mechanism understanding. It opens alternative possibilities toward accurate descriptor-based rational catalyst optimization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Real-time breath analysis towards a healthy human breath profile

Abstract The direct analysis of molecules contained within human breath has had significant implications for clinical and diagnostic applications in recent decades. However, attempts to compare one study to another or to reproduce previous work are hampered by: variability between sampling methodologies, human phenotypic variability, complex interactions between compounds within breath, and confounding signals from comorbidities. Towards this end, we have endeavored to create an averaged healthy human ‘profile’ against which follow-on studies might be compared. Through the use of direct secondary electrospray ionization combined with a high-resolution mass spectrometry and in-house bioinformatics pipeline, we seek to curate an average healthy human profile for breath and use this model to distinguish differences inter- and intra-day for human volunteers. Breath samples were significantly different in PERMANOVA analysis and ANOSIM analysis based on Time of Day, Participant ID, Date of Sample, Sex of Participant, and Age of Participant ( p < 0.001). Optimal binning analysis identify strong associations between specific features and variables. These include 227 breath features identified as unique identifiers for 28 of the 31 participants. Four signals were identified to be strongly associated with female participants and one with male participants. A total of 37 signals were identified to be strongly associated with the time-of-day samples were taken. Threshold indicator taxa analysis indicated a shift in significant breath features across the age gradient of participants with peak disruption of breath metabolites occurring at around age 32. Forty-eight features were identified after filtering from which a healthy human breath profile for all participants was created.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1992

Optimum design of a gearbox for low vibration

A computer program was developed for designing a low vibration gearbox. The code is based on a finite element shell analysis, a modal analysis, and a structural optimization method. In the finite element analysis, a triangular shell element with 18 degrees-of-freedom is used. In the optimization method, the overall vibration energy of the gearbox is used as the objective function and is minimized at the exciting frequency by varying the finite element thickness. Modal analysis is used to derive the sensitivity of the vibration energy with respect to the design variable. The sensitivity is representative of both eigenvalues and eigenvectors. The optimum value is computed by the gradient projection method and a unidimensional search procedure under the constraint condition of constant weight. The computer code is applied to a design problem derived from an experimental gearbox in use at the NASA Lewis Research Center. The top plate and two side plates of the gearbox are redesigned and the contribution of each surface to the total vibration is determined. Results show that optimization of the top plate alone is effective in reducing total gearbox vibration.

Inoue, Katsumi↗

DOE OSTI2023

Securely Aggregated Coded Matrix Inversion

Coded computing is a method for mitigating straggling workers in a centralized computing network, by using erasure-coding techniques. Federated learning is a decentralized model for training data distributed across client devices. In this work we propose approximating the inverse of an aggregated data matrix, where the data is generated by clients; similar to the federated learning paradigm, while also being resilient to stragglers. To do so, we propose a coded computing method based on gradient coding. We modify this method so that the coordinator does not access the local data at any point; while the clients access the aggregated matrix in order to complete their tasks. Here, the network we consider is not centrally administrated, and the communications which take place are secure against potential eavesdroppers.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Kohn-Sham Solver (KSSOLV) v2.0

KSSOLV is a MATLAB toolbox for solving Kohn-Sham density functional theory based electronic structure eigenvalue problems. It uses an object oriented features of MATLAB to represent atom, molecules, wavefunctions and Hamiltonians and their operations. It is designed to make it easier for users to prototype and test new algorithms for solving the Kohn-Sham problem. KSSOLV2.0 contains significant improvement over the original KSSOLV described in a paper published in ACM Transaction on Mathematical Software (attached). In addition to performing ground state calculation for small molecules, it can also perform geometry optimization for both molecules and solids. It uses standard pseudopotentials and implements local density approximation, generalized gradient approximation and hybrid functionals. Future releases will also include time-dependent DFT and post DFT calculations such as the GW quasi-particle energy calculation and Bethe-Salpeter equation solver for optical absorption.

Yang, Chao↗

DOE OSTI2026

Score-based deterministic density sampling

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density π given only its score ∇ log π. Our method approximates the Wasserstein gradient flow on KL($f_t$∥π) by learning the time-varying score ∇ log $f_t$ on the fly using score matching. While having the same marginal distribution as Langevin dynamics, our method produces smooth deterministic trajectories, resulting in monotone noise-free convergence. We prove that our method dissipates relative entropy at the same rate as the exact gradient flow, provided sufficient training. Numerical experiments validate our theoretical findings: our method converges at the optimal rate, has smooth trajectories, and is often more sample efficient than its stochastic counterpart. Experiments on high-dimensional image data show that our method produces high-quality generations in as few as 15 steps and exhibits natural exploratory behavior. The memory and runtime scale linearly in the sample size.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Shape design sensitivities using fully automatic 3-D mesh generation

Previous work in three dimensional shape optimization involved specifying design variables by associating parameters directly with mesh points. More recent work has shown the use of fully-automatic mesh generation based upon a parameterized geometric representation. Design variables have been associated with a mathematical model of the part rather than the discretized representation. The mesh generation procedure uses a nonuniform grid intersection technique to place nodal points directly on the surface geometry. Although there exists an associativity between the mesh and the geometrical/topological entities, there is no mathematical functional relationship. This poses a problem during certain steps in the optimization process in which geometry modification is required. For the large geometrical changes which occur at the beginning of each optimization step, a completely new mesh is created. However, for gradient calculations many small changes must be made and it would be too costly to regenerate the mesh for each design variable perturbation. For that reason, a local remeshing procedure has been implemented which operates only on the specific edges and faces associated with the design variable being perturbed. Two realistic design problems are presented which show the efficiency of this process and test the accuracy of the gradient computations.

Botkin, M. E.↗

DOE OSTI2025

Understanding the Effect of Sample Geometry on Temperature Distribution during Optical Floating Zone Crystal Growth in Vacuum Environment through Heat Transfer Modeling

Optical floating zone furnaces (OFZ) have had a transformative impact on fundamental science due to their ability to rapidly produce large single crystals of a wide variety of complex materials. However, a quantitative understanding of the OFZ growth environment is generally lacking due to the difficulty of measuring the local sample temperatures during OFZ growth, as well as to the general lack of information about the temperature-dependent physical parameters needed to model heat transfer. To overcome these challenges, we apply a physics-based heat transfer model, parametrized by measurements from synchrotron experiments and a machine-learning (ML) algorithm, to simulate the temperature distributions of samples heated in an OFZ furnace in a vacuum environment. This model is used to quantitatively understand how the sample maximum temperature and temperature gradient (key parameters that influence the success of crystal growth) are affected by the rod size, rod shape, and heat-zone position on the rod. The results of this study can be applied to make informed decisions on how crystal growth parameters can be tuned to modify temperature profiles and to optimize crystal growth outcomes even when data on internal sample temperature profiles (e.g., those obtained through in situ synchrotron experiments) are not accessible.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Influence of Water Transport Across Microscale Bipolar Interfaces on the Performance of Direct Borohydride Fuel Cells

Direct borohydride fuel cells (DBFCs) can operate at double the voltage of proton exchange membrane fuel cells (PEMFCs) by employing an alkaline NaBH 4 fuel feed and an acidic H 2 O 2 oxidant feed. The pH-gradient-enabled microscale bipolar interface (PMBI) facilitates the creation and maintenance of an alkaline environment at the anode and an acidic environment at the cathode for the borohydride oxidation and peroxide reduction reactions. However, given the need to dissociate water at the interface to ensure ionic conduction, PMBI can be efficient only when anion exchange ionomer (AEI) moieties enable fast water transport for autoprotolysis. Herein, a series of polynorbornene-based AEIs with a range of water uptake values are examined to unravel the optimum water uptake required to enable high performance DBFCs. The DBFC with PMBI configuration containing the optimal AEI composition delivers a current density of 302 mA cm –2 at 1.5 V and a peak power density of 580 mW cm –2 at 1 V. This AEI composition exhibits high hydroxide ionic conductivity of 90.7 mS cm –1 at 80 °C with an IEC of 2.01 mequiv g –1 and demonstrates impressive chemical stability by retaining 98.75% of its initial ionic conductivity after immersion into anolyte (3 M KOH and 1.5 M NaBH 4 ) at 70 °C for 536 h.

25 ENERGY STORAGE↗