Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient based optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Image registration - Similarity measure and preprocessing method comparisons

An experimental comparison of several similarity measures and preprocessing techniques used for the registration of temporally differing images is carried out. It is found that preprocessing of the images via a gradient operator improves the registration performance. This is in agreement with a derived optimal processor based upon image and temporal difference characteristics.

Svedlow, M.↗

Multifidelity Analysis and Optimization for Supersonic Design

Supersonic aircraft design is a computationally expensive optimization problem and multifidelity approaches over a significant opportunity to reduce design time and computational cost. This report presents tools developed to improve supersonic aircraft design capabilities including: aerodynamic tools for supersonic aircraft configurations; a systematic way to manage model uncertainty; and multifidelity model management concepts that incorporate uncertainty. The aerodynamic analysis tools developed are appropriate for use in a multifidelity optimization framework, and include four analysis routines to estimate the lift and drag of a supersonic airfoil, a multifidelity supersonic drag code that estimates the drag of aircraft configurations with three different methods: an area rule method, a panel method, and an Euler solver. In addition, five multifidelity optimization methods are developed, which include local and global methods as well as gradient-based and gradient-free techniques.

Kroo, Ilan↗

Stochastic Learning Approach for Binary Optimization: Application to Bayesian Optimal Design of Experiments

Here, we present a novel stochastic approach to binary optimization suited for optimal experimental design (OED) for Bayesian inverse problems governed by mathematical models such as partial differential equations. The OED utility function, namely, the regularized optimality criterion, is cast into a stochastic objective function in the form of an expectation over a multivariate Bernoulli distribution. The probabilistic objective is then solved by using a stochastic optimization routine to find an optimal observational policy. This formulation (a) is generally applicable to binary optimization problems with soft constraints and is ideal for OED and sensor placement problems; (b) does not require differentiability of the original objective function (e.g., a utility function in OED applications) with respect to the design variable, and thus it enables direct employment of sparsity-enforcing penalty functions such as $\ell_0$, without needing to utilize a continuation procedure or apply a rounding technique; (c) exhibits much lower computational cost than traditional gradient-based relaxation approaches; and (d) can be applied to both linear and nonlinear OED problems with proper choice of the utility function. The proposed approach is analyzed from an optimization perspective with detailed convergence analysis of the optimization approach and is also analyzed from a machine learning perspective with correspondence to policy gradient reinforcement learning. The approach is demonstrated numerically by using an idealized two-dimensional Bayesian linear inverse problem and validated by extensive numerical experiments carried out for sensor placement in a parameter identification setup.

97 MATHEMATICS AND COMPUTING↗

Protection Against Graph-Based False Data Injection Attacks on Power Systems

Graph signal processing (GSP) has emerged as a powerful tool for practical network applications, including power system monitoring. By representing power system voltages as smooth graph signals, recent research has focused on developing GSP-based methods for state estimation, attack detection, and topology identification. Included, efficient methods have been developed for detecting false data injection (FDI) attacks, which until now were perceived as non-smooth with respect to the graph Laplacian matrix. Consequently, these methods may not be effective against smooth FDI attacks. In this paper, we propose a graph FDI (GFDI) attack that minimizes the Laplacian-based graph total variation (TV) under practical constraints. In addition, we develop a low-complexity algorithm that solves the non-convex GDFI attack optimization problem using ell_1-norm relaxation, the projected gradient descent (PGD) algorithm, and the alternating direction method of multipliers (ADMM). We then propose a protection scheme that identifies the minimal set of measurements necessary to constrain the GFDI output to high graph TV, thereby enabling its detection by existing GSP-based detectors. Our numerical simulations on the IEEE-57 bus test case reveal the potential threat posed by well-designed GSP-based FDI attacks. Moreover, we demonstrate that integrating the proposed protection design with GSP-based detection can lead to significant hardware cost savings compared to previous designs of protection methods against FDI attacks.

Morgenstern, Gal↗

Optimal Disturbances in Boundary Layers Subject to Streamwise Pressure Gradient

Laminar-turbulent transition in shear flows is still an enigma in the area of fluid mechanics. The conventional explanation of the phenomenon is based on the instability of the shear flow with respect to infinitesimal disturbances. The conventional hydrodynamic stability theory deals with the analysis of normal modes that might be unstable. The latter circumstance is accompanied by an exponential growth of the disturbances that might lead to laminar-turbulent transition. Nevertheless, in many cases, the transition scenario bypasses the exponential growth stage associated with the normal modes. This type of transition is called bypass transition. An understanding of the phenomenon has eluded us to this day. One possibility is that bypass transition is associated with so-called algebraic (non-modal) growth of disturbances in shear flows. In the present work, an analysis of the optimal disturbances/streamwise vortices associated with the transient growth mechanism is performed for boundary layers in the presence of a streamwise pressure gradient. The theory will provide the optimal spacing of the control elements in the spanwise direction and their placement in the streamwise direction.

Tumin, Anatoli↗

Electron Beam Freeform Fabrication of Titanium Alloy Gradient Structures

Historically, the structural optimization of aerospace components has been done through geometric methods. A monolithic material is chosen based on the best compromise between the competing design limiting criteria. Then the structure is geometrically optimized to give the best overall performance using the single material chosen. Functionally graded materials offer the potential to further improve structural efficiency by allowing the material composition and/or microstructural features to spatially vary within a single structure. Thus, local properties could be tailored to the local design limiting criteria. Additive manufacturing techniques enable the fabrication of such graded materials and structures. This paper presents the results of a graded material study using two titanium alloys processed using electron beam freeform fabrication, an additive manufacturing process. The results show that the two alloys uniformly mix at various ratios and the resultant static tensile properties of the mixed alloys behave according to rule-of-mixtures. Additionally, the crack growth behavior across an abrupt change from one alloy to the other shows no discontinuity and the crack smoothly transitions from one crack growth regime into another.

Brice, Craig A.↗

Microscale thermophoresis as a powerful tool for screening glycosyltransferases involved in cell wall biosynthesis

Background: Identification and characterization of key enzymes associated with cell wall biosynthesis and modification is fundamental to gain insights into cell wall dynamics. However, it is a challenge that activity assays of glycosyltransferases are very low throughput and acceptor substrates are generally not available. Results: We optimized and validated microscale thermophoresis (MST) to achieve high throughput screening for glycosyltransferase substrates. MST is a powerful method for the quantitative analysis of protein-ligand interactions with low sample consumption. The technique is based on the motion of molecules along local temperature gradients, measured by fluorescence changes. We expressed glycosyltransferases as YFP-fusion proteins in tobacco and optimized the MST method to allow the determination of substrate binding affinity without purification of the target protein from the cell lysate. The application of this MST method to the β-1,4-galactosyltransferase AtGALS1 validated the capability to screen both nucleotide-sugar donor substrates and acceptor substrates. We also expanded the application to members of glycosyltransferase family GT61 in sorghum for substrate screening and function prediction. Conclusions: This method is rapid and sensitive to allow determination of both donor and acceptor substrates of glycosyltransferases. MST enables high throughput screening of glycosyltransferases for likely substrates, which will narrow down their in vivo function and help to select candidates for further studies. Additionally, this method gives insight into biochemical mechanism of glycosyltransferase function.

59 BASIC BIOLOGICAL SCIENCES↗

Supercooled Liquid Water Detection Capabilities from Ka-Band Doppler Profiling Radars: Moment-Based Algorithm Formulation and Assessment

The occurrence of supercooled liquid water in mixed-phase cloud (MPC) affects their cloud microphysical and radiative properties. The prevalence of MPCs in the mid- and high latitudes translates these effects to significant contributions to Earth’s radiative balance and hydrological cycle. The current study develops and assesses a radar-only, moment-based phase partition technique for the demarcation of supercooled liquid water volumes in arctic, MPC conditions. The study utilizes observations from the Ka band profiling radar, the collocated high spectral resolution lidar, and ambient temperature profiles from radio sounding deployments following a statistical analysis of 5.5 years of data (January 2014–May 2019) from the Atmospheric Radiation Measurement observatory at the North Slope of Alaska. The ice/liquid phase partition occurs via a per-pixel, neighborhood-dependent algorithm based on the premise that the partitioning can be deduced by examining the mean values of locally sampled probability distributions of radar-based observables and then compare those against the means of climatologically derived, per-phase probability distributions. Analyzed radar observables include linear depolarization ratio (LDR), spectral width, and vertical gradients of reflectivity factor and radial velocity corrected for vertical air motion. Results highlight that the optimal supercooled liquid water detection skill levels are realized for the radar variable combination of spectral width and reflectivity vertical gradient, suggesting that radar-based polarimetry, in the absence of full LDR spectra, is not as critical as Doppler capabilities. The cloud phase masking technique is proven particularly reliable when applied to cloud tops with an Equitable Threat Score (ETS) of 65%; the detection of embedded supercooled layers remains much more uncertain (ETS = 27%).

54 ENVIRONMENTAL SCIENCES↗

An Active Subspace Method for Accelerating Convergence in Delaunay-Based Optimization via Dimension Reduction

Delaunay-based derivative-free optimization, ∆DOGS, is an efficient and provably-convergent global optimization method for the problems which has computationally expensive objection function and the analytical expression for the objective function is not available. ∆-DOGS is a novel optimization scheme in the family of response surface methods (RSMs); however, it suffers from the curse of dimensionality since the computational cost increases dramatically as the number of design parameters increases. As a result, the number of design parameters in ∆-DOGS algorithm is relatively low (n.10). To avoid such problems, this paper proposes a combination of derivative-free optimization, seeking the global minimizer of an expensive and nonconvex objective function f(x) and active subspace method, detecting the directions of the most variability using evaluations of the gradient. The contribution of other directions to the objective function is bounded by a sufficiently small constant. This new algorithm iteratively applied Delaunay-based derivative-free optimization to seek the minimizer on the d-dimensional active subspace that has most function variation. Inverse mapping is needed to project data from active subspace to full-model for evaluating function values. This task is overcome by solving an inequality constrained problem that curves the response surface of the objective function. The test results show that this strategy is effective on a handful of optimization problems.

Bewley, Thomas R.↗

Optimal disturbances in boundary layers subject to streamwise pressure gradient

An analysis of the optimal non-modal growth of perturbations in a boundary layer in the presence of a streamwise pressure gradient is presented. The analysis is based on PSE equations for an incompressible fluid. Examples with Falkner-Scan profiles indicate that a favorable pressure gradient decreases the non-modal growth, while an unfavorable pressure gradient leads to an increase of the amplification. It is suggested that the transient growth mechanism be utilized to choose optimal parameters of tripping elements on a low-pressure turbine (LPT) airfoil. As an example, a boundary layer flow with a streamwise pressure gradient corresponding to the pressure distribution over a LPT airfoil is considered. It is shown that there is an optimal spacing of the tripping elements and that the transient growth effect depends on the starting point.

Ashpis, David E.↗

Improved image decompression for reduced transform coding artifacts

The perceived quality of images reconstructed from low bit rate compression is severely degraded by the appearance of transform coding artifacts. This paper proposes a method for producing higher quality reconstructed images based on a stochastic model for the image data. Quantization (scalar or vector) partitions the transform coefficient space and maps all points in a partition cell to a representative reconstruction point, usually taken as the centroid of the cell. The proposed image estimation technique selects the reconstruction point within the quantization partition cell which results in a reconstructed image which best fits a non-Gaussian Markov random field (MRF) image model. This approach results in a convex constrained optimization problem which can be solved iteratively. At each iteration, the gradient projection method is used to update the estimate based on the image model. In the transform domain, the resulting coefficient reconstruction points are projected to the particular quantization partition cells defined by the compressed image. Experimental results will be shown for images compressed using scalar quantization of block DCT and using vector quantization of subband wavelet transform. The proposed image decompression provides a reconstructed image with reduced visibility of transform coding artifacts and superior perceived quality.

Orourke, Thomas P.↗

Uncertainty-based weighted least squares density integration for background-oriented schlieren

We propose an improved density integration methodology for Background-Oriented Schlieren (BOS) measurements that overcomes the noise sensitivity of the commonly used Poisson solver. Here, the method employs a weighted least-squares (WLS) optimization of the 2D integration of the density gradient field by solving an over-determined system of equations. Weights are assigned to the grid points based on density gradient uncertainties to ensure that a less reliable measurement point has less effect on the integration procedure. Synthetic image analysis with a Gaussian density field shows that WLS constrains the propagation of random error and reduces it by 80% in comparison to Poisson for the highest noise level. Using WLS with experimental BOS measurements of flow induced by a spark plasma discharge shows a 30% reduction in density uncertainty in comparison to Poisson, thereby increasing the overall precision of the BOS density measurements.

42 ENGINEERING↗

Tailoring the Electronic Structures and Spectral Properties of ZnO with Irradiation Defects Generated Under Intense Electronic Excitation: A Combined Experimental and DFT Approach

Here, the relationship between the composition of the internal defect states, spectral properties, and correlated electronic structures of wurtzite zinc oxide (ZnO) crystals under 645 MeV Xe 35+ irradiation is systematically investigated, employing experimental characterizations combined with first-principle calculations. Based on the ion irradiation-induced thermal expansion and relaxation processes, the high concentration of vacancy/interstitial defects produced from the transient disordered phase in molten track states trigger photoelectric changes, as follows: i) the generation of internal defect states effectively reduces the intrinsic bandgap (3.25 eV → 2.66 eV); ii) a large number of defective active sites inhibits the recombination between electron–hole pairs, causing dark conductance and photoconductance to increase with increasing damage levels until optimal fluence is achieved. Based on the density functional theory (DFT) with the GGA + U (GGA = generalized gradient approximation) method, the defective models associated with the different electronic structures, density of states, formation energy, and the nature of the chemical bonding are established. The narrowing of the bandgap observed experimentally and the enhancement of carrier concentration originating from the internal electron defect states are qualitatively verified, therefore laying the foundation for designing future nanoscale photoelectronic devices and microelectronics applications.

36 MATERIALS SCIENCE↗

A log-barrier Newton-CG method for bound constrained optimization with complexity guarantees

Abstract We describe an algorithm based on a logarithmic barrier function, Newton’s method and linear conjugate gradients that seeks an approximate minimizer of a smooth function over the non-negative orthant. We develop a bound on the complexity of the approach, stated in terms of the required accuracy and the cost of a single gradient evaluation of the objective function and/or a matrix-vector multiplication involving the Hessian of the objective. The approach can be implemented without explicit calculation or storage of the Hessian.

O’Neill, Michael↗

MLOps for Beam Controls

Machine learning operations (MLOps) is the standardization and streamlining of the ML development lifecycle to address the challenges associated with large-scale machine learning applications. The full MLOps pipeline consists of open-source tools: DataHub, MinIO and MLflow. It is being used for dataset management and model development to handle changing data dependencies, varying business needs, reproducibility, and diverse teams working with differing tools and skills. To demonstrate the completion of an MLOps pipeline for particle accelerator operations, we are deploying a simple script that computes settings for the Booster’s gradient magnet power supply. Once the demonstration is complete, we will develop and deploy ML-based optimization algorithms to improve Booster’s overall efficiency. This MLOps pipeline opens the gate to systematically develop and deploy ML applications for accelerator controls and diagnostics.

43 PARTICLE ACCELERATORS↗

MLOps for Beam Controls

Machine learning operations (MLOps) is the standardization and streamlining of the ML development lifecycle to address the challenges associated with large-scale machine learning applications. The full MLOps pipeline consists of open-source tools: DataHub, MinIO and MLflow. It is being used for dataset management and model development to handle changing data dependencies, varying business needs, reproducibility, and diverse teams working with differing tools and skills. To demonstrate the completion of an MLOps pipeline for particle accelerator operations, we are deploying a simple script that computes settings for the Booster’s gradient magnet power supply. Once the demonstration is complete, we will develop and deploy ML-based optimization algorithms to improve Booster’s overall efficiency. This MLOps pipeline opens the gate to systematically develop and deploy ML applications for accelerator controls and diagnostics.

43 PARTICLE ACCELERATORS↗

MLOps for Beam Controls

Machine learning operations (MLOps) is the standardization and streamlining of the ML development lifecycle to address the challenges associated with large-scale machine learning applications. The full MLOps pipeline consists of open-source tools: DataHub, MinIO and MLflow. It is being used for dataset management and model development to handle changing data dependencies, varying business needs, reproducibility, and diverse teams working with differing tools and skills. To demonstrate the completion of an MLOps pipeline for particle accelerator operations, we are deploying a simple script that computes settings for the Booster’s gradient magnet power supply. Once the demonstration is complete, we will develop and deploy ML-based optimization algorithms to improve Booster’s overall efficiency. This MLOps pipeline opens the gate to systematically develop and deploy ML applications for accelerator controls and diagnostics.

43 PARTICLE ACCELERATORS↗

Optimal Disturbances in Boundary Layers Subject to Streamwise Pressure Gradient

An analysis of the non-modal growth of perturbations in a boundary layer in the presence of a streamwise pressure gradient is presented. The analysis is based on PSE equations for an incompressible fluid. Examples with Falkner- Skan profiles indicate that a favorable pressure gradient decreases the non-modal growth while an unfavorable pressure gradient leads to an increase of the amplification. It is suggested that the transient growth mechanism be utilized to choose optimal parameters of tripping elements on a low-pressure turbine (LPT) airfoil. As an example, a boundary-layer flow with a streamwise pressure gradient corresponding to the pressure distribution over a LPT airfoil is considered. It is shown that there is an optimal spacing of the tripping elements and that the transient growth effect depends on the starting point. The amplification is found to be small at the LPT s very low Reynolds numbers, but there is a possibility to enhance the transient energy growth by means of wall cooling.

Ashpis, David E.↗