SEARCH · Search NASA

Results for “gradient based optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

All sources NASA NTRS DOE OSTI

DOE OSTI2024

AEPF: Attention-Enabled Point Fusion for 3D Object Detection

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class’s easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Chemistry↗

NASA NTRS1980

Flutter spectral measurements using stationary pressure transducers

The paper deals with an analysis procedure, based on engine-order sampling, which eliminates effectively the engine harmonics from the overall flutter spectra obtained with a case-mounted static pressure transducer. Qualitative spectral analyses of pressure data, performed on the basis of blade order sampling, are examined. The interference of blade motion with the pressure signal in the steep gradient portion of the blade passage is demonstrated, using optimal displacement spectra. Two methods which remove the contribution of blade motion from the blade-pressure-difference spectra are described.

Kurkov, A. P.↗

NASA NTRS1989

An adaptive guidance law for single stage to low earth orbit

An adaptive guidance algorithm based on a cubic spline representation of the ascent profile and imposition of a dynamic pressure constraint is studied for a single stage to low earth orbit. The flight path is divided into initial and terminal phases. In the initial phase, fully adaptive, and in the terminal phase, semi-adaptive, guidance schemes are used. The cubic spline paqrameters are determined by gradient optimization for maximum payload to orbit. In the terminal phase, a linear quadratic regulator is used to derive the optimal feedback gains to keep the vehicle close to the nominal path. The computational aspects of the guidance algorithm are examined and criteria are developed to ensure stability and convergence.

Pamadi, Bandu N.↗

NASA NTRS1993

Trajectory optimization based on differential inclusion

A method for generating finite-dimensional approximations to the solutions of optimal control problems is introduced. By employing a description of the dynamical system in terms of its attainable sets in favor of using differential equations, the controls are completely eliminated from the system model. Besides reducing the dimensionality of the discretized problem compared to state-of-the-art collocation methods, this approach also alleviates the search for initial guesses from where standard gradient search methods are able to converge. The mechanics of the new method are illustrated on a simple double integrator problem. The performance of the new algorithm is demonstrated on a 1-D rocket ascent problem ('Goddard Problem') in presence of a dynamic pressure constraint.

Seywald, Hans↗

NASA NTRS1993

Trajectory optimization based on differential inclusion

A method for generating finite-dimensional approximations to the solutions of optimal control problems is introduced. By employing a description of the dynamical system in terms of its attainable sets in favor of using differential equations, the controls are completely eliminated from the system model. Besides reducing the dimensionality of the discretized problem compared to state-of-the-art collocation methods, this approach also alleviates the search for initial guesses from where standard gradient search methods are able to converge. The mechanics of the new method are illustrated on a simple double integrator problem. The performance of the new algorithm is demonstrated on a I-D rocket ascent problem ('Goddard Problem') in presence of a dynamic pressure constraint.

Seywald, Hans↗

NASA NTRS1993

Trajectory optimization based on differential inclusion

A method for generating finite-dimensional approximations to the solutions of optimal control problems is introduced. By employing a description of the dynamical system in terms of its attainable sets in favor of using differential equations, the controls are completely eliminated from the system model. Besides reducing the dimensionality of the discretized problem compared to state-of-the-art collocation methods, this approach also alleviates the search for initial guesses from where standard gradient search methods are able to converge. The mechanics of the new method are illustrated on a simple double integrator problem. The performance of the new algorithm is demonstrated on a 1-D rocket ascent problem (`Goddard Problem') in presence of a dynamic pressure constraint.

Seywald, Hans↗

DOE OSTI2024

Massively parallel axisymmetric fluid model for streamer discharges

A highly parallelizable fluid plasma simulation tool based upon the first-order drift-diffusion equations is discussed. Atmospheric pressure plasmas have densities and gradients that require small element sizes in order to accurately simulate the plasm resulting in computational meshes on the order of millions to tens of millions of elements for realistic size plasma reactors. To enable simulations of this nature, parallel computing is required and must be optimized for the particular problem. Here, a finite-volume, electrostatic drift-diffusion implementation for low-temperature plasma is discussed. The implementation is built upon the Message Passing Interface (MPI) library in C++ using Object Oriented Programming. The underlying numerical method is outlined in detail and benchmarked against simple streamer formation from other streamer codes. Electron densities, electric field, and propagation speeds are compared with the reference case and show good agreement. Convergence studies are also performed showing a minimal space step of approximately 4 μm required to reduce relative error to below 1% during early streamer simulation times and even finer space steps are required for longer times. Additionally, strong and weak scaling of the implementation are studied and demonstrate the excellent performance behavior of the implementation up to 100 million elements on 1024 processors. Lastly, different advection schemes are compared for the simple streamer problem to analyze the influence of numerical diffusion on the resulting quantities of interest.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

Hierarchical Flexibility Offering Strategy for Integrated Hybrid Resources in Real-time Energy Markets

This paper proposes a hierarchical model for determining the energy flexibility offering strategy of integrated hybrid resources (IHRs) in power distribution systems to participate in real-time energy markets. The proposed model utilizes the scalability, fast response time, and uncertainty observation of deep reinforcement learning (DRL) to overcome the scalability issue of operating numerous flexible resources and deliverability of energy flexibility to the real-time markets in the presence of the network constraints. To that end, the power distribution system is divided into multiple IHRs, where different types of flexible loads, energy storage systems, and solar plants with controllable inverters are operated through local IHR controllers, trained by deep deterministic policy gradient (DDPG) algorithm. Active power request and reactive power capacity of IHRs are then transmitted to a central flexibility controller, where a quadratic optimization model ensures the deliverability of the energy flexibility to the real-time energy market by satisfying the distribution network constraints. The proposed model is implemented on the 123-bus test power distribution system, demonstrating the capability of DRL-based hierarchical model for scalable operation of IHRs in order to offer deliverable energy flexibility to the real-time energy market.

Majidi, Majid↗

DOE OSTI2023

Proxy quality control of biomass particles using thermogravimetric analysis and Gaussian process regression models

Abstract The temperature experienced by reactants during preparation in a reactor is a key component in determining the yield and homogeneity of usable chemical products such as biomass particles. Thermocouples with sensors can be used to monitor spatial temperature gradients within reactors but these sensors are often too expensive and/or invasive. The present work proposes a strategy to identify optimal machine learning models to infer the maximum effective temperature experienced by particles during oxidative biomass torrefaction using key thermochemical combustion parameters. The maximum rate of weight loss, the corresponding temperature, and fixed carbon content on a dry‐ash‐free basis are used as literature‐based predictor variables obtained from thermogravimetric analysis. The evaluation of 24 machine‐learning models using the standard tenfold cross‐validation method suggests that the exponential Gaussian process regression (GPR) model is the most effective, followed by other GPR models. These high‐performing GPR models were also utilized to predict the effective preparation temperature distribution of reactor‐produced biomass particles under eight conditions of varying residence time and air‐to‐biomass ratio. The effective preparation temperature and residence time of individual biomass particles were then encoded into the torrefaction severity factor and used to estimate the energy yield of the reactor output as a novel quality control method. © 2023 The Authors. Biofuels, Bioproducts and Biorefining published by Society of Industrial Chemistry and John Wiley & Sons Ltd.

09 BIOMASS FUELS↗

DOE OSTI2025

Response tailoring of elasto-plastic trusses

Abstract In this work we tailor the response of trusses loaded beyond their yield limit. The truss structures are modeled using finite strain theory and rate-independent elasto-plasticity. We design trusses with a tailored mechanical response that is between “elastic” and “elastic-ideal-plastic” subject to the volume constraint. The design updates are generated by the gradient-based Method of Moving Asymptotes (MMA) solver and the sensitivities of the response functions are computed using a path-dependent adjoint sensitivity analysis. The computations are performed in Matlab.

42 ENGINEERING↗

DOE OSTI2023

An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints

The primary goal of this paper is to provide an efficient solution algorithm based on the augmented Lagrangian framework for optimization problems with a stochastic objective function and deterministic constraints. Our main contribution is combining the augmented Lagrangian framework with adaptive sampling, resulting in an efficient optimization methodology validated with practical examples. To achieve the presented efficiency, here we consider inexact solutions for the augmented Lagrangian subproblems, and through an adaptive sampling mechanism, we control the variance in the gradient estimates. Furthermore, we analyze the theoretical performance of the proposed scheme by showing equivalence to a gradient descent algorithm on a Moreau envelope function, and we prove sublinear convergence for convex objectives and linear convergence for strongly convex objectives with affine equality constraints. The worst-case sample complexity of the resulting algorithm, for an arbitrary choice of penalty parameter in the augmented Lagrangian function, is $\mathscr{O}$(ϵ -3-δ ) , where ϵ > 0 is the expected error of the solution and δ > 0 is a user-defined parameter. If the penalty parameter is chosen to be $\mathscr{O}$(ϵ -1 ), we demonstrate that the result can be improved to $\mathscr{O}$(ϵ -2 ) , which is competitive with the other methods employed in the literature. Moreover, if the objective function is strongly convex with affine equality constraints, we obtain $\mathscr{O}$(ϵ -1 log(1/ϵ)) complexity. Finally, we empirically verify the performance of our adaptive sampling augmented Lagrangian framework in machine learning optimization and engineering design problems, including topology optimization of a heat sink with environmental uncertainty.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Low-Cost Screening of Algae for Extreme Tolerance to pH, Temperature, Salinity, and Light

AbstractBioprospecting algae strains with tolerance to extreme conditions such as pH, temperature, salinity, and light is crucial for advancing biotechnology and environmental applications. However, traditional screening methods often involve significant costs and labor, restricting their accessibility and practical use. In this study, we developed and validated low-cost, high-throughput screening techniques, predominantly employing agar plates and liquid culture assays, to effectively differentiate tolerance levels among various algae strains. The methodologies were optimized using the model microalgaChlamydomonas reinhardtiiand its closely related speciesChlamydomonas incertaand the recently discovered extremophilicChlamydomonas pacifica. We systematically evaluated the algae for tolerance to extremes by establishing precise gradients of pH (acidic to alkaline conditions), salinity (0 to 5 M NaCl), temperature (34–42°C), and light intensity (40 to 2977 μE·m⁻²·s⁻¹). Our results demonstrated that these cost-effective, agar plate-based methods effectively distinguished algae strains exhibiting superior tolerance to extreme environmental conditions. These screening techniques not only provided clear differentiation among the closely related strains but also delivered reproducible outcomes suitable for scaling up to larger bioprospecting efforts. Furthermore, the affordability and simplicity of these methods facilitate their implementation in resource-limited laboratories, thereby broadening participation in algae bioprospecting endeavors. This study highlights the potential of low-cost, accessible screening techniques to significantly enhance the discovery and characterization of algal strains with extreme traits. Ultimately, these methods support the development of robust algae-based resources, driving innovation in diverse industrial processes and environmental solutions.Graphical Abstract

Saucedo, Barbara (ORCID:0009000008860839)↗

DOE OSTI2024

Inverse design for waveguide dispersion with a differentiable mode solver

Inverse design of optical components based on adjoint sensitivity analysis has the potential to address the most challenging photonic engineering problems. However, existing inverse design tools based on finite-difference-time-domain (FDTD) models are poorly suited for optimizing waveguide modes for adiabatic transformation or perturbative coupling, which lies at the heart of many important photonic devices. Among these, dispersion engineering of optical waveguides is especially challenging in ultrafast and nonlinear optical applications involving broad optical bandwidths and frequency-dependent anisotropic dielectric material response. In this work, we develop gradient back-propagation through a general-purpose electromagnetic eigenmode solver and use it to demonstrate waveguide dispersion optimization for second harmonic generation with maximized phase-matching bandwidth. This optimization of three design parameters converges in eight steps, reducing the computational cost of optimization by ∼100x compared to exhaustive search and identifying new designs for broadband optical frequency doubling of laser sources in the 1.3–1.4 µm wavelength range. Furthermore, we demonstrate that the computational cost of gradient back-propagation is independent of the number of parameters, as required for optimization of complex geometries. This technique enables practical inverse design for a broad range of previously intractable photonic devices.

Gray, Dodd (ORCID:000000030469599X)↗

NASA NTRSDate not supplied

Advancing GRCop-based Bimetallic Additive Manufacturing to Optimize Component Design and Applications for Liquid Rocket Engines

Additive manufacturing (AM) is advancing many applications of component design for liquid rocket engines. The ability to rapidly design and manufacture components has provided significant opportunities for development and flight programs across the propulsion industry. AM has demonstrated significant advantages that include cost and schedule savings in addition to performance improvements through new design opportunities. While these performance advantages can be in the characteristics of complex design features, they can also be in the form of new materials. AM has been demonstrated in these various component applications using a variety of metal alloys, many of which are traditional alloys for extreme environments. Additional developments were completed using AM to provide new alloys and maturing these material uses for high performance applications. Almost all of the prior developments across component applications have focused on single-alloys in these AM processes. NASA and industry partners have focused in recent years to advance processing to create bimetallic and multicomponent AM processes and materials. The role of multi-alloy AM offers advantages since it can further optimize weight, optimize reliability and performance by increasing the strength to weight ratio of a component, and can optimize materials for various engineering requirements. This is particularly important in liquid rocket engine combustion devices that must reject heat in high heat flux environments yet maintain adequate structural margins under high operational pressure. NASA has been exploring several AM processes, materials, and applications for combustion devices, specifically combustion chambers, injectors, nozzles, and ignition systems. These components require fine geometric features for internal flow or cooling functionality. They experience high thermal gradients across thin-walls and must survive high pressures and temperatures from propellants and the combustion process. A copper-based alloy is normally used to provide high thermal conductivity, but at the detriment of increased weight if used as a single alloy in an AM chamber. Various AM processes were demonstrated on these components using a copper-based alloy/superalloy bimetallic solution. The AM processes being explored individually and in combination for bimetallic applications include Laser Powder Bed Fusion (L-PBF), Laser Powder Directed Energy Deposition (LP-DED), and cold spray. The combination of bimetallic material combinations explored in this research include copper-based material primarily and superalloys, Inconel 625 or NASA HR-1. The various aspects of the additive manufacturing processes and challenges, materials characterization, and the testing of bimetallic components in a relevant environment will be discussed.

Additive Manufacturing↗

NASA NTRSDate not supplied

Advancing GRCop-based Bimetallic Additive Manufacturing to Optimize Component Design and Applications for Liquid Rocket Engines

Additive Manufacturing↗

DOE OSTI2022

Approximating the linear response of physical chaos

Abstract Parametric derivatives of statistics are highly desired quantities in prediction, design optimization and uncertainty quantification. In the presence of chaos, the rigorous computation of these quantities is certainly possible, but mathematically complicated and computationally expensive. Based on Ruelle’s formalism, this paper shows that the sophisticated linear response algorithm can be dramatically simplified in higher-dimensional systems featuring statistical homogeneity in the physical space. We argue that the contribution of the SRB (Sinai–Ruelle–Bowen) measure gradient, which is an integral yet the most cumbersome part of the full algorithm, is negligible if the objective function is appropriately aligned with unstable manifolds. This abstract condition could potentially be satisfied by a vast family of real-world chaotic systems, regardless of the physical meaning and mathematical form of the objective function and perturbed parameter. We demonstrate several numerical examples that support these conclusions and that present the use and performance of a simplified linear response algorithm. In the numerical experiments, we consider physical models described by differential equations, including Lorenz 96 and Kuramoto–Sivashinsky.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

Macroscale property assessment and indentation characteristics of thick section friction stir welded AA 5083

The spatial gradients in microstructure have been proven to be effective in optimizing the performance of components, and several techniques have been developed to achieve this microstructure. Nevertheless, the local microstructural modification methods inevitably result in the formation of gradient microstructure leading to a variation in the property. Herein this work systematically investigates the effect of gradient microstructure formed during thick section friction stir weld Al5083 alloy on its mechanical properties. A novel macro-indentation technique, profilometer-based indentation plastometry (PIP), is utilized to capture the variation in the mechanical properties in the feedstock (rolled plate) and weld region. The feedstock exhibited a gradient microstructure owing to different stress states during rolling. Additionally, the stirring of the tool resulted in a complex material flow pattern producing a microstructure gradient in the weld region. The aspect ratio of the grains was identified as the primary factor causing variation in indentation response in the feedstock. In contrast, variation in the grain size in the weld region resulted in property variation. Overall, the stir zone has a lower yield strength (158±4MPa) than the base material (173±3MPa). In addition, microstructure heterogeneity in the stir zone resulted in lower elongation than the base material.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗