Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Multiple-carrier-lifetime model for carrier dynamics in InGaN/GaN LEDs with a non-uniform carrier distribution

Here we introduce a multiple-carrier-lifetime model (MCLM) for light-emitting diodes (LEDs) with non-uniform carrier distribution, such as in multiple-quantum-well (MQW) structures. By employing the MCLM, we successfully explain the modulation response of V-pit engineered MQW LEDs, which exhibit an S 21 roll-off slower than –20 dB/decade. Using the proposed model and employing a gradient descent method, we extract effective recombination and escape lifetimes by averaging the carrier behavior across the quantum wells. Our results reveal slower effective carrier recombination and escape in MQW LEDs compared with LEDs emitting from a single QW, indicating the advantages of lower carrier density achieved through V-pit engineering. Notably, the effective carrier recombination time is more than one order of magnitude lower than the effective escape lifetime, suggesting that most carriers in the quantum wells recombine, while the escape process remains weak. To ensure the reliability and robustness of the MCLM, we subject it to a comprehensive threefold validation process. This work confirms the positive impact of spreading carriers into several quantum wells through V-pit engineering. In addition, the MCLM is applicable to other LEDs with a non-uniform carrier distribution, such as micro-LEDs with significant surface recombination and non-uniform lateral carrier profiles.

42 ENGINEERING↗
DOE OSTI2022

A rotationally invariant approach based on Gutzwiller wave function for correlated electron systems

Here, we introduce a rotationally invariant approach combined with the Gutzwiller conjugate gradient minimization method to study correlated electron systems. In the approach, the Gutzwiller projector is parametrized based on the number of electrons occupying the onsite orbitals instead of the onsite configurations. The approach efficiently groups the onsite orbitals according to their symmetry and greatly reduces the computational complexity, which yields a speedup of $20 \sim 50 \times $ in the minimal basis energy calculation of dimers. The computationally efficient approach promotes more accurate calculations beyond the minimal basis that is inapplicable in the original approach. A large-basis energy calculation of F 2 demonstrates favorable agreements with standard quantum-chemical calculations Bytautas et al (2007 J. Chem. Phys. 127 164317).

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2012

Protein subcellular location pattern classification in cellular images using latent discriminative models

Motivation: Knowledge of the subcellular location of a protein is crucial for understanding its functions. The subcellular pattern of a protein is typically represented as the set of cellular components in which it is located, and an important task is to determine this set from microscope images. In this article, we address this classification problem using confocal immunofluorescence images from the Human Protein Atlas (HPA) project. The HPA contains images of cells stained for many proteins; each is also stained for three reference components, but there are many other components that are invisible. Given one such cell, the task is to classify the pattern type of the stained protein. We first randomly select local image regions within the cells, and then extract various carefully designed features from these regions. This region-based approach enables us to explicitly study the relationship between proteins and different cell components, as well as the interactions between these components. To achieve these two goals, we propose two discriminative models that extend logistic regression with structured latent variables. The first model allows the same protein pattern class to be expressed differently according to the underlying components in different regions. The second model further captures the spatial dependencies between the components within the same cell so that we can better infer these components. To learn these models, we propose a fast approximate algorithm for inference, and then use gradient-based methods to maximize the data likelihood. Results: In the experiments, we show that the proposed models help improve the classification accuracies on synthetic data and real cellular images. The best overall accuracy we report in this article for classifying 942 proteins into 13 classes of patterns is about 84.6%, which to our knowledge is the best so far. In addition, the dependencies learned are consistent with prior knowledge of cell organization.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Fast, differentiable, and extensible big bang nucleosynthesis package

Here, we introduce light isotope nucleosynthesis with JAX (LINX), a new differentiable public big bang nucleosynthesis code designed for fast parameter estimation. By leveraging JAX, LINX achieves both speed and differentiability, enabling the use of Bayesian inference, including gradient-based methods. We discuss the formalism used in LINX for rapid primordial elemental abundance predictions and give examples of how LINX can be used. When combined with differentiable cosmic microwave background power spectrum emulators, LINX can be used for joint cosmic microwave background and big bang nucleosynthesis analyses without requiring extensive computational resources, including on personal hardware.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Stochastic noise can be helpful for variational quantum algorithms

Saddle points constitute a crucial challenge for first-order gradient descent algorithms. In notions of classical machine learning, they are avoided, for example, by means of stochastic gradient descent methods. In this work, we provide evidence that the saddle-points problem can be naturally avoided in variational quantum algorithms by exploiting the presence of stochasticity. We prove convergence guarantees and present practical examples in numerical simulations and on quantum hardware. We argue that the natural stochasticity of variational algorithms can be beneficial for avoiding strict saddle points, i.e., those saddle points with at least one negative Hessian eigenvalue. This insight that some levels of shot noise could help is expected to add a new perspective to notions of near-term variational quantum algorithms. Published by the American Physical Society 2025

Liu, Junyu↗
DOE OSTI2010

Topological insulators and topological nonlinear {sigma} models

In this paper we link the physics of topological nonlinear {sigma} models with that of Chern-Simons insulators. We show that corresponding to every 2n-dimensional Chern-Simons insulator there is a (n-1)-dimensional topological nonlinear {sigma} model with the Wess-Zumino-Witten term. Breaking internal symmetry in these nonlinear {sigma} models leads to nonlinear {sigma} models with the {theta} term. [This is analogous to the dimension reduction leading from 2n-dimensional Chern-Simons insulators to (2n-1) and (2n-2)-dimensional topological insulators protected by discrete symmetries.] The correspondence described in this paper allows one to derive the topological term in a theory involving fermions and order parameters (we shall referred to them as ''fermion-{sigma} models'') when the conventional gradient-expansion method fails. We also discuss the quantum number of solitons in topological nonlinear {sigma} model and the electromagnetic action of the (2n-1)-dimensional topological insulators. Throughout the paper we use a simple model to illustrate how things work.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Nucleon-pair coupling scheme in Elliott's SU(3) model

Elliott's SU(3) model is at the basis of the shell-model description of rotational motion in atomic nuclei. Here we demonstrate that SU(3) symmetry can be realized in a truncated shell-model space if constructed in terms of a sufficient number of collective S, D, G,...pairs (i.e., with angular momentum zero, two, four,...) and if the structure of the pairs is optimally determined either by a conjugate-gradient minimization method or from a Hartree-Fock intrinsic state. We illustrate the procedure for six protons and six neutrons in the pf (sdg) shell and exactly reproduce the level energies and electric quadrupole properties of the ground-state rotational band with SDG (SDGI) pairs. The SD-pair approximation without significant renormalization, on the other hand, cannot describe the full SU(3) collectivity. A mapping from Elliott's fermionic SU(3) model to systems with s, d, g,... bosons provides insight into the existence of a decoupled collective subspace in terms of S, D, G,... pairs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗
DOE OSTI2018

Communication-efficient Distributed Solutions to a System of Linear Equations with Laplacian Sparse Structure

Two communication-efficient distributed algorithms are proposed to solve a system of linear equations Ax = b with Laplacian sparse A. A system of linear equations with Laplacian sparse A can be found in many applications, e.g., the power flow problems and other network flow problems. The first algorithm is based on the gradient descent method in optimization and the agents only share two parts of the system state instead of that of the whole system state, which saves significant communication. The two parts shared by every agent through a communication link are the state information of its own and its neighbors connected by the communication link. The second method is obtained from an approximation of the Newton method, which converges faster. It requires twice as much communication as the first one but is still communicationefficient due to the low dimension of each part shared between agents. The convergence at a linear rate of both methods is proved. A comprehensive comparison of the convergence rate, communication burden, and computation costs between the methods is made. Finally, a simulation is conducted to show the effectiveness of both methods.

Wang, Peng↗
DOE OSTI2024

Time-Varying Feedback Optimization for Quadratic Programs with Heterogeneous Gradient Step Sizes

Online feedback-based optimization has become a promising framework for real-time optimization and control of complex engineering systems. This tutorial paper surveys the recent advances in the field as well as provides novel convergence results for primal-dual online algorithms with heterogeneous step sizes for different elements of the gradient. The analysis is performed for quadratic programs and the approach is illustrated on applications for adaptive step-size and model-free online algorithms, in the context of optimal control of modern power systems.

gradient methods↗
DOE OSTI2025

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

adaptation models↗
DOE OSTI2023

An Iterative Bidirectional Gradient Boosting Algorithm for CVR Baseline Estimation

This paper presents a novel iterative, bidirectional, gradient boosting (bidirectional-GB) algorithm for estimating the baseline of the Conservation Voltage Reduction (CVR) program. We define the CVR baseline as the load profile during the CVR period if the substation voltage is not lowered. The proposed algorithm consists of two key steps: selection of similar days and iterative bidirectional-GB training. In the first step, preand post-event temperature profiles of the targeted CVR day are used to select similar days from historical non-CVR days. In the second step, the pre-event and post-event similar days are used to train two GBMs iteratively: a forward-GBM and a backwardGBM. After each iteration, the two generated CVR baselines are reconciled and only the first and the last points on the reconciled baseline are kept. The iteration repeats until all CVR baseline points are generated. We tested two gradient boosting methods (i.e., GBM and LighGBM) with two data resolutions (i.e., 15and 30-minute). The results demonstrate that both the accuracy and performance of the algorithm are satisfactory.

Lee, Han Pyo↗
DOE OSTI2023

Optimization of Distribution Feeder Topology: A Differential Programming Learning Approach

This paper presents a gradient based method for optimizing distribution feeder network topology under load un- certainty. We recast the optimal network reconfiguration problem as a learning problem where edge weights of a graph are learned to produce an optimized spanning tree for a distribution network. Using recent methods published on differentiable programming, we provide a data driven method for learning these weights. We test our method on 100 variations of an IEEE 15-bus test system. Our results show that our method outperforms more traditional mathematical programming-based approaches.

differentiable programming↗
DOE OSTI2022

Accelerating Noisy VQE Optimization with Gaussian Processes

Hybrid variational quantum algorithms, which combine a classical optimizer with evaluations on a quantum chip, are the most promising candidates to show quantum advantage on current noisy, intermediate-scale quantum (NISQ) devices. The classical optimizer is required to perform well in the presence of noise in the objective function evaluations, or else it becomes the weakest link in the algorithm. We introduce the use of Gaussian Processes (GP) as surrogate models to reduce the impact of noise and to provide high quality seeds to escape local minima, whether real or noise-induced. We build this as a framework on top of local optimizations, for which we choose Implicit Filtering (ImFil) in this study. ImFil is a state-of-the-art, gradient-free method, which in comparative studies has been shown to outperform on noisy VQE problems. The result is a new method: "GP+ImFil". We show that when noise is present, the GP+ImFil approach finds results closer to the true global minimum in fewer evaluations than standalone ImFil, and that it works particularly well for larger dimensional problems. Using GP to seed local searches in a multi-modal landscape shows mixed results: although it is capable of improving on ImFil standalone, it does not do so consistently and would only be preferred over other, more exhaustive, multistart methods if resources are constrained.

Muller, Juliane↗
DOE OSTI2020

Multi-Level Optimal Power Flow Solver in Large Distribution Networks

Solving optimal power flow (OPF) problems for large distribution networks incurs high computational complexity. We consider a large multi-phase distribution network of tree topology with a deep penetration of active devices. We divide the network into collaborating areas featuring subtree topology and subareas featuring subsubtree topology. We design a multilevel implementation of the primal-dual gradient algorithm to solve the voltage regulation OPF problems while preserving nodal voltage information and topological information within areas and subareas. Numerical results on a 4,521-node system verify that the proposed algorithm can significantly improve the computational speed without compromising any optimality.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2017

A Distributed Algorithm for Economic Dispatch Over Time-Varying Directed Networks With Delays

In power system operation, economic dispatch problem (EDP) is designed to minimize the total generation cost while meeting the demand and satisfying generator capacity limits. This paper proposes an algorithm based on the gradient-push method to solve the EDP in a distributed manner over communication networks potentially with time-varying topologies and communication delays. It has been shown that the proposed method is guaranteed to solve the EDP if the time-varying directed communication network is uniformly jointly strongly connected. Moreover, the proposed algorithm is also able to handle arbitrarily large but bounded time delays on communication links. Numerical simulations are used to illustrate and validate the proposed algorithm.

Yang, Tao↗
DOE OSTI2015

Pore-scale investigation on stress-dependent characteristics of granular packs and the impact of pore deformation on fluid distribution

Understanding the effect of changing stress conditions on multiphase flow in porous media is of fundamental importance for many subsurface activities including enhanced oil recovery, water drawdown from aquifers, soil confinement, and geologic carbon storage. Geomechanical properties of complex porous systems are dynamically linked to flow conditions, but their feedback relationship is often oversimplified due to the difficulty of representing pore-scale stress deformation and multiphase flow characteristics in high fidelity. In this work, we performed pore-scale experiments of single- and multiphase flow through bead packs at different confining pressure conditions to elucidate compaction-dependent characteristics of granular packs and their impact on fluid flow. A series of drainage and imbibition cycles were conducted on a water-wet, soda-lime glass bead pack under varying confining stress conditions. Simultaneously, X-ray micro-CT was used to visualize and quantify the degree of deformation and fluid distribution corresponding with each stress condition and injection cycle. Micro-CT images were segmented using a gradient-based method to identify fluids (e.g., oil and water), and solid phase redistribution throughout the different experimental stages. Changes in porosity, tortuosity, and specific surface area were quantified as a function of applied confining pressure. Results demonstrate varying degrees of sensitivity of these properties to confining pressure, which suggests that caution must be taken when considering scalability of these properties for practical modeling purposes. Changes in capillary number with confining pressure are attributed to the increase in pore velocity as a result of pore contraction. Furthermore, this increase in pore velocity was found to have a marginal impact on average phase trapping at different confining pressures.

58 GEOSCIENCES↗
DOE OSTI2022

Machine learning and atomic layer deposition: Predicting saturation times from reactor growth profiles using artificial neural networks

In this work, we explore the application of deep neural networks to the optimization of atomic layer deposition (ALD) processes. In particular, we focus on a one-shot optimization problem, where we try to predict the optimal dose time that leads to saturation everywhere in the reactor based on thickness values measured at different points of an ALD reactor after a single trial growth. In order to tackle this problem, we introduce a dataset designed to train neural networks to predict saturation times based on these inputs for a cross-flow ALD reactor. Here, we then explore the predictive ability of artificial neural networks of different depths and sizes using a separate testing dataset to evaluate their accuracies. The results obtained show that networks trained using stochastic gradient descent methods can accurately predict saturation times without requiring any additional information on the surface kinetics. This provides a viable approach to minimize the number of experiments required to optimize new ALD processes in a known reactor, and it highlights the way machine learning can be leveraged for thin film growth and manufacturing. While the datasets and training procedure depend on the reactor geometry, the trained neural networks provide a general surrogate model connecting thickness values and trial dose times with optimal saturation times that can be reused for different ALD processes within the same reactor.

36 MATERIALS SCIENCE↗