Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Distributed and communication-efficient solutions to linear equations with special sparse structure

In this paper we report two distributed and communication-efficient algorithms based on the multi-agent system are proposed to solve a system of linear equations with the Laplacian sparse system matrix. One algorithm is based on the gradient descent method in optimization. In this algorithm, the agents only share partial information instead of all of their collective state vectors to save significant communication. The other algorithm is obtained by approximating Newton’s method for a faster convergence rate. Although it requires twice as much communication as the first one, it is still communication-efficient given the low dimension of the information shared among agents. The convergence at a linear rate is proved for both algorithms, and a comprehensive comparison of their convergence rate, communication burden, and computation costs is also performed. The proposed algorithms can be applied to various systems to solve those problems that can be modeled as a system of linear equations with a Laplacian sparse system matrix. Simulation results with the electric power system illustrate their effectiveness.

42 ENGINEERING↗

Diffusivity and Structure of Room Temperature Ionic Liquid in Various Organic Solvents

Room-temperature ionic liquids (RTILs) hold promise for applications in electric double layer capacitors (EDLCs), owing to a much wider potential window, lower vapor pressure, and better thermal and chemical stabilities compared to conventional aqueous and organic electrolytes. However, because the low diffusivity of ions in neat RTILs negates the EDLCs’ advantage of high power density, the ionic liquids are often used in mixture with organic solvents. In this study, we measured the diffusivity of cations and anions in RTIL, 1-butyl-3-methylimidazolium bis(trifluoromethylsulfonyl) ([BMIM + ][TFSI – ]), mixed with 10 organic solvents, by using the pulsed-field gradient NMR method. The ion diffusivity was found to follow that of neat solvents and in most studied solvents showed an excellent agreement with the predicted values reported in the recent molecular dynamics (MD) study [Thompson, M. W.; J. Phys. Chem. B 2019, 123, 1340-1347]. In two solvents consisting of long-chain molecules, however, the MD simulations predictions slightly underestimated the ionic diffusivities. The degree of ion dissociation was also estimated for each solvent by comparing the ionic conductivity with the molar conductivity derived from the diffusion measurements. The degree of ion dissociation and the hydrodynamic radius of ions suggest that the ions are coordinated by ~1 solvent molecule. Finally, the scarcity of solvent–ion interactions explains the fact that the diffusivity of ions in the mixture significantly depends on the viscosity of the solvent.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structural Evolution and Li Dynamics in Nanophase Li3PS4 by Solid-State and Pulsed Field Gradient NMR

The ceramic lithium ion conductor -Li3PS4 has a disordered and nanoporous structure that leads to an enhancement in ionic conductivity by some three orders of magnitude compared to the crystalline phase. The phase is prepared by thermal treatment of an inorganic-organic complex based on Li3PS4 and THF. Multinuclear (1H, 6,7Li, 31P) solid state NMR spectroscopy is used to characterize the structural phase evolution of the starting material at various steps in the thermal treatment. The phase formed after high temperature treatment is recognized as spectroscopically distinct from the bulk -Li3PS4 compound. Also formed is an amorphous lithium thiophosphate phase that is metastable as verified by annealing over an extended period. Lithium ion self-diffusion coefficients are measurable by standard pulsed gradient NMR methods at 100oC and with values consistent with the high ionic conductivity previously reported for this material.

energy storage↗

A Comparison of Linear Solvers for Resolving Flow in Three-Dimensional Discrete Fracture Networks

We compare various methods for resolving steady flow within three-dimensional discrete fracture networks, including direct methods, Krylov subspace methods with and without preconditioning, and multi-grid methods. We compared the performance of the methods based on compute times and scaling of the solution as a function of the number of grid nodes and log-variance of the hydraulic aperture. The methods are applied to three test cases: (a) variable density of networks with a truncated power-law distribution of fracture lengths, (b) a fixed network composed of monodisperse fracture sizes but varied permeability/aperture heterogeneity, (c) and a network based on field site in Nevada, US. We chose these cases to allow us to study the impact of the mesh size and flow properties, as well as to demonstrate our conclusions on a large-scale, realistic problem (more than 40 million mesh nodes). A direct solution using Cholesky factorization outperformed other methods for every example but was closely followed in performance by some algebraic multigrid (AMG) preconditioned Krylov subspace methods. Among the Krylov methods, conjugate gradients (CG) with an AMG preconditioner performs the best. Generally, Cholesky factorization is recommended, but CG with an AMG preconditioner may be suitable for very large problems beyond 40 million nodes where the entire linear system cannot reside in memory.

58 GEOSCIENCES↗

Scalable and accurate multi-GPU-based image reconstruction of large-scale ptychography data

Abstract While the advances in synchrotron light sources, together with the development of focusing optics and detectors, allow nanoscale ptychographic imaging of materials and biological specimens, the corresponding experiments can yield terabyte-scale volumes of data that can impose a heavy burden on the computing platform. Although graphics processing units (GPUs) provide high performance for such large-scale ptychography datasets, a single GPU is typically insufficient for analysis and reconstruction. Several works have considered leveraging multiple GPUs to accelerate the ptychographic reconstruction. However, most of these works utilize only the Message Passing Interface to handle the communications between GPUs. This approach poses inefficiency for a hardware configuration that has multiple GPUs in a single node, especially while reconstructing a single large projection, since it provides no optimizations to handle the heterogeneous GPU interconnections containing both low-speed (e.g., PCIe) and high-speed links (e.g., NVLink). In this paper, we provide an optimized intranode multi-GPU implementation that can efficiently solve large-scale ptychographic reconstruction problems. We focus on the maximum likelihood reconstruction problem using a conjugate gradient (CG) method for the solution and propose a novel hybrid parallelization model to address the performance bottlenecks in the CG solver. Accordingly, we have developed a tool, called PtyGer ( Pty chographic G PU(multipl e )-based r econstruction), implementing our hybrid parallelization model design. A comprehensive evaluation verifies that PtyGer can fully preserve the original algorithm’s accuracy while achieving outstanding intranode GPU scalability.

97 MATHEMATICS AND COMPUTING↗

Low responsiveness of machine learning models to critical or deteriorating health conditions

Machine learning (ML) based mortality prediction models can be immensely useful in intensive care units. Such a model should generate warnings to alert physicians when a patient’s condition rapidly deteriorates, or their vitals are in highly abnormal ranges. Before clinical deployment, it is important to comprehensively assess a model’s ability to recognize critical patient conditions. We develop multiple medical ML testing approaches, including a gradient ascent method and neural activation map. We systematically assess these machine learning models’ ability to respond to serious medical conditions using additional test cases, some of which are time series. Guided by medical doctors, our evaluation involves multiple machine learning models, resampling techniques, and four datasets for two clinical prediction tasks. We identify serious deficiencies in the models’ responsiveness, with the models being unable to recognize severely impaired medical conditions or rapidly deteriorating health. For in-hospital mortality prediction, the models tested using our synthesized cases fail to recognize 66% of the injuries. In some instances, the models fail to generate adequate mortality risk scores for all test cases. Our study identifies similar kinds of deficiencies in the responsiveness of 5-year breast and lung cancer prediction models. Using generated test cases, we find that statistical machine-learning models trained solely from patient data are grossly insufficient and have many dangerous blind spots. Most of the ML models tested fail to respond adequately to critically ill patients. How to incorporate medical knowledge into clinical machine learning models is an important future research direction.

60 APPLIED LIFE SCIENCES↗

Orbital relaxation effects on Kohn–Sham frontier orbital energies in density functional theory

We explore effects of orbital relaxation on Kohn–Sham frontier orbital energies in density functional theory by using a nonempirical scaling correction approach developed in Zheng et al. [J. Chem. Phys. 138, 174105 (2013)]. Relaxation of Kohn–Sham orbitals upon addition/removal of a fractional number of electrons to/from a finite system is determined by a systematic perturbative treatment. The information of orbital relaxation is then used to improve the accuracy of predicted Kohn–Sham frontier orbital energies by Hartree–Fock, local density approximation, and generalized gradient approximation methods. The results clearly highlight the significance of capturing the orbital relaxation effects. Moreover, the proposed scaling correction approach provides a useful way of computing derivative gaps and Fukui quantities of N-electron finite systems (N is an integer), without the need to perform self-consistent-field calculations for (N ± 1)-electron systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multiple-carrier-lifetime model for carrier dynamics in InGaN/GaN LEDs with a non-uniform carrier distribution

Here we introduce a multiple-carrier-lifetime model (MCLM) for light-emitting diodes (LEDs) with non-uniform carrier distribution, such as in multiple-quantum-well (MQW) structures. By employing the MCLM, we successfully explain the modulation response of V-pit engineered MQW LEDs, which exhibit an S 21 roll-off slower than –20 dB/decade. Using the proposed model and employing a gradient descent method, we extract effective recombination and escape lifetimes by averaging the carrier behavior across the quantum wells. Our results reveal slower effective carrier recombination and escape in MQW LEDs compared with LEDs emitting from a single QW, indicating the advantages of lower carrier density achieved through V-pit engineering. Notably, the effective carrier recombination time is more than one order of magnitude lower than the effective escape lifetime, suggesting that most carriers in the quantum wells recombine, while the escape process remains weak. To ensure the reliability and robustness of the MCLM, we subject it to a comprehensive threefold validation process. This work confirms the positive impact of spreading carriers into several quantum wells through V-pit engineering. In addition, the MCLM is applicable to other LEDs with a non-uniform carrier distribution, such as micro-LEDs with significant surface recombination and non-uniform lateral carrier profiles.

42 ENGINEERING↗

Fast bolometer built in an artificial HPHT diamond matrix

A fast bolometer built in a plate of diamond grown at high pressure by the gradient growth method is developed and fabricated. The parameters of this structure are compared with these of the structures investigated earlier, which were fabricated based on chemical vapour deposited (CVD) diamond and natural type IIa diamond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A rotationally invariant approach based on Gutzwiller wave function for correlated electron systems

Here, we introduce a rotationally invariant approach combined with the Gutzwiller conjugate gradient minimization method to study correlated electron systems. In the approach, the Gutzwiller projector is parametrized based on the number of electrons occupying the onsite orbitals instead of the onsite configurations. The approach efficiently groups the onsite orbitals according to their symmetry and greatly reduces the computational complexity, which yields a speedup of $20 \sim 50 \times $ in the minimal basis energy calculation of dimers. The computationally efficient approach promotes more accurate calculations beyond the minimal basis that is inapplicable in the original approach. A large-basis energy calculation of F 2 demonstrates favorable agreements with standard quantum-chemical calculations Bytautas et al (2007 J. Chem. Phys. 127 164317).

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Protein subcellular location pattern classification in cellular images using latent discriminative models

Motivation: Knowledge of the subcellular location of a protein is crucial for understanding its functions. The subcellular pattern of a protein is typically represented as the set of cellular components in which it is located, and an important task is to determine this set from microscope images. In this article, we address this classification problem using confocal immunofluorescence images from the Human Protein Atlas (HPA) project. The HPA contains images of cells stained for many proteins; each is also stained for three reference components, but there are many other components that are invisible. Given one such cell, the task is to classify the pattern type of the stained protein. We first randomly select local image regions within the cells, and then extract various carefully designed features from these regions. This region-based approach enables us to explicitly study the relationship between proteins and different cell components, as well as the interactions between these components. To achieve these two goals, we propose two discriminative models that extend logistic regression with structured latent variables. The first model allows the same protein pattern class to be expressed differently according to the underlying components in different regions. The second model further captures the spatial dependencies between the components within the same cell so that we can better infer these components. To learn these models, we propose a fast approximate algorithm for inference, and then use gradient-based methods to maximize the data likelihood. Results: In the experiments, we show that the proposed models help improve the classification accuracies on synthetic data and real cellular images. The best overall accuracy we report in this article for classifying 942 proteins into 13 classes of patterns is about 84.6%, which to our knowledge is the best so far. In addition, the dependencies learned are consistent with prior knowledge of cell organization.

59 BASIC BIOLOGICAL SCIENCES↗

Fast, differentiable, and extensible big bang nucleosynthesis package

Here, we introduce light isotope nucleosynthesis with JAX (LINX), a new differentiable public big bang nucleosynthesis code designed for fast parameter estimation. By leveraging JAX, LINX achieves both speed and differentiability, enabling the use of Bayesian inference, including gradient-based methods. We discuss the formalism used in LINX for rapid primordial elemental abundance predictions and give examples of how LINX can be used. When combined with differentiable cosmic microwave background power spectrum emulators, LINX can be used for joint cosmic microwave background and big bang nucleosynthesis analyses without requiring extensive computational resources, including on personal hardware.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Stochastic noise can be helpful for variational quantum algorithms

Saddle points constitute a crucial challenge for first-order gradient descent algorithms. In notions of classical machine learning, they are avoided, for example, by means of stochastic gradient descent methods. In this work, we provide evidence that the saddle-points problem can be naturally avoided in variational quantum algorithms by exploiting the presence of stochasticity. We prove convergence guarantees and present practical examples in numerical simulations and on quantum hardware. We argue that the natural stochasticity of variational algorithms can be beneficial for avoiding strict saddle points, i.e., those saddle points with at least one negative Hessian eigenvalue. This insight that some levels of shot noise could help is expected to add a new perspective to notions of near-term variational quantum algorithms. Published by the American Physical Society 2025

Liu, Junyu↗

Topological insulators and topological nonlinear {sigma} models

In this paper we link the physics of topological nonlinear {sigma} models with that of Chern-Simons insulators. We show that corresponding to every 2n-dimensional Chern-Simons insulator there is a (n-1)-dimensional topological nonlinear {sigma} model with the Wess-Zumino-Witten term. Breaking internal symmetry in these nonlinear {sigma} models leads to nonlinear {sigma} models with the {theta} term. [This is analogous to the dimension reduction leading from 2n-dimensional Chern-Simons insulators to (2n-1) and (2n-2)-dimensional topological insulators protected by discrete symmetries.] The correspondence described in this paper allows one to derive the topological term in a theory involving fermions and order parameters (we shall referred to them as ''fermion-{sigma} models'') when the conventional gradient-expansion method fails. We also discuss the quantum number of solitons in topological nonlinear {sigma} model and the electromagnetic action of the (2n-1)-dimensional topological insulators. Throughout the paper we use a simple model to illustrate how things work.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nucleon-pair coupling scheme in Elliott's SU(3) model

Elliott's SU(3) model is at the basis of the shell-model description of rotational motion in atomic nuclei. Here we demonstrate that SU(3) symmetry can be realized in a truncated shell-model space if constructed in terms of a sufficient number of collective S, D, G,...pairs (i.e., with angular momentum zero, two, four,...) and if the structure of the pairs is optimally determined either by a conjugate-gradient minimization method or from a Hartree-Fock intrinsic state. We illustrate the procedure for six protons and six neutrons in the pf (sdg) shell and exactly reproduce the level energies and electric quadrupole properties of the ground-state rotational band with SDG (SDGI) pairs. The SD-pair approximation without significant renormalization, on the other hand, cannot describe the full SU(3) collectivity. A mapping from Elliott's fermionic SU(3) model to systems with s, d, g,... bosons provides insight into the existence of a decoupled collective subspace in terms of S, D, G,... pairs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗

Communication-efficient Distributed Solutions to a System of Linear Equations with Laplacian Sparse Structure

Two communication-efficient distributed algorithms are proposed to solve a system of linear equations Ax = b with Laplacian sparse A. A system of linear equations with Laplacian sparse A can be found in many applications, e.g., the power flow problems and other network flow problems. The first algorithm is based on the gradient descent method in optimization and the agents only share two parts of the system state instead of that of the whole system state, which saves significant communication. The two parts shared by every agent through a communication link are the state information of its own and its neighbors connected by the communication link. The second method is obtained from an approximation of the Newton method, which converges faster. It requires twice as much communication as the first one but is still communicationefficient due to the low dimension of each part shared between agents. The convergence at a linear rate of both methods is proved. A comprehensive comparison of the convergence rate, communication burden, and computation costs between the methods is made. Finally, a simulation is conducted to show the effectiveness of both methods.

Wang, Peng↗

Time-Varying Feedback Optimization for Quadratic Programs with Heterogeneous Gradient Step Sizes

Online feedback-based optimization has become a promising framework for real-time optimization and control of complex engineering systems. This tutorial paper surveys the recent advances in the field as well as provides novel convergence results for primal-dual online algorithms with heterogeneous step sizes for different elements of the gradient. The analysis is performed for quadratic programs and the approach is illustrated on applications for adaptive step-size and model-free online algorithms, in the context of optimal control of modern power systems.

gradient methods↗