Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

FP-LAPW calculations of the elastic, electronic and thermoelectric properties of the filled skutterudite CeRu{sub 4}Sb{sub 12}

We have investigated the electronic structure, elastic and thermoelectric properties of the filled skutterudite CeRu{sub 4}Sb{sub 12} using the density functional theory (DFT). The full potential linearized augmented plane wave (FP-LAPW) method within a framework of the generalized gradient approximation (GGA) approach is used to perform the calculations presented here. The electronic structure calculation suggests an indirect band gap semiconducting nature of the material with energy band gap of 0.08 eV. The analysis of the elastic constants at relaxed positions reveals the ductile nature of the sample material with covalent contribution in the inter-atomic bonding. The narrow band gap semiconducting nature with high value of Seebeck coefficient suggests the possibility of the thermoelectric application of the material. The analysis of the thermal transport properties confirms the result obtained from the energy band structure of the material with high thermopower and dimensionless figure of merit 0.19 at room temperature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerated Sensitivity Analysis in High-Dimensional Stochastic Reaction Networks

Existing sensitivity analysis approaches are not able to handle efficiently stochastic reaction networks with a large number of parameters and species, which are typical in the modeling and simulation of complex biochemical phenomena. In this paper, a two-step strategy for parametric sensitivity analysis for such systems is proposed, exploiting advantages and synergies between two recently proposed sensitivity analysis methodologies for stochastic dynamics. The first method performs sensitivity analysis of the stochastic dynamics by means of the Fisher Information Matrix on the underlying distribution of the trajectories; the second method is a reduced-variance, finite-difference, gradient-type sensitivity approach relying on stochastic coupling techniques for variance reduction. Here in this paper we demonstrate that these two methods can be combined and deployed together by means of a new sensitivity bound which incorporates the variance of the quantity of interest as well as the Fisher Information Matrix estimated from the first method. The first step of the proposed strategy labels sensitivities using the bound and screens out the insensitive parameters in a controlled manner. In the second step of the proposed strategy, a finite-difference method is applied only for the sensitivity estimation of the (potentially) sensitive parameters that have not been screened out in the first step. Results on an epidermal growth factor network with fifty parameters and on a protein homeostasis with eighty parameters demonstrate that the proposed strategy is able to quickly discover and discard the insensitive parameters and in the remaining potentially sensitive parameters it accurately estimates the sensitivities. The new sensitivity strategy can be several times faster than current state-of-the-art approaches that test all parameters, especially in “sloppy” systems. In particular, the computational acceleration is quantified by the ratio between the total number of parameters over the number of the sensitive parameters.

97 MATHEMATICS AND COMPUTING↗

Gradient-based stochastic estimation of the density matrix

Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H) ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S -(d+2)/2d , where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Time-dependent density-functional tight-binding method with the third-order expansion of electron density

We develop a formalism for the calculation of excitation energies and excited state gradients for the self-consistent-charge density-functional tight-binding method with the third-order contributions of a Taylor series of the density functional theory energy with respect to the fluctuation of electron density (time-dependent density-functional tight-binding (TD-DFTB3)). The formulation of the excitation energy is based on the existing time-dependent density functional theory and the older TD-DFTB2 formulae. The analytical gradient is computed by solving Z-vector equations, and it requires one to calculate the third-order derivative of the total energy with respect to density matrix elements due to the inclusion of the third-order contributions. The comparison of adiabatic excitation energies for selected small and medium-size molecules using the TD-DFTB2 and TD-DFTB3 methods shows that the inclusion of the third-order contributions does not affect excitation energies significantly. A different set of parameters, which are optimized for DFTB3, slightly improves the prediction of adiabatic excitation energies statistically. The application of TD-DFTB for the prediction of absorption and fluorescence energies of cresyl violet demonstrates that TD-DFTB3 reproduced the experimental fluorescence energy quite well.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Nonlinear optimization for a tumor invasion PDE model

In this work, we introduce a methodology to approximate unknown parameters that appear on a non-linear reaction–diffusion model of tumor invasion. These equations consider that tumor-induced alteration of micro-environmental pH furnishes a mechanism for cancer invasion. A coupled system reaction–diffusion explaining this model is given by three partial differential equations for the non-dimensional spatial distribution and temporal evolution of the density of normal tissue, the neoplastic tissue growth and the excess concentration of H{sup +} ions. The tumor model parameters have a corresponding biological meaning: the reabsorption rate, the destructive influence of H{sup +} ions in the healthy tissue, the growth rate of tumor tissue and the diffusion coefficient. We propose to solve the direct problem using the Finite Element Method (FEM) and minimize an appropriate functional including both the real data (obtained via in-vitro experiments and fluorescence ratio imaging microscopy) and the numerical solution. The gradient of the functional is computed by the adjoint method.

60 APPLIED LIFE SCIENCES↗

An optimized method for mouse liver sinusoidal endothelial cell isolation

The objective of the present study was to develop an accurate and reproducible method for liver sinusoidal endothelial cell (LSEC) isolation in mice. Non-parenchymal cells were isolated using a modified two-step collagenase digestion combined with Optiprep density gradient centrifugation. LSEC were further purified using two prevalent methods, short-term selective adherence and CD146+ magnetic-activated cell sorting (MACS), and compared in terms of cell yield, viability and purity to our purification technique using CD11b cell depletion combined with long-term selective adherence. LSEC purification using our technique allowed to obtain 7.07±3.80 million LSEC per liver, while CD146+ MACS and short-term selective adherence yielded 2.94±1.28 and 0.99±0.66 million LSEC, respectively. Purity of the final cell preparation reached 95.10±2.58% when using our method. In contrast, CD146+ MACS and short-term selective adherence gave purities of 86.75±3.26% and 47.95±9.82%, respectively. Similarly, contamination by non-LSEC was the lowest when purification was performed using our technique, with a proportion of contaminating macrophages of only 1.87±0.77%. Further, isolated cells analysed by scanning electron microscopy presented typical LSEC fenestrations organized in sieve plates, demonstrating that the technique allowed to isolate bona fide LSEC. In conclusion, we described a reliable and reproducible technique for the isolation of high yields of pure LSEC in mice. This protocol provides an efficient method to prepare LSEC for studying their biological functions. - Highlights: • This protocol provides an efficient method to prepare primary mouse LSEC for studying their biological functions. • The liver cell dispersion step was improved by performing a retrograde cannulation of the liver. • The cell yield and the purity obtained were higher than comparative techniques in mice. • Contaminating macrophages were removed by introducing a CD11b- magnetic –activated cell sorting step.

60 APPLIED LIFE SCIENCES↗

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Selective capture and recovery of uranium oxide colloids from aqueous soil suspensions using high gradient magnetic filtration

High Gradient Magnetic Filtration (HGMF) is a promising method for the selective capture and recovery of uranium oxide from surface soils. To date, however, magnetic filtration of uranium oxide has only been demonstrated at a proof-of-principle scale using relatively small filters (<5 cm 3 ) at low flowrates (<60 mL/min). Here, to explore the efficacy of magnetic filtration of uranium oxide at a larger scale, a newly designed HGMF apparatus that is more than an order of magnitude larger than our earlier filters (106 cm 3 ) was designed, fabricated, and tested at relatively high flowrates. Filtration experiments were performed using aqueous uranium oxide particle suspensions with Arizona Road Dust (ARD) as a soil simulant. At a flowrate of 125 mL/min, the apparatus’ uranium capture rate was exceptionally high (96 %), but selectivity was poor due to the high rate of capture for diamagnetic soil constituents (e.g., 77 % for silicon). All particles were captured at a lower rate when the flowrate was increased to 250 mL/min, but uranium selectivity was significantly increased due to the more substantial reduction in diamagnetic particle capture (i.e., capture rate of 77 % and 15 % for uranium and silicon, respectively). When backwashing the apparatus at the same flowrates used during filtration experiments, the rate of uranium recovery tended to be fairly low. Nevertheless, higher flowrates (1 L/min) and sonication were both shown to be highly effective methods of increasing uranium recovery. Magnetic field simulations were also performed to investigate potential optimizations to the design of the apparatus. These simulations showed that the intensity of the applied magnetic field could be increased by increasing the thickness of the steel magnetic housing. Additionally, stochastic trajectory simulations were performed to investigate the potential mechanisms of particle capture.

HGMF↗

An Empirical Quantile Estimation Approach for Chance-Constrained Nonlinear Optimization Problems

We investigate an empirical quantile estimation approach to solve chance-constrained nonlinear optimization problems. Our approach is based on the reformulation of the chance constraint as an equivalent quantile constraint to provide stronger signals on the gradient. In this approach, the value of the quantile function is estimated empirically from samples drawn from the random parameters, and the gradient of the quantile function is estimated via a finite-difference approximation on top of the quantile-function-value estimation. We establish a convergence theory of this approach within the framework of an augmented Lagrangian method for solving general nonlinear constrained optimization problems. The foundation of the convergence analysis is a concentration property of the empirical quantile process, and the analysis is divided based on whether or not the quantile function is differentiable. In contrast to the sampling-and-smoothing approach used in the literature, the method developed in this paper does not involve any smoothing function and hence the quantile-function gradient approximation is easier to implement and there are less accuracy-control parameters to tune. Furthermore, we demonstrate the effectiveness of this approach and compare it with a smoothing method for the quantile-gradient estimation. Numerical investigation shows that the two approaches are competitive for certain problem instances.

Applied Probability↗

Electronic structure and thermoelectric properties of half-Heusler compounds with eight electron valence count—KScX (X = C and Ge)

Electronic band structure and structural properties of two representative half-Heusler (HH) compounds with 8 electron valence count (VC), KScC and KScGe, have been studied using first principles methods within density functional theory and generalized gradient approximation. These systems differ from the well studied class of HH compounds like ZrNiSn and ZrCoSb which have VC = 18 because of the absence of d electrons of the transition metal atoms Ni and Co. Electronic transport properties such as Seebeck coefficient (S), electrical conductivity (σ), electronic thermal conductivity (κ{sub e}) (the latter two scaled by electronic relaxation time), and the power factor (S{sup 2}σ) have been calculated using semi-classical Boltzmann transport theory within constant relaxation time approximation. Both the compounds are direct band gap semiconductors with band extrema at the X point. Their electronic structures show a mixture of heavy and light bands near the valance band maximum and highly anisotropic conduction and valence bands near the band extrema, desirable features of good thermoelectric. Optimal p- or n-type doping concentrations have been estimated based on thermopower and maximum power factors. The optimum room temperature values of S are ∼1.5 times larger than that of the best room temperature thermoelectric Bi{sub 2}Te{sub 3}. We also discuss the impact of the band structure on deviations from Weidemann-Franz law as one tunes the chemical potential across the band gap.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Design of a technique to measure the density of ultracold atoms in a short-period optical lattice in three dimensions with single-atom sensitivity

A measurement technique is described that has the potential to map the atomic site occupancies of ultracold atoms in a short-period three-dimensional optical lattice. The method uses accordion and pinning lattices, together with polarization gradient cooling and fluorescence detection, to measure the positions of individual atoms within the sample in three dimensions at a resolution of around half the atomic resonant wavelength. The method measures the site occupancy, rather than the parity of the site occupancy, of atoms in the lattice. It is expected that such measurements hold significant potential for the study of ultracold quantum dynamics.

74 ATOMIC AND MOLECULAR PHYSICS↗

Test of Shi et al. Method to Infer the Magnetic Reconnection Geometry from Spacecraft Data: MHD Simulation with Guide Field and Antiparallel Kinetic Simulation

When analyzing data from an array of spacecraft (such as Cluster or MMS) crossing a site of magnetic reconnection, it is desirable to be able to accurately determine the orientation of the reconnection site. If the reconnection is quasi-two dimensional, there are three key directions, the direction of maximum inhomogeneity (the direction across the reconnection site), the direction of the reconnecting component of the magnetic field, and the direction of rough invariance (the "out of plane" direction). Using simulated spacecraft observations of magnetic reconnection in the geomagnetic tail, we extend our previous tests of the direction-finding method developed by Shi et al. (2005) and the method to determine the structure velocity relative to the spacecraft Vstr. These methods require data from four proximate spacecraft. We add artificial noise and calibration errors to the simulation fields, and then use the perturbed gradient of the magnetic field B and perturbed time derivative dB/dt, as described by Denton et al. (2010). Three new simulations are examined: a weakly three-dimensional, i.e., quasi-two-dimensional, MHD simulation without a guide field, a quasi-two-dimensional MHD simulation with a guide field, and a two-dimensional full dynamics kinetic simulation with inherent noise so that the apparent minimum gradient was not exactly zero, even without added artificial errors. We also examined variations of the spacecraft trajectory for the kinetic simulation. The accuracy of the directions found varied depending on the simulation and spacecraft trajectory, but all the directions could be found within about 10 for all cases. Various aspects of the method were examined, including how to choose averaging intervals and the best intervals for determining the directions and velocity. For the kinetic simulation, we also investigated in detail how the errors in the inferred gradient directions from the unmodified Shi et al. method (using the unperturbed gradient) depended on the amplitude of the calibration errors. For an accuracy of 3 for the maximum gradient direction, the calibration errors could be as large as 3% of reconnection magnetic field, while for the same accuracy for the minimum gradient direction, the calibration errors could only be as large as 0.03% of the reconnection magnetic field. These results suggest that the maximum gradient direction can normally be determined by the unmodified Shi et al. method, while the modified method or some other method must be used to accurately determine the minimum gradient direction. The structure velocity was found with magnitude accurate to 2% and direction accurate to within 5%.

Denton, R.↗

Analytic gradients for compressed multistate pair-density functional theory

Photochemical reactions often involve states that are closely coupled due to near degeneracies, for example by proximity to conical intersections. Therefore, a multistate method is used to accurately describe these states; for example, ordinary perturbation theory is replaced by quasidegenerate perturbation theory. Multiconfiguration pair-density functional theory (MC-PDFT) provides an efficient way to approximate the full dynamical correlation energy of strongly correlated systems, and we recently proposed compressed multistate pair-density functional theory (CMS-PDFT) to treat closely coupled states. In the present paper, we report the implementation of analytic gradients for CMS-PDFT in both OpenMolcas and PySCF, and here we illustrate the use of these gradients by applying the method to the excited states of formaldehyde and phenol.

74 ATOMIC AND MOLECULAR PHYSICS↗

Stochastic properties of ultralight scalar field gradients

Ultralight axion-like particles are well-motivated dark matter candidates that are the target of numerous direct detection efforts. In the vicinity of the Solar System, such particles can be treated as oscillating scalar fields. The velocity dispersion of the Milky Way determines a coherence time of about 10 6 oscillations, beyond which the amplitude of the axion field fluctuates stochastically. Any analysis of data from an axion direct detection experiment must carefully account for this stochastic behavior to properly interpret the results. This is especially true for experiments sensitive to the gradient of the axion field that are unable to collect data for many coherence times. Indeed, the direction, in addition to the amplitude, of the axion field gradient fluctuates stochastically. We present the first complete stochastic treatment for the gradient of the axion field, including multiple computationally efficient methods for performing likelihood-based data analysis, which can be applied to any axion signal, regardless of coherence time. Additionally, we demonstrate that ignoring the stochastic behavior of the gradient of the axion field can potentially result in failure to discover a true axion signal

79 ASTRONOMY AND ASTROPHYSICS↗

Handling Iterative Solvers in an Algorithmic Differentiation Framework Using Implicit Methods

Differentiable programming is a powerful concept as it enables the seemly propagation of gradients through functions, algorithms, and/or whole physics simulations. These gradients are useful for a wide variety of applications, including sensitivity studies and machine learning, but one of particular interest is optimization. Gradient-based optimization, enabled through automatic/algorithmic differentiation (AD), can be used on predictive physical models to efficiently optimize a set of design variables. AD methods are a particularly promising approach to complex physics simulations because they can be shown to scale well with an increasing number of design variables; however, care must be taken when coupling between different models or different states of a single model.

algorithmic differentiation↗

Ab initio calculation of atomic solid hydrogen phases based on Gutzwiller many-body wave functions

We apply two ab initio many-body methods based on Gutzwiller wave functions, i.e., correlation matrix renormalization theory (CMRT) and Gutzwiller conjugate gradient minimization (GCGM), to the study of crystalline phases of atomic hydrogen. Both methods avoid empirical Hubbard U parameters and are free from double-counting issues. CMRT employs a Gutzwiller-type approximation that enables efficient calculations, while GCGM goes beyond this approximation to achieve higher accuracy at higher computational cost. By benchmarking against available quantum Monte Carlo (QMC) results, we demonstrate that while both methods are more accurate than the widely used density-functional theory, GCGM systematically captures additional correlation energy missing in CMRT, leading to significantly improved total energy predictions. We also show that by including the correlation energy Ec from local density approximation in the CMRT calculation, CMRT + E c produces energy in better agreement with the QMC results in these hydrogen lattice systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗