Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

A blended continuous–discontinuous finite element method for solving the multi-fluid plasma model

The multi-fluid plasma model represents electrons, multiple ion species, and multiple neutral species as separate fluids that interact through short-range collisions and long-range electromagnetic fields. The model spans a large range of temporal and spatial scales, which renders the model stiff and presents numerical challenges. To address the large range of timescales, a blended continuous and discontinuous Galerkin method is proposed, where the massive ion and neutral species are modeled using an explicit discontinuous Galerkin method while the electrons and electromagnetic fields are modeled using an implicit continuous Galerkin method. This approach is able to capture large-gradient ion and neutral physics like shock formation, while resolving high-frequency electron dynamics in a computationally efficient manner. The details of the Blended Finite Element Method (BFEM) are presented. The numerical method is benchmarked for accuracy and tested using two-fluid one-dimensional soliton problem and electromagnetic shock problem. The results are compared to conventional finite volume and finite element methods, and demonstrate that the BFEM is particularly effective in resolving physics in stiff problems involving realistic physical parameters, including realistic electron mass and speed of light. The benefit is illustrated by computing a three-fluid plasma application that demonstrates species separation in multi-component plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A combined ensemble-volume average homogenization method for lattice structures with defects under dynamic and static loading

In the study of lattices structures, both experiments and numerical simulations are often conducted with small samples. Using combined ensemble and volume averaging, this work introduces a method to extract a macroscopic constitutive response of a lattice material from numerical simulations performed in periodic domains. The domain size needed to obtain statistically accurate results is investigated. Similar to molecular dynamics, the concept of the virial stress is introduced after homogenized equations are derived using the ensemble averaging method. Under static conditions, the virial stress is shown to agree with the volume averaged solid stress. Using the homogenization method, constitutive relations for this stress can be obtained from systems with uniform strains. Application of such obtained constitutive relations to more general cases results in an error proportional to the square of the ratio between the lattice length scale and the macroscopic length scale. Taking advantage of this property, numerical simulations are performed in systems with a uniform gradient of the average velocity. The volume average method is then used to accelerate convergence when studying lattices with defects. To avoid the artificial numerical time scale from the size of a representative volume element divided by the wave speed, a numerical scheme is developed to enforce a spatially uniform velocity gradient within the computational domain while allowing fluctuations of the velocity or displacement to develop naturally. To account for probability distribution of lattice defects, the stress is calculated as the ensemble-volume averaged value. For dynamic systems, energy dissipation properties are also studied.

36 MATERIALS SCIENCE↗

FP-LAPW calculations of the elastic, electronic and thermoelectric properties of the filled skutterudite CeRu{sub 4}Sb{sub 12}

We have investigated the electronic structure, elastic and thermoelectric properties of the filled skutterudite CeRu{sub 4}Sb{sub 12} using the density functional theory (DFT). The full potential linearized augmented plane wave (FP-LAPW) method within a framework of the generalized gradient approximation (GGA) approach is used to perform the calculations presented here. The electronic structure calculation suggests an indirect band gap semiconducting nature of the material with energy band gap of 0.08 eV. The analysis of the elastic constants at relaxed positions reveals the ductile nature of the sample material with covalent contribution in the inter-atomic bonding. The narrow band gap semiconducting nature with high value of Seebeck coefficient suggests the possibility of the thermoelectric application of the material. The analysis of the thermal transport properties confirms the result obtained from the energy band structure of the material with high thermopower and dimensionless figure of merit 0.19 at room temperature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerated Sensitivity Analysis in High-Dimensional Stochastic Reaction Networks

Existing sensitivity analysis approaches are not able to handle efficiently stochastic reaction networks with a large number of parameters and species, which are typical in the modeling and simulation of complex biochemical phenomena. In this paper, a two-step strategy for parametric sensitivity analysis for such systems is proposed, exploiting advantages and synergies between two recently proposed sensitivity analysis methodologies for stochastic dynamics. The first method performs sensitivity analysis of the stochastic dynamics by means of the Fisher Information Matrix on the underlying distribution of the trajectories; the second method is a reduced-variance, finite-difference, gradient-type sensitivity approach relying on stochastic coupling techniques for variance reduction. Here in this paper we demonstrate that these two methods can be combined and deployed together by means of a new sensitivity bound which incorporates the variance of the quantity of interest as well as the Fisher Information Matrix estimated from the first method. The first step of the proposed strategy labels sensitivities using the bound and screens out the insensitive parameters in a controlled manner. In the second step of the proposed strategy, a finite-difference method is applied only for the sensitivity estimation of the (potentially) sensitive parameters that have not been screened out in the first step. Results on an epidermal growth factor network with fifty parameters and on a protein homeostasis with eighty parameters demonstrate that the proposed strategy is able to quickly discover and discard the insensitive parameters and in the remaining potentially sensitive parameters it accurately estimates the sensitivities. The new sensitivity strategy can be several times faster than current state-of-the-art approaches that test all parameters, especially in “sloppy” systems. In particular, the computational acceleration is quantified by the ratio between the total number of parameters over the number of the sensitive parameters.

97 MATHEMATICS AND COMPUTING↗

Gradient-based stochastic estimation of the density matrix

Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H) ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S -(d+2)/2d , where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Time-dependent density-functional tight-binding method with the third-order expansion of electron density

We develop a formalism for the calculation of excitation energies and excited state gradients for the self-consistent-charge density-functional tight-binding method with the third-order contributions of a Taylor series of the density functional theory energy with respect to the fluctuation of electron density (time-dependent density-functional tight-binding (TD-DFTB3)). The formulation of the excitation energy is based on the existing time-dependent density functional theory and the older TD-DFTB2 formulae. The analytical gradient is computed by solving Z-vector equations, and it requires one to calculate the third-order derivative of the total energy with respect to density matrix elements due to the inclusion of the third-order contributions. The comparison of adiabatic excitation energies for selected small and medium-size molecules using the TD-DFTB2 and TD-DFTB3 methods shows that the inclusion of the third-order contributions does not affect excitation energies significantly. A different set of parameters, which are optimized for DFTB3, slightly improves the prediction of adiabatic excitation energies statistically. The application of TD-DFTB for the prediction of absorption and fluorescence energies of cresyl violet demonstrates that TD-DFTB3 reproduced the experimental fluorescence energy quite well.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Nonlinear optimization for a tumor invasion PDE model

In this work, we introduce a methodology to approximate unknown parameters that appear on a non-linear reaction–diffusion model of tumor invasion. These equations consider that tumor-induced alteration of micro-environmental pH furnishes a mechanism for cancer invasion. A coupled system reaction–diffusion explaining this model is given by three partial differential equations for the non-dimensional spatial distribution and temporal evolution of the density of normal tissue, the neoplastic tissue growth and the excess concentration of H{sup +} ions. The tumor model parameters have a corresponding biological meaning: the reabsorption rate, the destructive influence of H{sup +} ions in the healthy tissue, the growth rate of tumor tissue and the diffusion coefficient. We propose to solve the direct problem using the Finite Element Method (FEM) and minimize an appropriate functional including both the real data (obtained via in-vitro experiments and fluorescence ratio imaging microscopy) and the numerical solution. The gradient of the functional is computed by the adjoint method.

60 APPLIED LIFE SCIENCES↗

An optimized method for mouse liver sinusoidal endothelial cell isolation

The objective of the present study was to develop an accurate and reproducible method for liver sinusoidal endothelial cell (LSEC) isolation in mice. Non-parenchymal cells were isolated using a modified two-step collagenase digestion combined with Optiprep density gradient centrifugation. LSEC were further purified using two prevalent methods, short-term selective adherence and CD146+ magnetic-activated cell sorting (MACS), and compared in terms of cell yield, viability and purity to our purification technique using CD11b cell depletion combined with long-term selective adherence. LSEC purification using our technique allowed to obtain 7.07±3.80 million LSEC per liver, while CD146+ MACS and short-term selective adherence yielded 2.94±1.28 and 0.99±0.66 million LSEC, respectively. Purity of the final cell preparation reached 95.10±2.58% when using our method. In contrast, CD146+ MACS and short-term selective adherence gave purities of 86.75±3.26% and 47.95±9.82%, respectively. Similarly, contamination by non-LSEC was the lowest when purification was performed using our technique, with a proportion of contaminating macrophages of only 1.87±0.77%. Further, isolated cells analysed by scanning electron microscopy presented typical LSEC fenestrations organized in sieve plates, demonstrating that the technique allowed to isolate bona fide LSEC. In conclusion, we described a reliable and reproducible technique for the isolation of high yields of pure LSEC in mice. This protocol provides an efficient method to prepare LSEC for studying their biological functions. - Highlights: • This protocol provides an efficient method to prepare primary mouse LSEC for studying their biological functions. • The liver cell dispersion step was improved by performing a retrograde cannulation of the liver. • The cell yield and the purity obtained were higher than comparative techniques in mice. • Contaminating macrophages were removed by introducing a CD11b- magnetic –activated cell sorting step.

60 APPLIED LIFE SCIENCES↗

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer from two problems. 1. Due to the lack of architectural guidance, random recurrent connectivity is often adopted, which does not guarantee good performance. 2. Training of RSNNs is in general challenging, bottlenecking achievable model accuracy. To address these problems, we propose a new type of RSNNs called Skip-Connected Self-Recurrent SNNs (ScSr-SNNs). Recurrence in ScSr-SNNs is introduced in a stereotyped manner by adding self-recurrent connections to spiking neurons. The SNNs with self-recurrent connections can realize recurrent behaviors similar to those of more complex RSNNs while the error gradients can be more straightforwardly calculated due to the mostly feedforward nature of the network. The network dynamics is enriched by skip connections between nonadjacent layers. Moreover, we propose a new backpropagation (BP) method called backpropagated intrinsic plasticity (BIP) to further boost the performance of ScSr-SNNs by training intrinsic model parameters. Unlike standard intrinsic plasticity rules that adjust the neuron's intrinsic parameters according to neuronal activity, the proposed BIP method optimizes intrinsic parameters based on the backpropagated error gradient of a well-defined global loss function in addition to synaptic weight training. Here, based on challenging speech, neuromorphic speech, and neuromorphic image datasets, the proposed ScSr-SNNs can boost performance by up to 2.85% compared with other types of RSNNs trained by state-of-the-art BP methods.

97 MATHEMATICS AND COMPUTING↗

Selective capture and recovery of uranium oxide colloids from aqueous soil suspensions using high gradient magnetic filtration

High Gradient Magnetic Filtration (HGMF) is a promising method for the selective capture and recovery of uranium oxide from surface soils. To date, however, magnetic filtration of uranium oxide has only been demonstrated at a proof-of-principle scale using relatively small filters (<5 cm 3 ) at low flowrates (<60 mL/min). Here, to explore the efficacy of magnetic filtration of uranium oxide at a larger scale, a newly designed HGMF apparatus that is more than an order of magnitude larger than our earlier filters (106 cm 3 ) was designed, fabricated, and tested at relatively high flowrates. Filtration experiments were performed using aqueous uranium oxide particle suspensions with Arizona Road Dust (ARD) as a soil simulant. At a flowrate of 125 mL/min, the apparatus’ uranium capture rate was exceptionally high (96 %), but selectivity was poor due to the high rate of capture for diamagnetic soil constituents (e.g., 77 % for silicon). All particles were captured at a lower rate when the flowrate was increased to 250 mL/min, but uranium selectivity was significantly increased due to the more substantial reduction in diamagnetic particle capture (i.e., capture rate of 77 % and 15 % for uranium and silicon, respectively). When backwashing the apparatus at the same flowrates used during filtration experiments, the rate of uranium recovery tended to be fairly low. Nevertheless, higher flowrates (1 L/min) and sonication were both shown to be highly effective methods of increasing uranium recovery. Magnetic field simulations were also performed to investigate potential optimizations to the design of the apparatus. These simulations showed that the intensity of the applied magnetic field could be increased by increasing the thickness of the steel magnetic housing. Additionally, stochastic trajectory simulations were performed to investigate the potential mechanisms of particle capture.

HGMF↗

An Empirical Quantile Estimation Approach for Chance-Constrained Nonlinear Optimization Problems

We investigate an empirical quantile estimation approach to solve chance-constrained nonlinear optimization problems. Our approach is based on the reformulation of the chance constraint as an equivalent quantile constraint to provide stronger signals on the gradient. In this approach, the value of the quantile function is estimated empirically from samples drawn from the random parameters, and the gradient of the quantile function is estimated via a finite-difference approximation on top of the quantile-function-value estimation. We establish a convergence theory of this approach within the framework of an augmented Lagrangian method for solving general nonlinear constrained optimization problems. The foundation of the convergence analysis is a concentration property of the empirical quantile process, and the analysis is divided based on whether or not the quantile function is differentiable. In contrast to the sampling-and-smoothing approach used in the literature, the method developed in this paper does not involve any smoothing function and hence the quantile-function gradient approximation is easier to implement and there are less accuracy-control parameters to tune. Furthermore, we demonstrate the effectiveness of this approach and compare it with a smoothing method for the quantile-gradient estimation. Numerical investigation shows that the two approaches are competitive for certain problem instances.

Applied Probability↗

Electronic structure and thermoelectric properties of half-Heusler compounds with eight electron valence count—KScX (X = C and Ge)

Electronic band structure and structural properties of two representative half-Heusler (HH) compounds with 8 electron valence count (VC), KScC and KScGe, have been studied using first principles methods within density functional theory and generalized gradient approximation. These systems differ from the well studied class of HH compounds like ZrNiSn and ZrCoSb which have VC = 18 because of the absence of d electrons of the transition metal atoms Ni and Co. Electronic transport properties such as Seebeck coefficient (S), electrical conductivity (σ), electronic thermal conductivity (κ{sub e}) (the latter two scaled by electronic relaxation time), and the power factor (S{sup 2}σ) have been calculated using semi-classical Boltzmann transport theory within constant relaxation time approximation. Both the compounds are direct band gap semiconductors with band extrema at the X point. Their electronic structures show a mixture of heavy and light bands near the valance band maximum and highly anisotropic conduction and valence bands near the band extrema, desirable features of good thermoelectric. Optimal p- or n-type doping concentrations have been estimated based on thermopower and maximum power factors. The optimum room temperature values of S are ∼1.5 times larger than that of the best room temperature thermoelectric Bi{sub 2}Te{sub 3}. We also discuss the impact of the band structure on deviations from Weidemann-Franz law as one tunes the chemical potential across the band gap.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Design of a technique to measure the density of ultracold atoms in a short-period optical lattice in three dimensions with single-atom sensitivity

A measurement technique is described that has the potential to map the atomic site occupancies of ultracold atoms in a short-period three-dimensional optical lattice. The method uses accordion and pinning lattices, together with polarization gradient cooling and fluorescence detection, to measure the positions of individual atoms within the sample in three dimensions at a resolution of around half the atomic resonant wavelength. The method measures the site occupancy, rather than the parity of the site occupancy, of atoms in the lattice. It is expected that such measurements hold significant potential for the study of ultracold quantum dynamics.

74 ATOMIC AND MOLECULAR PHYSICS↗

Analytic gradients for compressed multistate pair-density functional theory

Photochemical reactions often involve states that are closely coupled due to near degeneracies, for example by proximity to conical intersections. Therefore, a multistate method is used to accurately describe these states; for example, ordinary perturbation theory is replaced by quasidegenerate perturbation theory. Multiconfiguration pair-density functional theory (MC-PDFT) provides an efficient way to approximate the full dynamical correlation energy of strongly correlated systems, and we recently proposed compressed multistate pair-density functional theory (CMS-PDFT) to treat closely coupled states. In the present paper, we report the implementation of analytic gradients for CMS-PDFT in both OpenMolcas and PySCF, and here we illustrate the use of these gradients by applying the method to the excited states of formaldehyde and phenol.

74 ATOMIC AND MOLECULAR PHYSICS↗

Stochastic properties of ultralight scalar field gradients

Ultralight axion-like particles are well-motivated dark matter candidates that are the target of numerous direct detection efforts. In the vicinity of the Solar System, such particles can be treated as oscillating scalar fields. The velocity dispersion of the Milky Way determines a coherence time of about 10 6 oscillations, beyond which the amplitude of the axion field fluctuates stochastically. Any analysis of data from an axion direct detection experiment must carefully account for this stochastic behavior to properly interpret the results. This is especially true for experiments sensitive to the gradient of the axion field that are unable to collect data for many coherence times. Indeed, the direction, in addition to the amplitude, of the axion field gradient fluctuates stochastically. We present the first complete stochastic treatment for the gradient of the axion field, including multiple computationally efficient methods for performing likelihood-based data analysis, which can be applied to any axion signal, regardless of coherence time. Additionally, we demonstrate that ignoring the stochastic behavior of the gradient of the axion field can potentially result in failure to discover a true axion signal

79 ASTRONOMY AND ASTROPHYSICS↗

Handling Iterative Solvers in an Algorithmic Differentiation Framework Using Implicit Methods

Differentiable programming is a powerful concept as it enables the seemly propagation of gradients through functions, algorithms, and/or whole physics simulations. These gradients are useful for a wide variety of applications, including sensitivity studies and machine learning, but one of particular interest is optimization. Gradient-based optimization, enabled through automatic/algorithmic differentiation (AD), can be used on predictive physical models to efficiently optimize a set of design variables. AD methods are a particularly promising approach to complex physics simulations because they can be shown to scale well with an increasing number of design variables; however, care must be taken when coupling between different models or different states of a single model.

algorithmic differentiation↗