Search NASA⌕ Search

SEARCH · Search NASA

Results for “Numerical differentiation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Automatic Differentiation in MetaPhysicL and Its Applications in MOOSE

Efficient solution via Newton’s method of nonlinear systems of equations requires an accurate representation of the Jacobian, corresponding to the derivatives of the component residual equations with respect to the degrees of freedom. In practice these systems of equations often arise from spatial discretization of partial differential equations used to model physical phenomena. These equations may involve domain motion or material equations that are complex functions of the systems’ degrees of freedom. Computing the Jacobian by hand in these situations is arduous and prone to error. Finite difference approximations of the Jacobian or its action are prone to truncation error, especially in multiphysics settings. Symbolic differentiation packages may be used, but often result in an excessive number of terms in realistic model scenarios. An alternative to symbolic and numerical differentiation is automatic differentiation (AD), which propagates derivatives with every elementary operation of a computer program, corresponding to continual application of the chain rule. Automatic differentiation offers the guarantee of an exact Jacobian at a relatively small overhead cost. In this work, we outline the adoption of AD in the Multiphysics Object Oriented Simulation Environment (MOOSE) via the MetaPhysicL package. We describe the application of MOOSE’s AD capability to several sets of physics that were previously infeasible to model via hand-coded or Jacobian-free simulation techniques, including arbitrary Lagrangian-Eulerian and level-set simulations of laser melt pools, phase-field simulations with free energies provided through neural networks, and metallic nuclear fuel simulations that require inner Newton loop calculation of nonlinear material properties.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

High-order accurate finite difference discretisations on fully unstructured dual quadrilateral meshes

Here, we present a novel approach for high-order accurate numerical differentiation on unstructured meshes of quadrilateral elements. To differentiate a given function, an auxiliary function with greater smoothness properties is defined which when differentiated provides the derivatives of the original function. The method generalises traditional finite difference methods to meshes of arbitrary topology in any number of dimensions for any order of derivative and accuracy. We demonstrate the accuracy of the numerical scheme using dual quadrilateral meshes and a refinement method based on subdivision surfaces. The scheme is applied to the solution of a range of partial differential equations, including both linear and nonlinear, second and fourth order equations, and a time-dependent first order equation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Analytical nonadiabatic coupling and state-specific energy gradient for the crystal field Hamiltonian describing lanthanide single-ion magnets

Paramagnetic molecules with a metal ion as an electron spin center are promising building blocks for molecular qubits and high-density memory arrays. However, fast spin relaxation and decoherence in these molecules lead to a rapid loss of magnetization and quantum information. Nonadiabatic coupling (NAC), closely related to spin-vibrational coupling, is the main source of spin relaxation and decoherence in paramagnetic molecules at higher temperatures. Predicting these couplings using numerical differentiation requires a large number of computationally intensive ab initio or crystal field electronic structure calculations. To reduce computational cost and improve accuracy, we derive and implement analytical NAC and state-specific energy gradient for the ab initio parametrized crystal field Hamiltonian describing single-ion molecular magnets. Our implementation requires only a single crystal field calculation. In addition, the accurate NACs and state-specific energy gradients can be used to model spin relaxation using sophisticated nonadiabatic molecular dynamics, which avoids the harmonic approximation for molecular vibrations. To test our implementation, we calculate the NAC values for three lanthanide complexes. Finally, the predicted values support the relaxation mechanisms reported in previous studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Atomic forces from Dirac-Kohn-Sham equations: Implementation in flexible (APW+lo/LAPW)+LO basis set

The atomic forces formulation based on the Dirac-Kohn-Sham equation and the flexible (APW+lo/LAPW)+LO basis set is presented here. The formulation was implemented in the code FlapwMBPT and allows a user to easily switch between different basis functions of the augmentation type (APW or LAPW) and between different kind of local orbitals. Similar to the work (Phys.Rev.B 91 (2015) 035105), the implementation takes into account small discontinuities of the wave functions, density, and potential at the muffin-tin sphere boundaries. Applications to the materials with strong relativistic effects, such as $\alpha$-Uranium, PuCoGa$_{5}$, and FePt, demonstrate robustness of the method. The comparison of the calculated forces with the ones obtained by numerical differentiation of free energy shows close agreement with deviations about 0.1% or less.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Microbiome dynamics in the congregate environment of U.S. Army Infantry training

Within military training and operational environments, individuals from diverse backgrounds share common spaces, follow structured routines and diets, and engage in physically demanding tasks. While there has been interest in leveraging microbiome features to predict and improve military health and performance, the longitudinal convergence of microbiomes in such constrained environments has not been established. To assess the degree of microbiome convergence, we performed shotgun metagenomic sequencing on swab samples from a military trainee cohort. Samples were taken across four different body sites, three timepoints, and two spatially distinct platoons. We observed evidence of convergence in one platoon, whereby similarity in microbiome composition increased over time, with numerous differentially abundant species. We found no indication of strain transfer between individuals, suggesting that convergence was influenced by external environmental factors, diet, and lifestyle. Microbial shifts observed in the convergence process included a decrease in fungal species, such as Malassezia restricta in nasal cavities, and a decrease in Prevotella species at inguinal regions across time. Shifts in multiple Corynebacterium species were also observed with varying magnitudes depending on the body site. Overall, we provide preliminary evidence of convergence of host microbial communities in military-associated environments that were distinguishable using shotgun metagenomic sequencing approaches. The data presented here on microbiome convergence, dynamics, and stability may inform risk-based mitigation in congregate military settings facilitating development of targeted microbial, dietary, or other interventions to optimize health and performance of military populations.

Biological and medical sciences↗
DOE OSTI2024

Extracting and Interpreting Electrochemical Impedance Spectra (EIS) from Physics-Based Models of Lithium-Ion Batteries

This paper implements a highly efficient algorithm to extract electrochemical impedance spectra (EIS) from physics-based battery models (e.g., a P2D model). The mathematical approach is different from how EIS is practiced experimentally. Experimentally, the voltage (current) is harmonically perturbed over a wide range of frequencies and the amplitude and phase shift of the corresponding current (voltage) is measured. The experimental approach can be implemented in simulation software, but is computationally expensive. The approach here is to determine locally linear state-space models from the full physical model. The four Jacobian matrices that are the basis of the state-space models can be derived by numerical differentiation of the physical model. The EIS is then extracted from the state-space model using computationally efficient matrix-manipulation techniques. The algorithm can evaluate the full EIS at an instant in time during a transient, independent of whether the battery is in a stationary state. The approach is also able to separate the full-cell impedance to evaluate partial EIS, such as for a battery anode alone. Although such partial EIS is difficult to measure experimentally, the partial EIS provides valuable insights in interpreting the full-cell EIS.

25 ENERGY STORAGE↗
DOE OSTI2024

Functional Data Analysis in Wearable Body Sensor Networks

Improving response time of indirect room-size calorimeters is still an outstanding problem in metabolic research. Accurate estimates of instantaneous rates of gaseous exchange require numerical differentiation of measured gaseousgas concentrations. We propose a new method to estimate the instantaneous gaseousgas exchange rates in indirect calorimetry. In contrast to the previously developed techniques, the method addresses the problem of differentiation of gaseous concentrations as an ill-posed problem. By applying the method of regularization, the problem of differentiation is converted into a well-posed problem resulting in smooth and consistent gaseous exchange rates. The validity of the method is tested on a large dataset of calorimeter experiments which included 313 human experiments along with 231 alcohol combustion experiments. It is demonstrated that the method is able to reliably differentiate between the “unphysiological” process of alcohol combustion and physiological variations produced by human metabolism. The method also allowed unraveling the previously unreported relative kinetics of O2 consumption and Respiratory Quotient (RQ) in humans. It was found that the kinetics of oxidative fuel selection lags behind the energy expenditure in humans exhibiting some sort of oxidative inertia. The time lag varies from 2-3 min up to 30 min, depending on particular individual. No such lag was found in alcohol combustion experiments. In addition to the relative kinetics of substrate oxidation, two statistical indexes reflecting variability of minute-by-minute RQ were estimated. The indexes were the RQ’s standard deviation and RQ’s first-order derivative. Both indexes showed statistically significant difference between human experiments and alcohol combustion experiments. We conclude that the proposed method can consistently extract physiologically-relevant information from noisy calorimetry data and the aforesaid information can provide additional insights into the mechanism of metabolic fuel selection in humans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Functional Data Analysis in Wearable Body Sensor Networks

Improving response time of indirect room-size calorimeters is still an outstanding problem in metabolic research. Accurate estimates of instantaneous rates of gaseous exchange require numerical differentiation of measured gaseousgas concentrations. We propose a new method to estimate the instantaneous gaseousgas exchange rates in indirect calorimetry. In contrast to the previously developed techniques, the method addresses the problem of differentiation of gaseous concentrations as an ill-posed problem. By applying the method of regularization, the problem of differentiation is converted into a well-posed problem resulting in smooth and consistent gaseous exchange rates. The validity of the method is tested on a large dataset of calorimeter experiments which included 313 human experiments along with 231 alcohol combustion experiments. It is demonstrated that the method is able to reliably differentiate between the “unphysiological” process of alcohol combustion and physiological variations produced by human metabolism. The method also allowed unraveling the previously unreported relative kinetics of O2 consumption and Respiratory Quotient (RQ) in humans. It was found that the kinetics of oxidative fuel selection lags behind the energy expenditure in humans exhibiting some sort of oxidative inertia. The time lag varies from 2-3 min up to 30 min, depending on particular individual. No such lag was found in alcohol combustion experiments. In addition to the relative kinetics of substrate oxidation, two statistical indexes reflecting variability of minute-by-minute RQ were estimated. The indexes were the RQ’s standard deviation and RQ’s first-order derivative. Both indexes showed statistically significant difference between human experiments and alcohol combustion experiments. We conclude that the proposed method can consistently extract physiologically-relevant information from noisy calorimetry data and the aforesaid information can provide additional insights into the mechanism of metabolic fuel selection in humans.

60 - APPLIED LIFE SCIENCES↗
DOE OSTI2023

CRISPR/Cas9 Directed Reprogramming of iPSC for Accelerated Motor Neuron Differentiation Leads to Dysregulation of Neuronal Fate Patterning and Function

Neurodegeneration causes a significant disease burden and there are few therapeutic interventions available for reversing or slowing the disease progression. Induced pluripotent stem cells (iPSCs) hold significant potential since they are sourced from adult tissue and have the capacity to be differentiated into numerous cell lineages, including motor neurons. This differentiation process traditionally relies on cell lineage patterning factors to be supplied in the differentiation media. Genetic engineering of iPSC with the introduction of recombinant master regulators of motor neuron (MN) differentiation has the potential to shorten and streamline cell developmental programs. We have established stable iPSC cell lines with transient induction of exogenous LHX3 and ISL1 from the Tet-activator regulatory region and have demonstrated that induction of the transgenes is not sufficient for the development of mature MNs in the absence of neuron patterning factors. Comparative global transcriptome analysis of MN development from native and Lhx-ISL1 modified iPSC cultures demonstrated that the genetic manipulation helped to streamline the neuronal patterning process. However, leaky gene expression of the exogenous MN master regulators in iPSC resulted in the premature activation of genetic pathways characteristic of the mature MN function. Dysregulation of metabolic and regulatory pathways within the developmental process affected the MN electrophysiological responses.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A scalable and tunable thermoreversible polymer for 3D human pluripotent stem cell biomanufacturing

Human pluripotent stem cells (hPSCs) are an exciting and promising source to enable cell replacement therapies for a variety of unmet medical needs. Though hPSCs can be successfully derived into numerous physiologically relevant cell types, effective translation to the clinic is limited by challenges in scalable production of high-quality cells, cellular immaturity following the differentiation process, and the use of animal-derived components in culture. To address these limitations, we have developed a fully defined, reproducible, and tunable thermoreversible polymer for high-quality, scalable 3D cell production. Our reproducible synthesis method enables precise control of gelation temperature (24°C–32°C), hydrogel stiffness (100–4000 Pa), and the prevention of any unintended covalent crosslinking. After material optimization, we demonstrated hPSC expansion, pluripotency maintenance, and differentiation into numerous lineages within the hydrogel. Overall, this 3D thermoreversible hydrogel platform has broad applications in scalable, high-quality cell production to overcome the biomanufacturing burden of stem cell therapy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Numerical simulation of RHIC polarized proton run 17 spin flipper experiments

RHIC nine-magnet spin flipper has been operated successfully during RHIC polarized proton Run 17, with 97% spin flip efficiency achieved. The results show the importance of mirror resonance removal, small spin tune spread, and proper spin flipper driving tune sweep speed. Detailed spin tracking simulations, based on a Lorentz force and Thomas-BMT differential equation numerical solver code for accuracy, have been carried out to understand the experimental results. Agreement within measurement accuracy is obtained at injection energy, 23.8 GeV. It is not as tight at 255 GeV, reasons for that are exposed. These measurements and numerical studies allow to determine the sensitivity of spin-flip efficiency to the dispersion slopes at the two Siberian snakes and to the ac dipole frequency sweep speed. They also provide guidance for future developments at BNL’s electron-ion collider. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Degrees of rate control and AutoDiff-driven direct sensitivity analysis in heterogeneous catalysis

Despite the wide application and benefits of the degree of rate control (DRC) analysis, several details remain argued, particularly about the conservation of DRCs at transient (TR) and steady-state (SS) conditions, especially for complex reaction networks. This work argues that previous proofs about the conservation properties of DRCs have been incomplete, and we provide new mathematical proofs at TR and SS conditions. In addition, we use both analytical (automatic differentiation) and numerical (finite difference) approaches to compute DRCs for the case study of ethane hydrogenolysis (EH) over Pt(111). This work confirms that at both TR and SS conditions, the sum of all DRCs, i.e., sum of the degrees of kinetic (DKRC) and thermodynamic rate control (DTRC), is conserved at zero. At SS conditions, the sum of DKRC is conserved at 1 while the sum of DTRC is conserved at −1. In corroboration of previous works, we show that the DTRC for any adsorbate at SS is equal to the product of the species coverage and a constant. In contrast, at TR conditions, the individual sums of both DTRC and DKRC are not conserved and can be any real number, with potential implications for the novel field of dynamic catalysis. Finally, we show that the conventional finite difference (FD) approach, only useful at SS, is prone to inaccuracy and very sensitive to the value of the differential change applied. The optimal differential value also varies significantly with system and rate definition. Consequently, we describe and illustrate in this work the application of the automatic differentiation (AD) approach for the more accurate determination of DRCs at both TR and SS conditions.

Automatic differentiation↗
DOE OSTI2021

Stiff neural ordinary differential equations

Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODEs in the classical stiff ODE systems of Robertson’s problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson’s problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODEs. The success of learning stiff neural ODEs opens up possibilities of using neural ODEs in applications with widely varying time-scales, such as chemical dynamics in energy conversion, environmental engineering, and life sciences.

97 MATHEMATICS AND COMPUTING↗