Search NASA⌕ Search

SEARCH · Search NASA

Results for “Differential model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling

Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.

58 GEOSCIENCES↗

Differentiable modelling to unify machine learning and physical models for geosciences

Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. Here, in this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs.

58 GEOSCIENCES↗

Cosmic ray anisotropy in fractional differential models of anomalous diffusion

The problem of galactic cosmic ray anisotropy is considered in two versions of the fractional differential model for anomalous diffusion. The simplest problem of cosmic ray propagation from a point instantaneous source in an unbounded medium is used as an example to show that the transition from the standard diffusion model to the Lagutin-Uchaikin fractional differential model (with characteristic exponent {alpha} = 3/5 and a finite velocity of free particle motion), which gives rise to a knee in the energy spectrum at 10{sup 6} GeV, increases the anisotropy coefficient only by 20%, while the anisotropy coefficient in the Lagutin-Tyumentsev model (with exponents {alpha} = 0.3 and {beta} = 0.8, a long stay of particles in traps, and an infinite velocity of their jumps) is close to one. This is because the parameters of the Lagutin-Tyumentsev model have been chosen improperly.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Methylmercury causes epigenetic suppression of the tyrosine hydroxylase gene in an in vitro neuronal differentiation model

Highlights: • The low level of methylmercury induces inhibitory epigenetic changes in LUHMES cells. • Tyrosine hydroxylase is decreased by methylmercury in neuronal differentiation model. • HistoneH3 lysine27 tri-methylation is increased in promoter of tyrosine hydroxylase. Methylmercury (MeHg) is the causative substance of Minamata disease, which is associated with various neurological disorders such as sensory disturbance and ataxia. It has been suggested low-level dietary intake of MeHg from MeHg-containing fish during gestation adversely affects the fetus. In our study, we investigated the toxicological effects of MeHg exposure on neuronal differentiation focusing on epigenetics. We used human fetal brain-derived immortalized cells (LUHMES cells) as a human neuronal differentiation model. Cell viability, neuronal, and catecholamine markers in LUHMES cells were assessed after exposure to MeHg (0–1000 nM) for 6 days (from day 2 to day 8 of neuronal differentiation). Cell viability on day 8 was not affected by exposure to 1 nM MeHg for 6 days. mRNA levels of AADC, DBH, TUJ1, and SYN1 also were unaffected by MeHg exposure. In contrast, levels of TH, the rate-limiting enzyme for dopamine synthesis, were significantly decreased after MeHg exposure. Acetylated histone H3, acetylated histone H3 lysine 9, and tri-methyl histone H3 lysine 9 levels at the TH gene promoter were not altered by MeHg exposure. However, tri-methylation of histone H3 lysine 27 levels, related to transcriptional repression, were significantly increased at the TH gene promotor after MeHg exposure. In summary, MeHg exposure during neuronal differentiation led to epigenetic changes that repressed TH gene expression. This study provides useful insights into the toxicological mechanisms underlying the effects of developmental MeHg exposure during neuronal differentiation.

60 APPLIED LIFE SCIENCES↗

Complexity and Productivity Differentiation Models of Metallogenic Indicator Elements in Rocks and Supergene Media Around Daijiazhuang Pb-Zn Deposit in Dangchang County, Gansu Province

With the help of complexity indices, we quantitatively studied multifractals, frequency distributions, and linear and nonlinear characteristics of geochemical data for exploration of the Daijiazhuang Pb-Zn deposit. Furthermore, we derived productivity differentiation models of elements from thermodynamics and self-organized criticality of metallogenic systems. With respect to frequency distributions and multifractals, only Zn in rocks and most elements except Sb in secondary media, which had been derived mainly from weathering and alluviation, exhibit nonlinear distributions. The relations of productivity to concentrations of metallogenic elements and paragenic elements in rocks and those of elements strongly leached in secondary media can be seen as linear addition of exponential functions with a characteristic weak chaos. The relations of associated elements such as Mo, Sb, and Hg in rocks and other elements in secondary media can be expressed as an exponential function, and the relations of one-phase self-organized geological or metallogenic processes can be represented by a power function, each representing secondary chaos or strong chaos. For secondary media, exploration data of most elements should be processed using nonlinear mathematical methods or should be transformed to linear distributions before processing using linear mathematical methods.

58 GEOSCIENCES↗

End-to-End Differentiable Modeling and Management of the Environment

Focal Area: (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization. We emphasize the importance of leveraging optimization techniques from AI/machine learning (ML) to solve challenging problems in Earth system modeling. Science Challenge: Automatic differentiation has had a transformative effect on ML by allowing the calculation of gradients of arbitrary functions in an incredibly large class of models. We can potentially realize similar improvements in parameter estimation and control for Earth system models (ESMs) by reimplementing them in computational frameworks from ML. Practitioners working with large (>10 7 parameters) models in ML and AI can obtain good predictive performance in a range of spatiotemporal tasks by making use of optimization via stochastic gradient descent and incorporating prior knowledge at multiple levels. We propose writing ESMs in open-source computational frameworks such as Torch, Tensorflow, and JAX to greatly expand the scope of environmental forecasting and management challenges, which can be addressed by leveraging automatic differentiation and gradient descent-like algorithms. We do not call for a wholesale replacement of physical models with data-driven surrogates, but rather advocate for interleaving physical and empirical equations in a manner that is most faithful to the extent of our scientific knowledge and observational data. Central to this topic is the merging of differentiable physical simulations with differentiable optimization layers, which are now both beginning to come to the forefront.

54 ENVIRONMENTAL SCIENCES↗

Autonomous phase mapping of gold nanoparticles synthesis with differentiable models of spectral shape

Autonomous experimentation–or self-driving labs–offers a systematic approach to accelerate materials discovery by integrating automated synthesis, characterization, and data-driven decision-making. We present a closed-loop workflow for the on-demand synthesis and structural characterization of colloidal gold nanoparticles, enabling direct mapping from composition to nanoscale structure. Our framework leverages differentiable models of spectral shape to address two central tasks in self-driving labs: (a) phase mapping, or identifying compositional regions with distinct structural behavior; and (b) material retrosynthesis, or optimizing compositions for target structure. Using functional data analysis, we develop a data-driven model with generative pre-training, active learning, and high-throughput experiments to predict spectral responses across composition space. We demonstrate the approach on seed-mediated growth of gold nanoparticles, showcasing its ability to extract design rules, reveal secondary interactions, and efficiently navigate morphology space. Gradient-based optimization of the models enables inverse design, making this a unified platform.

36 MATERIALS SCIENCE↗

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Electrolytes play a critical role in designing next-generation battery systems, by allowing efficient ion transfer, preventing charge transfer, and stabilizing electrode-electrolyte interfaces. In this work, we develop a differentiable geometric deep learning (GDL) model for chemical mixtures, DiffMix, which is applied in guiding robotic experimentation and optimization towards fast charging battery electrolytes. In particular, we extend mixture thermodynamic and transport laws by creating GDL-learnable physical coefficients. We evaluate our model with mixture thermodynamics and ion transport properties, where we show improved prediction accuracy and model robustness of Diff-Mix than its purely data-driven variants. Furthermore, with a robotic experimentation setup, Clio, we improve ionic conductivity of electrolytes by over 18.8% within 10 experimental steps, via differentiable optimization built on DiffMix gradients. By combining GDL, mixture physics laws, and robotic experimentation, DiffMix expands the predictive modeling methods for chemical mixtures and enables efficient optimization in large chemical spaces.

25 - ENERGY STORAGE↗

A differentiable model of the evolution of dark matter halo concentration

ABSTRACT We introduce a new model of the evolution of the concentration of dark matter haloes, c(t). For individual haloes, our model approximates c(t) as a power law with a time-dependent index, such that at early times, concentration has a nearly constant value of c ≈ 3–4, and as cosmic time progresses, c(t) smoothly increases. Using large samples of halo merger trees taken from the Bolshoi–Planck and MultiDark Planck 2 cosmological simulations, we demonstrate that our three-parameter model can approximate the evolution of the concentration of individual haloes with a typical accuracy of 0.1 dex for $t\gtrsim 2\, {\rm Gyr}$ for all Bolshoi–Planck and MultiDark Planck 2 haloes of present-day peak mass $M_{0}\gtrsim 10^{11.5}\, {\rm M}_{\odot }$. We additionally present a new model of the evolution of the concentration of halo populations, which we show faithfully reproduces both average concentration growth and the diversity of smooth trajectories of c(t), including capturing correlations with halo mass and halo assembly history. Our publicly available source code, diffprof, can be used to generate Monte Carlo realizations of the concentration histories of cosmologically representative halo populations. diffprof is differentiable due to its implementation in the jax autodiff library, which facilitates the incorporation of our model into existing analytical halo model frameworks.

Stevanovich, Dash↗

Integro-differential modeling of ICRH wave propagation and damping at arbitrary cyclotron harmonics and wavelengths in tokamaks

Both at low and higher cyclotron harmonics, properly accounting for finite Larmor radius effects is crucial in many ion cyclotron resonance frequency heating scenarios creating high energy tails. The present paper discusses ongoing work to extend the 1D TOMCAT wave equation solver [D. Van Eester and R. Koch, Plasma Phys. Contr. Fusion 40 (1998) 1949] to arbitrary harmonics and arbitrary wavelengths. Rather than adopting the particle position, the guiding center position is used as the independent variable when writing down an expression for the dielectric response. Adopting a philosophy originally due to Kaufman [A.N. Kaufman, Phys. Fluids 15 (1972) 1063], the relevant dielectric response in the Galerkin formalism is written in a form where the electric field and the test function vector appear symmetrically, which yields a power balance equation that guarantees non-negative absorption for any wave type for Maxwellian plasmas. Moreover, this choice of independent variable yields intuitive expressions that can directly be linked to the corresponding expressions in the RF diffusion operator. It also guarantees that a positive definite power transfer from waves to particles is ensured for any of the wave modes in a plasma in which all populations have a Maxwellian distribution, as is expected from first principles. Rather than relying on a truncated Taylor series expansion of the dielectric response, an integro-differential approach that retains all finite Larmor radius effects [D. Van Eester and E. Lerche, Plasma Phys. Control. Fusion 55 (2013) 055008] is proposed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fractional Differential Model of Resonant Transfer of Excitations in Plasma

The most crucial feature of excitation transfer in low-temperature plasma forming the physical basis for operation of contemporary lighting devices is participation of resonant photons in the process. The widely used approximation of complete frequency redistribution assumes independence of the emitted photon frequency from frequency of the absorbed one. Averaged over frequency distribution in a resonance line, the natural transfer equation with the exponential kernel becomes the equation with an inverse power kernel, which in case of an infinite homogeneous medium is asymptotically equivalent to the Laplace equation of non-integer (fractional) order, considered in this article.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Recovering the phase and amplitude of X-ray FEL pulses using neural networks and differentiable models

Dynamics experiments are an important use-case for X-ray free-electron lasers (XFELs), but time-domain measurements of the X-ray pulses themselves remain a challenge. Shot-by-shot X-ray diagnostics could enable a new class of simpler and potentially higher-resolution pump-probe experiments. Here, we report training neural networks to combine low-resolution measurements in both the time and frequency domains to recover X-ray pulses at high-resolution. Critically, we also recover the phase, opening the door to coherent-control experiments with XFELs. The model-based generative neural-network architecture can be trained directly on unlabeled experimental data and is fast enough for real-time analysis on the new generation of MHz XFELs.

42 ENGINEERING↗

Differential methods for assessing sensitivity in biological models

Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.

59 BASIC BIOLOGICAL SCIENCES↗

Local random potentials of high differentiability to model the Landscape

We generate random functions locally via a novel generalization of Dyson Brownian motion, such that the functions are in a desired differentiability class C{sup k}, while ensuring that the Hessian is a member of the Gaussian orthogonal ensemble (other ensembles might be chosen if desired). Potentials in such higher differentiability classes (k≥2) are required/desirable to model string theoretical landscapes, for instance to compute cosmological perturbations (e.g., k=2 for the power-spectrum) or to search for minima (e.g., suitable de Sitter vacua for our universe). Since potentials are created locally, numerical studies become feasible even if the dimension of field space is large (D∼100). In addition to the theoretical prescription, we provide some numerical examples to highlight properties of such potentials; concrete cosmological applications will be discussed in companion publications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Model-Form Epistemic Uncertainty Quantification for Modeling with Differential Equations: Application to Epidemiology

Modeling real-world phenomena to any degree of accuracy is a challenge that the scientific research community has navigated since its foundation. Lack of information and limited computational and observational resources necessitate modeling assumptions which, when invalid, lead to model-form error (MFE). The work reported herein explored a novel method to represent model-form uncertainty (MFU) that combines Bayesian statistics with the emerging field of universal differential equations (UDEs). The fundamental principle behind UDEs is simple: use known equational forms that govern a dynamical system when you have them; then incorporate data-driven approaches – in this case neural networks (NNs) – embedded within the governing equations to learn the interacting terms that were underrepresented. Utilizing epidemiology as our motivating exemplar, this report will highlight the challenges of modeling novel infectious diseases while introducing ways to incorporate NN approximations to MFE. Prior to embarking on a Bayesian calibration, we first explored methods to augment the standard (non-Bayesian) UDE training procedure to account for uncertainty and increase robustness of training. In addition, it is often the case that uncertainty in observations is significant; this may be due to randomness or lack of precision in the measurement process. This uncertainty typically manifests as “noisy” observations which deviate from a true underlying signal. To account for such variability, the NN approximation to MFE is endowed with a probabilistic representation and is updated using available observational data in a Bayesian framework. By representing the MFU explicitly and deploying an embedded, data-driven model, this approach enables an agile, expressive, and interpretable method for representing MFU. In this report we will provide evidence that Bayesian UDEs show promise as a novel framework for any science-based, data-driven MFU representation; while emphasizing that significant advances must be made in the calibration of Bayesian NNs to ensure a robust calibration procedure.

97 MATHEMATICS AND COMPUTING↗