Search NASA⌕ Search

SEARCH · Search NASA

Results for “Differentiability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

An attention-based neural ordinary differential equation framework for modeling inelastic processes

To preserve strictly conservative behavior as well as model the variety of dissipative behavior displayed by solid materials, we propose a significant enhancement to the internal state variable-neural ordinary differential equation (ISV-NODE) framework. In this data-driven, physics-constrained modeling framework internal states are inferred rather than prescribed. The ISV-NODE consists of: (a) a stress model dependent on observable deformation and inferred internal state, and (b) a model of the evolution of the internal states. The enhancements to ISV-NODE proposed in this work are multifold: (a) a partially input convex neural network stress potential provides polyconvexity in terms of observed strain while leaving the inferred state unconstrained, and (b) an internal state flow model uses common latent features to inform novel attention-based gating and drives the flow of internal state only in dissipative regimes. We demonstrated that this architecture can accurately model dissipative and conservative behavior across an isotropic, isothermal elastic-viscoelastic-elastoplastic spectrum with three exemplars, while maintaining fundamental principles by design.

97 MATHEMATICS AND COMPUTING↗

An adaptive fast multipole method in Cartesian basis, enabled by algorithmic differentiation

A novel form of the fast multipole method is realized by the combination of adaptive data structures with implementation of the multipole expansions and their translations in Cartesian basis, and enabled by algorithmic differentiation. It may be possible to generalize it to any kernel that allows its formulation as a function of small quantities with respect to which they can be expanded. There is no hard and fast rule recipe that works for all cases. However, it is shown how to do it for the softened Coulomb kernel, which is different from the Coulomb kernel. The characteristics and performance of the method are mapped and shown to provide an attractive option for a generic fast multipole algorithm in a wide region of the parameter space. The algorithm is illustrated with a beam dynamics application.

97 MATHEMATICS AND COMPUTING↗

Optimal sensor network design for multi-scale, time-varying differential algebraic equation systems: Application to an entrained-flow gasifier refractory brick

An algorithm for optimal sensor network design for multi-scale, time-varying differential algebraic equation systems with non-separable dynamics is presented. As the process is time-varying, an integral normalized posterior error covariance of a multi-scale filter is minimized to obtain the optimal sensor locations. For reducing the computational cost, an adaptive sampling rate approach is considered for the slowly-varying variables. The algorithm is applied to a smart refractory brick with embedded sensors as part of an entrained-flow gasifier. Thermistors and interdigital capacitors are considered as candidate measurement technologies for estimating temperature and slag penetration profile along the gasifier wall. Finally, when the optimal set of sensors obtained from the algorithm is used for estimating temperature and slag penetration profiles in a multi-scale Kalman filter framework, satisfactory estimates are obtained despite high measurement noise and model mismatch.

42 ENGINEERING↗

Model-based compositional predictions for a differential scanning calorimetry/thermogravimetric analysis-mass spectrometry system used for heat of vaporization measurements

A Differential Scanning Calorimetry/Thermogravimetric Analysis (DSC/TGA) procedure for determination of Heat of Vaporization (HOV) of fuel and surrogate fuel mixtures has been previously utilized for evaluation of oxygenate impacts on spark ignition fuels. This analysis has been further leveraged with mass spectrometry (MS) to elucidate vapor phase compositional changes during evaporation. In this study we focus on a simple system of three compounds (ethanol, n-hexane, and n-octane) to provide a model-based understanding of the evaporation process under these experimental conditions. An Aspen Plus model was set up to provide liquid and vapor phase concentration predictions during mixture evaporation using the initial mixture composition, and measured temperature and mass loss profiles from DSC/TGA experiments. Agreements between the trends of the MS ion count profiles and model composition predictions provide a degree of validation of this modeling approach that can allow the interpretation and extrapolation of DSC/TGA measurements for more complex fuel mixtures.

33 ADVANCED PROPULSION SYSTEMS↗

Examination of the effect of differential molecular diffusion in DNS of turbulent non-premixed flames

Here, the effect of differential molecular diffusion (DMD) in turbulent non-premixed flames is studied by examining two previously reported DNS of temporally evolving planar jet flames, one with CO/H 2 as the fuel and the other with C 2 H 4 as the fuel. The effect of DMD in the CO/H 2 DNS flames in which H 2 is part of fuel is found to behave similar to laminar flamelet, while in the C 2 H 4 DNS flames in which H 2 is not present in the fuel it is similar to laminar flamelet in early stages but becomes different from laminar flamelet later. The scaling of the effect of DMD with respect to the Reynolds number Re is investigated in the CO/H 2 DNS flames, and an evident power law scaling (~Re –a with a a positive constant) is observed. The scaling of the effect of DMD with respect to the Damkohler number Da is explored in both laminar counter-flow jet C 2 H 4 diffusion flames and the C 2 H 4 DNS flames. A power law scaling (~ Da a with a a positive constant) is clearly demonstrated for C 2 H 4 nonpremixed flames.

08 HYDROGEN↗

Homogenizing atomic dynamics by fractional differential equations

In this paper, we propose two ways to construct fractional differential equations (FDE) for approximating atomic chain dynamics. Taking harmonic chain as an example, we add a power function of fractional order to Taylor expansion of the dispersion relation, and determine the parameters by matching two selected wave numbers. This approximate function leads to an FDE after considering both directions for wave propagation. As an alternative, we consider the symbol of the force term, and approximate it by a similar function. It also induces an FDE. Both approaches produce excellent agreement with the harmonic chain dynamics. The accuracy may be improved by optimizing the selected wave numbers, or starting with higher order Taylor expansions. When resolved in the lattice constant, the resulting FDE's faithfully reproduce the lattice dynamics. When resolved in a coarse grid instead, they systematically generate homogenized algorithms. Numerical tests are performed to verify the proposed approaches. Moreover, FDE's are also constructed for diatomic chain and anharmonic lattice, to illustrate the generality of the proposed approaches. - Highlights: • Match the dispersion relation of linear chain by power function of fractional order, added on low order Taylor expansion. • Design FDE by approximating dispersion relation, or the symbol for the force term. • Solve the FDE by algorithm of spectral accuracy. • Obtain faithful and systematical homogenization when resolved at coarser grid. • Applies to general lattices: complex, nonlinear and multidimensional.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamic calibration of differential equations using machine learning, with application to turbulence models

We present a methodology for calibration of parametric ordinary and partial differential equation models, using off-the-shelf software for back-propagation in Neural Networks (NN). As a prototypical example, we consider calibration of a Reynolds-averaged Navier-Stokes (RANS) turbulence closure model, against ground truth data from direct numerical simulations (DNS) of two different turbulent flows. Numerical time integration is represented as a custom NN, where only the RANS model parameters are trainable. A loss function is defined to quantify the mismatch between the NN prediction and the ground truth over a predefined, finite time integration window. This loss function is then minimized using a gradient descent method utilizing the back-propagation algorithm. Furthermore, this dynamic approach to training is to be contrasted with a static approach, wherein a least square regression estimate for parameters is obtained in the limit of an infinitesimal time integration window. In a first test of static and dynamic approaches against ground truth data generated by the model, the former proves to be significantly faster and more accurate than the latter at recovering the parameters. When both calibration approaches are tested against DNS data, for which it is known that the model cannot achieve a perfect fit, the static approach yields a good prediction only for short times, while the dynamic approach results in physical and stable predictions over the entire integration window. After optimization of the dynamic approach for time step, spatial resolution, stability, and physics-based constraints, we obtain a 50% improvement of outcomes over those obtained from the existing, manually calibrated set of parameters, demonstrating the merits of this systematic and automated procedure.

97 MATHEMATICS AND COMPUTING↗

Solving high-dimensional partial integral differential equations: The finite expression method

Partial integro-differential equations (PIDEs) have broad applications in the sciences, from electro-magnetism to options pricing. Here, in this paper, we introduce a new finite expression method (FEX) to solve PIDEs. This approach builds upon the original FEX and its inherent advantages with new advances: 1) A novel method of parameter grouping is proposed to reduce the number of coefficients in high-dimensional function approximation; 2) A Taylor series approximation method is implemented to significantly improve the computational efficiency and accuracy of the evaluation of the integral terms of PIDEs. The new FEX based method, denoted FEX-PG to indicate the addition of the parameter grouping (PG) step to the algorithm, provides both high accuracy and interpretable numerical solutions, with the outcome being an explicit equation that facilitates intuitive understanding of the underlying solution structures. These features are often absent in traditional methods, such as finite element methods (FEM) and finite difference methods, as well as in deep learning-based approaches. To benchmark our method against recent advances, we apply the new FEX-PG to solve benchmark PIDEs in the literature. In high-dimensional settings, FEX-PG exhibits strong and robust performance, achieving relative errors on the order of single precision machine epsilon, significantly outperforming existing approaches based on neural networks.

Combinatorial optimization↗

Active operator learning with predictive uncertainty quantification for partial differential equations

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. Here, we propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

97 MATHEMATICS AND COMPUTING↗

Evaluating switch lifetime in soft-switched single-stage differential-mode SST

The reliability of semiconductor switches in single-stage differential-mode solid-state transformers (DM-SSTs) has not been systematically evaluated under soft-switching operation and realistic grid conditions. This paper presents a switch-level reliability analysis for soft-switched and hard-switched DM-SST configurations by integrating converter-specific power loss modeling with empirical lifetime prediction. Analytical derivation of device current profiles specific to the DM-SST is used to characterize electrothermal stress, which is then mapped to lifetime using degradation models obtained from power cycling tests (PCTs). Applied to realistic SST load profiles and grid voltage variations, this approach provides a probabilistic prediction of switch lifetime for the DM-SST. Lifetime estimates for both SiC MOSFETs and Si IGBTs are presented, offering insight into device degradation under converter operating conditions. The results quantify the reliability benefits of soft switching in single-stage SSTs, highlighting how switching dynamics influence long-term switch degradation.

14 SOLAR ENERGY↗

A power compensated differential scanning calorimeter for protein stability characterization

This study presented a power compensated MEMS differential scanning calorimeter (DSC) for protein stability characterization. In this microfabricated sensor, PDMS (Polydimethylsiloxane) and polyimide were used to construct the adiabatic chamber (1 μL) and temperature sensitive vanadium oxide was used as the thermistor material. A power compensation system was implemented to maintain the sample and reference at the same temperature. The resolution study and step response characterization indicated the high sensitivity (6 V/W) and low noise level (60 μk) of the device. The test with IgG1 antibody (mAb1) samples showed clear phase transitions and the data was confirmed to be reasonable by comparing it with the results of commercial DSC’s test. Finally, this device used ~1uL sample amount and could complete the scanning process in 4 min, significantly increasing the throughput of the bimolecular thermodynamics study like drug formulation process.

36 MATERIALS SCIENCE↗

Investigating Fast Scanning Calorimetry and Differential Scanning Calorimetry as Screening Tools for Thermoset Polymer Material Compatibility with Laser-Based Powder Bed Fusion

As additive manufacturing (AM) technology has developed and progressed, a constant topic of research in the area is expanding the library of materials to be used with these techniques. Among AM methods that utilize polymers, laser-based powder bed fusion (PBF-LB) has preferentially used thermoplastic polymers as its starting materials, but the deposition and material joining method employed in PBF-LB may also be compatible with powdered thermoset polymer precursors as feedstocks. To assess the compatibility of candidate thermosetting polymers and PBF-LB, characterization techniques and protocols that link fundamental material behavior to material behavior in the processing environment are needed. Therefore, the objectives of this work are to compare the curing behavior measured with two different calorimetry techniques that can operate in different heating rate regimes, differential scanning calorimetry (DSC) and fast scanning calorimetry (FSC), and to assess the capabilities of these techniques to act as materials screening tools for PBF-LB. A commercial polyester powder coating is used as a model material to evaluate the potential of obtaining complimentary information for material screening through a combination of calorimetry methods, and its non-isothermal curing behavior is measured at heating rates between 5 °C/min and 7500 °C/min. Curing exotherms are observed with both calorimetry techniques, and comparing the enthalpy associated with curing shows that incomplete curing occurs at higher heating rates, with relative conversion values of approximately 30%. The curing data are fit with two isoconversional models, Friedman and Starink, which show a reduced activation energy at higher heating rates as well, signifying a lower barrier to curing at the conditions used in the FSC experiments. Overall, the results of this work indicate that using these two calorimetry techniques as tiered screening tools can provide valuable information about how curing may proceed in PBF-LB and inform materials selection and design activities for additive manufacturing.

36 MATERIALS SCIENCE↗

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations

One of the most promising applications of machine learning in computational physics is to accelerate the solution of partial differential equations (PDEs). The key objective of machine-learning-based PDE solvers is to output a sufficiently accurate solution faster than standard numerical methods, which are used as a baseline comparison. Here, we first perform a systematic review of the ML-for-PDE-solving literature. Out of all of the articles that report using ML to solve a fluid-related PDE and claim to outperform a standard numerical method, we determine that 79% (60/76) make a comparison with a weak baseline. Second, we find evidence that reporting biases are widespread, especially outcome reporting and publication biases. We conclude that ML-for-PDE-solving research is overoptimistic: weak baselines lead to overly positive results, while reporting biases lead to under-reporting of negative results. To a large extent, these issues seem to be caused by factors similar to those of past reproducibility crises: researcher degrees of freedom and a bias towards positive results. We call for bottom-up cultural changes to minimize biased reporting as well as top-down structural reforms to reduce perverse incentives for doing so.

97 MATHEMATICS AND COMPUTING↗

Comparative differential cuproproteomes of Rhodobacter capsulatus reveal novel copper homeostasis related proteins

Abstract Copper (Cu) is an essential, but toxic, micronutrient for living organisms and cells have developed sophisticated response mechanisms towards both the lack and the excess of Cu in their environments. In this study, we achieved a global view of Cu-responsive changes in the prokaryotic model organism Rhodobacter capsulatus using label-free quantitative differential proteomics. Semi-aerobically grown cells under heterotrophic conditions in minimal medium (∼0.3 μM Cu) were compared with cells supplemented with either 5 μM Cu or with 5 mM of the Cu-chelator bathocuproine sulfonate. Mass spectrometry based bottom-up proteomics of unfractionated cell lysates identified 2430 of the 3632 putative proteins encoded by the genome, producing a robust proteome dataset for R. capsulatus. Use of biological and technical replicates for each growth condition yielded high reproducibility and reliable quantification for 1926 of the identified proteins. Comparison of cells grown under Cu-excess or Cu-depleted conditions to those grown under minimal Cu-sufficient conditions revealed that 75 proteins exhibited statistically significant (p < 0.05) abundance changes, ranging from 2- to 300-fold. A subset of the highly Cu-responsive proteins was orthogonally probed using molecular genetics, validating that several of them were indeed involved in cellular Cu homeostasis.

59 BASIC BIOLOGICAL SCIENCES↗

The Princess Project: From Differential to Integral Experiments

Following the shutdown of the CEA Valduc experimental facilities, where, for more than 50 years, IRSN used to perform experiments related to criticality safety, IRSN initiated a new project named PRINCESS (PRoject for IRSN Neutron physics and Criticality Experimental data Supporting Safety). The objective is to continue collecting experimental data necessary for the IRSN missions in nuclear safety. For this purpose, collaborations with various national and international laboratories have been established. The PRINCESS project covers various nuclear physics fields from nuclear data to criticality-safety and reactor physics providing information to both differential and integral data improvements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Reconstructing magnetic deflections from sets of proton images using differential evolution

Proton imaging is a powerful technique for imaging electromagnetic fields within an experimental volume, in which spatial variations in proton fluence are a result of deflections to proton trajectories due to interaction with the fields. When deflections are large, proton trajectories can overlap, and this nonlinearity creates regions of greatly increased proton fluence on the image, known as caustics. The formation of caustics has been a persistent barrier to reconstructing the underlying fields from proton images. We have developed a new method for reconstructing the path-integrated magnetic fields, which begins to address the problem posed by caustics. Our method uses multiple proton images of the same object, each image at a different energy, to fill in the information gaps and provide some uniqueness when reconstructing caustic features. We use a differential evolution algorithm to iteratively estimate the underlying deflection function, which accurately reproduces the observed proton fluence at multiple proton energies simultaneously. We test this reconstruction method using synthetic proton images generated for three different, cylindrically symmetric field geometries at various field amplitudes and levels of proton statistics and present reconstruction results from a set of experimental images. Here, the method we propose requires no assumption of deflection linearity and can reliably solve for fields underlying linear, nonlinear, and caustic proton image features for the selected geometries and is shown to be fairly robust to noise in the input proton intensity.

47 OTHER INSTRUMENTATION↗

Stiff neural ordinary differential equations

Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODEs in the classical stiff ODE systems of Robertson’s problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson’s problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODEs. The success of learning stiff neural ODEs opens up possibilities of using neural ODEs in applications with widely varying time-scales, such as chemical dynamics in energy conversion, environmental engineering, and life sciences.

97 MATHEMATICS AND COMPUTING↗