Search NASA⌕ Search

SEARCH · Search NASA

Results for “differentiable programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Implementing Ordinary Differential Equation Solvers in Rust Programming Language for Modeling Vehicle Powertrain Systems: Preprint

Efficient and accurate ordinary differential equation (ODE) solvers are necessary for powertrain and vehicle dynamics modeling. However, current commercial ODE solvers can be financially prohibitive, leading to a need for accessible, effective, open-source ODE solvers designed for powertrain modeling. Rust is a compiled programming language that has the potential to be used for fast and easy-to-use powertrain models, given its exceptional computational performance, robust package ecosystem, and short time required for modelers to become proficient. However, of the three commonly used (>3,000 downloads) packages in Rust with ODE solver capabilities, only one has more than four numerical methods implemented, and none are designed specifically for modeling physical systems. Therefore, the goal of the Differential Equation System Solver (DESS) was to implement accurate ODE solvers in Rust designed for the component-based problems often seen in powertrain modeling. DESS is a text-based software package that provides a flexible framework for building and solving systems of ODEs. This allows DESS to be included as a dependency for automotive powertrain models that require a variety of solvers and solver configurations. Seven explicit ODE solver methods have been implemented in DESS: Euler’s, Heun’s, midpoint, Ralston’s, classic Runge-Kutta, Bogacki-Shampine, and Cash-Karp. These represent five fixed-step methods and two adaptive-step methods. This paper shows that the solver implementations increase accuracy and computational efficiency compared to Euler's method when modeling a system of three thermal masses in Rust. DESS also includes features designed for modeling component-based physical systems. Users can define relationships between nodes in their system, which the package then translates into a system of equations, leading to simpler and more intuitive code. In the case of a three-thermal-mass system, the user can specify node thermal properties (e.g., thermal capacitance), how nodes are interconnected, and thermal conductance between nodes rather than providing a system of equations. The core contribution from this work is an open-source, text-based Rust package with ODE solvers for automotive powertrain modeling to support cost-free, fast, and accurate simulation.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Evaluating the feasibility of using downwind methods to quantify point source oil and gas emissions using continuously monitoring fence-line sensors

The dependable reporting of methane (CH 4 ) emissions from point sources, such as fugitive leaks from oil and gas infrastructure, is important for profit maximization (retaining more hydrocarbons), evaluating climate impacts, assessing CH 4 fees for regulatory programs, and validating CH 4 intensity in differentiated gas programs. Currently, there are disagreements between emissions reported by different quantification techniques for the same sources. It has been suggested that downwind CH 4 quantification methods using CH 4 measurements on the fence line of production facilities could be used to generate emission estimates from oil and gas operations at the site level, but it is currently unclear how accurate the quantified emissions are. To investigate the accuracy of downwind methods, this study uses fence-line simulated data collected during controlled-release experiments as input for a non-standard closed-path eddy covariance (EC), the Gaussian plume inverse model (GPIM), and the backward Lagrangian stochastic (bLs) model in a range of atmospheric conditions. This study's EC attempt was unsuccessful due to data collection and instrumentation issues, resulting in invalid results characterized by underestimated emissions, large negative fluxes, and cospectra/ogives that deviated from their ideal shapes. Consequently, the EC results could not be compared with the GPIM and bLS model. The bLs model demonstrated the highest accuracy for single-release single-point emissions, though it exhibited greater uncertainty than GPIM under multi-release conditions. Across the GPIM and bLs model, the most reliable quantification was achieved with 15 min averaging and a narrow 5° wind sector range. Although EC was limited in this context, future studies should consider employing a standard EC system and further optimizing GPIM and bLs approaches – particularly for complex multi-source scenarios – to enhance quantification accuracy and reduce uncertainty.

03 NATURAL GAS↗
DOE OSTI2016

A Hybrid Method to Estimate Specific Differential Phase and Rainfall With Linear Programming and Physics Constraints

A hybrid method of combining linear programming (LP) and physical constraints is developed to estimate specific differential phase (K DP ) and to improve rain estimation. Moreover, the hybrid K DP estimator and the existing estimators of LP, least squares fitting, and a self-consistent relation of polarimetric radar variables are evaluated and compared using simulated data. Our simulation results indicate the new estimator's superiority, particularly in regions where backscattering phase (δ hv ) dominates. Further, a quantitative comparison between auto-weather-station rain-gauge observations and K DP -based radar rain estimates for a Meiyu event also demonstrate the superiority of the hybrid K DP estimator over existing methods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Optimal guidance law in quantum mechanics

Following de Broglie’s idea of a pilot wave, this paper treats quantum mechanics as a problem of stochastic optimal guidance law design. The guidance scenario considered in the quantum world is that an electron is the flight vehicle to be guided and its accompanying pilot wave is the guidance law to be designed so as to guide the electron to a random target driven by the Wiener process, while minimizing a cost-to-go function. After solving the stochastic optimal guidance problem by differential dynamic programming, we point out that the optimal pilot wave guiding the particle’s motion is just the wavefunction Ψ(t,x), a solution to the Schrödinger equation; meanwhile, the closed-loop guidance system forms a complex state–space dynamics for Ψ(t,x), from which quantum operators emerge naturally. Quantum trajectories under the action of the optimal guidance law are solved and their statistical distribution is shown to coincide with the prediction of the probability density function Ψ{sup ∗}Ψ. -- Highlights: •Treating quantum mechanics as a pursuit-evasion game. •Reveal an interesting analogy between guided flight motion and guided quantum motion. •Solve optimal quantum guidance problem by dynamic programming. •Gives a formal proof of de Broglie–Bohm’s idea of a pilot wave. •The optimal pilot wave is shown to be a wavefunction solved from Schrödinger equation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade

The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model’s main branch and is now freely available.

Adjoints↗
DOE OSTI2012

VLBI FOR GRAVITY PROBE B. I. OVERVIEW

We describe the NASA/Stanford gyroscope relativity mission, Gravity Probe B (GP-B), and provide an overview of the following series of six astrometric and astrophysical papers that report on our radio observations and analyses made in support of this mission. The main goal of this 8.5 year program of differential very long baseline interferometry astrometry was to determine the proper motion of the guide star of the GP-B mission, the RS CVn binary IM Pegasi (IM Peg; HR 8703). This proper motion is determined with respect to compact, extragalactic reference sources. The results are -20.833 {+-} 0.090 mas yr{sup -1} and -27.267 {+-} 0.095 mas yr{sup -1} for, respectively, the right ascension and declination, in local Cartesian coordinates, of IM Peg's proper motion, and 10.370 {+-} 0.074 mas (i.e., 96.43 {+-} 0.69 pc) for its parallax (and distance). Each quoted uncertainty is meant to represent an {approx}70% confidence interval that includes the estimated contribution from systematic error. These results are accurate enough not to discernibly degrade the GP-B estimates of its gyroscopes' relativistic precessions: the frame-dragging and geodetic effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Flow annealed importance sampling bootstrap meets differentiable particle physics

High-energy physics requires the generation of large numbers of simulated data samples from complex but analytically tractable distributions called matrix elements. Surrogate models, such as normalizing flows, are gaining popularity for this task due to their computational efficiency. We adopt an approach based on flow annealed importance sampling bootstrap (FAB) that evaluates the differentiable target density during training and helps avoid the costly generation of training data in advance. We show that FAB reaches higher sampling efficiency with fewer target evaluations in high dimensions in comparison to other methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman

Abstract Motivation Multiple sequence alignments (MSAs) of homologous sequences contain information on structural and functional constraints and their evolutionary histories. Despite their importance for many downstream tasks, such as structure prediction, MSA generation is often treated as a separate pre-processing step, without any guidance from the application it will be used for. Results Here, we implement a smooth and differentiable version of the Smith–Waterman pairwise alignment algorithm that enables jointly learning an MSA and a downstream machine learning system in an end-to-end fashion. To demonstrate its utility, we introduce SMURF (Smooth Markov Unaligned Random Field), a new method that jointly learns an alignment and the parameters of a Markov Random Field for unsupervised contact prediction. We find that SMURF learns MSAs that mildly improve contact prediction on a diverse set of protein and RNA families. As a proof of concept, we demonstrate that by connecting our differentiable alignment module to AlphaFold2 and maximizing predicted confidence, we can learn MSAs that improve structure predictions over the initial MSAs. Interestingly, the alignments that improve AlphaFold predictions are self-inconsistent and can be viewed as adversarial. This work highlights the potential of differentiable dynamic programming to improve neural network pipelines that rely on an alignment and the potential dangers of optimizing predictions of protein sequences with methods that are not fully understood. Availability and implementation Our code and examples are available at: https://github.com/spetti/SMURF. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Miniaturized Magnetoelastic Sensor System

This article describes the design, assembly, and implementation of a hand-held, magnetic-field-based sensor system that can be adapted for a variety of sensing applications. The miniaturized system is based on Chemical Identification by Magneto-Elastic Sensing (ChIMES) technology, which uses three concentric solenoid coils to wirelessly interrogate a sensor body comprised of a response material coupled to a magnetoelastic wire. The response material expands when it encounters a target, imposing mechanical stress on the wire and altering its magnetic permeability. The sensor bodies are passive, requiring no external power source, and they are small, measuring about 15 mm in length and 3.0 mm in diameter. Up to four sensor bodies can be configured as an evenly-spaced linear array. The sensor system operates by applying a low-frequency, current-stabilized, filtered triangle wave to a uniform-density excitation coil to switch the magnetic domains within the wire. Further, the responses from the sensors are picked up by a detection coil as stress-induced changes in the Faraday voltage, and the strong magnetic field induced by the excitation coil in the detection coil is nullified by a cancellation coil reverse-wound in series with the detection coil. The responses of the sensors in an array are separated in time by a linear gradient dc biasing coil. The sensors can be interrogated through metallic and nonmetallic barriers. The signals from the detection coil and the excitation coil are digitized by a pair of bipolar analog-to-digital converters (ADCs). A Raspberry Pi single-board computer (SBC) and associated software perform data acquisition and control all aspects of the sensor system hardware. The program allows the user to select the number of sensors in the array, the type of signal that is being collected, and the number of samples to take. The program also allows for signal processing of the sensor data, such as baseline correction. The program can differentiate sensor peaks from each other and calculate the magnitude of each sensor response with less than 1% error. The data are then displayed along with a graph of the signal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2016

Identification and characterization of a cis -regulatory element for zygotic gene expression in Chlamydomonas reinhardtii

Upon fertilization Chlamydomonas reinhardtii zygotes undergo a program of differentiation into a diploid zygospore that is accompanied by transcription of hundreds of zygote-specific genes. We identified a distinct sequence motif we term a zygotic response element (ZYRE) that is highly enriched in promoter regions of C. reinhardtii early zygotic genes. A luciferase reporter assay was used to show that native ZYRE motifs within the promoter of zygotic gene ZYS3 or intron of zygotic gene DMT4 are necessary for zygotic induction. A synthetic luciferase reporter with a minimal promoter was used to show that ZYRE motifs introduced upstream are sufficient to confer zygotic upregulation, and that ZYRE-controlled zygotic transcription is dependent on the homeodomain transcription factor GSP1. Furthermore, we predict that ZYRE motifs will correspond to binding sites for the homeodomain proteins GSP1-GSM1 that heterodimerize and activate zygotic gene expression in early zygotes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Fuel-Cladding Eutectic Study of Legacy Fast Flux Test Facility (FFTF) MFF HT9/U-10Zr Metallic Fuel

This report presents the first systematic investigation of fuel-cladding eutectic interaction (FCEI) in irradiated HT9/U-10Zr metallic fuel from the Fast Flux Test Facility (FFTF) Materials Fuels Form (MFF) program, using differential scanning calorimetry (DSC) coupled with scanning electron microscopy (SEM) and energy dispersive X-ray spectroscopy (EDS). Two irradiated fuel cross-sections, MNT07H (9.5 at% burnup, x/L = 0.78) and MNT08H (7.0 at% burnup, x/L = 0.93), were subjected to three successive isothermal annealing rounds (R1–R3) at 820°C for 20 minutes each, yielding a cumulative transient duration of one hour. This study directly addresses a recognized gap in the existing FCEI database, which previously lacked irradiated HT9/U-10Zr data at burnup levels above 8 at%. Two principal findings emerge from the study. First, for both samples, FCEI remained spatially confined within the pre-existing fuel-cladding chemical interaction (FCCI) zone boundaries after R3, with no measurable eutectic penetration into unaffected cladding beyond the original FCCI layer. This self-limiting behavior is consistent with historical Fuel Behavior Test Apparatus (FBTA) results and is attributed to the near-eutectic phase composition of the FCCI zone, which rapidly absorb the available eutectic-forming constituents and then stall penetration once the FCCI zone is consumed. A comparison with unirradiated surrogate data further supports this mechanism: whereas a U–34 at.% Fe sample would be expected to show ~176 µm of iron penetration under comparable conditions, the irradiated samples exhibited only ~20 µm, a discrepancy attributed to irradiation-induced interfacial porosity and pre-existing FCCI composition gradients. Second, for MNT08H, FCEI was observed exclusively on the half of the cladding circumference where pre-existing steady-state FCCI was present, with no detectable FCEI on the opposite half. Three hypotheses are proposed to explain this asymmetry: the inhibiting role of a zirconium-rich rind at the fuel-cladding interface; the chemical sequestration of iron by redistributed zirconium within the fuel matrix; and the persistence of fuel-cladding gaps on the FCEI-free half that preclude direct contact. All three hypotheses require further experimental investigation. The results extend the empirical FCEI database into higher-burnup territory and demonstrate the viability of DSC-based testing as a substitute for the no-longer-available FBTA apparatus. Future work will include additional cross-section testing, compilation of the full FCEI dataset, model evaluation, and DSC testing of ternary fuel compositions to broaden the experimental basis for safety assessment of sodium-cooled fast reactor systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Reverse-mode differentiation in arbitrary tensor network format: with application to supervised learning.

This paper describes an efficient reverse-mode differentiation algorithm for contraction operations of tensor networks that may have arbitrary and unconventional network topologies. The approach leverages the tensor contraction tree of Evenbly and Pfeifer (2014), which provides an instruction set for the contraction sequence of a network. We show that this tree can be efficiently leveraged for differentiation of a full tensor network contraction using a recursive scheme that exploits (1) the bilinear property of contraction and (2) the property that trees have single path from root to leaves. While differentiation of tensor-tensor contraction is already possible in most automatic differentiation packages, we show that exploiting these two additional properties in the specific context of contraction sequences can improve efficiency. Following a description of the algorithm and computational complexity analysis, we investigate its utility for gradient-based supervised learning for low-rank function recovery and for fitting real-world unstructured datasets. We demonstrate improved performance over alternating least-squares optimization approaches and the capability to handle heterogeneous and arbitrary tensor network formats. When compared to alternating minimization algorithms, we find that the gradient-based approach requires a smaller oversampling ratio (number of samples compared to number model parameters) for recovery. This increased efficiency extends to fitting unstructured data of varying dimensionality and when employing a variety of tensor network formats. Here, we show improved learning using the hierarchical Tucker method over the tensor-train in high-dimensional settings on a number of benchmark problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2011

Nash equilibrium in differential games and the construction of the programmed iteration method

This work is devoted to the study of nonzero-sum differential games. The set of payoffs in a situation of Nash equilibrium is examined. It is shown that the set of payoffs in a situation of Nash equilibrium coincides with the set of values of consistent functions which are fixed points of the program absorption operator. A condition for functions to be consistent is given in terms of the weak invariance of the graph of the functions under a certain differential inclusion. Bibliography: 18 titles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A multi-language auto differentiation package (mAD) v1.0

This is a multi-language auto differentiation package. It includes multiple language versions of the package. It can be included/used as a module/class in users' application program to enable differentiability of the program. It is simple, transparent, extensible, efficient compared with the other AD package such as Enzyme or Pytorch.

Qiang, Ji [Lawrence Berkeley National Laboratory (↗
DOE OSTI2024

A taxonomy of automatic differentiation pitfalls

Automatic differentiation is a popular technique for computing derivatives of computer programs. While automatic differentiation has been successfully used in countless engineering, science, and machine learning applications, it can sometimes nevertheless produce surprising results. In this paper, we categorize problematic usages of automatic differentiation, and illustrate each category with examples such as chaos, time-averages, discretizations, fixed-point loops, lookup tables, linear solvers, and probabilistic programs, in the hope that readers may more easily avoid or detect such pitfalls. We also review debugging techniques and their effectiveness in these situations.

Autodiff↗
DOE OSTI2015

The Clostridium Sporulation Programs: Diversity and Preservation of Endospore Differentiation

Bacillus and Clostridium organisms initiate the sporulation process when unfavorable conditions are detected. The sporulation process is a carefully orchestrated cascade of events at both the transcriptional and posttranslational levels involving a multitude of sigma factors, transcription factors, proteases, and phosphatases. Like Bacillus genomes, sequenced Clostridium genomes contain genes for all major sporulation-specific transcription and sigma factors (spo0A, sigH, sigF, sigE, sigG, and sigK) that orchestrate the sporulation program. However, recent studies have shown that there are substantial differences in the sporulation programs between the two genera as well as among different Clostridium species. First, in the absence of a Bacillus-like phosphorelay system, activation of Spo0A in Clostridium organisms is carried out by a number of orphan histidine kinases. Second, downstream of Spo0A, the transcriptional and posttranslational regulation of the canonical set of four sporulation-specific sigma factors (σF, σE, σG, and σK) display different patterns, not only compared to Bacillus but also among Clostridium organisms. Finally, recent studies demonstrated that σK, the last sigma factor to be activated according to the Bacillus subtilis model, is involved in the very early stages of sporulation in Clostridium acetobutylicum, C. perfringens, and C. botulinum as well as in the very late stages of spore maturation in C. acetobutylicum. Despite profound differences in initiation, propagation, and orchestration of expression of spore morphogenetic components, these findings demonstrate not only the robustness of the endospore sporulation program but also the plasticity of the program to generate different complex phenotypes, some apparently regulated at the epigenetic level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

A dynamic alternative splicing program regulates gene expression during terminal erythropoiesis

Alternative pre-messenger RNA splicing remodels the human transcriptome in a spatiotemporal manner during normal development and differentiation. Here we explored the landscape of transcript diversity in the erythroid lineage by RNA-seq analysis of five highly purified populations of morphologically distinct human erythroblasts, representing the last four cell divisions before enucleation. In this unique differentiation system, we found evidence of an extensive and dynamic alternative splicing program encompassing genes with many diverse functions. Alternative splicing was particularly enriched in genes controlling cell cycle, organelle organization, chromatin function and RNA processing. Many alternative exons exhibited differentiation-associated switches in splicing efficiency, mostly in late-stage polychromatophilic and orthochromatophilic erythroblasts, in concert with extensive cellular remodeling that precedes enucleation. A subset of alternative splicing switches introduces premature translation termination codons into selected transcripts in a differentiation stage-specific manner, supporting the hypothesis that alternative splicing-coupled nonsense-mediated decay contributes to regulation of erythroid-expressed genes as a novel part of the overall differentiation program. We conclude that a highly dynamic alternative splicing program in terminally differentiating erythroblasts plays a major role in regulating gene expression to ensure synthesis of appropriate proteome at each stage as the cells remodel in preparation for production of mature red cells.

59 BASIC BIOLOGICAL SCIENCES↗