Search NASA⌕ Search

SEARCH · Search NASA

Results for “Hybrid Transformer Model System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Harnessing the Digital Transformation for Development of Electrified Aircraft Propulsion Control Systems

Hybrid electric aircraft propulsion is an emerging technology that presents a variety of potential benefits along with technical integration challenges. Developing these new propulsion architectures with their complex control systems, and ultimately proving their benefit, is a multistep process that goes from concept, to analysis, to dynamic simulation, to hardware in the loop testing, to full scale testing and beyond. This effort is being revolutionized and indeed enabled by new digital tools that support the increasing technology readiness level throughout the maturation process. NASA has developed and made available a suite of digital tools that ease the path from concept to implementation. The three packages are the Toolbox for the Modeling and Analysis of Thermodynamic Systems (T-MATS), the Electrical Modeling and Thermal Analysis Toolbox (EMTAT), and the Thermal Systems Analysis Toolbox (TSAT). These tools are interactive, complementary, and compatible with each other. T-MATS is a modular thermodynamic modeling framework designed for creating custom component level models of jet engines. EMTAT is a modeling framework used to simulate a variety of power electronic devices, using both physics-based and power flow calculations. TSAT is a framework for modeling and analysis of dynamic heat transfer. These packages all consist of graphical, drag-and-drop, parameterizable building blocks representing various components of the system to be modeled, e.g., compressors, turbines, motors, energy storage devices, etc. They are designed to enable the user to model and simulate the end-to-end dynamic operation of a hybrid powertrain at the timescale of the turbomachinery, capturing mechanical, electrical, and thermal interactions. This paper will describe through multiple examples how these tools have been used successfully in several of the early stages of hybrid electric propulsion system development, from the initial system modeling to real-time interactive pilot-in-the-loop simulation to physical hardware-in-the-loop testing, each step bringing the technology closer to fruition.

Hybrid electric propulsion↗

EUTERPE: A global gyrokinetic code for stellarator geometry

The current state of the EUTERPE code is described with emphasis on the implemented models and their numerical implementation. The code solves the multi-species electromagnetic gyrokinetic equations in the full volume of a three-dimensional domain. Noise reduction of the particle-in-cell method is achieved by using a δf-method and Fourier filters. The field equations are discretized with B-splines and the resulting system of equations is solved iteratively. For linear simulations a phase-factor transformation is applied in order to strongly reduce the necessary grid resolution. Apart from the full gyrokinetic model, other numerically less expensive hybrid models are also implemented. They are mainly tailored for comparison with fluid theory and for studying the interaction of the bulk plasma with fast particles. The code is parallelized for CPUs by particle and domain decomposition. Good scalability up to several thousand nodes is demonstrated.

97 MATHEMATICS AND COMPUTING↗

Toward Coupled Data Assimilation in NASA’s GEOS: Developments in the Ocean Context

The Global Modeling & Assimilation Office (GMAO) at NASA GSFC produces analyses and predictions of the Earth system using various configurations of the Goddard Earth Observing System (GEOS) model and assimilation system. The current sub-seasonal-to-seasonal prediction system (GEOS-S2S) is based on a coupled atmosphere-ocean-land-ice configuration of GEOS which includes the Modular Ocean Model version 5 (MOM5) run at approximately 50-km resolution and a de-coupled OI-based ocean analysis that uses an initialization of MOM5 forced by the MERRA-2 reanalysis. GMAO will soon implement an updated GEOS-S2S system that will run at 25-km resolution and adopt aspects of the hybrid four-dimensional ensemble-variational (H4DEnVar) system already running in the production-version atmospheric analysis system, including a Local Ensemble Transform Kalman Filter (LETKF) to provide initial conditions for the oceanic state. This presentation will focus on developments to sustain the GMAO's systems on longer time horizons, where more radical transformations will be required to adapt to advanced computing environments, higher resolution and more diverse model components, and new observations for the Earth system. Results will describe progress toward a version of the GEOS coupled system that will be based around the Joint Effort for Data assimilation Integration (JEDI) framework being developed within Joint Center for Satellite Data Assimilation (JCSDA) and include an updated ocean model, MOM6. Discussion will focus specifically on the use of a Unified Forward Operator (UFO) for simulating observations and the Object Oriented Prediction System (OOPS) for providing the state estimate. These features are being developed as a multi-agency effort under the auspices of the JCSDA and are being adopted in the GMAO for all its applications of coupled data assimilation including S2S, numerical weather prediction, and reanalysis.

Mahajan, Rahul↗

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗

Solid-State Transformer and Hybrid Transformer With Integrated Energy Storage in Active Distribution Grids: Technical and Economic Comparison, Dispatch, and Control

Solid-state transformer (SST) and hybrid transformer (HT) are promising alternatives to the line-frequency transformer (LFT) in smart grids. The SST features medium-frequency isolation, full controllability for voltage regulation, reactive power compensation, and the capability of battery energy storage system (BESS) integration with multiport configuration. The HT has a partially-rated converter for fractional controllability and can integrate a small BESS. Fast grid-edge voltage fluctuations from increased solar photovoltaic (PV) and electric vehicle (EV) penetration are difficult to manage for mechanical load tap changers. Hence, along with the trend towards more BESS in the grid, the controllability and the storage integration capability of the SST and HT are of strong interest. However, a review of literature shows existing SST and HT research is mostly at converter level, while system-level assessments are scarce. Assessing technical and economic impacts is critical to understanding the benefits and role of the SST and HT to guide future research, which is presented for the first time in this article. Experimental results from medium-voltage (MV) SST and MV HT prototypes are shown to confirm equipment-level feasibility, where the voltage controllability waveforms of a MV HT prototype are reported for the first time. Comparative simulations are performed on a modified IEEE 34-bus system. Here, a grid-model-less decentralized grid-edge voltage control method and a day-ahead BESS dispatch method are proposed for the SST and HT. The simulations show that the SST and HT with integrated storage can host more PV, achieve peak shaving, mitigate voltage fluctuation and reverse power flow, and support energy arbitrage for operational cost reduction, as compared to the LFT. Moreover, comprehensive analyses of net present value (NPV) and internal rate of return (IRR) are performed under different installed PV capacities, HT’s partial converter ratings, and BESS capacities. Sensitivities to future cost reductions of the PV and BESS are studied. Although the NPV and IRR are currently negative, 60% capital cost reduction or 150% revenue increase will make the SST and HT economically viable in the use case studied.

14 SOLAR ENERGY↗

eYGFPuv-Assisted Transgenic Selection in Populus deltoides WV94 and Multiplex Genome Editing in Protoplasts of P. trichocarpa × P. deltoides Clone ‘52-225’

Although CRISPR/Cas-based genome editing has been widely used for plant genetic engineering, its application in the genetic improvement of trees has been limited, partly because of challenges in Agrobacterium-mediated transformation. As an important model for poplar genomics and biotechnology research, eastern cottonwood (Populus deltoides) clone WV94 can be transformed by A. tumefaciens, but several challenges remain unresolved, including the relatively low transformation efficiency and the relatively high rate of false positives from antibiotic-based selection of transgenic events. Moreover, the efficacy of CRISPR-Cas system has not been explored in P. deltoides yet. Here, we first optimized the protocol for Agrobacterium-mediated stable transformation in P. deltoides WV94 and applied a UV-visible reporter called eYGFPuv in transformation. Our results showed that the transgenic events in the early stage of transformation could be easily recognized and counted in a non-invasive manner to narrow down the number of regenerated shoots for further molecular characterization (at the DNA or mRNA level) using PCR. We found that approximately 8.7% of explants regenerated transgenic shoots with green fluorescence within two months. Next, we examined the efficacy of multiplex CRISPR-based genome editing in the protoplasts derived from P. deltoides WV94 and hybrid poplar clone ‘52-225’ (P. trichocarpa × P. deltoides clone ‘52-225’). The two constructs expressing the Trex2-Cas9 system resulted in mutation efficiency ranging from 31% to 57% in hybrid poplar clone 52-225, but no editing events were observed in P. deltoides WV94 transient assay. The eYGFPuv-assisted plant transformation and genome editing approach demonstrated in this study has great potential for accelerating the genome editing-based breeding process in poplar and other non-model plants species and point to the need for additional CRISPR work in P. deltoides.

59 BASIC BIOLOGICAL SCIENCES↗

Finite element appendage equations for hybrid coordinate dynamic analysis.

The increasingly common practice of idealizing a spacecraft as a collection of interconnected rigid bodies to some of which are attached linearly elastic flexible appendages leads to equations of motion expressed in terms of a combination of discrete coordinates describing the arbitrary rotational motions of the rigid bodies and distributed or modal coordinates describing the small, time-varying deformations of the appendages: such a formulation is said to employ a hybrid system of coordinates. In the present paper the existing literature is extended to provide hybrid coordinate equations of motion for a finite element model of a flexible appendage attached to a rigid base undergoing unrestricted motions and some of the advantages of the finite element approach are noted. Transformations to the modal coordinates appropriate for the general case are provided.

Likins, P. W.↗

Electromagnetic coupling in tight-binding models for strongly correlated light and matter

In this work, we discuss the construction of low-energy tight-binding Hamiltonians for condensed-matter systems with a strong coupling to the quantum electromagnetic field. Such Hamiltonians can be obtained by projecting the continuum theory on a given set of Wannier orbitals. However, different representations of the continuum theory lead to different low-energy formulations because different representations may entangle light and matter, transforming orbitals into light-matter hybrid states before the projection. In particular, a multicenter Power-Zienau-Woolley transformation yields a dipolar Hamiltonian which incorporates the light-matter coupling via both Peierls phases and a polarization density. We compare this dipolar gauge Hamiltonian and the straightforward Coulomb gauge Hamiltonian for a one-dimensional solid to describe subcycle light-driven electronic motion in the semiclassical limit and a coupling of the solid to a quantized cavity mode which renormalizes the band-structure into electron-polariton bands. Both descriptions yield the same result when many bands are taken into account but the dipolar Hamiltonian is more accurate when the model is restricted to few electronic bands, while the Coulomb Hamiltonian requires fewer electromagnetic modes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Multidisciplinary Conceptual Design for Reduced-Emission Rotorcraft

Python-based wrappers for OpenMDAO are used to integrate disparate software for practical conceptual design of rotorcraft. The suite of tools which are connected thus far include aircraft sizing, comprehensive analysis, and parametric geometry. The tools are exercised to design aircraft with aggressive goals for emission reductions relative to fielded state-of-the-art rotorcraft. Several advanced reduced-emission rotorcraft are designed and analyzed, demonstrating the flexibility of the tools to consider a wide variety of potentially transformative vertical flight vehicles. To explore scale effects, aircraft have been sized for 5, 24, or 76 passengers in their design missions. Aircraft types evaluated include tiltrotor, single-main-rotor, coaxial, and side-by-side helicopters. Energy and drive systems modeled include Lithium-ion battery, hydrogen fuel cell, turboelectric hybrid, and turboshaft drive systems. Observations include the complex nature of the trade space for this simple problem, with many potential aircraft design and operational solutions for achieving significant emission reductions. Also interesting is that achieving greatly reduced emissions may not require exotic component technologies, but may be achieved with a dedicated design objective of reducing emissions.

Rotorcraf↗

Transformer-based operator learning framework for self-energy in strongly correlated systems

We introduce Σ-Attention, a transformer-based operator-learning framework for approximating the self-energy operator of strongly correlated electronic systems. By creating a batched dataset that combines results from three complementary approaches, i.e., many-body perturbation theory, strong-coupling expansion, and exact diagonalization, each effective in specific parameter regimes, Σ-Attention is applied to learn an accurate approximation for the self-energy operator that is valid across a wide range of parameter regimes. This hybrid strategy leverages the strengths of existing methods while relying on the transformer's ability to generalize beyond individual limitations. More importantly, the scalability of the transformer architecture allows the learned self-energy to be extended to systems with larger sizes, leading to much improved computational scaling. Using the one-dimensional Hubbard model, we demonstrate that Σ-Attention can accurately predict the Matsubara Green's function of large systems with a wide range of coupling strength. Our framework offers a promising and scalable pathway for studying strongly correlated systems with many possible generalizations.

Zhu, Yuanran↗

Imaging Wavepackets in Real-Space & Disentangling Ultrafast Solvation Dynamics with High-Energy Ultrafast X-ray Scattering

The microscopic information of solute and solute-solvent motions can be measured using ultrafast diffuse x-ray scattering, and compared to molecular dynamics simulations, as demonstrated in studies of solvated molecular systems done in X-ray free-electron lasers. However, for the typical photon energies used in these experiments, the photon momentum transfer range was limited to lower Q values where the signals arising from different parts of the studied system overlap significantly. Recently, this limitation was greatly alleviated by extending the photon energy at the Linac Coherent Light-Source (LCLS), significantly increasing the accessible momentum transfer range. This improvement is transformative for ultrafast diffuse x-ray scattering measurements, enabling for the first time to disentangle the solute scattering difference signal, that persists to higher Q values, from the bulk solvent and solute-solvent cross-terms difference signals. In addition, it enhances the prediction ability of modeling and simulation methods such as the hybrid QM/MM approach. The extended Q range also opens the way to resolve in real-space details regarding coherent wavepackets motions beyond their center-of-mass positions. Here, we present the first results on high-energy (18keV) diffuse x-ray scattering in solution, demonstrating high fidelity time-resolved scattering and analysis of the photoexcited model photocatalysts PtPOP ([Pt2(POP)4]4-), and IrDimen ([Ir2(dimen)4]2+) in several solvents. These complexes provide ideal systems for demonstrating the ability of high-Q ultrafast scattering and QM/MM simulations to decompose ultrafast solvation dynamics into specific changes in the solute-solvent pair distribution function with a particular focus on how electronically excited states change the interaction between the solvent and photo-catalytically active metal sites. We introduce an approach to further utilize the high-energy capability and demonstrate a single-shot ultra-wide-angle X-ray Scattering modality using two perpendicular detectors, spanning a scattering angle range of more than 100 degrees, allowing to extend the accessible momentum transfer range up to Q~14 Å-1. We develop a model-free method to invert the x-ray scattering signals and enable the recovery of multiple pair-density motions that happen simultaneously, allowing us to directly measure in real-space nuclear wavepacket motions. . [1] Natan, Adi. "Real-Space Inversion and Super-Resolution of Ultrafast X-ray Scattering using Natural Scattering Kernels." arXiv preprint arXiv:2107.05576 (2021)

Natan, Adi↗

ESMs Latent Space Exploration for Uncertainty Quantification and Spatiotemporal Downscaling

This final report for DOE Award DE-SC0023044 presents advances in two key areas of climate modeling: (1) representative climate model selection and (2) Earth System Model (ESM) downscaling using hybrid AI methods. The first section introduces a reordered, three-stage workflow to select representative GCM runs that more effectively balance historical skill with ensemble spread, validated across Texas, Bihar, and New York. The second section introduces two novel super-resolution frameworks, ViSIR and ViFOR, that integrate Vision Transformers with sinusoidal and Fourier-based implicit neural representations. These models achieve state-of-the-art reconstruction accuracy for ESM variables including surface temperature and heat fluxes. The report includes detailed methodology, benchmarks, and results, demonstrating significant gains in uncertainty quantification, spatial fidelity, and scalability for climate-impact studies.

54 ENVIRONMENTAL SCIENCES↗

Stochastic Ion Heating by the Lower-Hybrid Waves

The resonance lower-hybrid wave-ion interaction is described by a group (differentiable map) of transformations of phase space of the system. All solutions to the map belong to a strange attractor, and chaotic motion of the attractor manifests itself in a number of macroscopic effects, such as the energy spectrum and particle heating. The applicability of the model to the problem of ion heating by waves at the front of collisionless shock as well as ion acceleration by a spectrum of waves is discussed. Keywords: plasma; ion-cyclotron heating; shocks; beat-wave accelerator.

Khazanov, G.↗

Quantum computing based hybrid deep learning for fault diagnosis in electrical power systems

Quantum computing (QC) and deep learning have shown promise of supporting transformative advances and have recently gained popularity in a wide range of areas. Here, this paper proposes a hybrid QC-based deep learning framework for fault diagnosis of electrical power systems that combine the feature extraction capabilities of conditional restricted Boltzmann machine with an efficient classification of deep networks. Computational challenges stemming from the complexities of such deep learning models are overcome by QC-based training methodologies that effectively leverage the complementary strengths of quantum assisted learning and classical training techniques. The proposed hybrid QC-based deep learning framework is tested on a simulated electrical power system with 30 buses and wide variations of substation and transmission line faults, to demonstrate the framework’s applicability, efficiency, and generalization capabilities. High computational efficiency is enjoyed by the proposed hybrid approach in terms of computational effort required and quality of diagnosis performance over classical training methods. In addition, superior and reliable fault diagnosis performance with faster response time is achieved over state-of-the-art pattern recognition methods based on artificial neural networks (ANN) and decision trees (DT).

42 ENGINEERING↗

Digital and optical shape representation and pattern recognition; Proceedings of the Meeting, Orlando, FL, Apr. 4-6, 1988

The present conference discusses topics in pattern-recognition correlator architectures, digital stereo systems, geometric image transformations and their applications, topics in pattern recognition, filter algorithms, object detection and classification, shape representation techniques, and model-based object recognition methods. Attention is given to edge-enhancement preprocessing using liquid crystal TVs, massively-parallel optical data base management, three-dimensional sensing with polar exponential sensor arrays, the optical processing of imaging spectrometer data, hybrid associative memories and metric data models, the representation of shape primitives in neural networks, and the Monte Carlo estimation of moment invariants for pattern recognition.

Juday, Richard D.↗

From Rules to Reasoning: A Survey of Large Language Model-Based Approaches to Scientific Hypothesis and Idea Generation

Scientific hypothesis generation represents a fundamental challenge in contemporary research due to exponentially expanding literature volumes and increasing disciplinary specialization. Large language models (LLMs) have emerged as transformative tools for automated scientific discovery, moving beyond traditional rule-based and literature-mining approaches. Four paradigmatic approaches define current LLM-driven hypothesis generation: direct prompting and fine-tuning methods, knowledge-enhanced frameworks integrating retrieval-augmented generation (RAG), multi-agent collaborative systems simulating research teams, and reasoning-focused approaches implementing cognitive architectures. Domain-specific applications demonstrate statistical equivalence to human expert performance in social psychology, experimental validation in biomedical research, and near-expert quality in astronomy. Evaluation methodologies encompass human expert assessment, LLM-as-judge frameworks, and comprehensive benchmarking systems. Technical challenges include hallucination management, knowledge integration limitations, and balancing novelty with feasibility. Future directions emphasize hybrid neural-symbolic architectures and sophisticated human-AI collaboration models for responsible scientific discovery acceleration.

AI-driven discovery↗

Developing Deep Learning Models for System Remaining Useful Life Predictions: Application to Aircraft Engines

Prognostics and health management (PHM) is an important part of ensuring reliable operations of complex safety- critical systems. System-level remaining useful life (RUL) estimation is a much more complex problem than making estimations at the component level, and system-level RUL methodologies remain sparse in the literature. Model-based approaches have traditionally worked in the past for components such as capacitors, MOSFETs, batteries, or hard-drives (to name a few examples), but developing high fidelity dynamics models of cyber physical systems that can be used to study the effects of multiple degrading components in the system remains a challenging task. Some initial work on model-based System RUL predictions was demonstrated in Khorasgani, et al [1], but, to generalize the system-level prognostics problem, we have to resort to pure data driven and hybrid approaches. In this work, we propose an end-to-end data- driven framework for developing deep learning models to predict remaining useful life of cyber physical systems operating under unknown faulty conditions. The raw data is organized with a data schema that improves the model development process and down stream data analysis tasks. Due to the unknown faulty conditions, the raw sensor data is transformed into signals that expose the underlying degradation processes, which are then used for model development. Bayesian Optimization is used to tune the model parameters prior to training and validation. We show that this approach results in accurate predictions within 3 cycles to end of life (EOL). We demonstrate the effectiveness of our approach by applying it to the N-CMAPSS turbofan engine dataset recently released by NASA, which includes high fidelity degradation modeling, real world operating conditions, and a large set of fault operating modes.

Prognostics↗

Thermomechanical Real-Time Hybrid Simulation: Conceptual Framework and Control Requirements

Real-time hybrid simulation (RTHS) is an enabling technology that has transformed engineering experimentation and helped researchers expand modeling capabilities. However, breakthroughs are necessary to expand the range of hybrid simulation methods and, thus, enable experiments with loading conditions representing multiple hazards. This paper discusses the development of a new thermomechanical RTHS framework and a systematic approach to determining RTHS control requirements. First, the framework is established using a representative finite element model of a layered structural system subjected to thermal loading. A complete two-layer system model serves as the reference system, and it is then partitioned into a numerical layer and an experimental layer that share interface conditions. Next, a thermal actuator is introduced to impose dynamic thermal loading on the experimental subsystem, serving as a transfer system. Finally, control and performance metrics are defined to evaluate the realization of interface boundary conditions and map this to the RTHS execution. Through an illustrative example considering the influence of temperature on a lunar habitat, we demonstrate how to establish controller requirements for RTHS and demonstrate that this approach can be used to conduct RTHS on structures with thermomechanical loading.

Herta Montoya↗