Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Getting a Cohesive Answer from a Common Start: Scalable Multidisciplinary Analysis through Transformation of a System Model

One of the challenges of systems engineering is in working multidisciplinary problems in a cohesive manner. When planning analysis of these problems, system engineers must tradeoff time and cost for analysis quality and quantity. The quality is associated with the fidelity of the multidisciplinary models and the quantity is associated with the design space that can be analyzed. The tradeoff is due to the resource intensive process of creating a cohesive multidisciplinary system model and analysis. Furthermore, reuse or extension of the models used in one stage of a product life cycle for another is a major challenge. Recent developments have enabled a much less resource-intensive and more rigorous approach than handwritten translation scripts or codes of multidisciplinary models and their analyses. The key is to work from a core system model defined in a MOF-based language such as SysML and in leveraging the emerging tool ecosystem, such as Query-View- Transform (QVT), from the OMG community. SysML was designed to model multidisciplinary systems and analyses. The QVT standard was designed to transform SysML models. The Europa Hability Mission (EHM) team has begun to exploit these capabilities. In one case, a Matlab/Simulink model is generated on the fly from a system description for power analysis written in SysML. In a more general case, a symbolic mathematical framework (supported by Wolfram Mathematica) is coordinated by data objects transformed from the system model, enabling extremely flexible and powerful tradespace exploration and analytical investigations of expected system performance.

Cole, Bjorn↗
DOE OSTI2025

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗
DOE OSTI2026

Computing the Critical Temperature of the Affine-Transformed $D=3$ Ising Model Using Masked Autoregressive Flow

The simple Ising model provides a rich environment to build and study lattice field theories. As part of an ongoing project to construct a conformal field theory (CFT) on an arbitrarily curved manifold, in this work we develop methods to measure the critical temperature $β_c$ of the affine-transformed Ising model on the face-centered cubic (FCC) lattice. The main challenge in this endeavor is finding a computationally efficient and accurate method of interpolating and extrapolating Monte Carlo observables with respect to coupling coefficients and temperature. Herein, we compare two such methods. A traditional statistical approach uses the multiple histogram (MH) method, while a newer machine learning approach uses a masked autoregressive flow (MAF) to estimate the underlying probability density function of a set of observables. While the MH method is specifically designed to interpolate and extrapolate Monte Carlo observables, we find that MAF is a viable alternative for measuring $β_c$ with a computational cost that scales more favorably. Furthermore, we comment on additional advantages of MAF relevant to our work, such as extrapolating in system volume.

Svenson, Kai [Texas U.]↗
DOE OSTI2025

Water Mass Transformation Budgets in Finite‐Volume Generalized Vertical Coordinate Ocean Models

Water Mass Transformation (WMT) theory provides conceptual tools that in principle enable innovative analyses of numerical ocean models; in practice, however, these methods can be challenging to implement and interpret, and therefore remain under-utilized. Our aim is to demonstrate the feasibility of diagnosing all terms in the water mass budget and to exemplify their usefulness for scientific inquiry and model development by quantitatively relating water mass changes, overturning circulations, boundary fluxes, and interior mixing. We begin with a pedagogical derivation of key results of classical WMT theory. We then describe best practices for diagnosing each of the water mass budget terms from the output of Finite-Volume Generalized Vertical Coordinate (FV-GVC) ocean models, including the identification of a non-negligible remainder term as the spurious numerical mixing due to advection scheme discretization errors. We illustrate key aspects of the methodology through the analysis of a polygonal region of the Greater Baltic Sea in a regional demonstration simulation using the Modular Ocean Model v6 (MOM6). We verify the convergence of our WMT diagnostics by brute-force, comparing time-averaged (“offline”) diagnostics on various vertical grids to timestep-averaged (“online”) diagnostics on the native model grid. Finally, we briefly describe a stack of xarray-enabled Python packages for evaluating WMT budgets in FV-GVC models (culminating in the new xwmb package), which is intended to be model-agnostic and available for community use and development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Transformer Masked Autoencoders for RF Device Fingerprinting

Machine learning methods for RF device fingerprinting typically rely on CNN-based models. Transformer-based models have outperformed CNNs for modulation classification tasks, but there are few implementations for device fingerprinting. We train a transformer for device fingerprinting with the largest device count to date and explore several variations of the architecture. Additionally, we demonstrate that pre-training an RF transformer as a Masked Autoencoder improves classification accuracy, as has been observed for CNN fingerprinting models and vision transformers.

artificial intelligence↗
DOE OSTI2025

GenAI4UQ: A software for forward and inverse uncertainty quantification using conditional generative AI

We introduce GenAI4UQ, a software package for forward and inverse uncertainty quantification in model calibration, parameter estimation, and ensemble forecasting. GenAI4UQ leverages a generative AI-based conditional modeling framework to address limitations of traditional inverse modeling techniques, such as Markov Chain Monte Carlo (MCMC) methods. By replacing computationally intensive iterative processes with a direct, learned mapping, GenAI4UQ enables efficient calibration of input parameters and generation of predictions directly from observations. The software supports rapid ensemble forecasting with robust uncertainty quantification while maintaining computational and storage efficiency. Built-in auto-tuning of hyperparameters simplifies model training, ensuring accessibility for users with varying expertise. Its versatile conditional generative framework is applicable across diverse scientific domains. While GenAI4UQ offers significant advantages in flexibility and efficiency, users should interpret its uncertainty estimates with caution in data-sparse scenarios, as the model may overestimate uncertainty—an effect common to all surrogate-based approaches including MCMC with surrogate models. Despite this, GenAI4UQ transforms inverse modeling by providing a fast, reliable, and user-friendly solution. It empowers researchers and practitioners to quickly estimate parameter distributions and generate model predictions for new observations, facilitating efficient decision-making and advancing the state of uncertainty quantification in computational modeling.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2024

How the INCOSE Model-Based Capability Matrix Has Steered Model-Based Systems Engineering Transformation at NASA

The National Aeronautics and Space Administration (NASA) is embarking on new, complex, and diverse missions to accomplish its scientific and exploration objectives, and it views digital transformation as a key enabler for those missions. The NASA Model-Based Systems Engineering (MBSE) Lead-ership Team (MLT) is leading the charge in the digital transformation of the systems engineering domain at NASA, and it is using the INCOSE Model-Based Capability Matrix (MBCM) as a roadmap. This paper discusses the modifications and tailoring of the INCOSE MBCM (Hale & Hoheb, 2020) for use at NASA, the process the team has taken on multiple rounds of assessment, findings to date, and work products that have been generated as a result of the assessment. The paper will also discuss findings and potential changes that should be made to the original product.

MBSE↗
DOE OSTI2024

Assessment of Current MACCS Capabilities for Modeling Atmospheric Physical and Chemical Transformations

The physical and chemical transformation during atmospheric transport of radionuclides released into the environment has the possibility of impacting consequence modeling results. Accordingly, this report identifies physical and chemical transformations that may occur following release of chemically reactive radioactive species, how those transformations may affect modeling of consequences of release to the atmosphere and identifies current capabilities – in both MACCS and other state-of-practice atmospheric transport and dispersions models– to model those transformations. It was found that the inclusion of physical and chemical transformations is currently very limited in current state-of-practice codes for atmospheric dispersion of radionuclides. State-of-practice atmospheric dispersion codes appear to be typically limited to simulating either physical-chemical transformations or radioactive transformations, but not both. A state-of-practice atmospheric dispersion code capable of performing parallel physical, chemical, and radioactive transformation was not identified. A few atmospheric dispersion codes capable of modeling physical and chemical transport of specific species such as tritium or uranium hexafluoride were identified. Consequently, there is currently no information available that clearly suggests updates to the MACCS code are needed to bring it up to state-of-practice. However, investigations concluded that the MACCS computational framework can currently accommodate multiple physical/chemical forms in one simulation. Additionally, with some major assumptions, the computational framework in MACCS can accommodate parallel physical-chemical and radioactive transformations.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS1979

Velocity Fourier transform solution of a model collision operator

A simpler technique than those introduced by Lenard and Bernstein (1958), and Dougherty (1964) is employed to obtain the perturbed species density from a specified kinetic equation for a plasma in a given uniform magnetic field. The technique is a generalization of the velocity-Fourier transform method employed by Karpman (1967) for B sub 0 identical to zero, and relies on the fact that in transform space the model collision operator, used to obtain the kinetic equation for waves in a magnetized plasma, contains only first derivatives. The technique is illustrated by evaluating the perturbed density of an arbitrary species.

Catto, P. J.↗
NASA NTRS1990

Fourier transform infrared studies of model polar stratospheric cloud surfaces - Growth and evaporation of ice and nitric acid/ice

Fourier-transform infrared surface studies are used to probe the microphysical properties of nitric acid trihydrate (NAT) and ice films representative of type I and II polar stratospheric clouds (PSC). Experiments indicate that, on initial exposure to 1.8 microtorr of HNO3, a layer of ice is quantitatively converted to NAT. However, conversion of ice to NAT does not proceed indefinitely, but rather the system reaches saturation. For longer exposures or higher HNO3 pressures, NAM becomes the dominant nitric acid containing species on the surface. Evaporation studies were performed to test the feasibility of a recent denitrification mechanism. The results indicate that ice coated with 0.20 micron of NAT evaporates at a temperature of about 4 C higher than uncoated ice.

Tolbert, Margaret A.↗
DOE OSTI2025

Simplified Model and Approach to Transform Infrared Surface Temperature to Film Effectiveness in a Conjugate Heat Transfer Experiment

This paper describes a simplified engineering model based on a one-dimensional thermal resistance network. The model is used to develop a new method to relate film cooling effectiveness and heat transfer augmentation to local overall cooling effectiveness in a conjugate flat plate experiment. This paper presents experimental proof-of-concept data to demonstrate the potential for this model. In contrast to previous approaches, neither the wall heat flux nor the adiabatic wall temperature is required to estimate the local film cooling performance parameters. The model predicts surface temperatures that are within the experimental uncertainties over the range for which the model is trained, and to within five percent when the model is extrapolated to higher coolant channel Reynolds numbers. This paper is relevant to conjugate test rigs that can measure the hot surface temperature distribution with and without film cooling. This information may also be relevant to designers as a method to approximate surface temperatures or used as an approximate heat transfer model for optimization studies.

advanced gas turbines↗
DOE OSTI2025

Computational Analysis and Optimized Modeling of Geomagnetically Induced Currents in Power Transformers

In this project we aim to better understand the effect of geomagnetically induced currents (GIC) on power transformers. Expanding upon our previous work focused on producing a methodology for accuracy-enhanced computation of GIC signatures (i.e., time-domain current magnitude variation for the event duration) from a combination of physics-based and data-driven computational tools, we propose the use of these GIC signatures as inputs for a physically-detailed and optimized model of the power transformer to investigate how GIC determination and transformer modeling influence the evaluation of GIC effects on the transformer operation, as well as in its interaction with the power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1992

Dynamic (computer) modelling of the particulate environment: Transformations from the LDEF reference frame to decode geocentric and interplanetary populations

The Long Duration Exposure Facility (LDEF) impact signature record and the size frequency distribution of craters and perforations offers a unique record of environmental data referenced conveniently to the geocentric reference frame. Chemical analysis of residues can offer only limited assistance. Hence, flux modeling has been developed to transform both geocentric orbital distributions and geocentrically unbounded interplanetary source distributions. This is applied to the foil and crater penetration records in the Ram (E), Trailing (W), and Space Pointing directions to offer the means of decoding the records. It shows that the mix of the components is size dependent. Parametric forms of the modeling transformations are presented for the orbital and unbounded populations.

Mcdonnell, J. A. M.↗
NASA NTRS1991

Dynamic (computer) modelling of the particulate environment: Transformations from the LDEF reference frame to decode geocentric and interplanetary populations

The Long Duration Exposure Facility's impact signature record and the size frequency distribution of craters and perforations offers a unique record of environmental data referenced conveniently to the geocentric reference frame. Chemical analysis of residues can offer only limited assistance. Hence, flux modelling has been developed to transform from both geocentric orbital distributions and geocentrically unbounded interplanetary source distributions. This is applied to the foil and crater penetration records in the Ram (E), Trailing (W), and Space Pointing directions to offer the means of decoding the records. It shows that the mix of the components is size dependent. Parametric forms of the modelling transformations are presented for the orbital and unbound populations.

Mcdonnell, J. A. M.↗
DOE OSTI2024

A Compound Data Poisoning Technique with Significant Adversarial Effects on Transformer-based Sentiment Classification Tasks

Transformer-based models have demonstrated much success in various natural language processing tasks. However, they are often vulnerable to adversarial attacks, such as data poisoning, which can intentionally fool the model into generating incorrect results. In this article, we present a novel, compound variant of a data poisoning attack on a transformer-based model that maximizes the poisoning effect while minimizing the scope of poisoning. Here we do so by combining the established data poisoning technique (label flipping) with a novel adversarial artifact selection and insertion technique aimed at minimizing detectability and the scope of the poisoning footprint. We find that by using a combination of these two techniques, we achieve a state-of-the-art attack success rate of approximately 90% while poisoning only 0.5% of the original training set, thus minimizing the scope and detectability of the poisoning action. These findings have the potential to advance the development of better data poisoning detection methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Simplified Model and Approach to Transform Infrared Surface Temperature to Film Effectiveness in a Conjugate Heat Transfer Experiment

In the pursuit of more efficient gas turbines, film cooling is a critical technology. This article describes a simplified engineering model based on a one-dimensional thermal resistance network. The model is used to relate film-cooling effectiveness and heat transfer augmentation to local overall cooling effectiveness in a conjugate flat plate experiment. Here, this article presents experimental proof-of-concept data to demonstrate the potential for this model. In contrast to previous approaches, neither the wall heat flux nor the adiabatic wall temperature is required to estimate the local film-cooling performance parameters. The model predicts surface temperatures that are within the experimental uncertainties over the range for which the model is trained and to within five percent when the model is extrapolated to higher coolant channel Reynolds numbers. This article is relevant to conjugate test rigs that can measure the hot-surface temperature distribution with and without film cooling. This information may also be relevant to designers as a method to approximate surface temperatures or used as an approximate heat transfer model for optimization studies.

advanced turbines↗
DOE OSTI2025

Developing a digital twin framework for remotely monitoring nuclear reactor facilities

A digital twin must seek to represent all applicable functional components of the system of interest. Different expertise is required for understanding the physical system being modeled than the skills needed for transforming those models into a functional digital twin through physics modeling, machine learning analysis, and visualization. The diversity of knowledge requires a multi-disciplinary team to ensure all system details are captured. Team members also need a method to verify that the data they generate within their domain can be effectively communicated to professionals in other fields. To address this challenge, this work provides an approach for developing a digital twin framework to remotely monitoring nuclear facilities. Through this, general knowledge of the framework is presented along with two examples to solidify the process. The AGN-201 digital twin and microreactor digital twins provide varying levels of complexity in a potential nuclear facility, where common threads are identified and lessons learned are provided. The goal of this research is to aid future researchers by providing a formula for a successful digital twin and in turn reducing the development time of nuclear system digital twins, specifically for remote monitoring.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗