Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Fourier transform methods in local gravity modeling

New algorithms were derived for computing terrain corrections, all components of the attraction of the topography at the topographic surface and the gradients of these attractions. These algoriithms utilize fast Fourier transforms, but, in contrast to methods currently in use, all divergences of the integrals are removed during the analysis. Sequential methods employing a smooth intermediate reference surface were developed to avoid the very large transforms necessary when making computations at high resolution over a wide area. A new method for the numerical solution of Molodensky's problem was developed to mitigate the convergence difficulties that occur at short wavelengths with methods based on a Taylor series expansion. A trial field on a level surface is continued analytically to the topographic surface, and compared with that predicted from gravity observations. The difference is used to compute a correction to the trial field and the process iterated. Special techniques are employed to speed convergence and prevent oscillations. Three different spectral methods for fitting a point-mass set to a gravity field given on a regular grid at constant elevation are described. Two of the methods differ in the way that the spectrum of the point-mass set, which extends to infinite wave number, is matched to that of the gravity field which is band-limited. The third method is essentially a space-domain technique in which Fourier methods are used to solve a set of simultaneous equations.

Harrison, J. C.↗

Domain-specific text embedding model for accelerator physics

Accelerator physics presents unique challenges for natural language processing (NLP) due to its specialized terminology and complex concepts. A key component in overcoming these challenges is the development of robust text embedding models that transform textual data into dense vector representations, facilitating efficient information retrieval and semantic understanding. In this work, we introduce AccPhysBERT, a sentence embedding model fine-tuned specifically for accelerator physics. Our model demonstrates superior performance across a range of downstream NLP tasks, surpassing existing models in capturing the domain-specific nuances of the field. We further showcase its practical applications, including semantic paper-reviewer matching and integration into retrieval-augmented generation systems, highlighting its potential to enhance information retrieval and knowledge discovery in accelerator physics. Published by the American Physical Society 2025

Hellert, Thorsten (ORCID:0000000227970926)↗

MLSPICE: Machine Learning based SPICE Modeling Platform for Power Magnetics

Electrical power converters are critical to a wide range of applications ranging from renewable integration to transportation electrification, and can be a key factor determining the size, weight, and efficiency of energy conversion systems. Magnetic components are typically the largest and least efficient components in power electronics. While there have been major strides in the modeling and analysis of power semiconductor devices and circuit simulations, the necessary advances in the design of power magnetics have lagged. In this project, we have transformed the modeling and design of power magnetics with machine learning enabled methods and catalyze simultaneous disruptive improvements for ML-based power electronics design tools. A fully automated open-source machine learning based magnetics modeling platform – the MagNet project - with innovations in full stack have been developed to greatly accelerate the design process and provide new insights to magnetic material and geometry design. The ARPA-E funded MagNet platform contains three major building blocks: 1) a ML-Integrated Data Acquisition System (MIDAS): a highly automated data acquisition testbed which is capable of measuring a large number of magnetic cores with a wide range of electrical circuit excitations; 2) a ML-integrated Core Loss Model (MICLM): a machine-learning trained modeling method for modeling the core loss and saturation effects of magnetic materials for arbitrary excitation waveforms; 3) ML-guided Magnetics SPICE Simulation Tool (PMSPICE): a fully integrated CAD tool which can simulate the magnetics in SPICE. It can help the designers to quickly model the linear and non-linear characteristics of magnetic components and evaluate their behavior in SPICE simulations. The developed MagNet system has fully demonstrated the proposed performance target and has been open sourced to the entire power electronics community to advance the modeling and design of power magnetics from many different angles.

36 MATERIALS SCIENCE↗

Simulation of intense microwave pulse propagation in air breakdown environment

An experiment is conducted to examine the tail erosion phenomenon which occurs to an intense microwave pulse propagating in air breakdown environment. In the experiment, a 1 MW microwave pulse (1.1 microsec) is transmitted through a large plexiglas chamber filled with dry air at about 1-2 torr pressure. Two different degrees of tail erosion caused by two different mechanisms are identified. This experimental effort leads to the understanding of the fundamental behavior of tail erosion and provides a data base for validating the theoretical model. A theoretical model based on two coupled partial differential equations is established to describe the propagation on an intense microwave pulse in air breakdown environment. One is derived from the Poynting theorem, and the other one is the rate equation of electron density. A semi-empirical formula of the ionization frequency is adopted for this model. A transformation of these two equations to local time frame of reference is introduced so that they can be solved numerically with considerably reduced computation time. This model is tested by using it to perform the computer simulation of the experiment. The numerical results are shown to agree well with the experimental results.

Kuo, S. P.↗

Multiscale Modeling of the Mechanical Response of Silicon Carbide Composite Within the Accelerated Fuel Qualification Framework

The accelerated fuel qualification (AFQ) framework has been used for the initial development of multiscale modeling of silicon carbide (SiC) fiber reinforced composite (SiC-SiC). The AFQ framework provides a methodology to leverage physics-informed multiscale modeling along with a reduced set of empirical test data to reduce the time and cost of licensing and qualification of new nuclear fuel systems while maintaining the overall nuclear power plant safety case. SiC-SiC is being proposed for in-core applications, most notably fuel cladding, for current and next-generation nuclear reactors because of its high temperature stability, irradiation tolerance, and ability to withstand many accident conditions. As these composites exhibit multiscale architectures and complex microstructure-based fracture mechanics, it is an appealing use case for the AFQ methodology. While the end goal of this work is a single multiscale model that can be used for predictive in-core performance, current focus is on the individual various length scale models. Four individual models have been initially developed from microscale to engineering system level to capture key physics-based effects across different length scales. These models include a microscale homogenized tow model, a mesoscale fast Fourier transform–based weave model that integrates the homogenized tow model, a mesoscale finite element–based weave model, and a system-level BISON fuel performance model. Results of these models have undergone an initial comparison with separate-effects test data showing a good match to experimental results. By using the AFQ framework during model development, several near-term benefits have been secured including a reduction in development time for the SiC-SiC cladding, more targeted irradiation testing, and a better understanding of uncertainty.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Architecting a Simulation Framework for Model Rehosting

The utility of vehicle math models extends beyond human-in-the-loop simulation. It is desirable to deploy a given model across a multitude of applications that target design, analysis, and research. However, the vehicle model alone represents an incomplete simulation. One must also replicate the environment models (e.g., atmosphere, gravity, terrain) to achieve identical vehicle behavior across all applications. Environment models are increasing in complexity and represent a substantial investment to re-engineer for a new application. A software component that can be rehosted in each application is one solution to the deployment problem. The component must encapsulate both the vehicle and environment models. The component must have a well-defined interface that abstracts the bulk of the logic to operate the models. This paper examines the characteristics of a rehostable modeling component from the perspective of a human-in-the-loop simulation framework. The Langley Standard Real-Time Simulation in C++ (LaSRS++) is used as an example. LaSRS++ was recently redesigned to transform its modeling package into a rehostable component.

Madden, Michael M.↗

A foundation model for atomistic materials chemistry

Atomistic simulations of matter, especially those that leverage first-principles (ab initio) electronic structure theory, provide a microscopic view of the world, underpinning much of our understanding of chemistry and materials science. Over the last decade or so, machine-learned force fields have transformed atomistic modeling by enabling simulations of ab initio quality over unprecedented time and length scales. However, early machine-learning (ML) force fields have largely been limited by (i) the substantial computational and human effort required to develop and validate potentials for each particular system of interest and (ii) a general lack of transferability from one chemical system to the next. Here, we show that it is possible to create a general-purpose atomistic ML model, trained on a public dataset of moderate size, that is capable of running stable molecular dynamics for a wide range of molecules and materials. We demonstrate the power of the MACE-MP-0 model-and its qualitative and at times quantitative accuracy-on a diverse set of problems in the physical sciences, including properties of solids, liquids, gases, chemical reactions, interfaces, and even the dynamics of a small protein. The model can be applied out of the box as a starting or "foundation" model for any atomistic system of interest and, when desired, can be fine-tuned on just a handful of application-specific data points to reach ab initio accuracy. Establishing that a stable force-field model can cover almost all materials changes atomistic modeling in a fundamental way: experienced users obtain reliable results much faster, and beginners face a lower barrier to entry. Foundation models thus represent a step toward democratizing the revolution in atomic-scale modeling that has been brought about by ML force fields.

Batatia, Ilyes↗

Environmental Impact Specification for Direct Space Weathering of Kuiper Belt and Oort Cloud Objects

The Direct Space Weathering Project of NASA's Outer Planets Research Program addresses specification of the plasma and energetic particle environments for irradiation and surface chemical processing of icy bodies in the outer solar system and the local interstellar medium. Knowledge of the radiation environments is being expanded by ongoing penetration of the twin Voyager spacecraft into the heliosheath boundary region of the outer heliosphere and expected emergence within the next decade into the very local interstellar medium. The Voyager measurements are being supplemented by remote sensing from Earth orbit of energetic neutral atom emission from this boundary region by NASA's Interstellar Boundary Explorer (IBEX). Although the Voyagers long ago passed the region of the Classical Kuiper Belt, the New Horizons spacecraft will encounter Pluto in 2015 and thereafter explore one or more KBOs, meanwhile providing updated measurements of the heliospheric radiation environment in this region. Modeling of ion transport within the heliosphere allows specification of time-integrated irradiation effects while the combination of Voyager and IBEX data supports projection of the in-situ measurements into interstellar space beyond the heliosheath. Transformation of model ion flux distributions into surface sputtering and volume ionization profiles provides a multi-layer perspective for space weathering impact on the affected icy bodies and may account for some aspects of color and compositional diversity. Other important related factors may include surface erosion and gardening by meteoritic impacts and surface renewal by cryovolcanism. Chemical products of space weathering may contribute to energy resources for the latter.

Cooper, John F.↗

Genetic Algorithm-Guided, Adaptive Model Order Reduction of Flexible Aircrafts

This paper presents a methodology for automated model order reduction (MOR) of flexible aircrafts to construct linear parameter-varying (LPV) reduced order models (ROM) for aeroservoelasticity (ASE) analysis and control synthesis in broad flight parameter space. The novelty includes utilization of genetic algorithms (GAs) to automatically determine the states for reduction while minimizing the trial-and-error process and heuristics requirement to perform MOR; balanced truncation for unstable systems to achieve locally optimal realization of the full model; congruence transformation for "weak" fulfillment of state consistency across the entire flight parameter space; and ROM interpolation based on adaptive grid refinement to generate a globally functional LPV ASE ROM. The methodology is applied to the X-56A MUTT model currently being tested at NASA/AFRC for flutter suppression and gust load alleviation. Our studies indicate that X-56A ROM with less than one-seventh the number of states relative to the original model is able to accurately predict system response among all input-output channels for pitch, roll, and ASE control at various flight conditions. The GA-guided approach exceeds manual and empirical state selection in terms of efficiency and accuracy. The adaptive refinement allows selective addition of the grid points in the parameter space where flight dynamics varies dramatically to enhance interpolation accuracy without over-burdening controller synthesis and onboard memory efforts downstream. The present MOR framework can be used by control engineers for robust ASE controller synthesis and novel vehicle design.

Numerical Analysi↗

Effects of vegetation on passive microwave estimates of soil moisture

Data collected over plots using a microwave radiometer with a wavelength of 21 cm were used to evaluate a theoretical model of the effect of vegetative cover on the emission of soils. The theoretical model was used as a basis of a simplified model which predicts the emissivity of a soil-vegetation complex with a full canopy cover. This model, when transformed to predict soil moisture, requires measurements of the microwave brightness temperature, surface temperature and vegetation biomass. Since surface temperature can be determined using thermal infrared measurements and vegetation biomass could be estimated with visible and near infrared measurements, the simplified model could be applied using only remotely sensed data.

Jackson, T. J.↗

Performance of FFT methods in local gravity field modelling

Fast Fourier transform (FFT) methods provide a fast and efficient means of processing large amounts of gravity or geoid data in local gravity field modelling. The FFT methods, however, has a number of theoretical and practical limitations, especially the use of flat-earth approximation, and the requirements for gridded data. In spite of this the method often yields excellent results in practice when compared to other more rigorous (and computationally expensive) methods, such as least-squares collocation. The good performance of the FFT methods illustrate that the theoretical approximations are offset by the capability of taking into account more data in larger areas, especially important for geoid predictions. For best results good data gridding algorithms are essential. In practice truncated collocation approaches may be used. For large areas at high latitudes the gridding must be done using suitable map projections such as UTM, to avoid trivial errors caused by the meridian convergence. The FFT methods are compared to ground truth data in New Mexico (xi, eta from delta g), Scandinavia (N from delta g, the geoid fits to 15 cm over 2000 km), and areas of the Atlantic (delta g from satellite altimetry using Wiener filtering). In all cases the FFT methods yields results comparable or superior to other methods.

Forsberg, Rene↗

BioRT‐HBV 1.0: A Biogeochemical Reactive Transport Model at the Watershed Scale

Abstract Reactive Transport Models (RTMs) are essential tools for understanding and predicting intertwined ecohydrological and biogeochemical processes on land and in rivers. While traditional RTMs have focused primarily on subsurface processes, recent watershed‐scale RTMs have integrated ecohydrological and biogeochemical interactions between surface and subsurface. These emergent, watershed‐scale RTMs are often spatially explicit and require extensive data, computational power, and computational expertise. There is however a pressing need to create parsimonious models that require minimal data and are accessible to scientists with limited computational background. To that end, we have developed BioRT‐HBV 1.0, a watershed‐scale, hydro‐biogeochemical RTM that builds upon the widely used, bucket‐type HBV model known for its simplicity and minimal data requirements. BioRT‐HBV uses the conceptual structure and hydrology output of HBV to simulate processes including advective solute transport and biogeochemical reactions that depend on reaction thermodynamics and kinetics. These reactions include, for example, chemical weathering, soil respiration, and nutrient transformation. The model uses time series of weather (air temperature, precipitation, and potential evapotranspiration) and initial biogeochemical conditions of subsurface water, soils, and rocks as input, and output times series of reaction rates and solute concentrations in subsurface waters and rivers. This paper presents the model structure and governing equations and demonstrates its utility with examples simulating carbon and nitrogen processes in a headwater catchment. As shown in the examples, BioRT‐HBV can be used to illuminate the dynamics of biogeochemical reactions in the invisible, arduous‐to‐measure subsurface, and their influence on the observed stream or river chemistry and solute export. With its parsimonious structure and easy‐to‐use graphical user interface, BioRT‐HBV can be a useful research tool for users without in‐depth computational training. It can additionally serve as an educational tool that promotes pollination of ideas across disciplines and foster a diverse, equal, and inclusive user community.

Sadayappan, Kayalvizhi↗

A comparison between the current models of mid-latitude spread F and data from the Arecibo Observatory

The current models of mid-latitude F sub s are studied. The assumptions and derivations of the Reid model, the Scannapieco model, and the Perkins model are presented in detail. Incoherent-scatter data of the density profiles and velocity profiles were obtained in order that the models could be evaluated on the basis of experimental data. Initial studies indicated that the Perkins model was most representative of the data from Arecibo, so a detailed comparison of the predictions of the Perkins model and the data was made. Two of four nights studied are nights with F sub s. The Perkins model is derived in a frame of reference moving with the velocity of the neutral wind; the model is transformed to the rest frame to facilitate comparison with data. Several data handling techniques are introduced. In particular, an integration interval that remains constant in length, but follows the vertical motion of the peak of the F layer is used to obtain the field integrated quantities of the Perkins model.

Imel, G.↗

Using a Simple Water Balance Framework to Quantify the Impact of Soil Moisture Initialization on Subseasonal Evapotranspiration and Air Temperature Forecasts

Past studies have shown that accurate soil moisture initialization can contribute significant skill to near-surface air temperature (T2M) forecasts at subseasonal leads. The mechanisms by which soil moisture contributes such skill are examined here with a simple water balance-based model that captures the essence of soil moisture behavior in a state-of-the-art subseasonal-to-seasonal (S2S) forecasting system. The simple model successfully transforms initial soil moisture contents into average “forecasted” ET values at 16-30 day lead that agree well, during summer, with the values forecasted by the full NASA GEOS S2S system, indicating that soil moisture initialization dominates over forecasted meteorology in determining ET fluxes at subseasonal leads. When the simple model’s ET anomalies are interpreted in terms of T2M anomalies, a similar conclusion is reached for T2M: soil moisture initialization explains much (about 50% in the eastern half of the continental US) of the T2M anomalies produced by the full GEOS S2S system at 16-30 day lead, and the T2M forecasts produced by the simple model capture about half of the skill attained by the full system. The simple model’s framework is particularly conducive to an analysis of uncertainty in forecasts. Drier soils are generally found to induce larger uncertainty in ET (and thus T2M) forecasts, a result linked to the functional form relating ET to soil moisture in the simple model and verified by an analysis of the ensemble spreads within the forecasts produced by the full GEOS S2S system

Randal D Koster↗

Model compilation: An approach to automated model derivation

An approach is introduced to automated model derivation for knowledge based systems. The approach, model compilation, involves procedurally generating the set of domain models used by a knowledge based system. With an implemented example, how this approach can be used to derive models of different precision and abstraction is illustrated, and models are tailored to different tasks, from a given set of base domain models. In particular, two implemented model compilers are described, each of which takes as input a base model that describes the structure and behavior of a simple electromechanical device, the Reaction Wheel Assembly of NASA's Hubble Space Telescope. The compilers transform this relatively general base model into simple task specific models for troubleshooting and redesign, respectively, by applying a sequence of model transformations. Each transformation in this sequence produces an increasingly more specialized model. The compilation approach lessens the burden of updating and maintaining consistency among models by enabling their automatic regeneration.

Keller, Richard M.↗

Uncertainty Modeling for Robustness Analysis of Control Upset Prevention and Recovery Systems

Formal robustness analysis of aircraft control upset prevention and recovery systems could play an important role in their validation and ultimate certification. Such systems (developed for failure detection, identification, and reconfiguration, as well as upset recovery) need to be evaluated over broad regions of the flight envelope and under extreme flight conditions, and should include various sources of uncertainty. However, formulation of linear fractional transformation (LFT) models for representing system uncertainty can be very difficult for complex parameter-dependent systems. This paper describes a preliminary LFT modeling software tool which uses a matrix-based computational approach that can be directly applied to parametric uncertainty problems involving multivariate matrix polynomial dependencies. Several examples are presented (including an F-16 at an extreme flight condition, a missile model, and a generic example with numerous crossproduct terms), and comparisons are given with other LFT modeling tools that are currently available. The LFT modeling method and preliminary software tool presented in this paper are shown to compare favorably with these methods.

Belcastro, Christine M.↗

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning↗

Performance Dependences of Multiplication Layer Thickness for InP/InGaAs Avalanche Photodiodes Based on Time Domain Modeling

InP/InGaAs avalanche photodiodes (APDs) are being widely utilized in optical receivers for modern long haul and high bit-rate optical fiber communication systems. The separate absorption, grading, charge, and multiplication (SAGCM) structure is an important design consideration for APDs with high performance characteristics. Time domain modeling techniques have been previously developed to provide better understanding and optimize design issues by saving time and cost for the APD research and development. In this work, performance dependences on multiplication layer thickness have been investigated by time domain modeling. These performance characteristics include breakdown field and breakdown voltage, multiplication gain, excess noise factor, frequency response and bandwidth etc. The simulations are performed versus various multiplication layer thicknesses with certain fixed values for the areal charge sheet density whereas the values for the other structure and material parameters are kept unchanged. The frequency response is obtained from the impulse response by fast Fourier transformation. The modeling results are presented and discussed, and design considerations, especially for high speed operation at 10 Gbit/s, are further analyzed.

Xiao, Yegao↗