SEARCH · Search NASA

Results for “Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Predicting Atomistic Transitions with Transformers

Accurate knowledge of the atomistic transition pathways in materials and material surfaces is crucial for many material science problems. However, conventional simulation techniques used to find these transitions are extremely computationally intensive. Even with large-scale, accelerated material simulations, the computational cost constrains the applicable domain in practice. Machine learning models, with the potential to learn the complex emergent behaviors governing atomistic transitions as a fast surrogate model, have great promise to predict transitions with a vastly reduced computational cost. Here, we demonstrate how transformers can be trained to predict atomistic transitions in nano-clusters. We show how we evaluate physical validity of the predictions and how a multitude of additional, different microstates can be generated by slightly varying the data provided to the model.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Computational prediction of dielectric breakdown strength of a transformer paper in oil with uncertainty quantification

The determination of the dielectric breakdown strengths of microstructurally heterogeneous materials has been a primarily experimental endeavor. We report the development of a microstructure-level model for computationally predicting the breakdown strength and analyzing the interactions between electromagnetic pulses (EMP) and the constituents in a composite of cellulose-based paper and mineral oil found in electrical transformers. The model allows explicit simulation of the material breakdown process by tracking the transition of dielectric constituents from non-conductive to conductive states. The focus is on the electric fields induced in the materials and the overall conditions for dielectric breakdown (defined as the onset of avalanche) caused by the electric field induced in the composite. Responses to three distinct pulse shapes, i.e., Steep Front (SF), Lightning (L), and AC with spectra spanning 60–9 × 105 Hz are considered. It is found that the breakdown strength of the material is significantly affected by microstructure heterogeneities, the spatial variations of the constituent properties, and the pulse shapes. A probabilistic characterization of the breakdown strength is computationally obtained and compared with experimental measurements. Although one particular material is analyzed, the model and approach are applicable to other heterogeneous materials as well.

breakdowns↗

DOE OSTI2026

MATEY: multiscale adaptive transformer models for spatiotemporal physical systems

Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two novel adaptive tokenization schemes that dynamically adjust patch sizes based on local features: one ensures convergent behavior to uniform patch refinement, while the other offers better computational efficiency. Moreover, we present a set of spatiotemporal attention schemes, where the temporal or axial spatial dimensions are decoupled, to evaluate their baseline computational and data efficiencies and to determine whether adaptive tokenization can improve this performance. We assess the performance of the proposed multiscale adaptive model, MATEY, in a sequence of experiments. Compared to a full spatiotemporal attention scheme or a scheme that decouples only the temporal dimension, we find that fully decoupled axial attention is less efficient and expressive, requiring more training time and model parameters to achieve the same accuracy. The experiments on the adaptive tokenization schemes show that, compared to a uniformly refined model, the proposed schemes achieve comparable or improved accuracy at a much lower cost in the tested two-dimensional settings. While the asymptotic analysis suggests the potential for favorable scaling, empirical validation at substantially longer sequence lengths remains to be performed in future work. Finally, we demonstrate in two fine-tuning tasks featuring different physics that models pretrained on PDEBench data outperform the ones trained from scratch, especially in the low data regime with frozen attention.

adaptive tokenization↗

DOE OSTI2024

Anticipating Technical Expertise and Capability Evolution in Research Communities Using Dynamic Graph Transformers

The ability to anticipate global technical expertise and capability evolution trends is essential for national and global security, especially in safety-critical domains such as nuclear nonproliferation (NN) and rapidly emerging fields like artificial intelligence (AI). Here, in this work, we extend traditional statistical relational learning approaches (e.g., link prediction in collaboration networks) and formulate a problem of anticipating technical expertise and capability evolution using dynamic heterogeneous graph representations. We develop novel capabilities to forecast collaboration patterns, authorship behavior, and technical capability evolution at different granularities (e.g., scientist and institution levels) in two distinct research fields. We implement a dynamic graph transformer (DGT) neural architecture, which pushes the state-of-the-art graph neural network models by: 1) forecasting heterogeneous (rather than homogeneous) nodes and edges; and 2) relying on both discrete- and continuous-time inputs. We demonstrate that our DGT models predict collaboration, partnership, and expertise patterns with 0.26, 0.73, and 0.53 mean reciprocal rank values for AI and 0.48, 0.93, and 0.22 for NN domains. DGT model performance exceeds the best-performing static graph baseline models by 30%–80% across AI and NN domains. Our findings demonstrate that DGT models boost inductive task performance when previously unseen nodes appear in the test data for the domains with emerging collaboration patterns (e.g., AI). Specifically, models accurately predict which established scientists will collaborate with early career scientists and vice versa in the AI domain.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗

DOE OSTI2025

A Class of Sparse Johnson–Lindenstrauss Transforms and Analysis of their Extreme Singular Values

The Johnson–Lindenstrauss (JL) lemma is a powerful tool for dimensionality reduction in modern algorithm design. The lemma states that any set of high-dimensional points in a Euclidean space can be projected into lower dimensions while approximately preserving pairwise Euclidean distances. Random matrices satisfying this lemma are called JL transforms (JLTs). Inspired by existing $s$-hashing JLTs with exactly $s$ nonzero elements on each column, the present work introduces an ensemble of sparse matrices encompassing so-called $s$-hashing-like matrices whose expected number of nonzero elements on each column is $s$. The independence of the sub-Gaussian entries of these matrices and the knowledge of their exact distribution play an important role in their analyses. Using properties of independent sub-Gaussian random variables, these matrices are demonstrated to be JLTs, and their smallest nontrivial singular values and largest singular values are estimated nonasymptotically using a technique from geometric functional analysis. As the dimensions of the matrix grow to infinity, these singular values are proved to converge almost surely to fixed quantities (by using the universal Bai–Yin law) and in distribution to the Gaussian orthogonal ensemble Tracy–Widom law after proper rescalings. Understanding the behaviors of extreme singular values is important in general because they are often used to define a measure of stability of matrix algorithms. For example, JLTs were recently used in derivative-free optimization algorithmic frameworks to select random subspaces in which are constructed random models or poll directions to achieve scalability, and hence estimating their smallest singular value in particular helps determine the dimension of these subspaces.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

High resolution characterization of soil dissolved organic matter with FTICR-MS (Fourier-transform ion cyclotron resonance mass spectrometry) from soil samples in control and warming plots in Blodgett Forest, CA (2014 and 2018)

The pathways of carbon transport and loss through and from soils—soil organic matter (SOM) depolymerization to dissolved organic carbon and mineralization to carbon dioxide (CO2)—are fundamentally driven by microbial activity, which is strongly regulated by environmental conditions. As part of Lawrence Berkeley National Laboratory (LBNL) Terrestrial Ecosystem Science (TES) Belowground Biogeochemistry Science Focus Area (SFA), we have established a novel whole-soil long-term warming experiment at the University of California (UC) Blodgett Forest Research Station (Sierra Nevada) in 2014, where we study the role of biogeochemical, microbial and geochemical process interactions in SOM decomposition and stabilization.This package contains Fourier transform ion cyclotron resonance mass spectrometry (21 Tesla FTICR-MS) data measured in negative and positive ionization mode from water and methanol soil extracts. Soil samples were collected in 2014/06/03 and 2018/06/04 from 3 replicated paired plots that had been subjected to experimental warming since June 2014 to simulate a predicted climate change scenario for northern California. The following files are included: (1) fticr_neg_h2oMeoh_data_raw.csv: raw data from combined water (H2O) and methanol (MeOH) extracts in negative ion mode, (2) fticr_neg_h2oMeoh_data_processed.csv: processed data from combined water (H2O) and methanol (MeOH) extracts in negative ion mode, (3) fticr_neg_metadata.csv: metadata for samples/measurements in negative ion mode, (4) fticr_pos_h2oMeoh_data_raw.csv: raw data from combined water (H2O) and methanol (MeOH) extracts in positive ion mode, (5) fticr_pos_h2oMeoh_data_processed.csv: processed data from combined water (H2O) and methanol (MeOH) extracts in positive ion mode, (6) fticr_pos_metadata.csv: metadata for samples/measurements in positive ion mode.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

A Scalable Test-Bed for Direct Current Current Transformer Automated Functional Testing and Characterization

This article describes a scalable test-bed for automation of measurements of the direct current current transformers (DCCT). Automation of measurement involves functional measurements, fault event based measurements and data validation. The test-bed is designed to measure up to 20 DCCTs at a time with software based measurement repetition checks and validation of the measurements.

43 PARTICLE ACCELERATORS↗

DOE OSTI2026

Large Power Transformer Supply Chain Gap Analysis and Domestic Content Strategies for Hydropower Rehabilitation: Supplemental Report

Large Power Transformers (LPTs) are indispensable to U.S. hydropower operations, serving as generator step-up (GSU) units that interconnect hydro facilities to the transmission grid. Yet the LPT supply chain faces mounting stress from aging infrastructure, limited domestic production, and long lead times. Currently, more than 80% of LPT demand is met through imports, with primary suppliers including Mexico, South Korea, Brazil, Austria, and Canada. Domestic manufacturers supply only about 20% of units, constrained by bottlenecks in high-grade Grain-Oriented Electrical Steel (GOES), copper conductors, bushings, and on-load tap changers (OLTCs). Hydropower rehabilitation projects in particular face additional challenges due to custom design requirements, remote siting, and regulatory needs around domestic content. Regional cost disparities, driven by transportation logistics, labor markets, and import price volatility, further exacerbate project risks. To address these vulnerabilities, coordinated action is required: strengthening domestic capacity for GOES and secondary components, developing near-site assembly hubs, and leveraging IRS domestic content safe harbors to incentivize U.S. manufacturing. This addendum refines the 2024 NREL Hydropower Supply Chain Gap Analysis by focusing specifically on critical issues related to LPT domestic manufacturing capacity and key considerations for hydropower developers and asset owners.

13 HYDRO ENERGY↗

DOE OSTI2025

Solid State Transformer Controls for Mitigation of E3a High-Altitude Electromagnetic Pulse Insults

This paper explores the use of a solid state transformer (SST) to mitigate the 𝐸 3𝐴 component of a high-altitude electromagnetic pulse (HEMP) insult using external energy storage optimal control techniques. In lieu of conventional passive blocking devices or feedback-controlled energy storage devices, a novel implementation of Hamiltonian error tracking is utilized to develop a feedback control law for the variable converter ratio in an SST. The findings of the simulations performed in this paper suggest that additional energy storage is not necessary to protect an individual load from a HEMP insult. The simulations performed examine the response of a single-phase SST connected to a single voltage source on a long transmission line on the one side and a single linear resistor on the other. The control law is specifically developed for the late-time, low-frequency portion of a HEMP insult, namely the 𝐸 3𝐴 components. The Hamiltonian error-based converter ratio control law is compared with nonlinear optimal feedforward controls to show that the HSSPFC is an external energy storage optimal controller.

HEMP mitigation↗

DOE OSTI2026

MTL_TX: A Multi-Task Transformer Model for Improved Radiation Time-Series Estimation

Controlling radiation doses at potential radioactive facilities is critical to ensuring the safety of both personnel and the public. At the Thomas Jefferson National Accelerator Facility (JLab), multiple sensors are deployed around the three experimental halls to monitor key parameters, including single-beam current, energy levels, current leakage, and radiation values during accelerator operations. In this study, we developed a Multi-task Transformer model, MTL_TX, to accurately estimate radiation doses at sensor locations based on historical data, with the aim of enhancing safety in accelerator facilities and surrounding public areas. To improve estimation accuracy, we integrated two innovative components into the proposed model: hierarchical feature embedding (HFE) and multi-level decomposition attention (MDA). Additionally, the multi-task learning (MTL) framework effectively leverages correlations among multiple sensors, enabling individual estimations for each sensor. MTL_TX achieved outstanding results on data collected in 2018, with an MSE of 0.1464, an RMSE of 0.2353, and an R 2 score of 0.8584. Furthermore, when trained on 2018 data, MTL_TX exhibited excellent generalization capability to unseen datasets from 2016 to 2019, achieving an MSE of 0.1407, an RMSE of 0.2263, and an R 2 score of 0.8831. These results demonstrate a significant improvement over existing state-of-the-art models.

Transformer↗

DOE OSTI2026

Hidden Rotation Symmetry of the Jordan–Wigner Transformation and Its Application to Measurement in Quantum Computation

Using a global rotation by 𝜃 about the z-axis in the spin sector of the Jordan–Wigner transformation rotates Pauli matrices 𝑋̂ and 𝑌̂ in the 𝑥−𝑦 -plane, while it adds a global complex phase to fermionic quantum states that have a fixed number of particles. With the right choice of angles, this relates expectation values of Pauli strings containing products of 𝑋̂ and 𝑌̂ to different products, which can be employed to reduce the number of measurements needed when simulating fermionic systems on a quantum computer. Here, we derive this symmetry and show how it can be applied to systems in Physics and Chemistry that involve Hamiltonians with only single-particle (hopping) and two-particle (interaction) terms. We also discuss the consequences of this for finding efficient measurement circuits in variational ground state preparation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Advanced Flexible Transformers

Advanced grid solutions are comprised of advanced transmission technologies and grid enhancing technologies. In this webinar, experts will provide participants with insights into eight advanced grid solutions. The advanced transmission technologies that will be discussed include point-to-point high voltage direct current and advanced conductoring and the grid enhancing technologies that experts will explore include topology optimization, advanced power flow control, dynamic line rating, energy storage, virtual power plants, and advanced flexible transformers

flexible power transformer, power flow controller,↗

DOE OSTI2025

Geothermal well testing pressure prediction by using a hybrid transformer model system: FORGE well use case

Geothermal has huge potential to become an indispensable component in achieving the goal of sustainable energy economy, given its capability to provide consistent baseload power to the electric grid. Injection tests are crucial in geothermal energy system as they naturally help to evaluate reservoir properties, understand fluid flow and even enhance reservoir performance. In this research, we developed a hybrid model system that integrates machine learning (ML) regression, a physics-based mathematical model, and transformer deep learning. Trained and validated using FORGE injection test dataset, this system can forecast the pressure variations both upward and downward over time. The pressure prediction achieved prediction accuracy within 3-6% variance of true pressure values. The system can significantly save time and reduce costs by testing only a few cycles and then using model predictions for further analysis, instead of conducting additional real injection cycle tests. The developed model system also holds promise for designing injection test processes and maintaining well production in geothermal energy. Presented at the IMAGE ‘25 Conference led by Shell.

FORGE↗

DOE OSTI2026

Affine Transformations to Correlate Experimental and Simulated EDS Spectra for Multi-Element Systems

Energy Dispersive X-ray Spectroscopy (EDS) is an essential technique for determining elemental concentrations and distributions within microstructures, critical for materials discovery, optimization, and qualification. However, most published EDS data is qualitative because current quantitative EDS analysis methods require extensive calibration and post-processing, limiting their practicality and widespread adoption. This work seeks to establish a framework for accelerated EDS characterization and spectrum analysis that can leverage ML to analyze correlations between various elemental compositions and resulting EDS spectra. The complex physics and data result in a high-dimensional problem that grows exponentially with the number of elements in the system and the complexity of the spectrum analysis. ML provides a way to compute and optimize the results of this highly dimensional problem in a flexible way to tailor it to the user’s specific needs and material system. However, the framework emphasizes transparency through a strictly mathematical affine transformation, so the analysis remains understandable and reviewable to facilitate adoption by the scientific community. While currently implemented methods are simplistic and unvalidated, further development and demonstration of this framework could enable high-throughput, accurate, and accessible EDS characterization.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Electronic Excitation‐Driven β‐Ga 2 O 3 Metastability Transformation and Self‐Organization Mechanism: β→κ/γ/δ Phases

Here, irradiation-driven multiphase self-organization presents emergent opportunities for the customization of nanoscale engineering properties, dynamically tuning strain-field distributions and interfacial electronic structures. Responding to intense electronic excitation-induced energy deposition, the dominant phase transformations, with varying Gibbs free energy $Δ,G^o_f$ are confirmed as β → κ → γ → δ that are located in specific microregions for Gallium (III) oxide (Ga 2 O 3 ), as follows: (i) Surface-localized interstitial accumulation under compressive stress triggers β → δ via semi-coherent interface formation. (ii) Tensile stress within latent tracks drives vacancy-mediated oxygen layer truncation (4/12 periodicity along ⟨0001⟩), stabilizing coherent 4H (ABCB) κ and 3C (ABC) β (ABC) interfaces through strain-compensated octahedral distortion. (iii) Screw dislocation-mediated lattice relaxation induces β → γ via cation disordering (Ga 3+ occupancy at β-interstitial sites), forming metastable spinel γ with mixed occupancy across 16d/8a Wyckoff sites. Irradiation-driven β-Ga 2 O 3 →κ/γ/δ transitions, as mechanistically revealed via inelastic thermal spike (i-TS) calculations and molecular dynamics simulations, induce defect-mediated nonlinear photoresponse, critical for optoelectronic engineering.

Han, Xinqing [Shandong Univ., Jinan (China)]↗

DOE OSTI2026

Phase Transformation and Water Adsorption Behavior of As‐Deposited and Annealed Ru Metal Thin Films Prepared by Atomic Layer Deposition

ABSTRACT Surfaces play a central role in catalytic processes, and understanding the transformation of ruthenium metal into ruthenium oxide during annealing is essential for tailoring functional catalytic interfaces. In this study, we systematically investigate ≈22 nm thick Ru metal films deposited by atomic layer deposition (ALD) at 300°C, focusing on their chemical composition, structural evolution, and surface hydration behavior following post‐deposition annealing in air from 400 to 600°C. Lab‐based and synchrotron X‐ray photoelectron spectroscopy (XPS) reveal a gradual conversion from metallic Ru to fully oxidized Ru 4+ with increasing annealing temperature, accompanied by a corresponding increase in lattice oxygen. X‐ray diffraction (XRD) shows amorphous Ru oxide phases at 400°C and 500°C that evolve into crystalline RuO 2 at 600°C, while atomic force microscopy (AFM) indicates enhanced grain growth and surface roughening upon annealing. Ambient‐pressure XPS (AP‐XPS) under controlled H 2 O vapor environments (1–17 Torr) demonstrates that samples annealed at 400°C and 500°C exhibit initially high hydroxyl coverage that decreases with increasing water vapor pressure, concurrent with a rise in molecular H 2 O adsorption. In contrast, the crystalline RuO 2 surface formed at 600°C maintains stable hydroxylation and supports increased water uptake. Overall, this work provides fundamental insight into Ru oxide–H 2 O interactions and establishes design principles for engineering oxide surfaces optimized for electrocatalytic applications.

APXPS↗