Search NASA⌕ Search

SEARCH · Search NASA

Results for “transform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Physics-informed transformation toward improving the machine-learned NLTE models of ICF simulations

The integration of machine-learning techniques into inertial confinement fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By replacing the costly nonlocal thermodynamic equilibrium (NLTE) model with machine-learning models, significant reductions in calculation time have been achieved. However, determining how to optimize machine-learning-based NLTE models in order to match ICF simulation dynamics remains challenging, underscoring the need for physically relevant error metrics and strategies to enhance model accuracy with respect to these metrics. Thus, we propose novel physics-informed transformations designed to emphasize energy transport, use these transformations to establish new error metrics, and demonstrate that they yield smaller errors within reduced principal-component spaces compared to conventional transformations. Published by the American Physical Society 2025

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

A low-temperature, one-step synthesis for monazite can transform monazite into a readily usable advanced nuclear waste form

It has been demonstrated that monazite-type materials are excellent candidates for nuclear waste forms, and hence, their facile synthesis is of great importance for the needed sequestration of existing nuclear waste. The synthesis of monazite, LaPO 4 , requires inconveniently high temperatures near 1000°C and generally involves the conversion of the presynthesized rhabdophane, LaPO 4 •nH 2 O, to the LaPO 4 monazite phase. During this structure transformation, the rhabdophane converts irreversibly to the thermodynamically stable monoclinic monazite structure. A low-temperature (185° to 260°C) mild hydrothermal acid-promoted synthesis of monazite is described that can both transform presynthesized rhabdophane or assemble reagents to the monoclinic monazite structure. The pH dependence of this reaction is detailed, and its applicability to the LnPO 4 (Ln = La, Ce, Pr, Nd, Sm-Gd), Ca 0.5 Th 0.5 PO 4 , and Sr 0.5 Th 0.5 PO 4 systems is discussed. The crystal growth of Ca 0.5 Th 0.5 PO 4 and Sr 0.5 Th 0.5 PO 4 is described, and their crystal structures were reported. In situ x-ray diffraction studies, performed as a function of temperature, provide insight into the structure transformation process.

Biogeochemistry↗
DOE OSTI2026

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗
DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗
DOE OSTI2025

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2024

CurvilinearGrids.jl: A Julia package for curvilinear coordinate transformations

Finite-difference discretizations of partial differential equations are widespread throughout the scientific community. Oftentimes finite-differences are used to compute spatial gradients of fields on a discrete grid, which is typically a uniform or rectilinear Cartesian mesh. Arbitrary multidimensional geometry is difficult to discretize directly with finite differences, however, due to non-uniform grid spacing and non-orthogonality. Curvilinear coordinate transformations can be used as a strategy to enable arbitrary geometry. While these curvilinear transformations are straightforward, the governing PDEs require additional terms (metrics) and must adhere to strict conservation laws; these criteria complicate the application of the transformation and require careful implementation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Low-latency Jet Tagging for HL-LHC Using Transformer Architectures

Transformers are the state-of-the-art model architectures and widely used in application areas of machine learning. However the performance of such architectures is less well explored in the ultra-low latency domains where deployment on FPGAs or ASICs is required. Such domains include the trigger and data acquisition systems of the LHC experiments. We present a transformer-based algorithm for jet tagging built with the HGQ2 framework, which is able to produce a model with heterogeneous bitwidths for fast inference on FPGAs, as required in the trigger systems at the LHC experiments. The bitwidths are acquired during training by minimizing the total bit operations as an additional parameter. By allowing a bitwidth of zero, the model is pruned in-situ during training. Using this quantization-aware approach, our algorithm achieves state-of-the-art performance while also retaining permutation invariance which is a key property for particle physics applications. Due to the strength of transformers in representation learning, our work also serves as a stepping stone for the development of a larger foundation model for trigger applications.

Laatu, Lauri [Imperial Coll., London]↗
DOE OSTI2025

RTN-099: Photometric Transformation Relations for the LSST Data Preview 1

This technical note provides photometric transformation relations between the Vera C. Rubin Observatory's LSSTCam and LSSTComCam systems and other photometric systems. These transformations are derived using both synthetic and empirical data and are intended to support calibration and comparison across survey systems. We present both polynomial equations and lookup-table-based methods, depending on the available data and desired accuracy. The transformations are generally valid for stars with typical spectral energy distributions (SEDs), and caution should be used when applying them to objects with strong emission lines or atypical colors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

RTN-125: Photometric Transformation Relations for the LSST Data Preview 2

This technical note provides photometric transformation relations between the NSF-DOE Vera C. Rubin Observatory's Data Preview 2 (DP2) and other photometric systems. These transformations are derived using both synthetic and empirical data and are intended to support calibration and comparison across survey systems. We present both polynomial equations and lookup-table-based methods, depending on the available data and desired accuracy. The transformations are generally valid for stars with typical spectral energy distributions (SEDs), and caution should be used when applying them to objects with strong emission lines or atypical colors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Atmospheric Transformation of Refrigerants: Current Research Developments and Knowledge Gaps

Refrigerants have evolved through the years to reduce their global warming potential while providing sufficient cooling in refrigeration systems. Replacements for hydrofluorocarbons (HFCs) and chlorofluorocarbons (CFCs) are the hydrofluoroolefins (HFOs), which contain reactive double bonds that decrease the atmospheric lifetime of fluorinated compounds. However, the transformation of unsaturated fluorinated compounds in the atmosphere could generate persistent pollutants, particularly trifluoroacetic acid (TFA) which is the simplest Perfluoroalkyl carboxylic acids (PFCAs). Understanding the transformation of refrigerants is critical in assessing their contribution to atmospheric levels of TFA and their impact on watersheds and human health. This article will present the reactivity of the refrigerants, atmospheric oxidation source, and sink processes of fluorinated refrigerants under daytime conditions, particularly the variability of TFA from refrigerants. Moreover, the discussion will suggest experimental procedures that can quantify the low concentration (~parts per trillion) of TFA generated from the transformation of HFOs. New state-of-the-art techniques such as chemical ionization mass spectrometers (HR-CIMS) will be assessed in providing high temporal resolution (minutes to hourly) to fully capture the atmospheric sources and variability of TFA. Likewise, local, regional, and global concentrations of TFA accounted from the oxidation of refrigerants will be examined. This will include data from both experimental procedures and simulation models. Participation of TFA in critical atmospheric processes such as new particle formation will also be included in this study. Lastly, overall knowledge gaps related to the oxidation products and their dispersion in the environment will be summarized to guide future research needs.

Salvador, Christian↗
DOE OSTI2024

Interpreting Transformers for Jet Tagging

Machine learning (ML) algorithms, particularly attention-based transformer models, have become indispensable for analyzing the vast data generated by particle physics experiments like ATLAS and CMS at the CERN LHC. Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging tasks, which are critical for identifying particles resulting from proton collisions. This study focuses on interpreting ParT by analyzing attention heat maps and particle-pair correlations on the $\eta$-$\phi$ plane, revealing a binary attention pattern where each particle attends to at most one other particle. At the same time, we observe that ParT shows varying focus on important particles and subjets depending on decay, indicating that the model learns traditional jet substructure observables. These insights enhance our understanding of the model's internal workings and learning process, offering potential avenues for improving the efficiency of transformer architectures in future high-energy physics applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Transformer designs for very high isolation with high coupling

Various examples are provided related to transformer designs that offer very high isolation while maintaining high coupling between the windings. In one example, an isolation transformer includes a first excitation coil wound around a first core and a second excitation coil wound about a second core. The second core is electrically separated from the first core by a high resistivity magnetic material or a non-conductive material. The first and second cores can include corresponding core segments arranged in a trident geometry or a quindent geometry. The core segments can align when the first excitation coil is inserted into a void of the second excitation coil. The isolation transformer designs are mechanically separable which can result in safe, energized, plug operations.

Beddingfield, Richard Byron↗
DOE OSTI2025

Why Is Attention Sparse In Particle Transformer?

Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a leading example of such models. A striking feature of ParT is its sparse, nearly binary, attention structure, raising questions about the origin of this behavior and whether it encodes physically meaningful correlations. In this work, we investigate the source of ParT's sparse attention by comparing models trained on multiple benchmark datasets and examine the relative contributions of the attention term and the physics-inspired interaction matrix before softmax. We find that binary sparsity arises primarily from the attention mechanism itself, with the interaction matrix playing a secondary role. Moreove, we show that ParT is able to identify key jet substructure elements, such as leptons in semileptonic top decays, even without explicit particle identification inputs. These results provide new insight into the interpretability of transformer-based jet taggers and clarify the conditions under which sparse attention patterns emerge in ParT.

Legge, Timothy [UC, San Diego]↗
DOE OSTI2024

Automated Framework for Groundwater Monitoring Using DWT with LSTM and Transformers

Environmental monitoring is critical for safeguarding public health and ecological well-being. Traditional data structuring and workflow monitoring methods consume significant time and effort, hindering timely insights and effective decision-making. Our study addresses this challenge by presenting an AI framework that automates data cleaning, structuring, and modeling processes, specifically targeting applications in groundwater monitoring. By leveraging automation for data processing and model training, our framework establishes a novel and efficient paradigm for environmental monitoring, with its potential application to the vast network of over a hundred Department of Energy Environmental Management (DoE-EM) cleanup sites across the country. It analyzes data streams from a network of groundwater Internet-of-Things (IoT) sensors deployed at the Savannah River Site (SRS) for prediction modeling. This allows human experts to focus on analysis and decision-making, ultimately leading to better environmental outcomes.The framework employs multivariate time-series forecasting methods to study and model the behavior of varying chemical analytes. The continuous learning process is enabled by utilizing deep learning techniques. It allows the framework to become more nuanced in its analysis over time, adapting to the specific characteristics of the environmental site and the evolving nature of contaminant behavior. Deep learning models known for sequence modeling, LSTM, and Transformers are employed for time series forecasting. Data processing and structuring are essential components significantly impacting the final model's performance. This hypothesis was proven by presenting a comparative analysis of model performance with processed and unprocessed data. The feature engineering approach utilized was the Discrete Wavelet Transform, which works well with time series data.

Discrete Wavelet Transform (DWT)↗
DOE OSTI2025

Atomically Revealing Bulk Point Defect Dynamics in Hydrogen‐Driven γ‐Fe 2 O 3 → Fe 3 O 4 → FeO Transformation

Understanding how point defects in the bulk govern redox transformations is essential for advancing hydrogen-based metal production and designing high-performance oxide materials. This study reveals the atomic-scale mechanisms driving hydrogen-induced reduction of γ-Fe 2 O 3 to Fe 3 O 4 , focusing on how bulk vacancy dynamics dictate structural evolution and reaction kinetics. A key finding is the pronounced contrast in defect behavior between the two oxides: in γ-Fe 2 O 3 , intrinsic Fe vacancies promote oxygen vacancy clustering, destabilizing the local lattice and driving nanopore formation. In contrast, Fe 3 O 4 exhibits a higher oxygen vacancy formation energy and lacks intrinsic Fe vacancies, suppressing vacancy aggregation and maintaining a dense, pore-free structure. This divergence governs distinct reduction pathways—γ-Fe 2 O 3 undergoes an interface-reaction-limited transformation confined to the γ-Fe 2 O 3 /Fe 3 O 4 boundary, while Fe 3 O 4 supports a uniform increase in oxygen vacancy concentration, enabling bulk-phase reduction to lower-oxide FeO. Integrated in situ electron microscopy and density functional theory modeling uncover a vacancy-mediated mechanism, where synergistic cation-anion vacancy dynamics steer microstructure evolution and phase progression. These insights highlight the critical role of vacancy dynamics in controlling oxide reactivity and offer a pathway toward vacancy engineering to enhance reduction kinetics in hydrogen metallurgy and to tailor porosity, reactivity, and structural resilience in oxide-based catalysts and energy materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Decoding anomalous grain growth at room temperature during pressure-induced phase transformations

Significant grain growth is observed during the high-pressure phase transformations (PTs) at room temperature in various materials. The main focus here is grain growth from a few hundred nanometers to 10 μm within an hour during α → ω PT in Zr. No existing theory explains this phenomenon since without PT, Zr nanocrystals do not grow at room temperature even for up to 10 years. Here, in this study, a multistep mechanism for the grain growth during α → ω PT in Zr is suggested. Phase interfaces (PI) and grain boundaries (GBs) coincide and move together as a combined PI-GBs under the action of the combined thermodynamic driving force. Such a combined motion changes the diffusional grain growth mechanism to the transformational one and the martensitic mechanism of PT to a reconstructive one via an intermediate disordered phase. The primary condition is that the GB energy of the ω phase is smaller than that of the α phase, which promotes the nucleation of ω-Zr and is consistent with the absence of the reverse PT and reduction in the PT pressure with reducing grain size. Several intermediate steps for such motion are suggested and justified kinetically. Nonhydrostatic stresses due to volume reduction in the growing ω grain promote continuous growth of the existing ω grain instead of a new nucleation at other GBs. In situ synchrotron Laue diffraction experiments confirm the main predictions of the theory. The suggested mechanism provides a new insight into synergistic interaction between PTs and microstructure evolution.

anomalous grain growth during phase transformation↗
DOE OSTI2025

A generalizable machine learning-assisted fast Fourier transform algorithm to simulate the large strain phenomena in polycrystalline materials

Machine learning methods have shown initial promise in constitutive modeling for single crystals or homogenized polycrystals, delivering notable computational efficiency. However, existing machine learning-based constitutive models often lack generalizability, limiting their application across diverse boundary value problems. This study introduces a thermodynamics-informed artificial neural network model to accelerate rate-tangent crystal plasticity fast Fourier transform simulations for cross-scale deformation behaviors of polycrystals under complex loading. Our model integrates microstructural variability and local interactions effectively. To address local effects in each grain, we employ K-means clustering to group Gauss points within the microstructure into clusters assumed to be in similar mechanical states. This approach, based on self-clustering analysis, extends model scope from macroscopic stress response to the granular level, capturing mechanical responses and orientation evolution across grains. This reduces the number of nonlinear problems to solve, with cluster responses propagated throughout each group. The thermodynamics-based artificial neural network-extracted features are further processed using local material state clusters to account for history-dependent deformation and evolving microstructures. Additionally, representative volume element simulations with rate-tangent crystal plasticity fast Fourier transform provide reliable datasets for model training. The proposed model demonstrates high efficiency, accuracy, self-consistency, and enhanced generalizability in predicting strain–stress responses and orientation evolution at both individual grain and aggregate scales under complex loading conditions, such as biaxial tension and arbitrary loading scenarios.

36 MATERIALS SCIENCE↗
DOE OSTI2026

scPlantAnnotate: an accurate and robust transformer-based model for plant cell type annotation

Accurate cell type annotation remains a major bottleneck in plant single-cell RNA sequencing (scRNA-seq), where existing tools are often adapted from animal studies and perform sub-optimally on plant data. The lack of plant-specific computational frameworks limits the construction of plant cell atlases and downstream biological discovery. We develop and evaluate scPlantAnnotate, a Transformer-based reference annotation framework tailored for plant scRNA-seq data, and benchmark it against state-of-the-art deep learning and conventional methods across multiple plant species. Species-specific scPlantAnnotate models were trained using curated datasets from Arabidopsis thaliana, Zea mays, Oryza sativa, and Glycine max. We compared scPlantAnnotate with leading baselines under both standard random-split evaluation and a more stringent leave-one-dataset-out setting, which tests robustness to completely unseen datasets and tissue types. scPlantAnnotate consistently outperforms existing approaches across all four species under random-split evaluation. In the leave-one-dataset-out setting for A. thaliana, where performance drops markedly for all methods due to strong batch effects and dataset heterogeneity, scPlantAnnotate nonetheless achieves the highest Accuracy, Macro-F1, Balanced Accuracy, and Macro-AUROC on average and ranks first on most held-out datasets. These results demonstrate improved robustness to dataset shifts, a critical yet underexplored challenge in plant scRNA-seq analysis. A freely accessible web server enables users to annotate their own datasets using pretrained models. scPlantAnnotate provides a plant-specific, Transformer-based framework for single-cell annotation that delivers state-of-the-art performance and enhanced robustness to unseen datasets. By addressing limitations of existing tools and enabling scalable reference-based annotation, scPlantAnnotate supports the development of comprehensive plant cell atlases and facilitates broader use of single-cell genomics in plant biology.

Bioinformatics↗