Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer encoder”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Predicting Future Laboratory Fault Friction Through Deep Learning Transformer Models

Machine learning models using seismic emissions as input can predict instantaneous fault characteristics such as displacement and friction in laboratory experiments, and slow slip in Earth. Here, we address whether the seismic/acoustic emission (AE) from laboratory experiments contains information about future frictional behavior. The approach uses a convolutional encoder-decoder containing a transformer model in the latent space, similar to models used for natural language processing. We test the model limits using progressively larger AE input time windows and progressively larger output friction time windows. The results demonstrate that very near-term friction predictions are indeed contained in the AE signal, and predictions are progressively worse farther into the future. The future predictions by the model of impending failure in the near-term are remarkably robust. This first effort predicting future fault frictional behavior with machine learning will aid in guiding efforts for applications in Earth.

58 GEOSCIENCES↗
DOE OSTI2026

ML-Based Pebble Power Reconstruction for Pebble Bed Reactor Analysis

Pebble power reconstruction has been explored to complement the conventional homogenized modeling approach in pebble bed reactor (PBR) analysis, as detailed heterogeneous geometry calculations are computationally expensive. The random distribution of pebble fuels within the core challenges the application of conventional pin power reconstruction methods. To address this, we introduce a machine learning approach based on the transformer model, composed of encoder and decoder layers, to estimate the flux and power form functions for reconstructing individual pebble neutron fluxes and powers. The homogeneous neutron flux distribution within each spectral zone (SZ) is obtained from finite element solutions of global diffusion or transport calculations. Verification tests demonstrate that the trained transformer model accurately predicts power form functions over a range of conditions, including variations in pebble enrichment, location, type, SZ size, and burnup. In particular, verification using a three-dimensional PBR benchmark with burned pebbles shows good agreement in heterogeneous pebble power distributions between Griffin and Serpent. These results highlight the potential of applying conventional pin power reconstruction approaches to PBR cores with randomly distributed pebbles.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

AGFormer: Adaptive Spatiotemporal graph informed transformer for multi-reservoir inflow forecasting

Accurate reservoir inflow forecasting is crucial for effective water resource management, yet most machine learning models focus on single-reservoir prediction and overlook spatial dependencies among hydrologically connected reservoirs. Here, we propose AGFormer (Adaptive Graph-Informed Transformer), an end-to-end framework that integrates adaptive graph learning with temporal sequence modeling for multi-reservoir inflow forecasting. A shared encoder and graph attention mechanism generate reservoir-specific embeddings, which are then processed by the Transformer-based encoder–decoder for multi-step inflow forecasting. We also introduce a pretraining paradigm to learn robust temporal embeddings from misaligned historical records. Evaluated on 30 reservoirs in the Upper Colorado River Basin, AGFormer achieves superior seven-day-ahead forecasts, with NSE > 0.75 for 20 reservoirs—outperforming Encoder–Decoder LSTM, GCN+LSTM, and Transformer baselines. Adaptive graph learning captures dynamic inter-reservoir dependencies, and feature attribution aligns with snowmelt-driven hydrology. Incorporating forecasted meteorological inputs further enhances accuracy, demonstrating AGFormer’s potential to support reservoir management under dynamic hydrological conditions.

Adaptive graph learning↗
NASA NTRS1976

Interframe transform coding of picture data

This semi-tutorial paper describes the process of using orthogonal transforms for the purposes of encoding TV picture data. Results pertaining to a 6:1 data compression experiment using the Walsh-Hadamard transform are included.

Ahmed, N.↗
DOE OSTI2020

Imaging of multiple fluorescent proteins in canopies enables synthetic biology in plants

Reverse genetics approaches have revolutionized plant biology and agriculture. Phenomics has the prospect of bridging plant phenotypes with genes, including transgenes, to transform agricultural fields. Genetically encoded fluorescent proteins (FPs) have revolutionized plant biology paradigms in gene expression, protein trafficking and plant physiology. While the first instance of plant canopy imaging of green fluorescent protein (GFP) was performed over 25 years ago, modern phenomics has largely ignored fluorescence as a transgene expression device despite the burgeoning FP colour palette available to plant biologists. Here, we show a new platform for stand-off imaging of plant canopies expressing a wide variety of FP genes. The platform-the fluorescence-inducing laser projector (FILP)-uses an ultra-low-noise camera to image a scene illuminated by compact diode lasers of various colours, coupled with emission filters to resolve individual FPs, to phenotype transgenic plants expressing FP genes. Each of the 20 FPs screened in plants were imaged at >3 m using FILP in a laboratory-based laser range. We also show that pairs of co-expressed fluorescence proteins can be imaged in canopies. The FILP system enabled a rapid synthetic promoter screen: starting from 2000 synthetic promoters transfected into protoplasts to FILP-imaged agroinfiltrated Nicotiana benthamiana plants in a matter of weeks, which was useful to characterize a water stress-inducible synthetic promoter. FILP canopy imaging was also accomplished for stably transformed GFP potato and in a split-GFP assay, which illustrates the flexibility of the instrument for analysing fluorescence signals in plant canopies.

abiotic stress↗
DOE OSTI2025

Continuous Encodable Reshaping of Gold Nanocrystals through Facet Modulation

Shape control of nanocrystals (NCs) is crucial for tuning their assembly behavior and functional properties, yet the precise manipulation of facet composition remains challenging. Here, we present a nanocrystal reshaping strategy to control and modulate the facets of gold (Au) NCs. Our one-pot approach, conducted at room temperature, requires only initial Au NCs, Au 3+ ions, and surfactants, distinguishing it from conventional reduction-mediated “etching-and-regrowth” methods. Detailed structural studies using electron microscopy, small-angle X-ray scattering (SAXS), and UV−vis spectroscopy reveal the surfactant-encoded pathway for NC transformation from shaped particles to spheres and then into various polyhedral shapes while preserving the individual particles' volume. The proposed reshaping mechanism involves the dissolution of surface Au atoms into Au + complexes in the presence of Au 3+ and surfactant, followed by surfactant-guided redeposition and formation of facets with different atomic planes. Using the ethanol oxidation reaction (EOR) as a probe, we observe a quasi-linear decrease in onset potential and an increase in activity with increasing {100} facet exposure. This work broadens synthetic strategies by offering precise NC reshaping and facet control.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Quantum computation of nuclear observables involving linear combinations of unitary operators

Here we present the quantum computation of nuclear observables where the operators of interest are first decomposed in terms of the linear combination of unitaries. Then we utilize the Hadamard test and the linear combination of unitaries based methods to compute the expectation values. We apply these methods to calculate the electric quadrupole moment of the deuteron. The results are compared for the Jordan-Wigner transformation and Gray code encoding. We discuss the versatility of our approach that can be utilized in general to calculate several observables on a quantum computer.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Toward Mixed Analog-Digital Quantum Signal Processing: Quantum AD/DA Conversion and the Fourier Transform

Signal processing stands as a pillar of classical computation and modern information technology, applicable to both analog and digital signals. Recently, advancements in quantum information science have suggested that quantum signal processing (QSP) can enable more powerful signal processing capabilities. However, the developments in QSP have primarily leveraged digital quantum resources, such as discrete-variable (DV) systems like qubits, rather than analog quantum resources, such as continuous-variable (CV) systems like quantum oscillators. Consequently, there remains a gap in understanding how signal processing can be performed on hybrid CV-DV quantum computers. Here we address this gap by developing a new paradigm of mixed analog-digital QSP. We demonstrate the utility of this paradigm by showcasing how it naturally enables analog-digital conversion of quantum signals—specifically, the transfer of states between DV and CV quantum systems. We then show that such quantum analog-digital conversion enables new implementations of quantum algorithms on CV-DV hardware. This is exemplified by realizing the quantum Fourier transform of a state encoded on qubits via the free-evolution of a quantum oscillator, albeit with a runtime exponential in the number of qubits due to information theoretic arguments. Collectively, this work marks a significant step forward in hybrid CV-DV quantum computation, providing a foundation for scalable analog-digital signal processing on quantum processors.

42 ENGINEERING↗
DOE OSTI2025

Engineering the green algae Chlamydomonas incerta for recombinant protein production

Chlamydomonas incerta , a genetically close relative of the model green alga Chlamydomonas reinhardtii , shows significant potential as a host for recombinant protein expression. Because of the close genetic relationship between C. incerta and C. reinhardtii , this species offers an additional reference point for advancing our understanding of photosynthetic organisms, and also provides a potential new candidate for biotechnological applications. This study investigates C. incerta ’s capacity to express three recombinant proteins: the fluorescent protein mCherry, the hemicellulose-degrading enzyme xylanase, and the plastic-degrading enzyme PHL7. We have also examined the capacity to target protein expression to various cellular compartments in this alga, including the cytosol, secretory pathway, cytoplasmic membrane, and cell wall. When compared directly with C. reinhardtii , C. incerta exhibited a distinct but notable capacity for recombinant protein production. Cellular transformation with a vector encoding mCherry revealed that C. incerta produced approximately 3.5 times higher fluorescence levels and a 3.7-fold increase in immunoblot intensity compared to C. reinhardtii . For xylanase expression and secretion, both C. incerta and C. reinhardtii showed similar secretion capacities and enzymatic activities, with comparable xylan degradation rates, highlighting the industrial applicability of xylanase expression in microalgae. Finally, C. incerta showed comparable PHL7 activity levels to C. reinhardtii , as demonstrated by the in vitro degradation of a polyester polyurethane suspension, Impranil® DLN. Finally, we also explored the potential of cellular fusion for the generation of genetic hybrids between C. incerta and C. reinhardtii as a means to enhance phenotypic diversity and augment genetic variation. We were able to generate genetic fusion that could exchange both the recombinant protein genes, as well as associated selectable marker genes into recombinant offspring. These findings emphasize C. incerta ’s potential as a robust platform for recombinant protein production, and as a powerful tool for gaining a better understanding of microalgal biology.

cell membranes↗
NASA NTRS2003

A High Performance Image Data Compression Technique for Space Applications

A highly performing image data compression technique is currently being developed for space science applications under the requirement of high-speed and pushbroom scanning. The technique is also applicable to frame based imaging data. The algorithm combines a two-dimensional transform with a bitplane encoding; this results in an embedded bit string with exact desirable compression rate specified by the user. The compression scheme performs well on a suite of test images acquired from spacecraft instruments. It can also be applied to three-dimensional data cube resulting from hyper-spectral imaging instrument. Flight qualifiable hardware implementations are in development. The implementation is being designed to compress data in excess of 20 Msampledsec and support quantization from 2 to 16 bits. This paper presents the algorithm, its applications and status of development.

Yeh, Pen-Shu↗
NASA NTRS2009

Applications of sub-audible speech recognition based upon electromyographic signals

Method and system for generating electromyographic or sub-audible signals (''SAWPs'') and for transmitting and recognizing the SAWPs that represent the original words and/or phrases. The SAWPs may be generated in an environment that interferes excessively with normal speech or that requires stealth communications, and may be transmitted using encoded, enciphered or otherwise transformed signals that are less subject to signal distortion or degradation in the ambient environment.

Jorgensen, C. Charles↗
DOE OSTI2022

A bistable and reconfigurable molecular system with encodable bonds

Molecular systems with ability to controllably transform between different conformations play pivotal roles in regulating biochemical functions. Here, we report the design of a bistable DNA origami four-way junction (DOJ) molecular system that adopts two distinct stable conformations with controllable reconfigurability by using conformation-controlled base stacking. Exquisite control over DOJ’s conformation and transformation is realized by programming the stacking bonds (quasi–blunt-ends) within the junction to induce prescribed coaxial stacking of neighboring junction arms. A specific DOJ conformation may be achieved by encoding the stacking bonds with binary stacking sequences based on thermodynamic calculations. Dynamic transformations of DOJ between various conformations are achieved by using specific environmental and molecular stimulations to reprogram the stacking codes. This work provides a useful platform for constructing self-assembled DNA nanostructures and nanomachines and insights for future design of artificial molecular systems with increasing complexity and reconfigurability.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2018

Phase Heritage: Deciphering Evidence of Pre-Existing Phases via Inherited Crystallographic Orientations

The concept of 'phase heritage' (e.g., Timms et al., 2017a) involves microstructural recognition of the former presence of a phase that has since transformed to another via evidence encoded in crystallographic orientations. Phase heritage relies on the phenomenon that newly grown (daughter) phases nucleate with particular crystallographic orientation relationships with the preceding (parent) phase. This phenomenon is common for displacive (i.e., shear or martensitic) transformations, well documented in the metals and ceramics literature, but is relatively uncommon in geosciences. This presentation outlines the concepts behind this approach, showcases results from software for automated analysis of EBSD data, and illustrates examples of polymorphic and dissociation phase transformations in the ZrSiO4-ZrO2-SiO2 system, which has particularly useful applications for 'extreme thermobarometry' in impact environments (Timms et al., 2017a).

Timms, Nicholas E.↗
NASA NTRS2016

Multidisciplinary Model Transformation Through Simplified Intermediate Representations

There has long been a challenge of making engineering tools from multiple disciplines interoperate. This problem extends to system modeling practices. This challenge has been confronted with a wide variety of techniques. These techniques include attempting to interface tools together into combined suites, attempting to find underlying commonalities in mathematics, supporting connections through semantic encoding, various graph mappings and transformations, and code wrappers. All of these approaches have strengths and weaknesses. These are measured in multiple areas: relative freedom of action of individual domain engineers in developing their own tools, speed of execution, ease of creation, traceability, fidelity of information transfer, and degree of alignment between the concepts of different domains. This paper presents an approach to this interoperation problem currently being used in the World-Wide Web. The approach is to develop easy-to-parse formats that allow flexibility to both the file author and file interpreter. Many of the formats that are currently deployed sacrifice runtime performance for the ability of third parties to easily understand what to do with the data. XML became popular earlier as a de-facto standard format for many web applications, but is now being replaced by JSON to enhance human readability and provide a simpler data model. This is the basis for work in this paper. Our approach, which provides the key to interoperation, is a simplified “shrapnel” intermediate collection of objects and relationships that is the result of a breakdown of the system model into minimal pieces. It is then reassembled on the destination side, forming a two-step transformation. Previous efforts with single-step transformations have proven too difficult to create efficiently. In contrast, the use of this approach leads to an almost automatic procedure for transformation development. The Europa project is a large engineering project that must coordinate the efforts of many different teams with different specialties. The traditional form of exchanging engineering information has been documentation. The vision of model-based systems engineering is to make this information exchange much more digital. This paper presents the application of our simplified format to connecting two different engineering tools to the system model, with a focus on a dynamic mission simulation encoded in Modelica.

Cole, Bjorn↗
DOE OSTI2024

AstroCLIP: a cross-modal foundation model for galaxies

ABSTRACT We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used – without any model fine-tuning – for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation from both images and spectra, and (4) morphology classification. Our approach to implementing AstroCLIP consists of two parts. First, we embed galaxy images and spectra separately by pre-training separate transformer-based image and spectrum encoders in self-supervised settings. We then align the encoders using a contrastive loss. We apply our method to spectra from the Dark Energy Spectroscopic Instrument and images from its corresponding Legacy Imaging Survey. Overall, we find remarkable performance on all downstream tasks, even relative to supervised baselines. For example, for a task like photometric redshift prediction, we find similar performance to a specifically trained ResNet18, and for additional tasks like physical property estimation (stellar mass, age, metallicity, and specific-star-formation rate), we beat this supervised baseline by 19 per cent in terms of R2. We also compare our results with a state-of-the-art self-supervised single-modal model for galaxy images, and find that our approach outperforms this benchmark by roughly a factor of two on photometric redshift estimation and physical property prediction in terms of R2, while remaining roughly in-line in terms of morphology classification. Ultimately, our approach represents the first cross-modal self-supervised model for galaxies, and the first self-supervised transformer-based architectures for galaxy images and spectra.

Parker, Liam (ORCID:0009000749521674)↗
DOE OSTI2026

Xanthos-Lake Model Source Code

This repository contains the source code for Xanthos-Lake, a lake-modeling extension of the Xanthos framework that introduces a coupled lake component comprising the Xanthos-Lake Snow and Ice Model (xLSIM) and the Xanthos-Lake Water Balance Model (xLWBM). xLSIM is a basin-aware machine-learning model for lake snow, ice, and thermal conditions. It predicts monthly lake ice thickness, snow depth, snow-cover fraction, mixing-layer temperature, and lake ice fraction from meteorological forcing and lake surface-area information. It uses sequence-based deep-learning architectures, including Transformer and hybrid Long Short-Term Memory–Transformer (LSTM–Transformer) models, together with seasonal encoding, multi-lake learning, physical masking, and basin-level cryospheric and non-cryospheric classification. The training workflow uses Ray for scalable execution and includes optional Ray Tune hyperparameter optimization. Model predictions, observations, diagnostics, and feature-importance outputs are written in NetCDF. xLWBM is the water-balance component of the new lake framework. It simulates monthly lake storage, surface area, evaporation, inflow, outflow, and lake–groundwater exchange. It combines physical water-balance equations with calibrated bathymetric relationships, weir-based outlet flow, modified Penman open-water evaporation, groundwater head relaxation, Penman–Monteith snow and ice sublimation, and snow, ice, and thermal conditions supplied by xLSIM. The model calibrates lake parameters against satellite-derived surface-area data, using evaporation-based calibration where surface-area data are unavailable, and supports small, medium, and large lake classes. For large lakes, xLWBM is integrated with the managed-routing workflow so that lake storage and outflow interact directly with downstream river routing and reservoir operations. Together, xLSIM and xLWBM provide Xanthos with a coupled lake-modeling capability. xLSIM supplies the snow, ice, and thermal conditions that affect lake evaporation and snow- and ice-related water exchanges, while xLWBM translates those conditions into dynamic lake storage, surface area, evaporation, and discharge. In return, xLWBM supplies evolving lake surface area to xLSIM. This coupling enables Xanthos to represent lakes as active hydrologic components within basin-scale water-availability and routing simulations.

Machine Learning↗
NASA NTRS1978

On decoding of Reed-Solomon codes over GF/32/ and GF/64/ using the transform techniques of Winograd

An algorithm based on the Winograd (1976) method is developed to compute a Fourier-like transform over Galois field GF(2 exp n) for n equal to 5 and 6. It is shown that this transform algorithm requires fewer multiplications than the more conventional fast transform algorithm described by Gentleman (1968). Such a transform can be used to encode and decode Reed-Solomon codes of length (2 exp n) -1.

Reed, I. S.↗
NASA NTRS2017

Performance of a Space-Based Wavelet Compressor for Plasma Count Data on the MMS Fast Plasma Investigation

Data compression has been a staple of imaging instruments for years. Recently, plasma measurements have utilized compression with relatively low compression ratios. The Fast Plasma Investigation (FPI) on board the Magnetospheric Multiscale (MMS) mission generates data roughly 100 times faster than previous plasma instruments, requiring a higher compression ratio to fit within the telemetry allocation. This study investigates the performance of a space-based compression standard employing a Discrete Wavelet Transform and a Bit Plane Encoder (DWT/BPE) in compressing FPI plasma count data. Data from the first 6 months of FPI operation are analyzed to explore the error modes evident in the data and how to adapt to them. While approximately half of the Dual Electron Spectrometer (DES) maps had some level of loss, it was found that there is little effect on the plasma moments and that errors present in individual sky maps are typically minor. The majority of Dual Ion Spectrometer burst sky maps compressed in a lossless fashion, with no error introduced during compression. Because of induced compression error, the size limit for DES burst images has been increased for Phase 1B. Additionally, it was found that the floating point compression mode yielded better results when images have significant compression error, leading to floating point mode being used for the fast survey mode of operation for Phase 1B. Despite the suggested tweaks, it was found that wavelet-based compression, and a DWT/BPE algorithm in particular, is highly suitable to data compression for plasma measurement instruments and can be recommended for future missions.

plasma↗