Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer encoder”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

ML-Based Pebble Power Reconstruction for Pebble Bed Reactor Analysis

Pebble power reconstruction has been explored to complement the conventional homogenized modeling approach in pebble bed reactor (PBR) analysis, as detailed heterogeneous geometry calculations are computationally expensive. The random distribution of pebble fuels within the core challenges the application of conventional pin power reconstruction methods. To address this, we introduce a machine learning approach based on the transformer model, composed of encoder and decoder layers, to estimate the flux and power form functions for reconstructing individual pebble neutron fluxes and powers. The homogeneous neutron flux distribution within each spectral zone (SZ) is obtained from finite element solutions of global diffusion or transport calculations. Verification tests demonstrate that the trained transformer model accurately predicts power form functions over a range of conditions, including variations in pebble enrichment, location, type, SZ size, and burnup. In particular, verification using a three-dimensional PBR benchmark with burned pebbles shows good agreement in heterogeneous pebble power distributions between Griffin and Serpent. These results highlight the potential of applying conventional pin power reconstruction approaches to PBR cores with randomly distributed pebbles.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

AGFormer: Adaptive Spatiotemporal graph informed transformer for multi-reservoir inflow forecasting

Accurate reservoir inflow forecasting is crucial for effective water resource management, yet most machine learning models focus on single-reservoir prediction and overlook spatial dependencies among hydrologically connected reservoirs. Here, we propose AGFormer (Adaptive Graph-Informed Transformer), an end-to-end framework that integrates adaptive graph learning with temporal sequence modeling for multi-reservoir inflow forecasting. A shared encoder and graph attention mechanism generate reservoir-specific embeddings, which are then processed by the Transformer-based encoder–decoder for multi-step inflow forecasting. We also introduce a pretraining paradigm to learn robust temporal embeddings from misaligned historical records. Evaluated on 30 reservoirs in the Upper Colorado River Basin, AGFormer achieves superior seven-day-ahead forecasts, with NSE > 0.75 for 20 reservoirs—outperforming Encoder–Decoder LSTM, GCN+LSTM, and Transformer baselines. Adaptive graph learning captures dynamic inter-reservoir dependencies, and feature attribution aligns with snowmelt-driven hydrology. Incorporating forecasted meteorological inputs further enhances accuracy, demonstrating AGFormer’s potential to support reservoir management under dynamic hydrological conditions.

Adaptive graph learning↗
DOE OSTI2020

Imaging of multiple fluorescent proteins in canopies enables synthetic biology in plants

Reverse genetics approaches have revolutionized plant biology and agriculture. Phenomics has the prospect of bridging plant phenotypes with genes, including transgenes, to transform agricultural fields. Genetically encoded fluorescent proteins (FPs) have revolutionized plant biology paradigms in gene expression, protein trafficking and plant physiology. While the first instance of plant canopy imaging of green fluorescent protein (GFP) was performed over 25 years ago, modern phenomics has largely ignored fluorescence as a transgene expression device despite the burgeoning FP colour palette available to plant biologists. Here, we show a new platform for stand-off imaging of plant canopies expressing a wide variety of FP genes. The platform-the fluorescence-inducing laser projector (FILP)-uses an ultra-low-noise camera to image a scene illuminated by compact diode lasers of various colours, coupled with emission filters to resolve individual FPs, to phenotype transgenic plants expressing FP genes. Each of the 20 FPs screened in plants were imaged at >3 m using FILP in a laboratory-based laser range. We also show that pairs of co-expressed fluorescence proteins can be imaged in canopies. The FILP system enabled a rapid synthetic promoter screen: starting from 2000 synthetic promoters transfected into protoplasts to FILP-imaged agroinfiltrated Nicotiana benthamiana plants in a matter of weeks, which was useful to characterize a water stress-inducible synthetic promoter. FILP canopy imaging was also accomplished for stably transformed GFP potato and in a split-GFP assay, which illustrates the flexibility of the instrument for analysing fluorescence signals in plant canopies.

abiotic stress↗
DOE OSTI2025

Continuous Encodable Reshaping of Gold Nanocrystals through Facet Modulation

Shape control of nanocrystals (NCs) is crucial for tuning their assembly behavior and functional properties, yet the precise manipulation of facet composition remains challenging. Here, we present a nanocrystal reshaping strategy to control and modulate the facets of gold (Au) NCs. Our one-pot approach, conducted at room temperature, requires only initial Au NCs, Au 3+ ions, and surfactants, distinguishing it from conventional reduction-mediated “etching-and-regrowth” methods. Detailed structural studies using electron microscopy, small-angle X-ray scattering (SAXS), and UV−vis spectroscopy reveal the surfactant-encoded pathway for NC transformation from shaped particles to spheres and then into various polyhedral shapes while preserving the individual particles' volume. The proposed reshaping mechanism involves the dissolution of surface Au atoms into Au + complexes in the presence of Au 3+ and surfactant, followed by surfactant-guided redeposition and formation of facets with different atomic planes. Using the ethanol oxidation reaction (EOR) as a probe, we observe a quasi-linear decrease in onset potential and an increase in activity with increasing {100} facet exposure. This work broadens synthetic strategies by offering precise NC reshaping and facet control.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Quantum computation of nuclear observables involving linear combinations of unitary operators

Here we present the quantum computation of nuclear observables where the operators of interest are first decomposed in terms of the linear combination of unitaries. Then we utilize the Hadamard test and the linear combination of unitaries based methods to compute the expectation values. We apply these methods to calculate the electric quadrupole moment of the deuteron. The results are compared for the Jordan-Wigner transformation and Gray code encoding. We discuss the versatility of our approach that can be utilized in general to calculate several observables on a quantum computer.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Toward Mixed Analog-Digital Quantum Signal Processing: Quantum AD/DA Conversion and the Fourier Transform

Signal processing stands as a pillar of classical computation and modern information technology, applicable to both analog and digital signals. Recently, advancements in quantum information science have suggested that quantum signal processing (QSP) can enable more powerful signal processing capabilities. However, the developments in QSP have primarily leveraged digital quantum resources, such as discrete-variable (DV) systems like qubits, rather than analog quantum resources, such as continuous-variable (CV) systems like quantum oscillators. Consequently, there remains a gap in understanding how signal processing can be performed on hybrid CV-DV quantum computers. Here we address this gap by developing a new paradigm of mixed analog-digital QSP. We demonstrate the utility of this paradigm by showcasing how it naturally enables analog-digital conversion of quantum signals—specifically, the transfer of states between DV and CV quantum systems. We then show that such quantum analog-digital conversion enables new implementations of quantum algorithms on CV-DV hardware. This is exemplified by realizing the quantum Fourier transform of a state encoded on qubits via the free-evolution of a quantum oscillator, albeit with a runtime exponential in the number of qubits due to information theoretic arguments. Collectively, this work marks a significant step forward in hybrid CV-DV quantum computation, providing a foundation for scalable analog-digital signal processing on quantum processors.

42 ENGINEERING↗
DOE OSTI2025

Engineering the green algae Chlamydomonas incerta for recombinant protein production

Chlamydomonas incerta , a genetically close relative of the model green alga Chlamydomonas reinhardtii , shows significant potential as a host for recombinant protein expression. Because of the close genetic relationship between C. incerta and C. reinhardtii , this species offers an additional reference point for advancing our understanding of photosynthetic organisms, and also provides a potential new candidate for biotechnological applications. This study investigates C. incerta ’s capacity to express three recombinant proteins: the fluorescent protein mCherry, the hemicellulose-degrading enzyme xylanase, and the plastic-degrading enzyme PHL7. We have also examined the capacity to target protein expression to various cellular compartments in this alga, including the cytosol, secretory pathway, cytoplasmic membrane, and cell wall. When compared directly with C. reinhardtii , C. incerta exhibited a distinct but notable capacity for recombinant protein production. Cellular transformation with a vector encoding mCherry revealed that C. incerta produced approximately 3.5 times higher fluorescence levels and a 3.7-fold increase in immunoblot intensity compared to C. reinhardtii . For xylanase expression and secretion, both C. incerta and C. reinhardtii showed similar secretion capacities and enzymatic activities, with comparable xylan degradation rates, highlighting the industrial applicability of xylanase expression in microalgae. Finally, C. incerta showed comparable PHL7 activity levels to C. reinhardtii , as demonstrated by the in vitro degradation of a polyester polyurethane suspension, Impranil® DLN. Finally, we also explored the potential of cellular fusion for the generation of genetic hybrids between C. incerta and C. reinhardtii as a means to enhance phenotypic diversity and augment genetic variation. We were able to generate genetic fusion that could exchange both the recombinant protein genes, as well as associated selectable marker genes into recombinant offspring. These findings emphasize C. incerta ’s potential as a robust platform for recombinant protein production, and as a powerful tool for gaining a better understanding of microalgal biology.

cell membranes↗
DOE OSTI2022

A bistable and reconfigurable molecular system with encodable bonds

Molecular systems with ability to controllably transform between different conformations play pivotal roles in regulating biochemical functions. Here, we report the design of a bistable DNA origami four-way junction (DOJ) molecular system that adopts two distinct stable conformations with controllable reconfigurability by using conformation-controlled base stacking. Exquisite control over DOJ’s conformation and transformation is realized by programming the stacking bonds (quasi–blunt-ends) within the junction to induce prescribed coaxial stacking of neighboring junction arms. A specific DOJ conformation may be achieved by encoding the stacking bonds with binary stacking sequences based on thermodynamic calculations. Dynamic transformations of DOJ between various conformations are achieved by using specific environmental and molecular stimulations to reprogram the stacking codes. This work provides a useful platform for constructing self-assembled DNA nanostructures and nanomachines and insights for future design of artificial molecular systems with increasing complexity and reconfigurability.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

AstroCLIP: a cross-modal foundation model for galaxies

ABSTRACT We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used – without any model fine-tuning – for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation from both images and spectra, and (4) morphology classification. Our approach to implementing AstroCLIP consists of two parts. First, we embed galaxy images and spectra separately by pre-training separate transformer-based image and spectrum encoders in self-supervised settings. We then align the encoders using a contrastive loss. We apply our method to spectra from the Dark Energy Spectroscopic Instrument and images from its corresponding Legacy Imaging Survey. Overall, we find remarkable performance on all downstream tasks, even relative to supervised baselines. For example, for a task like photometric redshift prediction, we find similar performance to a specifically trained ResNet18, and for additional tasks like physical property estimation (stellar mass, age, metallicity, and specific-star-formation rate), we beat this supervised baseline by 19 per cent in terms of R2. We also compare our results with a state-of-the-art self-supervised single-modal model for galaxy images, and find that our approach outperforms this benchmark by roughly a factor of two on photometric redshift estimation and physical property prediction in terms of R2, while remaining roughly in-line in terms of morphology classification. Ultimately, our approach represents the first cross-modal self-supervised model for galaxies, and the first self-supervised transformer-based architectures for galaxy images and spectra.

Parker, Liam (ORCID:0009000749521674)↗
DOE OSTI2026

Xanthos-Lake Model Source Code

This repository contains the source code for Xanthos-Lake, a lake-modeling extension of the Xanthos framework that introduces a coupled lake component comprising the Xanthos-Lake Snow and Ice Model (xLSIM) and the Xanthos-Lake Water Balance Model (xLWBM). xLSIM is a basin-aware machine-learning model for lake snow, ice, and thermal conditions. It predicts monthly lake ice thickness, snow depth, snow-cover fraction, mixing-layer temperature, and lake ice fraction from meteorological forcing and lake surface-area information. It uses sequence-based deep-learning architectures, including Transformer and hybrid Long Short-Term Memory–Transformer (LSTM–Transformer) models, together with seasonal encoding, multi-lake learning, physical masking, and basin-level cryospheric and non-cryospheric classification. The training workflow uses Ray for scalable execution and includes optional Ray Tune hyperparameter optimization. Model predictions, observations, diagnostics, and feature-importance outputs are written in NetCDF. xLWBM is the water-balance component of the new lake framework. It simulates monthly lake storage, surface area, evaporation, inflow, outflow, and lake–groundwater exchange. It combines physical water-balance equations with calibrated bathymetric relationships, weir-based outlet flow, modified Penman open-water evaporation, groundwater head relaxation, Penman–Monteith snow and ice sublimation, and snow, ice, and thermal conditions supplied by xLSIM. The model calibrates lake parameters against satellite-derived surface-area data, using evaporation-based calibration where surface-area data are unavailable, and supports small, medium, and large lake classes. For large lakes, xLWBM is integrated with the managed-routing workflow so that lake storage and outflow interact directly with downstream river routing and reservoir operations. Together, xLSIM and xLWBM provide Xanthos with a coupled lake-modeling capability. xLSIM supplies the snow, ice, and thermal conditions that affect lake evaporation and snow- and ice-related water exchanges, while xLWBM translates those conditions into dynamic lake storage, surface area, evaporation, and discharge. In return, xLWBM supplies evolving lake surface area to xLSIM. This coupling enables Xanthos to represent lakes as active hydrologic components within basin-scale water-availability and routing simulations.

Machine Learning↗
DOE OSTI2020

Plants with enhanced photosynthesis and methods of manufacture thereof

A transgenic plant having enhanced photosynthesis is disclosed. The transgenic plant is transformed with a transgenic polynucleotide encoding a heterologous bicarbonate transporter. The bicarbonate transporter can be from an algae or a cyanobacterial species. The transgenic polynucleotide comprises a nucleic acid sequence encoding the bicarbonate transporter under the control of a functional plant promoter and optionally includes a chloroplast envelope targeting peptide heterologous to the bicarbonate transporter. Methods of making the transgenic plant and transgenic polynucleotide are disclosed.

Schnell, Danny J.↗
DOE OSTI2021

Plants with enhanced yield and methods of construction

Transgenic plants having enhanced yield and having enhanced seed yield are disclosed. The transgenic plants are transformed with a transgenic polynucleotide encoding one or more metabolic enzymes. The metabolic enzymes can be from any biological source. The transgenic polynucleotide(s) comprises a nucleic acid sequences encoding the metabolic enzymes under the control of functional plant promoters, the one or more metabolic enzymes are targeted to the plastids by the addition of plastid targeting signals. Optionally the functional plant promoters are seed specific promoters and the metabolic enzymes are targeted to the plastids by the addition of plastid targeting peptide heterologous to the metabolic enzymes. Methods of making the transgenic plants and transgenic polynucleotides are disclosed. The magnitude of the increases in seed yield achieved with these transgenic plants are simply unprecedented.

Malik, Meghna↗
DOE OSTI2024

Plants with enhanced yield and methods of construction

Transgenic plants having enhanced yield and having enhanced seed yield are disclosed. The transgenic plants are transformed with a transgenic polynucleotide encoding one or more metabolic enzymes. The metabolic enzymes can be from any biological source. The transgenic polynucleotide(s) comprises a nucleic acid sequences encoding the metabolic enzymes under the control of functional plant promoters, the one or more metabolic enzymes are targeted to the plastids by the addition of plastid targeting signals. Optionally the functional plant promoters are seed specific promoters and the metabolic enzymes are targeted to the plastids by the addition of plastid targeting peptide heterologous to the metabolic enzymes. Methods of making the transgenic plants and transgenic polynucleotides are disclosed. The magnitude of the increases in seed yield achieved with these transgenic plants are unprecedented.

Malik, Meghna↗
DOE OSTI2025

An Evaluation of Representation Learning Methods in Particle Physics Foundation Models

We present a systematic evaluation of representation learning objectives for particle physics within a unified framework. Our study employs a shared transformer-based particle-cloud encoder with standardized preprocessing, matched sampling, and a consistent evaluation protocol on a jet classification dataset. We compare contrastive (supervised and self-supervised), masked particle modeling, and generative reconstruction objectives under a common training regimen. In addition, we introduce targeted supervised architectural modifications that achieve state-of-the-art performance on benchmark evaluations. This controlled comparison isolates the contributions of the learning objective, highlights their respective strengths and limitations, and provides reproducible baselines. We position this work as a reference point for the future development of foundation models in particle physics, enabling more transparent and robust progress across the community.

Chen, Michael [Caltech]↗
DOE OSTI2025

Quantum frequency resampling

In signal processing, resampling algorithms can modify the number of resources encoding a collection of data points. Downsampling reduces the cost of storage and communication, while upsampling interpolates new data from limited one, e.g., when resizing a digital image. We present a toolset of quantum algorithms to resample data encoded in the probabilities of a quantum register, using the quantum Fourier transform to adjust the number of high-frequency encoding qubits. We discuss advantage over classical resampling algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Ecological Trait-Based Digital Categorization of Microbial Genomes for Denitrification Potential

Microorganisms encode proteins that function in the transformations of useful and harmful nitrogenous compounds in the global nitrogen cycle. The major transformations in the nitrogen cycle are nitrogen fixation, nitrification, denitrification, anaerobic ammonium oxidation, and ammonification. The focus of this report is the complex biogeochemical process of denitrification, which, in the complete form, consists of a series of four enzyme-catalyzed reduction reactions that transforms nitrate to nitrogen gas. Denitrification is a microbial strain-level ecological trait (characteristic), and denitrification potential (functional performance) can be inferred from trait rules that rely on the presence or absence of genes for denitrifying enzymes in microbial genomes. Despite the global significance of denitrification and associated large-scale genomic and scholarly data sources, there is lack of datasets and interactive computational tools for investigating microbial genomes according to denitrification trait rules. Therefore, our goal is to categorize archaeal and bacterial genomes by denitrification potential based on denitrification traits defined by rules of enzyme involvement in the denitrification reduction steps. We report the integration of datasets on genome, taxonomic lineage, ecosystem, and denitrifying enzymes to provide data investigations context for the denitrification potential of microbial strains. We constructed an ecosystem and taxonomic annotated denitrification potential dataset of 62,624 microbial genomes (866 archaea and 61,758 bacteria) that encode at least one of the twelve denitrifying enzymes in the four-step canonical denitrification pathway. Our four-digit binary-coding scheme categorized the microbial genomes to one of sixteen denitrification traits including complete denitrification traits assigned to 3280 genomes from 260 bacteria genera. The bacterial strains with complete denitrification potential pattern included Arcobacteraceae strains isolated or detected in diverse ecosystems including aquatic, human, plant, and Mollusca (shellfish). The dataset on microbial denitrification potential and associated interactive data investigations tools can serve as research resources for understanding the biochemical, molecular, and physiological aspects of microbial denitrification, among others. The microbial denitrification data resources produced in our research can also be useful for identifying microbial strains for synthetic denitrifying communities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Carbon Additive Manufacturing with a Near-Replica “Green-to-Brown” Transformation

Nanocomposites containing nanoscale materials offer exciting opportunities to encode nanoscale features into macroscale dimensions, which produces unprecedented impact in material design and application. However, conventional methods cannot process nanocomposites with a high particle loading, as well as nanocomposites with the ability to be tailored at multiple scales. A composite architected mesoscale process strategy that brings particle loading nanoscale materials combined with multiscale features including nanoscale manipulation, mesoscale architecture, and macroscale formation to create spatially programmed nanocomposites with high particle loading and multiscale tailorability is reported. The process features a low-shrinking (<10%) “green-to-brown” transformation, making a near-geometric replica of the 3D design to produce a “brown” part with full nanomaterials to allow further matrix infill. Here, this demonstration includes additively manufactured carbon nanocomposites containing carbon nanotubes (CNTs) and thermoset epoxy, leading to multiscale CNTs tailorability, performance improvement, and 3D complex geometry feasibility. The process can produce nanomaterial-assembled architectures with 3D geometry and multiscale features and can incorporate a wide range of matrix materials, such as polymers, metals, and ceramics, to fabricate nanocomposites for new device structures and applications.

36 MATERIALS SCIENCE↗
DOE OSTI2024

GrainGNN: A dynamic graph neural network for predicting 3D grain microstructure

We propose GrainGNN, a surrogate model for the evolution of polycrystalline grain structure under rapid solidification conditions in metal additive manufacturing. High fidelity simulations of solidification microstructures are typically performed using multicomponent partial differential equations (PDEs) with moving interfaces. The inherent randomness of the PDE initial conditions (grain seeds) necessitates ensemble simulations to predict microstructure statistics, e.g., grain size, aspect ratio, and crystallographic orientation. Here, currently such ensemble simulations are prohibitively expensive and surrogates are necessary.In GrainGNN, we use a dynamic graph to represent interface motion and topological changes due to grain coarsening. We use a reduced representation of the microstructure using hand-crafted features; we combine pattern finding and altering graph algorithms with two neural networks, a classifier (for topological changes) and a regressor (for interface motion). Both networks have an encoder-decoder architecture; the encoder has a multi-layer transformer long-short-term-memory architecture; the decoder is a single layer perceptron.We evaluate GrainGNN by comparing it to high-fidelity phase field simulations for in-distribution and out-of-distribution grain configurations for solidification under laser power bed fusion conditions. GrainGNN results in 80%–90% pointwise accuracy; and nearly identical distributions of scalar quantities of interest (QoI) between phase field and GrainGNN simulations compared using Kolmogorov-Smirnov test. GrainGNN's inference speedup (PyTorch on single x86 CPU) over a high-fidelity phase field simulation (CUDA on a single NVIDIA A100 GPU) is 150×–2000× for 100-initial grain problem. Further, using GrainGNN, we model the formation of 11,600 grains in 220 seconds on a single CPU core.

36 MATERIALS SCIENCE↗