Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer encoder”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Equivalence between Fermion-to-Qubit Mappings in two Spatial Dimensions

We argue that all locality-preserving mappings between fermionic observables and Pauli matrices on a two-dimensional lattice can be generated from the exact bosonization in Chen et al., whose gauge constraints project onto the subspace of the toric code with emergent fermions. Starting from the exact bosonization and applying Clifford finite-depth generalized local unitary transformation, we can achieve all possible fermion-to-qubit mappings (up to the re-pairing of Majorana fermions). In particular, we discover a new supercompact encoding using 1.25 qubits per fermion on the square lattice. We prove the existence of finite-depth quantum circuits to obtain fermion-to-qubit mappings with qubit-fermion ratios r = 1 + 1/2k for positive integers k, utilizing the trivialness of quantum cellular automata in two spatial dimensions. Also, we provide direct constructions of fermion-to-qubit mappings with ratios arbitrarily close to 1. When the ratio reaches 1, the fermion-to-qubit mapping reduces to the one-dimensional Jordan-Wigner transformation along a certain path in the two-dimensional lattice. Finally, we explicitly demonstrate that the Bravyi-Kitaev superfast simulation, the Verstraete-Cirac auxiliary method, Kitaev’s exactly solved model, the Majorana loop stabilizer codes, and the compact fermion-to-qubit mapping can all be obtained from the exact bosonization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Block encoding bosons by signal processing

Block Encoding (BE) is a crucial subroutine in many modern quantum algorithms, including those with near-optimal scaling for simulating quantum many-body systems, which often rely on Quantum Signal Processing (QSP). Currently, the primary methods for constructing BEs are the Linear Combination of Unitaries (LCU) and the sparse oracle approach. In this work, we demonstrate that QSP-based techniques, such as Quantum Singular Value Transformation (QSVT) and Quantum Eigenvalue Transformation for Unitary Matrices (QETU), can themselves be efficiently utilized for BE implementation. Specifically, we present several examples of using QSVT and QETU algorithms, along with their combinations, to block encode Hamiltonians for lattice bosons, an essential ingredient in simulations of high-energy physics. We also introduce a straightforward approach to BE based on the exact implementation of Linear Operators Via Exponentiation and LCU (LOVE-LCU). We find that, while using QSVT for BE results in the best asymptotic gate count scaling with the number of qubits per site, LOVE-LCU outperforms all other methods for operators acting on up to qubits, highlighting the importance of concrete circuit constructions over mere comparisons of asymptotic scalings. Using LOVE-LCU to implement the BE, we simulate the time evolution of single-site and two-site systems in the lattice theory using the Generalized QSP algorithm and compare the gate counts to those required for Trotter simulation.

Kane, Christopher F↗

Efficient Fourier transforms for transverse momentum dependent distributions

Hadron production at low transverse momenta in semi-inclusive deep inelastic scattering can be described by transverse momentum dependent (TMD) factorization. This formalism has also been widely used to study the Drell-Yan process and back-to-back hadron pair production in $e^+e^-$ collisions. These processes are the main ones for extractions of TMD parton distribution functions and TMD fragmentation functions, which encode important information about nucleon structure and hadronization. One of the most widely used TMD factorization formalism in phenomenology formulates TMD observables in coordinate $b_\perp$-space, the conjugate space of the transverse momentum. The Fourier transform from $b_\perp$-space back into transverse momentum space is sufficiently complicated due to oscillatory integrands that it requires a careful and computationally intensive numerical treatment in order to avoid potentially large numerical errors. Within the TMD formalism, the azimuthal angular dependence is analytically integrated and the two-dimensional $b_\perp$ integration reduces to a one-dimensional integration over the magnitude $b_\perp$. In this paper we develop a fast numerical Hankel transform algorithm for such a $b_\perp$-integration that improves the numerical accuracy of TMD calculations in all standard processes. Libraries for this algorithm are implemented in Python 2.7 and 3, C++, as well as FORTRAN77. All packages are made available open source.

97 MATHEMATICS AND COMPUTING↗

The anaerobic fungus Neocallimastix californiae shifts metabolism and produces melanin in response to lignin-derived aromatic compounds

Biological deconstruction of lignocellulose for sustainable chemical production offers an opportunity to harness evolutionarily specialized enzymes and organisms for industrial bioprocessing. While hydrolysis of cellulose and hemicellulose by CAZymes yields fermentable sugars, ligninolysis releases a heterogeneous mix of aromatic compounds that likely play a crucial role in shaping microbial communities and microbial metabolism. Here, we interrogated the metabolomic and transcriptomic response of a lignocellulolytic anaerobic fungus, Neocallimastix californiae, to a heterogeneous mixture of aromatic compounds derived from lignin. Through exposing the fungus to both a concentration it might experience in its native environment and an elevated concentration of alkaline lignin, we observe that N. californiae transforms vanillin and that supplying alkaline lignin at 0.125 g/L, alongside cellulose, enhances the growth and polysaccharide-degrading activity of N. californiae. Altogether, our results further suggest that vanillin consumption, increased polymer-degrading activity, increased metabolic activity, and transcriptomic remodeling of amino acid synthesis genes all coincide with increased melanin production by fungal cells. These observations challenge previous notions that aromatics from lignocellulose only inhibit the growth and polymer deconstruction capabilities of the biomass-degrading anaerobic fungi (Neocallimastigomycetes). This study demonstrates that anaerobic fungi have a complex relationship with aromatic chemicals derived from lignin and hemicellulose and shift their metabolism in response to the addition of lignocellulose-derived aromatics to their growth medium. Further, as no known pathways for the biochemical transformation of aromatics were detected in these organisms despite observed transcriptome remodeling in the presence of aromatics, we suggest they might encode novel biochemical routes for scavenging amino acid building blocks from aromatic monomers derived from hemicellulose side chains and lignin.

Anaerobic fungi↗

Fractal image compression: A resolution independent representation for imagery

A deterministic fractal is an image which has low information content and no inherent scale. Because of their low information content, deterministic fractals can be described with small data sets. They can be displayed at high resolution since they are not bound by an inherent scale. A remarkable consequence follows. Fractal images can be encoded at very high compression ratios. This fern, for example is encoded in less than 50 bytes and yet can be displayed at resolutions with increasing levels of detail appearing. The Fractal Transform was discovered in 1988 by Michael F. Barnsley. It is the basis for a new image compression scheme which was initially developed by myself and Michael Barnsley at Iterated Systems. The Fractal Transform effectively solves the problem of finding a fractal which approximates a digital 'real world image'.

Sloan, Alan D.↗

Hierarchical structure analysis of interstellar clouds using nonorthogonal wavelets

We introduce the use of Laplacian pyramid transforms, a form of nonorthogonal wavelets, to analyze the structure of interstellar clouds. These transforms are generally better suited for analyzing structure than orthogonal wavelets because they provide more flexibility in the structure of the encoding functions - here circularly symmetric bandpass filters. This technique is applied to CO maps of Barnard 5. In the (C-13)O maps, for example, we identify 60 different fragments and clumps, as well as several cavities, or bubbles. Many features show evidence of hierarchical structure, with most of the power in the largest wavelengths. The clumps have a more chaotic structure at small wavelengths than expected for Kolmogorov turbulence, and a mass distribution proportional to M exp -5/3. The structure analysis is consistent with a picture where gravity, energy injection, compressible turbulence, and coalescence play an important role in the dynamics of B5.

Langer, William D.↗

Recombinant protein production and insect cell culture and process

A process has been developed for recombinant production of selected polypeptides using transformed insect cells cultured in a horizontally rotating culture vessel modulated to create low shear conditions. A metabolically transformed insect cell line is produced using the culture procedure regardless of genetic transformation. The recombinant polypeptide can be produced by an alternative process using the cultured insect cells as host for a virus encoding the described polypeptide such as baculovirus. The insect cells can also be a host for viral production.

Spaulding, Glenn↗

Gravitational memory and Ward identities in the local detector frame

Gravitational memory, which describes the permanent shift in the strain after the passage of gravitational waves, is directly related to Weinberg’s soft graviton theorems and the Bondi-Metzner-Sachs (BMS) symmetry group of asymptotically flat space-times. In this work, we provide an equivalent description of the phenomenon in local coordinates around gravitational wave detectors, such as transverse-traceless (TT) gauge. We show that gravitational memory is encoded in large residual diffeomorphisms in this gauge, which include time-dependent anisotropic spatial rescalings, and prove their equivalence to BMS transformations when translated to TT gauge. We then derive the associated Ward identities and associated soft theorems, for both scattering amplitudes and equal-time (in-in) correlation functions, and explicitly check their validity for planar gravitational waves. Furthermore, the in-in identities are recognized as the flat-space analog of the well-known inflationary consistency relations.

General relativity↗

Improved Compression of Wavelet-Transformed Images

A recently developed data-compression method is an adaptive technique for coding quantized wavelet-transformed data, nominally as part of a complete image-data compressor. Unlike some other approaches, this method admits a simple implementation and does not rely on the use of large code tables. A common data compression approach, particularly for images, is to perform a wavelet transform on the input data, and then losslessly compress a quantized version of the wavelet-transformed data. Under this compression approach, it is common for the quantized data to include long sequences, or runs, of zeros. The new coding method uses prefixfree codes for the nonnegative integers as part of an adaptive algorithm for compressing the quantized wavelet-transformed data by run-length coding. In the form of run-length coding used here, the data sequence to be encoded is parsed into strings consisting of some number (possibly 0) of zeros, followed by a nonzero value. The nonzero value and the length of the run of zeros are encoded. For a data stream that contains a sufficiently high frequency of zeros, this method is known to be more effective than using a single variable length code to encode each symbol. The specific prefix-free codes used are from two classes of variable-length codes: a class known as Golomb codes, and a class known as exponential-Golomb codes. The codes within each class are indexed by a single integer parameter. The present method uses exponential-Golomb codes for the lengths of the runs of zeros, and Golomb codes for the nonzero values. The code parameters within each code class are determined adaptively on the fly as compression proceeds, on the basis of statistics from previously encoded values. In particular, a simple adaptive method has been devised to select the parameter identifying the particular exponential-Golomb code to use. The method tracks the average number of bits used to encode recent runlengths, and takes the difference between this average length and the code parameter. When this difference falls outside a fixed range, the code parameter is updated (increased or decreased). The Golomb code parameter is selected based on the average magnitude of recently encoded nonzero samples. The coding method requires no floating- point operations, and more readily adapts to local statistics than other methods. The method can also accommodate arbitrarily large input values and arbitrarily long runs of zeros. In practice, this means that changes in the dynamic range or size of the input data set would not require a change to the compressor. The algorithm has been tested in computational experiments on test images. A comparison with a previously developed algorithm that uses large code tables (generated via Huffman coding on training data) suggests that the data-compression effectiveness of the present algorithm is comparable to the best performance achievable by the previously developed algorithm.

Kiely, Aaron↗

High-Speed Scanning Interferometer Using CMOS Image Sensor and FPGA Based on Multifrequency Phase-Tracking Detection

A sub-aperture stitching optical interferometer can provide a cost-effective solution for an in situ metrology tool for large optics; however, the currently available technologies are not suitable for high-speed and real-time continuous scan. NanoWave s SPPE (Scanning Probe Position Encoder) has been proven to exhibit excellent stability and sub-nanometer precision with a large dynamic range. This same technology can transform many optical interferometers into real-time subnanometer precision tools with only minor modification. The proposed field-programmable gate array (FPGA) signal processing concept, coupled with a new-generation, high-speed, mega-pixel CMOS (complementary metal-oxide semiconductor) image sensor, enables high speed (>1 m/s) and real-time continuous surface profiling that is insensitive to variation of pixel sensitivity and/or optical transmission/reflection. This is especially useful for large optics surface profiling.

Ohara, Tetsuo↗

Design and performance of AI agents interfacing with an atomic layer deposition tool

In this work, we introduce the design of an atomic layer deposition (ALD) reactor augmented with an AI interface for autonomous materials synthesis. Our modular design encapsulates the particularities of the hardware behind a Python interface that communicates with the ALD control software via transmission control protocol. This interface is compatible with model context protocol interfaces used in agentic frameworks. We have integrated our tool with a simple AI agent that leverages a large language model to transform user-supplied queries into ALD processes that are then run in our reactor. Our approach uses a JavaScript object notation schema to encode ALD processes. Our experimental results show that the AI interface does not impose a significant overhead to our control software, at least within our fastest 10 ms scale. We also carried out a detailed evaluation of the agent performance using leading models in two classes of tasks: basic instruction and process discovery tasks, where the agent is presented with a target material and needs to identify the correct ALD process compatible with the reactor configuration. Despite the simplicity of our agent design, we observed that most of the advanced models excelled at the instruction tasks. However, only recent models, such as o1, o3, GPT-5, and Claude Opus 4, performed well in process discovery tasks. We also observed significant variability in the response for the hardest challenges. While the results obtained are promising, we identify areas where AI research could improve the performance of agents for ALD.

47 OTHER INSTRUMENTATION↗

Multiscale Data-Driven Seismic Full-Waveform Inversion With Field Data Study

Seismic full-waveform inversion (FWI), which uses iterative methods to estimate high-resolution subsurface models from seismograms, is a powerful imaging technique in exploration geophysics. In recent years, the computational cost of FWI has grown exponentially due to the increasing size and resolution of seismic data. Moreover, it is a nonconvex problem and can encounter local minima due to the limited accuracy of the initial velocity models or the absence of low frequencies in the measurements. To overcome these computational issues, we develop a multiscale data-driven FWI method based on fully convolutional networks (FCNs). In preparing the training data, we first develop a real-time style transform method to create a large set of synthetic subsurface velocity models from natural images. We then develop two convolutional neural networks with encoder-decoder structures to reconstruct the low- and high-frequency components of the subsurface velocity models, separately. To validate the performance of our data-driven inversion method and the effectiveness of the synthesized training set, we compare it with conventional physics-based waveform inversion approaches using both synthetic and field data. Finally, these numerical results demonstrate that, once our model is fully trained, it can significantly reduce the computation time and yield more accurate subsurface velocity models in comparison with conventional FWI.

58 GEOSCIENCES↗

High-dimensional discrete Fourier transform gates with a quantum frequency processor

The discrete Fourier transform (DFT) is of fundamental interest in photonic quantum information, yet the ability to scale it to high dimensions depends heavily on the physical encoding, with practical recipes lacking in emerging platforms such as frequency bins. In this article, we show that d -point frequency-bin DFTs can be realized with a fixed three-component quantum frequency processor (QFP), simply by adding to the electro-optic modulation signals one radio-frequency harmonic per each incremental increase in d . We verify gate fidelity F W > 0.9997 and success probability P W > 0.965 up to d = 10 in numerical simulations, and experimentally implement the solution for d = 3, utilizing measurements with parallel DFTs to quantify entanglement and perform tomography of multiple two-photon frequency-bin states. Our results furnish new opportunities for high-dimensional frequency-bin protocols in quantum communications and networking.

97 MATHEMATICS AND COMPUTING↗

Why Is Attention Sparse In Particle Transformer?

Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a leading example of such models. A striking feature of ParT is its sparse, nearly binary, attention structure, raising questions about the origin of this behavior and whether it encodes physically meaningful correlations. In this work, we investigate the source of ParT's sparse attention by comparing models trained on multiple benchmark datasets and examine the relative contributions of the attention term and the physics-inspired interaction matrix before softmax. We find that binary sparsity arises primarily from the attention mechanism itself, with the interaction matrix playing a secondary role. Moreove, we show that ParT is able to identify key jet substructure elements, such as leptons in semileptonic top decays, even without explicit particle identification inputs. These results provide new insight into the interpretability of transformer-based jet taggers and clarify the conditions under which sparse attention patterns emerge in ParT.

Legge, Timothy [UC, San Diego]↗

Deletion of biofilm synthesis in Eubacterium limosum ATCC 8486 improves handling and transformation efficiency

Abstract Eubacterium limosum is an acetogenic bacterium of potential industrial relevance for its ability to efficiently metabolize a range of single carbon compounds. However, extracellular polymeric substance (EPS) produced by the type strain ATCC 8486 is a serious impediment to bioprocessing and genetic engineering. To remove these barriers, here we bioinformatically identified genes involved in EPS biosynthesis, and targeted several of the most promising candidates for inactivation, using a homologous recombination-based approach. Deletion of a single genomic region encoding homologues for epsABC, ptkA, and tmkA resulted in a strain incapable of producing EPS. This strain is significantly easier to handle by pipetting and centrifugation, and retains important wild-type phenotypes including the ability to grow on methanol and carbon dioxide and limited oxygen tolerance. Additionally, this strain is also more genetically tractable with a 2-fold increase in transformation efficiency compared to the highest previous reports. This work advances a simple, rapid protocol for gene knockouts in E. limosum using only the native homologous recombination machinery. These results will hasten the development of this organism as a workhorse for valorization of single carbon substrates, as well as facilitate exploration of its role in the human gut microbiota.

Sanford, Patrick A.↗

Denoising Seismograms in the Time Domain Using a Deep Learning Model

Deep learning has emerged as a transformative tool for enhancing the extraction of reliable information from seismograms, addressing the increasing demand for precise and efficient seismic data analysis. We introduce an innovative encoder–decoder deep learning model, named WaveDenoiser, designed for noise reduction in the time domain, thereby eliminating the need for spectrogram computations that have been used for existing deep learning tools and significantly improving processing speed. Utilizing the benchmark dataset that is Stanford Earthquake Dataset, we developed three models of varying sizes: base, medium, and large. Notably, the large (referred to as WaveDenoiser) model demonstrated superior performance, achieving a median signal‐to‐noise ratio improvement of 8.8 dB on in‐distribution unseen data (in the same geographic region) and 7.7 dB on out‐distribution unseen data (in a new geographic region), outpacing both the base and medium models. Further evaluation of the WaveDenoiser model revealed a reduction in median arrival‐time errors by 0.02 s for P waves and 0.01 s for S waves when processing waveforms prior to phase picking using PhaseNet on in‐distribution unseen data. When tested on out‐distribution unseen data, the model also effectively reduced the P‐wave median arrival‐time error by 0.02 and 0.01 s in median arrival‐time error for S waves. Importantly, the application of WaveDenoiser resulted in a significant reduction of phase picking outliers by 1.1% to 3.6% for both P and S waves. In addition, we achieved over five times acceleration in processing speed compared with the seisBench implementation of DeepDenoiser. Our findings underscore the potential of WaveDenoiser as a powerful tool for improving seismic data analysis and processing efficiency.

P-waves↗

Digital TV processing system

Two digital video data compression systems directly applicable to the Space Shuttle TV Communication System were described: (1) For the uplink, a low rate monochrome data compressor is used. The compression is achieved by using a motion detection technique in the Hadamard domain. To transform the variable source rate into a fixed rate, an adaptive rate buffer is provided. (2) For the downlink, a color data compressor is considered. The compression is achieved first by intra-color transformation of the original signal vector, into a vector which has lower information entropy. Then two-dimensional data compression techniques are applied to the Hadamard transformed components of this last vector. Mathematical models and data reliability analyses were also provided for the above video data compression techniques transmitted over a channel encoded Gaussian channel. It was shown that substantial gains can be achieved by the combination of video source and channel coding.

Source record↗

Anaerobic benzene oxidation in Geotalea daltonii involves activation by methylation and is regulated by the transition state regulator AbrB

ABSTRACT Benzene is a widespread groundwater contaminant that persists under anoxic conditions. The aim of this study was to more accurately investigate anaerobic microbial degradation pathways to predict benzene fate and transport. Preliminary genomic analysis of Geotalea daltonii strain FRC-32, isolated from contaminated groundwater, revealed the presence of putative aromatic-degrading genes. G. daltonii was subsequently shown to conserve energy for growth on benzene as the sole electron donor and fumarate or nitrate as the electron acceptor. The hbs gene, encoding for 3-hydroxybenzylsuccinate synthase (Hbs), a homolog of the radical-forming, toluene-activating benzylsuccinate synthase (Bss), was upregulated during benzene oxidation in G. daltonii , while the bss gene was upregulated during toluene oxidation. Addition of benzene to the G. daltonii whole-cell lysate resulted in toluene formation, indicating that methylation of benzene was occurring. Complementation of σ 54 - (deficient) E. coli transformed with the bss operon restored its ability to grow in the presence of toluene, revealing bss to be regulated by σ 54 . Binding sites for σ 70 and the transition state regulator AbrB were identified in the promoter region of the σ 54 -encoding gene rpoN, and binding was confirmed. Induced expression of abrB during benzene and toluene degradation caused G. daltonii cultures to transition to the death phase. Our results suggested that G. daltonii can anaerobically oxidize benzene by methylation, which is regulated by σ 54 and AbrB. Our findings further indicated that the benzene, toluene, and benzoate degradation pathways converge into a single metabolic pathway, representing a uniquely efficient approach to anaerobic aromatic degradation in G. daltonii . IMPORTANCE The contamination of anaerobic subsurface environments including groundwater with toxic aromatic hydrocarbons, specifically benzene, toluene, ethylbenzene, and xylene, has become a global issue. Subsurface groundwater is largely anoxic, and further study is needed to understand the natural attenuation of these compounds. This study elucidated a metabolic pathway utilized by the bacterium Geotalea daltonii capable of anaerobically degrading the recalcitrant molecule benzene using a unique activation mechanism involving methylation. The identification of aromatic-degrading genes and AbrB as a regulator of the anaerobic benzene and toluene degradation pathways provides insights into the mechanisms employed by G. daltonii to modulate metabolic pathways as necessary to thrive in anoxic contaminated groundwater. Our findings contribute to the understanding of novel anaerobic benzene degradation pathways that could potentially be harnessed to develop improved strategies for bioremediation of groundwater contaminants.

Bullows, James E.↗