Search NASA⌕ Search

SEARCH · Search NASA

Results for “embeddings”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Bootstrap embedding for interacting electrons in phonon coherent-state mean field

Here, we develop a Fermi–Bose bootstrap embedding framework for the ground state of interacting electrons coupled to a phonon mean field. The method combines bootstrap embedding for correlated electrons with a self-consistent coherent-state mean-field treatment for phonons. This method models the interacting electron–phonon problem as a system of correlated electrons traveling in a self-consistently specified potential landscape, allowing for efficient treatment of large lattice systems. Convergence of the methods for fragment size and total system size is demonstrated for the one-dimensional Hubbard–Holstein model for up to 350 sites. Finite-size scaling is performed to extrapolate to the infinite system size. Benchmarking against the density matrix renormalization group for a small 8-site system at half- and quarter-filling shows an orders-of-magnitude runtime advantage. The comparison further reveals that the method performs best in regimes dominated by localization, such as the Mott insulating phase and the strong-coupling tiny polaron regime, where the local embedding ansatz is still valid. However, due to the mean-field treatment for phonons, we find limitations of our methods in the weakly coupled delocalized region and at the Peierls transition, where quantum phonon fluctuations and long-range kinetic correlations become substantial.

Islam, Shariful [North Carolina State University, ↗
DOE OSTI2025

Partial PdAu nanoparticle embedding into TiO 2 support accentuates catalytic contributions from the Au/TiO 2 interface

Despite the broad catalytic relevance of metal–support interfaces, controlling their chemical nature, the interfacial contact perimeter (exposed to reactants), and consequently, their contributions to overall catalytic reactivity, remains challenging, as the nanoparticle and support characteristics are interdependent when catalysts are prepared by impregnation. Here, we decoupled both characteristics by using a raspberry-colloid-templating strategy that yields partially embedded PdAu nanoparticles within well-defined SiO 2 or TiO 2 supports, thereby increasing the metal–support interfacial contact compared to nonembedded catalysts that we prepared by attaching the same nanoparticles onto support surfaces. Between nonembedded PdAu/SiO 2 and PdAu/TiO 2 , we identified a support effect resulting in a 1.4-fold higher activity of PdAu/TiO 2 than PdAu/SiO 2 for benzaldehyde hydrogenation. Notably, partial nanoparticle embedding in the TiO 2 raspberry-colloid-templated support increased the metal–support interfacial perimeter and consequently, the number of Au/TiO 2 interfacial sites by 5.4-fold, which further enhanced the activity of PdAu/TiO 2 by an additional 4.1-fold. Theoretical calculations and in situ surface-sensitive desorption analyses reveal facile benzaldehyde binding at the Au/TiO 2 interface and at Pd ensembles on the nanoparticle surface, explaining the connection between the number of Au/TiO 2 interfacial sites (via the metal–support interfacial perimeter) and catalytic activity. Our results demonstrate partial nanoparticle embedding as a synthetic strategy to produce thermocatalytically stable catalysts and increase the number of catalytically active Au/TiO 2 interfacial sites to augment catalytic contributions arising from metal–support interfaces.

Lim, Kang Rui Garrick (ORCID:0000000321599844)↗
DOE OSTI2025

NEAR: Neural Embeddings for Amino acid Relationships

Protein language models (PLMs) have recently demonstrated potential to supplant classical protein database search methods based on sequence alignment, but are slower than common alignment-based tools and appear to be prone to a high rate of false labeling. Here, we present NEAR, a method based on neural representation learning that is designed to improve both speed and accuracy of search for likely homologs in a large protein sequence database. NEAR’s ResNet embedding model is trained using contrastive learning guided by trusted sequence alignments. It computes per-residue embeddings for target and query protein sequences, and identifies alignment candidates with a pipeline consisting of residue-level k-NN search and a simple neighbor aggregation scheme. Tests on a benchmark consisting of trusted remote homologs and randomly shuffled decoy sequences reveal that NEAR substantially improves accuracy relative to state-of-the-art PLMs, with lower memory requirements and faster embedding and search speed. While these results suggest that the NEAR model may be useful for standalone homology detection with increased sensitivity over standard alignment-based methods, in this manuscript we focus on a more straightforward analysis of the model’s value as a high-speed pre-filter for sensitive annotation. In that context, NEAR is at least 5x faster than the pre-filter currently used in the widely-used profile hidden Markov model (pHMM) search tool HMMER3, and also outperforms the pre-filter used in our fast pHMM tool, nail.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Finite-temperature density matrix embedding theory

We describe a formulation of the density matrix embedding theory at finite temperature. We present a generalization of the ground-state bath orbital construction that embeds a mean-field finite-temperature density matrix up to a given order in the Hamiltonian, or the Hamiltonian up to a given order in the density matrix. In this work, we assess the performance of the finite-temperature density matrix embedding on the one-dimensional Hubbard model both at half-filling and away from it, and the two-dimensional Hubbard model at half-filling, comparing to exact data where available, as well as results from finite-temperature density matrix renormalization group, dynamical mean-field theory, and dynamical cluster approximations. The accuracy of finite-temperature density matrix embedding appears comparable to that of the ground-state theory, with, at most, a modest increase in bath size, and competitive with that of cluster dynamical mean-field theory.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Embedding via the Exact Factorization Approach

We present a quantum electronic embedding method derived from the exact factorization approach to calculate static properties of a many-electron system. The method is exact in principle but the practical power lies in utilizing input from a low-level calculation on the entire system in a high-level method computed on a small fragment, as in other embedding methods. Here, the exact factorization approach defines an embedding Hamiltonian on the fragment. Further, various Hubbard models demonstrate that remarkably accurate ground-state energies are obtained over the full range of weak to strongly correlated systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Augmenting Graph Convolution with Distance Preserving Embedding for Improved Learning

Graph convolution incorporates topological information of a graph into learning. Message passing corresponds to traversal of a local neighborhood in classical graph algorithms. We show that incorporating additional global structures, such as shortest paths, through distance preserving embedding can improve performance. Our approach, Gavotte, significantly improves the performance of a range of popular graph neu-ral networks such as GCN, GA T,Graph SAGE, and GCNII for transductive learning. Gavotte also improves the performance of graph neural networks for full-supervised tasks, albeit to a smaller degree. As high-quality embeddings are generated by Gavotte as a by-product, we leverage clustering algorithms on these embed dings to augment the training set and introduce Gavotte+. Our results of Gavotte+ on datasets with very few labels demonstrate the advantage of augmenting graph convolution with distance preserving embedding.

Cong, Guojing↗
DOE OSTI2020

Low-cost embedded optical sensing systems for distribution transformer monitoring

There is a mounting need for low-cost monitoring with online sensing technologies to maintain grid reliability and uptime. Here we introduce an innovative low-cost, embedded optical sensing technology initially focused on transformers that was developed and demonstrated at a major electric utility, Con Edison. A version of it that can be retrofitted onto existing transformers in the field was also developed. Two new 500 kVA distribution network transformers were built with embedded fiber-optic (FO) sensors and qualified per industry standards. Vibration, temperature, and corrosion were key parameters monitored. The first transformer with embedded FO sensors was installed at a Con Edison facility and monitored at our team’s office. The second one was installed in an urban street-side underground location with online data processing/feature extraction algorithms and monitored through a wireless router. Additionally, an older transformer was also retrofitted. Data analysis was done on these transformers showing promising correlations with their corresponding loading cycles. Furthermore, key events such as the transformer primary-side energizing, and other events were detected. In general, the technology was demonstrated over 6 months across the 3 transformers instrumented with promising results. Thus, it has the potential to enable predictive maintenance for transformers and other grid assets.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Efficient Simulation of Cascading Outages Using an Energy Function-Embedded Quasi-Steady-State Model

Here, this paper proposed an energy function-embedded quasi-steady-state model for efficient simulation of cascading outages on a power grid while addressing transient stability concerns. Compared to quasi-steady-state models, the proposed model incorporates short-term dynamic simulation and an energy function method to efficiently evaluate the transient stability of a power grid together with outage propagation without transient stability simulation. Cascading outage simulation using the proposed model conducts three steps for each disturbance such as a line outage. First, it performs time-domain simulation for a short term to obtain a post-disturbance trajectory. Second, along the trajectory, the system state with the local maximum potential energy is found and used as the initial point to search for a relevant unstable equilibrium by Newton's method. Third, the transient energy margin is estimated based on this unstable equilibrium to predict an out-of-step condition with generators. The proposed energy function-embedded quasi-steady-state model is tested in terms of its accuracy and time performance on an NPCC 140-bus power system and compared to a quasi-steady-state model embedding transient stability simulation.

Guo, Zhenping [Univ. of Tennessee, Knoxville, TN (↗
DOE OSTI2021

REGULATORY REQUIREMENTS, GUIDANCE, AND REVIEW OF EMBEDDED DIGITAL DEVICES IN SAFETY SYSTEMS

Interest in embedded digital devices (EDDs) for monitoring and providing control of components is increasing in the nuclear power market as more and more users both within and outside the nuclear sector are employing EDDs. EDDs in other industries or countries may be known by the related terms as smart devices, devices of limited functionality, or intelligent devices. EDDs can sometimes perform a safety role when embedded in components such as temperature transmitters, pressure transmitters, voltage regulators, gas analyzers, boiler controllers, relays, and radiation monitors. The introduction of EDDs can affect safety by creating new hazards, vulnerabilities, failure modes, triggering mechanisms, and other potential safety concerns at both the component and system levels. The U.S. Nuclear Regulatory Commission’s (NRC’s) existing regulations and guidance cover the use of EDDs in safety-related and important to safety systems in nuclear power plants (NPPs). In addition to potential future challenges, the nature of EDDs being implemented in similar or identical manners between different plants and industries opens up the potential of leveraging the reviews of other regulators or utilization of industry certifications.Key words: embedded digital device, firmware

Halverson, D. S.↗
DOE OSTI2021

A Bayesian Calibration Framework with Embedded Model Error for Model Diagnostics

We study the utility and performance of a Bayesian model error embedding construction in the context of molecular dynamics modeling of metallic alloys, where we embed model error terms in existing interatomic potential model parameters. To alleviate the computational burden of this approach, we propose a framework combining likelihood approximation and Gaussian process surrogates. Here we leverage sparse Gaussian process techniques to construct a hierarchy of increasingly accurate but more expensive surrogate models. This hierarchy is then exploited by multilevel Markov chain Monte Carlo methods to efficiently sample from the target posterior distribution. We illustrate the utility of this approach by calibrating an interatomic potential model for a family of gold-copper alloys. In particular, this case study highlights effective means for dealing with computational challenges with Bayesian model error embedding in large-scale physical models, and the utility of embedded model error for model diagnostics.

Bayesian inference↗
DOE OSTI2025

Toward particle accelerator machine state embeddings as a modality for large language models

Understanding and diagnosing the state of a particle accelerator requires navigating high-dimensional control system data, often involving hundreds of interdependent parameters. We propose a novel multimodal embedding framework that jointly learns representations of machine states from both numerical control system readouts and natural language descriptions. This enables the translation of complex machine conditions into human-readable summaries while maintaining fidelity to the underlying physical system. The obtained embeddings are subsequently adapted to an open-weights large language model via cross-attention conditioning. We demonstrate a first implementation trained on European XFEL machine state data. This work covers the embedding model architecture, training methodology, and presents initial examples demonstrating the model's capabilities in action. Due to the general concept of machine state, the model can be easily adapted to other facilities and control system environments.

Accelerator Physics↗
DOE OSTI2025

Optimal Control for Fast Frequency Response and Black-Start using Embedded Storages with Grid-Forming Control

The grid-forming inverter is regarded as the solution for integrating high levels of renewable resources into future power systems. Ensuring the stable operation of grids necessitates that grid-forming inverters offer fast frequency response. This report introduces an optimal control method that coordinates the embedded storage within the grid-forming control model with conventional synchronous generators. The optimized active power reference for the embedded storage is generated using receding horizon optimization control, aiming to keep the center of inertia frequency within acceptable limits. The effectiveness of the proposed control is verified through testing in the IEEE 39-bus system. In addition, with grid-forming capability, we will also investigate the application of using mobile embedded storages as black-start units to provide cranking power to energize non-blackstart generators in a black-start process.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Understanding Generative AI Content with Embedding Models

The construction of high-quality numerical features is critical to any quantitative data analysis. Feature engineering has been historically addressed by carefully hand-crafting data representations based on domain expertise. This work views the internal representations of modern deep neural networks (DNNs), called embeddings, as an implicit form of traditional feature engineering. For trained DNNs, we show that these embeddings can reveal interpretable, high-level concepts in unstructured sample data. We use these embeddings in natural language and computer vision tasks to uncover both inherent heterogeneity in the underlying data and human-understandable explanations for it. In particular, we find empirical evidence that there is inherent separability between real data and those generated from AI models.

Vargas, Max↗
DOE OSTI2025

Data and Code for Understanding Generative AI Content with Embedding Models

This repository contains code for the experiments in the paper "Understanding Generative AI Content with Embedding Models". Constructing high-quality features is critical to any quantitative data analysis. While feature engineering was historically addressed by carefully hand-crafting data representations based on domain expertise, deep neural networks (DNNs) now offer a radically different approach. DNNs implicitly engineer features by transforming their input data into hidden feature vectors called embeddings. For embedding vectors produced by foundation models -- which are trained to be useful across many contexts -- we demonstrate that simple and well-studied dimensionality-reduction techniques such as Principal Component Analysis uncover inherent heterogeneity in input data concordant with human-understandable explanations. Of the many applications for this framework, we find empirical evidence that there is intrinsic separability between real samples and those generated by artificial intelligence (AI).

Vargas, Max [Pacific Northwest National Laboratory↗
DOE OSTI2023

Direct Ink-Write Printing of Ceramic Clay with an Embedded Wireless Temperature and Relative Humidity Sensor

This research presents a simple method to additively manufacture Cone 5 porcelain clay ceramics by using the direct ink-write (DIW) printing technique. DIW has allowed the application of extruding highly viscous ceramic materials with relatively high-quality and good mechanical properties, which additionally allows a freedom of design and the capability of manufacturing complex geometrical shapes. Clay particles were mixed with deionized (DI) water at different ratios, where the most suitable composition for 3D printing was observed at a 1:5 w/c ratio (16.2 wt.%. of DI water). Differential geometrical designs were printed to demonstrate the printing capabilities of the paste. In addition, a clay structure was fabricated with an embedded wireless temperature and relative humidity (RH) sensor during the 3D printing process. The embedded sensor read up to 65% RH and temperatures of up to 85 °F from a maximum distance of 141.7 m. The structural integrity of the selected 3D printed geometries was confirmed through the compressive strength of fired and non-fired clay samples, with strengths of 70 MPa and 90 MPa, respectively. This research demonstrates the feasibility of using the DIW printing of porcelain clay with embedded sensors, with fully functional temperature- and humidity-sensing capabilities.

42 ENGINEERING↗
DOE OSTI2022

Hexagonal Distributed Embedded Energy Converters (HexDEECs)

The HexDEEC is a small, characteristic length approximating a centimeter, energy transducer that converts the dynamic deformations of its elastomer housing into electricity through a variable capacitance charging-discharging cycle. This device is a type of Distributed Embedded Energy Converter Technology (DEEC-Tec), a new domain for marine renewable energy research that utilizes a conglomeration of small distributed embedded energy converters (DEECs) that, in aggregate, form larger metamaterial frameworks. These resulting DEEC-Tec metamaterials can then, in turn, be used to construct flexible ocean wave energy converters called flexWECs, which can utilize a broad band of ocean wave frequencies and lack highly loaded rigid bodies. These systems also provide new avenues of wave energy harvesting such as actively transforming topologies (e.g., shape and form) and morphologies (e.g., stiffness and damping throughout its entire structure) in real time. Presented, is one specific type of DEEC: the HexDEEC, which is currently being developed by the United States National Renewable Energy Laboratory. This transducer shows promise in aiding the adoption and further development of the DEEC-Tec domain. The following presentation focuses on the promise of this technology and current work being done to analyze the performance of an individual HexDEEC design. The HexDEEC is composed of a hyperelastic hexagonal housing, nominally silicon rubber, with six electrodes on its inner faces. The upper three electrodes share the same charge while the lower three electrodes oppose the upper electrode charges. Externally, the HexDEEC has two arms extending away from the middle vertices of the hexagon. Via principles governing the relationship between electrical capacitance and electrical potential (voltage and charge), electricity is generated when the HexDEEC's arms are dynamically pulled or released under tensile loading, as doing so causes the distance between the upper and lower sets of electrodes to change - varying the energy converter's overall capacitance. Analytical and numerical modeling is being used to evaluate the mechanics and electrical energy generated by the HexDEEC. Equations to describe the capacitance and electrostatic forces acting on this unique system have been developed and implemented into the numerical modeling software STAR-CCM+, along with models to describe its hyperelastic material, such as the Mooney-Rivlin 3-parameter model. So far, an initial design has been analyzed and we plan to further optimize it to increase power production. Individual HexDEECs have been fabricated by drawing uncured liquid silicon rubber into molds via vacuum pressure. To simplify manufacturing, HexDEEC sub-components - e.g., electrodes, wires - can be placed within those molds such that they are directly embedded into the hexagonal housing during the curing process. Furthermore, DEEC-Tec metamaterials can be created by interweaving or sequentially layering multiple HexDEEC strands together. The HexDEEC based metamaterial could then generate electricity through its gross deformations. Ultimately, HexDEECs represent a specific type of energy transducer that can be leveraged, by the DEEC-Tec domain, to create metamaterials used to construct novel flexWECs.

DEEC-Tec↗
DOE OSTI2022

Method for fabricating embedded nanostructures with arbitrary shape

A layered heterostructure, comprising alternating layers of different semiconductors, wherein one of the atom species of one of the semiconductors has a faster diffusion rate along an oxidizing interface than an atom species of the other semiconductor at an oxidizing temperature, can be used to fabricate embedded nanostructures with arbitrary shape. The result of the oxidation will be an embedded nanostructure comprising the semiconductor having slower diffusing atom species surrounded by the semiconductor having the higher diffusing atom species. The method enables the fabrication of low- and multi-dimensional quantum-scale embedded nanostructures, such as quantum dots (QDs), toroids, and ellipsoids.

Wang, George T.↗
DOE OSTI2022

Hexagonal Distributed Embedded Energy Converters (HexDEECs)

Distributed Embedded Energy Converter Technologies (DEEC-Tec) is a new domain for marine renewable energy research that utilizes a conglomeration of small distributed embedded energy converters (DEECs) that, in aggregate, form larger metamaterial frameworks. These resulting DEEC-Tec metamaterials can then, in turn, be used to construct flexible ocean wave energy converters called flexWECs. DEEC-Tec enables flexWECs: (i) to be inherently broad-banded ocean wave frequency energy converters and (ii) to have an inherent lack of highly loaded rigid bodies. The DEEC-Tec domain also benefits the marine renewable energy domain by inherently availing ways that marine energy can be harvested and converted that heretofore has not yet been considered possible: real-time execution of transforming topologies (e.g., actively changing a flexWEC's shape and form) and morphologies (e.g., actively changing a flexWEC's stiffness and damping throughout its entire structure). Presented, is one specific type of DEEC, a HexDEEC, that shows promise in aiding the adoption and further development of the DEEC-Tec domain - it is a small energy transducer being developed by the United States National Renewable Energy Laboratory. The HexDEEC is a small (characteristic length approximating a centimeter) energy transducer that converts the dynamic deformations of an elastomer into electricity through a charging-discharging cycle of a capacitor whose capacitance is varied by those elastic deformations. The HexDEEC is composed of a hyperelastic hexagonal housing (nominally silicon rubber) with six electrodes on its inner faces. The upper three electrodes share the same charge while the lower three electrodes oppose the upper electrode charges. Externally, the HexDEEC has two arms extending away from the middle vertices of the hexagon. Via principles governing the relationship between electrical capacitance and electrical potential (voltage and charge), electricity is generated when the HexDEEC's arms are dynamically pulled or released under tensile loading as doing so causes the distance between the upper and lower sets of electrodes to change - varying the energy converter's overall capacitance. Analytical and numerical modeling have already been used to estimate the electrical energy produced by a HexDEEC. The cursory models approximate the HexDEEC as a parallel plate variable capacitor - simplifying from six to two opposing plates with a constant dielectric volume between those two plates. To account for the elastic HexDEEC material properties, software such as SolidWorks and STAR-CCM+ have been used to generate hyperelastic models; notably, Mooney-Rivlin based models. Individual HexDEECs have been fabricated by drawing uncured liquid silicon rubber into molds via vacuum pressure. To simplify manufacturing, HexDEEC sub-components - e.g., electrodes, wires - can be placed within those molds such that they are directly embedded into the hexagonal housing during the curing process. Furthermore, DEEC-Tec metamaterials can be created by interweaving or sequentially layering multiple HexDEEC strands together. The HexDEEC based metamaterial could then generate electricity through its gross deformations. Ultimately, HexDEECs represent a specific type of energy transducer that can be leveraged, by the DEEC-Tec domain, to create metamaterials used to construct novel flexWECs.

DEEC-Tec↗