SEARCH · Search NASA

Results for “embeddings”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Visualizing Temporal Topic Embeddings with a Compass

—Dynamic topic modeling is useful at discovering the development and change in latent topics over time. However, present methodology relies on algorithms that separate document and word representations. This prevents the creation of a meaningful embedding space where changes in word usage and documents can be directly analyzed in a temporal context. This paper proposes an expansion of the compass-aligned temporal Word2Vec methodology into dynamic topic modeling. Such a method allows for the direct comparison of word and document embeddings across time in dynamic topics. This enables the creation of visualizations that incorporate temporal word embeddings within the context of documents into topic visualizations. In experiments against the current state-of-the-art, our proposed method demonstrates overall competitive performance in topic relevancy and diversity across temporal datasets of varying size. Simultaneously, it provides insightful visualizations focused on temporal word embeddings while maintaining the insights provided by global topic evolution, advancing our understanding of how topics evolve over time.

Cluster analysis↗

DOE OSTI2022

An energy-based study of the embedded element method for explicit dynamics

Abstract The embedded finite element technique provides a unique approach for modeling of fiber-reinforced composites. Meshing fibers as distinct bundles represented by truss elements embedded in a matrix material mesh allows for the assignment of more specific material properties for each component rather than homogenization of all of the properties. However, the implementations of the embedded element technique available in commercial software do not replace the material of the matrix elements with the material of the embedded elements. This causes a redundancy in the volume calculation of the overlapping meshes leading to artificially increased stiffness and mass. This paper investigates the consequences in the energy calculations of an explicit dynamic model due to this redundancy. A method for the correction of the edundancy within a finite element code is suggested which removes extra energy and is shown to be effective at correcting the energy calculations for large amounts of redundant volume.

Martin, Valerie A.↗

DOE OSTI2021

Enabling Interoperable SCADA Communications for PV Inverters through Embedded Controllers

The percentage integration of photovoltaic (PV) inverters in the field has increased significantly in the past 5 years. Regardless of the size of the PV plants and the inverters (residential vs. commercial), it is becoming crucial that these devices have the capability to communicate with peers (other smart devices) and with components that are at a hierarchy above the inverters (e.g., supervisory control and data acquisition (SCADA) systems, distributed controllers, and data managers). This project aims to develop a standard SCADA software code for inverters’ embedded controllers that will enable interoperability with other components in the system. To achieve this, the code will be developed using two different protocols: Distributed Network Protocol 3 and International Electrotechnical Commission 61850. The developed code is aimed to be deployed in simple embedded controllers. It will be tested in the National Renewable Energy Laboratory’s (NREL’s) Energy Systems Integration Facility. The tested code will then be made available through Triangle MicroWorks’s (TMW’s) software platform. The primary objectives of this project include training the NREL team with TMW’s embedded controller libraries, developing an interoperable communication code for embedded controllers, successfully testing and deploying the code, and demonstrating the newly developed code in a conference.

14 SOLAR ENERGY↗

DOE OSTI2024

AOI [1] Advanced Manufacturing of Ceramic Anchors with Embedded Sensors for Process and Health Monitoring of Coal Boilers

Researchers at West Virginia University (WVU) developed methods to fabricate and test ceramic anchors with an embedded sensor technology for monitoring the health and processing conditions within pulverized coal (PC) and fluidized-bed combustion (FBC) boiler systems. The technology included the development of advanced manufacturing processes for 2D/3D printing electroceramic (conductive ceramic) sensor designs within the ceramic anchor microstructure during the manufacturing process. This advanced manufacturing process would allow for the precise control of local microstructure and composition in order to engineer layer-by-layer any protective and electrically active materials within the refractory anchor. This 3D printing technology would permit the rapid and controlled design of the refractory microstructure and embedded sensor design throughout the volume of the ceramic anchor. The work also included a method to interconnect the sensors to boiler shell through the anchor clamp, where the sensor signals will be processed by low-power electronics and transmitted wirelessly to a central processing hub. The end-goal of the program was to produce a ceramic anchor sensor system which would be ready for implementation within a coal boiler, and/or other similar refractory liner systems (such as that in the glass and metal manufacturing areas). The project objectives were to: 1) Define the chemical and microstructural stability, in addition to the electrical properties, of oxide and non-oxide ceramic composites to be embedded within the ceramic anchor compositions that may operate up to 1400ºC; 2) Develop and implement the 2D/3D printing technology to pattern and control the microstructure of the ceramic anchor and embedded sensor circuits; 3) Develop an interconnect technology which will permit easy installation of the ceramic anchors and signal collection at the boiler shell; 4) Develop low power analog electronics and wireless communication hardware to efficiently collect the sensor signal at each processing unit and transmit data to a central hub for data analysis; 5) Demonstrate the smart ceramic anchor system for temperature and liner fracture within a high-temperature processing unit, such as a boiler furnace or glass melting furnace floor/wall liner.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2021

The Twins Embedding of Type Ia Supernovae. II. Improving Cosmological Distance Estimates

We show how spectra of Type Ia supernovae (SNe Ia) at maximum light can be used to improve cosmological distance estimates. In a companion article, we used manifold learning to build a three-dimensional parameterization of the intrinsic diversity of SNe Ia at maximum light that we call the "Twins Embedding."In this article, we discuss how the Twins Embedding can be used to improve the standardization of SNe Ia. With a single spectrophotometrically calibrated spectrum near maximum light, we can standardize our sample of SNe Ia with an rms of 0.101 0.007 mag, which corresponds to 0.084 0.009 mag if peculiar velocity contributions are removed and to 0.073 0.008 mag if a larger reference sample were obtained. Our techniques can standardize the full range of SNe Ia, including those typically labeled as peculiar and often rejected from other analyses. We find that traditional light-curve width + color standardization such as SALT2 is not sufficient. The Twins Embedding identifies a subset of SNe Ia, including, but not limited to, 91T-like SNe Ia whose SALT2 distance estimates are biased by 0.229 0.045 mag. Standardization using the Twins Embedding also significantly decreases host-galaxy correlations. We recover a host mass step of 0.040 0.020 mag compared to 0.092 0.026 mag for SALT2 standardization on the same sample of SNe Ia. These biases in traditional standardization methods could significantly impact future cosmology analyses if not properly taken into account.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Experiments and Modeling of Proppant Embedment and Fracture Conductivity for the Caney Shale, Oklahoma, USA

ABSTRACT: The ultimate aim of hydraulic fracturing is to have a long and conductive flow path that extends from the wellbore into the formation. The effective fracture length is part of a hydraulically propped fracture which contributes to production. The difficulty in achieving economical production targets from shale reservoirs is at the forefront in many exploration companies. Fracture conductivity loss is related to; proppant embedment under depletion, proppant crushing, damage as a result of fracturing fluid, fines migration and proppant-pack permeability-damage are some of the factors that contribute to production decline after hydraulic fracturing in shale reservoirs. The Caney Shale is a calcareous organic-rich mudrock. Various studies have investigated the effect that clay on shale well productivity, however, there is currently no literature on the Caney shale in relation to horizontal wells; all available literature exists in vertical wells as well as on formations of the Caney that are shallow in comparison to an emerging play which is twice the depth. In this paper we investigate stress-dependent fracture conductivity of proppant-filled fractures and proppant embedment in Caney shale through laboratory and modeling studies. API fracture conductivity tests were conducted using 2% KCl on five locations within the Caney shale that consisted of selecting three brittle(reservoir) zones and two ductile zones. Confining pressures range from 1,000 psi to 12,000 psi at 210°F. Conductivity, permeability as well as embedment were measured during the test. Our experimental results have confirmed that improved fracture conductivity is attributed to; proppant size, the increase in porosity of the proppant pack, closure pressure changes and the reduction in fracture conductivity are a function of many factors such as fracture closure stress. The findings from this study could help the stimulation design by providing new insights into the critical factors that are to be determined to facilitate the choice of proppants as well as fracturing fluids for long term production and recovery from shale reservoirs. 1 INTRODUCTION The development of low permeability formations, like shales, has been aided by hydraulic fracturing of horizontal wells (Radonjic et al., 2020). Hydraulic fracturing fluid is injected at a high pressure to induce tensile fractures that can link to and stimulate natural fractures (Katende et al., 2021a,b). Preserving adequate conductivity in hydraulic fractures over the life of the wells is required for economic production; nevertheless, conserving such conductivity can be difficult in some circumstances, particularly in soft, clay-rich formations (Wang et al., 2021). Proppant particles help to keep the fractures open when the pumping stops and the fracturing fluid returns to the wellbore, producing one or more propped hydraulic fractures of varying length, breadth, and height (Katende et al., 2021a). The proppant pack within the hydraulic fracture boosts well output by providing a greater permeability flowpath for hydrocarbons (Duenckel et al., 2016). Proppant in the fracture is under complicated stress conditions, and the interplay between the rock formation and the proppant pack has a significant impact on proppant-pack permeability (Karazincir et al., 2019). Proppant may be embedded (Katende et al., 2021a) in the rock or crushed into small pieces if the proppant size and strength characteristics are not specified appropriately, resulting in a loss in proppant-pack permeability and fracture aperture, and consequently a fall in well output.

Katende, A.↗

DOE OSTI2020

Track Seeding and Labelling with Embedded-space Graph Neural Networks

To address the unprecedented scale of HL-LHC data, the Exa.TrkX project is investigating a variety of machine learning approaches to particle track reconstruction. The most promising of these solutions, graph neural networks (GNN), process the event as a graph that connects track measurements (detector hits corresponding to nodes) with candidate line segments between the hits (corresponding to edges). Detector information can be associated with nodes and edges, enabling a GNN to propagate the embedded parameters around the graph and predict node-, edge- and graph-level observables. Previously, message-passing GNNs have shown success in predicting doublet likelihood, and we here report updates on the state-of-the-art architectures for this task. In addition, the Exa.TrkX project has investigated innovations in both graph construction, and embedded representations, in an effort to achieve fully learned end-to-end track finding. Hence, we present a suite of extensions to the original model, with encouraging results for hitgraph classification. In addition, we explore increased performance by constructing graphs from learned representations which contain non-linear metric structure, allowing for efficient clustering and neighborhood queries of data points. We demonstrate how this framework fits in with both traditional clustering pipelines, and GNN approaches. The embedded graphs feed into high-accuracy doublet and triplet classifiers, or can be used as an end-to-end track classifier by clustering in an embedded space. A set of post-processing methods improve performance with knowledge of the detector physics. Finally, we present numerical results on the TrackML particle tracking challenge dataset, where our framework shows favorable results in both seeding and track finding.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Methods and apparatus for embedding heating circuits into articles made by additive manufacturing and articles made therefrom

Methods of embedding a heating circuit in an article fabricated by additive manufacturing. The methods describe techniques such as co-extruding a wire, capable of being heated, along with print material in additive manufacturing of the article, and placing a pre-shaped wire capable of being heated between adjacent layers of the article. A third method includes dispensing a wire, capable of being heated, during the additive manufacturing of the article, and compacting the wire into the printed material. An apparatus for embedding a heating circuit in an article fabricated by additive manufacturing. The apparatus contains a wire dispenser, a cutter to control the length of the wire dispensed, and a compactor capable of embedding the wire capable of being heated into the printed material. An article made by additive manufacturing is disclosed. The article contains at least one heating element embedded in the article during the additive manufacturing process.

Barocio, Eduardo↗

DOE OSTI2024

Methods and apparatus for embedding heating circuits into articles made by additive manufacturing and articles made therefrom

Barocio, Eduardo↗

DOE OSTI2026

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and their smaller counterparts, with the goal of replicating the representational qualities of larger models in smaller models. We observe a geometric phenomenon which we term embedding condensation, where token embeddings collapse into a narrow cone-like subspace in some language models. Through systematic analyses across multiple Transformer families, we show that small models such as GPT2 and Qwen3-0.6B exhibit severe condensation, whereas larger models such as GPT2-x1 and Qwen3-32B are more resistant to this phenomenon. Additional observations show that embedding condensation is not reliably mitigated by knowledge distillation from larger models. To fight against it, we formulate a dispersion loss that explicitly encourages embedding dispersion during training. Experiments demonstrate that it mitigates condensation, recovers dispersion patterns seen in larger models, and yields performance gains across 10 benchmarks. We believe this work offers a principled path toward improving smaller Transformers without additional parameters.

Xiao, Xi [ORNL] (ORCID:0009000009316982)↗

DOE OSTI2020

Simulation of coupled multiphase flow and geomechanics in porous media with embedded discrete fractures

In fractured natural formations, the equations governing fluid flow and geomechanics are strongly coupled. Hydrodynamical properties depend on the mechanical configuration, and they are therefore difficult to accurately resolve using uncoupled methods. In recent years, significant research has focused on discretization strategies for these coupled systems, particularly in the presence of complicated fracture network geometries. In this work, we explore a finite-volume discretization for the multiphase flow equations coupled with a finite-element scheme for the mechanical equations. Fractures are treated as lower dimensional surfaces embedded in a background grid. Interactions are captured using the embedded discrete fracture model (EDFM) and the embedded finite element method (EFEM) for the flow and the mechanics, respectively. This nonconforming approach significantly alleviates meshing challenges. EDFM considers fractures as lower dimension finite volumes that exchange fluxes with the rock matrix cells. The EFEM method provides, instead, a local enrichment of the finite-element space inside each matrix cell cut by a fracture element. Both the use of piecewise constant and piecewise linear enrichments are investigated. They are also compared to an extended finite element approach. One key advantage of EFEM is the element-based nature of the enrichment, which reduces the geometric complexity of the implementation and leads to linear systems with advantageous properties. Synthetic numerical tests are presented to study the convergence and accuracy of the proposed method. It is also applied to a realistic scenario, involving a heterogeneous reservoir with a complex fracture distribution, to demonstrate its relevance for field applications.

58 GEOSCIENCES↗

DOE OSTI2024

Embedding Reverse Electron Transfer Between Stably Bare Cu Nanoparticles and Cation‐Vacancy CuWO 4

Cu nanoparticles (NPs) have attracted widespread attention in electronics, energy, and catalysis. However, conventionally synthesized Cu NPs face some challenges such as surface passivation and agglomeration in applications, which impairs their functionalities in the physicochemical properties. Here, the issues above by engineering an embedded interface of stably bare Cu NPs on the cation-vacancy CuWO 4 support is addressed, which induces the strong metal-support interactions and reverse electron transfer. Various atomic-scale analyses directly demonstrate the unique electronic structure of the embedded Cu NPs with negative charge and anion oxygen protective layer, which mitigates the typical degradation pathways such as oxidation in ambient air, high-temperature agglomeration, and CO poisoning adsorption. Kinetics and in situ spectroscopic studies unveil that the embedded electron-enriched Cu NPs follow the typical Eley-Rideal mechanism in CO oxidation, contrasting the Langmuir-Hinshelwood mechanism on the traditional Cu NPs. This mechanistic shift is driven by the Coulombic repulsion in anion oxygen layer, enabling its direct reaction with gaseous CO to form the easily desorbed monodentate carbonate.

Cu nanoparticles↗

DOE OSTI2020

Quantum embedding for material chemistry based on domain separation and open subsystems

Our perspective considers two theories we recently proposed to perform quantum embedding calculations for chemical systems: domain-separated density functional theory (DSDFT) and locally coupled open subsystems (LCOS). The development includes both the fundamentals of each theory as well as potential applications, some technical aspects, and related challenges. DS-DFT is suited to study intramolecular effects, where one can apply a high level of theory (based on DFT or wave function theory) to a region of interest inside a molecule or solid, and lower level theory elsewhere, with smooth switching between the regions. LCOS, in contrast, is a fragment-based embedding which offers computational advantages to study intermolecular behavior such as electron hopping, spin-environment interaction, and charge transfer excitations. Yet, both theories can exchange roles when appropriate. In addition, these theories allow for control of computational scaling of their algorithms. We investigate paths to determine the charge-transfer operator used in LCOS, and suggest an auxiliary energy minimization that can provide a practical estimate to this operator. We also briefly discuss how to implement density fitting techniques in domain separation, and how domain separation can be used for pure wavefunction-based embedding.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2023

Creep Properties of Shale and Predicted Impact on Proppant Embedment for the Caney Shale, Oklahoma

The Caney shale is an emerging hydrocarbon play located in southwest Oklahoma, USA. Within the Caney shale exist facies which were initially dubbed “reservoir” and “ductile” based on evaluation of well logging data. While past work has shown the distinction of “brittle” and “ductile” is not mechanically justifiable according to formal definitions, here the current work shows some important differences between nominally ductile and reservoir zones. First, the “ductile” zones are more clay rich and have textural differences which can be expected to lead to differences in mechanical properties. One important impact of these differences is observed in triaxial creep experiments showing the “ductile” zones are more prone to creep deformation. Numerical simulations predict the “reservoir” zones will experience very little proppant embedment due to creep deformation of hydraulic fractures around proppant particles. On the other hand, “ductile” zones can be expected to undergo creep-driven proppant embedment leading to loss of fracture aperture ranging up to 100% loss, depending upon the spatial density of the proppant distribution. Hence, this research shows the identification of nominally “ductile” zones from well logs, while a misnomer, can be useful in finding clay-rich, creep-prone zones which will be the most prone to proppant embedment and hence vulnerable to greater production decline over time.

58 GEOSCIENCES↗

DOE OSTI2026

Commuting embeddings for parallel strategies in non-local games

Non-local games provide a versatile framework for probing quantum correlations and for benchmarking the power of entanglement. In finite dimensions, the standard method for playing several games in parallel requires a tensor product of the local Hilbert spaces, which scales additively in the number of qubits. In this work, we show that this additive cost can be reduced by exploiting algebraic embeddings. We introduce two forms of compressions. First, when a referee selects one game from a finite collection of games at random, the game quantum strategy can be implemented using a maximally entangled state of dimension equal to the largest individual game, thereby eliminating the need for repeated state preparations. Second, we establish conditions under which several games can be played simultaneously in parallel on fewer qubits than the tensor product baseline. These conditions are expressed in terms of commuting embeddings of the game algebras. Moreover, we provide a constructive framework for building such embeddings. Using tools from Lie theory, we show that aligning the various game algebras into a common Cartan decomposition enables such a qubit reduction. Beyond the theoretical contribution, our framework casts NLGs as algebraic primitives for distributed and resource-constrained quantum computations and suggested NLGs as a comparable device-independent dimension witness.

Commuting embeddings↗

DOE OSTI2021

A comprehensive review of proppant embedment in shale reservoirs: Experimentation, modeling and future prospects

This paper provides a comprehensive review on the application of proppants to maintain fracture permeability over the lifetime of a well based on published observations from experiments and modeling. The review identifies and describes important processes occurring during proppant embedment, during hydraulic fracturing, laboratory testing of fracture conductivity, proppant embedment and modeling of proppant embedment. Lastly, this paper identifies the challenges and knowledge gaps that also provide future avenues of research and opportunities for collaborative technological development which requires an interdisciplinary approach of science, engineering in academia, government, and private sector.

03 NATURAL GAS↗

DOE OSTI2023

TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformers

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various applications. Such temporal graphs exhibit heterogeneous transient dynamics, varying time intervals, and highly evolving node features throughout their evolution. Hence, incorporating long-range dependencies from the historical graph context plays a crucial role in accurately learning their temporal dynamics. In this paper, we develop a graph embedding model with uncertainty quantification, TransformerG2G, by exploiting the advanced transformer encoder to first learn intermediate node representations from its current state (t) and previous context (over timestamps [t–1,t–l], l is the length of context). Moreover, we employ two projection layers to generate lower-dimensional multivariate Gaussian distributions as each node's latent embedding at timestamp t. We consider diverse benchmarks with varying levels of "novelty" as measured by the TEA (Temporal Edge Appearance) plots. Here, our experiments demonstrate that the proposed TransformerG2G model outperforms conventional multi-step methods and our prior work (DynG2G) in terms of both link prediction accuracy and computational efficiency, especially for high degree of novelty. Furthermore, the learned time-dependent attention weights across multiple graph snapshots reveal the development of an automatic adaptive time stepping enabled by the transformer. Importantly, by examining the attention weights, we can uncover temporal dependencies, identify influential elements, and gain insights into the complex interactions within the graph structure. For example, we identified a strong correlation between attention weights and node degree at the various stages of the graph topology evolution.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Multireference Embedding and Fragmentation Methods for Classical and Quantum Computers: From Model Systems to Realistic Applications

One of the primary challenges in quantum chemistry is the accurate modeling of strong electron correlation. While multireference methods effectively capture such correlation, their steep scaling with system size prohibits their application to large molecules and extended materials. Quantum embedding offers a promising solution by partitioning complex systems into manageable subsystems. In this Review, we highlight recent advances in multireference density matrix embedding and localized active space self-consistent field approaches for complex molecules and extended materials. We discuss both classical implementations and the emerging potential of these methods on quantum computers. Here, by extending classical embedding concepts to the quantum landscape, these algorithms have the potential to expand the reach of multireference methods in quantum chemistry and materials.

Algorithms↗