Search NASA⌕ Search

SEARCH · Search NASA

Results for “embedding model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

HydraGNN v4.0

The new version of HydraGNN v4.0 provides additional core capabilities, such as: Inclusion of multi-body atomistic cluster expansion MACE, polarizable atom interaction neural network PAINN, and equivariant principal neighborhood aggregation (PNAEq) among the message passing layers supported -Inclusion of graph transformers to directly model long-range interactions between nodes that are distant in the graph topology Integration of graph transformers with message passing layers by combining the graph embedding generated by the two mechanisms, which allows for an improved expressivity of the HydraGNN architecture Improved re-implementation of multi-task learning (MTL) to allow its use for stabilized training across imbalanced, multi-source, multi-fidelity data Introduction of multi-task parallelism, a newly proposed type of model parallelism specifically for MTL architectures, which allows to dispatch different output decoding heads to different GPU devices Integration of multi-task parallelism with pre-existing distributed data parallelism to enable a 2D parallelization for distributed training Improved portability of the distributed training across Intel GPUs, which has been testes on ALCF exascale supercomputer Aurora Inclusion of 2-level fine-grained energy profilers portable across NVIDIA, AMD, and Intel GPUs to monitor the power and energy consumption associated with different functions executed by the HydraGNN code during data pre-load and training Restructuring of previous examples and inclusion of new sets of examples to illustrate the download, preprocess, and training of HydraGNN models on new large-scale open-source datasets for atomistic materials modeling (e.g., Alexandria, Transition1x, OMat24, OMol25)

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗
DOE OSTI2026

MOSAIC-CONUS: A Multimodal, Multi-Temporally Paired Dataset for Earth Sciences

Earth embeddings—vector representations of geographic locations indexed in space and time—are emerging as a unifying interface for geospatial AI. However, their quality depends not only on model design, but on how multimodal Earth observation (EO) data are spatially indexed, temporally aligned, and cross-modally associated during pretraining. We introduce MOSAIC-CONUS (Multimodal Observations with Spatially Aligned Imagery, Urban Points of Interest, In-Situ Measurements and Text Captions), a large-scale EO dataset over the contiguous United States, organized around 250,000 stratified point indices that serve as stable spatial keys across seven modalities: active radar, passive optical imagery, lidar-derived elevation, land cover, functional context, hydrometeorological measurements, and textual summaries. Unlike existing EO datasets, MOSAIC-CONUS introduces four contributions not jointly addressed in prior work: 1. an open-source, large-scale multimodal EO corpus structured around point-indexed data designed to support Earth embedding learning; 2. explicit radar-optical pairing tables spanning twelve temporal alignment regimes, formalizing cross-sensor alignment as a controllable variable for analyzing how temporal mismatch across modalities influences learned embeddings quality; 3. a benchmark suite spanning cross-modal retrieval, annual nightlights regression, and basin-held-out streamflow prediction, positioning MOSAIC-CONUS as a benchmark-ready resource for multimodal AI systems; and 4. a language-based embedding layer through co-registered textual summaries, enabling Earth embeddings to function as a queryable interface for agentic AI systems. The dataset and pairing protocols are publicly released.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Multiscale Modeling of Nanoparticle Precipitation in Oxide Dispersion-Strengthened Steels Produced by Laser Powder Bed Fusion

Laser Powder Bed Fusion (LPBF) enables the efficient production of near-net-shape oxide dispersion-strengthened (ODS) alloys, which possess superior mechanical properties due to oxide nanoparticles (e.g., yttrium oxide, Y-O, and yttrium-titanium oxide, Y-Ti-O) embedded in the alloy matrix. To better understand the precipitation mechanisms of the oxide nanoparticles and predict their size distribution under LPBF conditions, we developed an innovative physics-based multiscale modeling strategy that incorporates multiple computational approaches. These include a finite volume method model (Flow3D) to analyze the temperature field and cooling rate of the melt pool during the LPBF process, a density functional theory model to calculate the binding energy of Y-O particles and the temperature-dependent diffusivities of Y and O in molten 316L stainless steel (SS), and a cluster dynamics model to evaluate the kinetic evolution and size distribution of Y-O nanoparticles in as-fabricated 316L SS ODS alloys. The model-predicted particle sizes exhibit good agreement with experimental measurements across various LPBF process parameters, i.e., laser power (110–220 W) and scanning speed (150–900 mm/s), demonstrating the reliability and predictive power of the modeling approach. The multiscale approach can be used to guide the future design of experimental process parameters to control oxide nanoparticle characteristics in LPBF-manufactured ODS alloys. Additionally, our approach introduces a novel strategy for understanding and modeling the thermodynamics and kinetics of precipitation in high-temperature systems, particularly molten alloys.

Wang, Zhengming (ORCID:0000000241627112)↗
DOE OSTI2026

Quantum mechanical closure of partial differential equations with symmetries

We develop a statistical framework for the dynamical closure of spatiotemporal dynamics governed by partial differential equations. Employing the mathematical framework of quantum mechanics to embed the original classical dynamics into a quantum mechanical representation, we use the space of quantum density operators to model the unresolved degrees of freedom of the original dynamics in a statistical sense, and the framework of quantum measurement to predict their contributions to the resolved dynamics. The embedded dynamics is discretized by a positivity preserving process, leading to a compressed representation that is invariant under the dynamical symmetries of the resolved dynamics. We present a data based formulation of the closure scheme and apply it to a closure problem for the shallow water equations. The numerical results demonstrate that our closure model can accurately predict the main features of the true dynamics, including for out of sample initial conditions.

Delay embedding↗
DOE OSTI2026

AGFormer: Adaptive Spatiotemporal graph informed transformer for multi-reservoir inflow forecasting

Accurate reservoir inflow forecasting is crucial for effective water resource management, yet most machine learning models focus on single-reservoir prediction and overlook spatial dependencies among hydrologically connected reservoirs. Here, we propose AGFormer (Adaptive Graph-Informed Transformer), an end-to-end framework that integrates adaptive graph learning with temporal sequence modeling for multi-reservoir inflow forecasting. A shared encoder and graph attention mechanism generate reservoir-specific embeddings, which are then processed by the Transformer-based encoder–decoder for multi-step inflow forecasting. We also introduce a pretraining paradigm to learn robust temporal embeddings from misaligned historical records. Evaluated on 30 reservoirs in the Upper Colorado River Basin, AGFormer achieves superior seven-day-ahead forecasts, with NSE > 0.75 for 20 reservoirs—outperforming Encoder–Decoder LSTM, GCN+LSTM, and Transformer baselines. Adaptive graph learning captures dynamic inter-reservoir dependencies, and feature attribution aligns with snowmelt-driven hydrology. Incorporating forecasted meteorological inputs further enhances accuracy, demonstrating AGFormer’s potential to support reservoir management under dynamic hydrological conditions.

Adaptive graph learning↗
DOE OSTI2026

Neural entropy-stable conservative flux form neural networks for learning hyperbolic conservation laws

We propose a neural entropy-stable conservative flux form neural network (NESCFN) for learning hyperbolic conservation laws and their associated entropy functions directly from solution trajectories, without requiring any predefined numerical discretization. While recent neural network architectures have successfully integrated classical numerical principles into learned models, most rely on prior knowledge of the governing equations or assume a fixed discretization. Our approach removes this dependency by embedding entropy-stable design principles into the learning process itself, enabling the discovery of physically consistent dynamics in a fully data-driven setting. By jointly learning both the flux function and a corresponding entropy, NESCFN promotes conservation and entropy dissipation, which is critical for long-term stability and fidelity in the system of hyperbolic conservation laws. Furthermore, numerical results demonstrate that the method achieves stability and conservation over extended time horizons and accurately captures shock propagation speeds, even without oracle access to future-time solution profiles in the training data.

Conservative flux form↗
DOE OSTI2025

Object detection with deep learning for rare event search in the GADGET II TPC

In the pursuit of identifying rare two-particle events within the GADGET II Time Projection Chamber (TPC), this paper presents a comprehensive approach for leveraging Convolutional Neural Networks (CNNs) and various data processing methods. To address the inherent complexities of 3D TPC track reconstructions, the data is expressed in 2D projections and 1D quantities. This approach capitalizes on the diverse data modalities of the TPC, allowing for the efficient representation of the distinct features of the 3D events, with no loss in topology uniqueness. Additionally, it leverages the computational efficiency of 2D CNNs and benefits from the extensive availability of pre-trained models. Given the scarcity of real training data for the rare events of interest, simulated events are used to train the models to detect real events. To account for potential distribution shifts when predominantly depending on simulations, significant perturbations are embedded within the simulations. This produces a broad parameter space that works to account for potential physics parameter and detector response variations and uncertainties. These parameter-varied simulations are used to train sensitive 2D CNN object detectors. When combined with 1D histogram peak detection algorithms, this multi-modal detection framework is highly adept at identifying rare, two-particle events in data taken during experiment 21072 at the Facility for Rare Isotope Beams (FRIB), demonstrating a 100% recall for events of interest. Here, we present the methods and outcomes of our investigation and discuss the potential future applications of these techniques.

Convolutional neural network↗
DOE OSTI2024

Towards Immobilized Proton-Coupled Electron Transfer Agents for Electrochemical Carbon Capture from Air and Seawater

Electrochemical CO 2 separation has drawn attention as a promising strategy for using renewable energy to mitigate climate change. Redox-active compounds that undergo proton-coupled electron transfer (PCET) are an impetus for pH-swing-driven CO 2 capture at low energetic costs. However, multiple barriers hinder this technology from maturing, including sensitivity to oxygen and the slow kinetics of CO 2 capture. Here, we use vapor phase chemistry to construct a textile electrode comprising an immobilized PCET agent, poly(1-aminoanthraquinone) (PAAQ), and incorporate it into redox flow cells. This design contrasts with others that use dissolved PCET agents by confining proton-storage to the surface of an electrode kept separate from an aqueous, CO 2 -capturing phase. This system facilitates carbon capture from gaseous sources (a 1% CO 2 feed and air), as well as seawater, with the latter at an energetic cost of 202 kJ/mol CO2 , and we find that quinone moieties embedded within the electrode are more stable to oxygen than dissolved counterparts. Simulations using a 1D reaction-transport model show that moderate energetic costs should be possible for air capture of CO 2 with higher loadings of polymer-bound PCET moieties. The remarkable stability of this system sets the stage for producing textile-based electrodes that facilitate pH-swing-driven carbon capture in practical situations.

Ali, Fawaz↗
DOE OSTI2025

Higgs-portal dark matter in Brane-world cosmology

Abstract The Higgs-portal scalar dark matter (DM) model is a simple extension of the Standard Model (SM) to incorporate a DM particle to the SM, where a $$Z_2$$ Z 2 -odd real scalar field is introduced as a DM candidate. We consider this DM model in the context of 5-dimensional brane-world cosmology, where our 3-dimensional space is realized as a hyper-surface embedded in 4-dimensional space. In the setup, all the SM and DM fields reside on the hyper-surface while graviton lives in the bulk. We consider two well-known brane-world cosmologies, namely, the Randall–Sundrum (RS) and the Gauss–Bonnet (GB) brane-world cosmologies, in which the standard Big Bang cosmology is reproduced at low temperatures below the so-called “transition temperature” while at high temperatures the expansion law of the universe is significantly modified. Such a non-standard expansion law directly impacts the prediction for the relic density of the Higgs-portal DM. We investigate the brane-world cosmological effects and identify the allowed model parameter region by combining the constraints from the observed DM relic density, and the direct and indirect DM detection experiments. It is well-known that only DM masses in the vicinity of half the Higgs boson mass are allowed in the Higgs-portal scalar DM model. We find that the allowed parameter region becomes more severely constrained and even disappears in the RS cosmology, while the GB cosmological effect significantly enlarges the allowed region. Upon discovering Higgs-portal DM, we can determine transition temperature in the GB brane-world cosmology.

Liu, Taoli↗
DOE OSTI2025

A deep generative model for deciphering cellular dynamics and in silico drug discovery in complex diseases

Human diseases are characterized by intricate cellular dynamics. Single-cell transcriptomics provides critical insights, yet a persistent gap remains in computational tools for detailed disease progression analysis and targeted in silico drug interventions. Here we introduce UNAGI, a deep generative neural network tailored to analyse time-series single-cell transcriptomic data. This tool captures the complex cellular dynamics underlying disease progression, enhancing drug perturbation modelling and screening. When applied to a dataset from patients with idiopathic pulmonary fibrosis, UNAGI learns disease-informed cell embeddings that sharpen our understanding of disease progression, leading to the identification of potential therapeutic drug candidates. Validation using proteomics reveals the accuracy of UNAGI’s cellular dynamics analysis, and the use of the fibrotic cocktail-treated human precision-cut lung slices confirms UNAGI’s predictions that nifedipine, an antihypertensive drug, may have anti-fibrotic effects on human tissues. UNAGI’s versatility extends to other diseases, including COVID, demonstrating adaptability and confirming its broader applicability in decoding complex cellular dynamics beyond idiopathic pulmonary fibrosis, amplifying its use in the quest for therapeutic solutions across diverse pathological landscapes.

Neural Network↗
DOE OSTI2025

Comparing three generations of D-Wave quantum annealers for minor embedded combinatorial optimization problems

Abstract Quantum annealing (QA) is a novel type of analog computation that aims to use quantum mechanical fluctuations to search for optimal solutions of Ising problems. QA in the transverse Ising model, implemented on D-Wave quantum processing units, are available as cloud computing resources. In this study we report concise benchmarks across three generations of D-Wave quantum annealers, consisting of four different devices, for the NP-hard discrete combinatorial optimization problems unweighted maximum clique and unweighted maximum cut on random graphs. The Ising, or equivalently quadratic unconstrained binary optimization, formulation of these problems do not require auxiliary variables for order reduction, and their overall structure and weights are not highly variable, which makes these problems simple test cases to understand the sampling capability of current D-Wave quantum annealers. All-to-all minor embeddings of size 52, with relatively uniform chain lengths, are used for a direct comparison across the Chimera, Pegasus, and Zephyr device topologies. A grid-search over annealing times and the minor embedding chain strengths is performed in order to determine the level of reasonable performance for each device and problem type. Experiment metrics that are reported are approximation ratios for non-broken chain samples, chain break proportions, and time-to-solution for the maximum clique problem instances. How fairly the quantum annealers sample optimal maximum cliques, for instances which contain multiple maximum cliques, is quantified using entropy of the measured ground state distributions. The newest generation of quantum annealing hardware, which has a Zephyr hardware connectivity, performed the best overall with respect to approximation ratios and chain break frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Covalent Drug Binding in Live Cells Monitored by Mid-Infrared Quantum Cascade Laser Spectroscopy: Photoactive Yellow Protein as a Model System

The detection of drug-target interactions in live cells enables analysis of therapeutic compounds in a native cellular environment. Recent advances in spectroscopy and molecular biology have facilitated the development of genetically encoded vibrational probes like nitriles that can sensitively report on molecular interactions. Nitriles are powerful tools for measuring electrostatic environments within condensed media like proteins, but such measurements in live cells have been hindered by low signal-to-noise ratios. In this study, we design a spectrometer based on a double-beam quantum cascade laser (QCL)-based transmission infrared (IR) source with balanced detection that can significantly enhance sensitivity to nitrile vibrational probes embedded in proteins within cells compared to a conventional FTIR spectrometer. Here, using this approach, we detect small-molecule binding in Escherichia coli, with particular focus on the interaction between para-Coumaric acid (pCA) and nitrile-incorporated photoactive yellow protein (PYP). This system effectively serves as a model for investigating covalent drug binding in a cellular environment. Notably, we observe large spectral shifts of up to 15 cm –1 for nitriles embedded in PYP between the unbound and drug-bound states directly within bacteria, in agreement with observations for purified proteins. Such large spectral shifts are ascribed to the changes in the hydrogen-bonding environment around the local environment of nitriles, accurately modeled through high-level molecular dynamics simulations using the AMOEBA force field. Our findings underscore the QCL spectrometer’s ability to enhance sensitivity for monitoring drug–protein interactions, offering new opportunities for advanced methodologies in drug development and biochemical research.

chromophores↗
DOE OSTI2026

FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipelines ability to ingest several modalities of information. We present (1) a curated dataset of 93 questions designed to evaluate a pipeline's ability to ingest textual data, tables, images, multimodal data, and cross-document multimodal data; (2) a phrase-level recall metric for correctness; (3) a nearest-neighbor embedding classifier in an attempt to classify pipeline hallucinations; (4) a comparative evaluation of 2 pipelines built with open-source retrieval mechanisms and 4 closed-source foundational models; and (5) a third-party human evaluation of the alignment of our correctness and hallucination metrics. We find that closed-source pipelines significantly outperform open-source pipelines in both the correctness and halucination metrics, with a wider performance gap in questions relying on multimodal and cross-document information. We also find after a human evaluation of our correctness and hallucination metric compared with our questions and pipeline responses, average agreement was 4.62 for correctness 4.53 for hallucination detection on a 1-5 Likert scale with 5 being strongly agree with our determination.

Hildebrand, Samuel [ORNL] (ORCID:0009000465963104)↗
DOE OSTI2025

Factors controlling injection-induced rupture of intersecting faults during geological sequestration of CO 2

This study addresses coupled multiphase fluid flow and geomechanics effects on potential fault activation associated with subsurface CO 2 injection around intersecting faults. An enhanced fault-representation model is used to capture geomechanical responses of two intersecting faults with finite length during CO 2 injection. The faults are embedded in a strike-slip stress regime of a caprock-reservoir-basement system with the faults represented by zero-thickness interfaces with adjacent finite-thickness damage zones. A sensitivity analysis is conducted to study the effect of fault permeability, slip-weakening behavior, well location relative to the orientation of faults, and well placement (the number and location of injection wells). Five metrics (pressure, CO 2 plume, shear state on the fault, as well as shear displacement and stress path at selected fault monitoring points) are selected to assess CO 2 migration and reactivation of intersecting faults. The results show that induced ruptures are favored by low permeability faults due to high pressure buildup and by slip-weakening behavior resulting from fault strength reduction. The location of one injection well relative to fault orientation determines the magnitude of changes in effective normal stress and shear stress, affecting the location of induced ruptures. Well placement (two injection wells used in the paper) dominates pressure diffusion around the intersection and tips of faults. This redistributes changes in effective normal stress caused by each injection well, influencing the spatial distribution of ruptures along faults. A larger injection volume induces far-field ruptures that are controlled by stress transfer within the injection layer. The findings presented here can provide valuable insights into engineering operations for a long-term, safe, and reliable geologic CO 2 storage.

Fault permeability↗
DOE OSTI2024

Neural network interatomic potential-driven analysis of phase stability in Ti–V alloys at the atomistic scale

The evolution of the ω phase in titanium–vanadium (Ti–V) alloys is critical for their mechanical properties, particularly in aerospace and biomedical applications. Here, this study employs a Rapid Artificial Neural Network (RANN) potential to model the ω phase evolution at the atomistic level, demonstrating a high degree of consistency with experimental observations, unlike the Modified Embedded Atom Method (MEAM), which fails to capture this phase transformation accurately. RANN simulations replicate key phenomena such as the nucleation of α precipitates at ω/β interfaces and accurate lattice orientations, enhancing our understanding of phase stability and transformation kinetics. The findings affirm that RANN potentials can significantly improve the prediction accuracy of complex material behaviors, offering a powerful tool for designing advanced materials with tailored properties such as solute effect in various stacking fault energies. This approach not only bridges the gap between theoretical predictions and empirical data but also sets a new direction for future research in materials science, emphasizing the integration of machine learning techniques in the development and optimization of new alloys.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Absolute decay counting of 146 Sm with 4π cryogenic microcalorimetry

We present a methodology for absolute activity counting of long-lived isotopes based on cryogenic Decay Energy Spectroscopy. A 146 Sm source was produced at the TRIUMF Laboratory and then processed and purified at Lawrence Livermore National Laboratory, yielding a pure sample. The source was embedded within a 4π thermal absorber coupled to a magnetic microcalorimeter achieving nearly 100% counting efficiency. Experimental uncertainties were studied and modeled, including thermal coupling of the source to the absorber, pulse pile-up, trigger, and event selection efficiencies. Here, the absolute activity of the pure 146 Sm source was measured to better than 1% uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Dynamic embedding of effective harmonic normal mode vibrations in all-atomistic energy gap fluctuations: Case study of light harvesting 2 complex

Environmental effects in excitation energy transfer have mostly been modeled by baths of harmonic oscillators, but to what extent such modeling provides a reliable description of actual interactions between molecular systems and environments remains an open issue. Here, we address this issue by investigating fluctuations in the excitation energies of the light harvesting 2 complex using a realistic all-atomistic simulation of the potential energy surface. Our analyses reveal that molecular motions exhibit significant anharmonic features, even for underdamped intramolecular vibrations. In particular, we find that the anharmonicity contributes to the broadening of spectral densities and substantial overlaps between neighboring peaks, which complicates the meaning of mode frequencies constituting a bath model. Thus, we develop a strategy to construct a minimally underdamped harmonic bath that has a clear connection to all-atomistic dynamics by utilizing actual normal modes of molecules but optimizing their frequencies such that the resulting bath model can best reproduce the all-atomistic simulation results. By subtracting the underdamped contribution from the entire fluctuations, we also show that identifying a residual spectral density representing all other contributions with overdamped behavior is possible. We find that this can be fitted well with a well-established analytic form of a spectral density function or, alternatively, modeled as explicit time dependent fluctuations with muti-exponential or power law type correlation functions. We provide an assessment and the implications of these possibilities. The approach presented here can also serve as a general strategy to construct a simplified bath model that can effectively represent the underlying all-atomistic bath dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Experimental Investigation of Low-Frequency Distributed Acoustic Sensor Responses to Two Parallel Propagating Fractures

Low-frequency distributed acoustic sensing (LF-DAS) is a diagnostic tool for hydraulic fracture propagation with far-field monitoring using fiber optic sensors. LF-DAS senses strain rate variation caused by stress field change due to fracture propagation. Fiber optic sensors are installed in the monitoring wells in the vicinity of a fractured well. From the strain responses, fracture propagation can be evaluated. To understand subsurface conditions with multiple propagating fractures, a laboratory-scale hydraulic fracture experiment was performed simulating the LF-DAS response to fracture propagation with embedded distributed optical fiber strain sensors under these conditions. The experiment was performed using a transparent cube of epoxy with two parallel radial initial flaws centered in the cube. Fluid was injected into the sample to generate fractures along the initial flaws. The experiment used distributed high-definition fiber optic strain sensors with tight spatial resolutions. The sensors were embedded at two different locations on opposite sides of the initial flaws, serving as observation/monitoring locations. We also employed finite element modeling to numerically solve the linear elastic equations of equilibrium continuity and stress–strain relationships. The measured strains from the experiment were compared to simulation results from the finite element model. The experimentally derived strain and strain-rate waterfall plots from this study show the responses to both fractures propagating, while the fracture at the lower position took most of the fluid during the experiment. Interestingly, a fracture first began propagating from the upper flaw of the two flaws, but once the lower fracture was initiated, it grew much faster than the upper fracture. Both fibers were intercepted by the lower fracture, further verifying the strain signature as a fracture is approaching and intersecting an offset fiber.

Chemistry↗