Bayesian Framework for Embedded Model Error Representation and Quantification.
Abstract not provided.
Sargsyan, Khachik↗
SEARCH · Search NASA
Results for “embedding model”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Symbolic diagnostics to interpret and analyze neural network models
Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.
97 MATHEMATICS AND COMPUTING↗
Explaining word embeddings with perfect fidelity: a case study in predicting research impact
The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.
Coarse-grained models↗
Two diverse models of embedding class one
Highlights: •The embedding of curved spacetime in higher-dimensional flat spacetime is discussed. •The focus is on two diverse models of embedding class one. •The first model is a complete wormhole solution including the junction conditions. •The second is a new model to explain the flat galactic rotation curves without the need for dark matter. -- Abstract: Embedding theorems have continued to be a topic of interest in the general theory of relativity since these help connect the classical theory to higher-dimensional manifolds. This paper deals with spacetimes of embedding class one, i.e., spacetimes that can be embedded in a five-dimensional flat spacetime. These ideas are applied to two diverse models, a complete solution for a charged wormhole admitting a one-parameter group of conformal motions and a new model to explain the flat rotation curves in spiral galaxies without the need for dark matter.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Differences in chemical evolution between isolated and embedded prestellar cores
Models of prestellar cores often assume that the cores are isolated from their environment – material outside the core boundary plays no role in the subsequent evolution. This is unlikely to be the case in reality, where cores are located within hierarchically substructured molecular clouds. Here, we investigate the dynamical and chemical evolution of prestellar cores, modelled as Bonnor–Ebert spheres, and show that the density of the ambient medium has a large impact on the resulting chemical properties of the cores. Models embedded in high-density, low-temperature surroundings have greatly enhanced abundances of several molecules, such as CO and CS, compared to models with more diffuse surroundings, corresponding to relatively isolated cores. The predicted intensities and profile shapes of molecular lines are also affected. The density of the ambient medium has a stronger effect on the chemical evolution than whether the cores are initially in or out of equilibrium. This suggests that the impact of environment cannot be neglected when modelling chemistry in prestellar cores; the results of these models are highly sensitive to the assumptions made about the core surroundings.
79 ASTRONOMY AND ASTROPHYSICS↗
OUTWARD MIGRATION OF JUPITER AND SATURN IN 3:2 OR 2:1 RESONANCE IN RADIATIVE DISKS: IMPLICATIONS FOR THE GRAND TACK AND NICE MODELS
Embedded in the gaseous protoplanetary disk, Jupiter and Saturn naturally become trapped in 3:2 resonance and migrate outward. This serves as the basis of the Grand Tack model. However, previous hydrodynamical simulations were restricted to isothermal disks, with moderate aspect ratio and viscosity. Here we simulate the orbital evolution of the gas giants in disks with viscous heating and radiative cooling. We find that Jupiter and Saturn migrate outward in 3:2 resonance in modest-mass (M {sub disk} ≈ M {sub MMSN}, where MMSN is the {sup m}inimum-mass solar nebula{sup )} disks with viscous stress parameter α between 10{sup –3} and 10{sup –2}. In disks with relatively low-mass (M {sub disk} ≲ M {sub MMSN}), Jupiter and Saturn get captured in 2:1 resonance and can even migrate outward in low-viscosity disks (α ≤ 10{sup –4}). Such disks have a very small aspect ratio (h ∼ 0.02-0.03) that favors outward migration after capture in 2:1 resonance, as confirmed by isothermal runs which resulted in a similar outcome for h ∼ 0.02 and α ≤ 10{sup –4}. We also performed N-body runs of the outer solar system starting from the results of our hydrodynamical simulations and including 2-3 ice giants. After dispersal of the gaseous disk, a Nice model instability starting with Jupiter and Saturn in 2:1 resonance results in good solar systems analogs. We conclude that in a cold solar nebula, the 2:1 resonance between Jupiter and Saturn can lead to outward migration of the system, and this may represent an alternative scenario for the evolution of the solar system.
79 ASTRONOMY AND ASTROPHYSICS↗
An embedded Python model interpreter for Xyce TM (Xyce-PyMi)
This is the documentation for the Xyce-PyMi embedded Python model interpreter in Xyce.
97 MATHEMATICS AND COMPUTING↗
Visual Analytics for Deep Embeddings of Large Scale Molecular Dynamics Simulations
Molecular Dynamics (MD) simulation have been emerging as an excellent candidate for understanding complex atomic and molecular scale mechanism of bio-molecules that control essential bio-physical phenomenon in a living organism. But this MD technique produces large-size and long-timescale data that are inherently high-dimensional and occupies many terabytes of data. Processing this immense amount of data in a meaningful way is becoming increasingly difficult. Therefore, specific dimensionality reduction algorithm using deep learning technique has been employed here to embed the high-dimensional data in a lower-dimension latent space that still preserves the inherent molecular characteristics i.e. retains biologically meaningful information. Subsequently, the results of the embedding models are visualized for model evaluation and analysis of the extracted underlying features. However, most of the existing visualizations for embeddings have limitations in evaluating the embedding models and understanding the complex simulation data. We propose an interactive visual analytics system for embeddings of MD simulations to not only evaluate and explain an embedding model but also analyze various characteristics of the simulations. Our system enables exploration and discovery of meaningful and semantic embedding results and supports the understanding and evaluation of results by the quantitatively described features of the MD simulations (even without specific labels).
Chae, Junghoon↗
Quantification of modeling uncertainty in the Rayleigh damping model
Understanding and accurately characterizing energy dissipation mechanisms in civil structures during earthquakes is an important element of seismic assessment and design. The most commonly used model is attributed to Rayleigh. This paper proposes a systematic approach to quantify the uncertainty associated with Rayleigh's damping model. Bayesian calibration with embedded model error is employed to treat the coefficients of the Rayleigh model as random variables using modal damping ratios. Through a numerical example, we illustrate how this approach works and how the calibrated model can address modeling uncertainty associated with the Rayleigh damping model.
42 ENGINEERING↗
Understanding Event Trajectories Across Massive Temporal Datasets with Word Embeddings and Visualization
In collaboration with researchers from Virginia Tech, Savannah River National Laboratory has continued development of a natural language processing pipeline to identify and extract events of interest from massive open data sources in the domain of worldwide state-sponsored civil nuclear energy. The foundation of the pipeline is built on compass aligned temporal word embedding models, whereby contextual shifts are automatically identified by comparing keyword embedding vectors across successive time windows. Within the approach, a contextual shift indicates the occurrence of a potential event of interest. However, in such a broad topical domain that captures events at a global scale, across various life cycle stages, and across numerous different technology types, a user that is monitoring events may have broad interests in capturing many different event types with varying degrees of signal. As such, the quantity of information that may be returned from an automated event extraction pipeline can be substantial, requiring manual effort to sift through the information to identify any relevant bits of information. Therefore, a more streamlined workflow that aids in directing a user toward specific information at different points in time is necessary. The workflow presented here has been developed with this concept in mind, built on top of the initial prototype event extraction pipeline, whereby a user can analyze temporal text-based data sources at multiple different contextual levels to isolate key points in time and key subdomains captured within a data corpus. Using multiple corpuses that consist of approximately 7 million Tweets and 7 million news articles, the team has extended compass aligned temporal word embedding models to establish an interconnected and hierarchical structure that relates known key words of interest to documents, local topics (i.e., within a time window), and global topics across the corpuses. All of this information is packaged into a visual analytics system that is linked to the information extraction pipeline and enables a user to identify contextual information that describes the evolution of a high dimensional embedding space across time to isolate changes of interest and explore associated events. This report demonstrates the use of these analytics and a means to fuse information across multiple datasets.
97 MATHEMATICS AND COMPUTING↗
Dispatch Manager for NEML2 Constitutive Model Calculations Embedded in MOOSE
This report describes the extended capabilities of the NEML2 constitutive modeling library, including a flexible and efficient work dispatching system designed to leverage both CPU and GPU resources. This enhancement addresses one of the primary computational challenges in large-scale simulations: the ability to distribute and execute batches of material model evaluations across heterogeneous computing devices. The new dispatch system introduces a modular set of dispatcher and scheduler classes that coordinate the flow of data and execution between devices. The dispatcher is responsible for efficiently packaging work, managing device-specific memory operations, and synchronizing results. This modularity allows for extensibility, making it straightforward to integrate additional computing backends in the future. From an implementation standpoint, the dispatcher system interfaces seamlessly with NEML2's existing models. They handle device-aware tensor operations, optimize memory transfers, and support asynchronous execution when applicable. This design ensures that batches of material points can be evaluated concurrently, substantially improving throughput compared to previous single-device or serial implementations. These improvements not only enhance the raw performance of NEML2 but also improve its usability in multiscale and high-fidelity simulations, where the simultaneous evaluation of large material point batches is critical. Benchmarks included in the report demonstrate the system’s scalability, highlighting its effectiveness when leveraging modern GPU architectures.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Integrating a reservoir regulation scheme into a spatially distributed hydrological model
During the past several decades, numerous reservoirs have been built across the world for a variety of purposes such as flood control, irrigation, municipal/industrial water supplies, and hydropower generation. Consequently, natural streamflow timing and magnitude have been altered significantly by reservoir operations. In addition, the hydrological cycle can be modified by land use/land cover and climate changes. To understand the fine scale feedback between hydrological processes and water management decisions, a distributed hydrological model embedded with a reservoir component is of desire. In this study, a multi-purpose reservoir module with predefined complex operational rules was integrated into the Distributed Hydrology Soil Vegetation Model (DHSVM). Conditional operating rules, which are designed to reduce flood risk and enhance water supply reliability, were adopted in this module. The performance of the integrated model was tested over the upper Brazos River Basin in Texas, where two U.S. Army Corps of Engineers reservoirs, Lake Whitney and Aquilla Lake, are located. The integrated DHSVM model was calibrated and validated using observed reservoir inflow, outflow, and storage data. The error statistics were summarized for both reservoirs on a daily, weekly, and monthly basis. Using the weekly reservoir storage for Lake Whitney as an example, the coefficients of determination (R2) and the Nash-Sutcliff Efficiency (NSE) are 0.85 and 0.75, respectively. These results suggest that this reservoir module has promise for use in sub-monthly hydrological simulations. Enabled with the new reservoir component, the DHSVM model provides a platform to support adaptive water resources management under the impacts of evolving anthropogenic activities and substantial environmental changes.
Zhao, Gang↗
An embedded 3D fracture modeling approach for simulating fracture-dominated fluid flow and heat transfer in geothermal reservoirs
In this paper, we describe an efficient modeling approach, named embedded discrete fracture method (EDFM), for incorporating arbitrary 3D, discrete fractures, such as hydraulic fractures or faults, into modeling fracture-dominated fluid flow and heat transfer in fractured geothermal reservoirs. This technique allows 3D discrete fractures to be discretized independently from surrounding rock volume and inserted explicitly into a primary fracture/matrix grid, generated without including 3D discrete fractures in prior. An effective computational algorithm is developed to discretize these 3D discrete fractures and construct local connections between 3D fractures and fracture/matrix grid blocks representing the surrounding rock volume. The constructed gridding information on 3D fractures is then added to the primary grid. This embedded fracture modeling approach can be directly implemented into a developed geothermal reservoir simulator via the integral finite difference (IFD) method or with TOUGH2 technology. This embedded fracture modeling approach is very promising and computationally efficient to handle realistic 3D discrete fractures with complicated geometries, connections, and spatial distributions. Compared with other fracture modeling approaches, it avoids cumbersome 3D unstructured, local refining procedures, and increases computational efficiency by simplifying Jacobian matrix size and sparsity, while maintaining enough accuracy. Several numeral simulations are presented to demonstrate the utility and robustness of the proposed technique. Our numerical experiments show that this approach captures all the key patterns about fluid flow and heat transfer dominated by fractures in these cases. Thus, this approach is readily available to the simulation of fractured geothermal reservoirs with both artificial and natural fractures.
15 GEOTHERMAL ENERGY↗
Group-Additivity–Embedded Multiscale Modeling for Electric Field-Enhanced Nanocatalysis
Elucidating structure-performance relationships remains a central challenge in field-enhanced catalysis, where nanoparticles exhibit nonuniform surface sites with site-dependent responses to electric fields. Low-coordination sites (edges, corners, and tips) are particularly electric field-sensitive (EF), leading to nonuniform charge distribution, adsorption energies, and catalytic activity. Here, using ammonia decomposition on a ruthenium cluster as a model system, we develop a transferable multiscale framework integrating density functional theory, group additivity (GA), Brønsted-Evans-Polanyi scaling, and microkinetic modeling to predict EF-dependent activity across nonuniform cluster sites. Across sites and fields, the nitrogen adsorption energy (E N ) emerges as the governing descriptor, yielding robust volcano relationships whose optimum shifts systematically with field: negative fields strengthen N binding via electron accumulation, while positive fields weaken N binding via charge depletion, moving the optimal E N toward weaker binding. Microkinetic analysis shows that N≡N bond formation remains the key kinetic bottleneck over most conditions; positive fields lower the effective barrier and, critically, increase the fraction of near-optimal active sites, leading to a net enhancement in overall activity relative to zero-field and negative-field cases. By capturing EF- and site-dependent energetics with high accuracy and low computational cost, this GA-embedded multi-scale simulation workflow provides a physically interpretable route to predict and design field-enhanced nanocatalysis.
ammonia decomposition↗
Phase behavior of electrostatically complexed polyelectrolyte gels using an embedded fluctuation model
Abstract not provided
Audus, Debra J.↗
Flexocaloric effect near a ferroelastic transition
A Ginzburg-Landau model embedded into a vibrational model is used to study the flexocaloric effect in a beam near a ferroelastic transition. The caloric response upon bending is characterized by the isothermal entropy change and the adiabatic temperature change of the beam. Here, we obtain a larger response relative to the strength of the applied forces at temperatures slightly above the transition temperature. It is also obtained that the maximum caloric response is almost linear with the bending angle of the beam, whereas the relation between the bending angle and the applied forces is highly nonlinear. Small hysteresis associated with the phase transition is obtained for sufficiently large bending forces due to the existence of a critical point in the temperature-stress phase diagram of the ferroelastic material. Finally, the microstructure changes with bending in the beam are consistent with previous experimental observations.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗