Search NASA⌕ Search

SEARCH · Search NASA

Results for “embedding model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗

Two diverse models of embedding class one

Highlights: •The embedding of curved spacetime in higher-dimensional flat spacetime is discussed. •The focus is on two diverse models of embedding class one. •The first model is a complete wormhole solution including the junction conditions. •The second is a new model to explain the flat galactic rotation curves without the need for dark matter. -- Abstract: Embedding theorems have continued to be a topic of interest in the general theory of relativity since these help connect the classical theory to higher-dimensional manifolds. This paper deals with spacetimes of embedding class one, i.e., spacetimes that can be embedded in a five-dimensional flat spacetime. These ideas are applied to two diverse models, a complete solution for a charged wormhole admitting a one-parameter group of conformal motions and a new model to explain the flat rotation curves in spiral galaxies without the need for dark matter.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Differences in chemical evolution between isolated and embedded prestellar cores

Models of prestellar cores often assume that the cores are isolated from their environment – material outside the core boundary plays no role in the subsequent evolution. This is unlikely to be the case in reality, where cores are located within hierarchically substructured molecular clouds. Here, we investigate the dynamical and chemical evolution of prestellar cores, modelled as Bonnor–Ebert spheres, and show that the density of the ambient medium has a large impact on the resulting chemical properties of the cores. Models embedded in high-density, low-temperature surroundings have greatly enhanced abundances of several molecules, such as CO and CS, compared to models with more diffuse surroundings, corresponding to relatively isolated cores. The predicted intensities and profile shapes of molecular lines are also affected. The density of the ambient medium has a stronger effect on the chemical evolution than whether the cores are initially in or out of equilibrium. This suggests that the impact of environment cannot be neglected when modelling chemistry in prestellar cores; the results of these models are highly sensitive to the assumptions made about the core surroundings.

79 ASTRONOMY AND ASTROPHYSICS↗

OUTWARD MIGRATION OF JUPITER AND SATURN IN 3:2 OR 2:1 RESONANCE IN RADIATIVE DISKS: IMPLICATIONS FOR THE GRAND TACK AND NICE MODELS

Embedded in the gaseous protoplanetary disk, Jupiter and Saturn naturally become trapped in 3:2 resonance and migrate outward. This serves as the basis of the Grand Tack model. However, previous hydrodynamical simulations were restricted to isothermal disks, with moderate aspect ratio and viscosity. Here we simulate the orbital evolution of the gas giants in disks with viscous heating and radiative cooling. We find that Jupiter and Saturn migrate outward in 3:2 resonance in modest-mass (M {sub disk} ≈ M {sub MMSN}, where MMSN is the {sup m}inimum-mass solar nebula{sup )} disks with viscous stress parameter α between 10{sup –3} and 10{sup –2}. In disks with relatively low-mass (M {sub disk} ≲ M {sub MMSN}), Jupiter and Saturn get captured in 2:1 resonance and can even migrate outward in low-viscosity disks (α ≤ 10{sup –4}). Such disks have a very small aspect ratio (h ∼ 0.02-0.03) that favors outward migration after capture in 2:1 resonance, as confirmed by isothermal runs which resulted in a similar outcome for h ∼ 0.02 and α ≤ 10{sup –4}. We also performed N-body runs of the outer solar system starting from the results of our hydrodynamical simulations and including 2-3 ice giants. After dispersal of the gaseous disk, a Nice model instability starting with Jupiter and Saturn in 2:1 resonance results in good solar systems analogs. We conclude that in a cold solar nebula, the 2:1 resonance between Jupiter and Saturn can lead to outward migration of the system, and this may represent an alternative scenario for the evolution of the solar system.

79 ASTRONOMY AND ASTROPHYSICS↗

Visual Analytics for Deep Embeddings of Large Scale Molecular Dynamics Simulations

Molecular Dynamics (MD) simulation have been emerging as an excellent candidate for understanding complex atomic and molecular scale mechanism of bio-molecules that control essential bio-physical phenomenon in a living organism. But this MD technique produces large-size and long-timescale data that are inherently high-dimensional and occupies many terabytes of data. Processing this immense amount of data in a meaningful way is becoming increasingly difficult. Therefore, specific dimensionality reduction algorithm using deep learning technique has been employed here to embed the high-dimensional data in a lower-dimension latent space that still preserves the inherent molecular characteristics i.e. retains biologically meaningful information. Subsequently, the results of the embedding models are visualized for model evaluation and analysis of the extracted underlying features. However, most of the existing visualizations for embeddings have limitations in evaluating the embedding models and understanding the complex simulation data. We propose an interactive visual analytics system for embeddings of MD simulations to not only evaluate and explain an embedding model but also analyze various characteristics of the simulations. Our system enables exploration and discovery of meaningful and semantic embedding results and supports the understanding and evaluation of results by the quantitatively described features of the MD simulations (even without specific labels).

Chae, Junghoon↗

The embedded feature model for the interpretation of chromospheric contrast profiles

Contrast profiles obtained from chromospheric filtergrams and spectra of bright and dark mottles have to date been interpreted almost exclusively in terms of Becker's cloud model. Here we demonstrate the failure of this model to account in a physically consistent way for the observed contrasts. As an alternative, we introduce an embedded-feature model, restricting our discussion in this paper to stationary features. Our model is then characterized by three independent parameters: the density of absorbing atoms, the geometrical depth, and the profile of the absorption coefficient. An analytic approximation to the contrast resulting from such a model reproduces well the observed behavior of all types of contrast profiles.

Steinitz, R.↗

Quantification of modeling uncertainty in the Rayleigh damping model

Understanding and accurately characterizing energy dissipation mechanisms in civil structures during earthquakes is an important element of seismic assessment and design. The most commonly used model is attributed to Rayleigh. This paper proposes a systematic approach to quantify the uncertainty associated with Rayleigh's damping model. Bayesian calibration with embedded model error is employed to treat the coefficients of the Rayleigh model as random variables using modal damping ratios. Through a numerical example, we illustrate how this approach works and how the calibrated model can address modeling uncertainty associated with the Rayleigh damping model.

42 ENGINEERING↗

Observational constraints on an embedded cloud model for the soft X-ray diffuse background

The reason for the observed anticorrelation between soft X-ray diffuse background (SXRB) and neutral hydrogen column densities are considered. Using the B and C band data from an all-sky survey of the SXRB, as well as data in the Be band, it is shown that the Jakobsen and Kahn (1986) embedded cloud model, in which several statistical properties of the SXRB in the B and C bands were used to constrain their model parameters, cannot fit the observed band ratios, except in the limit in which virtually all of the emission originates in the near side of the absorbing gas. It was also shown that model parameters corresponding to appreciably mixed emission and absorption, as proposed by Bunner et al. (1969) and Davidsen et al. (1972), do not fit the data. Model parameters corresponding to the absorption models of Bowyer et al. (1968), Bunner et al. (1969), Davidsen et al. (1972), and Yentis et al. (1972), cannot fit the data unless the absorbing material is more strongly clumped than is permitted by 21-cm observations.

Burrows, D. N.↗

Understanding Event Trajectories Across Massive Temporal Datasets with Word Embeddings and Visualization

In collaboration with researchers from Virginia Tech, Savannah River National Laboratory has continued development of a natural language processing pipeline to identify and extract events of interest from massive open data sources in the domain of worldwide state-sponsored civil nuclear energy. The foundation of the pipeline is built on compass aligned temporal word embedding models, whereby contextual shifts are automatically identified by comparing keyword embedding vectors across successive time windows. Within the approach, a contextual shift indicates the occurrence of a potential event of interest. However, in such a broad topical domain that captures events at a global scale, across various life cycle stages, and across numerous different technology types, a user that is monitoring events may have broad interests in capturing many different event types with varying degrees of signal. As such, the quantity of information that may be returned from an automated event extraction pipeline can be substantial, requiring manual effort to sift through the information to identify any relevant bits of information. Therefore, a more streamlined workflow that aids in directing a user toward specific information at different points in time is necessary. The workflow presented here has been developed with this concept in mind, built on top of the initial prototype event extraction pipeline, whereby a user can analyze temporal text-based data sources at multiple different contextual levels to isolate key points in time and key subdomains captured within a data corpus. Using multiple corpuses that consist of approximately 7 million Tweets and 7 million news articles, the team has extended compass aligned temporal word embedding models to establish an interconnected and hierarchical structure that relates known key words of interest to documents, local topics (i.e., within a time window), and global topics across the corpuses. All of this information is packaged into a visual analytics system that is linked to the information extraction pipeline and enables a user to identify contextual information that describes the evolution of a high dimensional embedding space across time to isolate changes of interest and explore associated events. This report demonstrates the use of these analytics and a means to fuse information across multiple datasets.

97 MATHEMATICS AND COMPUTING↗

Dispatch Manager for NEML2 Constitutive Model Calculations Embedded in MOOSE

This report describes the extended capabilities of the NEML2 constitutive modeling library, including a flexible and efficient work dispatching system designed to leverage both CPU and GPU resources. This enhancement addresses one of the primary computational challenges in large-scale simulations: the ability to distribute and execute batches of material model evaluations across heterogeneous computing devices. The new dispatch system introduces a modular set of dispatcher and scheduler classes that coordinate the flow of data and execution between devices. The dispatcher is responsible for efficiently packaging work, managing device-specific memory operations, and synchronizing results. This modularity allows for extensibility, making it straightforward to integrate additional computing backends in the future. From an implementation standpoint, the dispatcher system interfaces seamlessly with NEML2's existing models. They handle device-aware tensor operations, optimize memory transfers, and support asynchronous execution when applicable. This design ensures that batches of material points can be evaluated concurrently, substantially improving throughput compared to previous single-device or serial implementations. These improvements not only enhance the raw performance of NEML2 but also improve its usability in multiscale and high-fidelity simulations, where the simultaneous evaluation of large material point batches is critical. Benchmarks included in the report demonstrate the system’s scalability, highlighting its effectiveness when leveraging modern GPU architectures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A liquid drop model for embedded atom method cluster energies

Minimum energy configurations for homonuclear clusters containing from two to twenty-two atoms of six metals, Ag, Au, Cu, Ni, Pd, and Pt have been calculated using the Embedded Atom Method (EAM). The average energy per atom as a function of cluster size has been fit to a liquid drop model, giving estimates of the surface and curvature energies. The liquid drop model gives a good representation of the relationship between average energy and cluster size. As a test the resulting surface energies are compared to EAM surface energy calculations for various low-index crystal faces with reasonable agreement.

Finley, C. W.↗

Integrating a reservoir regulation scheme into a spatially distributed hydrological model

During the past several decades, numerous reservoirs have been built across the world for a variety of purposes such as flood control, irrigation, municipal/industrial water supplies, and hydropower generation. Consequently, natural streamflow timing and magnitude have been altered significantly by reservoir operations. In addition, the hydrological cycle can be modified by land use/land cover and climate changes. To understand the fine scale feedback between hydrological processes and water management decisions, a distributed hydrological model embedded with a reservoir component is of desire. In this study, a multi-purpose reservoir module with predefined complex operational rules was integrated into the Distributed Hydrology Soil Vegetation Model (DHSVM). Conditional operating rules, which are designed to reduce flood risk and enhance water supply reliability, were adopted in this module. The performance of the integrated model was tested over the upper Brazos River Basin in Texas, where two U.S. Army Corps of Engineers reservoirs, Lake Whitney and Aquilla Lake, are located. The integrated DHSVM model was calibrated and validated using observed reservoir inflow, outflow, and storage data. The error statistics were summarized for both reservoirs on a daily, weekly, and monthly basis. Using the weekly reservoir storage for Lake Whitney as an example, the coefficients of determination (R2) and the Nash-Sutcliff Efficiency (NSE) are 0.85 and 0.75, respectively. These results suggest that this reservoir module has promise for use in sub-monthly hydrological simulations. Enabled with the new reservoir component, the DHSVM model provides a platform to support adaptive water resources management under the impacts of evolving anthropogenic activities and substantial environmental changes.

Zhao, Gang↗