Search NASA⌕ Search

SEARCH · Search NASA

Results for “latent representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Deep Koopman Neural Network for Analyzing High-Energy-Density Simulations of Electrical Wire Explosions

Megaampere-scale electrical wire experiments (EWEs) provide a platform for studying magnetohydrodynamic (MHD) instability growth in magneto-inertial fusion (MIF) devices. Even when nonlinear simulations of these experiments can digitally reproduce much of the experimentally observed instability growth, interpreting the results and understanding mode growth and evolution can be non-trivial. As a first step toward providing better interpretation of these simulation features, this work investigates the use of a deep neural network that uses Koopman operator theory to analyze the dynamics of pulsed-power-driven explosions of EWEs. This deep neural network is trained on 1-D resistive MHD simulations of EWEs. This neural network learns to transform the nonlinear data into a lower-dimensional representation where the time dynamics are linear. Layers of this neural network are shown to learn features of the simulations, including the locations of shock waves and different physical regimes of the simulation. Using the learned features, the network can compress a time state of the simulation consisting of 5120 data point into a 36-parameter lower-dimensional latent space embedding. Furthermore, these embeddings are shown to be clustered in the latent space by initial radius and time state.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Enhanced Sampling of Crystal Nucleation with Graph Representation Learnt Variables

In this study, we present a graph neural network-based learning approach using an autoencoder setup to derive low-dimensional variables from features observed in experimental crystal structures. These variables are then biased in enhanced sampling to observe state-to-state transitions and reliable thermodynamic weights. Our approach uses simple convolution and pooling methods. To verify the effectiveness of our protocol, we examined the nucleation of various allotropes and polymorphs of iron and glycine from their molten states. Our graph latent variables when biased in well-tempered metadynamics consistently show transitions between states and achieve accurate free energy calculations in agreement with experiments, both of which are indicators of dependable sampling. This underscores the strength and promise of our graph neural net variables for improved sampling. Furthermore, the protocol shown here should be applicable for other systems and with other sampling methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Neural embedding: learning the embedding of the manifold of physics data

In this paper, we present a method of embedding physics data manifolds with metric structure into lower dimensional spaces with simpler metrics, such as Euclidean and Hyperbolic spaces. We then demonstrate that it can be a powerful step in the data analysis pipeline for many applications. Using progressively more realistic simulated collisions at the Large Hadron Collider, we show that this embedding approach learns the underlying latent structure. With the notion of volume in Euclidean spaces, we provide for the first time a viable solution to quantifying the true search capability of model agnostic search algorithms in collider physics (i.e. anomaly detection). Finally, we discuss how the ideas presented in this paper can be employed to solve many practical challenges that require the extraction of physically meaningful representations from information in complex high dimensional datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Outlier classification using autoencoders: application for fluctuation driven flows in fusion plasmas

Understanding the statistics of fluctuation driven flows in the boundary layer of magnetically confined plasmas is desired to accurately model the lifetime of the vacuum vessel components. Mirror Langmuir probes (MLPs) are a novel diagnostic that uniquely allow us to sample the plasma parameters on a time scale shorter than the characteristic time scale of their fluctuations. Sudden large-amplitude fluctuations in the plasma degrade the precision and accuracy of the plasma parameters reported by MLPs for cases in which the probe bias range is of insufficient amplitude. While some data samples can readily be classified as valid and invalid, we find that such a classification may be ambiguous for up to 40% of data sampled for the plasma parameters and bias voltages considered in this study. In this contribution, we employ an autoencoder (AE) to learn a low-dimensional representation of valid data samples. By definition, the coordinates in this space are the features that mostly characterize valid data. Ambiguous data samples are classified in this space using standard classifiers for vectorial data. In this way, we avoid defining complicated threshold rules to identify outliers, which require strong assumptions and introduce biases in the analysis. By removing the outliers that are identified in the latent low-dimensional space of the AE, we find that the average conductive and convective radial heat fluxes are between approximately 5% and 15% lower as when removing outliers identified by threshold values. For contributions to the radial heat flux due to triple correlations, the difference is up to 40%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

pyDRESCALk

Modern data scientists are tasked to analyze ever-growing data sets with increasingly complex relationships. Tensor decompositions have come to play a central role in identifying underlying latent structures in higher-order data. The problem of fitting tensor models to different distributions is complicated by the combinations of size, dimensionality, and sparsity present in real world data. The situation demands efficient algorithms designed for shared-memory and distributed systems. This work will present new research that tackles these challenges on several different fronts, leveraging optimizations in numerical algorithms and sparse tensor representations in heterogeneous high performance computing environments.

Bhattarai, Manish↗

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗

Digital polycrystalline microstructure generation using diffusion probabilistic models

Accurate micromechanical simulation of polycrystalline materials requires a realistic digital representation of the grain scale microstructure. Here, this work demonstrates the use of a generative diffusion probabilistic model for synthesizing single phase polycrystalline realizations. The model performs well and is capable of producing realistic microstructures consisting of not just simple equiaxed structures but also structures exhibiting more complex spatial arrangements. Masked microstructure generation reveals that the model is context aware of morphological descriptors which may be encoded in the latent space. Training on more diverse data sets, with scaled up architectures, may enable development of future models capable of synthesizing even more complex microstructural features.

36 MATERIALS SCIENCE↗

ESMs Latent Space Exploration for Uncertainty Quantification and Spatiotemporal Downscaling

This final report for DOE Award DE-SC0023044 presents advances in two key areas of climate modeling: (1) representative climate model selection and (2) Earth System Model (ESM) downscaling using hybrid AI methods. The first section introduces a reordered, three-stage workflow to select representative GCM runs that more effectively balance historical skill with ensemble spread, validated across Texas, Bihar, and New York. The second section introduces two novel super-resolution frameworks, ViSIR and ViFOR, that integrate Vision Transformers with sinusoidal and Fourier-based implicit neural representations. These models achieve state-of-the-art reconstruction accuracy for ESM variables including surface temperature and heat fluxes. The report includes detailed methodology, benchmarks, and results, demonstrating significant gains in uncertainty quantification, spatial fidelity, and scalability for climate-impact studies.

54 ENVIRONMENTAL SCIENCES↗

Learning earthquake ground motions via conditional generative modeling

Predicting high-fidelity ground motions for future earthquakes is crucial for seismic hazard assessment and infrastructure resilience. Conventional empirical simulations suffer from sparse sensor distribution and geographically localized earthquake locations, while physics-based methods are computationally intensive and require accurate representations of Earth structures and earthquake sources. We propose an artificial intelligence (AI) spectrogram generator, Conditional Generative Modeling for Ground Motion (CGM-GM). CGM-GM leverages earthquake magnitudes and geographic coordinates of earthquakes and sensors as inputs, when postprocessed with phase information, capturing spatially continuous Fourier amplitude spectra (FAS) as well as properties such as P and S arrivals, and waveform durations, without explicit physics constraints. This is achieved through a probabilistic autoencoder that extracts latent distributions in the time-frequency domain and variational sequential models for prior and posterior distributions. We evaluate the performance of CGM-GM using small-magnitude earthquake records from the San Francisco Bay Area, a region with high seismic risks. Here, we report that CGM-GM demonstrates potential for complementing physics-based simulations and non-ergodic empirical ground motion models, as well as shows promise in seismology and beyond.

geophysics↗

Including a Cold Pool Representation in a Convection Parameterization and Simulating Its Impacts on the Spatial and Temporal Variability of the Precipitation in the NASA GEOS GCM

We developed and implemented a simple representation of a cold pool in the Grell-Freitas (GF) convection parameterization. The cold pool parameterization is based on the observation that convective-scale downdrafts produce a local ‘deficit’ of the moist static energy (MSE). This information is advected and becoming downwind available to trigger and intensify new convection. The cold pool is dissipated by a simple exponential decay using a lifetime of a few hours, or by interacting with the underneath surface by exchanging latent and sensible heat fluxes. Preliminary results show some improvement of the simulation of the diurnal cycle of the precipitation over the land, mainly during the nighttime.

Cold pools↗

Vegetation type is an important predictor of the arctic summer land surface energy budget

Despite the importance of high-latitude surface energy budgets (SEBs) for land-climate interactions in the rapidly changing Arctic, uncertainties in their prediction persist. Here, we harmonize SEB observations across a network of vegetated and glaciated sites at circumpolar scale (1994–2021). Our variance-partitioning analysis identifies vegetation type as an important predictor for SEB-components during Arctic summer (June-August), compared to other SEB-drivers including climate, latitude and permafrost characteristics. Differences among vegetation types can be of similar magnitude as between vegetation and glacier surfaces and are especially high for summer sensible and latent heat fluxes. The timing of SEB-flux summer-regimes (when daily mean values exceed 0 Wm –2 ) relative to snow-free and -onset dates varies substantially depending on vegetation type, implying vegetation controls on snow-cover and SEB-flux seasonality. Our results indicate complex shifts in surface energy fluxes with land-cover transitions and a lengthening summer season, and highlight the potential for improving future Earth system models via a refined representation of Arctic vegetation types.

54 ENVIRONMENTAL SCIENCES↗

A model of the CO2 exchanges between biosphere and atmosphere in the tundra

A physical model of the soil thermal regime in a permafrost terrain has been developed and validated with soil temperature measurements at Barrow, Alaska. The model calculates daily soil temperatures as a function of depth and average moisture contents of the organic and mineral layers using a set of five climatic variables, i.e., air temperature, precipitation, cloudiness, wind speed, and relative humidity. The model is not only designed to study the impact of climate change on the soil temperature and moisture regime, but also to provide the input to a decomposition and net primary production model. In this context, it is well known that CO2 exchanges between the terrestrial biosphere and the atmosphere are driven by soil temperature through decomposition of soil organic matter and root respiration. However, in tundra ecosystems, net CO2 exchange is extremely sensitive to soil moisture content; therefore it is necessary to predict variations in soil moisture in order to assess the impact of climate change on carbon fluxes. To this end, the present model includes the representation of the soil moisture response to changes in climatic conditions. The results presented in the foregoing demonstrate that large errors in soil temperature and permafrost depth estimates arise from neglecting the dependence of the soil thermal regime on soil moisture contents. Permafrost terrain is an example of a situation where soil moisture and temperature are particularly interrelated: drainage conditions improve when the depth of the permafrost increases; a decrease in soil moisture content leads to a decrease in the latent heat required for the phase transition so that the heat penetrates faster and deeper, and the maximum depth of thaw increases; and as excepted, soil thermal coefficients increase with moisture.

Labgaa, Rachid R.↗

A comparative analysis of two land surface heterogeneity representations

Two contrasting representations of land surface variability used in general circulation models (GCMs) are compared through an analysis of their corresponding surface energy balance equations. In one representation (the 'mixture' approach), different vegetation types are assumed to be homogeneously mixed over a grid square, so that the GCM atmosphere sees near-surface conditions pertaining to the mixture only. In the second representation (the 'mosaic' approach), different vegetation types are viewed as separate 'tiles' of a grid-square 'mosaic', and each tile interacts with the atmosphere independently. The mosaic approach is computationally simpler and in many ways more flexible than the mixture approach. Analytical solutions to the linearized energy balance equations and numerical solutions to the nonlinear equations both demonstrate that the mixture strategy, when applied to two coexisting vegetation types that differ only in canopy transpiration resistance, promotes both total turbulent flux and latent heat flux relative to the mosaic strategy. The effective differences between the strategies, however, are small over a wide range of conditions. In particular, the strategies are effectively equivalent when the transpiration resistances of the different vegetation types are of the same order of magnitude.

Koster, Randal D.↗

Earth System Model Overestimation of Cropland Temperatures Scales With Agricultural Intensity

Intensive crop growth can modify regional climate by partitioning energy to latent heating through transpiration, cooling growing season temperatures. Recent work shows that cooling associated with agriculture can dampen anthropogenic warming over breadbasket regions. However, it is unknown whether climate models reproduce crop influences on regional climate, and thus the future risk of extreme climate events over global breadbasket regions. Here, we show that models overestimate growing season temperatures and underestimate evapotranspiration (ET) over global croplands, and that these differences increase with cropped area. We trace this warm and dry difference through each model's representation of the surface energy budget, showing that model differences in transpiration, leaf area index, and the ratio of transpiration to total ET drive the overall effect. While the implications of these model deficiencies for future projections are uncertain, they point to the importance of improving representations of crop-climate processes to better assess breadbasket vulnerability to climate change.

54 ENVIRONMENTAL SCIENCES↗

Enhancing Interpretability in Generative Modeling: Statistically Disentangled Latent Spaces Guided by Generative Factors in Scientific Datasets

This study addresses the challenge of statistically extracting generative factors from complex, high-dimensional datasets in unsupervised or semi-supervised settings. We investigate encoder-decoder-based generative models for nonlinear dimensionality reduction, focusing on disentangling low-dimensional latent variables corresponding to independent physical factors. Introducing Aux-VAE, a novel architecture within the classical Variational Autoencoder framework, we achieve disentanglement with minimal modifications to the standard VAE loss function by leveraging prior statistical knowledge through auxiliary variables. These variables guide the shaping of the latent space by aligning latent factors with learned auxiliary variables. We validate the efficacy of Aux-VAE through comparative assessments on multiple datasets, including astronomical simulations.

97 MATHEMATICS AND COMPUTING↗

Phase transition phenomenology with nonparametric representations of the neutron star equation of state

Astrophysical observations of neutron stars probe the structure of dense nuclear matter and have the potential to reveal phase transitions at high densities. Most recent analyses are based on parametrized models of the equation of state with a finite number of parameters and occasionally include extra parameters intended to capture phase-transition phenomenology. However, such models restrict the types of behavior allowed and may not match the true equation of state. We introduce a complementary approach that extracts phase transitions directly from the equation of state without relying on, and thus being restricted by, an underlying parametrization. We then constrain the presence of phase transitions in neutron stars with astrophysical data. Current pulsar mass, tidal deformability, and mass-radius measurements disfavor only the strongest of possible phase transitions (latent energy per particle ≳ 100 MeV). Weaker phase transitions are consistent with observations. Here we further investigate the prospects for measuring phase transitions with future gravitational-wave observations and find that catalogs of O (100) events will (at best) yield Bayes factors of ~ 10 : 1 in favor of phase transitions even when the true equation of state contains very strong phase transitions. Our results reinforce the idea that neutron star observations will primarily constrain trends in macroscopic properties rather than detailed microscopic behavior. Fine-tuned equation of state models will likely remain unconstrained in the near future.

79 ASTRONOMY AND ASTROPHYSICS↗

Navigating Transition-Metal Chemical Space: Artificial Intelligence for First-Principles Design

Conspectus The variability of chemical bonding in open-shell transition-metal complexes not only motivates their study as functional materials and catalysts but also challenges conventional computational modeling tools. Here, tailoring ligand chemistry can alter preferred spin or oxidation states as well as electronic structure properties and reactivity, creating vast regions of chemical space to explore when designing new materials atom by atom. Although first-principles density functional theory (DFT) remains the workhorse of computational chemistry in mechanism deduction and property prediction, it is of limited use here. DFT is both far too computationally costly for widespread exploration of transition-metal chemical space and also prone to inaccuracies that limit its predictive performance for localized d electrons in transition-metal complexes. These challenges starkly contrast with the well-trodden regions of small-organic-molecule chemical space, where the analytical forms of molecular mechanics force fields and semiempirical theories have for decades accelerated the discovery of new molecules, accurate DFT functional performance has been demonstrated, and gold-standard methods from correlated wavefunction theory can predict experimental results to chemical accuracy. The combined promise of transition-metal chemical space exploration and lack of established tools has mandated a distinct approach. In this Account, we outline the path we charted in exploration of transition-metal chemical space starting from the first machine learning (ML) models (i.e., artificial neural network and kernel ridge regression) and representations for the prediction of open-shell transition-metal complex properties. The distinct importance of the immediate coordination environment of the metal center as well as the lack of low-level methods to accurately predict structural properties in this coordination environment first motivated and then benefited from these ML models and representations. Once developed, the recipe for prediction of geometric, spin state, and redox potential properties was straightforwardly extended to a diverse range of other properties, including in catalysis, computational “feasibility”, and the gas separation properties of periodic metal–organic frameworks. Interpretation of selected features most important for model prediction revealed new ways to encapsulate design rules and confirmed that models were robustly mapping essential structure–property relationships. Encountering the special challenge of ensuring that good model performance could generalize to new discovery targets motivated investigation of how to best carry out model uncertainty quantification. Distance-based approaches, whether in model latent space or in carefully engineered feature space, provided intuitive measures of the domain of applicability. With all of these pieces together, ML can be harnessed as an engine to tackle the large-scale exploration of transition-metal chemical space needed to satisfy multiple objectives using efficient global optimization methods. In practical terms, bringing these artificial intelligence tools to bear on the problems of transition-metal chemical space exploration has resulted in ML-model assessments of large, multimillion compound spaces in minutes and validated new design leads in weeks instead of decades.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Understanding water and energy fluxes in the Amazonia: Lessons from an observation‐model intercomparison

Abstract Tropical forests are an important part of global water and energy cycles, but the mechanisms that drive seasonality of their land‐atmosphere exchanges have proven challenging to capture in models. Here, we (1) report the seasonality of fluxes of latent heat (LE), sensible heat ( H ), and outgoing short and longwave radiation at four diverse tropical forest sites across Amazonia—along the equator from the Caxiuanã and Tapajós National Forests in the eastern Amazon to a forest near Manaus, and from the equatorial zone to the southern forest in Reserva Jaru; (2) investigate how vegetation and climate influence these fluxes; and (3) evaluate land surface model performance by comparing simulations to observations. We found that previously identified failure of models to capture observed dry‐season increases in evapotranspiration (ET) was associated with model overestimations of (1) magnitude and seasonality of Bowen ratios (relative to aseasonal observations in which sensible was only 20%–30% of the latent heat flux) indicating model exaggerated water limitation, (2) canopy emissivity and reflectance (albedo was only 10%–15% of incoming solar radiation, compared to 0.15%–0.22% simulated), and (3) vegetation temperatures (due to underestimation of dry‐season ET and associated cooling). These partially compensating model‐observation discrepancies (e.g., higher temperatures expected from excess Bowen ratios were partially ameliorated by brighter leaves and more interception/evaporation) significantly biased seasonal model estimates of net radiation ( R n ), the key driver of water and energy fluxes (LE ~ 0.6 R n and H ~ 0.15 R n ), though these biases varied among sites and models. A better representation of energy‐related parameters associated with dynamic phenology (e.g., leaf optical properties, canopy interception, and skin temperature) could improve simulations and benchmarking of current vegetation–atmosphere exchange and reduce uncertainty of regional and global biogeochemical models.

Restrepo‐Coupe, Natalia↗