Search NASA⌕ Search

SEARCH · Search NASA

Results for “Latent”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Disentangling Rotational Dynamics and Ordering Transitions in a System of Self-Organizing Protein Nanorods via Rotationally Invariant Latent Representations

The dynamics of complex ordering systems with active rotational degrees of freedom exemplified by protein self-assembly is explored using a machine learning workflow that combines deep learning-based semantic segmentation and rotationally invariant variational autoencoder-based analysis of orientation and shape evolution. The latter allows for disentanglement of the particle orientation from other degrees of freedom and compensates for lateral shifts. The disentangled representations in the latent space encode the rich spectrum of local transitions that can now be visualized and explored via continuous variables. The time dependence of ensemble averages allows insight into the time dynamics of the system and, in particular, illustrates the presence of the potential ordering transition. Finally, analysis of the latent variables along the single-particle trajectory allows tracing these parameters on a single-particle level. The proposed approach is expected to be universally applicable for the description of the imaging data in optical, scanning probe, and electron microscopy seeking to understand the dynamics of complex systems where rotations are a significant part of the process.

representation learning↗

Optimizing training trajectories in variational autoencoders via latent Bayesian optimization approach *

Unsupervised and semi-supervised ML methods such as variational autoencoders (VAE) have become widely adopted across multiple areas of physics, chemistry, and materials sciences due to their capability in disentangling representations and ability to find latent manifolds for classification and/or regression of complex experimental data. Like other ML problems, VAEs require hyperparameter tuning, e.g. balancing the Kullback–Leibler and reconstruction terms. However, the training process and resulting manifold topology and connectivity depend not only on hyperparameters, but also their evolution during training. Because of the inefficiency of exhaustive search in a high-dimensional hyperparameter space for the expensive-to-train models, here we have explored a latent Bayesian optimization (zBO) approach for the hyperparameter trajectory optimization for the unsupervised and semi-supervised ML and demonstrated for joint-VAE with rotational invariances. We have demonstrated an application of this method for finding joint discrete and continuous rotationally invariant representations for modified national institute of standards and technology database (MNIST) and experimental data of a plasmonic nanoparticles material system. The performance of the proposed approach has been discussed extensively, where it allows for any high dimensional hyperparameter trajectory optimization of other ML models.

42 ENGINEERING↗

Crystal generation using the fully differentiable pipeline and latent space optimization

We present a materials generation framework that couples a symmetry-conditioned variational autoencoder with a differentiable SO(3) power spectrum objective to steer candidates toward a specified local environment under the crystallographic constraints. In particular, we implement a fully differentiable pipeline that performs batch-wise optimization on both direct and latent crystallographic representations. Using the GPU acceleration, the implementation achieves about fivefold speed compared to our previous CPU workflow, while yielding comparable outcomes. In addition, we introduce the optimization strategy that alternatively performs optimization on the direct and latent crystal representations. This dual-level relaxation approach can effectively escape local minima defined by different objective gradients, thus increasing the success rate of generating complex structures satisfying the target local environments. This framework can be extended to systems consisting of multi-components and multi-environments, providing a scalable route to generate material structures with the target local environment.

conditional VAE↗

Improving AHU Performance by Minimizing Approach Temperature, Reducing Air Maldistribution, and Efficiently Handling Sensible and Latent Loads (Phase 1 Interim Final Technical Report)

Residential air handling units (AHUs) have stayed the same in form and efficiency for the past 30+ years, with incremental improvements made to address safety, functionality, and energy-efficiency. The purpose of this research in Phase I, Topic 9a: Next Generation Residential Air Handlers, was to improve AHU performance by minimizing heat exchanger (HX) approach temperature, reducing air maldistribution, and developing alternative system configurations which more efficiently handle sensible and latent loads. In this research Optimized Thermal Systems (OTS) developed, modeled, and evaluated multiple alternative system concepts. A dual vapor compression system separate sensible and latent cooling (SSLC) concept was studied to inform work on alternative concepts and to show best-case performance benefit. System concepts included ejector enhanced vapor compression cycles, desiccant assisted dehumidification, dual evaporator SSLC, and alternative AHU HX configurations. A dual vapor compression system showed COP improvement of 20%, however, required additional components, increased unit size, and increased cost. Two types of ejector enhanced vapor compression cycles with dual evaporators improved system COP by 9 to 11%, and reduced AHU losses by as much as 18%, with design changes limited to the AHU, no unit physical size increase, and a moderate increase to system first cost. Desiccant assisted air-conditioning required increased air flow rate resulting in higher fan power and the desiccant wheel increased sensible heat load leading to increased compressor power and reduced system COP. Dual evaporator cycles were found to degrade performance due to increased expansion losses. Optimized single slab HX designs used in place of the traditional A-coil HX led to 44–49% reduction in aluminum, 47–60% less refrigerant charge, and improved HX velocity distribution.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Electrohydrodynamic Enabled Electrochemical Membrane Dehumidifier for Separate Sensible and Latent Cooling

In hot and humid parts of the world, air conditioning is a necessity for an adequate standard of living. Cooling and heating represent one-third of building energy consumption. When cooling humid air, a substantial amount of the cooling energy is absorbed by water vapor condensation. The dehumidification cooling load is referred to as the latent cooling load and the dry bulb cooling load is referred to as the sensible cooling load. In most residential applications, the total cooling load is processed by a vapor compression cycle. Processing the latent load separately would not only reduce energy consumption. It would also reduce the required refrigeration capacity. Refrigerants often have adverse ecological impacts, contributing to the greenhouse effect and depletion of the ozone layer. Reduction of the cooling capacity in a system could reduce the amount of refrigerant charge required.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A neural network to retrieve the mesoscale instantaneous latent heat flux over oceans from SSM/I observations

The turbulent latent and sensible heat fluxes are necessary to study heat budget of the upper ocean or initialize ocean general circulation models. In order to retrieve the latent heat flux from satellite observations authors mostly use a bulk approximation of the flux whose parameters are derived from different instrument. In this paper, an approach based on artificial neural networks is proposed and compared to the bulk method on a global data set and 3 local data sets.

SSM/I latent heat flux air-sea interactions↗

TRMM Latent Heating Retrieval and Comparisons with Field Campaigns and Large-Scale Analyses

Rainfall production is a fundamental process within the Earth's hydrological cycle because it represents both a principal forcing term in surface water budgets, and its energetics corollary, latent heating (LH), is one of the principal sources of atmospheric diabatic heating. Latent heat release itself is a consequence of phase changes between the vapor, liquid, and frozen states of water. The vertical distribution of LH has a strong influence on the atmosphere, controlling large-scale tropical circulations, exciting and modulating tropical waves, maintaining the intensities of tropical cyclones, and even providing the energetics of midlatitude cyclones and other mobile midlatitude weather systems. Moreover, the processes associated with LH result in significant non-linear changes in atmospheric radiation through the creation, dissipation and modulation of clouds and precipitation. Yanai et al. (1973) utilized the meteorological data collected from a sounding network to present a pioneering work on thermodynamic budgets, which are referred to as the apparent heat source (Q1) and apparent moisture sink (Q2). Yanai's paper motivated the development of satellite-based LH algorithms and provided a theoretical background for imposing large-scale advective forcing into cloud-resolving models (CRMs). These CRM-simulated LH and Q1 data have been used to generate the look-up tables used in LH algorithms. This paper examines the retrieval, validation, and application of LH estimates based on rain rate quantities acquired from the Tropical Rainfall Measuring Mission satellite (TRMM). TRMM was launched in November 1997 as a joint enterprise between the American and Japanese space agencies -- with overriding goals of providing accurate four-dimensional estimates of rainfall and LH over the global Tropics and subtropics equatorward of 35o. Other literature has acknowledged the achievement of the first goal of obtaining an accurate rainfall climatology. This paper describes the second major goal of obtaining credible LH estimates as well as their applications within TRMM's zone of coverage, the standard TRMM LH products, and areas for further improvement.

latent heating↗

Identifying Outside Influences as Latent Factors to Risk in Human Performance

During the Acquisition Life Cycle for a program, there are several opportunities for the system in design to be adjusted in accordance with its changing landscape as it is being shaped by evolving policy and organizational culture. Human Systems Integration is integral to identifying these opportunities of change as there are a set number of activities that may account for altered operational states, human performance deviations, and overall component engagement if HSI is enacted early enough in the life cycle. Some changes that occur in the operational environment may not be accounted for since the organizational culture and practices are not currently a part of the HSI focus. Likewise, policy changes themselves from a top-to-bottom analysis may not have the appearance of effecting human performance until having gone through a trail-and-error period. Workarounds to adjust for unforeseen policy affects become the system's solution that usually includes changes in the training and education of the operators, maintainers, and support personnel. A system full of workarounds and off-normal practices, that cause operators to disregard the purpose of the design, coupled with the false notion that these activities are proven for successful system operation, is the very definition of “an accident waiting to happen”. Unforeseen changes in policies and practices that cause new and unusual activities to successfully and keep the system running, should be considered latent factors that may cause a potential mishap, and not part of the resilience that humans provide to the successful operation of the system. This presentation will explore how latent factors may find their way into system operations and how they can be identified and addressed.

Human Systems Integration↗

Latent Catalysis as a Platform for Accessing Diverse Material Properties in Vat Photopolymerization 3D Printing

Vat photopolymerization (VP) 3D printing is an attractive strategy to manufacture customized polymer parts. The properties of printed materials are limited by the need to employ a low viscosity liquid resin and achieve rapid polymerization kinetics. To circumvent this limitation, dual‐cure methods have been developed using reagents embedded in the liquid resin formulation; however, the reagent‐based approach requires the discovery and optimization of new chemistry for each desired material. Here, in this work, we demonstrate a catalytic, dual‐cure platform that enables access to both Nylon‐6 and polyester interpenetrating networks through VP 3D printing under a universal approach. Structure–reactivity relationships of the latent NHC catalysts led to the identification of a magnesium chloride–NHC adduct as a latent catalyst that is orthogonal to radical polymerization and can be unmasked at elevated temperatures post‐printing to initiate ring‐opening polymerization of lactones and lactams. This strategy results in access to semicrystalline materials, which are a challenging morphology to access via VP 3D printing, that have attractive mechanical properties and can be printed at high resolution. This work represents the first photochemical‐based 3D printing of Nylon‐based materials and demonstrates the value of catalytic approaches to access new material properties in VP 3D printing.

Colliver, Cali N. [University of North Carolina, C↗

Synthesizing realistic sand assemblies with denoising diffusion in latent space

Abstract The shapes and morphological features of grains in sand assemblies have far‐reaching implications in many engineering applications, such as geotechnical engineering, computer animations, petroleum engineering, and concentrated solar power. Yet, our understanding of the influence of grain geometries on macroscopic response is often only qualitative, due to the limited availability of high‐quality 3D grain geometry data. In this paper, we introduce a denoising diffusion algorithm that uses a set of point clouds collected from the surface of individual sand grains to generate grains in the latent space. By employing a point cloud autoencoder, the three‐dimensional point cloud structures of sand grains are first encoded into a lower‐dimensional latent space. A generative denoising diffusion probabilistic model is trained to produce synthetic sand that maximizes the log‐likelihood of the generated samples belonging to the original data distribution measured by a Kullback‐Leibler divergence. Numerical experiments suggest that the proposed method is capable of generating realistic grains with morphology, shapes and sizes consistent with the training data inferred from an F50 sand database. We then use a rigid contact dynamic simulator to pour the synthetic sand in a confined volume to form granular assemblies in a static equilibrium state with targeted distribution properties. To ensure third‐party validation, 50,000 synthetic sand grains and the 1542 real synchrotron microcomputed tomography (SMT) scans of the F50 sand, as well as the granular assemblies composed of synthetic sand grains are made available in an open‐source repository.

Vlassis, Nikolaos N.↗

Latent map Gaussian processes for mixed variable metamodeling

Gaussian processes (GPs) are ubiquitously used in sciences and engineering as metamodels. Standard GPs, however, can only handle numerical or quantitative variables. Here we introduce latent map Gaussian processes (LMGPs) that inherit the attractive properties of GPs and are also applicable to mixed data which have both quantitative and qualitative inputs. The core idea behind LMGPs is to learn a continuous, low-dimensional latent space or manifold which encodes all qualitative inputs. To learn this manifold, we first assign a unique prior vector representation to each combination of qualitative inputs. We then use a low-rank linear map to project these priors on a manifold that characterizes the posterior representations. As the posteriors are quantitative, they can be directly used in any standard correlation function such as the Gaussian or Matern. Hence, the optimal map and the corresponding manifold, along with other hyperparameters of the correlation function, can be systematically learned via maximum likelihood estimation. Through a wide range of analytic and real-world examples, we demonstrate the advantages of LMGPs over state-of-the-art methods in terms of accuracy and versatility. In particular, we show that LMGPs can handle variable-length inputs, have an explainable neural network interpretation, and provide insights into how qualitative inputs affect the response or interact with each other. We also employ LMGPs in Bayesian optimization and illustrate that they can discover optimal compound compositions more efficiently than conventional methods that convert compositions to qualitative variables via manual featurization.

42 ENGINEERING↗

Latent code-based fusion: A Volterra neural network approach

We propose a deep structure encoder using Volterra Neural Networks (VNNs) to seek a latent representation of multi-modal data whose features are jointly captured by a union of subspaces. The so-called self-representation embedding of the latent codes leads to a simplified fusion which is driven by a similarly constructed decoding. The Volterra Filter architecture achieved reduction in parameter complexity is primarily due to controlled non-linearities being introduced by the higher-order convolutions in lieu of generalized activation functions. Experimental results on two different datasets have shown a significant improvement in the clustering performance for VNNs auto-encoder over conventional Convolutional Neural Networks (CNNs) auto-encoder. In addition, we also show that the proposed approach demonstrates a much-improved sample complexity over CNN-based auto-encoder with a robust classification performance.

97 MATHEMATICS AND COMPUTING↗

Neural-network learning of SPOD latent dynamics

Here, we aim to reconstruct the latent space dynamics of high dimensional, quasi-stationary systems using model order reduction via the spectral proper orthogonal decomposition (SPOD). The proposed method is based on three fundamental steps: in the first, once that the mean flow field has been subtracted from the realizations (also referred to as snapshots), we compress the data from a high-dimensional representation to a lower dimensional one by constructing the SPOD latent space; in the second, we build the time-dependent coefficients by projecting the snapshots containing the fluctuations onto the SPOD basis and we learn their evolution in time with the aid of recurrent neural networks; in the third, we reconstruct the high-dimensional data from the learnt lower -dimensional representation. The proposed method is demonstrated on two different test cases, namely, a compressible jet flow, and a geophysical problem known as the Madden-Julian Oscillation. An extensive comparison between SPOD and the equivalent POD-based counterpart is provided and differences between the two approaches are highlighted. The numerical results suggest that the proposed model is able to provide low rank predictions of complex statistically stationary data and to provide insights into the evolution of phenomena characterized by specific range of frequencies. The comparison between POD and SPOD surrogate strategies highlights the need for further work on the characterization of the interplay of error between data reduction techniques and neural network forecasts.

97 MATHEMATICS AND COMPUTING↗

From Latent Dynamics to Meaningful Representations

While representation learning has been central to the rise of machine learning and artificial intelligence, a key problem remains in making the learnt representations meaningful. For this the typical approach is to regularize the learned representation through prior probability distributions. However such priors are usually unavailable or are ad hoc. To deal with this, recent efforts have shifted towards leveraging the insights from physical principles to guide the learning process. In this spirit, we propose a purely dynamics-constrained representation learning framework. Instead of relying on predefined probabilities, we restrict the latent representation to follow overdamped Langevin dynamics with a learnable transition density — a prior driven by statistical mechanics. We show this is a more natural constraint for representation learning in stochastic dynamical systems, with the crucial ability to uniquely identify the ground truth representation. We validate our framework for different systems including a real-world fluorescent DNA movie dataset. Here, we show that our algorithm can uniquely identify orthogonal, isometric and meaningful latent representations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On-Demand Selection of the Latent Domain Orientation in Spray-Deposited Block Copolymer Thin Films

With their ability to self-assemble spontaneously into well-defined nanoscale morphologies, block copolymer (BCP) thin films are a versatile platform to fabricate functional nanomaterials. An important challenge to wider deployment of BCPs in nanofabrication is combining precise control over the nanoscale domain orientation in BCP assemblies with scalable deposition techniques that are applicable to large-area, curved, and flexible substrates. Here, in this study, we show that spray-deposited smooth films of a nominally disordered BCP exhibit latent orientations, which can be prescriptively selected by controlling solvent evaporation during spray casting. Subsequent solvent vapor annealing triggers assembly toward highly ordered cylindrical morphologies along the pathway determined by solvent evaporation in the prior spray deposition stage. Faster evaporation promotes assembly of vertically oriented cylinders spanning the entire film thickness (100–300 nm). In comparison, slow solvent evaporation permits intermicellar aggregation and incipient cylinder formation in solution, which induces horizontal cylinder assembly upon annealing. The evaporatively controlled latent orientation mechanism presented herein elucidates how nonequilibrium phenomena during casting govern successive self-assembly pathways and facilitates a versatile method to dictate the domain orientation of BCP thin films on demand on flexible and highly curved substrates or in distinct pattern areas on the same substrate.

36 MATERIALS SCIENCE↗

Learning nonlinear operators in latent spaces for real-time predictions of complex dynamics in physical systems

Abstract Predicting complex dynamics in physical applications governed by partial differential equations in real-time is nearly impossible with traditional numerical simulations due to high computational cost. Neural operators offer a solution by approximating mappings between infinite-dimensional Banach spaces, yet their performance degrades with system size and complexity. We propose an approach for learning neural operators in latent spaces, facilitating real-time predictions for highly nonlinear and multiscale systems on high-dimensional domains. Our method utilizes the deep operator network architecture on a low-dimensional latent space to efficiently approximate underlying operators. Demonstrations on material fracture, fluid flow prediction, and climate modeling highlight superior prediction accuracy and computational efficiency compared to existing methods. Notably, our approach enables approximating large-scale atmospheric flows with millions of degrees, enhancing weather and climate forecasts. Here we show that the proposed approach enables real-time predictions that can facilitate decision-making for a wide range of applications in science and engineering.

97 MATHEMATICS AND COMPUTING↗

Adaptive machine learning for time-varying systems: low dimensional latent space tuning

Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map combinations of accelerator parameters and images which are 2D projections of the 6D phase space distributions of charged particle beams as they are transported between various particle accelerator locations. Despite their strengths, applying ML to time-varying systems, or systems with shifting distributions, is an open problem, especially for large systems for which collecting new data for re-training is impractical or interrupts operations. Particle accelerators are one example of large time-varying systems for which collecting detailed training data requires lengthy dedicated beam measurements which may no longer be available during regular operations. We present a novel method of adaptive ML for time-varying systems. Our approach is to map very high (N ≈ 100k) dimensional inputs (a combination of scalar parameters and images) into the low dimensional (N ≈ 2) latent space at the output of the encoder section of an encoder-decoder CNN. We then actively tune the low dimensional latent space-based representation of complex system dynamics by the addition of an adaptively tuned feedback vector directly before the decoder sections builds back up to our image-based high-dimensional phase space density representations. This method allows us to learn correlations within and to quickly tune the characteristics of incredibly large parameter space systems and to track their evolution in real time based on feedback without massive new data sets for re-training. We demonstrate that our method can accurately predict and track the phase space of charged particle beams at various locations in a particle accelerator by adaptively adjusting in real-time while the unknown input beam distribution of the accelerator is changing in shape, charge, and offset and while the RF system of the accelerator itself is also changing in an unpredictable way. For FACET-II we demonstrate that such an approach has the potential to use transverse deflecting cavity and energy spread spectrum beam measurements to accurately predict 2D projections of the 6D phase space of the electron beam at the plasma wakefield acceleration interaction point where such diagnostics are unavailable.

47 OTHER INSTRUMENTATION↗

Latent bone modelling for estimation of plutonium concentration in skeleton of former nuclear workers

Abstract The skeleton is a major plutonium retention site in the human body. Estimation of the total plutonium activity in the skeleton is a challenging problem. For most tissue donors at the United States Transuranium and Uranium Registries, a limited number of bone samples is available. The skeleton activity is calculated using plutonium activity concentration (Cskel) and skeleton weight. In this study, latent bone modelling was used to estimate Cskel from the limited number of analysed bone samples. Data from 13 non-osteoporotic whole-body donors were used to develop latent bone model (LBM) to estimate Cskel for seven cases with four to eight analysed bone samples. LBM predictions were compared to Cskel estimated using an arithmetic mean in terms of accuracy and precision. For the studied cases, LBM offered a significant reduction of uncertainty of Cskel estimate.

Environmental Sciences & Ecology↗