Search NASASearch

SEARCH · Search NASA

Results for “High dimensional modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

The baroclinic instability of highly structured one-dimensional basic states

A frictionless, adiabatic, quasi-geostrophic model on a beta-plane was employed to examine the baroclinic instability of highly structured one-dimensional basic states. Definitions of the model eigenvalue equation, the boundary conditions, and the fluxes and energetics are provided, and highly structured average wind speed and temperature profiles were selected to represent a wide range of latitudes. Attention was given to the instability source, wavelength, growth rate, phase velocity, steering levels, and the vertical structure of their amplitude, phase, meridional entropy transport, and conversion of potential-to-kinetic energy. Green modes, Charney-Eady modes, and the modes defined in the paper are examined in connection with the highly structured profiles. The eigenvalue approach is shown to be superior to the numerical time integration approach and necessary conditions for instabilities are defined.

Fullmer, J. W. A.

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas

The Sensitivity of Model Ozone to Advective and Photochemical Processes in the High Latitude Winter Lower Stratosphere

Three dimensional chemistry and transport models (CTMs) contain a set of coupled continuity equations which describe the evolution of constituents such as ozone and other minor species which affect ozone. Both advection and photochemical processes contribute to constituent evolution, and a CTM provides a means to evaluate these contributions separately. Such evaluation is particularly useful when both terms are important to the modeled tendency. An example is the ozone tendency in the high latitude winter lower stratosphere, where advection tends to increase ozone, and catalytic processes involving chlorine radicals tend to decrease ozone. The Goddard three dimensional chemistry and transport model uses meteorological fields from the Goddard Earth Observing System Data Assimilation System, thus the modeled ozone evolution may reproduce the observed evolution and provide a test of the model representation of photochemical processes if the transport is shown to be modeled appropriately. We have investigated the model advection further using diabatic trajectory calculations. For long lived constituents such as N2O, the model field for a particular time on a potential temperature surface is compared with a field produced by calculating 15 day back trajectories for a fixed latitude longitude grid, and mapping model N2O at the terminus of the back trajectories onto the initial grid. This provides a quantitative means to evaluate two aspects of the CTM transport: one, the model horizontal gradient between middle latitudes and the polar vortex is compared with the gradient produced using the non-diffusive trajectory calculation; two, the model vertical advection, which is produced by the divergence of the horizontal winds, is compared with the vertical transport expected from diabatic cooling.

Douglass, A.

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.

Low‐dimensional manifold learning for uncertainty quantification in complex multi‐scale stochastic systems

Broadly speaking, the goals of the project are to develop techniques to use manifold learning to develop reduced‐order and surrogate models for "hyper‐reduction" of very high‐dimensional complex multi‐scale systems. This is being achieved by employing a newly proposed form of manifold projection and learning that leverages recent advancements in computational geometry and data‐driven modeling. In particular, we are applying a manifold projection technique to project the solutions of very high‐dimensional systems onto the so‐called Grassmannmanifold, a Reimannian manifold comprised of orthonormal matrices. We then apply data‐driven machine learning techniques to classify the solutions on the manifold (e.g. clustering techniques) according to their proximity on the manifold and leverage a further nonlinear dimension reduction to organize the structured data on the manifold. Finally, we are developing novel techniques that enable us to directly interpolate the hyper‐reduced data such that we can predict the solution of the complex, high‐ dimensional system without need to call the full expensive computational model. Given their adherence to the underlying structure of the solution of the physical system, it is expected that these approximate solutions will be sufficiently constrained so as to (approximately) adhere to physical principles.

97 MATHEMATICS AND COMPUTING

Magnetic dynamics in NiTiO 3 honeycomb antiferromagnet using neutron scattering

The ilmenite NiTiO 3 consists of a buckled honeycomb lattice, with the Ni spins aligned ferromagnetically in-plane and antiferromagnetically out-of-plane. Using neutron spectroscopy, the magnetic structure and the dynamics were investigated as a function of temperature. Dispersive acoustic bands and nearly dispersionless optical bands at ≈ 3.7 meV are described by a highly anisotropy Heisenberg model with stronger antiferromagnetic (AFM) out-of-plane, weaker ferromagnetic (FM) in-plane interactions and an anisotropy gap of 0.95 meV. Furthermore, the order parameter yields a critical exponent between the Heisenberg and two-dimensional Ising models, consistent with highly anisotropic Heisenberg systems. The frustration parameter ≈ 2 supports a weakly frustrated system.

Antiferromagnets

SympGNNs: Symplectic Graph Neural Networks for identifying high-dimensional Hamiltonian systems and node classification

Existing neural network models to learn Hamiltonian systems, such as SympNets, although accurate in low-dimensions, struggle to learn the correct dynamics for high-dimensional many-body systems. Herein, we introduce Symplectic Graph Neural Networks (SympGNNs) that can effectively handle system identification in high-dimensional Hamiltonian systems, as well as node classification. SympGNNs combine symplectic maps with permutation equivariance, a property of graph neural networks. Specifically, we propose two variants of SympGNNs: (i) G-SympGNN and (ii) LA-SympGNN, arising from different parameterizations of the kinetic and potential energy. We demonstrate the capabilities of SympGNN on two physical examples: a 40-particle coupled Harmonic oscillator, and a 2000-particle molecular dynamics simulation in a two-dimensional Lennard-Jones potential. Furthermore, we demonstrate the performance of SympGNN in the node classification task, achieving accuracy comparable to the state-of-the-art. Finally, we also empirically show that SympGNN can overcome the oversmoothing and heterophily problems, two key challenges in the field of graph neural networks.

Deep learning

Scalability Analysis of Quantum Models for Stress and Emotion Detection

Stress and emotion detection from high-dimensional physiological signals is a challenging task, particularly when aiming for accurate classification across diverse behavioral states. Quantum machine learning (QML) is promising for modeling such high-dimensional data, but scalability is limited by qubit resources and the exponential cost of classical statevector simulation. This work studies the scalability of quantum support vector machines (QSVMs) for binary stress detection and three-class emotion recognition (Negative/Neutral/Positive) under varying qubit counts and angle-encoding strategies. We also present a comparison study with one-feature-per-qubit (1:1) and two-features-per-qubit (2:1) mappings. Experiments are executed on HPC infrastructure using NVIDIA CUDA-Q to evaluate performance, variance, and class-dependent separability at higher-qubit setups. Results show that larger Hilbert spaces can improve peak accuracy but may increase instability. At the same time, dense 2:1 encoding yields more consistent stress detection performance. For emotion recognition, scaling improves discrimination for classes like Negative and Positive more than Neutral. We find that effective QML scaling is task-dependent and benefits more from encoding design than simply increasing qubit count.

Onim, Md. Saif Hassan [University of Tennessee, Kn

Laser Measurement Of Convective-Heat-Transfer Coefficient

Coefficient of convective transfer of heat at spot on surface of wind-tunnel model computed from measurements acquired by developmental laser-induced-heat-flux technique. Enables non-intrusive measurements of convective-heat-transfer coefficients at many points across surfaces of models in complicated, three-dimensional, high-speed flows. Measurement spot scanned across surface of model. Apparatus includes argon-ion laser, attenuator/beam splitter electronic shutter infrared camera, and subsystem.

Porro, A. Robert

Three-dimensional hydrodynamic Bondi-Hoyle accretion. 2: Homogeneous medium at Mach 3 with gamma = 5/3

We investigate the hydrodynamics of three-dimensional classical Bondi-Hoyle accretion. Totally absorbing spheres of varying sizes (from 10 down to 0.01 accretion radii) move at Mach 3 relative to a homogeneous and slightly perturbed medium, which is taken to be an ideal gas (gamma = 5/3). To accommodate the long-range gravitational forces, the extent of the computational volume is 32(exp 3) accretion radii. We examine the influence of numerical procedure on physical behavior. The hydrodynamics is modeled by the 'piecewise parabolic method.' No energy sources (nuclear burning) or sinks (radiation, conduction) are included. The resolution in the vicinity of the accretor is increased by multiply nesting several (5-10) grids around the sphere, each finer grid being a factor of 2 smaller in zone dimension that the next coarser grid. The largest dynamic range (ratio of size of the largest grid to size of the finest zone) is 16,384. This allows us to include a coarse model for the surface of the accretor (vacuum sphere) on the finest grid, while at the same time evolving the gas on the coarser grids. Initially (at time t = 0-10), a shock front is set up, a Mach cone develops, and the accretion column is observable. Eventually the flow becomes unstable, destroying axisymmetry. This happens approximately when the mass accretion rate reaches the values (+/- 10%) predicted by the Bondi-Hoyle accretion formula (factor of 2 included). However, our three-dimensional models do not show the highly dynamic flip-flop flow so prominent in two-dimensional calculations performed by other authors. The flow, and thus the accretion rate of all quantities, shows quasi-periodic (P approximately equals 5) cycles between quiescent and active states. The interpolation formula proposed in an accompanying paper is found to follow the collected numerical data to within approximately 30%. The specific angular momentum accreted is of the same order of magnitude as the values previously found for two-dimensional flows.

Ruffert, Maximilian

The calculation of theoretical chromospheric models and the interpretation of solar spectra from rockets and spacecraft

Solar chromospheric models are described. The models included are based on the observed spectrum, and on the assumption of hydrostatic equilibrium. The calculations depend on realistic solutions of the radiative transfer and statistical equilibrium equations for optically thick lines and continua, and on including the effects of large numbers of lines throughout the spectrum. Although spectroheliograms show that the structure of the chromosphere is highly complex, one-dimensional models of particular features are reasonably successful in matching observed spectra. Such models were applied to the interpretation of chromospheric observations.

Avrett, E. H.

Recent thermal models of the chromosphere

The paper describes recent research on the calculation of solar chromospheric models. The models included here are based on the observed spectrum, and on the assumption of hydrostatic equilibrium. The calculations depend on realistic solutions of the radiative transfer and statistical equilibrium equations for optically thick lines and continua, and on including the effects of large numbers of lines throughout the spectrum. Although spectroheliograms show that the structure of the chromosphere is highly complex, one-dimensional models of particular features are reasonably successful in matching observed spectra. There has been considerable recent progress in applying such models to the interpretation of chromospheric observations.

Avrett, E. H.

Hydrokinetic tidal energy resource assessment following international electrotechnical commission guidelines

Marine renewable energy can be used as a viable energy source to alleviate the impact of the climate crisis and have a carbon-free electricity sector in the future. Especially the energetic tidal streams are an attractive source of clean energy due to the periodic occurrence of high tidal flows daily. However, before any deployment of tidal turbine farms, it is essential to perform a resource assessment depending on the scope and scale of the project. Here, the International Electrotechnical Commission has developed a technical standard for assessing the tidal stream resource "IEC 62600-201 TS" to aid in this effort: determine a particular site's feasibility and perform the project layout design. In this study, we implemented and validated a high-resolution three-dimensional numerical model and provided results following the IEC TS for a project layout design in a highly energetic tidal channel, Tacoma Narrows of Puget Sound, in the State of Washington, USA. Implementation of the guidelines has helped adequately identify the undisturbed theoretical and technical resources with less bias, where the latter included energy extraction from the flow field arranging a hypothetical tidal energy converter (TEC) array. Also, following the standard, we carefully assessed the changes to channel flow properties from TECs, such as the kinetic energy flux and annual energy production (AEP), to provide the detailed information required for a larger project layout design. Ultimately, this work has shown the important role of IEC TS in tidal stream resource assessment, which can simultaneously act as a benchmark for other studies worldwide.

13 HYDRO ENERGY

Rapid wavefield forecasting for earthquake early warning via deep sequence to sequence learning

We propose a deep learning model, WaveCastNet, to forecast high-dimensional wavefields. WaveCastNet integrates a convolutional long expressive memory architecture into a sequence-to-sequence forecasting framework, enabling it to model long-term dependencies and multiscale patterns in both space and time. By sharing weights across spatial and temporal dimensions, WaveCastNet requires significantly fewer parameters than more resource-intensive models such as transformers, resulting in faster inference times. Crucially, WaveCastNet also generalizes better than transformers to rare and critical seismic scenarios, such as high-magnitude earthquakes. Here, we show the ability of the model to predict the intensity and timing of destructive ground motions in real time, using simulated data from the San Francisco Bay Area. Furthermore, we demonstrate its zero-shot capabilities by evaluating WaveCastNet on real earthquake data. Our approach does not require estimating earthquake magnitudes and epicenters, steps that are prone to error in conventional methods, nor does it rely on empirical ground-motion models, which often fail to capture strongly heterogeneous wave propagation effects.

Geophysics

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning

NASA's Long-term Debris Environment and Active Debris Removal Modeling Activities

This slide presentation reviews the modeling activities for modeling of the long-term debris environment, the updated assessments of the environment, and the necessity to model the effectiveness of the technologies aimed at the removal of orbital debris. The model being used is named a LEO to GEO environment debris (LEGEND). It is a high fidelity three dimensional numerical simulation model with the capability to treat objects individually. It uses a Monte Carlo approach and a collision probability evaluation algorithm to simulate future satellite breakups and the growth of the debris populations.

Liou, J.-C.