Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sparse representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

ECLEIRS: Exact conservation law embedded identification of reduced states for parameterized nonlinear conservation laws from sparse and noisy data

Multi-query applications such as parameter estimation, uncertainty quantification and design optimization for parameterized partial differential equation (PDE) systems are expensive. While reduced/latent state dynamics approaches for parameterized PDEs offer a viable alternative, these approaches rely on high-quality data and struggle with highly sparse spatiotemporal noisy measurements typically obtained from experiments. Furthermore, there is no guarantee that these models satisfy governing physical conservation laws. In this article, we propose a reduced state dynamics approach, referred to as ECLEIRS, that embeds exact conservation in the solution and flux representation by utilizing a space-time divergence-free neural network formulation. We compare ECLEIRS with other reduced state dynamics approaches, those that do not enforce any physical constraints and those with physics-informed loss functions, for three shock-propagation problems: 1-D advection, 1-D Burgers and 2-D Euler equations. In conclusion, the numerical experiments conducted in this study demonstrate that ECLEIRS provides the most accurate prediction of dynamics for unseen parameters even in the presence of highly sparse and noisy data.

97 MATHEMATICS AND COMPUTING↗

Understanding the Design Space of Sparse/Dense Multiphase Dataflows for Mapping Graph Neural Networks on Spatial Accelerators

Graph Neural Networks (GNNs) have garnered a lot of recent interest because of their success in learning representations from graph-structured data across several critical applications in cloud and HPC. Owing to their unique compute and memory characteristics that come from an interplay between dense and sparse phases of computations, the emergence of reconfigurable dataflow (aka spatial) accelerators offers promise for acceleration by mapping optimized dataflows (i.e., computation order and parallelism) for both phases. The goal of this work is to characterize and understand the design-space of dataflow choices for running GNNs on spatial accelerators in order for the compilers to optimize the dataflow based on the workload. Specifically, we propose a taxonomy to describe all possible choices for mapping the dense and sparse phases of GNNs spatially and temporally over a spatial accelerator, capturing both the intra-phase dataflow and the inter-phase (pipelined) dataflow. Using this taxonomy, we do deep-dives into the cost and benefits of several dataflows and perform case studies on implications of hardware parameters for dataflows and value of flexibility to support pipelined execution.

97 MATHEMATICS AND COMPUTING↗

Enhancements of Bayesian Blocks; Application to Large Light Curve Databases

Bayesian Blocks are optimal piecewise linear representations (step function fits) of light-curves. The simple algorithm implementing this idea, using dynamic programming, has been extended to include more data modes and fitness metrics, multivariate analysis, and data on the circle (Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations, Scargle, Norris, Jackson and Chiang 2013, ApJ, 764, 167), as well as new results on background subtraction and refinement of the procedure for precise timing of transient events in sparse data. Example demonstrations will include exploratory analysis of the Kepler light curve archive in a search for "star-tickling" signals from extraterrestrial civilizations. (The Cepheid Galactic Internet, Learned, Kudritzki, Pakvasa1, and Zee, 2008, arXiv: 0809.0339; Walkowicz et al., in progress).

Kepler light curve archive↗

Arctic sea ice albedo from AVHRR

The seasonal cycle of surface albedo of sea ice in the Arctic is estimated from measurements made with the Advanced Very High Resolution Radiometer (AVHRR) on the polar-orbiting satellites NOAA-10 and NOAA-11. The albedos of 145 200-km-square cells are analyzed. The cells are from March through September 1989 and include only those for which the sun is more than 10 deg above the horizon. Cloud masking is performed manually. Corrections are applied for instrument calibration, nonisotropic reflection, atmospheric interference, narrowband to broadband conversion, and normalization to a common solar zenith angle. The estimated albedos are relative, with the instrument gain set to give an albedo of 0.80 for ice floes in March and April. The mean values for the cloud-free portions of individual cells range from 0.18 to 0.91. Monthly averages of cells in the central Arctic range from 0.76 in April to 0.47 in August. The monthly averages of the within-cell standard deviations in the central Arctic are 0.04 in April and 0.06 in September. The surface albedo and surface temperature are correlated most strongly in March (R = -0.77) with little correlation in the summer. The monthly average lead fraction is determined from the mean potential open water, a scaled representation of the temperature or albedo between 0.0 (for ice) and 1.0 (for water); in the central Arctic it rises from an average 0.025 in the spring to 0.06 in September. Sparse data on aerosols, ozone, and water vapor in the atmospheric column contribute uncertainties to instantaneous, area-average albedos of 0.13, 0.04, and 0.08. Uncertainties in monthly average albedos are not this large. Contemporaneous estimation of these variables could reduce the uncertainty in the estimated albedo considerably. The poor calibration of AVHRR channels 1 and 2 is another large impediment to making accurate albedo estimates.

Lindsay, R. W.↗

Improving Simulations of Vegetation Dynamics over the Tibetan Plateau: Role of Atmospheric Forcing Data and Spatial Resolution

The efficacy of vegetation dynamics simulations in offline land surface models (LSMs) largely depends on the quality and spatial resolution of meteorological forcing data. In this study, the Princeton Global Meteorological Forcing Data (PMFD) and the high spatial resolution and upscaled China Meteorological Forcing Data (CMFD) were used to drive the Simplified Simple Biosphere model version 4/Top-down Representation of Interactive Foliage and Flora Including Dynamics (SSiB4/TRIFFID) and investigate how meteorological forcing datasets with different spatial resolutions affect simulations over the Tibetan Plateau (TP), a region with complex topography and sparse observations. By comparing the monthly Leaf Area Index (LAI) and Gross Primary Production (GPP) against observations, we found that SSiB4/TRIFFID driven by upscaled CMFD improved the performance in simulating the spatial distributions of LAI and GPP over the TP, reducing RMSEs by 24.3% and 20.5%, respectively. The multi-year averaged GPP decreased from 364.68 gC m –2 yr –1 to 241.21 gC m –2 yr –1 with the percentage bias dropping from 50.2% to –1.7%. When using the high spatial resolution CMFD, the RMSEs of the spatial distributions of LAI and GPP simulations were further reduced by 7.5% and 9.5%, respectively. This study highlights the importance of more realistic and high-resolution forcing data in simulating vegetation growth and carbon exchange between the atmosphere and biosphere over the TP.

54 ENVIRONMENTAL SCIENCES↗

Improved Reanalysis and Prediction of Atmospheric Fields Over the Southern Ocean Using Campaign‐Based Radiosonde Observations

Abstract This study investigated the impact of radiosonde observations from the Southern Ocean obtained by the Australian R/V Aurora Australis on the ALERA2 experimental ensemble reanalysis data set and ensemble forecast experiment. An observing system experiment (OSE) that included additional ship‐launched radiosonde data captured the atmospheric structure over the Southern Ocean. ALERA2 without additional radiosondes had positive temperature biases exceeding 7 °C in the upper troposphere when low‐pressure cyclonic systems passed over the ship. The spread in the upper level was reduced by 15% in the OSE, which propagated downstream from the ship's position because of the sparse observing network over southern high latitudes. Comparison of two 63‐member ensemble forecast experiments initialized by ALERA2 and the OSE revealed that prediction of midlatitude cyclone tracks was improved by the realistic representation of upper‐level troughs in the OSE forecast. This confirms that additional radiosondes over the Southern Ocean reduce uncertainty and error in midlatitude cyclone forecasts.

54 ENVIRONMENTAL SCIENCES↗

Understanding Differences Between Co-Incident CloudSat, Aqua/MODIS and NOAA18 MHS Ice water Path Retrievals Over the Tropical Oceans

Accurate measurement of the physical and radiative properties of clouds and their representation in climate models continues to be a challe nge. Model parameterizations are still subject to a large number of t unable parameters; furthermore, accurate and representative in situ o bservations are very sparse, and satellite observations historically have significant quantitative uncertainties, particularly with respect to particle size distribution (PSD) and cloud phase. Ice Water Path (IWP), or amount of ice present in a cloud column, is an important cl oud property to accurately quantify, because it is an integral measur e of the microphysical properties of clouds and the cloud feedback pr ocesses in the climate system. This paper investigates near co-incident retrievals of IWP over tropical oceans using three diverse measurem ent systems: radar from CloudSat, Vis/IR from Aqua/MODIS, and microwa ve from NOAA-18IMHS. CloudSat 94 GHz radar measurements provide high resolution vertical and along-orbit structure of cloud reflectivity a nd enable IWP (and IWC) retrievals. Overlapping MODIS measurements of cloud optical thickness and phase allow estimates of IWP when cloud tops are identified as being ice. Periodically, NOAA18 becomes co-inci dent in space I time to enable comparison of A-Train measurements to IWP inferred from the 157 and 89 GHz channel radiances. This latter m easurement is effective only for thick convective anvil systems. We s tratify these co-incident data (less than 4 minutes separation) into cirrus only, cirrus overlying liquid water clouds, and precipitating d eep convective clouds. Substantial biases in IWP and ice effective ra dius are found. Systematic differences in these retrievals are consid ered in light of the uncertainties in a priori assumptions ofPSDs, sp ectral sensitivity and algorithm strategies, which have a direct impact on the IWP product.

Pittman, Jasna↗

Cloud condensation nuclei concentrations derived from the CAMS reanalysis

Determining number concentrations of cloud condensation nuclei (CCN) is one of the first steps in the chain in analysis of cloud droplet formation, the direct microphysical link between aerosols and cloud droplets, and a process key for aerosol–cloud interactions (ACI). However, due to sparse coverage of in situ measurements and difficulties associated with retrievals from satellites, a global exploration of their magnitude, source as well as temporal and spatial distribution cannot be easily obtained. Thus, a better representation of CCN numbers is one of the goals for quantifying ACI processes and achieving uncertainty-reduced estimates of their associated radiative forcing. Here, we introduce a new CCN dataset which is derived based on aerosol mass mixing ratios from the latest Copernicus Atmosphere Monitoring Service reanalysis (CAMSRA) in a diagnostic model that uses CAMSRA aerosol properties and a simplified kappa-Köhler framework suitable for global models. The emitted aerosols in CAMSRA are not only based on input from emission inventories using aerosol observations, they also have a strong tie to satellite-retrieved aerosol optical depth (AOD) as this is assimilated as a constraining factor in the reanalysis. Furthermore, the reanalysis interpolates for cases of poor or missing retrievals and thus allows for a full spatiotemporal quantification of CCN numbers. The derived CCN dataset captures the general trend and spatial and temporal distribution of total CCN number concentrations and CCN from different aerosol species. A brief evaluation with ground-based in situ measurements demonstrates the improvement of the modelled CCN over the sole use of AOD as a proxy for CCN as the overall correlation coefficient improved from 0.37 to 0.71. However, we find the modelled CCN from CAMSRA to be generally high biased and find a particular erroneous overestimation at one heavily polluted site which emphasises the need for further validation. The CCN dataset (https://doi.org/10.26050/WDCC/QUAERERE_CCNCAMS_v1, Block, 2023), which is now freely available to users, features 3-D CCN number concentrations of global coverage for various supersaturations and aerosol species covering the years 2003–2021 with daily frequency. This dataset is one of its kind as it offers lots of opportunities to be used for evaluation in models and in ACI studies.

54 ENVIRONMENTAL SCIENCES↗

Combining Tensor Decompositions and Graph Analytics to Provide Cyber Situational Awareness at HPC Scale

This paper describes MADHAT (Multidimensional Anomaly Detection fusing HPC, Analytics, and Tensors), an integrated workflow that demonstrates the applicability of HPC resources to the problem of maintaining cyber situational awareness. MADHAT combines two high-performance packages: ENSIGN for large-scale sparse tensor decompositions and HAGGLE for graph analytics. Tensor decompositions isolate coherent patterns of network behavior in ways that common clustering methods based on distance metrics cannot. Parallelized graph analysis then uses directed queries on a representation that combines the elements of identified patterns with other available information (such as additional log fields, domain knowledge, network topology, whitelists and blacklists, prior feedback, and published alerts) to confirm or reject a threat hypothesis, collect context, and raise alerts. MADHAT was developed using the collaborative HPC Architecture for Cyber Situational Awareness (HACSAW) research environment and evaluated on structured network sensor logs collected from Defense Research and Engineering Network (DREN) sites using HPC resources at the U.S. Army Engineer Research and Development Center DoD Supercomputing Resource Center (ERDC DSRC). To date, MADHAT has analyzed logs with over 650 million entries.

Cyber security, Tensor decomposition, graph analyt↗

Cognitive factors associated with immersion in virtual environments

Immersion into the dataspace provided by a computer, and the feeling of really being there or 'presence', are commonly acknowledged as the uniquely important features of virtual reality environments. How immersed one feels appears to be determined by a complex set of physical components and affordances of the environment, and as yet poorly understood psychological processes. Pimentel and Teixeira say that the experience of being immersed in a computer-generated world involves the same mental shift of 'suspending your disbelief for a period of time' as 'when you get wrapped up in a good novel or become absorbed in playing a computer game'. That sounds as if it could be right, but it would be good to get some evidence for these important conclusions. It might be even better to try to connect these statements with theoretical positions that try to do justice to complex cognitive processes. The basic precondition for understanding Virtual Reality (VR) is understanding the spatial representation systems that localize our bodies or egocenters in space. The effort to understand these cognitive processes is being driven with new energy by the pragmatic demands of successful virtual reality environments, but the literature is largely sparse and anecdotal.

Psotka, Joseph↗

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗

Machine learning inversion of interatomic force constants from single-crystal inelastic neutron scattering

Atomic vibrations govern many macroscopic properties of materials, but experiments to comprehensively probe them remain challenging. Inelastic neutron scattering (INS) is a powerful technique to map phonon dispersions in crystals, especially when leveraging modern time-of-flight (ToF) spectrometers with large detectors. However, efficiently and robustly extracting interatomic force constants (FCs) parameterizing phonon dynamics from experimental spectra remains a bottleneck due to the complexity and high dimensionality of ToF INS datasets. Here, we present a machine learning approach for the direct inversion of FCs from single-crystal INS measurements. The framework leverages synthetic training data generated using universal machine-learned force fields and an efficient physics-based forward model. We benchmark two neural architectures–one emphasizing structured latent representation learning and the other direct, supervised spectral regression–across simulated datasets for two materials under idealized and noisy conditions. The latent-representation model is subsequently applied to experimental single-crystal INS data on germanium. The model is shown to reproduce FCs derived from both first-principles simulations and from iterative optimization, and furthermore achieves reliable inference even from sparse, single-orientation measurements representing short data acquisitions. Analysis of the learned latent space reveals semantically continuous and physically interpretable encodings that support strong cross-domain generalization. By bridging theoretical and experimental domains, we establish a path toward rapid inversion of experimental spectra and data-driven interpretation of temperature-dependent lattice dynamics.

42 ENGINEERING↗

Qubit Lattice Algorithms Based on the Schrödinger-Dirac Representation of Maxwell Equations and Their Extensions

It is well known that Maxwell equations can be expressed in a unitary Schrodinger-Dirac representation for homogeneous media. However, difficulties arise when considering inhomogeneous media. A Dyson map points to a unitary field qubit basis, but the standard qubit lattice algorithm of interleaved unitary collision-stream operators must be augmented by some sparse non-unitary potential operators that recover the derivatives on the refractive indices. Here, the effect of the steepness of these derivatives on two-dimensional scattering is examined with simulations showing quite complex wavefronts emitted due to transmissions/reflections within the dielectric objects. Maxwell equations are extended to handle dissipation using Kraus operators. Then, our theoretical algorithms are extended to these open quantum systems. A quantum circuit diagram is presented as well as estimates on the required number of quantum gates for implementation on a quantum computer.

2D electromagnetic scattering↗

On the Recoverability of Reactor Dynamics from Point Kinetics Data using SINDYc

Data driven models for reactor dynamics tend to face a few notable challenges. First, the broad range of timescales present across the various feedback mechanisms. Next, high standards for safety and importance of model performance in all operational domains. Finally, the correlations between state variables observed in most transients leads to difficulties when methods attempt to attribute certain dynamic phenomena to a particular cause. The current paper seeks to support efforts towards incorporating physics knowledge into one particular data-driven method for finding reactor dynamics called ``Sparse Identification of Nonlinear Dynamics with Control (SINDYc). The incorporation of physical knowledge into SINDYc will help address the challenges listed above by giving the model an initial understanding of the system being modeled. The demonstration of an exact representation of a set of point reactor dynamics equations in SINDYc is provided. Then, this allows for further discussion with mathematical justification as to why SINDYc, and other data-driven methods, may be difficult to apply to nuclear reactor dynamics due to correlations in the state variables. A particularly useful result of this work is the set of candidate functions required in SINDYc to exactly represent the reactor dynamics under a point approximation. In the future, SINDYc can be integrated with point models for reactor dynamics before being applied to the physical system to yield higher accuracy.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Artificial Intelligence Guided Studies of van der Waals Magnets

A materials informatics framework to explore a large number of candidate van der Waals (vdW) materials is developed. In particular, in this study a large space of monolayer transition metal halides is investigated by combining high-throughput density functional theory calculations and artificial intelligence (AI) to accelerate the discovery of stable materials and the prediction of their magnetic properties. Here, the formation energy is used as a proxy for chemical stability. Semi-supervised learning is harnessed to mitigate the challenges of sparsely labeled materials data in order to improve the performance of AI models. This approach creates avenues for the rapid discovery of chemically stable vdW magnets by leveraging the ability of AI to recognize patterns in data, to learn mathematical representations of materials from data and to predict materials properties. Using this approach, previously unexplored vdW magnetic materials with potential applications in data storage and spintronics are identified.

36 MATERIALS SCIENCE↗

Qubit Lattice Algorithms based on the Schrodinger-Dirac representation of Maxwell Equations and their Extensions

It is well known that Maxwell equations can be expressed in a unitary Schrodinger-Dirac representation for homogeneous media. However, difficulties arise when considering inhomoge- neous media. A Dyson map points to a unitary field qubit basis, but the standard qubit lattice algorithm of interleaved unitary collision-stream operators must be augmented by some sparse non-unitary potential operators that recover the derivatives on the refractive indices. The effect of the steepness of these derivatives on two dimensional scattering is examined with simulations showing quite complex wavefronts emitted due to transmissions/reflections within the dielectric objects. Maxwell equations are extended to handle dissipation using Kraus operators. Then, our theoretical algorithms are extended to these open quantum systems. A quantum circuit diagram is presented as well as estimates on the required number of quantum gates for implementation on a quantum computer.

Vahala, George↗

Fast and converged classical simulations of evidence for the utility of quantum computing before fault tolerance

A recent quantum simulation of observables of the kicked Ising model on 127 qubits implemented circuits that exceed the capabilities of exact classical simulation. We show that several approximate classical methods, based on sparse Pauli dynamics and tensor network algorithms, can simulate these observables orders of magnitude faster than the quantum experiment and can also be systematically converged beyond the experimental accuracy. Our most accurate technique combines a mixed Schrödinger and Heisenberg tensor network representation with the Bethe free entropy relation of belief propagation to compute expectation values with an effective wave function–operator sandwich bond dimension >16,000,000, achieving an absolute accuracy, without extrapolation, in the observables of <0.01, which is converged for many practical purposes. We thereby identify inaccuracies in the experimental extrapolations and suggest how future experiments can be implemented to increase the classical hardness.

Science & Technology - Other Topics↗