Search NASA⌕ Search

SEARCH · Search NASA

Results for “Covariance and correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

On the statistical theory of self-gravitating collisionless dark matter flow

Dark matter, if it exists, accounts for five times as much as the ordinary baryonic matter. Compared to hydrodynamic turbulence, the flow of dark matter might possess the widest presence in our universe. This paper presents a statistical theory for the flow of dark matter that is compared with N-body simulations. By contrast to hydrodynamics of normal fluids, dark matter flow is self-gravitating, long-range, and collisionless with a scale-dependent flow behavior. The peculiar velocity field is of constant divergence nature on small scale and irrotational on large scale. The statistical measures, i.e., correlation, structure, dispersion, and spectrum functions, are modeled on both small and large scales, respectively. Kinematic relations between statistical measures are fully developed for incompressible, constant divergence, and irrotational flow. Incompressible and constant divergence flow share the same kinematic relations for even order correlations. The limiting correlation of velocity $\mathrm{ρ_{L}=1/2}$ on the smallest scale ( r = 0) is a unique feature of collisionless flow (⁠$\mathrm{ρ_{L}=1}$ for incompressible flow). On large scale, transverse velocity correlation has an exponential form $T_{2}∝e^{–r/r_2}$ with a constant comoving scale r 2 =21.3 Mpc/h that may be related to the horizon size at matter–radiation equality. All other correlation, structure, dispersion, and spectrum functions for velocity, density, and potential fields are derived analytically from kinematic relations for irrotational flow. On small scale, longitudinal structure function follows one-fourth law of ${S}_{2}^{1}∝r^{1/4}$. All other statistical measures can be obtained from kinematic relations for constant divergence flow. Vorticity is negatively correlated for scale r between 1 and 7 Mpc/h. Divergence is negatively correlated for r > 30 Mpc/h that leads to a negative density correlation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Temporal Error Correlations in a Terrestrial Carbon Cycle Model Derived by Comparison to Carbon Dioxide Eddy Covariance Flux Tower Measurements

Abstract Atmospheric CO 2 flux inversions require as input an estimate of spatial and temporal correlations of errors in their estimate of the prior mean. Some previous studies have used the differences in CO 2 daily average flux estimates produced by terrestrial carbon cycle models and eddy covariance measurements to constrain the flux error correlations. Since inversions are starting to resolve the daily cycle, we set out to examine the correlations at sub‐daily time scales, as well as the correlations across years. To this end, we examine the autocorrelations in the difference between net ecosystem‐atmosphere exchange measurements from 75 AmeriFlux towers and temporally downscaled high‐spatial‐resolution flux estimates from the Carnegie‐Ames‐Stanford Approach (CASA) terrestrial carbon cycle model. We find that the daily cycle is prominent in these hourly autocorrelations and that these autocorrelations persist across years. We propose a family of functions to model these temporal correlations in atmospheric inversions, and use cross validation to determine which of the correlation functions best fits autocorrelation data from towers not in the training set. Correlation functions with a component that attempts to model the daily cycle in the differences match correlations from other towers better than those without. Those models that reproduce the same correlation structures at 1‐year intervals while modulating the amplitudes of the correlations between those intervals improve the fit still further.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Stability of Kuramoto networks subject to large and small fluctuations from heterogeneous and spatially correlated noise

Oscillatory networks subjected to noise are broadly used to model physical and technological systems. Due to their nonlinear coupling, such networks typically have multiple stable and unstable states that a network might visit due to noise. In this article, we focus on the assessment of fluctuations resulting from heterogeneous and spatially correlated noise inputs on Kuramoto model networks. We evaluate the typical, small fluctuations near synchronized states and connect the network variance to the overlap between stable modes of synchronization and the input noise covariance. Going beyond small to large fluctuations, we introduce the indicator mode approximation that projects the dynamics onto a single amplitude dimension. Such an approximation allows for estimating rates of fluctuations to saddle instabilities, resulting in phase slips between connected oscillators. Statistics for both regimes are quantified in terms of effective noise amplitudes that are compared and contrasted for several noise models. In conclusion, bridging the gap between small and large fluctuations, we show that a larger network variance does not necessarily lead to higher rates of large fluctuations.

42 ENGINEERING↗
DOE OSTI2025

Covariance operator estimation via adaptive thresholding

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the sample covariance function using an estimate of the variance component. Building on recent results from empirical process theory, we derive an operator norm bound on the estimation error in terms of the sparsity level of the covariance and the expected supremum of a normalized process. Furthermore, our theory and numerical simulations demonstrate the advantage of adaptive threshold estimators over universal threshold and sample covariance estimators in nonstationary settings.

Al-Ghattas, Omar [University of Chicago, IL (Unite↗
DOE OSTI2021

Does jackknife scale really matter for accurate large-scale structure covariances?

ABSTRACT The jackknife method gives an internal covariance estimate for large-scale structure surveys and allows model-independent errors on cosmological parameters. Using the SDSS-III BOSS CMASS sample, we study how the jackknife size and number of resamplings impact the precision of the covariance estimate on the correlation function multipoles and the error on the inferred baryon acoustic scale. We compare the measurement with the MultiDark Patchy mock galaxy catalogues, and we also validate it against a set of lognormal mocks with the same survey geometry. We build several jackknife configurations that vary in size and number of resamplings. We introduce the Hartlap factor in the covariance estimate that depends on the number of jackknife resamplings. We also find that it is useful to apply the tapering scheme to estimate the precision matrix from a limited number of resamplings. The results from CMASS and mock catalogues show that the error estimate of the baryon acoustic scale does not depend on the jackknife scale. For the shift parameter α, we find an average error of 1.6 per cent, 2.2 per cent and 1.2 per cent, respectively, from CMASS, Patchy, and lognormal jackknife covariances. Despite these uncertainties fluctuate significantly due to some structural limitations of the jackknife method, our α estimates are in reasonable agreement with published pre-reconstruction analyses. Jackknife methods will provide valuable and complementary covariance estimates for future large-scale structure surveys.

Favole, Ginevra (ORCID:000000028218563X)↗
DOE OSTI2026

Eddy Correlation Flux Measurement System (ECOR) Instrument Handbook

The eddy correlation (ECOR) flux measurement system provides in situ, half-hour measurements of surface turbulent fluxes of momentum, sensible heat, latent heat, and carbon dioxide (CO 2 ) at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility sites. ARM’s ECORs also historically measured methane fluxes at Utqiaġvik and Oliktok Point, Alaska. The fluxes are obtained with the eddy covariance technique, which involves correlation of the vertical wind component with the horizontal wind component, the air temperature, the water vapor density, and the CO 2 concentration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Eddy Correlation Flux Measurement System (ECOR) Instrument Handbook

The eddy correlation (ECOR) flux measurement system provides in situ, half-hour measurements of the surface turbulent fluxes of momentum, sensible heat, latent heat, and carbon dioxide (CO 2 ) (and methane at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s North Slope of Alaska central facility [NSA Barrow], and at the ARM Mobile Facility (AMF) deployment at Oliktok Point). The fluxes are obtained with the eddy covariance technique, which involves correlation of the vertical wind component with the horizontal wind component, the air temperature, the water vapor density, and the CO 2 concentration. The instruments used are: a fast-response, three-dimensional (3D) wind sensor (sonic anemometer) to obtain the orthogonal wind components and the speed of sound (SOS) (used to derive the air temperature), an open-path infrared gas analyzer (IRGA) to obtain the water vapor density and the CO 2 concentration, and an open-path infrared gas analyzer (IRGA) to obtain methane density and methane flux at NSA Barrow and at the AMF deployment at Oliktok Point. The ECOR systems are deployed at the locations where other methods for surface flux measurements (e.g., energy balance Bowen ratio [EBBR] systems) are difficult to employ, primarily at the north edge of a field of crops. A surface energy balance system (SEBS) has been installed collocated with each deployed ECOR system in SGP, NSA, Tropical Western Pacific (TWP), and each of three ARM Mobile Facilities. The surface energy balance system consists of upwelling and downwelling solar and infrared radiometers within one net radiometer, a wetness sensor, and soil measurements. Finally, the SEBS measurements allow the comparison of ECOR sensible and latent heat fluxes with the energy balance determined from the SEBS and provide information on wetting of the sensors for data quality purposes.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Dynamical correlation between ions in liquid seen in real space and time

Controlling ionic transport in liquids is anticipated to provide new scientific and technological opportunities, but it requires accurate knowledge of atomic-scale dynamics of ions beyond the hydrodynamic description. Atomic dynamics in liquids is characterized by strong and dynamical correlations among atoms, which render a conventional approach to describing the dynamics in reciprocal space challenging. We propose an alternative approach to describe liquid dynamics in real space and time using the time-delayed two-body correlation function, Van Hove correlation function, and discuss recent results on the local dynamics in water and electrolytes.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

Novel 2D velocity estimation method for large transient events in plasmas

Dynamics of fast transient events are challenging to be analyzed with high time resolution. Such events can occur in fusion plasmas such as the filaments during edge-localized modes (ELMs). Here, we present a robust method—the spatial displacement estimation—for estimating the displacements of structures with fast dynamics from high spatial and time resolution imaging diagnostics [e.g., gas-puff imaging (GPI)] with sampling time temporal resolution. First, a background suppression method is shown, which suppresses the slowly time-evolving and spatially non-uniform background in the signal. In the second step, a two-dimensional polynomial trend subtraction method is presented to tackle the remaining polynomial order trend in the signal. After performing these pre-processing steps, the spatial displacement of the propagating structure is estimated from the two-dimensional spatial cross-correlation coefficient function calculated between consecutive frames. The method is tested for its robustness and accuracy by simulated Gaussian events and spatially displaced random noise. An example application of the method is presented on propagating ELM filaments measured by the GPI system on the National Spherical Torus Experiment spherical tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Materials representation and transfer learning for multi-property prediction

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements as well as the relationships among multiple properties to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates: (i) prediction using only a material's composition, (ii) learning and exploitation of correlations among target properties in multi-target regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 three-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data are available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with transfer learning [H-CLMP(T)] wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well suited for multi-target regression across the physical sciences.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Small angle scattering of diblock copolymers profiled by machine learning

We outline a machine learning strategy for quantitively determining the conformation of AB-type diblock copolymers with excluded volume effects using small angle scattering. Complemented by computer simulations, a correlation matrix connecting conformations of different copolymers according to their scattering features is established on the mathematical framework of a Gaussian process, a multivariate extension of the familiar univariate Gaussian distribution. We show that the relevant conformational characteristics of copolymers can be probabilistically inferred from their coherent scattering cross sections without any restriction imposed by model assumptions. This work not only facilitates the quantitative structural analysis of copolymer solutions but also provides the reliable benchmarking for the related theoretical development of scattering functions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Descriptors of water aggregation

For this work, we rely on a total of 23 (cluster size, 8 structural, and 14 connectivity) descriptors to investigate structural patterns and connectivity motifs associated with water cluster aggregation. In addition to the cluster size n (number of molecules), the 8 structural descriptors can be further categorized into (i) one-body (intramolecular): covalent OH bond length (r OH ) and HOH bond angle (θ HOH ), (ii) two-body: OO distance (r OO ), OHO angle (θ OHO ), and HOOX dihedral angle ($\phi$ HOOX ), where X lies on the bisector of the HOH angle, (iii) three-body: OOO angle (θ OOO ), and (iv) many-body: modified tetrahedral order parameter (q) to account for two-, three-, four-, five-coordinated molecules (q m , m = 2, 3, 4, 5) and radius of gyration (R g ). The 14 connectivity descriptors are all many-body in nature and consist of the AD, AAD, ADD, AADD, AAAD, AAADD adjacencies [number of hydrogen bonds accepted (A) and donated (D) by each water molecule], Wiener index, Average Shortest Path Length, hydrogen bond saturation (% HB), and number of non-short-circuited three-membered cycles, four-membered cycles, five-membered cycles, six-membered cycles, and seven-membered cycles. We mined a previously reported database of 4 948 959 water cluster minima for (H 2 O) n , n = 3–25 to analyze the evolution and correlation of these descriptors for the clusters within 5 kcal/mol of the putative minima. It was found that r OH and % HB correlated strongly with cluster size n, which was identified as the strongest predictor of energetic stability. Marked changes in the adjacencies and cycle count were observed, lending insight into changes in the hydrogen bond network upon aggregation. A Principal Component Analysis (PCA) was employed to identify descriptor dependencies and group clusters into specific structural patterns across different cluster sizes. The results of this study inform our understanding of how water clusters evolve in size and what appropriate descriptors of their structural and connectivity patterns are with respect to system size, stability, and similarity. The approach described in this study is general and can be easily extended to other hydrogen-bonded systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

OrbNet Denali: A machine learning potential for biological and organic chemistry with semi-empirical cost and DFT accuracy

We present OrbNet Denali, a machine learning model for an electronic structure that is designed as a drop-in replacement for groundstate density functional theory (DFT) energy calculations. The model is a message-passing graph neural network that uses symmetryadapted atomic orbital features from a low-cost quantum calculation to predict the energy of a molecule. OrbNet Denali is trained on a vast dataset of 2.3 × 10 6 DFT calculations on molecules and geometries. This dataset covers the most common elements in biochemistry and organic chemistry (H, Li, B, C, N, O, F, Na, Mg, Si, P, S, Cl, K, Ca, Br, and I) and charged molecules. OrbNet Denali is demonstrated on several well-established benchmark datasets, and we find that it provides accuracy that is on par with modern DFT methods while offering a speedup of up to three orders of magnitude. For the GMTKN55 benchmark set, OrbNet Denali achieves WTMAD-1 and WTMAD-2 scores of 7.19 and 9.84, on par with modern DFT functionals. For several GMTKN55 subsets, which contain chemical problems that are not present in the training set, OrbNet Denali produces a mean absolute error comparable to those of DFT methods. For the Hutchison conformer benchmark set, OrbNet Denali has a median correlation coefficient of R 2 = 0.90 compared to the reference DLPNO-CCSD(T) calculation and R 2 = 0.97 compared to the method used to generate the training data (ωB97X-D3/def2- TZVP), exceeding the performance of any other method with a similar cost. Similarly, the model reaches chemical accuracy for noncovalent interactions in the S66x10 dataset. For torsional profiles, OrbNet Denali reproduces the torsion profiles of ωB97X-D3/def2-TZVP with an average mean absolute error of 0.12 kcal/mol for the potential energy surfaces of the diverse fragments in the TorsionNet500 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Parity-odd four-point correlation function from the DESI data release 1 luminous red galaxy sample

The parity-odd four-point function provides a unique probe of fundamental symmetries and potential new physics in the large-scale structure of the Universe. We present measurements of the parity-odd four-point function using the Dark Energy Spectroscopic Instrument (DESI) DR1 luminous red galaxy (LRG) sample and assess its detection significance. Our analysis considers both auto- and cross-correlations, using two complementary approaches to the covariance: (i) the full analytic covariance matrix applied to the uncompressed data vector, and (ii) a compressed data vector combined with a hybrid covariance matrix constructed from simulations and analytic estimates. When using the full analytic covariance matrix without corrections, we observe apparent auto-correlation signals with significance up to 4⁢𝜎. However, this excess is also consistent with a mismatch between the statistical fluctuations estimated from the simulations and those present in the real data. Our findings therefore suggest that the parity-odd signal in the current DESI DR1 LRG sample is consistent with zero. We note, however, that the low completeness of this sample may have a non-negligible impact on the detection sensitivity. Future data releases with improved completeness will be crucial for further investigation.

Hou, Jiamin [Ludwig-Maximilians-Universität; Unive↗
DOE OSTI2024

Fermionic mean-field theory as a tool for studying spin Hamiltonians

The Jordan–Wigner transformation permits one to convert spin 1/2 operators into spinless fermion ones, or vice versa. In some cases, it transforms an interacting spin Hamiltonian into a noninteracting fermionic one, which is exactly solved at the mean-field level. Even when the resulting fermionic Hamiltonian is interacting, its mean-field solution can provide surprisingly accurate energies and correlation functions. Furthermore, Jordan–Wigner is, however, only one possible means of interconverting spin and fermionic degrees of freedom. Here, we apply several such techniques to the XXZ and J 1 –J 2 Heisenberg models, as well as to the pairing or reduced Bardeen–Cooper–Schrieffer Hamiltonian, with the aim of discovering which of these mappings is most useful in applying fermionic mean-field theory to the study of spin Hamiltonians.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Evolution of intermittent filaments in the scrape-off layer of NSTX

Filamentary structures naturally arise from background turbulence in the scrape-off layer (SOL) of plasmas, leading to significant particle and heat transport that can degrade overall plasma confinement. This enhanced transport can contribute to unacceptably high heat loads on plasma-facing components. As such, understanding the physics of SOL plasma filaments is critical for predicting and mitigating their effects in future fusion devices. On the National Spherical Torus Experiment (NSTX), plasma filaments—commonly referred to as “blobs”—were investigated using the gas-puff imaging (GPI) diagnostic in the edge and SOL regions. The analysis involved identifying, segmenting, and tracking the characteristic contours of the blobs in each frame of the GPI video sequences. Their evolution was characterized through shape descriptors, velocity, and angular velocity derived from their contour coordinates. The results indicate that as the blob area increases, their shapes become more concave and less circular, suggesting reduced structural stability in larger blobs. This result aligns with previous theoretical results where it was shown that larger blobs are more susceptible to instabilities [Krasheninnikov et al., J. Plasma Phys. 74, 679–717 (2008) and D'Ippolito et al., Phys. Plasmas 18, 060501 (2011)]. A positive correlation was observed between radial velocity and radial position, suggesting radially outward acceleration of the filaments, potentially driven by decreasing viscous drag toward the far SOL. Interestingly, blobs in background SOL turbulence exhibited minimal spinning in contrast to filaments originating from edge localized modes, which show substantial rotation during their paths [Lampert et al., Phys. Plasmas 29, 102502 (2022)]. Statistical analysis of the solidity and total curvature shape descriptors, along with their temporal evolution, revealed relatively broad, near-Gaussian distributions. This suggests that blob morphology is strongly influenced by stochastic turbulent processes in the surrounding plasma environment. Blob parameters were also compared with bulk plasma and radial profile measurements. Notable trends were found between blob rotation and poloidal velocity with collisionality and line-integrated density. These findings contribute to a deeper understanding of blob dynamics and provide valuable insights for refining SOL turbulence models.

Covariance and correlation↗
DOE OSTI2023

Surface coverage dynamics for reversible dissociative adsorption on finite linear lattices

Dissociative adsorption onto a surface introduces dynamic correlations between neighboring sites not found in non-dissociative absorption. We study surface coverage dynamics where reversible dissociative adsorption of dimers occurs on a finite linear lattice. We derive analytic expressions for the equilibrium surface coverage as a function of the number of reactive sites, N, and the ratio of the adsorption and desorption rates. Using these results, we characterize the finite size effect on the equilibrium surface coverage. For comparable N’s, the finite size effect is significantly larger when N is even than when N is odd. Moreover, as N increases, the size effect decays more slowly in the even case than in the odd case. The finite-size effect becomes significant when adsorption and desorption rates are considerably different. These finite-size effects are related to the number of accessible configurations in a finite system where the odd-even dependence arises from the limited number of accessible configurations in the even case. We confirm our analytical results with kinetic Monte Carlo simulations. We also analyze the surface-diffusion case where adsorbed atoms can hop into neighboring sites. As expected, the odd-even dependence disappears because more configurations are accessible in the even case due to surface diffusion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Correlation function metrology for warm dense matter: Recent developments and practical guidelines

X-ray Thomson scattering (XRTS) has emerged as a valuable diagnostic for matter under extreme conditions, as it captures the intricate many-body physics of the probed sample. Recent advances, such as the model-free temperature diagnostic of Dornheim et al. [Nat. Commun. 13 , 7911 (2022)], have demonstrated how much information can be extracted directly within the imaginary-time formalism. However, since the imaginary-time formalism is a concept often difficult to grasp, we provide here a systematic overview of its theoretical foundations and explicitly demonstrate its practical applications to temperature inference, including relevant subtleties. Furthermore, we present recent developments that enable the determination of the absolute normalization, Rayleigh weight, and density from XRTS measurements without reliance on uncontrolled model assumptions. Finally, we outline a unified workflow that guides the extraction of these key observables, offering a practical framework for applying the method to interpret experimental measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗