A likelihood ratio test for shrinkage covariance estimators
Explore the source record for details and available documents.
Anderson, Dylan Zachary↗
SEARCH · Search NASA
Results for “Covariance”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
An analytic approximation to the covariance between pre- and post-reconstruction galaxy two-point statistics
We present a simple analytic approximation for the covariance between pre-reconstruction galaxy power spectrum measurements and post-reconstruction two-point correlation functions. This cross-covariance is essential for joint analyses that combine full-shape clustering information with baryon acoustic oscillation (BAO) measurements, as commonly performed in modern spectroscopic surveys. Our model builds on the disconnected contribution to the covariance and accounts for the damping of correlations due to the BAO reconstruction process. We validate our analytic prescription against numerical simulations from the Dark Energy Spectroscopic Instrument (DESI), testing both idealized cubic geometries and realistic survey configurations including complex footprints and fiber assignment effects. Despite neglecting survey window functions in the analytic calculation, we find excellent agreement with simulation-based covariances and demonstrate that cosmological parameter constraints are virtually unchanged when using our approximation. Our results show that the pre-post cross-covariance is sufficiently small that even approximate treatments are adequate for cosmological inference, opening a pathway toward fully analytic covariance matrices for next-generation galaxy surveys.
baryon acoustic oscillations↗
Neural network based emulation of galaxy power spectrum covariances: A reanalysis of BOSS DR12 data
We train neural networks to quickly generate redshift-space galaxy power spectrum covariances from a given parameter set (cosmology and galaxy bias). This covariance emulator utilizes a combination of traditional fully connected network layers and transformer architecture to accurately predict covariance matrices for the high redshift, north galactic cap sample of the BOSS DR12 galaxy catalog. We run simulated likelihood analyses with emulated and brute-force computed covariances, and we quantify the network’s performance via two different metrics: (1) difference in Χ 2 and (2) likelihood contours for simulated BOSS DR 12 analyses. We find that the emulator returns excellent results over a large parameter range. We then use our emulator to perform a reanalysis of the BOSS HighZ NGC galaxy power spectrum, and find that varying covariance with cosmology along with the model vector produces Ω m = $0.276$$^{+0.013}_{–0.015}$, H 0 = 70.2 ± 1.9 km/s/Mpc, and σ 8 = $0.674$$^{+0.058}_{–0.077}$. These constraints represent an average 0.46σ shift in best-fit values and a 5% increase in constraining power compared to fixing the covariance matrix (Ω m = 0.293 ± 0.017, H 0 = 70.3 ± 2.0 km/s/Mpc, σ 8 = $0.702$$^{+0.063}_{–0.075}$). As a result, this work demonstrates that emulators for more complex cosmological quantities than second-order statistics can be trained over a wide parameter range at sufficiently high accuracy to be implemented in realistic likelihood analyses.
79 ASTRONOMY AND ASTROPHYSICS↗
Covariance operator estimation: Sparsity, lengthscale, and ensemble Kalman filters
This paper investigates covariance operator estimation via thresholding. For Gaussian random fields with approximately sparse covariance operators, we establish non-asymptotic bounds on the estimation error in terms of the sparsity level of the covariance and the expected supremum of the field. We prove that thresholded estimators enjoy an exponential improvement in sample complexity compared with the standard sample covariance estimator if the field has a small correlation lengthscale. As an application of the theory, we study thresholded estimation of covariance operators within ensemble Kalman filters.
Covariance operator estimation↗
Covariance operator estimation via adaptive thresholding
This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the sample covariance function using an estimate of the variance component. Building on recent results from empirical process theory, we derive an operator norm bound on the estimation error in terms of the sparsity level of the covariance and the expected supremum of a normalized process. Furthermore, our theory and numerical simulations demonstrate the advantage of adaptive threshold estimators over universal threshold and sample covariance estimators in nonstationary settings.
Al-Ghattas, Omar [University of Chicago, IL (Unite↗
Further steps toward the next generation of covariant energy density functionals
The present study aims at further development of covariant energy density functionals (CEDFs) towards more accurate description of binding energies across the nuclear chart. Infinite basis corrections to binding energies in the fermionic and bosonic sectors of the covariant density functional theory are taken into account in the fitting protocol within the covariant density functional theory. In addition, total electron binding energies are used in the conversion of atomic binding energies into nuclear ones. Their dependence on neutron excess is investigated across the nuclear chart within the atomic approach. Furthermore, these factors were disregarded in the previous generation of covariant energy density functionals, but their omission leads to substantial global calculation errors for physical quantities of interest. For example, these errors for binding energies are of the order of 0.8 MeV or higher for the three major classes of covariant energy density functionals.
Binding energy & masses↗
Formatting and V&V of Consistent 238,240−24 2Pu $\overline{v}_p$ Evaluated Mean Values and Covariances
This report is in answer to the Nuclear Criticality Safety Program FY24 quarter 4 milestone that requires: “Format and V&V nu-bar means and covariances” for 238,240-242 Pu average prompt fission neutron multiplicities, $\overline{ν}$ p , that were obtained by a consistent evaluation leveraging the fission-event generator CGMF and a detailed uncertainty quantification of experimental data. It is described how nuclear data mean values and covariances were formatted using ENDFtk. Implementing the new 238,240-242 Pu $\overline{ν}$ p into the ENDF/B-VIII.1β 4 library leads to only small overall changes in criticality values of the Jezebel, Dirty Jezebel, Jupiter-001, Jupiter-002, EUCLID 3x2 and EUCLID 8x1 critical assemblies. Simulated k eff uncertainties due to $\overline{ν}$ p covariances change only little if cross-isotope covariances are considered or not for those assemblies with low percentage content of minor Pu isotopes. However, for the Dirty Jezebel critical assembly, that has a sizeable 240 Pu and non-negligible 241 Pu content, the simulated k eff uncertainties due to considering or neglecting cross-isotope $\overline{ν}$ p covariances is 443 versus 374 pcm.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Hilbert series for covariants and their applications to minimal flavor violation
We elaborate how to apply the Hilbert series method to enumerating group covariants, which transform under any given representation, including but going beyond group invariants. Mathematically, group covariants form a module over the ring of the invariants. The number of independent covariants is given by the rank of the module, which can be computed by taking a ratio of two Hilbert series. In many cases, the rank equals the dimension of the group covariant representation. When this happens, we say that there is a rank saturation. We apply this technology to revisit the hypothesis of Minimal Flavor Violation in constructing Effective Field Theories beyond the Standard Model. We find that rank saturation is guaranteed in this case, leading to the important consequence that the MFV symmetry principle does not impose any restriction on the EFT, i.e. MFV SMEFT = SMEFT, in the absence of additional assumptions.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Electron–Ion Covariance Reveals Geometry-Resolved Inner-Shell Spectra in CS 2 Photodissociation
The chemical shifts of inner-shell atomic orbitals are highly sensitive to chemical bonding and molecular structure. In evolving systems, however, the spectra of distinct molecular species and geometries overlap, obscuring the underlying chemical dynamics. Here we demonstrate the use of electron–ion covariance analysis to combine the structural sensitivity of Coulomb explosion imaging with inner-shell spectroscopy, yielding geometry-specific spectra of transient and product species. We apply this approach to the excited state dynamics of CS 2 probed by ionization above the S 2p edge. Electron–ion covariance with time- and momentum-selected S + and S 2+ ions isolates distinct S 2p photoelectron spectra for ground-state CS 2 , bent photoexcited CS 2 , the CS photoproduct, and bare atomic sulfur ─ species whose spectra overlap strongly in the channel-averaged measurement. Clear chemical shifts are observed in the covariance photoelectron spectrum for each of these species, all of which are consistent with high-level calculations. Here, by extracting the atomic S contribution to the photoelectron spectrum in a finely time-resolved manner we can disentangle this contribution to the overall time-resolved photoelectron spectrum as the photodissociation proceeds. These results demonstrate the promise of electron–ion covariance as a general approach to geometry-resolved inner-shell spectroscopy, opening a route to tracking structural evolution through chemical shifts in complex photoexcited molecules.
Ionization↗
Analytical and EZmock covariance validation for the DESI 2024 results
The estimation of uncertainties in cosmological parameters is an important challenge in Large-Scale-Structure (LSS) analyses. For standard analyses such as Baryon Acoustic Oscillations (BAO) and Full-Shape two approaches are usually considered. First: analytical estimates of the covariance matrix use Gaussian approximations and (nonlinear) clustering measurements to estimate the matrix, which allows a relatively fast and computationally cheap way to generate matrices that adapt to an arbitrary clustering measurement. On the other hand, sample covariances are an empirical estimate of the matrix based on an ensemble of clustering measurements from fast and approximate simulations. While more computationally expensive due to the large amount of simulations and volume required, these allow us to take into account systematics that are impossible to model analytically. In this work we compare these two approaches in order to enable DESI's key analyses. We find that the configuration space analytical estimate performs satisfactorily in BAO analyses and its flexibility in terms of input clustering makes it the fiducial choice for DESI's 2024 BAO analysis. On the contrary, the analytical computation of the covariance matrix in Fourier space does not reproduce the expected measurements in terms of Full-Shape analyses, which motivates the use of a corrected mock covariance for DESI's 2024 Full Shape analysis.
79 ASTRONOMY AND ASTROPHYSICS↗
Evaluating quenching in cosmological simulations of galaxy formation with spectral covariance in the optical window
ABSTRACT Cosmological hydrodynamical simulations provide valuable insights on galaxy evolution when coupled with observational data. Comparisons with real galaxies are typically performed via scaling relations of the observables. Here, we follow an alternative approach based on the spectral covariance in a model-independent way. We build upon previous work by Sharbaf et al. that studied the covariance of high-quality SDSS (Sloan Digital Sky Survey) continuum-subtracted spectra in a relatively narrow range of velocity dispersion ($\sigma \in [100,150]$ km s$^{-1}$). Here, the same analysis is applied to synthetic data from the eagle and IllustrisTNG100 simulations, to assess the ability of these runs to mimic real galaxies. The real and simulated spectra are consistent regarding spectral covariance, although with subtle differences that can inform the implementation of subgrid physics. Spectral fitting done a posteriori on stacks segregated with respect to latent space reveals that the first principal component (PC1) is predominantly influenced by the stellar age distribution, with an underlying age–metallicity degeneracy. Good agreement is found regarding star formation prescriptions but there is disagreement with active galactic nucleus (AGN) feedback, that also affects the subset of quiescent galaxies. We show a substantial difference in the implementation of the AGN subgrid prescriptions, regarding central black hole seeding, that could lead to the mismatch. Differences are manifest between these two simulations in the star formation histories stacked with respect to latent space. We emphasize that this methodology only relies on the spectral covariance to assess whether simulations provide a true representation of galaxy formation.
Sharbaf, Z. (ORCID:0009000450545946)↗
From Quantum Time to Manifestly Covariant QFT: On the Need for a Quantum-Action-Based Quantization
In quantum time (QT) schemes, time is promoted to a degree of freedom, allowing Lorentz covariance to be made explicit for single particles. We ask whether this can be lifted to QFT so that Lorentz covariance becomes manifest at the Hilbert-space level, rather than being hidden as in the standard canonical formulation. We address this question by proposing a second-quantized approach in which the elementary particle is the QT particle itself, leading naturally to the notion of spacetime field algebras and of quantum action. We show, however, that a naive many-body construction runs into inconsistencies. To pinpoint their origin we introduce a classical counterpart of the second-quantized formalism, spacetime classical mechanics (SCM), and prove a no-go theorem: Dirac quantization of SCM collapses back to standard QFT and therefore hides covariance. We circumvent this problem by presenting a quantum-action-based quantization that yields a spacetime version of quantum mechanics (SQM), making covariance manifest for (interacting) QFTs. Finally, we show that this resolution is tied to a genuine spacetime generalization of the notion of a quantum state, required by causality and closely connected to recent “states over time” proposals and, in dS/CFT–motivated settings, to microscopic notions of timelike entanglement and emergent time.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Wake-Resolving Acoustic Tomography: Advances through Numerical Covariance Methods
Acoustic tomography offers path-integrated measurements of atmospheric velocity and temperature fluctuations with high spatial resolution. Classical implementations of time-dependent stochastic inversion rely on homogeneous, isotropic covariance models that are poorly suited to the anisotropic structure of wind turbine wakes. By directly estimating heterogeneous covariances from large-eddy simulations (LESs) into the time-dependent stochastic inversion operator, we relax implicit assumptions in the analytical models used historically. Retrievals using these LES-informed models improve agreement with true fields in variance, turbulent kinetic energy, and spectral content compared to analytical and precursor-based covariance models. The results indicate that LES-informed covariance models can enhance the accuracy of acoustic tomography retrievals in complex, anisotropic flows such as wind turbine wakes in some cases and highlight instances where analytical models still offer competitive performance, despite their simplifying assumptions.
17 WIND ENERGY↗
Better practices for inferring ecosystem water use strategy from eddy covariance data
Eddy covariance data are critical for inferring ecosystem water use strategies. Yet, such inferences are sensitive to a range of assumptions applied across studies, hindering our understanding of water use strategies within and across eddy covariance sites. A recent analysis across 151 FLUXNET2015 and AmeriFlux-FLUXNET datasets found that poor model performance was the key driver of non-robust inferences of ecosystem water use strategies. Here, we leverage this previous analysis to (i) identify the specific assumptions that improve inference model performance across most sites, (ii) explain the mechanisms behind the performance improvements, and (iii) check whether better performance improves water use inference. We find that the common practice of fitting a model to canopy conductance (G c ) derived from the evapotranspiration (ET) observations, rather than to observed ET itself, artificially amplifies data errors and degrades the model performance. Next, accounting for vegetation dynamics by applying a growing season filter or incorporating satellite LAI data improves performance, but the former practice may remove soil water stress periods. Lastly, using the leaf-to-air vapor pressure deficit (VPD l ) derived from ET observations as a model input may artificially inflate performance. Based on these results, we recommend selecting observed ET (rather than derived G c ) as the response variable, carefully accounting for vegetation dynamics, and avoiding derived VPD l as a model input; these best practices improve model performance by c. 20% and robustness by c. 80% across all eddy covariance sites. Nevertheless, the performance improvements do not always correspond to more robust inference of water use strategies, as model parameter selection and surface energy budget closure corrections still strongly influence the ecosystem water use parameter estimation in a site-specific manner.
AmeriFlux↗
Distinguishing the XUV-induced Coulomb explosion dynamics of iodobenzene using covariance analysis
The primary and secondary fragmentation dynamics of iodobenzene following its ionization at 120 eV were determined using three-dimensional velocity map imaging and covariance analysis. Site-selective iodine 4d ionization was used to populate a range of excited polycationic parent states, which primarily broke apart at the carbon-iodine bond to produce I+ with phenyl or phenyl-like cations (C n H x + or C n H, with n = 1 – 6 and x = 1 – 5). The molecular products were produced with varying degrees of internal excitation and dehydrogenation, leading to stable and unstable outcomes. This further allowed the secondary dynamics of C 6 H x 2+ intermediates to be distinguished using native-frame covariance analysis, which isolated these processes in their own centre-of-mass reference frames. Furthermore, the mass resolution of the imaging mass spectrometer used for these measurements enabled the primary and secondary reaction channels to be specified at the level of individual hydrogen atoms, demonstrating the ability of covariance analysis to comprehensively measure the competing fragmentation channels of aryl cations, including those involving intermediate steps.
74 ATOMIC AND MOLECULAR PHYSICS↗
Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data
We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation (emulator) used in the mocks. Importantly, we find a close agreement (≤ 8% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, making it particularly relevant to the broad current and future analyses of DESI data.
79 ASTRONOMY AND ASTROPHYSICS↗
Physics-informed Estimation of the Covariance Matrix for Various Neutron Spectra
A method for estimating covariance matrices which capture the uncertainties in calculated reactor spectra has been developed. This method is based on perturbing the parameters of a physics-based analytic model fitted to a calculated spectrum. The covariance of the perturbed analytic spectra imposes energy-dependent correlations due to the physics of the neutron processes in the reactor, i.e., a fission component, a 1/E down-scatting component, and a thermal Maxwellian component. An analytic model is developed which is shown to produce good fits to several reactor environments. The covariance matrices produced via this method are then used as the prior spectrum in STAYSL least squares spectrum adjustment where it is combined with integral metrics, such as activation measurements, to produce a high-fidelity neutron spectrum characterization. It was concluded that the methodology showed agreeable results for the ACRR free-field spectrum adjustment in STAYSL resulting in a 𝜒 2 value of 2.21 (per degree of freedom), but further work is needed to describe scattering and interface regions.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
On the Error Covariance Correction Step of an ESKF Attitude Update
The attitude states of an error-state Kalman filter (ESKF) behave differently than most other states in the system due to their multiplicative (rather than additive) nature. One way in which they differ is an error covariance correction step after an ESKF error reset, which is not required for, for example, position and velocity states. This covariance correction step is not intuitive, and it has only been recently derived for coordinate transform matrices. The author of this memo, however, found the provided derivation in [1] confusing due to a lack of clarity surrounding the invoked reference frames, and clarity is required as there are at least 4 different ways to parameterize small-angle attitude errors in an ESKF. Furthermore, while reproducing the work, the author of this memo found a more straightforward derivation that provides additional insight into the correction step. This memo offers a derivation of the attitude error covariance correction step of an ESKF, which pays specific attention to the coordinate reference frames.
97 MATHEMATICS AND COMPUTING↗