Search NASA⌕ Search

SEARCH · Search NASA

Results for “Covariance and correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Nuclear Data Covariances and Sampling

In this report, we present an overview of the task of producing sample nuclear data sets for the purpose of exploring the effects of nuclear data uncertainties on physics simulations. These sample data sets (or, as we sometimes call them variations) are produced based on uncertainties specified in the ENDF/B-VIII nuclear data library, although the principles discussed here apply to sampling based on similar libraries, such as JENDL. The uncertainties in ENDF and similar libraries are given in the form of mean values (a mean vector) and a covariance matrix. The components of the mean vector are what are normally thought of as the values of the nuclear data (cross sections, $\bar{v}$, the prompt fission neutron spectrum, etc.) and the covariance matrix contains the information about the uncertainties in these values and correlations between them, including correlations across different energies in a single channel and correlations across different channels.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

Liquid-like and rigid-body motions in molecular-dynamics simulations of a crystalline protein

To gain insight into crystalline protein dynamics, we performed molecular-dynamics (MD) simulations of a periodic 2 × 2 × 2 supercell of staphylococcal nuclease. We used the resulting MD trajectories to simulate X-ray diffraction and to study collective motions. The agreement of simulated X-ray diffraction with the data is comparable to previous MD simulation studies. We studied collective motions by analyzing statistically the covariance of alpha-carbon position displacements. The covariance decreases exponentially with the distance between atoms, which is consistent with a liquidlike motions (LLM) model, in which the protein behaves like a soft material. To gain finer insight into the collective motions, we examined the covariance behavior within a protein molecule (intraprotein) and between different protein molecules (interprotein). The interprotein atom pairs, which dominate the overall statistics, exhibit LLM behavior; however, the intraprotein pairs exhibit behavior that is consistent with a superposition of LLM and rigid-body motions (RBM). Our results indicate that LLM behavior of global dynamics is present in MD simulations of a protein crystal. They also show that RBM behavior is detectable in the simulations but that it is subsumed by the LLM behavior. Finally, the results provide clues about how correlated motions of atom pairs both within and across proteins might manifest in diffraction data. Overall, our findings increase our understanding of the connection between molecular motions and diffraction data and therefore advance efforts to extract information about functionally important motions from crystallography experiments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A semiparametric latent factor model for large scale temporal data with heteroscedasticity

Large scale temporal data have flourished in a vast array of applications, and their sophisticated structures, especially the heteroscedasticity among subjects with inter- and intra-temporal dependence, have fueled a great demand for new statistical models. In this paper, with covariate information, we consider a flexible model for large scale temporal data with subject-specific heteroscedasticity. Formally, the model employs latent semiparametric factors to simultaneously account for the subject-specific heteroscedasticity and the contemporaneous and/or serial correlations. The subject-specific heteroscedasticity is modeled as the product of the unobserved factor process and subject’s covariate effect, which is further characterized via additive models. For estimation, we propose a two-step procedure. First, the latent factor process and nonparametric loading are recovered through projection-based methods, and following, we estimate the regression components by approaches motivated from the generalized least squares. By scrupulously examining the non-asymptotic rates for recovering the factor process and its loading, we show the consistency and efficiency of estimated regression coefficients in the absence of prior knowledge of latent factor process and subject’s covariate effect. Here, the statistical guarantees remain valid even for finite time points that makes our method particularly appealing when the subjects significantly outnumber the observation time points. Using comprehensive simulations, we demonstrate the finite sample performance of our method, which corroborates the theoretical findings. Finally, we apply our method to a data set of air quality and energy consumption collected at 129 monitoring sites in the United States in 2015.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Impact of dynamical chiral symmetry breaking and dynamical diquark correlations on proton generalized parton distributions

We calculate the leading-twist, helicity-independent generalized parton distributions (GPDs) of the proton, at finite skewness, in the Nambu–Jona-Lasinio (NJL) model of quantum chomodynamics (QCD). The NJL model reproduces low-energy characteristics of QCD, including dynamical chiral symmetry breaking (DCSB). The proton bound-state amplitude is solved for using the Faddeev equation in a quark-diquark approximation, including both dynamical scalar and axial vector diquarks. GPDs are calculated using a dressed non-local correlator, consistent with DCSB, which is obtained by solving a Bethe-Salpeter equation. The model and approximations used observe Lorentz covariance, and as a consequence the GPDs obey polynomiality sum rules. Extractions of electromagnetic and gravitational form factors are performed. We find a D-term of -1.08 when the non-local correlator is properly dressed, and 0.85 when the bare correlator is used instead, suggesting that within this framework proton stability requires the constituent quarks to be dressed consistently with DCSB. In conclusion, we also find that the anomalous gravitomagnetic moment vanishes, as required by Poincare symmetry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Global estimates of the fitness advantage of SARS-CoV-2 variant Omicron

Abstract New variants of SARS-CoV-2 show remarkable heterogeneity in their relative fitness over both time and space. In this paper we extend the tools available for estimating the selection strength for new SARS-CoV-2 variants to a hierarchical, mixed-effects, renewal equation model. This formulation allows us to estimate selection effects at the global level while incorporating both measured and unmeasured heterogeneity among countries. Applying this model to the spread of Omicron in forty countries, we find evidence for very strong but very heterogeneous selection effects. To test whether this heterogeneity is explained by differences in the immune landscape, we considered several measures of vaccination rates and recent population-level infection as covariates, finding moderately strong, statistically significant effects. We also found a significant positive correlation between the selection advantage of Delta and Omicron at the country level, suggesting that other region-specific explanatory variables of fitness differences do exist. Our method is implemented in the Stan programming language, can be run on standard consumer-grade computing resources, and will be straightforward to apply to future variants.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Evaluation of VEGETATION and PROBA-V Phenology Using PhenoCam and Eddy Covariance Data

High-quality retrieval of land surface phenology (LSP) is increasingly important for understanding the effects of climate change on ecosystem function and biosphere–atmosphere interactions. We analyzed four state-of-the-art phenology methods: threshold, logistic-function, moving-average and first derivative based approaches, and retrieved LSP in the North Hemisphere for the period 1999–2017 from Copernicus Global Land Service (CGLS) SPOT-VEGETATION and PROBA-V leaf area index (LAI) 1 km V2.0 time series. We validated the LSP estimates with near-surface PhenoCam and eddy covariance FLUXNET data over 80 sites of deciduous forests. Results showed a strong correlation (R 2 > 0.7) between the satellite LSP and ground-based observations from both PhenoCam and FLUXNET for the timing of the start (SoS) and R 2 > 0.5 for the end of season (EoS). The threshold-based method performed the best with a root mean square error of ~9 d with PhenoCam and ~7 d with FLUXNET for the timing of SoS (30th percentile of the annual amplitude), and ~12 d and ~10 d, respectively, for the timing of EoS (40th percentile).

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Correlation-aware binning for small-angle neutron scattering via Gaussian-process inference

Binning in small-angle neutron scattering (SANS) is typically performed empirically, with fixed parameters chosen for convenience rather than statistical optimality. Such practices often fail to balance statistical precision and spatial resolution, leading to inconsistencies across instruments and datasets. Here we establish a correlation-aware framework that determines the optimal bin width from first principles by extending the classical Freedman–Diaconis (FD) rule to account for inter-bin correlations with a Gaussian process. In this formulation, the scattering intensity is treated as a smooth stochastic field whose statistical coherence is described by a covariance matrix. Analytical expressions of errors derived from this model yield closed-form criteria that separate the total deviation into contributions from counting noise, aliasing distortion and curvature-dependent correlation effects. Expressed in reduced variables, the resulting dimensionless error surface reveals a continuous transition from the uncorrelated FD regime to the correlation-dominated limit, providing a unified description of noise suppression and resolution control. Because the formulation depends only on the profile characteristics of scattering intensity I(Q), specifically its average intensity and first- and second-order derivatives, it applies generally to any SANS measurement regardless of sample, instrument or geometry. Experimental validation using small- and ultra-small-angle neutron scattering data confirms the predicted scaling behavior, demonstrating that correlation-aware inference systematically reduces mean-squared error and enables information-efficient reproducible data reduction across materials and instruments.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗
DOE OSTI2026

Haze–cloud correlations mediated by supersaturation fluctuations

Atmospheric aerosol particles that contain water-soluble components can absorb water vapor in humid environments and form either haze particles or cloud droplets, depending on supersaturation conditions. Laboratory and in situ measurements have shown that haze particles and cloud droplets often coexist and compete for available water vapor in shallow clouds and fogs, especially under polluted conditions. It is expected that more aerosol particles can form more haze particles and cloud droplets, so that the haze and cloud number concentrations are positively correlated. However, recent large-eddy simulations show that haze and cloud number concentration can be negatively correlated under extremely polluted conditions. Haze–cloud interactions across different environmental settings remain poorly understood. In this study, experiments in a convection cloud chamber with the same aerosol injection rate show that, as supersaturation forcing increases (i.e., changing from polluted to clean conditions), the covariance between haze and cloud droplet number concentration changes from negative to positive and finally to zero. Large-eddy simulations (LES) of the cloud chamber with a fixed supersaturation forcing but varying aerosol injection rates show a similar result for the haze–cloud correlation: near zero in clean, mean-supersaturation-dominated activation conditions; positive in moderate, supersaturation-fluctuation-influenced activation conditions; and negative in polluted, supersaturation-fluctuation-dominated activation conditions. A theoretical covariance framework was developed to interpret this behavior based on the relative magnitude and signs of the correlations between supersaturation and the populations of haze and cloud droplets. Significantly, experiments, LES, and theory all yield the same three-regime behavior for the sign of the haze–cloud covariance. Furthermore, our results show that the haze–cloud covariance remains robust and easily measurable, thereby providing a useful metric for regime identification in the atmosphere, improving regime-aware parameterizations, and informing aerosol interventions such as fog dispersion, rainfall enhancement, and albedo modification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Vertical dependence of horizontal variation of cloud microphysics: observations from the ACE-ENA field campaign and implications for warm-rain simulation in climate models

Abstract. In the current global climate models (GCMs), the nonlinearity effect of subgrid cloud variations on the parameterization of warm-rain process, e.g., the autoconversion rate, is often treated by multiplying the resolved-scale warm-rain process rates by a so-called enhancement factor (EF). In this study, we investigate the subgrid-scale horizontal variations and covariation of cloud water content (qc) and cloud droplet number concentration (Nc) in marine boundary layer (MBL) clouds based on the in situ measurements from a recent field campaign and study the implications for the autoconversion rate EF in GCMs. Based on a few carefully selected cases from the field campaign, we found that in contrast to the enhancing effect of qc and Nc variations that tends to make EF > 1, the strong positive correlation between qc and Nc results in a suppressing effect that tends to make EF < 1. This effect is especially strong at cloud top, where the qc and Nc correlation can be as high as 0.95. We also found that the physically complete EF that accounts for the covariation of qc and Nc is significantly smaller than its counterpart that accounts only for the subgrid variation of qc, especially at cloud top. Although this study is based on limited cases, it suggests that the subgrid variations of Nc and its correlation with qc both need to be considered for an accurate simulation of the autoconversion process in GCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Using heterogeneous data to identify signatures of dengue outbreaks at fine spatio-temporal scales across Brazil

Dengue virus remains a significant public health challenge in Brazil, and seasonal preparation efforts are hindered by variable intra- and interseasonal dynamics. Here, we present a framework for characterizing weekly dengue activity at the Brazilian mesoregion level from 2010–2016 as time series properties that are relevant to forecasting efforts, focusing on outbreak shape, seasonal timing, and pairwise correlations in magnitude and onset. In addition, we use a combination of 18 satellite remote sensing imagery, weather, clinical, mobility, and census data streams and regression methods to identify a parsimonious set of covariates that explain each time series property. The models explained 54% of the variation in outbreak shape, 38% of seasonal onset, 34% of pairwise correlation in outbreak timing, and 11% of pairwise correlation in outbreak magnitude. Regions that have experienced longer periods of drought sensitivity, as captured by the “normalized burn ratio,” experienced less intense outbreaks, while regions with regular fluctuations in relative humidity had less regular seasonal outbreaks. Both the pairwise correlations in outbreak timing and outbreak trend between mesoresgions were best predicted by distance. Our analysis also revealed the presence of distinct geographic clusters where dengue properties tend to be spatially correlated. Forecasting models aimed at predicting the dynamics of dengue activity need to identify the most salient variables capable of contributing to accurate predictions. Our findings show that successful models may need to leverage distinct variables in different locations and be catered to a specific task, such as predicting outbreak magnitude or timing characteristics, to be useful. This advocates in favor of “adaptive models” rather than “one-size-fits-all” models. The results of this study can be applied to improving spatial hierarchical or target-focused forecasting models of dengue activity across Brazil.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Physics-informed Karhunen-Loeve and Neural Network Approximations for Solving Inverse Differential Equation Problems

Here we present the PI-CKL-NN method for parameter estimation in differential equation (DE) models given sparse measurements of the parameters and states. In the proposed approach, the space- or time-dependent parameters are approximated by Karhunen-Loeve (KL) expansions that are conditioned on the parameters’ measurements, and the states are approximated by deep neural networks (DNNs). The unknown weights in the KL expansions and DNNs are found my minimizing the cost function that enforces the measurements of the states the DE constraint. Regularization is achieved by adding the l2 norm of the conditional KL coefficients into the loss function. Our approach assumes that the parameter fields are correlated in space or time and enforces the statistical knowledge (the mean and the covariance function) in addition to the DE constraints and measurements as opposed to the physics-informed neural network (PINN) and other similar physics-informed machine learning methods where only DE constraints and data are used for parameter estimation. We use the PI-CKL-NN method for parameter estimation in an ordinary differential equation with an unknown time-dependent parameter and the one- and two-dimensional partial differential diffusion equations with unknown space-dependent diffusion coefficients. We also demonstrate that PI-CKL-NN is more accurate than the PINN method, especially when the observations of the parameters are very sparse

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Big-Data-Driven Geo-Spatiotemporal Correlation Analysis between Precursor Pollen and Influenza and its Implication to Novel Coronavirus Outbreak

Although studies of many respiratory viruses and pollens are often framed by both seasonal and health related perspectives, pollen has yet to be extensively examined as an important covariate to seasonal respiratory viruses (SRVs) in any context, including a causal one. This study contributes to those goals through an investigation of SRVs and pollen counts at selected regions across the Western Hemisphere. Two complementary decadal-scaled geospatial profiles were developed. One laterally spanned the US and was anchored by detailed pollen information for Albuquerque, New Mexico. The other straddled the equator to include Fortaleza, Brazil. We found that the geospatial and climatological patterns of pollen advancement and decline across the US every year presented a statistically significant correlation to the subsequent emergence and decline of SRVs. Other significant covariates included winds, temperatures, and atmospheric moisture. Our study indicates that areas of the US with lower geostrophic wind baselines are typically areas of persistently higher and earlier influenza like illness (ILI) cases. In addition to that continental- scaled contrast, many sites indicated seasonal highs of geostrophic winds and ILI which were closely aligned. These observations suggest extensive scale-dependent connectivity of viruses to geostrophic circulation. Pollen emergence and its own scale-dependent circulation may contribute to the geospatial and seasonal patterns of ILI. We explore some uncertainties associated with this investigation, and consider the possibility that in a temperate climate, following a Spring pollen emergence, a resulting increase in pollen triggered human Immunoglobulin E (IgE) antibodies may suppress ILIs for several months.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

SmoQyDEAC.jl: A differential evolution package for the analytic continuation of imaginary time correlation functions

We introduce the SmoQyDEAC.jl package, a Julia implementation of the Differential Evolution Analytic Continuation (DEAC) algorithm [N. S. Nichols et al., Phys. Rev. E 106, 025312 (2022)] for analytically continuing noisy imaginary time correlation functions to the real frequency axis. Our implementation supports fermionic and bosonic correlation functions on either the imaginary time or Matsubara frequency axes, and treatment of the covariance error in the input data. This paper presents an overview of the DEAC algorithm and the features implemented in the SmoQyDEAC.jl package. It also provides detailed benchmarks of the package's output against the popular maximum entropy and stochastic analytic continuation methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Codebase release r1.1 for SmoQyDEAC.jl

We introduce the SmoQyDEAC.jl package, a Julia implementation of the Differential Evolution Analytic Continuation (DEAC) algorithm [N. S. Nichols et al., Phys. Rev. E 106, 025312 (2022)] for analytically continuing noisy imaginary time correlation functions to the real frequency axis. Our implementation supports fermionic and bosonic correlation functions on either the imaginary time or Matsubara frequency axes, and treatment of the covariance error in the input data. This paper presents an overview of the DEAC algorithm and the features implemented in the SmoQyDEAC.jl package. It also provides detailed benchmarks of the package’s output against the popular maximum entropy and stochastic analytic continuation methods. The code for this package can be downloaded from our GitHub repository at https://github.com/SmoQySuite/SmoQyDEAC.jl or installed using the Julia package manager. The online documentation, including examples, can be accessed at https://smoqysuite.github.io/SmoQyDEAC.jl/stable/.

Neuhaus, James (ORCID:0000000169048510)↗
DOE OSTI2025

Optimizing stochastic algorithms for hadron correlation function computations in lattice QCD using a localized distillation basis

Distillation is a quark-smearing method for the construction of a broad class of hadron operators useful in lattice QCD computations and defined via a projection operator into a vector space of smooth gauge-covariant fields. A new orthonormal basis for this space is constructed which builds in locality. This basis is useful for the construction of stochastic methods to estimate the correlation functions computed in Monte Carlo calculations relevant for hadronic physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Cosmological constraints from a joint DESI DR1 Full-Shape and DR2 BAO

We present a cosmological analysis combining full-shape (FS) clustering measurements from the Dark Energy Spectroscopic Instrument (DESI) DR1 with baryon acoustic oscillation (BAO) measurements from DESI DR2. To achieve a robust combination that accounts for the correlation between the two data releases, we employ the ShapeFit compression method and estimate the joint covariance using EZmocks. This compressed approach inherently mitigates the prior volume effects that have previously dominated Bayesian constraints from DESI data with minimal external priors. Consequently, we obtain — for the first time within a Bayesian framework — reliable DESI-only constraints on extensions to ΛCDM using only a Big Bang Nucleosynthesis prior on the baryon density and a wide prior on the spectral index. In flat ΛCDM, we find Ω m = 0.3035 ± 0.0085, h = 0.6876 ± 0.0059, and σ 8 = 0.822 ± 0.034. For the w 0 w a CDM dynamical dark energy model, we measure w 0 = -0.49 ± 0.25 and w a = -1.52 ± 0.77, improving constraints by ∼ 30% relative to the analogous DR1 measurement and reducing the discrepancy with ΛCDM to 1.4σ when compared to BAO only analyses. We also report competitive limits on the sum of neutrino masses and spatial curvature. This work demonstrates that the ShapeFit compression provides a prior-robust and computationally efficient pathway to constrain beyond-ΛCDM physics with large-scale structure.

baryon acoustic oscillations↗