Search NASA⌕ Search

SEARCH · Search NASA

Results for “correlated noise analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative data sets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student t process regression. We apply Student t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via colouring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics and classic machine learning clustering algorithms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Gaussian process analysis of electron energy loss spectroscopy data: multivariate reconstruction and kernel control

Abstract Advances in hyperspectral imaging including electron energy loss spectroscopy bring forth the challenges of exploratory and physics-based analysis of multidimensional data sets. The multivariate linear unmixing methods generally explore similarities in the energy dimension, but ignore correlations in the spatial domain. At the same time, Gaussian process (GP) explicitly incorporate spatial correlations in the form of kernel functions but is computationally intensive. Here, we implement a GP method operating on the full spatial domain and reduced representations in the energy domain. In this multivariate GP, the information between the components is shared via a common spatial kernel structure, while allowing for variability in the relative noise magnitude or image morphology. We explore the role of kernel constraints on the quality of the reconstruction, and suggest an approach for estimating them from the experimental data. We further show that spatial information contained in higher-order components can be reconstructed and spatially localized.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Excited-state uncertainties in lattice-QCD calculations of multi-hadron systems

Excited-state effects lead to hard-to-quantify systematic uncertainties in lattice quantum chromodynamics (LQCD) spectroscopy calculations when computationally accessible imaginary times are smaller than inverse excitation gaps, as often arises for multi-hadron systems with signal-to-noise problems. Lanczos residual bounds address this by providing two-sided constraints on energies that do not require assumptions beyond Hermiticity, but often give very conservative systematic uncertainty estimates. Here, a more-constraining set of gap bounds is introduced for hadron spectroscopy. These bounds provide tighter constraints whose validity requires an explicit assumption about an energy gap. Exactly solvable lattice field theory correlators are used to test the utility of residual and gap bounds at finite and infinite statistics. Two-sided bounds and other analysis methods are then applied to a high-statistics LQCD calculation of nucleon-nucleon scattering at $m_π\sim 800$ MeV. Generalized eigenvalue problem (GEVP) and Lanczos energy estimators are compatible when applied to the same correlator data, but analyses including different interpolating operators show statistically significant inconsistencies. However, two-sided bounds from all operators are consistent. Under the assumption that the number of energy levels below $NΔ$ and $ΔΔ$ thresholds is the same as for non-interacting nucleons, gap bounds are sufficient to constrain nucleon-nucleon scattering amplitudes at phenomenologically relevant precision. Lanczos methods further reveal that energy-eigenstate estimates from previously studied asymmetric correlators have not converged over accessible imaginary times. Nevertheless, data-driven examples demonstrate why assumptions are required to draw conclusions about the natures of two-nucleon ground states at these masses.

Detmold, William [MIT, Cambridge, CTP]↗
DOE OSTI2022

The DESI N -body simulation project – I. Testing the robustness of simulations for the DESI dark time survey

ABSTRACT Analysis of large galaxy surveys requires confidence in the robustness of numerical simulation methods. The simulations are used to construct mock galaxy catalogues to validate data analysis pipelines and identify potential systematics. We compare three N-body simulation codes, abacus, gadget-2, and swift, to investigate the regimes in which their results agree. We run N-body simulations at three different mass resolutions, 6.25 × 108, 2.11 × 109, and 5.00 × 109 h−1 M⊙, matching phases to reduce the noise within the comparisons. We find systematic errors in the halo clustering between different codes are smaller than the Dark Energy Spectroscopic Instrument (DESI) statistical error for $s\ \gt\ 20\ h^{-1}$ Mpc in the correlation function in redshift space. Through the resolution comparison we find that simulations run with a mass resolution of 2.1 × 109 h−1 M⊙ are sufficiently converged for systematic effects in the halo clustering to be smaller than the DESI statistical error at scales larger than $20\ h^{-1}$ Mpc. These findings show that the simulations are robust for extracting cosmological information from large scales which is the key goal of the DESI survey. Comparing matter power spectra, we find the codes agree to within 1 per cent for k ≤ 10 h Mpc−1. We also run a comparison of three initial condition generation codes and find good agreement. In addition, we include a quasi-N-body code, FastPM, since we plan use it for certain DESI analyses. The impact of the halo definition and galaxy–halo relation will be presented in a follow-up study.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Comparisons Between Array Derived Dynamic Strain Rate (ADDS) and Fiber‐Optic Distributed Acoustic Sensing (DAS) Strain Rate

Abstract Distributed acoustic sensing (DAS) strain rate and particle velocity can be compared through approximate scaling with medium velocity. We instead performed a direct comparison between array derived dynamic strain (ADDS) rate and DAS strain rate for six frequency bands. The PoroTomo project at Brady's Hot Springs, Nevada, deployed a 240‐geophone 3C array co‐located with fiber‐optic DAS system and 8.7 km of buried cable. We selected subsets of the geophone array to create four smaller arrays and computed ADDS. The horizontal components of the ADDS were rotated into the direction of the fiber‐optic cable and then compared with the observed DAS strain rates. From three example regional earthquakes of local magnitudes 2.9, 4.1, and 4.3, the ADDS are found to be coherent with DAS for frequencies ≤1 Hz. For frequencies >1‐Hz, this correlation decays quickly. Small differences between linear and areal dynamic strains at 1‐Hz suggest poor signal‐to‐noise or localized strain that is perturbed by shallow heterogeneities compare to the average strain propagating across the geophone array. The implication is that around 1‐Hz, straight fiber DAS is measuring axial strain along the fiber and can provide good approximations to translational particle motions. However, above 1‐Hz, DAS becomes more sensitive to shallow velocity gradients that can be beneficial for geophysical imaging yet becomes a limitation for traditional seismic analysis methods depending on absolute amplitude and phase from translational particle motions.

58 GEOSCIENCES↗
DOE OSTI2024

The Shortwave Cloud-SST Feedback Amplifies Multi-Decadal Pacific Sea Surface Temperature Trends: Implications for Observed Cooling

Climate models struggle to produce sea surface temperature (SST) gradient trends in the tropical Pacific comparable to those seen recently in nature. Here, we find that the magnitude of the cloud-SST feedback in the subtropical Southeast Pacific is correlated across models with the magnitude of Eastern Pacific multi-decadal SST variability. A heat-budget analysis reveals coupling between cloud-radiative effects, circulation, and SST gradients in driving multi-decadal variability in the Eastern Pacific. Using this relationship and observed feedback estimates, we find that internal Eastern Pacific SST variability is underestimated in most models. Adjusting for model bias increases the likelihood of generating a cooling trend at least as large as observations in preindustrial control simulations by ~56% on average. If models underestimate climate “noise,” as our results suggest, this bias should be accounted for when attributing the relative importance of forced versus unforced changes in the climate.

58 GEOSCIENCES↗
DOE OSTI2023

BEYONDPLANCK II. CMB mapmaking through Gibbs sampling

We present a Gibbs sampling solution to the mapmaking problem for cosmic microwave background (CMB) measurements that builds on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps: noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benefit as compared to traditional methods and it allows us, for the first time, to bring the destriping baseline length to a single sample. Here, we applied the Gibbs procedure to simulated Planck 30 GHz data. We find that gaps in the time-ordered data are handled efficiently by filling them in with simulated noise as part of the Gibbs process. The Gibbs procedure yields a chain of map samples, from which we are able to compute the posterior mean as a best-estimate map. The variation in the chain provides information on the correlated residual noise, without the need to construct a full noise covariance matrix. However, if only a single maximum-likelihood frequency map estimate is required, we find that traditional conjugate gradient solvers converge much faster than a Gibbs sampler in terms of the total number of iterations. The conceptual advantages of the Gibbs sampling approach lies in statistically well-defined error propagation and systematic error correction. This methodology thus forms the conceptual basis for the mapmaking algorithm employed in the BEYONDPLANCK framework, which implements the first end-to-end Bayesian analysis pipeline for CMB observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Hyper Suprime-Cam Year 3 results: Cosmology from cosmic shear two-point correlation functions

Here, we perform a blinded cosmology analysis with cosmic shear two-point correlation functions measured from more than 25 million galaxies in the Hyper Suprime-Cam three-year shear catalog in four tomographic redshift bins ranging from 0.3 to 1.5. After conservative masking and galaxy selection, the survey covers 416 deg 2 of the northern sky with an effective galaxy number density of 15 arcmin –2 over the four redshift bins. The 2PCFs adopted for cosmology analysis are measured in the angular range; 7.1 <θ/arcmin < 56.6 for ξ + and 31.2 < θ/arcmin < 248 for ξ – , with a total signal-to-noise ratio of 26.6. We apply a conservative, wide, flat prior on the photometric redshift errors on the last two tomographic bins, and the relative magnitudes of the cosmic shear amplitude across four redshift bins allow us to calibrate the photometric redshift errors. With this flat prior on redshift errors, we find Ω m = 0.25⁢6$^{+0.056}_{–0.044}$ and S 8 ≡ σ 8 ⁢$\sqrt{Ω_{m}/0.3}$ = 0.76⁢9$^{+0.031}_{–0.034}$ (both 68% C.I.) for a flat Λ cold dark matter cosmology. We find, after unblinding, that our constraint on S 8 is consistent with the Fourier space cosmic shear and the 3 × 2 pt analyses on the same HSC dataset. We carefully study the potential systematics from astrophysical and systematic model uncertainties in our fiducial analysis using synthetic data, and report no biases (including projection bias in the posterior space) greater than 0.5σ in the estimation of S 8 . Our analysis hints that the mean redshifts of the two highest tomographic bins are higher than initially estimated. In addition, a number of consistency tests are conducted to assess the robustness of our analysis. Comparing our result with Planck-2018 cosmic microwave background observations, we find a ~2σ tension for the Λ ⁢CDM model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Universal framework for simultaneous tomography of quantum states and SPAM noise

We present a general denoising algorithm for performing simultaneous tomography of quantum states and measurement noise. This algorithm allows us to fully characterize state preparation and measurement (SPAM) errors present in any quantum system. Our method is based on the analysis of the properties of the linear operator space induced by unitary operations. Given any quantum system with a noisy measurement apparatus, our method can output the quantum state and the noise matrix of the detector up to a single gauge degree of freedom. We show that this gauge freedom is unavoidable in the general case, but this degeneracy can be generally broken using prior knowledge on the state or noise properties, thus fixing the gauge for several types of state-noise combinations with no assumptions about noise strength. Such combinations include pure quantum states with arbitrarily correlated errors, and arbitrary states with block independent errors. This framework can further use available prior information about the setting to systematically reduce the number of observations and measurements required for state and noise detection. Our method effectively generalizes existing approaches to the problem, and includes as special cases common settings considered in the literature requiring an uncorrelated or invertible noise matrix, or specific probe states.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Tracer-field cross-correlations with k -nearest neighbour distributions

ABSTRACT In astronomy and cosmology significant effort is devoted to characterizing and understanding spatial cross-correlations between points – e.g galaxy positions, high energy neutrino arrival directions, X-ray and AGN sources, and continuous fields – e.g. weak lensing meiand Cosmic Microwave Background maps. Recently, we introduced the k-nearest neighbour (kNN) formalism to better characterize the clustering of discrete (point) data sets. Here, we extend it to the point – field cross-correlations analysis. It combines kNN measurements of the point data set with measurements of the field smoothed at many scales. The resulting statistics are sensitive to all orders in the joint clustering of the points and the field. We demonstrate that this approach, unlike the 2-pt cross-correlation, can measure the statistical dependence of two data sets even when there are no linear (Gaussian) correlations between them. We further demonstrate that this framework is far more effective than the two point function in detecting cross-correlations when the continuous field is contaminated by high levels of noise. For a particularly high level of noise, the cross-correlation between haloes and the underlying matter field in a cosmological simulation, between 10 h−1 Mpc and 30 h−1 Mpc, is detected at >5σ significance using the technique presented here, when the two-point cross-correlation significance is ∼1σ. Finally, we show that kNN cross-correlations of haloes and the matter field can be well modelled on quasi-linear scales using the Hybrid Effective Field Theory (HEFT) framework, with the same set of bias parameters as are used for 2-pt cross-correlations. The substantial improvement in the statistical power of detecting cross-correlations using this method makes it a promising tool for various cosmological applications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Mesoscopic-scale complexity in macroscopically-uniform plastic flow of an Al 0.3 CoCrFeNi high-entropy alloy

The concept of a smooth and homogeneous plastic flow of solids is nowadays constantly challenged by various observations of the self-organization of crystal defects on mesoscopic scales pertaining, e.g., to acoustic emission or the evolution of the local strain field. Such investigations would be of particular interest for High-Entropy Alloys (HEAs) characterized by extremely complex microstructures. However, the complexity of their deformation has been only studied in relation to the jerky flow. The present work explores a mesoscale complexity of the macroscopically-smooth plastic flow of an Al 0.3 CoCrFeNi alloy. Here, an inclusive approach involving various experimental methods and complementary nonlinear analyses allowed to reveal transitions between distinct dynamical regimes, which may be assimilated with noises of different colors, in particular the blue noise that is rarely observed in complex systems, and various kinds of reddened behavior. Such findings provide significant new insights into the micro/macro transition in the deformation behavior of HEAs.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Evaluating radiation impact on transmon qubits in above and underground facilities

Superconducting qubits can be sensitive to energy deposits caused by cosmic rays and ambient radioactivity. While previous studies have explored correlated effects in time and space due to cosmic ray interactions, we present the first direct comparison of a transmon qubit’s performance measured at two distinct sites: the above-ground SQMS facility (Fermilab, US) and the deep-underground Gran Sasso Laboratory (Italy). Despite the stark difference in radiation levels, we observe a similar average qubit relaxation time of approximately 80 microseconds at both locations. To investigate radiation-induced events, we employ a fast decay detection protocol, comparing the relative rates of events between the two environments. Although intrinsic noise remains the dominant source of errors in superconducting qubits, our analysis revealed a significant excess of radiation-induced events for high-coherence transmon qubits operated above-ground. Finally, using γ-ray sources with increasing activity levels, we evaluate the qubit response in a controlled low-background environment.

De Dominicis, Francesco [GSSI, Aquila; INFN, LNS]↗
DOE OSTI2024

Analysis of the Challenges in Developing Sample-Based Multi-fidelity Estimators for Non-deterministic Models

Multifidelity (MF) uncertainty quantification (UQ) seeks to leverage and fuse information from a collection of models to achieve greater statistical accuracy with respect to a single-fidelity counterpart, while maintaining an efficient use of computational resources. Despite many recent advancements in MF UQ, several challenges remain and these often limit its practical impact in certain application areas. In this manuscript, we focus on the challenges introduced by nondeterministic models to sampling MF UQ estimators. Nondeterministic models produce different responses for the same inputs, which means their outputs are effectively noisy. MF UQ is complicated by this noise since many state-of-the-art approaches rely on statistics, e.g., the correlation among models, to optimally fuse information and allocate computational resources. Here, we demonstrate how the statistics of the quantities of interest, which impact the design, effectiveness, and use of existing MF UQ techniques, change as functions of the noise. With this in hand, we extend the unifying approximate control variate framework to account for nondeterminism, providing for the first time a rigorous means of comparing the effect of nondeterminism on different multifidelity estimators and analyzing their performance with respect to one another. Numerical examples are presented throughout the manuscript to illustrate and discuss the consequences of the presented theoretical results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Joint analysis of Dark Energy Survey Year 3 data and CMB lensing from SPT and Planck . III. Combined cosmological constraints

Here we present cosmological constraints from the analysis of two-point correlation functions between galaxy positions and galaxy lensing measured in Dark Energy Survey (DES) Year 3 data and measurements of cosmic microwave background (CMB) lensing from the South Pole Telescope (SPT) and Planck. When jointly analyzing the DES-only two-point functions and the DES cross-correlations with SPT+Planck CMB lensing, we find Ω m = 0.344 ± 0.030 and S 8 ≡ σ 8 (Ω m /0.3) 0.5 = 0.773 ± 0.016, assuming ΛCDM. When additionally combining with measurements of the CMB lensing autospectrum, we find Ω m = 0.306$^{+0.018}_{-0.021}$ and S 8 = 0.792 ± 0.012. The high signal-to-noise of the CMB lensing cross-correlations enables several powerful consistency tests of these results, including comparisons with constraints derived from cross-correlations only, and comparisons designed to test the robustness of the galaxy lensing and clustering measurements from DES. Applying these tests to our measurements, we find no evidence of significant biases in the baseline cosmological constraints from the DES-only analyses or from the joint analyses with CMB lensing cross-correlations. However, the CMB lensing cross-correlations suggest possible problems with the correlation function measurements using alternative lens galaxy samples, in particular the redMaGiC galaxies and high-redshift MagLim galaxies, consistent with the findings of previous studies. We use the CMB lensing cross-correlations to identify directions for further investigating these problems.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Data-driven modeling of dynamic occupant thermostat override behavior for demand response applications

Buildings consume nearly 40% of global energy and produce similar emissions. Whiletechnological advances address efficiency, occupant behavior causes energy use variations up to 300% between identical buildings. This gap between predicted and actual building performance impacts building design, operations, and grid demand management programs. Through analyses of smart thermostat data from 1,400 single-occupant homes, the researchdemonstrates that occupants respond to 8°F thermostat setpoint changes within a median of 15 minutes, while 2°F changes trigger responses within a median of 30 minutes. This highlights an understudied temporal relationship between thermostat setbacks and response time of occupant behaviors. Models of such behavior dynamics are required to incorporate occupant impacts into building performance simulation. A key contribution of this dissertation is the Thermal Frustration Theory (TFT), which positsthat thermal discomfort driven behaviors are caused by the time-accumulation of discomfort, not simply a temperature deviation threshold or a delay from an initiating event. Using a dataset of 634 thermostats, each with 25+ manual setpoint changes, a comparative analysis of TFT and comfort zone and a delayed response theories demonstrated that personalized TFT models better predict when manual setpoint change occur. This was measured by the area under the curve statistical measure (AUC); all three models perform similarly by a Matthews Correlation Coefficient measure. Higher AUC performance is especially important for modeling occupant behavior in demand response programs where false negatives of rare occupant interactions could adversely affect grid stability. EnergyPlus based simulations were conducted with TFT-derived occupant models, demonstrating the ability to identify parameters of known TFT models from only data observable with smart thermostats, even under the presence of noise from routine overrides. Overall, the dissertation highlights that thermostat interactions are neither static,instantaneous, nor driven solely by the environment. Instead, temporal accumulation of discomfort and routine-based behavior play important roles. The methodology and results offer a pathway towards more accurate modeling of human-building interactions for policy assessment, building design, and demand response programs.

Sharma, Kunind [Northeastern University] (ORCID:00↗
DOE OSTI2022

Transitioning from Stage-III to Stage-IV: cosmology from galaxy×CMB lensing and shear×CMB lensing

ABSTRACT We examine the cosmological constraining power from two cross-correlation probes between galaxy and cosmic microwave background (CMB) surveys: the cross-correlation of lens galaxy density with CMB lensing convergence 〈δgκCMB〉, and source galaxy weak lensing shear with CMB lensing convergence 〈γκCMB〉. These two cross-correlation probes provide an independent cross-check of other large-scale structure constraints and are insensitive to galaxy-only or CMB-only systematic effects. In addition, when combined with other large-scale structure probes, the cross-correlations can break degeneracies in cosmological and nuisance parameters, improving both the precision and robustness of the analysis. In this work, we study how the constraining power of 〈δgκCMB〉 + 〈γκCMB〉 changes from Stage-III (ongoing) to Stage-IV (future) surveys. Given the flexibility in selecting the lens galaxy sample, we also explore systematically the impact on cosmological constraints when we vary the redshift range and magnitude limit of the lens galaxies using mock galaxy catalogs. We find that in our setup, the contribution to cosmological constraints from 〈δgκCMB〉 and 〈γκCMB〉 are comparable in the Stage-III data sets; but in Stage-IV surveys, the noise in 〈δgκCMB〉 becomes subdominant to cosmic variance, preventing 〈δgκCMB〉 to further improve the constraints. This implies that to maximize the cosmological constraints from future 〈δgκCMB〉 + 〈γκCMB〉 analyses, we should focus more on the requirements on 〈γκCMB〉 instead of 〈δgκCMB〉. Furthermore, the selection of the lens sample should be optimized in terms of our ability to characterize its redshift or galaxy bias instead of its number density.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The two-point correlation function covariance with fewer mocks

We present FITCOV an approach for accurate estimation of the covariance of two-point correlation functions that requires fewer mocks than the standard mock-based covariance. This can be achieved by dividing a set of mocks into jackknife regions and fitting the correction term first introduced in Mohammad & Percival (2022), such that the mean of the jackknife covariances corresponds to the one from the mocks. This extends the model beyond the shot-noise limited regime, allowing it to be used for denser samples of galaxies. We test the performance of our fitted jackknife approach, both in terms of accuracy and precision, using lognormal mocks with varying densities and approximate EZmocks mimicking the Dark Energy Spectroscopic Instrument LRG and ELG samples in the redshift range of z = [0.8, 1.1]. We find that the Mohammad–Percival correction produces a bias in the two-point correlation function covariance matrix that grows with number density and that our fitted jackknife approach does not. We also study the effect of the covariance on the uncertainty of cosmological parameters by performing a full-shape analysis. We demonstrate that our fitted jackknife approach based on 25 mocks can recover unbiased and as precise cosmological parameters as the ones obtained from a covariance matrix based on 1000 or 1500 mocks, while the Mohammad–Percival correction produces uncertainties that are twice as large.

79 ASTRONOMY AND ASTROPHYSICS↗