Uncertainty Analysis in Signal Detection
Presentation discussed uncertainty analysis in signal detection and the inverse problem for time of arrival (ToA).
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Presentation discussed uncertainty analysis in signal detection and the inverse problem for time of arrival (ToA).
Monte Carlo radiation transport software is used extensively for determining the effective multiplication factor k of fissionable systems towards assessing the criticality safety of operations. Understanding the predictive capability of the Monte Carlo software and nuclear data libraries for calculations of specific applications is vital towards making these assessments. Recently, sensitivity and uncertainty (S/U) methods have been developed for this purpose. A computational tool has been developed that uses the S/U methods with MCNP6 to select critical experiment benchmarks that have similar sources of computational bias, and extreme value theory is then used to determine suitable and conservative calculational margins. The S/U techniques are then used to perform nuclear data adjustments, which are then used to determine a suitable margin of subcriticality from cross section uncertainties. This document gives an overview of the theory of S/U methods used for criticality safety validation. First an overview is given for using the sensitivity coefficients and nuclear co variance data towards determining neutronic similarity factors is then discussed. Next, the extreme value theory (EVT) to determine a calculational margin is given along with how the similarity factors are used in the analysis. Then, the Generalized Linear Least Squares (GLLS) method for performing data adjustment and how that method is used to reject benchmarks and compute adjusted nuclear data uncertainties in k are discussed. Last, a discussion of the margin of subcriticality is given along with how to apply of the GLLS data adjustment methods to quantify the effect of nuclear data variability on k.
The R package TBASS is an extension of the BASS package created by Francom and Sansó (2019). The package is used to fit a Bayesian multivariate adaptive spline to a dataset that either follows a Student’s t-distribution or has outliers. Much of the framework for TBASS is adapted from the concepts of Bayesian Multivariate Adaptive Regression Splines (BMARS), specifically the work done by Denison, Mallick, and Smith (1998). The spline function is fit using a Reversible-Jump Markov Chain Monte Carlo algorithm,. By including this more robust generalization, a dataset with outliers can be accurately fit using the BMARS model, without the possibility of overfitting or variance inflation.
This report documents the FY25 Theory and Simulation Performance Target (TSPT) of developing an integrated modeling framework for fusion reactor design and assessment (FREDA). Over Q1-Q4, new capabilities were developed across both plasma and engineering domains and demonstrated on an example representation of a Compact Advanced Tokamak with a Dual Cooled Lead Lithium blanket. This represents a first-of-a-kind demonstration of coupled core-to-wall-to-engineering for a reactor. Self-consistent CESOL workflows were applied to provide core, pedestal, and SOL prediction; new modules were developed for energetic particle stability (FAR3D) and transport (TGLF-EP) analysis; and boundary plasma modeling (SOLPS-ITER, BOUT++/Hermes-3) was expanded to evaluate wall and divertor heat fluxes and interface with engineering thermal analysis. A parameterized CAD tool, TRACER, was expanded to generate medium-fidelity divertor, blanket, and coil geometries; OpenFOAM and Diablo workflows were applied for first-wall and divertor thermal analyses with helium cooling; and reduced-order models were created for high-mass-flux divertor cooling. Magnet multiphysics capabilities were verified between Elmer, Diablo, and a new MFEM-based solver, and workflows enable stress, thermal, and neutron-fluence analysis of TF coils with neutronics-driven heating. Nuclear and blanket analysis workflows were demonstrated, including tritium breeding, transport, and CFD-informed thermo-mechanical assessment. Preliminary multi-fidelity uncertainty quantification workflows were applied to boundary modeling codes and shown to achieve variance reductions with fewer high-fidelity boundary simulations. Key findings highlight the challenges of resolving the ITEP gap to find suitable balance between wall and divertor loads, neutron heating, and practical limits of PFC cooling. Next step priorities are to develop automated workflows to check boundary code convergence and detachment, implement tighter physics-engineering CAD provenance tracking, and inclusion of plasma-material interface models for SLAG and tungsten cracking behavior. Collectively, these developments establish sophisticated capabilities for predictive, multi-fidelity, whole-device modeling that integrates plasma physics, materials, magnets, and nuclear engineering to guide pathways to viable Fusion Pilot Plant design points.
To minimize the eutrophication pressure along the Gulf of Mexico or reduce the size of the hypoxic zone in the Gulf of Mexico, it is important to understand the underlying temporal and spatial variations and correlations in excess nutrient loads, which are strongly associated with the formation of hypoxia. This study’s objective was to reveal and visualize structures in high-dimensional datasets of nutrient yield distributions throughout the Mississippi/Atchafalaya River Basin (MARB). For this purpose, the annual mean nutrient concentrations were collected from thirty-three US Geological Survey (USGS) water stations scattered in the upper and lower MARB from 1996 to 2020. Eight surface water quality indicators were selected to make comparisons among water stations along the MARB over the past two decades. Principal component analysis (PCA) was used to comprehensively evaluate the nutrient yields across thirty-three USGS monitoring stations and identify the major contributing nutrient loads. The results showed that all samples could be analyzed using two main components, which accounted for 81.6% of the total variance. The PCA results showed that yields of orthophosphate (OP), silica (SI), nitrate–nitrites (NO 3 -NO 2 ), and total suspended sediment (TSS) are major contributors to nutrient yields. It also showed that land-planted crops, density of population, domestic and industrial discharges, and precipitation are fundamental causes of excess nutrient loads in MARB. These factors are of great significance for the excess nutrient load management and pollution control of the Mississippi River. It was found that the average nutrient yields were stable within the sub-MARB area, but the large nitrogen yields in the upper MARB and the large phosphorus yields in the lower MARB were of great concern. t-distributed stochastic neighbor embedding (t-SNE) revealed interesting nonlinear and local structures in nutrient yield distributions. Clustering analysis (CA) showed the detailed development of similarities in the nutrient yield distribution. Moreover, PCA, t-SNE, and CA showed consistent clustering results. This study demonstrated that the integration of dimension reduction techniques, PCA, and t-SNE with CA techniques in machine learning are effective tools for the visualization of the structures of the correlations in high-dimensional datasets of nutrient yields and provide a comprehensive understanding of the correlations in the distributions of nutrient loads across the MARB.
Orbital and Geodetic Parameter Estimation Error Analysis Program (ORAN) is Bayesian least-squares simulation program for orbital trajectories. ORAN does not process data; rather, computes accuracy of results of data reduction if measurements are processed by minimum-variance data-reduction program. Actual data used to provide time when given measurement was available and estimated noise on that measurement.
Saturn’s icy moon, Enceladus, ejects frozen particles consisting of water and salts indicative of a subsurface ocean. Believed to originate from hydrothermal reactions near the core, the subsequent pressure drop generates boiling liquids that erupt and expand out of the tiger stripes. The purpose of this research is to simulate the ongoing geyser activity of Enceladus in the lab and to explore the concentrations of biomass which could exist in geyser bubbles as compared to ejected particles. We tested variance of intensity of light absorbed from the bubbles at different heights of the simulated plume. Anazodye, Allura Red, is a complex organic that will act as a tracer molecule allowing for quantitative analysis of light absorption through a spectrophotometer. Theazodye in combination with water is ejected from a water chamber using compressed air to simulate bubbles forming and a jet erupting from a body of water. Samples were taken of the bubbles at varying heights of the simulated plume as analogs to the Enceladus geysers. This research will provide quantitative analog information on rising bubbles from the ocean of Enceladus which can be applied directly to the practical concern of measuring biomass in the plume.
The coastal county of Sarasota, Florida, is located within the humid subtropical climate region and experiences an average of 250 days of sunshine every year. The county has large, urbanized communities which are vulnerable to urban heat island (UHI) effects. These rapidly growing communities contribute to the increasing surface temperatures and placing more residents at risk of heat-related illness. In partnership with Sarasota County Sustainability, the Sarasota Climate team utilized Earth observation data from NASA Landsat 8 and Landsat 9’s Thermal Infrared Sensors (TIRS), and the International Space Station’s Ecosystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) to model UHI effects within the county during the Summer for the last five years, 2019 to 2023. Data analysis with the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) and Urban Heat Exposure Assessment Tempe 1.0 (UHEAT 1.0) models and within ModelBuilder produced maps that identified the land surface temperature (LST) variance within the county, the regions that are most susceptible to extreme heat, and areas least capable of mitigating the effects of UHI. The results revealed that heat intensity varies significantly across Sarasota County with the highest temperatures in the more developed western part of the county. Additionally, the team identified that there are at least three vulnerable communities that exist in high-heat regions, including North Sarasota, Venice, and North Port. These regions have an overlap between socioeconomic sensitivity and environmental hazard that indicate a high priority in future heat mitigation efforts.
An advanced vehicle concept, the HWB N2A-EXTE aircraft design, was tested in NASA Langley's 14- by 22-Foot Subsonic Wind Tunnel to study its acoustic characteristics for var- ious propulsion system installation and airframe con gurations. A signi cant upgrade to existing data processing systems was implemented, with a focus on portability and a re- duction in turnaround time. These requirements were met by updating codes originally written for a cluster environment and transferring them to a local workstation while en- abling GPU computing. Post-test, additional processing of the time series was required to remove transient hydrodynamic gusts from some of the microphone time series. A novel automated procedure was developed to analyze and reject contaminated blocks of data, under the assumption that the desired acoustic signal of interest was a band-limited sta- tionary random process, and of lower variance than the hydrodynamic contamination. The procedure is shown to successfully identify and remove contaminated blocks of data and retain the desired acoustic signal. Additional corrections to the data, mainly background subtraction, shear layer refraction calculations, atmospheric attenuation and microphone directivity corrections, were all necessary for initial analysis and noise assessments. These were implemented for the post-processing of spectral data, and are shown to behave as expected.
Quasi-periodic oscillations (QPO) and dwarf nova oscillations (DNOs) occur in dwarf novae and nova-like variables during outburst and occasionally during quiescence, and have analogs in high-mass X-ray binaries and black-hole candidates. The frequent low coherence of quasi-period oscillations and DNOs can make detection with standard time-series tools such as periodograms problematic. This paper develops tools to analyze quasi-periodic brightness oscillations. We review the use of time-frequency representations (TFRs) in the astronomical literature, and show that representations such as the Choi-Williams distribution and Zhao-Atlas-Marks representation, which are best suited to high signal-to-noise data, cannot be assumed a priori to be the best techniques for our data, which have a much higher noise level and lower coherence. This leads us to a detailed analysis of the time-frequency resolution and statistical properties of six TFRs. We conclude that the wavelet scalogram, with the addition of wavelet ridges and maxima points, is the most effective TFR for analyzing quasi-periodicities in low signal-to-noise data, as it has high time-frequency resolution, and is a minimum variance estimator. We use the wavelet ridges method to re-analyze archival data from VW Hyi, and find 62 new QPOs and 7 new long-period DNOs. Relative to previous analyses, our method substantially improves the detection rate for QPOs.
Airway and vessel characterization of bronchiectasis patterns in lung high-resolution computed tomography (HRCT) images of cystic fibrosis (CF) patients is very important to compute the score of disease severity. We propose a hybrid and evolutionary optimized threshold and model-based method for characterization of airway and vessel in lung HRCT images of CF patients. First, the initial model of airway and vessel is obtained using the enhanced threshold-based method. Then, the model is fitted to the actual image by optimizing its parameters using particle swarm optimization (PSO) evolutionary algorithm. The experimental results demonstrated the outperformance of the proposed method over its counterpart in R-squared, mean and variance of error, and run time. Moreover, the proposed method outperformed its counterpart for airway inner diameter/vessel diameter (AID/VD) and airway wall thickness/vessel diameter (AWT/VD) biomarkers in R-squared and slope of regression analysis.
We revisit the prospects for detecting the Sunyaev Zel'dovich (SZ) effect induced by dark matter (DM) annihilation or decay. We show that with standard (or even extreme) assumptions for DM properties, the optical depth associated with relativistic electrons injected from DM annihilation or decay is much smaller than that associated with thermal electrons, when averaged over the angular resolution of current and future experiments. For example, we find: τ{sub DM} ∼ 10{sup −9}−10{sup −5} (depending on the assumptions) for m{sub χ} = 1 GeV and a density profile ρ∝r{sup −1} for a template cluster located at 50 Mpc and observed within an angular resolution of 10'', compared to τ{sub th} ∼ 10{sup −3}−10{sup −2}. This, together with a full spectral analysis, enables us to demonstrate that, for a template cluster with generic properties, the SZ effect due to DM annihilation or decay is far below the sensitivity of the Planck satellite. This is at variance with previous claims regarding heavier annihilating DM particles. Should DM be made of lighter particles, the current constraints from 511 keV observations on the annihilation cross section or decay rate still prevent a detectable SZ effect. Finally, we show that spatial diffusion sets a core of a few kpc in the electron distribution, even for very cuspy DM profiles, such that improving the angular resolution of the instrument, eg with ALMA, does not necessarily improve the detection potential. We provide useful analytical formulæ parameterized in terms of the DM mass, decay rate or annihilation cross section and DM halo features, that allow quick estimates of the SZ effect induced by any given candidate and any DM halo profile.
In recent work (Seljak, Hamaus, and Desjacques 2009) it was found that weighting central halo galaxies by halo mass can significantly suppress their stochasticity relative to the dark matter, well below the Poisson model expectation. This is useful for constraining relations between galaxies and the dark matter, such as the galaxy bias, especially in situations where sampling variance errors can be eliminated. In this paper we extend this study with the goal of finding the optimal mass-dependent halo weighting. We use N-body simulations to perform a general analysis of halo stochasticity and its dependence on halo mass. We investigate the stochasticity matrix, defined as C{sub ij{identical_to}}<({delta}{sub i}-b{sub i{delta}m})({delta}{sub j}-b{sub j{delta}m})>, where {delta}{sub m} is the dark matter overdensity in Fourier space, {delta}{sub i} the halo overdensity of the i-th halo mass bin, and b{sub i} the corresponding halo bias. In contrast to the Poisson model predictions we detect nonvanishing correlations between different mass bins. We also find the diagonal terms to be sub-Poissonian for the highest-mass halos. The diagonalization of this matrix results in one large and one low eigenvalue, with the remaining eigenvalues close to the Poisson prediction 1/n, where n is the mean halo number density. The eigenmode with the lowest eigenvalue contains most of the information and the corresponding eigenvector provides an optimal weighting function to minimize the stochasticity between halos and dark matter. We find this optimal weighting function to match linear mass weighting at high masses, while at the low-mass end the weights approach a constant whose value depends on the low-mass cut in the halo mass function. This weighting further suppresses the stochasticity as compared to the previously explored mass weighting. Finally, we employ the halo model to derive the stochasticity matrix and the scale-dependent bias from an analytical perspective. It is remarkably successful in reproducing our numerical results and predicts that the stochasticity between halos and the dark matter can be reduced further when going to halo masses lower than we can resolve in current simulations.
Non-Gaussian correlations induced in CMB power spectra by gravitational lensing needs to be included in likelihood analyses for future CMB experiments. We present a simple but accurate likelihood model which includes these correlations and use it for Markov Chain Monte Carlo parameter estimation from simulated lensed CMB maps in the context of ΛCDM and extensions which include the sum of neutrino masses or the dark energy equation of state w. If lensing-induced covariance is not taken into account for a CMB-S4 type experiment, the errors for one combination of parameters in each case would be underestimated by more then a factor of two and lower limits on w could be misestimated substantially. The frequency of falsely ruling out the true model or finding tension with other data sets would also substantially increase. Our analysis also enables a separation of lens and unlensed information from CMB power spectra, which provides for consistency tests of the model and, if combined with other such measurements, a nearly lens-sample-variance free test for systematics and new physics in the unlensed spectrum. This parameterization also leads to a simple effective likelihood that can be used to assist model building in case consistency tests of ΛCDM fail.
Purpose: Texture analysis on fluence maps was performed to evaluate the degree of modulation for volumetric modulated arc therapy (VMAT) plans. Methods: A total of six textural features including angular second moment, inverse difference moment, contrast, variance, correlation, and entropy were calculated for fluence maps generated from 20 prostate and 20 head and neck VMAT plans. For each of the textural features, particular displacement distances (d) of 1, 5, and 10 were adopted. To investigate the deliverability of each VMAT plan, gamma passing rates of pretreatment quality assurance, and differences in modulating parameters such as multileaf collimator (MLC) positions, gantry angles, and monitor units at each control point between VMAT plans and dynamic log files registered by the Linac control system during delivery were acquired. Furthermore, differences between the original VMAT plan and the plan reconstructed from the dynamic log files were also investigated. To test the performance of the textural features as indicators for the modulation degree of VMAT plans, Spearman’s rank correlation coefficients (r{sub s}) with the plan deliverability were calculated. For comparison purposes, conventional modulation indices for VMAT including the modulation complexity score for VMAT, leaf travel modulation complexity score, and modulation index supporting station parameter optimized radiation therapy (MI{sub SPORT}) were calculated, and their correlations were analyzed in the same way. Results: There was no particular textural feature which always showed superior correlations with every type of plan deliverability. Considering the results comprehensively, contrast (d = 1) and variance (d = 1) generally showed considerable correlations with every type of plan deliverability. These textural features always showed higher correlations to the plan deliverability than did the conventional modulation indices, except in the case of modulating parameter differences. The r{sub s} values of contrast to the global gamma passing rates with criteria of 2%/2 mm, 2%/1 mm, and 1%/2 mm were 0.536, 0.473, and 0.718, respectively. The respective values for variance were 0.551, 0.481, and 0.688. In the case of local gamma passing rates, the r{sub s} values of contrast were 0.547, 0.578, and 0.620, respectively, and those of variance were 0.519, 0.527, and 0.569. All of the r{sub s} values in those cases were statistically significant (p < 0.003). In the cases of global and local gamma passing rates, MI{sub SPORT} showed the highest correlations among the conventional modulation indices. For global passing rates, r{sub s} values of MI{sub SPORT} were −0.420, −0.330, and −0.632, respectively, and those for local passing rates were −0.455, −0.490 and −0.502. The values of r{sub s} of contrast, variance, and MI{sub SPORT} with the MLC errors were −0.863, −0.828, and 0.795, respectively, all with statistical significances (p < 0.001). The correlations with statistical significances between variance and dose-volumetric differences were observed more frequently than the others. Conclusions: The contrast (d = 1) and variance (d = 1) calculated from fluence maps of VMAT plans showed considerable correlations with the plan deliverability, indicating their potential use as indicators for assessing the degree of modulation of VMAT plans. Both contrast and variance consistently showed better performance than the conventional modulation indices for VMAT.
In order to address fundamental questions related to the expansion history of the Universe and its primordial nature with the next generation of galaxy experiments, we need to model reliably large-scale structure observables such as the correlation function and the power spectrum. Cosmological N-body simulations provide a reference through which we can test our models, but their output suffers from sample variance on large scales. Fortunately, this is the regime where accurate analytic approximations exist. To reduce the variance, which is key to making optimal use of these simulations, we can leverage the accuracy and precision of such analytic descriptions using Control Variates (CV). The power of control variates stems from utilizing inexpensive but highly correlated surrogates of the statistics one wishes to measure. The stronger the correlation between the surrogate and the statistic of interest, the larger the variance reduction delivered by the method. We apply two control variate formulations to mock catalogs generated in anticipation of upcoming data from the Dark Energy Spectroscopic Instrument (DESI) to test the robustness of its analysis pipeline. Our CV-reduced measurements offer a factor of 5-10 improvement in the measurement error compared with the raw measurements. We explore the relevant properties of the galaxy samples that dictate this reduction and comment on the improvements we find on some of the derived quantities relevant to Baryon Acoustic Oscillation (BAO) analysis.
In this report, we present results from analysis of Quantum Monte Carlo (QMC) simulation data with the goal of determining internal structure of a 3N-dimensional phase space of an N-electron molecule. We are interested in mining the simulation data for patterns that might be indicative of the bond rearrangement as molecules change electronic states. We examined simulation output that tracks the positions of two coupled electrons in the singlet and triplet states of an H2 molecule. The electrons trace out a trajectory, which was analyzed with a number of statistical techniques. This project was intended to address the following scientific questions: (1) Do high-dimensional phase spaces characterizing electronic structure of molecules tend to cluster in any natural way? Do we see a change in clustering patterns as we explore different electronic states of the same molecule? (2) Since it is hard to understand the high-dimensional space of trajectories, can we project these trajectories to a lower dimensional subspace to gain a better understanding of patterns? (3) Do trajectories inherently lie in a lower-dimensional manifold? Can we recover that manifold? After extensive statistical analysis, we are now in a better position to respond to these questions. (1) We definitely see clustering patterns, and differences between the H2 and H2tri datasets. These are revealed by the pamk method in a fairly reliable manner and can potentially be used to distinguish bonded and non-bonded systems and get insight into the nature of bonding. (2) Projecting to a lower dimensional subspace ({approx}4-5) using PCA or Kernel PCA reveals interesting patterns in the distribution of scalar values, which can be related to the existing descriptors of electronic structure of molecules. Also, these results can be immediately used to develop robust tools for analysis of noisy data obtained during QMC simulations (3) All dimensionality reduction and estimation techniques that we tried seem to indicate that one needs 4 or 5 components to account for most of the variance in the data, hence this 5D dataset does not necessarily lie on a well-defined, low dimensional manifold. In terms of specific clustering techniques, K-means was generally useful in exploring the dataset. The partition around medoids (pam) technique produced the most definitive results for our data showing distinctive patterns for both a sample of the complete data and time-series. The gap statistic with tibshirani criteria did not provide any distinction across the 2 dataset. The gap statistic w/DandF criteria, Model based clustering and hierarchical modeling simply failed to run on our datasets. Thankfully, the vanilla PCA technique was successful in handling our entire dataset. PCA revealed some interesting patterns for the scalar value distribution. Kernel PCA techniques (vanilladot, RBF, Polynomial) and MDS failed to run on the entire dataset, or even a significant fraction of the dataset, and we resorted to creating an explicit feature map followed by conventional PCA. Clustering using K-means and PAM in the new basis set seems to produce promising results. Understanding the new basis set in the scientific context of the problem is challenging, and we are currently working to further examine and interpret the results.
We report an analysis that compares global horizontal irradiance (GHI) estimates from version 3 of the National Solar Radiation Database (NSRDB v3) with surface measurements of GHI at a wide variety of locations over the period spanning from 2005 to 2012. The NSRDB v3 estimate of GHI are derived from the Physical Solar Model (PSM) which employs physics-based models to estimate GHI from measurements of reflected visible and infrared irradiance collected by Geostationary Operational Environment Satellites (GOES) and several other data sources. Because the ground measurements themselves are uncertain our analysis does not establish the absolute accuracy for PSM GHI. However by examining the comparison for trends and for consistency across a large number of sites, we may establish a level of confidence in PSM GHI and identify conditions which indicate opportunities to improve PSM. We focus our evaluation on annual and monthly insolation because these quantities directly relate to prediction of energy production from solar power systems. We find that generally, PSM GHI exhibits a bias towards overestimating insolation, on the order of 5% when all sky conditions are considered, and somewhat less (-3%) when only clear sky conditions are considered. The biases persist across multiple years and are evident at many locations. In our opinion the bias originates with PSM and we view as less credible that the bias stems from calibration drift or soiling of ground instruments. We observe that PSM GHI may significantly underestimate monthly insolation in locations subject to broad snow cover. We found examples of days where PSM GHI apparently misidentified snow cover as clouds, resulting in significant underestimates of GHI during these days and hence leading to substantial understatement of monthly insolation. Analysis of PSM GHI in adjacent pixels shows that the level of agreement between PSM GHI and ground data can vary substantially over distances on the order of 2 km. We conclude that the variance most likely originates from dramatic contrasts in the ground's appearance over these distances.