Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey quasar sample: testing observational systematics on the Baryon Acoustic Oscillation measurement

ABSTRACT Baryon Acoustic Oscillations (BAO) are considered to be a very robust standard ruler against various systematics. This premise has been tested against observational systematics, but not to the level required for the next generation of galaxy surveys such as the Dark Energy Spectroscopic Instrument (DESI) and Euclid. In this paper, we investigate the effect of observational systematics on the BAO measurement of the final sample of quasars from the extended Baryon Oscillation Spectroscopic Survey Data Release 16 in order to prepare and hone a similar analysis for upcoming surveys. We employ catalogues with various treatments of imaging systematic effects using linear and neural network-based non-linear approaches and consider how the BAO measurement changes. We also test how the variations to the BAO fitting model respond to the observational systematics. As expected, we confirm that the BAO measurements obtained from the DR16 quasar sample are robust against imaging systematics well within the statistical error, while reporting slightly modified constraints that shift the line-of-sight BAO signal by less than 1.1 per cent. We use realistic simulations with similar redshift and angular distributions as the DR16 sample to conduct statistical tests for validating the pipeline, quantifying the significance of differences, and estimating the expected bias on the BAO scale in future high-precision data sets. Although we find a marginal impact for the eBOSS QSO data, the work presented here is of vital importance for constraining the nature of dark energy with the BAO feature in the new era of big data cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Filtering a statistically exactly solvable test model for turbulent tracers from partial observations

A statistically exactly solvable model for passive tracers is introduced as a test model for the authors' Nonlinear Extended Kalman Filter (NEKF) as well as other filtering algorithms. The model involves a Gaussian velocity field and a passive tracer governed by the advection-diffusion equation with an imposed mean gradient. The model has direct relevance to engineering problems such as the spread of pollutants in the air or contaminants in the water as well as climate change problems concerning the transport of greenhouse gases such as carbon dioxide with strongly intermittent probability distributions consistent with the actual observations of the atmosphere. One of the attractive properties of the model is the existence of the exact statistical solution. In particular, this unique feature of the model provides an opportunity to design and test fast and efficient algorithms for real-time data assimilation based on rigorous mathematical theory for a turbulence model problem with many active spatiotemporal scales. Here, we extensively study the performance of the NEKF which uses the exact first and second order nonlinear statistics without any approximations due to linearization. The role of partial and sparse observations, the frequency of observations and the observation noise strength in recovering the true signal, its spectrum, and fat tail probability distribution are the central issues discussed here. The results of our study provide useful guidelines for filtering realistic turbulent systems with passive tracers through partial observations.

54 ENVIRONMENTAL SCIENCES↗

AFIP6-MkII and RERTR-12 Porosity Data Collection and Analysis for Modeling and Simulation

Gathering data for the improvement of nuclear fuel modeling and simulation efforts is the primary driver for this work. Mechanistic models allow for a better understanding of the material on a micro- and macrostructural level while saving time and money over traditional experiment efforts. Historically, summarized data and correlations are the inputs for empirical material models and model validation. When improving these models for nuclear fuels with experimental results, there is a lack of reliable data readily available. Experiments - RERTR-12 and AFIP6-MkII - were conducted to understand the irradiation behavior of metallic U-10Mo monolithic fuels for use in extreme reactor environments such as research reactors like the Advanced Test Reactor (ATR) or the High Flux Isotope Reactor (HFIR). Microstructural characteristics of fission gas pores (FGP) in each experiment are collected using an automated image analysis technique developed at the University of Florida and presented here. A series of statistical tests are performed to explore the reliability of the results, as well as understand where the data is lacking and what future data collection is necessary to provide sufficient information to assist modeling efforts. The focus is on the porosity, pore size, and eccentricity of FGPs formed during irradiation in three AFIP6-MkII samples and one RERTR-12 sample. From the analysis, it is clear there are substantial impacts of fission density on the pore structure, but there also exist also underlying connections between each sample and the behavior observed in the pores. Further analyses of the pre- and post-irradiation microstructure are needed to improve the understanding of these connections. An early method for microstructural data analysis is presented within and is currently being expanded to include other microstructure data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Bayesian Analysis of Congruence of Core Genes in Prochlorococcus and Synechococcus and Implications on Horizontal Gene Transfer

It is often suggested that horizontal gene transfer is so ubiquitous in microbes that the concept of a phylogenetic tree representing the pattern of vertical inheritance is oversimplified or even positively misleading. “Universal proteins” have been used to infer the organismal phylogeny, but have been criticized as being only the “tree of one percent.” Currently, few options exist for those wishing to rigorously assess how well a universal protein phylogeny, based on a relative handful of well-conserved genes, represents the phylogenetic histories of hundreds of genes. Here, we address this problem by proposing a visualization method and a statistical test within a Bayesian framework. We use the genomes of marine cyanobacteria, a group thought to exhibit substantial amounts of HGT, as a test case. We take 379 orthologous gene families from 28 cyanobacteria genomes and estimate the Bayesian posterior distributions of trees – a “treecloud” – for each, as well as for a concatenated dataset based on putative “universal proteins.” We then calculate the average distance between trees within and between all treeclouds on various metrics and visualize this high-dimensional space with non-metric multidimensional scaling (NMMDS). We show that the tree space is strongly clustered and that the universal protein treecloud is statistically significantly closer to the center of this tree space than any individual gene treecloud. We apply several commonly-used tests for incongruence/HGT and show that they agree HGT is rare in this dataset, but make different choices about which genes were subject to HGT. Our results show that the question of the representativeness of the “tree of one percent” is a quantitative empirical question, and that the phylogenetic central tendency is a meaningful observation even if many individual genes disagree due to the various sources of incongruence.

59 BASIC BIOLOGICAL SCIENCES↗

Detectability of neutrino-signal fluctuations induced by the hadron-quark phase transition in failing core-collapse supernovae

Here we introduce a systematic and quantitative methodology for establishing the presence of neutrino oscillatory signals due to the hadron-quark phase transition (PT) in failing core-collapse supernovae from the observed neutrino event rate in water- or ice-based neutrino detectors. The methodology uses a likelihood ratio in the frequency domain as a test-statistic; it is employed for quantitative analysis of neutrino signals without assuming the frequency, amplitude, starting time, and duration of the PT-induced oscillations present in the neutrino events and thus it is suitable for analyzing neutrino signals from a wide variety of numerical simulations. We test the validity of this method by using a core-collapse simulation of a 17 solar-mass star by Zha et al. [Astrophys. J. 911, 74 (2021) ]. Based on this model, we further report the presence of a PT-induced oscillations quantitatively for a core-collapse supernovae out to a distance of ~10 kpc, ~5 kpc for IceCube and to a distance of ~10 kpc, ~5 kpc, and ~1 kpc for a 0.4 Mt mass water Cherenkov detector. This methodology will aid the investigation of a future galactic supernova and the study of hadron-quark phase in the core of core-collapse supernovae.

79 ASTRONOMY AND ASTROPHYSICS↗

Image Based Characterization of Formal and Informal Neighborhoods in an Urban Landscape

The high rate of global urbanization has resulted in a rapid increase in informal settlements, which can be de ned as unplanned, unauthorized, and/or unstructured housing. Techniques for ef ciently mapping these settlement boundaries can bene t various decision making bodies. From a remote sensing perspective, informal settlements share unique spatial characteristics that distinguish them from other types of structures (e.g., industrial, commercial, and formal residential). These spatial characteristics are often captured in high spatial resolution satellite imagery. We analyzed the role of spatial, structural, and contextual features (e.g., GLCM, Histogram of Oriented Gradients, Line Support Regions, Lacunarity) for urban neighborhood mapping, and computed several low-level image features at multiple scales to characterize local neighborhoods. The decision parameters to classify formal-, informal-, and non-settlement classes were learned under Decision Trees and a supervised classi cation framework. Experiments were conducted on high-resolution satellite imagery from the CitySphere collection, and four different cities (i.e., Caracas, Kabul, Kandahar, and La Paz) with varying spatial characteristics were represented. Overall accuracy ranged from 85% in La Paz, Bolivia, to 92% in Kandahar, Afghanistan. While the disparities between formal and informal neighborhoods varied greatly, many of the image statistics tested proved robust.

58 GEOSCIENCES↗

Statistics and Discoveries at the LHC (4/4)

The lectures will give an introduction to statistics as applied in particle physics and will provide all the necessary basics for data analysis at the LHC. Special emphasis will be placed on the the problems and questions that arise when searching for new phenomena, including p-values, discovery significance, limit setting procedures, treatment of small signals in the presence of large backgrounds. Specific issues that will be addressed include the advantages and drawbacks of different statistical test procedures (cut-based, likelihood-ratio, etc.), the look-elsewhere effect and treatment of systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Observational tests of the black hole area increase law

The black hole area theorem implies that when two black holes merge, the area of the final black hole should be greater than the sum of the areas of the two original black holes. In this study, we examine how this prediction can be tested with gravitational-wave observations of binary black holes. By separately fitting the early inspiral and final ringdown stages, we calculate the posterior distributions for the masses and spins of the two initial and the final black holes. This yields posterior distributions for the change in the area and thus a statistical test of the validity of the area increase law. We illustrate this method with a GW150914-like binary black hole waveform calculated using numerical relativity, and detector sensitivities representative of both the first observing run and the design configuration of Advanced LIGO. We obtain a ~74.6 % probability that the simulated signal is consistent with the area theorem with current sensitivity, improving to ~99.9 % when Advanced LIGO reaches design sensitivity. Lastly, an important ingredient in our test is a method of estimating when the postmerger signal is well fit by a damped sinusoid ringdown waveform.

79 ASTRONOMY AND ASTROPHYSICS↗

Multiscale spatial analysis of fracture arrangement and pattern reconstruction using Ripley's K-function

This work presents novel multiscale spatial data analytics using Ripley's K-function, as a measure of spatial interaction, to study one-dimensional arrangement of fractures. Fracture spatial arrangements are classified into clustered, anticlustered, or indistinguishable from random by testing statistical significance of the calculated Ripley's K-function. Characterizations of fracture arrangements are performed as a function of length scale and position. Analysis of the K-function along the study interval identifies where fracture clustering and anticlustering occur. Here, a simulation technique is also introduced here to statistically reconstruct spatial arrangements and to generate fracture realizations that are spatially similar to the fractures observed in the field. With this simulation technique, one can also fill spatial gaps in fracture measurements where data are absent, unreliable, or unused. Synthetic as well as field-measured 1D fracture datasets are used for testing and demonstration. Methods introduced in this work can be readily applied to fracture datasets observed in outcrops, borehole image logs, and cores.

58 GEOSCIENCES↗

PNNL-Predictive-Phenomics/ProteoMeter

ProteoMeter is a Python package that assists in the statistical analysis of global proteomics, protein post-translation modification (PTM), and limited proteolysis (LiP) data. It contains batch correction, normalization, and statistical testing methods, as well as functions that "roll up" peptide-level data to the single-site level. It has a robust user configuration system, allowing it to flexibly integrate different types of experiment designs. For basic usage, a simple configuration file provides the essential functionality. Advanced users have access to the entire statistical pipeline for fine-tuning analyses. Processed data is easily exported to many common spreadsheet and data-frame formats.

Rozum, Jordan [Pacific Northwest National Lab]↗

Statistics and Discoveries at the LHC (2/4)

The lectures will give an introduction to statistics as applied in particle physics and will provide all the necessary basics for data analysis at the LHC. Special emphasis will be placed on the the problems and questions that arise when searching for new phenomena, including p-values, discovery significance, limit setting procedures, treatment of small signals in the presence of large backgrounds. Specific issues that will be addressed include the advantages and drawbacks of different statistical test procedures (cut-based, likelihood-ratio, etc.), the look-elsewhere effect and treatment of systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Integrating Symbolic and Statistical Methods for Testing Intelligent Systems Applications to Machine Learning and Computer Vision

Embedded intelligent systems ranging from tiny im- plantable biomedical devices to large swarms of autonomous un- manned aerial systems are becoming pervasive in our daily lives. While we depend on the flawless functioning of such intelligent systems, and often take their behavioral correctness and safety for granted, it is notoriously difficult to generate test cases that expose subtle errors in the implementations of machine learning algorithms. Hence, the validation of intelligent systems is usually achieved by studying their behavior on representative data sets, using methods such as cross-validation and bootstrapping.In this paper, we present a new testing methodology for studying the correctness of intelligent systems. Our approach uses symbolic decision procedures coupled with statistical hypothesis testing to. We also use our algorithm to analyze the robustness of a human detection algorithm built using the OpenCV open-source computer vision library. We show that the human detection implementation can fail to detect humans in perturbed video frames even when the perturbations are so small that the corresponding frames look identical to the naked eye.

Jha, Sumit Kumar↗

Spectral characterization of flash and high flux x-ray radiographic sources with a magnetic Compton spectrometer

In this article, we present a new analysis method applied to revitalize permanent magnet Compton spectrometers used to measure photon energy spectra in the MeV range. The inversion of the measured electron distribution to determine the original photon distribution is achieved via a method of consistent coupled radiation transport and magnetic field mapping of the input photon spectra to the measured electron distribution. The method of linear least squares was used to perform the unfolding of the electron distribution to the initial photon spectra, without any assumptions made regarding the electron distribution. We present an application of this method to data from a nominal 19.4 MeV flash radiographic source (the first axis of the Dual Axis Radiographic Hydro-Test Facility) capable of generating 500 R @ 1 m in ~60 ns and a medical therapy source (a Scanditronix M22, Microtron) capable of variable energies with nominal endpoints of 6, 10, 15, and 20 MeV and an output of ~1000–2000 R/min @ 1 m. The results provide agreement between the modeled and unfolded experimentally measured photon spectra as quantified by statistical tests, from 1.5 to 20 MeV. Experimental results are presented as well as a discussion of the novel MCNP6-based simulations and methods for reconstruction of the spectra.

47 OTHER INSTRUMENTATION↗

Angular-planar CMB power spectrum

Gaussianity and statistical isotropy of the Universe are modern cosmology's minimal set of hypotheses. In this work we introduce a new statistical test to detect observational deviations from this minimal set. By defining the temperature correlation function over the whole celestial sphere, we are able to independently quantify both angular and planar dependence (modulations) of the CMB temperature power spectrum over different slices of this sphere. Given that planar dependence leads to further modulations of the usual angular power spectrum C{sub l}, this test can potentially reveal richer structures in the morphology of the primordial temperature field. We have also constructed an unbiased estimator for this angular-planar power spectrum which naturally generalizes the estimator for the usual C{sub l}'s. With the help of a chi-square analysis, we have used this estimator to search for observational deviations of statistical isotropy in WMAP's 5 year release data set (ILC5), where we found only slight anomalies on the angular scales l=7 and l=8. Since this angular-planar statistic is model-independent, it is ideal to employ in searches of statistical anisotropy (e.g., contaminations from the galactic plane) and to characterize non-Gaussianities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Interactive XCMS Online: Simplifying Advanced Metabolomic Data Processing and Subsequent Statistical Analyses

XCMS Online (xcmsonline.scripps.edu) is a cloud-based informatic platform designed to process and visualize mass-spectrometry-based, untargeted metabolomic data. Initially, the platform was developed for two-group comparisons to match the independent, “control” versus “disease” experimental design. Here, we introduce an enhanced XCMS Online interface that enables users to perform dependent (paired) two-group comparisons, meta-analysis, and multigroup comparisons, with comprehensive statistical output and interactive visualization tools. Newly incorporated statistical tests cover a wide array of univariate analyses. Multigroup comparison allows for the identification of differentially expressed metabolite features across multiple classes of data while higher order meta-analysis facilitates the identification of shared metabolic patterns across multiple two-group comparisons. Given the complexity of these data sets, we have developed an interactive platform where users can monitor the statistical output of univariate (cloud plots) and multivariate (PCA plots) data analysis in real time by adjusting the threshold and range of various parameters. On the interactive cloud plot, metabolite features can be filtered out by their significance level (p-value), fold change, mass-to-charge ratio, retention time, and intensity. The variation pattern of each feature can be visualized on both extracted-ion chromatograms and box plots. The interactive principal component analysis includes scores, loadings, and scree plots that can be adjusted depending on scaling criteria. The utility of XCMS functionalities is demonstrated through the metabolomic analysis of bacterial stress response and the comparison of lymphoblastic leukemia cell lines.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Statistics and Discoveries at the LHC (3/4)

The lectures will give an introduction to statistics as applied in particle physics and will provide all the necessary basics for data analysis at the LHC. Special emphasis will be placed on the the problems and questions that arise when searching for new phenomena, including p-values, discovery significance, limit setting procedures, treatment of small signals in the presence of large backgrounds. Specific issues that will be addressed include the advantages and drawbacks of different statistical test procedures (cut-based, likelihood-ratio, etc.), the look-elsewhere effect and treatment of systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Feasibility study for test rig assessments of fish passage conditions in a Kaplan turbine

The assessment of fish passage conditions in hydroelectric turbines consists of identifying and quantifying physical magnitudes leading to increased risks of injury of fish passing through turbines in operation. Such assessments are usually carried out either with the use of computer-based methods during design or with field testing of live fish and sensors passing through prototypes. A method in between consists of test rig experimentation, which is critical for testing fish-focused design concepts and offers the opportunity for implementing the most effective design measures for improved fish survivability. However, fish-related assessments in test rigs are not sufficiently documented for industrial applications. This work presents the main findings of an experimental campaign to quantify fish-related hydraulic magnitudes in a physical model of a Kaplan turbine in a commercial test rig. Two operating conditions were tested by releasing miniaturized autonomous sensor devices (termed Sensor Fish Mini) at the turbine intake flow, passing them through the runner in motion and recovering them at the draft tube exit. During passage, time series of acceleration, absolute pressure and rotational velocity were recorded. The recordings were then interpreted to determine the magnitude and likely location of hydraulic stressors hazardous to fish. The statistical tests on the reported measurements indicated that low pressure, collisions on the runner and rotations in the draft tube were not different between the two tested operating points. On the other hand, pressure drop and collision rates on the distributor differed considerably as a function of net head. The outcomes of this investigation showed that test rig evaluations of fish-related properties with Sensor Fish Mini can contribute to an evidence-based development of turbine geometries designed for providing safer passage conditions. Future work will investigate the scaling of test rig measurements to hydraulically equivalent magnitudes in the prototype and their biological consequences.

13 HYDRO ENERGY↗

SU-E-J-85: Leave-One-Out Perturbation (LOOP) Fitting Algorithm for Absolute Dose Film Calibration

Purpose: To introduce an outliers-recognition fitting routine for film dosimetry. It cannot only be flexible with any linear and non-linear regression but also can provide information for the minimal number of sampling points, critical sampling distributions and evaluating analytical functions for absolute film-dose calibration. Methods: The technique, leave-one-out (LOO) cross validation, is often used for statistical analyses on model performance. We used LOO analyses with perturbed bootstrap fitting called leave-one-out perturbation (LOOP) for film-dose calibration . Given a threshold, the LOO process detects unfit points (“outliers”) compared to other cohorts, and a bootstrap fitting process follows to seek any possibilities of using perturbations for further improvement. After that outliers were reconfirmed by a traditional t-test statistics and eliminated, then another LOOP feedback resulted in the final. An over-sampled film-dose- calibration dataset was collected as a reference (dose range: 0-800cGy), and various simulated conditions for outliers and sampling distributions were derived from the reference. Comparisons over the various conditions were made, and the performance of fitting functions, polynomial and rational functions, were evaluated. Results: (1) LOOP can prove its sensitive outlier-recognition by its statistical correlation to an exceptional better goodness-of-fit as outliers being left-out. (2) With sufficient statistical information, the LOOP can correct outliers under some low-sampling conditions that other “robust fits”, e.g. Least Absolute Residuals, cannot. (3) Complete cross-validated analyses of LOOP indicate that the function of rational type demonstrates a much superior performance compared to the polynomial. Even with 5 data points including one outlier, using LOOP with rational function can restore more than a 95% value back to its reference values, while the polynomial fitting completely failed under the same conditions. Conclusion: LOOP can cooperate with any fitting routine functioning as a “robust fit”. In addition, it can be set as a benchmark for film-dose calibration fitting performance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗