Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Designing Size Consistent Statistics for Accurate Anomaly Detection in Dynamic Networks

An important task in network analysis is the detection of anomalous events in a network time series. These events could merely be times of interest in the network timeline or they could be examples of malicious activity or network malfunction. Hypothesis testing using network statistics to summarize the behavior of the network provides a robust framework for the anomaly detection decision process. Unfortunately, choosing network statistics that are dependent on confounding factors like the total number of nodes or edges can lead to incorrect conclusions (e.g., false positives and false negatives). In this article, we describe the challenges that face anomaly detection in dynamic network streams regarding confounding factors. We also provide two solutions to avoiding error due to confounding factors: the first is a randomization testing method that controls for confounding factors, and the second is a set of size-consistent network statistics that avoid confounding due to the most common factors, edge count and node count.

97 MATHEMATICS AND COMPUTING↗

New Advanced Source Identification Algorithm (ASIA-NEW) for radiation monitors with plastic detectors

Radiation Portal Monitors (RPM) with plastic detectors represent the main instruments used for primary border (customs) radiation control. RPM are widely used because they are simple, reliable, relatively inexpensive and have a high sensitivity. However, experience using the RPM in various countries has revealed the systems have some grave shortcomings. There is a dramatic decrease of the probability of detection of radioactive sources under high suppression of the natural gamma background (radiation control of heavy cargoes, containers and, especially, trains). NORM (Naturally Occurring Radioactive Material) existing in objects under control trigger the so-called 'nuisance alarms', requiring a secondary inspection for source verification. At a number of sites, the rate of such alarms is so high it significantly complicates the work of customs and border officers. This paper presents a brief description of new variant of algorithm ASIA-New (New Advanced Source Identification Algorithm), which was developed by the authors and based on some experimental test results. It also demonstrates results of different tests and the capability of a new system to overcome the shortcomings stated above. New electronics and ASIA-New enables RPM to detect radioactive sources under a high background suppression (tested at 15-30%) and to verify the detected NORM (KCl) and the artificial isotopes (Co-57, Ba-133 and other). New variant of ASIA is based on physical principles and does not require a lot of special tests to attain statistical data for its parameters. That is why this system can be easily installed into any RPM with plastic detectors. This algorithm was tested for 1,395 passages of different transports (cars, trucks and trailers) without radioactive sources. It also was tested for 4,015 passages of these transports with radioactive sources of different activity (Co-57, Ba-133, Cs-137, Co-60, Ra-226, Th-232) and these sources masked by NORM (K-40) as well. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗

D-Guaranteed Discrimination of Statistical Hypotheses: a Review of Results and Unsolved Problems

We compare two sequential d-guaranteed tests and an optimal d-guaranteed test based on a fixed number of observations with respect to the average number of observations within the most accepted practical applications of Bayesian probabilistic models. We consider the sequential “first skipping” test, the sequential locally efficient test based on the score statistic, and the test based on a fixed number of observations that minimizes the necessary sample size. We study various characteristics of these tests connected with the number of observations within three probabilistic models, namely, the normal (ϑ, σ{sup 2}) distribution of the observed random variable and the normal a priori distribution of ϑ with fixed σ{sup 2}; the exponential distribution with the intensity parameter ϑ and the a priori gamma distribution of ϑ; and the Bernoulli sampling with the success probability ϑ and the a priori beta distribution of ϑ. We discuss the connection of the d-posterior approach with the compound decision problem as applied to the analysis of data provided by microchips (when the false discovery rate, or FDR, for short, is treated as the d-risk of the first kind). We present the vast data on characteristics of the mentioned tests obtained by the method of mathematical modeling in several tables. We discuss unsolved problems of the d-guaranteed discrimination of hypotheses with the minimal number of observations and approaches to their solution.

97 MATHEMATICS AND COMPUTING↗

An Indication of Anisotropy in Arrival Directions of Ultra-high-energy Cosmic Rays through Comparison to the Flux Pattern of Extragalactic Gamma-Ray Sources

A new analysis of the dataset from the Pierre Auger Observatory provides evidence for anisotropy in the arrival directions of ultra-high-energy cosmic rays on an intermediate angular scale, which is indicative of excess arrivals from strong, nearby sources. The data consist of 5514 events above 20 EeV with zenith angles up to 80 deg recorded before 2017 April 30. Sky models have been created for two distinct populations of extragalactic gamma-ray emitters: active galactic nuclei from the second catalog of hard Fermi-LAT sources (2FHL) and starburst galaxies from a sample that was examined with Fermi-LAT. Flux-limited samples, which include all types of galaxies from the Swift-BAT and 2MASS surveys, have been investigated for comparison. The sky model of cosmic-ray density constructed using each catalog has two free parameters, the fraction of events correlating with astrophysical objects and an angular scale characterizing the clustering of cosmic rays around extragalactic sources. A maximum-likelihood ratio test is used to evaluate the best values of these parameters and to quantify the strength of each model by contrast with isotropy. It is found that the starburst model fits the data better than the hypothesis of isotropy with a statistical significance of 4.0 sigma, the highest value of the test statistic being for energies above 39 EeV. The three alternative models are favored against isotropy with 2.7-3.2 sigma significance. The origin of the indicated deviation from isotropy is examined and prospects for more sensitive future studies are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Step-Stress Accelerated Degradation Testing for Solar Reflectors: Preprint

To meet the challenge to reduce the cost of electricity generated with concentrating solar power (CSP) new low-cost reflector materials are being developed including metalized polymer reflectors and must be tested and validated against appropriate failure mechanisms. We explore the application of testing methods and statistical inference techniques for quantifying estimates and improvinglifetimes of concentrating solar power (CSP) reflectors associated with failure mechanisms initiated by exposure to the ultraviolet (UV) part of the solar spectrum. In general, a suite of durability and reliability tests are available for testing a variety of failure mechanisms where the results of a set are required to understand overall lifetime of a CSP reflector. We will focus on the use ofthe Ultra-Accelerated Weathering System (UAWS) as a testing device for assessing various degradation patterns attributable to accelerated UV exposure. Depending on number of samples, test conditions, degradation and failure patterns, test results may be used to derive insight into failure mechanisms, associated physical parameters, lifetimes and uncertainties. In the most complicated casewarranting advanced planning and statistical inference, step-stress accelerated degradation (SSADT) methods may be applied.

14 SOLAR ENERGY↗

The 1st International Round-Robin on Bi-Facial Modules

This presentation discusses validation of methods and ensuring the validity of results when testing bifacial PV modules, both of which are requirements in ISO/IEC 17025:2017; electrical parameters to be reported per IEC TS 60904-1-2; and statistical design proficiency testing per ISO 17043.

14 SOLAR ENERGY↗

Dosimetric effect of beam arrangement for intensity-modulated radiation therapy in the treatment of upper thoracic esophageal carcinoma

To evaluate the lung sparing in intensity-modulated radiation therapy (IMRT) for patients with upper thoracic esophageal tumors extending inferiorly to the thorax by different beam arrangement. Overall, 15 patient cases with cancer of upper thoracic esophagus were selected for a retrospective treatment-planning study. Intensity-modulated radiation therapy plans using 4, 5, and 7 beams (4B, 5B, and 7B) were developed for each patient by direct machine parameter optimization (DMPO). All plans were evaluated with respect to dose volumes to irradiated targets and normal structures, with statistical comparisons made between 4B with 5B and 7B intensity-modulated radiation therapy plans. Differences among plans were evaluated using a two-tailed Friedman test at a statistical significance of p < 0.05. The maximum dose, average dose, and the conformity index (CI) of planning target volume 1 (PTV1) were similar for 3 plans for each case. No significant difference of coverage for planning target volume 1 and maximum dose for spinal cords were observed among 3 plans in present study (p > 0.05). The average V{sub 5}, V{sub 13}, V{sub 20}, mean lung dose, and generalized equivalent uniform dose (gEUD) for the total lung were significantly lower in 4B-plans than those data in 5B-plans and 7B-plans (p < 0.01). Although the average V{sub 30} for the total lung were significantly higher in 4B-plans than those in 5B-plans and 7B-plans (p < 0.05). In addition, when comparing with the 4B-plans, the conformity/heterogeneity index of the 5B- and 7B-plans were significantly superior (p < 0.05). The 4B-intensity-modulated radiation therapy plan has advantage to address the specialized problem of lung sparing to low- and intermediate-dose exposure in the thorax when dealing with relative long tumors extended inferiorly to the thoracic esophagus for upper esophageal carcinoma with the cost for less conformity. Studies are needed to compare the superiority of volumetric modulated arc therapy with intensity-modulated radiation therapy technique.

61 RADIATION PROTECTION AND DOSIMETRY↗

TESTING THE DARK ENERGY WITH GRAVITATIONAL LENSING STATISTICS

We study the redshift distribution of two samples of early-type gravitational lenses, extracted from a larger collection of 122 systems, to constrain the cosmological constant in the {Lambda}CDM model and the parameters of a set of alternative dark energy models (XCDM, Dvali-Gabadadze-Porrati, and Ricci dark energy models), in a spatially flat universe. The likelihood is maximized for {Omega}{sub {Lambda}} = 0.70 {+-} 0.09 when considering the sample excluding the Sloan Lens ACS systems (known to be biased toward large image-separation lenses) and no-evolution, and {Omega}{sub {Lambda}} = 0.81 {+-} 0.05 when limiting to gravitational lenses with image separation {Delta}{theta} > 2'' and no-evolution. In both cases, results accounting for galaxy evolution are consistent within 1{sigma}. The present test supports the accelerated expansion, by excluding the null hypothesis (i.e., {Omega}{sub {Lambda}} = 0) at more than 4{sigma}, regardless of the chosen sample and assumptions on the galaxy evolution. A comparison between competitive world models is performed by means of the Bayesian information criterion. This shows that the simplest cosmological constant model-that has only one free parameter-is still preferred by the available data on the redshift distribution of gravitational lenses. We perform an analysis of the possible systematic effects, finding that the systematic errors due to sample incompleteness, galaxy evolution, and model uncertainties approximately equal the statistical errors, with present-day data. We find that the largest sources of systemic errors are the dynamical normalization and the high-velocity cutoff factor, followed by the faint-end slope of the velocity dispersion function.

79 ASTRONOMY AND ASTROPHYSICS↗

Droplet size distributions in turbulent clouds: experimental evaluation of theoretical distributions

Precipitation efficiency and optical properties of clouds, both central to determining Earth's weather and climate, depend on the size distribution of cloud particles. Here in this paper, theoretical expressions for cloud droplet size distribution shape are evaluated using measurements from controlled experiments in a convective-cloud chamber. The experiments are a unique opportunity to constrain theory because they are in steady-state and because the initial and boundary conditions are well characterized compared to typical atmospheric measurements. Three theoretical distributions obtained from a Langevin drift-diffusion approach to cloud formation via stochastic condensation are tested: (a) stochastic condensation with a constant removal time-scale; (b) stochastic condensation with a size-dependent removal time-scale; (c) droplet growth in a fixed supersaturation condition and with size-dependent removal. In addition, a similar Weibull distribution that can be obtained from the drift-diffusion approach, as well as from mechanism-independent probabilistic arguments (e.g., maximum entropy), is tested as a fourth hypothesis. Statistical techniques such as the χ2 test, sum of squared errors of prediction, and residual analysis are employed to judge relative success or failure of the theoretical distributions to describe the experimental data. An extensive set of cloud droplet size distributions are measured under different aerosol injection rates. Five different aerosol injection rates are run both for size-selected aerosol particles, and six aerosol injection rates are run for broad-distribution, polydisperse aerosol particles. In relative comparison, the most favourable comparison to the measurements is the expression for stochastic condensation with size-dependent droplet removal rate. However, even this optimal distribution breaks down for broad aerosol size distributions, primarily due to deviations from the measured large-droplet tail. Lastly, a possible explanation for the deviation is the Ostwald ripening effect coupled with deactivation/activation in polluted cloud conditions.

54 ENVIRONMENTAL SCIENCES↗

Improved Subseasonal Forecasting of Extreme Polar Vortices Using Machine Learning

Our research was focused on forecasting the position and shape of the winter stratospheric polar vortex at a subseasonal timescale of 15 days in advance. To achieve this, we employed both statistical and neural network machine learning techniques. The analysis was performed on 42 winter seasons of reanalysis data provided by NASA giving us a total of 6,342 days of data. The state of the polar vortex for determined by using geometric moments to calculate the centroid latitude and the aspect ratio of an ellipse fit onto the vortex. Timeseries for thirty additional precursors were calculated to help improve the predictive capabilities of the algorithm. Feature importance of these precursors was performed using random forest to measure the predictive importance and the ideal number of precursors. Then, using the precursors identified as important, various statistical methods were tested for predictive accuracy with random forest and nearest neighbor performing the best. An echo state network, a type of recurrent neural network that features sparsely connected hidden layer and a reduced number of trainable parameters that allows for rapid training and testing, was also implemented for the forecasting problem. Hyperparameter tuning was performed for each methods using a subset of the training data. The algorithms were trained and tuned on the first 41 years of data, then tested for accuracy on the final year. In general, the centroid latitude of the polar vortex proved easier to predict than the aspect ratio across all algorithms. Random forest outperformed other statistical forecasting algorithms overall but struggled to predict extreme values. Forecasting from echo state network suggested a strong predictive capability past 15 days, but further work is required to fully realize the potential of recurrent neural network approaches.

54 ENVIRONMENTAL SCIENCES↗

High-Throughput Statistical Interrogation of Mechanical Properties with Build Plate Location and Powder Reuse in AlSi10Mg

Abstract Additive manufacturing (AM) allows agile, rapid manufacturing of geometrically complex components that would otherwise be impossible through traditional manufacturing methods. With this maturing manufacturing technology comes the need to adopt testing methods that are commensurate with the speed of additive manufacturing and take advantage of its geometric flexibility. High-throughput tensile testing (HTT) is a technique that allows a large number of tensile bars to be tested in a short amount of time. In the present study, HTT is used to evaluate AM AlSi10Mg produced using powder bed fusion with a Renishaw AM250 machine. Three parameters were varied in this study: (1) powder reuse history, (2) location on the build plate, and (3) size of the tensile specimen. For all parameter combinations, at least 22 specimens were tested; in several cases, over 40 were tested. This large dataset, consisting of over 500 tensile tests, permits Weibull statistical analysis and provides sufficient fidelity to isolate subtle trends that would have likely been missed in smaller, traditional datasets. The observed trends are rationalized in terms of the role of porosity and surface crust on mechanical response.

Carroll, Jay D. (ORCID:0000000258184709)↗

Optimization of detection sensitivity for a Fiber Optic Intrusion Detection System (FOIDS) using design of experiments.

The Fiber Optic Intrusion Detection System (FOIDS)1 is a physical security sensor deployed on fence lines to detect climb or cut intrusions by adversaries. Calibration of detection sensitivity can be time consuming because, for example, the FiberSenSys FD-332 has 32 settings that can be adjusted independently to provide a balance between a high probability of detection and a low nuisance alarm rate. Therefore, an efficient method of calibrating the FOIDS in the field, other than by trial and error, was needed. This study was conducted to: x Identify the most significant settings for controlling detection x Develop a way of predicting detection sensitivity for given settings x Develop a set of optimal settings for validation The Design of Experiments (DoE) 2-4 methodology was used to generate small, planned test matrixes, which could be statistically analyzed to yield more information from the test data. Design of Experiments is a statistical methodology for quickly optimizing performance of systems with measurable input and output variables. DoE was used to design custom screening experiments based on 11 FOIDS settings believed to have the most affect on WKH types of fence perimeter intrusions were evaluated: simulated cut intrusions and actual climb intrusions. Two slightly different two-level randomized fractional factorial designed experiment matrixes consisting of 16 unique experiments were performed in the field for each type of intrusion. Three repetitions were conducted for every cut test; two repetitions were conducted for every climb test. Total number of cut tests analyzed was 51; the total number of climb tests was 38. This paper discusses the results and benefits of using Design of Experiments (DoE) to calibrate and optimize the settings for a FOIDS sensor

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A statistical investigation of the mass discrepancy–acceleration relation

We use the mass discrepancy–acceleration relation (the correlation between the ratio of total-to-visible mass and acceleration in galaxies; MDAR) to test the galaxy–halo connection. Here, we analyse the MDAR using a set of 16 statistics that quantify its four most important features: shape, scatter, the presence of a ‘characteristic acceleration scale’, and the correlation of its residuals with other galaxy properties. We construct an empirical framework for the galaxy–halo connection in LCDM to generate predictions for these statistics, starting with conventional correlations (halo abundance matching; AM) and introducing more where required. Comparing to the SPARC data, we find that: (1) the approximate shape of the MDAR is readily reproduced by AM, and there is no evidence that the acceleration at which dark matter becomes negligible has less spread in the data than in AM mocks; (2) even under conservative assumptions, AM significantly overpredicts the scatter in the relation and its normalization at low acceleration, and furthermore positions dark matter too close to galaxies’ centres on average; (3) the MDAR affords 2σ evidence for an anticorrelation of galaxy size and Hubble type with halo mass or concentration at fixed stellar mass. Lastly, our analysis lays the groundwork for a bottom-up determination of the galaxy–halo connection from relations such as the MDAR, provides concrete statistical tests for specific galaxy formation models, and brings into sharper focus the relative evidence accorded by galaxy kinematics to LCDM and modified gravity alternatives.

79 ASTRONOMY AND ASTROPHYSICS↗

Implementing and testing theoretical fission fragment yields in a Hauser-Feshbach statistical decay framework

Here, we implement fission fragment yields, calculated using Brownian shape-motion on a macroscopic-microscopic potential energy surface in six dimensions, into the Hauser-Feshbach statistical decay code CGMF. This combination allows us to test the impact of utilizing theoretically-calculated fission fragment yields on the subsequent prompt neutron and γ-ray emission. We draw connections between the fragment yields and the total kinetic energy TKE of the fission fragments and demonstrate that the use of calculated yields can introduce a difference in the $\langle$TKE$\rangle$ and, thus, the prompt neutron multiplicity v, as compared with experimental fragment yields. We deduce the uncertainty on the $\langle$TKE$\rangle$ and v from this procedure and identify possible applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

SU-E-T-558: Monte Carlo Photon Transport Simulations On GPU with Quadric Geometry

Purpose: Monte Carlo simulation on GPU has experienced rapid advancements over the past a few years and tremendous accelerations have been achieved. Yet existing packages were developed only in voxelized geometry. In some applications, e.g. radioactive seed modeling, simulations in more complicated geometry are needed. This abstract reports our initial efforts towards developing a quadric geometry module aiming at expanding the application scope of GPU-based MC simulations. Methods: We defined the simulation geometry consisting of a number of homogeneous bodies, each specified by its material composition and limiting surfaces characterized by quadric functions. A tree data structure was utilized to define geometric relationship between different bodies. We modified our GPU-based photon MC transport package to incorporate this geometry. Specifically, geometry parameters were loaded into GPU’s shared memory for fast access. Geometry functions were rewritten to enable the identification of the body that contains the current particle location via a fast searching algorithm based on the tree data structure. Results: We tested our package in an example problem of HDR-brachytherapy dose calculation for shielded cylinder. The dose under the quadric geometry and that under the voxelized geometry agreed in 94.2% of total voxels within 20% isodose line based on a statistical t-test (95% confidence level), where the reference dose was defined to be the one at 0.5cm away from the cylinder surface. It took 243sec to transport 100million source photons under this quadric geometry on an NVidia Titan GPU card. Compared with simulation time of 99.6sec in the voxelized geometry, including quadric geometry reduced efficiency due to the complicated geometry-related computations. Conclusion: Our GPU-based MC package has been extended to support photon transport simulation in quadric geometry. Satisfactory accuracy was observed with a reduced efficiency. Developments for charged particle transport in this geometry are currently in progress.

61 RADIATION PROTECTION AND DOSIMETRY↗

A multivariate approach to ensure statistical reproducibility of climate model simulations

Effective utilization of novel hybrid architectures of pre-exascale and exascale machines requires transformations to global climate modeling systems that may not reproduce the original model solution bit-for-bit. Round-off level differences grow rapidly in these non-linear and chaotic systems. This makes it difficult to isolate bugs/errors from innocuous growth expected from round-off level differences. Here, we apply two modern multivariate two sample equality of distribution tests to evaluate statistical reproducibility of global climate model simulations using standard monthly output of short (~ 1-year) simulation ensembles of a control model and a modified model of US Department of Energy's Energy Exascale Earth System Model (E3SM). Both the tests are able to identify changes induced by modifications to some model tuning parameters. We also conduct formal power analyses of the tests by applying them on designed suites of short simulation ensembles each with an increasingly different climate from the control ensemble. The results are compared against those from another such test. These power analyses provide a framework to quantify the degree of differences that can be detected confidently by the tests for a given ensemble size (sample size). This will allow model developers using the tests to make an informed decision when accepting/rejecting an unintentional non-bit-for-bit change to the model solution.

Mahajan, Salil↗