Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Statistical Requirements For Pass-Fail Testing Of Contraband Detection Systems

Contraband detection systems for homeland security applications are typically tested for probability of detection (PD) and probability of false alarm (PFA) using pass-fail testing protocols. Test protocols usually require specified values for PD and PFA to be demonstrated at a specified level of statistical confidence CL. Based on a recent more theoretical treatment of this subject [1], this summary reviews the definition of CL and provides formulas and spreadsheet functions for constructing tables of general test requirements and for determining the minimum number of tests required. The formulas and tables in this article may be generally applied to many other applications of pass-fail testing, in addition to testing of contraband detection systems.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Testing convolutional neural network based deep learning systems: a statistical metamorphic approach

Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.

Computer Science↗

Application of 'Six Sigma{sup TM}' and 'Design of Experiment' for Cementation - Recipe Development for Evaporator Concentrate for NPP Ling AO, Phase II (China) - 12555

Cementation of radioactive waste is a common technology. The waste is mixed with cement and water and forms a stable, solid block. The physical properties like compression strength or low leach ability depends strongly on the cement recipe. Due to the fact that this waste cement mixture has to fulfill special requirements, a recipe development is necessary. The Six Sigma{sup TM}' DMAIC methodology, together with the Design of experiment (DoE) approach, was employed to optimize the process of a recipe development for cementation at the Ling Ao nuclear power plant (NPP) in China. The DMAIC offers a structured, systematical and traceable process to derive test parameters. The DoE test plans and statistical analysis is efficient regarding the amount of test runs and the benefit gain by getting a transfer function. A transfer function enables simulation which is useful to optimize the later process and being responsive to changes. The DoE method was successfully applied for developing a cementation recipe for both evaporator concentrate and resin waste in the plant. The key input parameters were determined, evaluated and the control of these parameters were included into the design. The applied Six Sigma{sup TM} tools can help to organize the thinking during the engineering process. Data are organized and clearly presented. Various variables can be limited to the most important ones. The Six Sigma{sup TM} tools help to make the thinking and decision process trace able. The tools can help to make data driven decisions (e.g. C and E Matrix). But the tools are not the only golden way. Results from scoring tools like the C and E Matrix need close review before using them. The DoE is an effective tool for generating test plans. DoE can be used with a small number of tests runs, but gives a valuable result from an engineering perspective in terms of a transfer function. The DoE prediction results, however, are only valid in the tested area. So a careful selection of input parameter and their limits for setting up a DoE is very important. An extrapolation of results is not recommended because the results are not reliable out of the tested area. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Statistical analysis of an inter-laboratory comparison of small-scale safety and thermal testing of RDX

In this study, the Integrated Data Collection Analysis (IDCA) program has conducted a proficiency test for small-scale safety and thermal (SSST) testing of homemade explosives (HMEs). Described here are statistical analyses of the results from this test for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Class 5 Type II standard. The material was tested as a well-characterized standard several times during the proficiency test to assess differences among participants and the range of results that may arise for well-behaved explosive materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An assessment of total depletion uncertainties for a GBC-32 dry storage cask with PLUS7 fuels using Monte Carlo sampling and two-way ANOVA F-test

It is important to accurately evaluate depletion uncertainties that exist due to the limitations of a computer code on accuracy in a nuclear depletion calculation for criticality safety analysis. In this work, the bias and bias uncertainty in the effective neutron multiplication factor (k{sub eff}) for the generic 32 PWR-assembly burnup credit (GBC-32) cask system were assessed using the Monte Carlo uncertainty sampling method for three different burnups and the isotopic biases and uncertainties obtained with the calculated and measured isotopic concentrations. The PLUS7 used nuclear fuel assemblies discharged from the Hanbit Nuclear Power Plant Unit 3 were assumed to be loaded into the GBC-32 cask. In addition, the statistical F-test in the two-way analysis of variance (ANOVA) was suggested to efficiently estimate the statistically converged total depletion uncertainty in k{sub eff}, with a significant reduction of computing efforts in the Monte Carlo criticality calculations, and it was applied to the GBC-32 cask system after a sensitivity analysis was performed to select the important nuclides having significant contributions to the total depletion uncertainty. With the statistical F-tests in the two-way ANOVA, 100 criticality calculations were needed to get a statistically converged total depletion uncertainty for 10 and 30 GWD/MTU, while 120 criticality calculations were needed for 50 GWD/MTU. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-E-J-261: Statistical Analysis and Chaotic Dynamics of Respiratory Signal of Patients in BodyFix

Purpose: To quantify respiratory signal of patients in BodyFix undergoing 4DCT scan with and without immobilization cover. Methods: 20 pairs of respiratory tracks recorded with RPM system during 4DCT scan were analyzed. Descriptive statistic was applied to selected parameters of exhale-inhale decomposition. Standardized signals were used with the delay method to build orbits in embedded space. Nonlinear behavior was tested with surrogate data. Sample entropy SE, Lempel-Ziv complexity LZC and the largest Lyapunov exponents LLE were compared. Results: Statistical tests show difference between scans for inspiration time and its variability, which is bigger for scans without cover. The same is for variability of the end of exhalation and inhalation. Other parameters fail to show the difference. For both scans respiratory signals show determinism and nonlinear stationarity. Statistical test on surrogate data reveals their nonlinearity. LLEs show signals chaotic nature and its correlation with breathing period and its embedding delay time. SE, LZC and LLE measure respiratory signal complexity. Nonlinear characteristics do not differ between scans. Conclusion: Contrary to expectation cover applied to patients in BodyFix appears to have limited effect on signal parameters. Analysis based on trajectories of delay vectors shows respiratory system nonlinear character and its sensitive dependence on initial conditions. Reproducibility of respiratory signal can be evaluated with measures of signal complexity and its predictability window. Longer respiratory period is conducive for signal reproducibility as shown by these gauges. Statistical independence of the exhale and inhale times is also supported by the magnitude of LLE. The nonlinear parameters seem more appropriate to gauge respiratory signal complexity since its deterministic chaotic nature. It contrasts with measures based on harmonic analysis that are blind for nonlinear features. Dynamics of breathing, so crucial for 4D-based clinical technologies, can be better controlled if nonlinear-based methodology, which reflects respiration characteristic, is applied. Funding provided by Varian Medical Systems via Investigator Initiated Research Project.

60 APPLIED LIFE SCIENCES↗

Develop and Manufacture an Ergonomically Sound Glovebox Glove Report

Ergonomic injury and radiation exposure are two safety concerns for the Plutonium Facility at Los Alamos National Laboratory (LANL). This facility employs the largest number of gloveboxes (GB) at LANL with approximately 6000 gloves installed. The current GB glove design dates back to the 1960’s and is not based on true hand anatomy, revealing several issues: short fingers, inappropriate length from the wrist to finger webbing, nonexistent joint angles and incorrect thumb placement. These design flaws are directly related to elbow (lateral epicondylitis) and thumb (DeQuervain’s tenosynovitis) injuries. The current design also contributes to increased wear on the glove, causing unplanned glove openings (failures) which places workers at risk of exposure. An improved glovebox glove design has three significant benefits: 1) it will reduce the risk of injury, 2) it will improve comfort and productivity, and 3) it will reduce the risk of a glovebox failures. The combination of these three benefits has estimated savings of several million dollars. The new glove design incorporated the varied physical attributes of workers ranging from the 5 th percentile female to the 95th percentile male. Anthropometric hand dimensions along with current GB worker dimensions were used to develop the most comprehensive design specifications for the new glove. Collaboration with orthopedic hand surgeons also provided major contributtions to the design. The new glovebox glove was developed and manufactured incorporating over forty dimensions producing the most comprehensive ergonomically sound design. The new design received a LANL patent (patent attorney docket No: LANS 36USD1 “Protective Glove”, one of 20 highest patents awarded by the Richard P. Feynman Center for Innovation. The glove dimensions were inputed into a solid works model which was used to produce molds. The molds were then shipped to a glove manufacturer for production of the new glovebox gloves. The new glovebox gloves were tested against the presently used glovebox gloves for design validity. The testing included a subjective survey and four dexterity tests. The prototype was statistically significant in 3 dexterity tests and favorable on 8 out of 10 survey questions. The more ergonomically sound glovebox glove will improve worker comfort, mitigate glovebox worker injuries, and reduce glove breaches.

42 ENGINEERING↗

MATRIX 1 RESULTS OF THE FY07 ENHANCED DOE HIGH-LEVEL WASTE MELTER THROUGHPUT STUDIES AT SRNL

High-level waste (HLW) throughput (i.e., the amount of waste processed per unit time) is a function of two critical parameters: waste loading (WL) and melt rate. For the Waste Treatment and Immobilization Plant (WTP) at the Hanford Site and the Defense Waste Processing Facility (DWPF) at the Savannah River Site (SRS), increasing HLW throughput would significantly reduce the overall mission life cycle costs for the Department of Energy (DOE). It has been proposed that a team of glass formulation and processing experts at the Pacific Northwest National Laboratory (PNNL), Savannah River National Laboratory (SRNL), and Vitreous State Laboratory (VSL) at Catholic University of America develop a systematic approach to increase HLW throughput (by increasing WL with minimal or positive impacts on melt rate). Programmatically, this task is aimed at proof-of-principle testing and the development of tools to improve waste loading and melt rate, which will lead to higher waste throughput. The following four specific tasks have been proposed to meet this programmatic objective: (1) Integration and Oversight, (2) Crystal Accumulation Modeling (led by PNNL)/Higher Waste Loading Glasses (led by SRNL), (3) Melt Rate Evaluation and Modeling, and (4) Melter Scale Demonstrations. The details of these tasks can be found in the associated task plan WSRC-STI-2007-00483. The current study is focused on Task 2 (crystal accumulation modeling and higher waste loading glasses) and involves glass formulation and physical property testing by both PNNL and SRNL (as defined in the PNNL and SRNL test plans). The intent of this report is to document the chemical composition and Product Consistency Test (PCT) results and statistical analysis of PNNL's Test Matrix 1 glasses. Note that this document is only a compilation of the data collected by SRNL for PNNL's glasses in support of this task and no conclusions will be drawn.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Probing the role of solids loading and mix procedure on the properties of acoustically mixed materials for additive manufacturing

We report resonant acoustic mixing has been of particular interest for use in additive manufacturing since viscous, solids-loaded materials can be difficult to mix and inhomogeneity has adverse effects on print quality. In this study, we detail a method to iterate through different formulations and mix procedures and assess mixture quality. The approach utilizes a constant pressure-driven flow test to collect statistics on flow rate through a standard geometry. This test is first applied to well mixed formulations containing particulate solids and find that the results are sensitive to viscosity produced by solids content. We then consider the formulations at various stages of mixing and find that the spread in the volume measurements is indicative of the mixing quality; poorly mixed material yields measurements with wide distributions. We believe this testing approach can be useful when screening new formulations, developing mixing processes, or for quality control.

36 MATERIALS SCIENCE↗

Lumen Maintenance Testing of the Philips 60-Watt Replacement Lamp L Prize Entry

This paper describes testing conducted to evaluate the Philips' L Prize award winning 60-watt LED replacement product's ability to meet the lifetime/lumen maintenance requirement of the competition, which was: "having 70 percent of the lumen value under subparagraph (A) [producing a luminous flux greater than 900 lumens] exceeding 25,000 hours under typical conditions expected in residential use." A custom test apparatus was designed and constructed for this testing and a statistical approach was developed for use in evaluating the test results. This will be the only publicly available, third-party data set of long-term LED product operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

TESTING MODELS OF MAGNETIC FIELD EVOLUTION OF NEUTRON STARS WITH THE STATISTICAL PROPERTIES OF THEIR SPIN EVOLUTIONS

We test models for the evolution of neutron star (NS) magnetic fields (B). Our model for the evolution of the NS spin is taken from an analysis of pulsar timing noise presented by Hobbs et al.. We first test the standard model of a pulsar's magnetosphere in which B does not change with time and magnetic dipole radiation is assumed to dominate the pulsar's spin-down. We find that this model fails to predict both the magnitudes and signs of the second derivatives of the spin frequencies ({nu}-double dot). We then construct a phenomenological model of the evolution of B, which contains a long-term decay (LTD) modulated by short-term oscillations; a pulsar's spin is thus modified by its B-evolution. We find that an exponential LTD is not favored by the observed statistical properties of {nu}-double dot for young pulsars and fails to explain the fact that {nu}-double dot is negative for roughly half of the old pulsars. A simple power-law LTD can explain all the observed statistical properties of {nu}-double dot. Finally, we discuss some physical implications of our results to models of the B-decay of NSs and suggest reliable determination of the true ages of many young NSs is needed, in order to constrain further the physical mechanisms of their B-decay. Our model can be further tested with the measured evolutions of {nu}-dot and {nu}-double dot for an individual pulsar; the decay index, oscillation amplitude, and period can also be determined this way for the pulsar.

79 ASTRONOMY AND ASTROPHYSICS↗

A STATISTICAL METHOD FOR MEASURING THE GALACTIC POTENTIAL AND TESTING GRAVITY WITH COLD TIDAL STREAMS

We introduce the Minimum Entropy Method, a simple statistical technique for constraining the Milky Way gravitational potential and simultaneously testing different gravity theories directly from 6D phase-space surveys and without adopting dynamical models. We demonstrate that orbital energy distributions that are separable (i.e., independent of position) have an associated entropy that increases under wrong assumptions about the gravitational potential and/or gravity theory. Of known objects, 'cold' tidal streams from low-mass progenitors follow orbital distributions that most nearly satisfy the condition of separability. Although the orbits of tidally stripped stars are perturbed by the progenitor's self-gravity, systematic variations of the energy distribution can be quantified in terms of the cross-entropy of individual tails, giving further sensitivity to theoretical biases in the host potential. The feasibility of using the Minimum Entropy Method to test a wide range of gravity theories is illustrated by evolving restricted N-body models in a Newtonian potential and examining the changes in entropy introduced by Dirac, MONDian, and f(R) gravity modifications.

79 ASTRONOMY AND ASTROPHYSICS↗

Chaotic vibrations of the duffing system with fractional damping

We examined the Duffing system with a fractional damping term. Calculating the basins of attraction, we demonstrate a broad spectrum of non-linear behaviour connected with sensitivity to the initial conditions and chaos. To quantify dynamical response of the system, we propose the statistical 0-1 test as well as the maximal Lyapunov exponent; the application of the latter encounter a few difficulties because of the memory effect due to the fractional derivative. The results are confirmed by bifurcation diagrams, phase portraits, and Poincaré sections.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On the reliability of microvariability tests in quasars

Microvariations probe the physics and internal structure of quasars. Unpredictability and small flux variations make this phenomenon elusive and difficult to detect. Variance-based probes such as the C and F tests, or a combination of both, are popular methods to compare the light curves of the quasar and a comparison star. Recently, detection claims in some studies have depended on the agreement of the results of the C and F tests, or of two instances of the F-test, for rejecting the non-variation null hypothesis. However, the C-test is a non-reliable statistical procedure, the F-test is not robust, and the combination of tests with concurrent results is anything but a straightforward methodology. A priori power analysis calculations and post hoc analysis of Monte Carlo simulations show excellent agreement for the analysis of variance test to detect microvariations as well as the limitations of the F-test. Additionally, the combined tests yield correlated probabilities that make the assessment of statistical significance unworkable. However, it is possible to include data from several field stars to enhance the power in a single F-test, increasing the reliability of the statistical analysis. This would be the preferred methodology when several comparison stars are available. An example using two stars and the enhanced F-test is presented. These results show the importance of using adequate methodologies and avoiding inappropriate procedures that can jeopardize microvariability detections. Power analysis and Monte Carlo simulations are useful tools for research planning, as they can demonstrate the robustness and reliability of different research approaches.

79 ASTRONOMY AND ASTROPHYSICS↗

Statistical Validation of Normal Tissue Complication Probability Models

Purpose: To investigate the applicability and value of double cross-validation and permutation tests as established statistical approaches in the validation of normal tissue complication probability (NTCP) models. Methods and Materials: A penalized regression method, LASSO (least absolute shrinkage and selection operator), was used to build NTCP models for xerostomia after radiation therapy treatment of head-and-neck cancer. Model assessment was based on the likelihood function and the area under the receiver operating characteristic curve. Results: Repeated double cross-validation showed the uncertainty and instability of the NTCP models and indicated that the statistical significance of model performance can be obtained by permutation testing. Conclusion: Repeated double cross-validation and permutation tests are recommended to validate NTCP models before clinical use.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Overall Performance Losses and Activated Mechanisms in Double Glass and Glass-backsheet Photovoltaic Modules with Monofacial and Bifacial PERC Cells, under Accelerated Exposures

Commercial PV modules have various packaging choices nowadays, which influence their long-term reliability. This study compared the degradation behaviors of sixteen module variants from two brands with varying encapsulant materials (EVA or POE), encapsulant types, module architectures (GB or DG), and cell types (monofacial or bifacial) using null hypothesis testing to determine statistical significant findings. The modules were exposed for 2,520 hours under two accelerated exposures: modified damp heat (mDH) and modified damp heat with full-spectrum light (mDH+FSL). For both brands, two DG module variants with UV-Cutoff rear encapsulant are found to have significantly lower average power loss than the module variants of EVA+GB with opaque rear encapsulant after each accelerated exposure. Metallization interconnect corrosion is identified as the primary degradation mechanism. Furthermore, unsupervised hierarchical clustering finds that the degradation behaviors of modules from one brand with a more strict manufacturing quality control depends on module architectures only.

14 SOLAR ENERGY↗

Significant Association between Sulfate-Reducing Bacteria and Uranium-Reducing Microbial Communities as Revealed by a Combined Massively Parallel Sequencing-Indicator Species Approach

Massively parallel sequencing has provided a more affordable and high-throughput method to study microbial communities, although it has mostly been used in an exploratory fashion. We combined pyrosequencing with a strict indicator species statistical analysis to test if bacteria specifically responded to ethanol injection that successfully promoted dissimilatory uranium(VI) reduction in the subsurface of a uranium contamination plume at the Oak Ridge Field Research Center in Tennessee. Remediation was achieved with a hydraulic flow control consisting of an inner loop, where ethanol was injected, and an outer loop for flow-field protection. This strategy reduced uranium concentrations in groundwater to levels below 0.126 M and created geochemical gradients in electron donors from the inner-loop injection well toward the outer loop and downgradient flow path. Our analysis with 15 sediment samples from the entire test area found significant indicator species that showed a high degree of adaptation to the three different hydrochemical-created conditions. Castellaniella and Rhodanobacter characterized areas with low pH, heavy metals, and low bioactivity, while sulfate-, Fe(III)-, and U(VI)-reducing bacteria (Desulfovibrio, Anaeromyxobacter, and Desulfosporosinus) were indicators of areas where U(VI) reduction occurred. The abundance of these bacteria, as well as the Fe(III) and U(VI) reducer Geobacter, correlated with the hydraulic connectivity to the substrate injection site, suggesting that the selected populations were a direct response to electron donor addition by the groundwater flow path. A false-discovery-rate approach was implemented to discard false-positive results by chance, given the large amount of data compared.

54 ENVIRONMENTAL SCIENCES↗

Statistical chronometry of meteorites. I. A Test of 26 Al homogeneity and the Pb-Pb age of the solar system’s $t=0$

Here, we use rapidly cooled achondrites to test the assumption of 26 Al homogeneity in the solar nebula, by checking if there is a single value of t SS , the absolute “Pb-Pb” age of the Solar System’s t=0, that makes concordant their ages from the Al-Mg and Pb-Pb systems. We find that values t SS =4568.42 ± 0.24 Myr do make these ages concordant, and therefore the hypothesis of homogeneous 26 Al is not falsified. This age, defined to be when the solar nebula had ( 26 Al/ 27 Al) = 5.23 × 10 –5 , is significantly older than the ≈ 4567.3 Myr inferred from direct measurements of Pb-Pb ages in CAIs. Discrepancies between the Al-Mg and Pb-Pb chronometers in chondrules and CAIs have previously been interpreted as arising from heterogeneities in 26 Al, under the presumption that the Al-Mg and Pb-Pb systems in CAIs closed simultaneously. We examine this assumption and show that resetting is to be expected in CAIs. In particular, we quantitatively demonstrate that it is plausible that Pb-Pb ages of CAIs were reset at late times, without resetting the earlier Al-Mg ages, if they were transiently heated in the same manner as chondrules. We critically examine Pb-Pb isochrons, refining data and suggesting best practices for their calculation and reporting. We advocate reporting chronometry as times of formation after t=0 rather than absolute ages, as only the former is useful for astrophysical models of the solar nebula. We advocate averaging of multiple samples, rather than anchoring to individual meteorites, to improve precision.

79 ASTRONOMY AND ASTROPHYSICS↗