Comparison of Multiple Statistical Methods for Calculating the Probability of Detection from SHM Systems.
Abstract not provided.
Roach, Dennis P.↗
SEARCH · Search NASA
Results for “Methods:statistical”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Novel Statistical Method to Quantify Uncertainties Associated with Mineral Dissolution and Precipitation Modeling under Geologic Carbon Storage Conditions
Presented by NETL at American Chemical Society Fall Meeting, 08/16
Zhang, Liwei↗
Statistical Methods used in the Born Qualified LDRD Project.
Abstract not provided.
Swiler, Laura Painton↗
Shell Model Methods, Statistical Nuclear Reactions, and Beta-delayed Neutron Emission
Explore the source record for details and available documents.
Physics - Nuclear physics and radiation physics↗
Statistical Methods for Developing Cybersecurity Response Thresholds for Operational Technology Using Historical Data
Explore the source record for details and available documents.
Grady, John Connor↗
To have value, comparisons of high-throughput phenotyping methods need statistical tests of bias and variance
The gap between genomics and phenomics is narrowing. The rate at which it is narrowing, however, is being slowed by improper statistical comparison of methods. Quantification using Pearson’s correlation coefficient ( r ) is commonly used to assess method quality, but it is an often misleading statistic for this purpose as it is unable to provide information about the relative quality of two methods. Using r can both erroneously discount methods that are inherently more precise and validate methods that are less accurate. These errors occur because of logical flaws inherent in the use of r when comparing methods, not as a problem of limited sample size or the unavoidable possibility of a type I error. A popular alternative to using r is to measure the limits of agreement (LOA). However both r and LOA fail to identify which instrument is more or less variable than the other and can lead to incorrect conclusions about method quality. An alternative approach, comparing variances of methods, requires repeated measurements of the same subject, but avoids incorrect conclusions. Variance comparison is arguably the most important component of method validation and, thus, when repeated measurements are possible, variance comparison provides considerable value to these studies. Statistical tests to compare variances presented here are well established, easy to interpret and ubiquitously available. The widespread use of r has potentially led to numerous incorrect conclusions about method quality, hampering development, and the approach described here would be useful to advance high throughput phenotyping methods but can also extend into any branch of science. The adoption of the statistical techniques outlined in this paper will help speed the adoption of new high throughput phenotyping techniques by indicating when one should reject a new method, outright replace an old method or conditionally use a new method.
59 BASIC BIOLOGICAL SCIENCES↗
Review of rotating wing dynamic stall: Experiments and flow control
Dynamic stall has been a technical challenge and a fluid dynamical subject of interest for more than fifty years; but in the last decade significant advances have been made in the understanding, prediction, modeling, and control of dynamic stall on rotors. This paper provides a summary of the state of the art of dynamic stall experiments and future directions in the understanding of dynamic stall on rotors. Experimental data sets are discussed, as well the direction of future research for control of dynamic stall. Coordinated testing between airfoils and rotating blades, as well as close integration between computational and experimental studies were found to be productive approaches. Advanced analysis methods, including statistical methods, modal representations, and artificial intelligence methods have led to significant advances in the understanding of dynamic stall. Investigations of dynamic stall control devices have allowed many useful targeted investigations of the transition to separated flow, but have not yet resulted in a commercially implemented device.
42 ENGINEERING↗
Testing convolutional neural network based deep learning systems: a statistical metamorphic approach
Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.
Computer Science↗
Using the Monte Carlo Method to Evaluate the Reliability of Screening Multifamily Housing for Radon
When screening for radon in a multifamily housing complex using a fixed sample density (e.g., testing 1 in 10 (10%) or 1 in 4 units (25%)), the statistical confidence is dependent upon the assumed elevated radon frequency. For example, testing 25% of units in a complex estimated to have eight units with elevated radon levels will provide 90% confidence. However, if it is assumed that, in the same complex, there are only three units with elevated radon levels, the confidence drops to around 58% for the same sample density. Furthermore, in the previous example, if elevated radon levels are not found during the screening, all that can be stated is that the screening provides 90% confidence that there are no more than seven units in the complex with elevated radon levels. To more fully illustrate this uncertainty, ten separate multifamily housing radon data sets with 1 to 10 units with radon levels ≥4 pCi/L (Table 1) were selected for analysis using the Monte Carlo statistical method. Unlike other mathematically based statistical approaches, the Monte Carlo statistical method relies on repeated analysis of randomly selected data. from a 100% sampled complex at various sample densities. Success for each simulation is defined as finding at least one unit with elevated radon levels. In this statistical method, confidence in the overarching conclusion can be greatly enhanced by repeating the simulated screening hundreds or even thousands of times. For this study, each of the ten data sets was simulated 1,000 times. For each simulation, the data set was randomized three times before the fixed percentage of data was selected.
38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
Output power fluctuations due to different weights of macro particles used in particle-in-cell simulations of Cerenkov devices
The output power fluctuations caused by weights of macro particles used in particle-in-cell (PIC) simulations of a backward wave oscillator and a travelling wave tube are statistically analyzed. It is found that the velocities of electrons passed a specific slow-wave structure form a specific electron velocity distribution. The electron velocity distribution obtained in PIC simulation with a relative small weight of macro particles is considered as an initial distribution. By analyzing this initial distribution with a statistical method, the estimations of the output power fluctuations caused by different weights of macro particles are obtained. The statistical method is verified by comparing the estimations with the simulation results. The fluctuations become stronger with increasing weight of macro particles, which can also be determined reversely from estimations of the output power fluctuations. With the weights of macro particles optimized by the statistical method, the output power fluctuations in PIC simulations are relatively small and acceptable.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Adding ($\mathcal{α}$,n) Emission to an Existing Subcritical Benchmark Statistical Uncertainty Method
Subcritical measurements often use radiation detectors to infer parameters related to the physics of a measured system. One type of subcritical measurements typically performed are called neutron noise measurements. These types of measurements utilize the fact that prompt neutrons are produced from fission immediately after a fission event and are therefore correlated in time. Subcritical benchmarks require evaluation of the statistical and systematic uncertainties of a measurement. Previous work established methods for determining statistical and systematic uncertainties in subcritical benchmarks. The data were analyzed using the Hage-Cifarelli formalism of the Feynman Variance-to-Mean method. The previous work made an assumption that the ($\mathcal{α}$,n) emission rate was negligible. This assumption was used because the previous work focused on systems with metal Plutonium. This work extends the existing statistical uncertainty method to include ($\mathcal{α}$,n) emissions.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Evaluation of the Large-Scale and Regional Climatic Response Across North Africa to Natural Variability in Oceanic Modes and Terrestrial Vegetation Among the CMIP5 Models
Hydrologic variability is a serious threat to the poverty-stricken regions of North Africa. Meanwhile, the scientific community struggles to attribute these extreme climatic episodes to specific oceanic and land drivers. Prior modeling studies have not assessed simulated feedbacks over North Africa against an established observational benchmark, so their results are considered as untested, model-specific findings. The Coupled Model Intercomparison Project Phase Five (CMIP5) archive represents the state-of-the-art in climate projections, with most CMIP5 models now containing interactive vegetation phenology; however, there have been no studies to date of their simulated vegetation feedbacks. The capability of CMIP5 models at accurately simulating the forcing of both sea-surface temperature (SST) and regional leaf area index (LAI) anomalies on North African climate needs to be a key consideration in assessing the models’ overall credibility and determining appropriate model weighting for developing climate projections. The Generalized Equilibrium Feedback Assessment (GEFA) is a promising statistical method, which can be applied to either model output or observations, for isolating the local and remote impacts of individual oceanic or terrestrial forcings on regional climate. We performed a combined observational and modeling assessment of land-ocean-atmosphere interactions across the distinct ecological and moisture gradients of North Africa. We evaluated and demonstrated the reliability of the GEFA statistical method over North Africa using the Community Earth System Model (CESM), applied GEFA to observational data to quantify the observed forcing of ocean basin SST anomalies and regional LAI anomalies on North African climate, evaluated the CMIP5 models’ performance in terms of representing these key observed feedbacks, and formulated CMIP5 feedback performance metrics for weighting North African climate projections. Our study represented the first attempt to separate the observed roles of oceanic and vegetation feedbacks across North Africa, the first systematic assessment and intercomparison of land-ocean-atmosphere feedbacks in CMIP5, and the first exploration of vegetation feedbacks among CMIP5 models. The following work was accomplished. (1) The team generated 14 scientific publications and 30 presentations based on the DOE-funded research. (2) A stepwise version of the GEFA statistical method was developed in which unimportant forcings were dropped to increase the reliability of the results. (3) SGEFA was successfully validated through experiments with CESM in terms of its ability to isolate the atmospheric responses to individual oceanic or land forcings. (4) Observational evidence was revealed for the Sahel’s positive vegetation-rainfall feedback on the seasonal to interannual time scale, and it was attributed to a moisture recycling mechanism rather than an albedo mechanism. (5) An approach with SGEFA was developed in which the individual contributions of soil moisture versus vegetation forcings could be separated, revealing that the former forcing outweighed the latter for sub-Saharan Africa. (6) Tropical ocean temperatures were found to be key regulators of pan-tropical vegetation variability, especially for arid and semi-arid regions, including sub-Saharan Africa. (7) The CMIP5 models largely underestimated the importance of land feedbacks across the Sahel. (8) The general consensus among CMIP5 models indicates, for the late 21st century, a diminished seasonal predictability of sub-Saharan African regional climate and an elevated role of the land surface compared to oceanic drivers in regulating regional climate variability. (9) Land-ocean-atmosphere interactions were demonstrated to be key contributors to the seasonal predictability of African wildfire activity. (10) The El Djouf was determined to be of greater importance than the Bodélé depression in terms of providing trans-Atlantic dust transport to the Americas.
54 ENVIRONMENTAL SCIENCES↗
Bootstrap inversion technique for atmospheric trace gas source detection and quantification using long open-path laser measurements
Advances in natural gas extraction technology have led to increased activity in the production and transport sectors in the United States and, as a consequence, an increased need for reliable monitoring of methane leaks to the atmosphere. We present a statistical methodology in combination with an observing system for the detection and attribution of fugitive emissions of methane from distributed potential source location landscapes such as natural gas production sites. We measure long (> 500 m), integrated open-path concentrations of atmospheric methane using a dual frequency comb spectrometer and combine measurements with an atmospheric transport model to infer leak locations and strengths using a novel statistical method, the non-zero minimum bootstrap (NZMB). The new statistical method allows us to determine whether the empirical distribution of possible source strengths for a given location excludes zero. Using this information, we identify leaking source locations (i.e., natural gas wells) through rejection of the null hypothesis that the source is not leaking. The method is tested with a series of synthetic data inversions with varying measurement density and varying levels of model–data mismatch. It is also tested with field observations of (1) a non-leaking source location and (2) a source location where a controlled emission of 3.1 × 10 -5 kg s -1 of methane gas is released over a period of several hours. This series of synthetic data tests and outdoor field observations using a controlled methane release demonstrates the viability of the approach for the detection and sizing of very small leaks of methane across large distances (4 + km 2 in synthetic tests). The field tests demonstrate the ability to attribute small atmospheric enhancements of 17 ppb to the emitting source location against a background of combined atmospheric (e.g., background methane variability) and measurement uncertainty of 5 ppb (1 σ ), when measurements are averaged over 2 min. The results of the synthetic and field data testing show that the new observing system and statistical approach greatly decreases the incidence of false alarms (that is, wrongly identifying a well site to be leaking) compared with the same tests that do not use the NZMB approach and therefore offers increased leak detection and sizing capabilities.
03 NATURAL GAS↗
Causal relationships of vegetation productivity with root zone water availability and atmospheric dryness at the catchment scale
Abstract. This study explores the causal relationships between catchment water availability, vapor pressure deficit, and gross primary productivity (GPP) across 341 catchments in the contiguous US. Seasonal climatic, hydrological, and vegetation characteristics were represented using the Horton index, ecological aridity index, evaporative fraction index, and carbon uptake efficiency. Statistical methods, including circularity statistics, correlation analysis, and causality tests, were employed to determine the complex interactions between catchment wetness, atmospheric dryness, and vegetation carbon uptake. The results revealed a maximum lag of 2 months in the intra-annual variability of catchment water supply–productivity and atmospheric water demand–productivity relationships, with hysteresis patterns varying with the catchment's hydrological characteristics. In catchments not permanently under water-limited or energy-limited conditions, vegetation experiences hydrological stress during the peak growing period, coinciding with the highest gross primary productivity and carbon uptake efficiency being out of phase with the Horton index and in phase with the evaporative fraction index. Causality analysis highlights strong temporal continuity in GPP seasonal characteristics, with a cause–effect relationship between catchment water supply, atmospheric demand, and vegetation productivity spanning a maximum of 2 months. These findings underscore the need for a comprehensive functional framework that integrates catchment water supply, atmospheric demand, and vegetation productivity to enhance our understanding and predictive capabilities with regard to ecosystem responses to climate change.
54 ENVIRONMENTAL SCIENCES↗
Comparisons of Wilks’ and Monte Carlo Methods in Response to the 10CFR50.46(c) Proposed Rulemaking
The Nuclear Regulatory Commission (NRC) is proposing a new rulemaking on emergency core system/loss-of-coolant accident (LOCA) performance analysis. In the proposed rulemaking, designated as 10CFR50.46(c), the US NRC put forward an equivalent cladding oxidation criterion as a function of cladding pre-transient hydrogen content. The proposed rulemaking imposes more restrictive and burnup-dependent cladding embrittlement criteria; consequently nearly all the fuel rods in a reactor core need to be analyzed under LOCA conditions to demonstrate compliance to the safety limits. New analysis methods are required to provide a thorough characterization of the reactor core in order to identify the locations of the limiting rods as well as to quantify the safety margins under LOCA conditions. With the new analysis method presented in this work, the limiting transient case and the limiting rods can be easily identified to quantify the safety margins in response to the proposed new rulemaking. In this work, the best-estimate plus uncertainty (BEPU) analysis capability for large break LOCA with the new cladding embrittlement criteria using the RELAP5-3D code is established and demonstrated with a reduced set of uncertainty parameters. Both the direct Monte Carlo method and the Wilks’ nonparametric statistical method can be used to perform uncertainty quantification. Wilks’ method has become the de-facto industry standard to perform uncertainty quantification in BEPU LOCA analyses. Despite its widespread adoption by the industry, the use of small sample sizes to infer statement of compliance to the existing 10CFR50.46 rule, has been a major cause of unrealized operational margin in today’s BEPU methods. Moreover the debate on the proper interpretation of the Wilks’ theorem in the context of safety analyses is not fully resolved yet, even more than two decades after its introduction in the frame of safety analyses in the nuclear industry. This represents both a regulatory and application risk in rolling out new methods. With the 10CFR50.46(c) proposed rulemaking, the deficiencies of the Wilks’ approach are further exacerbated. The direct Monte Carlo approach offers a robust alternative to perform uncertainty quantification within the context of BEPU analyses. In this work, the Monte Carlo method is compared with the Wilks’ method in response to the NRC 10CFR50.46(c) proposed rulemaking.
10CFR50.46(c)↗
Guide to Using Onionskin Analysis Code (U)
This document is a guide to using R-code written for the purpose of analyzing onionskin experiments. We expect the user to be very familiar with statistical methods and the R programming language. For more details about onionskin experiments and the statistical methods mentioned in this document see Storlie, Fugate, et al. (2013). Engineers at LANL experiment with detonators and high explosives to assess performance. The experimental unit, called an onionskin, is a hemisphere consisting of a detonator and a booster pellet surrounded by explosive material. When the detonator explodes, a streak camera mounted above the pole of the hemisphere records when the shock wave arrives at the surface. The output from the camera is a two-dimensional image that is transformed into a curve that shows the arrival time as a function of polar angle. The statistical challenge is to characterize a baseline population of arrival time curves and to compare the baseline curves to curves from a new, so-called, test series. The hope is that the new test series of curves is statistically similar to the baseline population.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
Probing the Spin Structure of the Proton Using Polarized Proton-Proton Collisions and the Production of W Bosons
This thesis discusses the process of extracting the longitudinal asymmetry, A$W±\atop{L}$ describing W → μ production in forward kinematic regimes. This asymmetry is used to constrain our understanding of the polarized parton distribution functions characterizing $\bar{u}$ and $\bar{d}$ sea quarks in the proton. This asymmetry will be used to constrain the overall contribution of the sea-quarks to the total proton spin. The asymmetry is evaluated over the pseudorapidity range of the PHENIX Muon Arms, 2.1 < |η| 2.6, for longitudinally polarized proton-proton collisions at 510 GeV √s. In particular, I will discuss the statistical methods used to characterize real muonic W decays and the various background processes is presented, including a discussion of likelihood event selection and the Extended Unbinned Maximum Likelihood t. These statistical methods serve estimate the yields of W muonic decays, which are used to calculate the longitudinal asymmetry.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗