Search NASA⌕ Search

SEARCH · Search NASA

Results for “detection probability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Optimizing Probability of Detection Point Estimate Demonstration

Probability of detection (POD) analysis is used in assessing reliably detectable flaw size in nondestructive evaluation (NDE). MIL-HDBK-18231and associated mh18232POD software gives most common methods of POD analysis. Real flaws such as cracks and crack-like flaws are desired to be detected using these NDE methods. A reliably detectable crack size is required for safe life analysis of fracture critical parts. The paper provides discussion on optimizing probability of detection (POD) demonstration experiments using Point Estimate Method. POD Point estimate method is used by NASA for qualifying special NDE procedures. The point estimate method uses binomial distribution for probability density. Normally, a set of 29 flaws of same size within some tolerance are used in the demonstration. The optimization is performed to provide acceptable value for probability of passing demonstration (PPD) and achieving acceptable value for probability of false (POF) calls while keeping the flaw sizes in the set as small as possible.

Koshti, Ajay M.↗
DOE OSTI2022

Projected network performance for next-generation xenon monitoring systems

Next-generation radioxenon monitoring systems are reaching maturity and are expected to improve certain aspects of performance in verifying the absence of nuclear tests. To predict the improvement in detecting and locating nuclear releases, thousands of releases all over the globe were simulated and the global detection probability was calculated. This was done for the International Monitoring System network of noble gas samplers as it currently exists (25 certified stations), and how it would be for potential future network sizes of 39 and 79 stations. The probability of detection was calculated for releases ranging from 10 10 Bq to 10 16 Bq of 133 Xe and presented as coverage maps and global integrals for both current and next-generation monitoring systems. Similarly, the number of detecting stations and the number of detecting samples were tabulated to elucidate the possibilities for enhanced location capability. Improvements in global detection coverage are maximized at different release sizes in a way that depends on the station density. For example, for releases of 3×10 14 Bq and 39 stations, the detection probability would rise from 60% to 70% with next-generation systems, while for releases of 10 13 Bq and 79 stations, it would rise from 37% to 52%. Achieving an average of two detecting stations requires a 1015 Bq release for a 39-station network and a 10 14 Bq release for a 79-station network. The largest impact of using next-generation systems may be the confidence, failure tolerance, and location capability that arise from obtaining multiple samples associated with a single release event.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2022

Guidebook for Assessing Similarity and Implementing Empirical Transfer Functions for Probability of Detection (POD) Demonstrations for Signal Based Nondestructive Evaluation (NDE) Methods

This document provides guidance for assessing similarity relative to nondestructive evaluation (NDE) detectability based on Probability of Detection demonstrations when comparing different NDE inspection situations. Differences in inspection situations addressed by the similarity assessment methodology herein can include differences in the component being inspected, and differences in the conditions for the inspection. Additional differences in the inspection situation relative to differences in the method or procedure are not addressed in this document but can be assessed using NDE calibration or instrument standardization specimens.

Probability of Detection↗
NASA NTRS1991

Assessment of probability of detection of delaminations in fiber-reinforced composites

Delamination is one of the critical defects in composite materials and structures. An ultrasonic C-scan imaging technique which maps out the acoustic impedance mismatched areas with respect to the sample coordinates, is particularly well suited for detecting and characterizing delaminations in composites. To properly interpret the results, it is necessary to correlate the indications with the detection limits and probability of detection (POD) of the ultrasonic C-scan imaging technique. The baseline information on the assessment of POD of delaminations in composite materials and structures is very beneficial to the evaluation of spacecraft materials. In this study, we review the principle of POD, describe the laboratory set-up and procedure, and present the experimental results as well as assessment of POD of delaminations in fiber reinforced composite panels using ultrasonic C-scan techniques.

Chern, E. J.↗
NASA NTRS2009

Recent Advances in Model-Assisted Probability of Detection

The increased role played by probability of detection (POD) in structural integrity programs, combined with the significant time and cost associated with the purely empirical determination of POD, provides motivation for alternate means to estimate this important metric of NDE techniques. One approach to make the process of POD estimation more efficient is to complement limited empirical experiments with information from physics-based models of the inspection process or controlled laboratory experiments. The Model-Assisted Probability of Detection (MAPOD) Working Group was formed by the Air Force Research Laboratory, the FAA Technical Center, and NASA to explore these possibilities. Since the 2004 inception of the MAPOD Working Group, 11 meetings have been held in conjunction with major NDE conferences. This paper will review the accomplishments of this group, which includes over 90 members from around the world. Included will be a discussion of strategies developed to combine physics-based and empirical understanding, draft protocols that have been developed to guide application of the strategies, and demonstrations that have been or are being carried out in a number of countries. The talk will conclude with a discussion of future directions, which will include documentation of benefits via case studies, development of formal protocols for engineering practice, as well as a number of specific technical issues.

Thompson, R. Bruce↗
NASA NTRS1994

The probability of flaw detection and the probability of false calls in nondestructive evaluation equipment

The space industry has developed many composite materials that have high durability in proportion to their weights. Many of these materials have a likelihood for flaws that is higher than in traditional metals. There are also coverings (such as paint) that develop flaws that may adversely affect the performance of the system in which they are used. Therefore there is a need to monitor the soundness of composite structures. To meet this monitoring need, many nondestructive evaluation (NDE) systems have been developed. An NDE system is designed to detect material flaws and make flaw measurements without destroying the inspected item. Also, the detection operation is expected to be performed in a rapid manner in a field or production environment. Some of the most recent video-based NDE methodologies are shearography, holography, thermography, and video image correlation.

Temple, Enoch C.↗
NASA NTRSDate not supplied

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modeling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) specialists within the Nondestructive Evaluation Sciences branch at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗
NASA NTRSDate not supplied

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modelling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) group at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗
NASA NTRS2015

Directed Design of Experiments for Validating Probability of Detection Capability of NDE Systems (DOEPOD)

Directed Design of Experiments for Validating Probability of Detection Capability of NDE Systems (DOEPOD) Manual v.1.2 The capability of an inspection system is established by applications of various methodologies to determine the probability of detection (POD). One accepted metric of an adequate inspection system is that there is 95% confidence that the POD is greater than 90% (90/95 POD). Design of experiments for validating probability of detection capability of nondestructive evaluation (NDE) systems (DOEPOD) is a methodology that is implemented via software to serve as a diagnostic tool providing detailed analysis of POD test data, guidance on establishing data distribution requirements, and resolving test issues. DOEPOD demands utilization of observance of occurrences. The DOEPOD capability has been developed to provide an efficient and accurate methodology that yields observed POD and confidence bounds for both Hit-Miss or signal amplitude testing. DOEPOD does not assume prescribed POD logarithmic or similar functions with assumed adequacy over a wide range of flaw sizes and inspection system technologies, so that multi-parameter curve fitting or model optimization approaches to generate a POD curve are not required. DOEPOD applications for supporting inspector qualifications is included.

Generazio, Edward R.↗
NASA NTRS2003

Probability of Detecting Planets with Microlensing

The proposed research to determine the probability of detecting extra solar planets from the ground with microlensing was completely accomplished during the grant period. A summary of the publications and their abstracts follow below. The publications include: 1) On microlensing rates and optical depth toward the Galactic center; 2) Newly discovered brown dwarfs not seen in microlensing timescale frequency distribution? 3) Probability of detecting a planetary companion during a microlensing event; 4) Comparison of a ground-based microlensing search for planets with a search from space; 5) Secular evolution of hierarchical planetary systems.

Peale, S. J.↗
DOE OSTI2019

Single-shot, multi-signature remote detection of uranium by filament-induced breakdown spectroscopy

Filament-induced breakdown spectroscopy (FIBS) is an attractive remote detection approach that is potentially applicable to nuclear materials, such as uranium (U). Simultaneous detection of atomic U and uranium monoxide features is demonstrated in a single laser shot with detection probabilities of 52.2% and 39.0%, respectively, and with a 1% false-alarm probability. It is shown that a nearly 100% detection probability can be reached with 1% false alarm probability in .1 second when using an 80-Hz laser and data acquisition system. Atomic U and UO signal features are identifiable in the remote measurement with comparable signal-to-background ratios, suggesting that, despite being broader than the U I emission line, the UO band is also suitable for remote detection of uranium by FIBS.

(020.3260) Isotope shifts, (140.3440) Laser-induce↗
NASA NTRS2011

Binomial Test Method for Determining Probability of Detection Capability for Fracture Critical Applications

The capability of an inspection system is established by applications of various methodologies to determine the probability of detection (POD). One accepted metric of an adequate inspection system is that for a minimum flaw size and all greater flaw sizes, there is 0.90 probability of detection with 95% confidence (90/95 POD). Directed design of experiments for probability of detection (DOEPOD) has been developed to provide an efficient and accurate methodology that yields estimates of POD and confidence bounds for both Hit-Miss or signal amplitude testing, where signal amplitudes are reduced to Hit-Miss by using a signal threshold Directed DOEPOD uses a nonparametric approach for the analysis or inspection data that does require any assumptions about the particular functional form of a POD function. The DOEPOD procedure identifies, for a given sample set whether or not the minimum requirement of 0.90 probability of detection with 95% confidence is demonstrated for a minimum flaw size and for all greater flaw sizes (90/95 POD). The DOEPOD procedures are sequentially executed in order to minimize the number of samples needed to demonstrate that there is a 90/95 POD lower confidence bound at a given flaw size and that the POD is monotonic for flaw sizes exceeding that 90/95 POD flaw size. The conservativeness of the DOEPOD methodology results is discussed. Validated guidelines for binomial estimation of POD for fracture critical inspection are established.

Generazio, Edward R.↗
NASA NTRS2008

Probability of Detection Study on Impact Damage to Honeycomb Composite Structure using Thermographic Inspection

A probability of detection study was performed for the detection of impact damage using flash heating infrared thermography on a full scale honeycomb composite structure. The honeycomb structure was an intertank structure from a previous NASA technology demonstration program. The intertank was fabricated from IM7/8552 carbon fiber/epoxy facesheets and aluminum honeycomb core. The intertank was impacted in multiple locations with a range of impact energies utilizing a spherical indenter. In a single blind study, the intertank was inspected with thermography before and after impact damage was incurred. Following thermographic inspection several impact sites were sectioned from the intertank and cross-sectioned for microscopic comparisons of NDE detection and actual damage incurred. The study concluded that thermographic inspection was a good method of detecting delamination damage incurred by impact. The 90/95 confidence level on the probability of detection was close to the impact energy that delaminations were first observed through cross-sectional analysis.

Hodge, Andrew J.↗
DOE OSTI2022

RESULTS OF A VIRTUAL ROUND ROBIN STUDY TO ESTIMATE PROBABILITY OF DETECTION FOR DISSIMILAR METAL WELDS

This paper presents efforts to overcome challenges with empirical probability of detection (POD) estimations in the nuclear power industry through the utilization of a novel virtual flaw method. A virtual round robin (VRR) study was conducted under the Program for Investigation Of NDE by International Collaboration (PIONIC), organized by the United States Nuclear Regulatory Commission (NRC) utilizing data generated by the virtual flaw method. Analysis of results from the VRR was performed by teams from Pacific Northwest National Laboratory (PNNL), Electric Power Research Institute (EPRI), and Aalto University. Empirically derived POD estimations are presented, and challenges associated with obtaining these estimations are discussed. The virtual flaw method is introduced and some details of its implementation for the VRR activity are described. Results from POD analysis of the VRR data by PNNL, EPRI, and Aalto University are presented and a discussion regarding differences in analysis results is provided. Finally, potential future efforts to improve the application of the virtual flaw method and its estimation of POD are discussed.

Probability of detection, Dissimilar Metal Weld, P↗
NASA NTRS2012

Directed Design of Experiments for Validating Probability of Detection Capability of a Testing System

A method of validating a probability of detection (POD) testing system using directed design of experiments (DOE) includes recording an input data set of observed hit and miss or analog data for sample components as a function of size of a flaw in the components. The method also includes processing the input data set to generate an output data set having an optimal class width, assigning a case number to the output data set, and generating validation instructions based on the assigned case number. An apparatus includes a host machine for receiving the input data set from the testing system and an algorithm for executing DOE to validate the test system. The algorithm applies DOE to the input data set to determine a data set having an optimal class width, assigns a case number to that data set, and generates validation instructions based on the case number.

Generazio, Edward R.↗
NASA NTRS2014

Interrelationships Between Receiver/Relative Operating Characteristics Display, Binomial, Logit, and Bayes' Rule Probability of Detection Methodologies

Unknown risks are introduced into failure critical systems when probability of detection (POD) capabilities are accepted without a complete understanding of the statistical method applied and the interpretation of the statistical results. The presence of this risk in the nondestructive evaluation (NDE) community is revealed in common statements about POD. These statements are often interpreted in a variety of ways and therefore, the very existence of the statements identifies the need for a more comprehensive understanding of POD methodologies. Statistical methodologies have data requirements to be met, procedures to be followed, and requirements for validation or demonstration of adequacy of the POD estimates. Risks are further enhanced due to the wide range of statistical methodologies used for determining the POD capability. Receiver/Relative Operating Characteristics (ROC) Display, simple binomial, logistic regression, and Bayes' rule POD methodologies are widely used in determining POD capability. This work focuses on Hit-Miss data to reveal the framework of the interrelationships between Receiver/Relative Operating Characteristics Display, simple binomial, logistic regression, and Bayes' Rule methodologies as they are applied to POD. Knowledge of these interrelationships leads to an intuitive and global understanding of the statistical data, procedural and validation requirements for establishing credible POD estimates.

Generazio, Edward R.↗
NASA NTRS1991

Open-loop frequency acquisition for suppressed-carrier biphase signals using one-pole arm filters

Open loop frequency acquisition performance is discussed for suppressed carrier binary phase shift keyed signals in terms of the probability of detecting the carrier frequency offset when the arms of the Costas loop detector have one pole filters. The approach, which does not require symbol timing, uses fast Fourier transforms (FFTs) to detect the carrier frequency offset. The detection probability, which depends on both the 3 dB arm filter bandwidth and the received symbol signal to noise ratio, is derived and is shown to be independent of symbol timing. It is shown that the performance of this technique is slightly better that other open loop acquisition techniques which use integrators in the arms and whose detection performance varies with symbol timing.

Shah, B.↗