Search NASA⌕ Search

SEARCH · Search NASA

Results for “probability of detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Lightning Initiation Forecasting: An Operational Dual-Polarimetric Radar Technique

The objective of this NASA MSFC and NOAA CSTAR funded study is to develop and test operational forecast algorithms for the prediction of lightning initiation utilizing the C-band dual-polarimetric radar, UAHuntsville's Advanced Radar for Meteorological and Operational Research (ARMOR). Although there is a rich research history of radar signatures associated with lightning initiation, few studies have utilized dual-polarimetric radar signatures (e.g., Z(sub dr) columns) and capabilities (e.g., fuzzy-logic particle identification [PID] of precipitation ice) in an operational algorithm for first flash forecasting. The specific goal of this study is to develop and test polarimetric techniques that enhance the performance of current operational radar reflectivity based first flash algorithms. Improving lightning watch and warning performance will positively impact personnel safety in both work and leisure environments. Advanced warnings can provide space shuttle launch managers time to respond appropriately to secure equipment and personnel, while they can also provide appropriate warnings for spectators and players of leisure sporting events to seek safe shelter. Through the analysis of eight case dates, consisting of 35 pulse-type thunderstorms and 20 non-thunderstorm case studies, lightning initiation forecast techniques were developed and tested. The hypothesis is that the additional dual-polarimetric information could potentially reduce false alarms while maintaining high probability of detection and increasing lead-time for the prediction of the first lightning flash relative to reflectivity-only based techniques. To test the hypothesis, various physically-based techniques using polarimetric variables and/or PID categories, which are strongly correlated to initial storm electrification (e.g., large precipitation ice production via drop freezing), were benchmarked against the operational reflectivity-only based approaches to find the best compromise between forecast skill and lead-time. Forecast skill is determined by statistical analysis of probability of detection (POD), false alarm ratio (FAR), Operational Utility Index (OUI), and critical success index (CSI).

Woodard, Crystal J.↗

Overview of Nondestructive Evaluation Capabilities at NASA MSFC

Nondestructive evaluation (NDE) methods examine material integrity without impairing its usefulness. The NDE team at NASA Marshall Space Flight Center (MSFC) in Huntsville, Alabama is responsible for applying existing methods to new hardware designs and material systems, probability of detection studies to quantify detection capabilities, overseeing NDE requirements for flight hardware, inspecting development articles and flight hardware, engineering support for failure investigations, and investigating emerging NDE methods. NASA MSFC has been on the cutting edge of developing new NDE techniques, first for the space shuttle, then for composite structures, and most recently for additive manufacturing (AM). Standard in-house inspection capabilities include eddy current, magnetic particle, liquid penetrant, ultrasonic, and radiographic testing (including computed tomography). Other advanced inspection capabilities include infrared flash thermography, shearography, acoustic emission, and microwave/millimeter wave testing. Some recent research studies include AM probability of detection testing, investigating in-situ process monitoring methods for AM, and correlating the NDE response of true fatigue cracks with artificial notches.

nondestructive evaluation↗

Reliability analysis and fault-tolerant system development for a redundant strapdown inertial measurement unit

A methodology is developed and applied for quantitatively analyzing the reliability of a dual, fail-operational redundant strapdown inertial measurement unit (RSDIMU). A Markov evaluation model is defined in terms of the operational states of the RSDIMU to predict system reliability. A 27 state model is defined based upon a candidate redundancy management system which can detect and isolate a spectrum of failure magnitudes. The results of parametric studies are presented which show the effect on reliability of the gyro failure rate, both the gyro and accelerometer failure rates together, false alarms, probability of failure detection, probability of failure isolation, and probability of damage effects and mission time. A technique is developed and evaluated for generating dynamic thresholds for detecting and isolating failures of the dual, separated IMU. Special emphasis is given to the detection of multiple, nonconcurrent failures. Digital simulation time histories are presented which show the thresholds obtained and their effectiveness in detecting and isolating sensor failures.

Motyka, P.↗

Echo asymmetry and its impact on NEXRAD storm identification

The effects of echo shape and radar viewing angle on the detections of cells are investigated. A chart representing the probability of detection of a storm is derived. Case studies from Florida and Alabama are analyzed in order to assess the performance of NEXRAD. It is noted that the current thresholds for storm identification for NEXRAD are inadequate for identifying small lightning-producing storms. Time-history and radar-reflectivity charts for the storms are provided.

Buechler, Dennis E.↗

Obtaining the Mass and Radius of Extra-Solar Giant Planets

The scientific utility and feasibility of detecting transits of the 9 known extrasolar planets is explored. A transit of a solar-like star by a Jupiter mass planet produces a 1% decrease in the amount of light received from the star. Transit observation will remove the ambiguity in the measurement of the planetary mass inherent in the radial velocity method and confirm the planet's existence. The 9 known planets have a 33% chance of producing at least one observable transit. Additional extrasolar planet detections from the radial velocity surveys will increase this probability to greater than 90%. The radius of the planet can be determined by the fractional decrease in light received during transit. The mass and radius may distinguish rocky or gas giant planets from brown dwarfs. The probability of detection, the transit signal size and duration, and predictions of the transit times (including errors) are calculated for circular and elliptical orbits. Observational limits are investigated and it is shown that small telescopes and existing detectors are adequate enough to achieve the 0.1% photometry necessary to detect transits of the known extrasolar planets.

Castellano, Tim↗

Considerations for Qualifying Reliable Eddy Current Array Technique for Detection of Backwall Cracks

A reliable nondestructive evaluation (NDE) technique provides minimum 90% probability of detection(POD) with 95% confidence for detection of cracklike flaws of a qualified size. In this case, the flaws are on backside of material. Eddy current array (ECA) probe or a single sensor eddy current probe in c-scanning mode is used for the flaw detection. Here, two geometries are considered for the test specimens. The two geometries are, a flat plate, and tube or pipe. The probe is assumed to be on outer diameter (OD)surface and the flaw is assumed to be at the inner diameter (ID) surface for tube inspection. The flaw and probe are on opposite side of wall thickness for inspection of plate material. The application may be used for acreage inspection or just for inspection of butt weld and heat affected zone (HAZ) in a tube, cylinder, or plate. The proposed approach is based on developing an instrument standardization or calibration procedure. Decision threshold of inspection procedure is determined using empirical qualification and noise data. The work explores essential parameters that are required to meet certain conditions to ensure reliable flaw detection. Physics-based simulation of eddy current array flaw detection is used to understand effect of essential parameters on signal response (amplitude and phase),and therefore flaw detectability. Simulation data is used to justify choice of calibration reference standard requirements and the qualification approach. An ECA technique qualification model is provided. The paper gives brief description of tasks to be completed for qualifying ECA technique for reliable detection of cracklike flaws.

Eddy current array inspection, nondestructive eval↗

Transfer function models for using empirical and physics-based simulation signal response data

In many situations, real or induced flaws such as tight cracks with known morphology cannot be manufactured in part geometry specimens or in real parts. Typically, surface fatigue cracks are manufactured in simple geometry specimens such as flat plates, dog-bone shaped flat or cylindrical specimens. If a nondestructive evaluation (NDE)technique is required to provide a reliably detectable flaw size, denoted asa90/95, for induced flaws in a part, then a direct method for qualifying the NDE procedure is to use appropriate induced flaw specimens and perform NDE procedure demonstration on the specimens. Probability of detection (POD)analysis of the empirical data may provide estimation of a90/95. This approach is described as direct POD demonstration testing, which may follow guidelines of MIL-HDBK-1823. This paper considers a case, where embedded tight cracklike induced flaws are to be detected reliably using a signal response based NDE procedure. Here, it is assumed that it is not practical to make surface or embedded induced flaw specimens in part geometry or configuration. Therefore, a direct POD demonstration testing cannot be undertaken. It is also assumed that simulation of signal response is possible for both surface and embedded induced flaws in part geometry specimens using a physics-based model. The proposed approach for NDE procedure qualification uses artificial flaws in simple geometry and part geometry specimens, and induced flaws in the same type of simple geometry specimens. Signal response data is taken on all sets of artificial and induced flaws in simple geometry and part geometry specimens. Moreover, simulated signal response data is generated for surface and embedded flaws. Thus, a case of five signal response versus flaw size datasets is considered. Three of the datasets are empirical and two datasets are physics model-based simulation datasets. A method of devising and using transfer function calculation dataset blocks to estimate the either the reliably detectable flaw size or the demonstration flaw size is provided.

Nondestructive evaluation↗

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗

Teleseismic Network Association with GENIE

In this report we investigate adapting the Graph Neural Interpretation Engine (GENIE), an associator developed for three-component dense monitoring networks, to regional to teleseismic association using a sparse network of array stations. We expand GENIE’s input features to include first-P detection time, azimuth, and slowness estimates. Additionally, we include a probability of detection (PDET) term which measures a station’s likelihood of detecting an event. To assess each feature’s relative importance, we train four models, each using an increasing set of node features and find that the PDET models perform the best. We define two measures of event complexity which demonstrate that all GENIE model versions perform better than the standard backprojection stack.

47 OTHER INSTRUMENTATION↗

Early focus development effort, ultrasonic inspection of fixed housing metal-to-adhesive bondline

An ultrasonic technique was developed for the fixed housing metal-to-adhesive bondline that will support the Flight 15 time frame and subsequent motors. The technique has the capability to detect a 1.0 inch diameter unbond with a 90 percent probability of detection (POD) at a 95 percent confidence level. The technique and support equipment will perform within the working envelope dictated by a stacked motor configuration.

Hartmann, John K.↗

Optical Microscopy Techniques to Inspect for Metallic Whiskers

Metal surface finishes of tin, zinc and cadmium are often applied to electronic components, mechanical hardware and other structures. These finishes sometimes unpredictably may form metal whiskers over periods that can take from hours to months or even many years. The metal whiskers are crystalline structures commonly having uniform cross sectional area along their entire length. Typical whisker dimensions are nominally on the order of only a few microns (um) across while their lengths can extend from a few microns to several millimeters. Metal whiskers pose a reliability hazard to electronic systems primarily as an electrical shorting hazard. The extremely narrow dimensions of metal whiskers can make observation with optical techniques very challenging. The videos herein were compiled to demonstrate the complexities associated with optical microscope inspection of electronic and mechanical components and assemblies for the presence or absence of metal whiskers. The importance of magnification, light source and angle of illumination play critical roles in being able to detect metal whiskers when present. Furthermore, it is demonstrated how improper techniques can easily obscure detection. It is hoped that these videos will improve the probability of detecting metal whiskers with optical inspection techniques.

Brusse, Jay A.↗

Evaluation of Precipitation Detection over Various Surfaces from Passive Microwave Imagers and Sounders

During the middle part of this decade a wide variety of passive microwave imagers and sounders will be unified in the Global Precipitation Measurement (GPM) mission to provide a common basis for frequent (3 hr), global precipitation monitoring. The ability of these sensors to detect precipitation by discerning it from non-precipitating background depends upon the channels available and characteristics of the surface and atmosphere. This study quantifies the minimum detectable precipitation rate and fraction of precipitation detected for four representative instruments (TMI, GMI, AMSU-A, and AMSU-B) that will be part of the GPM constellation. Observations for these instruments were constructed from equivalent channels on the SSMIS instrument on DMSP satellites F16 and F17 and matched to precipitation data from NOAA's National Mosaic and QPE (NMQ) during 2009 over the continuous United States. A variational optimal estimation retrieval of non-precipitation surface and atmosphere parameters was used to determine the consistency between the observed brightness temperatures and these parameters, with high cost function values shown to be related to precipitation. The minimum detectable precipitation rate, defined as the lowest rate for which probability of detection exceeds 50%, and the detected fraction of precipitation, are reported for each sensor, surface type (ocean, coast, bare land, snow cover) and precipitation type (rain, mix, snow). The best sensors over ocean and bare land were GMI (0.22 mm/hr minimum threshold and 90% of precipitation detected) and AMSU (0.26 mm/hr minimum threshold and 81% of precipitation detected), respectively. Over coasts (0.74 mm/hr threshold and 12% detected) and snow-covered surfaces (0.44 mm/hr threshold and 23% detected), AMSU again performed best but with much lower detection skill, whereas TMI had no skill over these surfaces. The sounders (particularly over water) benefited from the use of re-analysis data (vs. climatology) to set the a-priori atmospheric state and all instruments benefit from the use of a conditional snow cover emissivity database over land. It is recommended that real-time sources of these data be used in the operational GPM precipitation algorithms.

GPM↗

Frame synchronization for a channel with different data rates

In some communication links, different data rates are used at different times on the same channel and each is assigned a separate frame synchronization (sync) marker. The frame search is completed within a finite number of frame intervals once both phase-lock and bit-sync are achieved because the incoming data rate can change. The probability of failure to frame-lock, and an upper bound of probability of false frame-lock in a frame search mode are derived for a communication link with a 10 to the -5th bit error probability. The probability of failure to detect data-rate change and the probability of false detection of data-rate change in a frame-lock mode are discussed. In a frame-lock mode, the probability of failure to detect data-rate change and probability detection of data-rate change an equal to 4.96 x 10 to the -12th. A frame-lock device can be used for the Space Station Freedom Ku-band return link.

Kwon, Hyuck M.↗

NASA NDE Fracture Critical Detectable Flaw Sizes History and Methodology

NASA requires that NDE methods and inspectors demonstrate 90% Probability of Detection (POD) with 95% confidence for critical flaw sizes when inspecting fracture critical metallic components. NASA addresses the known variability of NDE inspector capability in two ways. The first, Special NDE, requires that every inspector demonstrate the required 90/95 POD, which is resource intensive. The second approach is Standard NDE for which conservative flaw sizes for different NDE methods are provided such that it is expected that most properly trained inspectors will exceed the 90/95 POD requirement. As such, individual POD demonstration testing is not required. The origin of NASA Standard NDE dates to the start of the Space Shuttle Program in the early 1970’s. In the first study to quantitatively assess NDE methods and inspectors, the performance of multiple inspectors was evaluated for different NDE methods using a large set of fatigue cracked specimens. A rudimentary POD analysis was performed to estimate the 90/95 POD flaw size for each inspector for each method. Additionally, the average and standard deviation of the 90/95 POD flaw size across the multiple inspectors was calculated to estimate the flaw size for which 95 percent of inspectors would provide the 90/95 POD capability. These estimated 90/95/95 POD flaw sizes evolved into the NASA Standard NDE flaw sizes still in use for structural analysis five decades later. The methodology for performing Standard NDE POD studies was never documented in NASA requirements. Furthermore, POD analysis methods have significantly evolved since this seminal study. Likewise, NDE methods have improved and there has been a push to reassess Standard NDE flaw sizes for existing methods, and to develop Standard NDE flaw sizes for new methods such as digital radiography. In this study, a Standard NDE POD methodology was developed and baselined using the historical data. This reanalysis of the historical data identified several deficiencies in the original test plan as well as an overall lack of conservatism in the estimated 90/95/95 POD flaw sizes. The results of this historical review and the new methodology are being incorporated into an update of NASA NDE POD requirements.

Nondestructive Evaluation↗

Transfer Function Models and Sensitivity Analysis

In many situations, real or induced flaws such as tight cracks with known morphology cannot be manufactured in part configuration specimens or in real parts. Typically, fatigue cracks are manufactured in simple geometry specimens such as flat plates, dog-bone shaped flat or round specimens. If a nondestructive evaluation (NDE) technique is required to provide a reliably detectable target flaw size denoted as α_(90/95) for induced flaws in real part, then the direct method for qualifying the NDE procedure is to use the appropriate induced flaw specimens and perform probability of detection analysis using these flaws. This can be described as direct POD demonstration testing, which may follow guidelines of MIL-HDBK-1823. This paper considers a case, where induced flaws are not available in part configuration specimens. Therefore, a direct POD demonstration study cannot be undertaken. In such situation, general practice for NDE procedure qualification is to use artificial flaws in simple geometry and part configuration specimens, and induced flaws in the chosen simple geometry specimens. Signal response data is taken on all sets of artificial and induced flaws. NDE procedure testing on induced flaw in simple geometry specimen is called NDE demonstration testing here. A transfer function NDE procedure qualification method for forward case calculates predicted induced flaw size for demonstration using a chosen target flaw size. Another transfer function method for inverse case, calculates the target flaw size using a given demonstration flaw size. The transfer function analysis assumes relationship of artificial flaw signal responses in real parts and simple geometry specimens; and induced flaw responses in simple geometry specimens to induced flaws in real parts. The signal response transfer relationships model should be defined before transfer function models can be devised. Assuming that the signal response transfer relationships model is valid, forward and inverse case transfer function methods have been devised. Because of lack of signal response data from induced flaws in real part, 90/95% POD/confidence (P/C) cannot be demonstrated directly. However, the transfer function method may be assessed using simulation to evaluate whether the resulting target flaw size or demonstration flaw size provides adequate confidence to the assumed signal response transfer relationships model. Therefore, the transfer function approach is a risk assessment approach. Both the signal response transfer relationships model and the transfer function model are important in managing risk in results provided by the transfer function NDE technique qualification or assessment. The signal response transfer relationships model needs to be validated with empirical data and then transfer function model needs to be validated for desired P/C on case-by-case basis.

Nondestructive evaluation↗

Adaptive narrow-band interference rejection in a DS spread-spectrum intercept receiver using transform domain signal processing techniques

An intercept receiver which uses a transform-domain-processing filter is described. This receiver detects direct-sequence BPSK spread-spectrum signals in the presence of narrowband interference by employing adaptive narrowband interference rejection techniques. The improvement in the system performance over that of conventional detection techniques is shown by presenting the results of experimental measurements of probability of detection versus false alarm for an enhanced total power detector. Also presented are certain results corresponding to detection of the spectral lines generated at twice the carrier frequency, wherein the goal is often not just signal detection, but also carrier frequency estimation. The receiver uses one of two transform-domain-processing techniques for adaptive narrowband interference rejection. In the first technique, the narrowband interference is detected and excised in the transform domain by using an adaptive notch filter. In the second technique, the interference is suppressed using soft-limiting in the transform domain.

Gevargiz, John↗

Convective Weather Forecast Quality Metrics for Air Traffic Management Decision-Making

Since numerical weather prediction models are unable to accurately forecast the severity and the location of the storm cells several hours into the future when compared with observation data, there has been a growing interest in probabilistic description of convective weather. The classical approach for generating uncertainty bounds consists of integrating the state equations and covariance propagation equations forward in time. This step is readily recognized as the process update step of the Kalman Filter algorithm. The second well known method, known as the Monte Carlo method, consists of generating output samples by driving the forecast algorithm with input samples selected from distributions. The statistical properties of the distributions of the output samples are then used for defining the uncertainty bounds of the output variables. This method is computationally expensive for a complex model compared to the covariance propagation method. The main advantage of the Monte Carlo method is that a complex non-linear model can be easily handled. Recently, a few different methods for probabilistic forecasting have appeared in the literature. A method for computing probability of convection in a region using forecast data is described in Ref. 5. Probability at a grid location is computed as the fraction of grid points, within a box of specified dimensions around the grid location, with forecast convection precipitation exceeding a specified threshold. The main limitation of this method is that the results are dependent on the chosen dimensions of the box. The examples presented Ref. 5 show that this process is equivalent to low-pass filtering of the forecast data with a finite support spatial filter. References 6 and 7 describe the technique for computing percentage coverage within a 92 x 92 square-kilometer box and assigning the value to the center 4 x 4 square-kilometer box. This technique is same as that described in Ref. 5. Characterizing the forecast, following the process described in Refs. 5 through 7, in terms of percentage coverage or confidence level is notionally sound compared to characterizing in terms of probabilities because the probability of the forecast being correct can only be determined using actual observations. References 5 through 7 only use the forecast data and not the observations. The method for computing the probability of detection, false alarm ratio and several forecast quality metrics (Skill Scores) using both the forecast and observation data are given in Ref. 2. This paper extends the statistical verification method in Ref. 2 to determine co-occurrence probabilities. The method consists of computing the probability that a severe weather cell (grid location) is detected in the observation data in the neighborhood of the severe weather cell in the forecast data. Probabilities of occurrence at the grid location and in its neighborhood with higher severity, and with lower severity in the observation data compared to that in the forecast data are examined. The method proposed in Refs. 5 through 7 is used for computing the probability that a certain number of cells in the neighborhood of severe weather cells in the forecast data are seen as severe weather cells in the observation data. Finally, the probability of existence of gaps in the observation data in the neighborhood of severe weather cells in forecast data is computed. Gaps are defined as openings between severe weather cells through which an aircraft can safely fly to its intended destination. The rest of the paper is organized as follows. Section II summarizes the statistical verification method described in Ref. 2. The extension of this method for computing the co-occurrence probabilities in discussed in Section HI. Numerical examples using NCWF forecast data and NCWD observation data are presented in Section III to elucidate the characteristics of the co-occurrence probabilities. This section also discusses the procedure for computing throbabilities that the severity of convection in the observation data will be higher or lower in the neighborhood of grid locations compared to that indicated at the grid locations in the forecast data. The probability of coverage of neighborhood grid cells is also described via examples in this section. Section IV discusses the gap detection algorithm and presents a numerical example to illustrate the method. The locations of the detected gaps in the observation data are used along with the locations of convective weather cells in the forecast data to determine the probability of existence of gaps in the neighborhood of these cells. Finally, the paper is concluded in Section V.

Chatterji, Gano B.↗

An analysis of the facsimile-camera response to radiant point sources

In addition to imaging the surrounding terrain, planetary lander cameras may also be used to survey the stars to aid in locating the lander site. The response of the facsimile camera, which was selected for the Viking lander missions to Mars, to a radiant point source is formulated and shown to result in a statistical rather than deterministic signal. The signal statistics are derived and magnitudes are evaluated for the brighter visual and red stars. The probability of detecting the resultant statistical signals in photosensor and preamplifier noise and the associated probability of false alarms are also determined.

Huck, F. O.↗