Search NASA⌕ Search

SEARCH · Search NASA

Results for “false alarm rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

A Method for Evaluating the Safety Impacts of Air Traffic Automation

This report describes a methodology for analyzing the safety and operational impacts of emerging air traffic technologies. The approach integrates traditional reliability models of the system infrastructure with models that analyze the environment within which the system operates, and models of how the system responds to different scenarios. Products of the analysis include safety measures such as predicted incident rates, predicted accident statistics, and false alarm rates; and operational availability data. The report demonstrates the methodology with an analysis of the operation of the Center-TRACON Automation System at Dallas-Fort Worth International Airport.

Kostiuk, Peter↗
NASA NTRS2009

Processing Images of Craters for Spacecraft Navigation

A crater-detection algorithm has been conceived to enable automation of what, heretofore, have been manual processes for utilizing images of craters on a celestial body as landmarks for navigating a spacecraft flying near or landing on that body. The images are acquired by an electronic camera aboard the spacecraft, then digitized, then processed by the algorithm, which consists mainly of the following steps: 1. Edges in an image detected and placed in a database. 2. Crater rim edges are selected from the edge database. 3. Edges that belong to the same crater are grouped together. 4. An ellipse is fitted to each group of crater edges. 5. Ellipses are refined directly in the image domain to reduce errors introduced in the detection of edges and fitting of ellipses. 6. The quality of each detected crater is evaluated. It is planned to utilize this algorithm as the basis of a computer program for automated, real-time, onboard processing of crater-image data. Experimental studies have led to the conclusion that this algorithm is capable of a detection rate >93 percent, a false-alarm rate <5 percent, a geometric error <0.5 pixel, and a position error <0.3 pixel.

Cheng, Yang↗
NASA NTRS1971

Analysis of pilot warning indicator performance in terminal area traffic.

Three pilot warning indicator concepts for collision hazard avoidance are analyzed using computer fast-time simulation. A hazard measure is defined based on a 1/2-g maximum horizontal acceleration, a maximum climb or dive angle of 10 deg for each aircraft, and a 20-sec warning time, through escape completion. The traffic model is based on flight tracks recorded in the Atlanta terminal area over an 11 hr period during August 1967. The basic PWI concept studied alarms on range to flashing beacons mounted on intruder aircraft as a function of relative azimuth and elevation. The alarm-hazard epoch ratio is about 17/1 to maintain the missed-alarm rate below 10%. Beacon vignetting or range-rate discrimination are shown to reduce the false-alarm rate by about 75%.

Ruetenik, J. R.↗
NASA NTRS2010

Optimization of a Multi-Stage ATR System for Small Target Identification

An Automated Target Recognition system (ATR) was developed to locate and target small object in images and videos. The data is preprocessed and sent to a grayscale optical correlator (GOC) filter to identify possible regionsof- interest (ROIs). Next, features are extracted from ROIs based on Principal Component Analysis (PCA) and sent to neural network (NN) to be classified. The features are analyzed by the NN classifier indicating if each ROI contains the desired target or not. The ATR system was found useful in identifying small boats in open sea. However, due to "noisy background," such as weather conditions, background buildings, or water wakes, some false targets are mis-classified. Feedforward backpropagation and Radial Basis neural networks are optimized for generalization of representative features to reduce false-alarm rate. The neural networks are compared for their performance in classification accuracy, classifying time, and training time.

false alarm rate↗
NASA NTRS2006

NASA Taxonomies for Searching Problem Reports and FMEAs

Many types of hazard and risk analyses are used during the life cycle of complex systems, including Failure Modes and Effects Analysis (FMEA), Hazard Analysis, Fault Tree and Event Tree Analysis, Probabilistic Risk Assessment, Reliability Analysis and analysis of Problem Reporting and Corrective Action (PRACA) databases. The success of these methods depends on the availability of input data and the analysts knowledge. Standard nomenclature can increase the reusability of hazard, risk and problem data. When nomenclature in the source texts is not standard, taxonomies with mapping words (sets of rough synonyms) can be combined with semantic search to identify items and tag them with metadata based on a rich standard nomenclature. Semantic search uses word meanings in the context of parsed phrases to find matches. The NASA taxonomies provide the word meanings. Spacecraft taxonomies and ontologies (generalization hierarchies with attributes and relationships, based on terms meanings) are being developed for types of subsystems, functions, entities, hazards and failures. The ontologies are broad and general, covering hardware, software and human systems. Semantic search of Space Station texts was used to validate and extend the taxonomies. The taxonomies have also been used to extract system connectivity (interaction) models and functions from requirements text. Now the Reconciler semantic search tool and the taxonomies are being applied to improve search in the Space Shuttle PRACA database, to discover recurring patterns of failure. Usual methods of string search and keyword search fall short because the entries are terse and have numerous shortcuts (irregular abbreviations, nonstandard acronyms, cryptic codes) and modifier words cannot be used in sentence context to refine the search. The limited and fixed FMEA categories associated with the entries do not make the fine distinctions needed in the search. The approach assigns PRACA report titles to problem classes in the taxonomy. Each ontology class includes mapping words - near-synonyms naming different manifestations of that problem class. The mapping words for Problems, Entities and Functions are converted to a canonical form plus any of a small set of modifier words (e.g. non-uniformity NOT + UNIFORM.) The report titles are parsed as sentences if possible, or treated as a flat sequence of word tokens if parsing fails. When canonical forms in the title match mapping words, the PRACA entry is associated with the corresponding Problem, Entity or Function in the ontology. The user can search for types of failures associated with types of equipment, clustering by type of problem (e.g., all bearings found with problems of being uneven: rough, irregular, gritty ). The results could also be used for tagging PRACA report entries with rich metadata. This approach could also be applied to searching and tagging failure modes, failure effects and mitigations in FMEAs. In the pilot work, parsing 52K+ truncated titles (the test cases that were available), has resulted in identification of both a type of equipment and type of problem in about 75% of the cases. The results are displayed in a manner analogous to Google search results. The effort has also led to the enrichment of the taxonomy, adding some new categories and many new mapping words. Further work would make enhancements that have been identified for improving the clustering and further reducing the false alarm rate. (In searching for recurring problems, good clustering is more important than reducing false alarms). Searching complete PRACA reports should lead to immediate improvement.

Malin, Jane T.↗
NASA NTRS2003

Optical landmark detection for spacecraft navigation

In this paper, a new crater detection algorithm is suggested. Experimental studies show that this new algorithm can achieve sub-pixel accuracy in position, its detection rate is better than 90% and its false alarm rate is less than 5%. These good characteristics indicate that it is an ideal crater detection algorithm for spacecraft optical navigation.

optical↗
NASA NTRS2001

Performance Assessment of the Optical Transient Detector and Lightning Imaging Sensor: Predicted Diurnal Variability - 1

Laboratory calibration and observed background radiance data are used to determine the effective sensitivities of the Optical Transient Detector and Lightning Imaging Sensor, as functions of local hour and pixel location within the instrument arrays. The effective LIS thresholds, expressed as radiances emitted normal to cloud top, are 4.0 plus or minus 0.7 and 7.6 plus or minus 3.3 micro J/ster/m (sup 2) for night and local noon; the OTD thresholds am 11.7 plus or minus 2.2 and 16.8 plus or minus 4.6 microJ/ster/m (sup 2). LIS and OTD minimum signal to noise ratios occur from 0800 to 1600 local time, and attain values of 10 plus or minus 2 and 20 plus or minus 3, respectively. False alarm rate due to instrument noise yields approximately 5 false triggers per month for LIS, and is negligible for OTD. Flash detection efficiency, based on prior optical pulse sensor measurements, is predicted to be 93 plus or minus 4% and 73 plus or minus 11% for LIS night and noon; 56 plus or minus 7% and 44 plus or minus 9% for OTD night and noon, corresponding to a 12 - 20% diurnal variability and LIS:OTD ratio of 1.7. Use of the weighted daily mean detection efficiency (i.e., not controlling for local hour) corresponds to a sigma = 8 - 9% uncertainty. These are likely overestimates of actual flash detection efficiency due to differences in pixel ground field-of-view across the instrument arrays, which are not accounted for in the validation optical pulse sensor data.

Boccippio, Dennis J.↗
NASA NTRS1990

Initial results on fault diagnosis of DSN antenna control assemblies using pattern recognition techniques

Initial results obtained from an investigation using pattern recognition techniques for identifying fault modes in the Deep Space Network (DSN) 70 m antenna control loops are described. The overall background to the problem is described, the motivation and potential benefits of this approach are outlined. In particular, an experiment is described in which fault modes were introduced into a state-space simulation of the antenna control loops. By training a multilayer feed-forward neural network on the simulated sensor output, classification rates of over 95 percent were achieved with a false alarm rate of zero on unseen tests data. It concludes that although the neural classifier has certain practical limitations at present, it also has considerable potential for problems of this nature.

Smyth, P.↗
NASA NTRS2005

Radiation Dosimetry via Automated Fluorescence Microscopy

A developmental instrument for assessment of radiation-induced damage in human lymphocytes includes an automated fluorescence microscope equipped with a one or more chargecoupled- device (CCD) video camera(s) and circuitry to digitize the video output. The microscope is also equipped with a three-axis translation stage that includes a rotation stage, and a rotary tray that holds as many as thirty specimen slides. The figure depicts one version of the instrument. Once the slides have been prepared and loaded into the tray, the instrument can operate unattended. A computer controls the operation of the stage, tray, and microscope, and processes the digital fluorescence-image data to recognize and count chromosomes that have been broken, presumably by radiation. The design and method of operation of the instrument exploit fluorescence in situ hybridization (FISH) of metaphase chromosome spreads, which is a technique that has been found to be valuable for monitoring the radiation dose to circulating lymphocytes. In the specific FISH protocol used to prepare specimens for this instrument, metaphase lymphocyte cultures are chosen for high mitotic index and highly condensed chromosomes, then several of the largest chromosomes are labeled with three of four differently colored whole-chromosome-staining dyes. The three dyes, which are used both individually and in various combinations, are fluorescein isothiocyanate (FITC), Texas Red (or equivalent), and Cy5 (or equivalent); The fourth dye 4',6-diamidino- 2-phenylindole (DAPI) is used as a counterstain. Under control by the computer, the microscope is automatically focused on the cells and each slide is scanned while the computer analyzes the DAPI-fluorescence images to find the metaphases. Each metaphase field is recentered in the field of view and refocused. Then a four-color image (more precisely, a set of images of the same view in the fluorescent colors of the four dyes) is acquired. By use of pattern-recognition software developed specifically for this instrument, the images in the various colors are processed to recognize the metaphases and count the chromosome fragments of each color within the metaphases. The intermediate results are then further processed to estimate the proportion of cells that have suffered genetic damage. The prototype instrument scans at an average areal rate of 4.7 mm2/h in unattended operation, finding about 14 metaphases per hour. The false-alarm rate is typically less than 3 percent, and the metaphase-miss rate has been estimated to be less than 5 percent. The counts of chromosomes and fragments thereof are 50 to 70 percent accurate.

Castleman, Kenneth R.↗
NASA NTRS1983

Sensory redundancy management: The development of a design methodology for determining threshold values through a statistical analysis of sensor output data

Sensor redundancy management (SRM) requires a system which will detect failures and reconstruct avionics accordingly. A probability density function to determine false alarm rates, using an algorithmic approach was generated. Microcomputer software was developed which will print out tables of values for the cummulative probability of being in the domain of failure; system reliability; and false alarm probability, given a signal is in the domain of failure. The microcomputer software was applied to the sensor output data for various AFT1 F-16 flights and sensor parameters. Practical recommendations for further research were made.

Scalzo, F.↗
NASA NTRS1980

Conceptual design of a spaceborne lightning sensor

A conceptual design of a broad-area optical lightning telescope sensor (BOLTS) designed to provide full-time (day/night) coverage of the continental United States from a geosynchronous orbit is described. Variations are discussed that could cover the whole globe from four to five geosynchronous satellites or cover only smaller areas with a high (2.5 km) resolution. The design is based on research results of the initial phase of a NASA-sponsored program. The ground resolution will be 8 x 8 km. The focal plane is an 800 x 800 pixel CCD array, electronically subdivided to allow for the high data rates (1000 frames per sec) imposed by the characteristics of lightning flashes. It will detect lightning strokes whose optical power is greater than 10 million watts, with a probability of detection of 0.9, and a false alarm rate of 0.1.

Wolfe, W. L.↗
NASA NTRS2014

Lightning Jump Algorithm Development for the GOES·R Geostationary Lightning Mapper

Current work on the lightning jump algorithm to be used in GOES‐R Geostationary Lightning Mapper (GLM)'s data stream is multifaceted due to the intricate interplay between the storm tracking, GLM proxy data, and the performance of the lightning jump itself. This work outlines the progress of the last year, where analysis and performance of the lightning jump algorithm with automated storm tracking and GLM proxy data were assessed using over 700 storms from North Alabama. The cases analyzed coincide with previous semi‐objective work performed using total lightning mapping array (LMA) measurements in Schultz et al. (2011). Analysis shows that key components of the algorithm (flash rate and sigma thresholds) have the greatest influence on the performance of the algorithm when validating using severe storm reports. Automated objective analysis using the GLM proxy data has shown probability of detection (POD) values around 60% with false alarm rates (FAR) around 73% using similar methodology to Schultz et al. (2011). However, when applying verification methods similar to those employed by the National Weather Service, POD values increase slightly (69%) and FAR values decrease (63%). The relationship between storm tracking and lightning jump has also been tested in a real‐time framework at NSSL. This system includes fully automated tracking by radar alone, real‐time LMA and radar observations and the lightning jump. Results indicate that the POD is strong at 65%. However, the FAR is significantly higher than in Schultz et al. (2011) (50‐80% depending on various tracking/lightning jump parameters) when using storm reports for verification. Given known issues with Storm Data, the performance of the real‐time jump algorithm is also being tested with high density radar and surface observations from the NSSL Severe Hazards Analysis & Verification Experiment (SHAVE).

Schultz. E.↗
NASA NTRS2011

Modeling Kepler Transit Light Curves as False Positives: Rejection of Blend Scenarios for Kepler-9, and Validation of Kepler-9 d, a Super-Earth-Size Planet in a Multiple System

Light curves from the Kepler Mission contain valuable information on the nature of the phenomena producing the transit-like signals. To assist in exploring the possibility that they are due to an astrophysical false positive we describe a procedure (BLENDER) to model the photometry in terms of a blend rather than a planet orbiting a star. A blend may consist of a background or foreground eclipsing binary (or star-planet pair) whose eclipses are attenuated by the light of the candidate and possibly other stars within the photometric aperture. We apply BLENDER to the case of Kepler-9 (KIC 3323887), a target harboring two previously confirmed Saturn-size planets (Kepler-9 b and Kepler-9 c) showing transit timing variations, and an additional shallower signal with a 1.59 day period suggesting the presence of a super-Earth-size planet. Using BLENDER together with constraints from other follow-up observations we are able to rule out all blends for the two deeper signals and provide independent validation of their planetary nature. For the shallower signal, we rule out a large fraction of the false positives that might mimic the transits. The false alarm rate for remaining blends depends in part (and inversely) on the unknown frequency of small-size planets. Based on several realistic estimates of this frequency, we conclude with very high confidence that this small signal is due to a super-Earth-size planet (Kepler-9 d) in a multiple system, rather than a false positive. The radius is determined to be 1.64(exp)(sub-14),R, and current spectroscopic observations are as yet insufficient to establish its mass.

PLANETARY SYSTEMS↗
NASA NTRS2021

All-Sky Search for Short Gravitational-Wave Bursts in the Third Advanced LIGO and Advanced Virgo Run

This paper presents the results of a search for generic short-duration gravitational-wave transients in datafrom the third observing run of Advanced LIGO and Advanced Virgo. Transients with durations ofmilliseconds to a few seconds in the 24–4096 Hz frequency band are targeted by the search, with noassumptions made regarding the incoming signal direction, polarization, or morphology. Gravitationalwaves from compact binary coalescences that have been identified by other targeted analyses are detected,but no statistically significant evidence for other gravitational wave bursts is found. Sensitivities to a varietyof signals are presented. These include updated upper limits on the source rate density as a function of thecharacteristic frequency of the signal, which are roughly an order of magnitude better than previous upperlimits. This search is sensitive to sources radiating as little as∼10−10M⊙c2in gravitational waves at∼70Hz from a distance of 10 kpc, with 50% detection efficiency at a false alarm rate of one per century.The sensitivity of this search to two plausible astrophysical sources is estimated: neutron starfmodes,which may be excited by pulsar glitches, as well as selected core-collapse supernova models.

R Abbott↗
NASA NTRS2003

Sensitivity and Bias in Searches of Cockpit Display of Traffic Information Utilizing Highlighting/Lowlighting

A previous investigation showed that when bright and dim traffic symbols were mixed together on a cockpit display of traffic information, dim targets required longer search times than bright targets. The current experiment utilized Signal Detection methodology to determine the cause of this effect. Two factors were manipulated, Intensity and Mixture. The Intensity manipulation varied whether targets were bright or dim. The Mixture manipulation varied whether the brightness of all aircraft symbols was the same, or if half were bright and half dim. Participants were given 1.25 s to search a display of eight aircraft and determine whether a target was present or absent (50% of the time a target was present) and then rated their confidence in the accuracy of their decision. A Mixture by Intensity repeated-measures ANOVA on the signal detectability measure, A (a non- parametric variant of d ), revealed that targets presented at the dim intensity in the mixed condition yielded significantly lower sensitivity than either of the pure (homogenous) conditions or the bright targets in the mixed condition. There was not a significant difference in False Alarm rates between any conditions, indicating no change in decision criterion. Findings are discussed in terms of possible masking effects evoked by bright aircraft over the dim aircraft. Funding for this work was provided by the Advanced Air Transportation Technologies Project of NASA s Airspace Operation Systems Program.

Johnson, Walter W.↗
NASA NTRS2009

Preliminary Development and Evaluation of Lightning Jump Algorithms for the Real-Time Detection of Severe Weather

Previous studies have demonstrated that rapid increases in total lightning activity (intracloud + cloud-to-ground) are often observed tens of minutes in advance of the occurrence of severe weather at the ground. These rapid increases in lightning activity have been termed "lightning jumps." Herein, we document a positive correlation between lightning jumps and the manifestation of severe weather in thunderstorms occurring across the Tennessee Valley and Washington D.C. A total of 107 thunderstorms were examined in this study, with 69 of the 107 thunderstorms falling into the category of non-severe, and 38 into the category of severe. From the dataset of 69 isolated non-severe thunderstorms, an average peak 1 minute flash rate of 10 flashes/min was determined. A variety of severe thunderstorm types were examined for this study including an MCS, MCV, tornadic outer rainbands of tropical remnants, supercells, and pulse severe thunderstorms. Of the 107 thunderstorms, 85 thunderstorms (47 non-severe, 38 severe) from the Tennessee Valley and Washington D.C tested 6 lightning jump algorithm configurations (Gatlin, Gatlin 45, 2(sigma), 3(sigma), Threshold 10, and Threshold 8). Performance metrics for each algorithm were then calculated, yielding encouraging results from the limited sample of 85 thunderstorms. The 2(sigma) lightning jump algorithm had a high probability of detection (POD; 87%), a modest false alarm rate (FAR; 33%), and a solid Heidke Skill Score (HSS; 0.75). A second and more simplistic lightning jump algorithm named the Threshold 8 lightning jump algorithm also shows promise, with a POD of 81% and a FAR of 41%. Average lead times to severe weather occurrence for these two algorithms were 23 minutes and 20 minutes, respectively. The overall goal of this study is to advance the development of an operationally-applicable jump algorithm that can be used with either total lightning observations made from the ground, or in the near future from space using the GOES-R Geostationary Lightning Mapper.

Schultz, Christopher J.↗
NASA NTRS1999

Total Lightning Activity Associated with Tornadic Storms

Severe storms often have high flash rates (in excess of one flash per second) and are dominated by intracloud lightning activity. In addition to the extraordinary flash rates, there is a second distinguishing lightning characteristic of severe storms that seems to be important. When the total lightning history is examined, one finds sudden increases in the lightning rate, which we refer to as lightning "jumps," that precede the occurrence of severe weather by ten or more minutes. These jumps are typically 30-60 flashes/min, and are easily identified as anomalously large derivatives in the flash rate. This relationship is associated with updraft intensification and updraft strength is an important factor in storm severity (through the accumulation of condensate aloft and the stretching of vorticity). In several cases, evidence for diminishment of midlevel rotation and the descent of angular momentum from aloft is present prior to the appearance of the surface tornado. Based on our experience with severe and tornadic storms in Central Florida, we believe the total lightning may augment the more traditional use of NEXRAD radars and storm spotters. However, a more rigorous relation of these jumps to storm kinematics is needed if we are to apply total lightning in a decision tree that leads to improved warning lead times and decreased false alarm rates.

Goodman, Steven J.↗
NASA NTRS2014

MAG4 Versus Alternative Techniques for Forecasting Active-Region Flare Productivity

MAG4 is a technique of forecasting an active region's rate of production of major flares in the coming few days from a free-magnetic-energy proxy. We present a statistical method of measuring the difference in performance between MAG4 and comparable alternative techniques that forecast an active region's major-flare productivity from alternative observed aspects of the active region. We demonstrate the method by measuring the difference in performance between the "Present MAG4" technique and each of three alternative techniques, called "McIntosh Active-Region Class," "Total Magnetic Flux," and "Next MAG4." We do this by using (1) the MAG4 database of magnetograms and major-flare histories of sunspot active regions, (2) the NOAA table of the major-flare productivity of each of 60 McIntosh active-region classes of sunspot active regions, and (3) five technique-performance metrics (Heidke Skill Score, True Skill Score, Percent Correct, Probability of Detection, and False Alarm Rate) evaluated from 2000 random two-by-two contingency tables obtained from the databases. We find that (1) Present MAG4 far outperforms both McIntosh Active-Region Class and Total Magnetic Flux, (2) Next MAG4 significantly outperforms Present MAG4, (3) the performance of Next MAG4 is insensitive to the forward and backward temporal windows used, in the range of one to a few days, and (4) forecasting from the free-energy proxy in combination with either any broad category of McIntosh active-region classes or any Mount Wilson active-region class gives no significant performance improvement over forecasting from the free-energy proxy alone (Present MAG4).

Falconer, David A.↗