Search NASA⌕ Search

SEARCH · Search NASA

Results for “false alarm rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Social-Cognitive Biases in Simulated Airline Luggage Screening

This study illustrated how social cognitive biases affect the decision making process of air1ine luggage screeners. Participants (n = 96) performed a computer simulated task to detect hidden weapons in 200 x-ray images of passenger luggage. Participants saw each image for two (high time pressure) or six seconds (low time pressure). Participants observed pictures of the "passenger" who owns the luggage . The "pre-anchor group" answered questions about the passenger before the luggage image appeared, the "post-snchor" group answered questions after the luggage appeared, and the "no-anchor group" answered no questions. Participants either stopped or did not stop the bag. and rated their confidence in their decision. Participants under high time pressure had lower hit rates and higher false alarms, Significant differences between the pre-, no-, and post-anchor groups were based on the gender and race of the passengers. Participants had higher false alarm rates in response to male than female passengers.

Brown, Jeremy R.↗
NASA NTRS1989

Costas loop lock detection in the advanced receiver

The advanced receiver currently being developed uses a Costas digital loop to demodulate the subcarrier. Previous analyses of lock detector algorithms for Costas loops have ignored the effects of the inherent correlation between the samples of the phase-error process. Accounting for this correlation is necessary to achieve the desired lock-detection probability for a given false-alarm rate. Both analysis and simulations are used to quantify the effects of phase correlation on lock detection for the square-law and the absolute-value type detectors. Results are obtained which depict the lock-detection probability as a function of loop signal-to-noise ratio for a given false-alarm rate. The mathematical model and computer simulation show that the square-law detector experiences less degradation due to phase jitter than the absolute-value detector and that the degradation in detector signal-to-noise ratio is more pronounced for square-wave than for sine-wave signals.

Mileant, A.↗
NASA NTRS2008

Simulating Operation of a Complex Sensor Network

Simulation Tool for ASCTA Microsensor Network Architecture (STAMiNA) ["ASCTA" denotes the Advanced Sensors Collaborative Technology Alliance.] is a computer program for evaluating conceptual sensor networks deployed over terrain to provide military situational awareness. This or a similar program is needed because of the complexity of interactions among such diverse phenomena as sensing and communication portions of a network, deployment of sensor nodes, effects of terrain, data-fusion algorithms, and threat characteristics. STAMiNA is built upon a commercial network-simulator engine, with extensions to include both sensing and communication models in a discrete-event simulation environment. Users can define (1) a mission environment, including terrain features; (2) objects to be sensed; (3) placements and modalities of sensors, abilities of sensors to sense objects of various types, and sensor false alarm rates; (4) trajectories of threatening objects; (5) means of dissemination and fusion of data; and (6) various network configurations. By use of STAMiNA, one can simulate detection of targets through sensing, dissemination of information by various wireless communication subsystems under various scenarios, and fusion of information, incorporating such metrics as target-detection probabilities, false-alarm rates, and communication loads, and capturing effects of terrain and threat.

Jennings, Esther↗
DOE OSTI2024

Securing Grid-interactive Efficient Buildings (GEB) through Cyber Defense and Resilient System (CYDRES)

The DOE CYDRES project is driven by the urgent need to address critical research gaps in the domain of cyber-physical security of smart buildings, including Grid-interactive Efficient Buildings (GEBs). CYDRES, a real-time advanced building resilient platform, aims to enhance the cyber-attack-immune capabilities of buildings through multi-layered prevention, detection, and adaptation mechanisms. CYDRES consists of five key modules: a multi-layer network analyzer, an Automatic Fault Detection, Diagnosis, and Prognosis (AFDDP) framework, an intelligent mode selector, a cyber-resilient control framework, and a situation awareness platform. The Network Analyzer employs a data-driven framework that includes a protocol state learning tool and a CRF (Conditional Random Field) command validator. In Hardware-In-the-Loop (HIL) testbeds, it achieved 100% detection accuracy with a false alarm rate of 3%, validating its efficacy in identifying selected cyber-attacks. The AFDDP framework leverages pattern matching, PCA (Principal Component Analysis)-based strategies, and a DBN (Dynamic Bayesian Network)-based fault diagnosis approach to pinpoint the causes of physical system abnormalities using Building Automation System (BAS) data. In HIL experiments, the AFDDP module attained a detection accuracy of over 95% with a false alarm rate below 7%. Additionally, the fault detector utilized machine learning (Random Forest) and deep learning (Multi-Layer Perceptron) methods with acoustic sensor data to achieve a 100% fault detection accuracy in Heating, Ventilation, and Air-Conditioning (HVAC) equipment. The Mode Selector offered real-time impact analysis, allowing immediate actions to protect BASs in the face of emerging threats. The cyber-resilient control framework included an adaptive Model Predictive Control (MPC) and a measurement compensator, reducing temperature violations by up to 94% and improving the total demand flexibility by up to 70% in HIL experiments. Such HIL experiments covered a cyber-attack case and a physical fault case, showcasing CYDRES’ efficiency in maintaining operational continuity during threats. The situation awareness platform in Grafana enhanced real-time threat detection and response visualization, augmenting the operational awareness for building operators. CYDRES demonstrated high technical effectiveness in various test scenarios, particularly in HIL environments. The project's phased development approach ensured efficient use of resources, highlighting its practical feasibility and readiness for commercialization. By enhancing the security and resilience of building operations, CYDRES represents a significant advance in mitigating risks associated with cyber-physical systems, thereby enhancing public confidence in the safety of modern building infrastructure. Future directions for the project include expanding testing protocols, refining AFDDP methodologies, exploring more comprehensive resilient control strategies, and testing in real commercial buildings.

42 ENGINEERING↗
NASA NTRS1987

A new approach to importance sampling for the simulation of false alarms

In this paper a modified importance sampling technique for improving the convergence of Importance Sampling is given. By using this approach to estimate low false alarm rates in radar simulations, the number of Monte Carlo runs can be reduced significantly. For one-dimensional exponential, Weibull, and Rayleigh distributions, a uniformly minimum variance unbiased estimator is obtained. For Gaussian distribution the estimator in this approach is uniformly better than that of previously known Importance Sampling approach. For a cell averaging system, by combining this technique and group sampling, the reduction of Monte Carlo runs for a reference cell of 20 and false alarm rate of lE-6 is on the order of 170 as compared to the previously known Importance Sampling approach.

Lu, D.↗
NASA NTRS2011

Advancements in the Development of an Operational Lightning Jump Algorithm for GOES-R GLM

Rapid increases in total lightning have been shown to precede the manifestation of severe weather at the surface. These rapid increases have been termed lightning jumps, and are the current focus of algorithm development for the GOES-R Geostationary Lightning Mapper (GLM). Recent lightning jump algorithm work has focused on evaluation of algorithms in three additional regions of the country, as well as, markedly increasing the number of thunderstorms in order to evaluate the each algorithm s performance on a larger population of storms. Lightning characteristics of just over 600 thunderstorms have been studied over the past four years. The 2 lightning jump algorithm continues to show the most promise for an operational lightning jump algorithm, with a probability of detection of 82%, a false alarm rate of 35%, a critical success index of 57%, and a Heidke Skill Score of 0.73 on the entire population of thunderstorms. Average lead time for the 2 algorithm on all severe weather is 21.15 minutes, with a standard deviation of +/- 14.68 minutes. Looking at tornadoes alone, the average lead time is 18.71 minutes, with a standard deviation of +/-14.88 minutes. Moreover, removing the 2 lightning jumps that occur after a jump has been detected, and before severe weather is detected at the ground, the 2 lightning jump algorithm s false alarm rate drops from 35% to 21%. Cold season, low topped, and tropical environments cause problems for the 2 lightning jump algorithm, due to their relative dearth in lightning as compared to a supercellular or summertime airmass thunderstorm environment.

Shultz, Chris↗
DOE OSTI2020

Kilonova Luminosity Function Constraints Based on Zwicky Transient Facility Searches for 13 Neutron Star Merger Triggers during O3

We present a systematic search for optical counterparts to 13 gravitational wave (GW) triggers involving at least one neutron star during LIGO/Virgo's third observing run (O3). We searched binary neutron star (BNS) and neutron star black hole (NSBH) merger localizations with the Zwicky Transient Facility (ZTF) and undertook follow-up with the Global Relay of Observatories Watching Transients Happen (GROWTH) collaboration. The GW triggers had a median localization area of 4480 deg 2 , a median distance of 267 Mpc, and false-alarm rates ranging from 1.5 to 10 -25 yr -1 . The ZTF coverage in the g and r bands had a median enclosed probability of 39%, median depth of 20.8 mag, and median time lag between merger and the start of observations of 1.5 hr. The O3 follow-up by the GROWTH team comprised 340 UltraViolet/Optical/InfraRed (UVOIR) photometric points, 64 OIR spectra, and three radio images using 17 different telescopes. We find no promising kilonovae (radioactivity-powered counterparts), and we show how to convert the upper limits to constrain the underlying kilonova luminosity function. Initially, we assume that all GW triggers are bona fide astrophysical events regardless of false-alarm rate and that kilonovae accompanying BNS and NSBH mergers are drawn from a common population; later, we relax these assumptions. Assuming that all kilonovae are at least as luminous as the discovery magnitude of GW170817 (-16.1 mag), we calculate that our joint probability of detecting zero kilonovae is only 4.2%. If we assume that all kilonovae are brighter than-16.6 mag (the extrapolated peak magnitude of GW170817) and fade at a rate of 1 mag day -1 (similar to GW170817), the joint probability of zero detections is 7%. If we separate the NSBH and BNS populations based on the online classifications, the joint probability of zero detections, assuming all kilonovae are brighter than -16.6 mag, is 9.7% for NSBH and 7.9% for BNS mergers. Moreover, no more than <57% (<89%) of putative kilonovae could be brighter than -16.6 mag assuming flat evolution (fading by 1 mag day -1 ) at the 90% confidence level. If we further take into account the online terrestrial probability for each GW trigger, we find that no more than <68% of putative kilonovae could be brighter than -16.6 mag. Comparing to model grids, we find that some kilonovae must have M ej < 0.03 M ⊙ , X lan > 10 -4 , or φ > 30° to be consistent with our limits. We look forward to searches in the fourth GW observing run; even 17 neutron star mergers with only 50% coverage to a depth of-16 mag would constrain the maximum fraction of bright kilonovae to <25%.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2009

The Use of Meteorlogical Data to Improve Contrail Detection in Thermal Imagery over Ireland.

Aircraft induced contrails have been found to have a net warming influence on the climate system, with strong regional dependence. Persistent linear contrails are detectable in 1 Km thermal imagery and, using an automated Contrail Detection Algorithm (CDA), can be identified on the basis of their different properties at the 11 and 12 m w av.el enTgthshe algorithm s ability to distinguish contrails from other linear features depends on the sensitivity of its tuning parameters. In order to keep the number of false identifications low, the algorithm imposes strict limits on contrail size, linearity and intensity. This paper investigates whether including additional information (i.e. meteorological data) within the CDA may allow for these criteria to be less rigorous, thus increasing the contrail-detection rate, without increasing the false alarm rate.

Whelan, Gillian M.↗
DOE OSTI2020

Classification of Dissolution Events Using Fusion of Effluents Measurements and Classifiers

Classifiers for dissolution events at a radiochemical processing facility are studied using gamma spectra measurements of effluents collected by a high purity germanium detector located at its off-gas stack. Data sets collected at the Oak Ridge National Laboratory’s Radiochemical Engineering Development Center under a Pu dissolution campaign spanning a three months period are utilized. Features corresponding to the activity levels of 15 radionuclides, including isotopes of iodine, krypton, and xenon, that are indicated by the target decay chains, are computed from the spectra at 1 hour intervals. A conceptualization diagram is developed to reflect the steps from the source to measurement to feature computation that depend on fission products indicated by decay chains, chemical processing, and effluents transport to the off-gas stack. A diverse set of eight classifiers based on different design principles are trained using the ground truth data for this campaign, and the outputs of top three classifiers, namely, classification trees, Ensemble of Trees (EOT), and k-nearest neighbor, are combined using EOT classifier-fuser. Our results show that for 5-fold cross validation, features associated with isotopes of xenon provide the lowest classification error among the different elements across the classifiers; the classification error is furthered improved when all 15 isotope features are used by each classifier, and it is again improved by the fusion of three classifiers. Further reduction in classification error is achieved by using a measurement window of 1-2 days which is identified based on half-life time estimates of the isotopes; it is long enough for the stabilization of feature estimates while being short enough not to be affected by the follow on dissolution events. As a net result of feature and classifier fusion, combined with the incorporation of decay chain and isotope half-life information, this approach achieves 98% detection rate while maintaining a false alarm rate under 2% for this data set.

Rao, Nageswara↗
NASA NTRS1998

A Method for Evaluating the Safety Impacts of Air Traffic Automation

This report describes a methodology for analyzing the safety and operational impacts of emerging air traffic technologies. The approach integrates traditional reliability models of the system infrastructure with models that analyze the environment within which the system operates, and models of how the system responds to different scenarios. Products of the analysis include safety measures such as predicted incident rates, predicted accident statistics, and false alarm rates; and operational availability data. The report demonstrates the methodology with an analysis of the operation of the Center-TRACON Automation System at Dallas-Fort Worth International Airport.

Kostiuk, Peter↗
NASA NTRS2009

Processing Images of Craters for Spacecraft Navigation

A crater-detection algorithm has been conceived to enable automation of what, heretofore, have been manual processes for utilizing images of craters on a celestial body as landmarks for navigating a spacecraft flying near or landing on that body. The images are acquired by an electronic camera aboard the spacecraft, then digitized, then processed by the algorithm, which consists mainly of the following steps: 1. Edges in an image detected and placed in a database. 2. Crater rim edges are selected from the edge database. 3. Edges that belong to the same crater are grouped together. 4. An ellipse is fitted to each group of crater edges. 5. Ellipses are refined directly in the image domain to reduce errors introduced in the detection of edges and fitting of ellipses. 6. The quality of each detected crater is evaluated. It is planned to utilize this algorithm as the basis of a computer program for automated, real-time, onboard processing of crater-image data. Experimental studies have led to the conclusion that this algorithm is capable of a detection rate >93 percent, a false-alarm rate <5 percent, a geometric error <0.5 pixel, and a position error <0.3 pixel.

Cheng, Yang↗
NASA NTRS1971

Analysis of pilot warning indicator performance in terminal area traffic.

Three pilot warning indicator concepts for collision hazard avoidance are analyzed using computer fast-time simulation. A hazard measure is defined based on a 1/2-g maximum horizontal acceleration, a maximum climb or dive angle of 10 deg for each aircraft, and a 20-sec warning time, through escape completion. The traffic model is based on flight tracks recorded in the Atlanta terminal area over an 11 hr period during August 1967. The basic PWI concept studied alarms on range to flashing beacons mounted on intruder aircraft as a function of relative azimuth and elevation. The alarm-hazard epoch ratio is about 17/1 to maintain the missed-alarm rate below 10%. Beacon vignetting or range-rate discrimination are shown to reduce the false-alarm rate by about 75%.

Ruetenik, J. R.↗
DOE OSTI2022

A Double-Edged Sword: The Role of Prior Knowledge in Memory Aging

People accumulate knowledge throughout their lifespan and the accumulated knowledge influences how we encode and retrieve information in memory processing. This study aims to investigate the role of knowledge in associative memory across the adult lifespan, and specifically examines the effects of two material properties that interact with prior knowledge: congruency – whether the material is congruent with people’s prior knowledge, and ambiguity – whether the material is ambiguous to interpret based on prior knowledge. 273 participants (aged 22–70 years old) completed an incidental memory task online. Participants were shown pictures depicting an object in a scene and judged if the object was likely or unlikely to be in the particular scene. Later, in the recognition test, participants were asked to identify if the exact picture was presented earlier. The pictures were manipulated to have varying levels of congruency, meaning that some depicted likely object–scene pairs and some unlikely. We also measured how different the likely/unlikely judgment for each object–scene pair was across all participants to determine the ambiguity level of the object–scene pair: some were more likely to receive diverse responses across people, whereas others are unambiguously consistent (or inconsistent) with common knowledge shared by most people. We used mixed-effects logistic regressions to predict memory outcome for each trial as a function of age, age 2 , congruency/ambiguity, and their interactions. The object–scene pairs perceived as congruent had higher hit rates than incongruent ones, as well as higher false alarm rates, especially in middle-aged and older people. Higher ambiguity was also related to both greater true and false memory, independent of age. Finally, the effect of ambiguity only emerged when the object–scene pair was perceived incongruent. The results suggest that people rely on prior knowledge to process new information and that this reliance improves hit responses, but also induces false memories particularly for middle-aged and older people, suggesting a double-edged role of knowledge in associative memory and its disproportionate influence on memory aging. Over-reliance on knowledge in older adults, which has been suspected in other cognitive processes, may be one of the mechanisms underlying associative memory decrease in aging.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2010

Optimization of a Multi-Stage ATR System for Small Target Identification

An Automated Target Recognition system (ATR) was developed to locate and target small object in images and videos. The data is preprocessed and sent to a grayscale optical correlator (GOC) filter to identify possible regionsof- interest (ROIs). Next, features are extracted from ROIs based on Principal Component Analysis (PCA) and sent to neural network (NN) to be classified. The features are analyzed by the NN classifier indicating if each ROI contains the desired target or not. The ATR system was found useful in identifying small boats in open sea. However, due to "noisy background," such as weather conditions, background buildings, or water wakes, some false targets are mis-classified. Feedforward backpropagation and Radial Basis neural networks are optimized for generalization of representative features to reduce false-alarm rate. The neural networks are compared for their performance in classification accuracy, classifying time, and training time.

false alarm rate↗
NASA NTRS2006

NASA Taxonomies for Searching Problem Reports and FMEAs

Many types of hazard and risk analyses are used during the life cycle of complex systems, including Failure Modes and Effects Analysis (FMEA), Hazard Analysis, Fault Tree and Event Tree Analysis, Probabilistic Risk Assessment, Reliability Analysis and analysis of Problem Reporting and Corrective Action (PRACA) databases. The success of these methods depends on the availability of input data and the analysts knowledge. Standard nomenclature can increase the reusability of hazard, risk and problem data. When nomenclature in the source texts is not standard, taxonomies with mapping words (sets of rough synonyms) can be combined with semantic search to identify items and tag them with metadata based on a rich standard nomenclature. Semantic search uses word meanings in the context of parsed phrases to find matches. The NASA taxonomies provide the word meanings. Spacecraft taxonomies and ontologies (generalization hierarchies with attributes and relationships, based on terms meanings) are being developed for types of subsystems, functions, entities, hazards and failures. The ontologies are broad and general, covering hardware, software and human systems. Semantic search of Space Station texts was used to validate and extend the taxonomies. The taxonomies have also been used to extract system connectivity (interaction) models and functions from requirements text. Now the Reconciler semantic search tool and the taxonomies are being applied to improve search in the Space Shuttle PRACA database, to discover recurring patterns of failure. Usual methods of string search and keyword search fall short because the entries are terse and have numerous shortcuts (irregular abbreviations, nonstandard acronyms, cryptic codes) and modifier words cannot be used in sentence context to refine the search. The limited and fixed FMEA categories associated with the entries do not make the fine distinctions needed in the search. The approach assigns PRACA report titles to problem classes in the taxonomy. Each ontology class includes mapping words - near-synonyms naming different manifestations of that problem class. The mapping words for Problems, Entities and Functions are converted to a canonical form plus any of a small set of modifier words (e.g. non-uniformity NOT + UNIFORM.) The report titles are parsed as sentences if possible, or treated as a flat sequence of word tokens if parsing fails. When canonical forms in the title match mapping words, the PRACA entry is associated with the corresponding Problem, Entity or Function in the ontology. The user can search for types of failures associated with types of equipment, clustering by type of problem (e.g., all bearings found with problems of being uneven: rough, irregular, gritty ). The results could also be used for tagging PRACA report entries with rich metadata. This approach could also be applied to searching and tagging failure modes, failure effects and mitigations in FMEAs. In the pilot work, parsing 52K+ truncated titles (the test cases that were available), has resulted in identification of both a type of equipment and type of problem in about 75% of the cases. The results are displayed in a manner analogous to Google search results. The effort has also led to the enrichment of the taxonomy, adding some new categories and many new mapping words. Further work would make enhancements that have been identified for improving the clustering and further reducing the false alarm rate. (In searching for recurring problems, good clustering is more important than reducing false alarms). Searching complete PRACA reports should lead to immediate improvement.

Malin, Jane T.↗
NASA NTRS2003

Optical landmark detection for spacecraft navigation

In this paper, a new crater detection algorithm is suggested. Experimental studies show that this new algorithm can achieve sub-pixel accuracy in position, its detection rate is better than 90% and its false alarm rate is less than 5%. These good characteristics indicate that it is an ideal crater detection algorithm for spacecraft optical navigation.

optical↗
NASA NTRS2001

Performance Assessment of the Optical Transient Detector and Lightning Imaging Sensor: Predicted Diurnal Variability - 1

Laboratory calibration and observed background radiance data are used to determine the effective sensitivities of the Optical Transient Detector and Lightning Imaging Sensor, as functions of local hour and pixel location within the instrument arrays. The effective LIS thresholds, expressed as radiances emitted normal to cloud top, are 4.0 plus or minus 0.7 and 7.6 plus or minus 3.3 micro J/ster/m (sup 2) for night and local noon; the OTD thresholds am 11.7 plus or minus 2.2 and 16.8 plus or minus 4.6 microJ/ster/m (sup 2). LIS and OTD minimum signal to noise ratios occur from 0800 to 1600 local time, and attain values of 10 plus or minus 2 and 20 plus or minus 3, respectively. False alarm rate due to instrument noise yields approximately 5 false triggers per month for LIS, and is negligible for OTD. Flash detection efficiency, based on prior optical pulse sensor measurements, is predicted to be 93 plus or minus 4% and 73 plus or minus 11% for LIS night and noon; 56 plus or minus 7% and 44 plus or minus 9% for OTD night and noon, corresponding to a 12 - 20% diurnal variability and LIS:OTD ratio of 1.7. Use of the weighted daily mean detection efficiency (i.e., not controlling for local hour) corresponds to a sigma = 8 - 9% uncertainty. These are likely overestimates of actual flash detection efficiency due to differences in pixel ground field-of-view across the instrument arrays, which are not accounted for in the validation optical pulse sensor data.

Boccippio, Dennis J.↗
NASA NTRS1990

Initial results on fault diagnosis of DSN antenna control assemblies using pattern recognition techniques

Initial results obtained from an investigation using pattern recognition techniques for identifying fault modes in the Deep Space Network (DSN) 70 m antenna control loops are described. The overall background to the problem is described, the motivation and potential benefits of this approach are outlined. In particular, an experiment is described in which fault modes were introduced into a state-space simulation of the antenna control loops. By training a multilayer feed-forward neural network on the simulated sensor output, classification rates of over 95 percent were achieved with a false alarm rate of zero on unseen tests data. It concludes that although the neural classifier has certain practical limitations at present, it also has considerable potential for problems of this nature.

Smyth, P.↗