Search NASA⌕ Search

SEARCH · Search NASA

Results for “false alarm rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Radiation Dosimetry via Automated Fluorescence Microscopy

A developmental instrument for assessment of radiation-induced damage in human lymphocytes includes an automated fluorescence microscope equipped with a one or more chargecoupled- device (CCD) video camera(s) and circuitry to digitize the video output. The microscope is also equipped with a three-axis translation stage that includes a rotation stage, and a rotary tray that holds as many as thirty specimen slides. The figure depicts one version of the instrument. Once the slides have been prepared and loaded into the tray, the instrument can operate unattended. A computer controls the operation of the stage, tray, and microscope, and processes the digital fluorescence-image data to recognize and count chromosomes that have been broken, presumably by radiation. The design and method of operation of the instrument exploit fluorescence in situ hybridization (FISH) of metaphase chromosome spreads, which is a technique that has been found to be valuable for monitoring the radiation dose to circulating lymphocytes. In the specific FISH protocol used to prepare specimens for this instrument, metaphase lymphocyte cultures are chosen for high mitotic index and highly condensed chromosomes, then several of the largest chromosomes are labeled with three of four differently colored whole-chromosome-staining dyes. The three dyes, which are used both individually and in various combinations, are fluorescein isothiocyanate (FITC), Texas Red (or equivalent), and Cy5 (or equivalent); The fourth dye 4',6-diamidino- 2-phenylindole (DAPI) is used as a counterstain. Under control by the computer, the microscope is automatically focused on the cells and each slide is scanned while the computer analyzes the DAPI-fluorescence images to find the metaphases. Each metaphase field is recentered in the field of view and refocused. Then a four-color image (more precisely, a set of images of the same view in the fluorescent colors of the four dyes) is acquired. By use of pattern-recognition software developed specifically for this instrument, the images in the various colors are processed to recognize the metaphases and count the chromosome fragments of each color within the metaphases. The intermediate results are then further processed to estimate the proportion of cells that have suffered genetic damage. The prototype instrument scans at an average areal rate of 4.7 mm2/h in unattended operation, finding about 14 metaphases per hour. The false-alarm rate is typically less than 3 percent, and the metaphase-miss rate has been estimated to be less than 5 percent. The counts of chromosomes and fragments thereof are 50 to 70 percent accurate.

Castleman, Kenneth R.↗

Sensory redundancy management: The development of a design methodology for determining threshold values through a statistical analysis of sensor output data

Sensor redundancy management (SRM) requires a system which will detect failures and reconstruct avionics accordingly. A probability density function to determine false alarm rates, using an algorithmic approach was generated. Microcomputer software was developed which will print out tables of values for the cummulative probability of being in the domain of failure; system reliability; and false alarm probability, given a signal is in the domain of failure. The microcomputer software was applied to the sensor output data for various AFT1 F-16 flights and sensor parameters. Practical recommendations for further research were made.

Scalzo, F.↗

Short–Term Forecasting of Wind Gusts at Airports Across CONUS Using Machine Learning

Short–term forecasting of wind gusts, particularly those of higher intensity, is of great societal importance but is challenging due to the presence of multiple gust generation mechanisms. Wind gust observations from eight high–passenger–volume airports across the continental United States (CONUS) are summarized and used to develop predictive models of wind gust occurrence and magnitude. These short–term (same hour) forecast models are built using multiple logistic and linear regression, as well as artificial neural networks (ANNs) of varying complexity. A suite of 19 upper–air predictors drawn from the ERA5 reanalysis and an autoregressive (AR) term are used. Stepwise procedures instruct predictor selection, and resampling is used to quantify model stability. All models are developed separately for the warm (April–September) and cold (October–March) seasons. Results show that ANNs of 3–5 hidden layers (HLs) generally exhibit higher hit rates than logistic regression models and also improve skill with respect to wind gust magnitudes. However, deeper networks with more HLs increase false alarm rates in occurrence models and mean absolute error in magnitude models due to model overfitting. For model skill, inclusion of the AR term is critical while the majority of the remaining skill derives from wind speeds and lapse rates. A predictive ceiling is also clearly demonstrated, particularly for the strong and damaging gust magnitudes, which appears to be partially due to ERA5 predictor characteristics and the presence of mixed wind climates.

54 ENVIRONMENTAL SCIENCES↗

Conceptual design of a spaceborne lightning sensor

A conceptual design of a broad-area optical lightning telescope sensor (BOLTS) designed to provide full-time (day/night) coverage of the continental United States from a geosynchronous orbit is described. Variations are discussed that could cover the whole globe from four to five geosynchronous satellites or cover only smaller areas with a high (2.5 km) resolution. The design is based on research results of the initial phase of a NASA-sponsored program. The ground resolution will be 8 x 8 km. The focal plane is an 800 x 800 pixel CCD array, electronically subdivided to allow for the high data rates (1000 frames per sec) imposed by the characteristics of lightning flashes. It will detect lightning strokes whose optical power is greater than 10 million watts, with a probability of detection of 0.9, and a false alarm rate of 0.1.

Wolfe, W. L.↗

Lightning Jump Algorithm Development for the GOES·R Geostationary Lightning Mapper

Current work on the lightning jump algorithm to be used in GOES‐R Geostationary Lightning Mapper (GLM)'s data stream is multifaceted due to the intricate interplay between the storm tracking, GLM proxy data, and the performance of the lightning jump itself. This work outlines the progress of the last year, where analysis and performance of the lightning jump algorithm with automated storm tracking and GLM proxy data were assessed using over 700 storms from North Alabama. The cases analyzed coincide with previous semi‐objective work performed using total lightning mapping array (LMA) measurements in Schultz et al. (2011). Analysis shows that key components of the algorithm (flash rate and sigma thresholds) have the greatest influence on the performance of the algorithm when validating using severe storm reports. Automated objective analysis using the GLM proxy data has shown probability of detection (POD) values around 60% with false alarm rates (FAR) around 73% using similar methodology to Schultz et al. (2011). However, when applying verification methods similar to those employed by the National Weather Service, POD values increase slightly (69%) and FAR values decrease (63%). The relationship between storm tracking and lightning jump has also been tested in a real‐time framework at NSSL. This system includes fully automated tracking by radar alone, real‐time LMA and radar observations and the lightning jump. Results indicate that the POD is strong at 65%. However, the FAR is significantly higher than in Schultz et al. (2011) (50‐80% depending on various tracking/lightning jump parameters) when using storm reports for verification. Given known issues with Storm Data, the performance of the real‐time jump algorithm is also being tested with high density radar and surface observations from the NSSL Severe Hazards Analysis & Verification Experiment (SHAVE).

Schultz. E.↗

Error Correction Decoding for Underwater Acoustic Tag Detection

This paper presents a decoding method applied to a set of underwater acoustic tags that employ very short signal beacons periodically transmitted. The tags use the CRC8- Dallas linear block code for error detection originally. Though the CRC8-Dallas is quite weak, syndrome-based error correction is applied to correct the decoding errors. Meanwhile, multi-channel array receivers are utilized to find the common decodes of the tag IDs, and the list of the true tag IDs is used to test the detection accuracy and false alarm rate. The proposed syndrome decoding method is applied to over 2 million files recorded in field experiments. The results demonstrate that the syndrome method yields around 9.85% more true positive decodes at the cost of a 2 - 5 times increase in false positive rates. Further insights are also gained to enable future improvement of the detection algorithms

Hall, Joseph↗

Modeling Kepler Transit Light Curves as False Positives: Rejection of Blend Scenarios for Kepler-9, and Validation of Kepler-9 d, a Super-Earth-Size Planet in a Multiple System

Light curves from the Kepler Mission contain valuable information on the nature of the phenomena producing the transit-like signals. To assist in exploring the possibility that they are due to an astrophysical false positive we describe a procedure (BLENDER) to model the photometry in terms of a blend rather than a planet orbiting a star. A blend may consist of a background or foreground eclipsing binary (or star-planet pair) whose eclipses are attenuated by the light of the candidate and possibly other stars within the photometric aperture. We apply BLENDER to the case of Kepler-9 (KIC 3323887), a target harboring two previously confirmed Saturn-size planets (Kepler-9 b and Kepler-9 c) showing transit timing variations, and an additional shallower signal with a 1.59 day period suggesting the presence of a super-Earth-size planet. Using BLENDER together with constraints from other follow-up observations we are able to rule out all blends for the two deeper signals and provide independent validation of their planetary nature. For the shallower signal, we rule out a large fraction of the false positives that might mimic the transits. The false alarm rate for remaining blends depends in part (and inversely) on the unknown frequency of small-size planets. Based on several realistic estimates of this frequency, we conclude with very high confidence that this small signal is due to a super-Earth-size planet (Kepler-9 d) in a multiple system, rather than a false positive. The radius is determined to be 1.64(exp)(sub-14),R, and current spectroscopic observations are as yet insufficient to establish its mass.

PLANETARY SYSTEMS↗

All-Sky Search for Short Gravitational-Wave Bursts in the Third Advanced LIGO and Advanced Virgo Run

This paper presents the results of a search for generic short-duration gravitational-wave transients in datafrom the third observing run of Advanced LIGO and Advanced Virgo. Transients with durations ofmilliseconds to a few seconds in the 24–4096 Hz frequency band are targeted by the search, with noassumptions made regarding the incoming signal direction, polarization, or morphology. Gravitationalwaves from compact binary coalescences that have been identified by other targeted analyses are detected,but no statistically significant evidence for other gravitational wave bursts is found. Sensitivities to a varietyof signals are presented. These include updated upper limits on the source rate density as a function of thecharacteristic frequency of the signal, which are roughly an order of magnitude better than previous upperlimits. This search is sensitive to sources radiating as little as∼10−10M⊙c2in gravitational waves at∼70Hz from a distance of 10 kpc, with 50% detection efficiency at a false alarm rate of one per century.The sensitivity of this search to two plausible astrophysical sources is estimated: neutron starfmodes,which may be excited by pulsar glitches, as well as selected core-collapse supernova models.

R Abbott↗

Detecting Low-level Radiation Sources Using Border Monitoring Gamma Sensors

We consider a problem of detecting a low-level radiation source using a network of Gamma spectral sensors placed on the periphery of a monitored region. We propose a computationally light-weight, correlation-based method which is primarily intended for systems with limited computing capacity. Sensor measurements are combined at the fusion by first generating decisions at each time step and then taking their majority vote within a time widow. At each time step, decisions are generated using two strategies: (i) SUM method based on a threshold decision on a correlation statistic derived from measurements from all sensors, and (ii) OR method based on logical-OR of threshold decisions based on correlations statistics of individual sensor measurements. We derive analytical performance bounds for false alarm rates of SUM and OR methods, and show that their performance is enhanced by the temporal smoothing of majority vote within a time window. Using measurements from a test campaign, we generate a border monitoring scenario with twelve 2"x2" NaI Gamma sensors deployed on the periphery of 42m x 42m outdoor region. A Cs-137 source is moved in a straight-line across this region, starting several meters outside and finally moving away from it. We illustrate the performance of both correlation-based detection methods, and compare their performances with each other and with a particle filter method. Overall, under small false-alarm conditions, the OR fusion is found to produce better detection performance.

Sen, Satyabrata↗

Sensitivity and Bias in Searches of Cockpit Display of Traffic Information Utilizing Highlighting/Lowlighting

A previous investigation showed that when bright and dim traffic symbols were mixed together on a cockpit display of traffic information, dim targets required longer search times than bright targets. The current experiment utilized Signal Detection methodology to determine the cause of this effect. Two factors were manipulated, Intensity and Mixture. The Intensity manipulation varied whether targets were bright or dim. The Mixture manipulation varied whether the brightness of all aircraft symbols was the same, or if half were bright and half dim. Participants were given 1.25 s to search a display of eight aircraft and determine whether a target was present or absent (50% of the time a target was present) and then rated their confidence in the accuracy of their decision. A Mixture by Intensity repeated-measures ANOVA on the signal detectability measure, A (a non- parametric variant of d ), revealed that targets presented at the dim intensity in the mixed condition yielded significantly lower sensitivity than either of the pure (homogenous) conditions or the bright targets in the mixed condition. There was not a significant difference in False Alarm rates between any conditions, indicating no change in decision criterion. Findings are discussed in terms of possible masking effects evoked by bright aircraft over the dim aircraft. Funding for this work was provided by the Advanced Air Transportation Technologies Project of NASA s Airspace Operation Systems Program.

Johnson, Walter W.↗

Preliminary Development and Evaluation of Lightning Jump Algorithms for the Real-Time Detection of Severe Weather

Previous studies have demonstrated that rapid increases in total lightning activity (intracloud + cloud-to-ground) are often observed tens of minutes in advance of the occurrence of severe weather at the ground. These rapid increases in lightning activity have been termed "lightning jumps." Herein, we document a positive correlation between lightning jumps and the manifestation of severe weather in thunderstorms occurring across the Tennessee Valley and Washington D.C. A total of 107 thunderstorms were examined in this study, with 69 of the 107 thunderstorms falling into the category of non-severe, and 38 into the category of severe. From the dataset of 69 isolated non-severe thunderstorms, an average peak 1 minute flash rate of 10 flashes/min was determined. A variety of severe thunderstorm types were examined for this study including an MCS, MCV, tornadic outer rainbands of tropical remnants, supercells, and pulse severe thunderstorms. Of the 107 thunderstorms, 85 thunderstorms (47 non-severe, 38 severe) from the Tennessee Valley and Washington D.C tested 6 lightning jump algorithm configurations (Gatlin, Gatlin 45, 2(sigma), 3(sigma), Threshold 10, and Threshold 8). Performance metrics for each algorithm were then calculated, yielding encouraging results from the limited sample of 85 thunderstorms. The 2(sigma) lightning jump algorithm had a high probability of detection (POD; 87%), a modest false alarm rate (FAR; 33%), and a solid Heidke Skill Score (HSS; 0.75). A second and more simplistic lightning jump algorithm named the Threshold 8 lightning jump algorithm also shows promise, with a POD of 81% and a FAR of 41%. Average lead times to severe weather occurrence for these two algorithms were 23 minutes and 20 minutes, respectively. The overall goal of this study is to advance the development of an operationally-applicable jump algorithm that can be used with either total lightning observations made from the ground, or in the near future from space using the GOES-R Geostationary Lightning Mapper.

Schultz, Christopher J.↗

Total Lightning Activity Associated with Tornadic Storms

Severe storms often have high flash rates (in excess of one flash per second) and are dominated by intracloud lightning activity. In addition to the extraordinary flash rates, there is a second distinguishing lightning characteristic of severe storms that seems to be important. When the total lightning history is examined, one finds sudden increases in the lightning rate, which we refer to as lightning "jumps," that precede the occurrence of severe weather by ten or more minutes. These jumps are typically 30-60 flashes/min, and are easily identified as anomalously large derivatives in the flash rate. This relationship is associated with updraft intensification and updraft strength is an important factor in storm severity (through the accumulation of condensate aloft and the stretching of vorticity). In several cases, evidence for diminishment of midlevel rotation and the descent of angular momentum from aloft is present prior to the appearance of the surface tornado. Based on our experience with severe and tornadic storms in Central Florida, we believe the total lightning may augment the more traditional use of NEXRAD radars and storm spotters. However, a more rigorous relation of these jumps to storm kinematics is needed if we are to apply total lightning in a decision tree that leads to improved warning lead times and decreased false alarm rates.

Goodman, Steven J.↗

MAG4 Versus Alternative Techniques for Forecasting Active-Region Flare Productivity

MAG4 is a technique of forecasting an active region's rate of production of major flares in the coming few days from a free-magnetic-energy proxy. We present a statistical method of measuring the difference in performance between MAG4 and comparable alternative techniques that forecast an active region's major-flare productivity from alternative observed aspects of the active region. We demonstrate the method by measuring the difference in performance between the "Present MAG4" technique and each of three alternative techniques, called "McIntosh Active-Region Class," "Total Magnetic Flux," and "Next MAG4." We do this by using (1) the MAG4 database of magnetograms and major-flare histories of sunspot active regions, (2) the NOAA table of the major-flare productivity of each of 60 McIntosh active-region classes of sunspot active regions, and (3) five technique-performance metrics (Heidke Skill Score, True Skill Score, Percent Correct, Probability of Detection, and False Alarm Rate) evaluated from 2000 random two-by-two contingency tables obtained from the databases. We find that (1) Present MAG4 far outperforms both McIntosh Active-Region Class and Total Magnetic Flux, (2) Next MAG4 significantly outperforms Present MAG4, (3) the performance of Next MAG4 is insensitive to the forward and backward temporal windows used, in the range of one to a few days, and (4) forecasting from the free-energy proxy in combination with either any broad category of McIntosh active-region classes or any Mount Wilson active-region class gives no significant performance improvement over forecasting from the free-energy proxy alone (Present MAG4).

Falconer, David A.↗

MAG4 Versus Alternative Techniques for Forecasting Active-Region Flare Productivity

MAG4 is a technique of forecasting an active region's rate of production of major flares in the coming few days from a free-magnetic-energy proxy. We present a statistical method of measuring the difference in performance between MAG4 and comparable alternative techniques that forecast an active region's major-flare productivity from alternative observed aspects of the active region. We demonstrate the method by measuring the difference in performance between the "Present MAG4" technique and each of three alternative techniques, called "McIntosh Active-Region Class," "Total Magnetic Flux," and "Next MAG4." We do this by using (1) the MAG4 database of magnetograms and major-flare histories of sunspot active regions, (2) the NOAA table of the major-flare productivity of each of 60 McIntosh active-region classes of sunspot active regions, and (3) five technique-performance metrics (Heidke Skill Score, True Skill Score, Percent Correct, Probability of Detection, and False Alarm Rate) evaluated from 2000 random two-by-two contingency tables obtained from the databases. We find that (1) Present MAG4 far outperforms both McIntosh Active-Region Class and Total Magnetic Flux, (2) Next MAG4 significantly outperforms Present MAG4, (3) the performance of Next MAG4 is insensitive to the forward and backward temporal windows used, in the range of one to a few days, and (4) forecasting from the free-energy proxy in combination with either any broad category of McIntosh active-region classes or any Mount Wilson active-region class gives no significant performance improvement over forecasting from the free-energy proxy alone (Present MAG4).

Falconer, David A.↗

Monitoring and flaw detection during wire-based directed energy deposition using in-situ acoustic sensing and wavelet graph signal analysis

The goal of this work is to detect flaw formation in the wire-based directed energy deposition (W-DED) process using in-situ sensor data. The W-DED studied in this work is analogous to metal inert gas electric arc welding. The adoption of W-DED in industry is limited because the process is susceptible to stochastic and environmental disturbances that cause instabilities in the electric arc, eventually leading to flaw formation, such as porosity and suboptimal geometric integrity. Moreover, due to the large size of W-DED parts, it is difficult to detect flaws post-process using non-destructive techniques, such as X-ray computed tomography. Accordingly, the objective of this work is to detect flaw formation in W-DED parts using data acquired from an acoustic (sound) sensor installed near the electric arc. To realize this objective, we develop and apply a novel wavelet integrated graph theory approach. The approach extracts a single feature called graph Laplacian Fiedler number from the noise-contaminated acoustic sensor data, which is subsequently tracked in a statistical control chart. Using this approach, the onset of various types of flaws are detected with a false alarm rate less-than 2%. This work demonstrates the potential of using advanced data analytics for in-situ monitoring of W-DED.

42 ENGINEERING↗

The System for Classification of Low-Pressure Systems (SyCLoPS): An All-In-One Objective Framework for Large-Scale Data Sets

We propose the first unified objective framework (SyCLoPS) for detecting and classifying all types of low-pressure systems (LPSs) in a given data set. We use the state-of-the-art automated feature tracking software TempestExtremes (TE) to detect and track LPS features globally in ERA5 and compute 16 parameters from commonly found atmospheric variables for classification. A Python classifier is implemented to classify all LPSs at once. The framework assigns 16 different labels (classes) to each LPS data point and designates four different types of high-impact LPS tracks, including tracks of tropical cyclone (TC), monsoonal system, subtropical storm and polar low. The classification process involves disentangling high-altitude and drier LPSs, differentiating tropical and non-tropical LPSs using novel criteria, and optimizing for the detection of the four types of high-impact LPS. A comparison of our labels with those in the International Best Track Archive for Climate Stewardship (IBTrACS) revealed an overall accuracy of 95% in distinguishing between tropical systems, extratropical cyclones, and disturbances. SyCLoPS produces a better TC detection skill compared to the previous algorithms, highlighted by an approximately 6% reduction in the false alarm rate compared to the previous TE algorithm. The vertical cross section composite of the four types of high-impact LPS we detect each shows distinct structural characteristics. Finally, we demonstrate that SyCLoPS is valuable for investigating various aspects of LPSs in climate data, such as the evolution of a single LPS track, patterns of LPS frequencies, and precipitation or wind influence associated with a particular LPS class.

54 ENVIRONMENTAL SCIENCES↗

Search for subsolar-mass black hole binaries in the second part of Advanced LIGO’s and Advanced Virgo’s third observing run

ABSTRACT We describe a search for gravitational waves from compact binaries with at least one component with mass $0.2$–$1.0 \, \mathrm{M}_\odot$ and mass ratio q ≥ 0.1 in Advanced Laser Interferometer Gravitational-Wave Observatory (LIGO) and Advanced Virgo data collected between 2019 November 1, 15:00 utc and 2020 March 27, 17:00 utc. No signals were detected. The most significant candidate has a false alarm rate of $0.2 \, \rm {yr}^{-1}$. We estimate the sensitivity of our search over the entirety of Advanced LIGO’s and Advanced Virgo’s third observing run, and present the most stringent limits to date on the merger rate of binary black holes with at least one subsolar-mass component. We use the upper limits to constrain two fiducial scenarios that could produce subsolar-mass black holes: primordial black holes (PBH) and a model of dissipative dark matter. The PBH model uses recent prescriptions for the merger rate of PBH binaries that include a rate suppression factor to effectively account for PBH early binary disruptions. If the PBHs are monochromatically distributed, we can exclude a dark matter fraction in PBHs $f_\mathrm{PBH} \gtrsim \, 0.6$ (at 90 per cent confidence) in the probed subsolar-mass range. However, if we allow for broad PBH mass distributions, we are unable to rule out fPBH = 1. For the dissipative model, where the dark matter has chemistry that allows a small fraction to cool and collapse into black holes, we find an upper bound fDBH < 10−5 on the fraction of atomic dark matter collapsed into black holes.

79 ASTRONOMY AND ASTROPHYSICS↗