SEARCH · Search NASA

Results for “False Positive Rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Exoplanets in the Antarctic Sky. IV. Dual-band Photometry of Variables Found by the CSTAR-II Commissioning Survey at the North Sky

From the experiences learned in three decades of exoplanet search, wide-field transit surveys have proven to be one of the most effective ways to detect exoplanets. Wide field of view, however, suffers from high false-positive rates caused by blended eclipsing binaries. The chromaticity in eclipse depth is an effective feature to distinguish low-depth eclipsing binaries from transiting exoplanets, making multiple-band photometry follow-up advantageous before a target is passed onto more expensive spectroscopic follow-up. Moreover, a multiple-band photometric survey is itself a powerful method to find and vet planetary candidates and narrow down the candidate list of high-priority targets. In this work, we report the first results of a dual-band (Sloan-g and -i) wide-field photometry survey—the Chinese Small Telescope ARray II (CSTAR-II), an updated version of the original CSTAR. As a key component of the Chinese Exoplanet Searching Program from Antarctica, CSTAR-II has been tested thoroughly at a remote arctic site near Mohe during the winter of 2014. In total, 13,531 light curves with the best overall photometric precision of ∼3 mmag were extracted from 7721 stars in the Sloan-g and -i bands. Using a robust method, we have detected 63 variables, of which 48 are newly discovered. The dual-band photometric results as well as the stellar properties of the detected sources are provided in this work.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Detecting Anomalous Images in Astronomical Datasets

Abstract Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and sometimes not accurate. This is an important issue in weak lensing studies, particularly in the era of large-scale galaxy surveys, in which image qualities are crucial for the success of galaxy shape measurements. In this work we present two automatic methods for detecting anomalous images in astronomical data sets. The anomalous features can be divided into two types: one is associated with the source images, and the other appears on the background. Our first method, called the entropy method, utilizes the randomness of the orientation distribution of the source shapes and the background gradients to quantify the likelihood of an exposure being anomalous. Our second method involves training a neural network (autoencoder) to detect anomalies. We evaluate the effectiveness of the entropy method on the Canada–France–Hawaii Telescope Lensing Survey (CFHTLenS) and Dark Energy Camera Legacy Survey (DECaLS DR3) data. In CFHTLenS, with 1171 exposures, the entropy method outperforms human inspection by detecting 12 of the 13 anomalous exposures found during human inspection and uncovering 10 new ones. In DECaLS DR3, with 17112 exposures, the entropy method detects a significant number of anomalous exposures while keeping a low false-positive rate. We find that although the neural network performs relatively well in detecting source anomalies, its current performance is not as good as the entropy method.

Astronomy & Astrophysics↗

DOE OSTI2021

Be It Unresolved: Measuring Time Delays from Lensed Supernovae

Gravitationally lensed Type Ia supernovae (SNe Ia) may be the next frontier in cosmic probes, able to deliver independent constraints on dark energy, spatial curvature, and the Hubble constant. Measurements of time delays between the multiple images become more incisive due to the standardized candle nature of the source, monitoring for months rather than years, and partial immunity to microlensing. While currently extremely rare, hundreds of such systems should be detected by upcoming time domain surveys. Others will have the images spatially unresolved, with the observed lightcurve a superposition of time-delayed image fluxes. We investigate whether unresolved images can be recognized as lensed sources given only lightcurve information, and whether time delays can be extracted robustly. We develop a method that we show can identify these systems for the case of lensed SNe Ia with two images and time delays exceeding ten days. When tested on such an ensemble, without microlensing, the method achieves a false-positive rate of ≲5%, and measures the time delays with a completeness of ≳93% and with a bias of ≲0.5% for Δt fit ≳ 10 days. Since the method does not assume a template of any particular type of SN, the method has the (untested) potential to work on other types of lensed SNe systems and possibly on other transients as well.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

DeepZipper. II. Searching for Lensed Supernovae in Dark Energy Survey Data with Deep Learning

Gravitationally lensed supernovae (LSNe) are important probes of cosmic expansion, but they remain rare and difficult to find. Current cosmic surveys likely contain 5–10 LSNe in total while next-generation experiments are expected to contain several hundred to a few thousand of these systems. We search for these systems in observed Dark Energy Survey (DES) five year SN fields—10 3 sq. deg. regions of sky imaged in the griz bands approximately every six nights over five years. To perform the search, we utilize the DeepZipper approach: a multi-branch deep learning architecture trained on image-level simulations of LSNe that simultaneously learns spatial and temporal relationships from time series of images. We find that our method obtains an LSN recall of 61.13% and a false-positive rate of 0.02% on the DES SN field data. DeepZipper selected 2245 candidates from a magnitude-limited (m i < 22.5) catalog of 3,459,186 systems. We employ human visual inspection to review systems selected by the network and find three candidate LSNe in the DES SN fields.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1994

FRESIP: A Discovery Mission Concept To Find Earth-Sized Planets Around Solar Like Stars

The current nebular theory postulates that planets are. a consequence of the formation of stars from viscous accretion disks. Condensation from the accretion disk favors the formation of small rocky planets in the hot inner region, and the formation of gas giants in the cool outer region. Consequently, terrestrial-type planet in inner orbits should be commonplace. From geometrical considerations , Borucki and Summers have shown that 1% of planetary systems resembling our solar system should show transits for Earth-sized (or larger) planets. Thus a photometric satellite that uses a wide field of view telescope and a large detector array to simultaneously monitor 5000 target stars should detect 50 planetary systems. To differentiate regularly recurring transits from statistical fluctuations of the stellar flux, one must observe over several orbital periods so that the false positive rate can be reduced to one event or less. A one-meter aperture telescope placed in a halo orbit about either the L1 or L2 Lagrange points and viewing perpendicular to both the orbital and ecliptic planes can view continuously for the required period because neither the Sun, Earth, or Moon would enter the field of view. Model calculations show that the observations should provide statistically significant estimates of the distributions of planetary size, orbital radius, coplanarity, and the frequency of planetary systems that have Earth-sized planets in inner orbits. Because approximately one half of the star systems observed will be binary systems, the frequency of planetary systems orbiting either one or both of the stars can also be determined.

Borucki, William↗

NASA NTRS2003

Hosted Services for Advanced V and V Technologies: An Approach to Achieving Adoption without the Woes of Usage

Attempts to achieve widespread use of software verification tools have been notably unsuccessful. Even 'straightforward', classic, and potentially effective verification tools such as lint-like tools face limits on their acceptance. These limits are imposed by the expertise required applying the tools and interpreting the results, the high false positive rate of many verification tools, and the need to integrate the tools into development environments. The barriers are even greater for more complex advanced technologies such as model checking. Web-hosted services for advanced verification technologies may mitigate these problems by centralizing tool expertise. The possible benefits of this approach include eliminating the need for software developer expertise in tool application and results filtering, and improving integration with other development tools.

Koga, Dennis↗

NASA NTRS2010

Multi-Stage System for Automatic Target Recognition

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feedforward back-propagation neural network (NN) is then trained to classify each feature vector and to remove false positives. The system parameter optimizations process has been developed to adapt to various targets and datasets. The objective was to design an efficient computer vision system that can learn to detect multiple targets in large images with unknown backgrounds. Because the target size is small relative to the image size in this problem, there are many regions of the image that could potentially contain the target. A cursory analysis of every region can be computationally efficient, but may yield too many false positives. On the other hand, a detailed analysis of every region can yield better results, but may be computationally inefficient. The multi-stage ATR system was designed to achieve an optimal balance between accuracy and computational efficiency by incorporating both models. The detection stage first identifies potential ROIs where the target may be present by performing a fast Fourier domain OT-MACH filter-based correlation. Because threshold for this stage is chosen with the goal of detecting all true positives, a number of false positives are also detected as ROIs. The verification stage then transforms the regions of interest into feature space, and eliminates false positives using an artificial neural network classifier. The multi-stage system allows tuning the detection sensitivity and the identification specificity individually in each stage. It is easier to achieve optimized ATR operation based on its specific goal. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar and video image datasets.

Chao, Tien-Hsin↗

NASA NTRS2012

Modeling and Detection of Ice Particle Accretion in Aircraft Engine Compression Systems

The accretion of ice particles in the core of commercial aircraft engines has been an ongoing aviation safety challenge. While no accidents have resulted from this phenomenon to date, numerous engine power loss events ranging from uneventful recoveries to forced landings have been recorded. As a first step to enabling mitigation strategies during ice accretion, a detection scheme must be developed that is capable of being implemented on board modern engines. In this paper, a simple detection scheme is developed and tested using a realistic engine simulation with approximate ice accretion models based on data from a compressor design tool. These accretion models are implemented as modified Low Pressure Compressor maps and have the capability to shift engine performance based on a specified level of ice blockage. Based on results from this model, it is possible to detect the accretion of ice in the engine core by observing shifts in the typical sensed engine outputs. Results are presented in which, for a 0.1 percent false positive rate, a true positive detection rate of 98 percent is achieved.

May, Ryan D.↗

NASA NTRS2009

Neural Network Target Identification System for False Alarm Reduction

ATR↗

NASA NTRS2021

Cloud Detection over Sunglint Regions with Observations from the Earth Polychromatic Imaging Camera (EPIC)

With the ability to observe the entire sunlit side of the Earth, EPIC data have become an important resource for studying cloud daily variability. Inaccurate cloud masking is a great source of uncertainty. One main region that is prone to error in cloud masking is the sunglint area over ocean surfaces. Cloud detection over these regions is challenging for the EPIC instrument because of its limited spectral channels. Clear sky ocean surface reflectance from visible channels over sunglint is much larger than that over the non-glint areas and can exceed reflectance from thin clouds. This paper presents an improved EPIC ocean cloud masking algorithm (Version 3). Over sunglint regions (glint angle ≤ 25°), the algorithm utilizes EPIC’s oxygen (O2) A-band ratio (764nm to 780 nm) in addition to the 780 nm reflectance observations in masking tests. Outside the sunglint regions, a dynamic reflectance threshold for the Rayleigh corrected 780 nm reflectance is applied. The thresholds are derived as a function of glint angle. When compared with co-located data from the geosynchronous Earth orbit (GEO) and the low Earth orbit (LEO) observations, the consistency of the new ocean cloud mask algorithm has increased by 4~10% and 4~6% in the glint center and granule edges respectively. The false positive rate is reduced by 10~17%. Overall global ocean cloud detection consistency increases by 2%. This algorithm, along with other improvements to the EPIC cloud masks, has been implemented in the EPIC cloud products Version 3. This algorithm will improve the cloud daily variability analysis by removing the artificial peak at local noon time in the glint center latitudes and reducing biases in the early morning and late afternoon cloud fraction over ocean surfaces.

EPIC↗

DOE OSTI2026

Pushing the Limits of Pulse Shape Discrimination in a Large Liquid Xenon Detector

The LUX-ZEPLIN (LZ) experiment is a direct-detection dark matter experiment, optimized to search for weakly interacting massive particles (WIMPs) through WIMP-nucleon interactions. The main challenge in dark matter detection is differentiating between WIMP signals and background events. In LZ, the ratio of ionization to scintillation signals (charge-to-light) is the primary method for rejecting electronic recoil (ER) background. Pulse shape discrimination (PSD) offers a method for additional ER backgrounds rejection in liquid xenon detectors. In this paper, the discrimination power of PSD with the LZ experiment is discussed. To precisely characterize the scintillation pulse shape, an analysis framework is developed to reconstruct the detection time of individual photons. Using LZ calibration data, the photon-timing prompt fraction discriminator is optimized and achieves ER leakage as low as $15\%$. For specific background processes such as $^{124}$Xe double electron capture, the leakage is reduced further to about $5\%$. PSD is combined with charge-to-light to form two-factor discrimination (TFD). The optimized TFD performance is compared with the performance of the charge-to-light method, with the corresponding false positive rate reduced by up to a factor of two for large scintillation pulses. Finally, PSD and TFD are applied to data from LZ's WS2024 run and their performance is summarized.

Akerib, D. S. [SLAC; KIPAC, Menlo Park]↗

DOE OSTI2026

Real-Time Detection of Charge Jumps in Superconducting Qubits with a Convolutional Neural Network

Ionizing radiation from cosmic rays and gammas can induce discontinuous jumps in the environmental charge of superconducting qubits (charge jumps), causing correlated errors that challenge fault-tolerant quantum computing while simultaneously providing a detection signature for quantum sensing applications. Current detection methods operate offline, introducing latency incompatible with in-the-loop qubit control. In this paper, an online detector of charge jumps for superconducting qubits, based on a dilated causal convolutional neural network (DCCNN) designed for in-the-loop deployment on the Quantum Instrumentation Control Kit (QICK) platform, is presented. The network is trained on synthetic Ramsey tomography scans generated from qubit templates measured at the Northwestern Experimental Underground Site (NEXUS) at Fermilab, and translated to FPGA firmware via hls4ml with ap_fixed$\langle 16,6 \rangle$ quantization, reaching a per-inference latency of $6.19 μ$s on the Zynq UltraScale+ RFSoC ZCU216. At this operating point the DCCNN matches the detection efficiency of the established offline $χ^2$ algorithm ($0.843 \pm 0.022$ vs. $0.866 \pm 0.020$ on $|Δq| \in [0.1, 0.5] e$ at matched false-positive rate), while requiring no per-qubit hyperparameter tuning. This shifts charge-jump detection from a post-hoc diagnostic to a control-loop primitive, enabling adaptive protocols that respond to radiation-induced events in situ, with applications to quantum-computing error mitigation and to the use of superconducting qubits as particle detectors.

Gaytan-Villarreal, Daniel [Carnegie Mellon U.]↗

DOE OSTI2022

A new algorithm for estimating radioxenon concentrations

A new algorithm (Xcounts) is introduced for estimating the activity concentrations of the xenon isotopes 131m Xe, 133m Xe, 133 Xe, and 135 Xe using beta-gamma coincidence data. The algorithm simultaneously estimates the decay counts associated with the four xenon isotopes, background, and radon in contrast to the net-counts method that uses sequential residual removal to account for background and interreferences. Calibration data for background counts are determined from gas-background measurements and simulation. In Xcounts, the false positive count rates for 131m Xe and 133m Xe are lower than the false positive rates for 133 Xe and 135 Xe. This algorithm appears to reliably detect the metastable isotopes at lower activity levels than the net-counts method and have similar performance for the other isotopes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data

Attaining Industry 4.0 for manufacturing operations requires advanced monitoring systems and real-time data analytics of plant data, among other topics. We propose a Probabilistic Bidirectional Recurrent Network (PBRN) for industrial process monitoring for the early detection of faults. The model is based on a Gated Recurrent Unit (GRU) neural network that allows the model to retain long-term dependencies between sensor data along a time horizon, hence learning the dynamic behavior of the process. To reduce the false-positive detection rate of the model, we compel the model to learn from a highly noisy sensor reading while outputting noise-free sensor outputs. The performance of the proposed model is compared to other data-driven statistical process monitoring schemes using real plant data from an industrial Air Separations Unit (ASU) containing noisy sensor readings. We show that the model can learn from noisy data without reducing its performance. Using two different fault cases, we demonstrate the model’s ability to carry out early fault detection with average false-positive rates of 2.9% and 4.9% for both fault cases. The missed detection rates are 0.1% and 0.2%, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS2011

Daytime Water Detection Based on Sky Reflections

Robust water detection is a critical perception requirement for unmanned ground vehicle (UGV) autonomous navigation. This is particularly true in wide-open areas where water can collect in naturally occurring terrain depressions during periods of heavy precipitation and form large water bodies. One of the properties of water useful for detecting it is that its surface acts as a horizontal mirror at large incidence angles. Water bodies can be indirectly detected by detecting reflections of the sky below the horizon in color imagery. The Jet Propulsion Laboratory (JPL) has implemented a water detector based on sky reflections that geometrically locates the pixel in the sky that is reflecting on a candidate water pixel on the ground and predicts if the ground pixel is water based on color similarity and local terrain features. This software detects water bodies in wide-open areas on cross-country terrain at mid- to far-range using imagery acquired from a forward-looking stereo pair of color cameras mounted on a terrestrial UGV. In three test sequences approaching a pond under a clear, overcast, and cloudy sky, the true positive detection rate was 100% when the UGV was beyond 7 meters of the water's leading edge and the largest false positive detection rate was 0.58%. The sky reflection based water detector has been integrated on an experimental unmanned vehicle and field tested at Ft. Indiantown Gap, PA, USA.

sky reflections↗

NASA NTRS1981

The effect of abnormal cell proportion on specimen classifier performance

An analysis is presented of the results obtained from a cell classifier which is confronted with an abnormal/normal cell ratio which is different from the ratio assumed in the calibration of the classifier. False negative and false positive error rates are determined in advance for classifier operation, along with the necessary sample size in order to validate the predicted distributions. Changes are demonstrated to happen only regarding the false negative rate, where reductions in the abnormal cell rate below the expected rates would cause totally unreliable data. Substantial overproduction of abnormal cells would be quickly noticeable, while production rates beyond, but close to, the expected rates would only require more extensive sampling. Classifier systems for 10% proportions of abnormal cells are concluded to be possible, but difficulties are present with much lower rates

Castleman, K. R.↗

DOE OSTI2026

Automating Detection and Diagnosis of Faults, Failures, and Underperformance in PV Plants

The project developed hybrid physics-based and machine-learning methods for near-real-time detection of balance-of-system faults (e.g., string, combiner, and tracker outages) in utility-scale Photovoltaic plants, achieving over 50% true positive rates with under 10% false positives and significantly reducing engineering setup time. In the extended phase, the scope expanded to plant-level underperformance analysis and industry benchmarking through the SUPER.epri.com platform. SUPER standardizes data processing and performance metrics across more than 9 GWac and 120+ plants, enabling robust comparisons and insights into loss rates, inverter downtime, and capacity degradation.

14 SOLAR ENERGY↗

DOE OSTI2023

A comparison of machine learning methods to classify radioactive elements using prompt-gamma-ray neutron activation data

The detection of illicit radiological materials is critical to establishing a robust second line of defence in nuclear security. Neutron-capture prompt-gamma activation analysis (PGAA) can be used to detect multiple radioactive materials across the entire Periodic Table. However, long detection times and a high rate of false positives pose a significant hindrance in the deployment of PGAA-based systems to identify the presence of illicit substances in nuclear forensics. In the present work, six different machine-learning algorithms were developed to classify radioactive elements based on the PGAA energy spectra. The model performance was evaluated using standard classification metrics and trend curves with an emphasis on comparing the effectiveness of algorithms that are best suited for classifying imbalanced datasets. We analyse the classification performance based on Precision, Recall, F1-score, Specificity, Confusion matrix, ROC-AUC curves, and Geometric Mean Score (GMS) measures. The tree-based algorithms (Decision Trees, Random Forest and AdaBoost) have consistently outperformed Support Vector Machine and K-Nearest Neighbours. Based on the results presented, AdaBoost is the preferred classifier to analyse data containing PGAA spectral information due to the high recall and minimal false negatives reported in the minority class.

97 MATHEMATICS AND COMPUTING↗