Search NASA⌕ Search

SEARCH · Search NASA

Results for “false data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

An experiment protocol for a search for radio signals of extraterrestrial intelligent origin in the presence of man-made radio frequency sources

Some aspects of signal extraction in a microwave search for evidence of extraterrestrial intelligence are examined. Parametric relations are summarized which are applicable to a microwave search of constrained duration that employs FFT spectrum-analyzer receivers, with sensitivity enhancement by spectrum accumulation and detection by a threshold criterion. Three types of natural and man-made false alarms are identified, the probability of false alarm in a single data channel is computed, and the implications of false alarms for a constant-beamwidth sky survey are considered. It is shown that the key to an efficient search is the prompt and unambiguous elimination of false alarms. An experimental protocol is suggested which eliminates spurious signals primarily through procedural techniques involving antenna repointing, delayed repeated observations, and storage of particular historical parameters for suspect signals.

Edelson, R. E.↗

Detecting and Removing Data Artifacts in Hadamard Transform Ion Mobility-Mass Spectrometry Measurements

Applying Hadamard transform multiplexing to ion mobility separations (IMS) can significantly improve the signal-to-noise ratio and throughput for IMS coupled mass spectrometry (MS) measurements by increasing the ion utilization efficiency. However, it has been determined that both fluctuations in ion intensity as well as spatial shifts in the multiplexed data lower the signal-to-noise ratios and appear as noise in downstream processing of the data. To address this problem, we have developed a novel algorithm that discovers and eliminates data artifacts. The algorithm uses knowledge of the true signal peaks derived from the encoded data and allows for both artifacts and noise to be removed with high confidence, decreasing the likelihood of false identifications in subsequent data processing. The result is that IMS-MS can be applied to increase measurement sensitivity while avoiding artifacts that have previously limited its utility.

47 OTHER INSTRUMENTATION↗

Evaluating resilience of DNP3-controlled SCADA systems against event buffer flooding

The DNP3 protocol is widely used in SCADA systems (particularly electrical power) as a means of communicating observed sensor state information back to a control center. Typical architectures using DNP3 have a two level hierarchy, where a specialized data aggregator device receives observed state from devices within a local region, and the control center collects the aggregated state from the data aggregator. The DNP3 communication between control center and data aggregator is asynchronous with the DNP3 communication between data aggregator and relays; this leads to the possibility of completely filling a data aggregator's buffer of pending events, when a relay is compromised or spoofed and sends overly many (false) events to the data aggregator. This paper investigates how a real-world SCADA device responds to event buffer flooding. A Discrete-Time Markov Chain (DTMC) model is developed for understanding this. The DTMC model is validated by a Moebius simulation model and data collected on real SCADA testbed.

42 ENGINEERING↗

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

Timestamp Shift Detection for Synchrophasor Data Based on Similarity Analysis between Relative Phase Angle and Frequency

Timestamp Shift (TS) in synchrophasor data can lead to false operation of synchrophasor-based wide-area monitoring, protection and control applications. The letter presents a method to detect TS of synchrophasor data based on similarity analysis between its own relative phase angle and frequency. Here, a linear correlation component, caused by TS, between relative phase angle and measured frequency is discovered via theoretical derivation. Then a detection method is developed utilizing this linear component for TS diagnosis. Firstly, system phase angle is leveraged as angle reference and then relative phase angle is calculated. Secondly, the correlation coefficient between relative phase angle and frequency is calculated for similarity analysis. Thirdly, the TS is detected via threshold criterion and corresponding time error is estimated. The effectiveness of this method is validated via experiments with actual synchrophasor data in FNET/Grideye.

97 MATHEMATICS AND COMPUTING↗

THE THIRD SWIFT BURST ALERT TELESCOPE GAMMA-RAY BURST CATALOG

To date, the Burst Alert Telescope (BAT) onboard Swift has detected ∼1000 gamma-ray bursts (GRBs), of which ∼360 GRBs have redshift measurements, ranging from z = 0.03 to z = 9.38. We present the analyses of the BAT-detected GRBs for the past ∼11 years up through GRB 151027B. We report summaries of both the temporal and spectral analyses of the GRB characteristics using event data (i.e., data for each photon within approximately 250 s before and 950 s after the BAT trigger time), and discuss the instrumental sensitivity and selection effects of GRB detections. We also explore the GRB properties with redshift when possible. The result summaries and data products are available at http://swift.gsfc.nasa.gov/results/batgrbcat/index.html. In addition, we perform searches for GRB emissions before or after the event data using the BAT survey data. We estimate the false detection rate to be only one false detection in this sample. There are 15 ultra-long GRBs (∼2% of the BAT GRBs) in this search with confirmed emission beyond ∼1000 s of event data, and only two GRBs (GRB 100316D and GRB 101024A) with detections in the survey data prior to the starting of event data.

79 ASTRONOMY AND ASTROPHYSICS↗

Contamination in the Kepler field. Identification of 685 KOIs as false positives via ephemeris matching based ON Q1-Q12 data

The Kepler mission has to date found almost 6000 planetary transit-like signals, utilizing three years of data for over 170,000 stars at extremely high photometric precision. Due to its design, contamination from eclipsing binaries, variable stars, and other transiting planets results in a significant number of these signals being false positives (FPs). This directly affects the determination of the occurrence rate of Earth-like planets in our Galaxy, as well as other planet population statistics. In order to detect as many of these FPs as possible, we perform ephemeris matching among all transiting planet, eclipsing binary, and variable star sources. We find that 685 Kepler Objects of Interest (KOIs)—12% of all those analyzed—are FPs as a result of contamination, due to 409 unique parent sources. Of these, 118 have not previously been identified by other methods. We estimate that ∼35% of KOIs are FPs due to contamination, when performing a first-order correction for observational bias. Comparing single-planet candidate KOIs to multi-planet candidate KOIs, we find an observed FP fraction due to contamination of 16% and 2.4% respectively, bolstering the existing evidence that multi-planet KOIs are significantly less likely to be FPs. We also analyze the parameter distributions of the ephemeris matches and derive a simple model for the most common type of contamination in the Kepler field. We find that the ephemeris matching technique is able to identify low signal-to-noise FPs that are difficult to identify with other vetting techniques. We expect FP KOIs to become more frequent when analyzing more quarters of Kepler data, and note that many of them will not be able to be identified based on Kepler data alone.

79 ASTRONOMY AND ASTROPHYSICS↗

Assimilation of Time-Averaged Pseudoproxies for Climate Reconstruction

The efficacy of a novel ensemble data assimilation (DA) technique is examined in the climate field reconstruction (CFR) of surface temperature. A minimalistic, computationally inexpensive DA technique is employed that requires only a static ensemble of climatologically plausible states. Pseudoproxy experiments are performed with both general circulation model (GCM) and Twentieth Century Reanalysis (20CR) data by reconstructing surface temperature fields from a sparse network of noisy pseudoproxies. The DA approach is compared to a conventional CFR approach based on principal component analysis (PCA) for experiments on global domains. DA outperforms PCA in reconstructing global-mean temperature in all experiments and is more consistent across experiments, with a range of time series correlations of 0.69–0.94 compared to 0.19–0.87 for the PCA method. DA improvements are even more evident in spatial reconstruction skill, especially in sparsely sampled pseudoproxy regions and for 20CR experiments. It is hypothesized that DA improves spatial reconstructions because it relies on coherent, spatially local temperature patterns, which remain robust even when glacial states are used to reconstruct nonglacial states and vice versa. These local relationships, as utilized by DA, appear to be more robust than the orthogonal patterns of variability utilized by PCA. Comparing results for GCM and 20CR data indicates that pseudoproxy experiments that rely solely on GCM data may give a false impression of reconstruction skill.

54 ENVIRONMENTAL SCIENCES↗

A Comparison of the Detection Sensitivity of the Poisson Clutter Split and Region of Interest Algorithms on the RadMAP Mobile System

This analysis uses source injection into background data collected by the Radiological Multi-sensor Analysis Platform (RadMAP) to characterize the performance of the Poisson Clutter Split algorithm and compare it with a region-of-interest algorithm. This comparison is performed for varying detector array sizes and false alarm rates using data from Sodium Iodide and High Purity Germanium detector arrays. The application of the Poisson Clutter Split algorithm is found to yield significant performance gains for both medium- and high-resolution detector arrays. Furthermore, trade-offs between energy resolution, array size, cost, and detection performance are explored. In doing so, it is shown that the choice of detection algorithm is a key factor in determining the overall system performance and should be an important consideration in system design.

Joshi, T. H.↗

Subspace-Driven Learning for Anomaly Detection in Process Transients

Nuclear power plant (NPP) monitoring and diagnostic centers are actively investigating and implementing automated anomaly detection algorithms to help plants catch anomalies sooner, thereby preventing or reducing the duration of unexpected shutdowns. Current machine learning-based anomaly detection methods are expected to be highly effective during stable, full-power operations because NPPs typically operate as baseload power generators, meaning there are extensive operating data available from plant equipment. However, it is expected that anomaly detection methods will face significant challenges during transient conditions (i.e., when power output falls below full power) because plants only occasionally operate at these lower power levels, generating sparse transient operational data, and resulting in false alarms or missed detections. Here, to address this issue, transfer learning is used, which for this problem leverages knowledge (in the form of learned features) from stable, full-power operations to improve detection accuracy during transient conditions, even with limited data. In this effort, a novel subspace approach is developed to transfer a subset of the data features from full power operation to transients. This approach is validated through experiments using synthetic data and was found to outperform two baseline transfer learning approaches in anomaly detection performance across a range of amounts of transient data used in the training process.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

The false lock performance of Costas loops with hard-limited in-phase channel

The ability of a Costas loop to false lock on a data sideband is a problem which must be dealt with in the design of suppressed-carrier receivers which employ such loops for carrier reconstruction. For conventional Costas loops wherein the error signal is formed from the product of two analog signals, the false lock problem has recently been investigated by the author and others and is now well understood. For implementation reasons associated with the reduction of dc offsets, it is often desirable to hard-limit the output of the in-phase channel and replace the analog multiplier which forms the above product with a chopper-type device. The false lock behavior of such a Costas loop with hard-limited in-phase channel is quite different from that of the conventional Costas loop and is the subject of investigation in this paper. Results are also presented for a modified version of the Costas loop wherein the quadrature arm filter is removed.

Simon, M. K.↗

FLASH LIDAR Based Relative Navigation

Relative navigation remains the most challenging part of spacecraft rendezvous and docking. In recent years, flash LIDARs, have been increasingly selected as the go-to sensors for proximity operations and docking. Flash LIDARS are generally lighter and require less power that scanning Lidars. Flash LIDARs do not have moving parts, and they are capable of tracking multiple targets as well as generating a 3D map of a given target. However, there are some significant drawbacks of Flash Lidars that must be resolved if their use is to be of long-term significance. Overcoming the challenges of Flash LIDARs for navigation-namely, low technology readiness level, lack of historical performance data, target identification, existence of false positives, and performance of vision processing algorithms as intermediaries between the raw sensor data and the Kalman filter-requires a world-class testing facility, such as the Lockheed Martin Space Operations Simulation Center (SOSC). Ground-based testing is a critical step for maturing the next-generation flash LIDAR-based spacecraft relative navigation. This paper will focus on the tests of an integrated relative navigation system conducted at the SOSC in January 2014. The intent of the tests was to characterize and then improve the performance of relative navigation, while addressing many of the flash LIDAR challenges mentioned above. A section on navigation performance and future recommendation completes the discussion.

Brazzel, Jack↗

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

The Remote Analysis Station (RAS) as an instructional system

"Hands-on" training in LANDSAT data analysis techniques can be obtained using a desk-top, interactive remote analysis station (RAS) which consists of a color CRT imagery display, with alphanumeric overwrite and keyboard, as well as a cursor controller and modem. This portable station can communicate via modem and dial-up telephone with a host computer at 1200 baud or it can be hardwired to a host computer at 9600 baud. A Z80 microcomputer controls the display refresh memory and remote station processing. LANDSAT data is displayed as three-band false-color imagery, one-band color-sliced imagery, or color-coded processed imagery. Although the display memory routinely operates at 256 x 256 picture elements, a display resolution of 128 x 128 can be selected to fill the display faster. In the false color mode the computer packs the data into one 8-bit character. When the host is not sending pictorial information the characters sent are in ordinary ASCII code. System capabilities are described.

Rogers, R. H.↗

The Dangers of Parametrics

Building a parametric cost model is hard work. The data is noisy and often does not behave like we want it to. We need statistics to give us an indication of the goodness of our models, but; statistics can be manipulated and mislead. On top of all of that, our own very human biases can lead us astray; causing us to see patterns in the noise and draw false conclusions from the data. Yet, it is the data itself that is the foundation for making better cost estimates and cost models. I believe the mistake we often make is we believe that our models are representative of the data; that our models summarize the experiences, the knowledge, and the stories contained in the data. However, it is the opposite that is true. Our models are but imitations of reality. They give us trends, but not truth. The experiences, the knowledge, and the stories that we need in order to make good cost estimates is bound up in the data. You cannot separate good cost estimating from a knowledge of the historical data. One final thought. It is our attempts to make sense out of the randomness that leads us astray. In order to make progress as cost modelers and cost estimators, we must accept that there are real limitations on our ability to model the past and predict the future. I do not believe we should throw up our hands and say this is the best we can do. Rather, to see real improvement we must first recognize these limitations, avoid the easy but misleading solutions, and seek to find ways to better model the world we live in. I don't have any simple solutions. Perhaps the answers lie in better data or in a totally different approach to simulating how the world works. All I know is that we must do our best to speak truth to ourselves and our customers. Misleading ourselves and our customers will, in the end, result in an inability to have a positive impact on those we serve.

Prince, Frank A.↗

The Dangers of Parametrics

Building a parametric cost model is hard work. The data is noisy and often does not behave like we want it to. We need statistics to give us an indication of the goodness of our models, but; statistics can be manipulated and mislead. On top of all of that, our own very human biases can lead us astray; causing us to see patterns in the noise and draw false conclusions from the data. Yet, it is the data itself that is the foundation for making better cost estimates and cost models. I believe the mistake we often make is we believe that our models are representative of the data; that our models summarize the experiences, the knowledge, and the stories contained in the data. However, it is the opposite that is true. Our models are but imitations of reality. They give us trends, but not truth. The experiences, the knowledge, and the stories that we need in order to make good cost estimates is bound up in the data. You cannot separate good cost estimating from a knowledge of the historical data. One final thought. It is our attempts to make sense out of the randomness that leads us astray. In order to make progress as cost modelers and cost estimators, we must accept that there are real limitations on our ability to model the past and predict the future. I do not believe we should throw up our hands and say this is the best we can do. Rather, to see real improvement we must first recognize these limitations, avoid the easy but misleading solutions, and seek to find ways to better model the world we live in. I don't have any simple solutions. Perhaps the answers lie in better data or in a totally different approach to simulating how the world works. All I know is that we must do our best to speak truth to ourselves and our customers. Misleading ourselves and our customers will, in the end, result in an inability to have a positive impact on those we serve.

Prince, Frank A.↗

The Use of a Multichannel Analyzer to Investigate Effects of Experimental Factors on Gross-Counting Gamma and Neutron Detectors

Radiation detection technology is invaluable to many fields of study in identifying nuclear materials. However, many detectors use gross-counting methods that give only a relative count rate. Without a spectrum (information on counts over time vs energy), it can be more difficult to discern if an alarm is false, innocent, or real. In particular, we would like to understand better the effect of experimental factors (i.e., external conditions and equipment parameters) on detector data, with possible implications for false alarms. To more thoroughly characterize detector technology, a multichannel analyzer (MCA) was used to record spectra from neutron (helium-3 tubes) and gamma (photomultiplier tubes) gross-counting detectors. Several factors could affect the signal-to-noise ratio of sources. For example, we examined the effects of neutron detector high voltage setting on the appearance of a californium-252 spectrum, the effect of discriminator values on integrated counts in neutron detection, and the effect of gain changes on the gamma spectra from several sources. Possible implications of ambient temperature of the experiment on the data collected will be discussed. The input impedance of the MCA must be considered to ensure that data are not affected by the measurement itself. Moreover, a calibration on the MCA was performed to verify the conversion of a MCA channel number to a voltage. In summary, the series of source spectra collected on an MCA with a variety of experimental conditions allow us to understand factors that affect data better, and assure us that gross-counting neutron and gamma detectors will have minimal false alarms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗