Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bad data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Anomaly Detection and Mitigation in FACTS-based Wide-Area Voltage Control Systems using Machine Learning

With the increasing deployment of Flexible AC Transmission System (FACTS) devices in wide-area voltage control systems (WAVCS) for achieving improved voltage stability of bulk power systems, the possibility for cyber attacks on these systems is also increasing. Successful stealthy cyber attacks that are difficult to detect by traditional informational technology (IT)-based cybersecurity solutions or threshold-based bad data detectors can lead to a voltage collapse in power grid. This paper presents the testbed-based attacks implementation and real-time evaluation of machine learning (ML) algorithm for detecting and mitigating stealthy cyber attacks on FACTS-based WAVCS on a hardware-in-the-loop (HIL) testbed. Initially, we discuss the implementation of a fuzzy logic controller (FLC) that controls a Static VAR Compensator (SVC) device deployed in a two-area four-machine Kundur power system for improving transient voltage stability. Later, the ML-based Anomaly Detection and Mitigation (ADM) system is implemented on the cyber-physical HIL testbed to detect and mitigate various stealthy cyber attacks, which are injected in real-time over the wide-area network (WAN). The experimental results show accurate and effective performance of ADM system in detecting and mitigating anomalies while keeping the grid stable and within the system operating limits, as defined by the North America Electric Reliability Corporation (NERC).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards Smart Grids Enhanced Situation Awareness: A Bi-Level Quasi-Static State Estimation Model

Smart Grid situational awareness is provided by Energy Management Systems. A core process of these systems is State Estimation. The great majority of state estimators model the Smart Grid through a set of nonlinear algebraic equations, named the measurement model. Problem formulation considers the Gauss solution. Several model improvements have been presented regarding the Gauss solution, aiming between others to provide measurement noise robustness to the state estimation process. While considerable effort has been focused on such developments, state estimation is still constrained by the implicit modelling error, and thus inevitably vulnerable to cyber-threats. In this work, a state estimation bi-level formal model is presented towards Smart Grids enhanced situational awareness considering the concepts of synthetic measurements and innovation. Comparative test results with the state-of-the-art on the IEEE 14-bus system are presented highlighting improved situational awareness to bad data. Easy-to-implement model, without hard-to-derive parameters, built-on the classic weighted least squares solution, highlight potential aspects for real-life implementation.

cyber security↗

Distribution System State Estimation Using a Multiple Iteration Extended Kalman Filter Approach

To support the operation of modern distribution systems, operators require real-time visibility into system states. Due to a lack of measurements and unbalanced operation, the state estimation in distribution systems is challenging as compared to transmission systems. This paper proposes the utilization of a Multiple Iteration - Extended Kalman Filter based approach for the distribution system state estimation. This modified version of the baseline extended Kalman filter iterates over the update step multiple times thereby reducing the estimation error. The proposed algorithm along with the auxiliary algorithms such as bad data detection is integrated into a co-simulation environment. Case studies show that the proposed state estimation method can result in a lesser estimation error as compared to the baseline approach.

Bhatti, Bilal Ahmad↗

QA/QC-ed BCI meteorological drivers

Time series raw datasets of Temperature, Solar Radiation, Relative Humidity, Rainfall, Barometric Pressure, Wind Speed, and Wind Direction for the Barro Colorado (PA-BCI) site for the period from 2003-01-01 to 2016-12-31 were downloaded from the STRI website. The QA/QC protocol of raw datasets included the detection and removal of NAs, outliers and bad data points, imputation of missing data, and creation of the time series with equidistant time stamps. The time series for different meteorological parameters were aligned into a single database to be used for modeling. Statistical QA/QC analysis was performed using a series of R libraries in Rstudio. The changes in the dataset were flagged. The file BCI_met_drivers_2003-2016_QAQC_summary_report.docx provides the details of the QA/QC data analysis.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Fiber Bragg Grating and Distributed Optical Fiber Temperature Sensors

Fiber optic temperature sensors were evaluated in the High Temperature Test Lab (HTTL) to determine the accuracy of the measurements at various temperatures. A distributed temperature sensor was evaluated up to 550C and a fiber Bragg grating sensor was evaluated up to 750C. HTTL measurements indicate that there is a drift in fiber Bragg sensor over time of approximately -10C with higher accuracy at temperatures above 300C. The distributed sensor produced some bad data points at and above 500C but produced measurements with less than 2% error at increasing temperatures up to 400C

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Anomaly Detection in Power System State Estimation: Review and New Directions

Foundational and state-of-the-art anomaly-detection methods through power system state estimation are reviewed. Traditional components for bad data detection, such as chi-square testing, residual-based methods, and hypothesis testing, are discussed to explain the motivations for recent anomaly-detection methods given the increasing complexity of power grids, energy management systems, and cyber-threats. In particular, state estimation anomaly detection based on data-driven quickest-change detection and artificial intelligence are discussed, and directions for research are suggested with particular emphasis on considerations of the future smart grid.

42 ENGINEERING↗

Onboard navigation of the Space Shuttle

This paper discusses the Kalman filter used in the navigation software of the Space Shuttle. The form of the filter will be discussed: the standard Kalman filter versus the square-root version of this filter. Both of these filters have severe nonlinearity problems. Two successful solutions of the nonlinearity problem are presented. A real-time program must have a good method of editing bad data. The data editing scheme is discussed. Those elements of the Kalman filter state vector which are random variables will be discussed.

Lear, W. M.↗

The High Resolution Spectrograph for the Space Telescope

The High Resoltuion Spectrograph (HRS) in conjunction with the Space Telescope (ST), extends ultraviolet astronomical spectroscopy to higher spectra, spatial, and time resolutions than previously achieved, as well as to fainter and more distant celestial objects. Other significant advances inherent in the instrument are high photometric accuracy and efficient operation via exposure meter control and real time rejection of bad data. These capabilities are provided to accomplish the scientific programs of the HRS investigation definition team, which concern the interstellar medium, stellar winds, and evolutionary aspects of stellar atmosphere studies; the determination of chemical abundances relevant to stellar evolution; the investigation of quasars and Seyfert galaxy nuclei; and the analysis of the atmospheres of solar system objects, including comets.

Brandt, J. C.↗

On the impact of the FGGE on tropical forecasts

It has become evident from operational experience that a good forecast requires, in general, a good analysis. This is as true in the tropics as it is in the extratropics. One can find many examples of bad data being accepted by the analysis scheme and significantly degrading the subsequent forecast. Equally, a lack of data may result in a forecast completely missing the early development of, for example, a midlatitude cyclone or tropical depression. Also, single level data may be misinterpreted by an analysis scheme. These problems are compounded in the tropics by our relative ignorance of the dynamics, the necessarily crude descriptions of many important physical processes, and fundamental in analysis. The impact of the FGGE on tropical analysis/forecasting is reviewed.

Heckley, W. A.↗

Planned LMSS propagation experiment using ACTS: Preliminary antenna pointing results during mobile operations

An overview and a status description of the planned LMSS mobile K band experiment with ACTS is presented. As a precursor to the ACTS mobile measurements at 20.185 GHz, measurements at 19.77 GHz employing the Olympus satellite were originally planned. However, because of the demise of Olympus in June of 1991, the efforts described here are focused towards the ACTS measurements. In particular, we describe the design and testing results of a gyro controlled mobile-antenna pointing system. Preliminary pointing measurements during mobile operations indicate that the present system is suitable for measurements employing a 15 cm aperture (beamwidth at approximately 7 deg) receiving antenna operating with ACTS in the high gain transponder mode. This should enable measurements with pattern losses smaller than plus or minus 1 dB over more than 95 percent of the driving distance. Measurements with the present mount system employing a 60 cm aperture (beamwidth at approximately 1.7 deg) results in pattern losses smaller than plus or minus 3 dB for 70 percent of the driving distance. Acceptable propagation measurements may still be made with this system by employing developed software to flag out bad data points due to extreme pointing errors. The receiver system including associated computer control software has been designed and assembled. Plans are underway to integrate the antenna mount with the receiver on the University of Texas mobile receiving van and repeat the pointing tests on highways employing a recently designed radome system.

Rowland, John R.↗

ASpect: A new spectrum and line analysis package for IRAF

We examined several publicly available spectral analysis software packages looking for one with enough functionality and versatility to meet the analysis needs of astronomers during the next decade. None of those examined can satisfactorily support the wide variety of panchromatic science programs that are now becoming possible. Furthermore, we concluded that none of these packages can be simply modified to include critical functions because of their original (limited) designs. During the next two years we will write a new spectral analysis package, ASpect, that will incorporate the latest analysis techniques for astronomical spectra in all wavelength domains. The ASpect package has several functional requirements. It must operate on spectra from a wide variety of ground-based and space-based instruments spanning wavelengths from radio to gamma rays. It must accommodate non-linear dispersion relations. It must provide a variety of functions, individually or in combination, with which to fit spectral features and the continuum. It is vitally important that known bad data be masked and that, uncertainties be propagated throughout the calculations in order for astronomers to evaluate the reliability of results. Finally, this new package must provide a powerful, intuitive graphical user interface to handle the burden of data input/output (I/O), on-line 'help,' selection of relevant features for analysis, plotting and graphical interaction, and data base management--all in a comprehensible environment. We anticipate that ASpect will take the form of an external package in IRAF (such as the NOAO and STSDAS packages) and will be layered upon the IRAF virtual Operating System to make it available on as many platforms as possible, while making it resistant to changes in operating systems and compilers. Our choice of IRAF is motivated by its portability, its wide use within the astronomical community, and its rich set of existing user applications.

Hulbert, S. J.↗

A study of various methods for calculating locations of lightning events

This article reports on the results of numerical experiments on finding the location of lightning events using different numerical methods. The methods include linear least squares, nonlinear least squares, statistical estimations, cluster analysis and angular filters and combinations of such techniques. The experiments involved investigations of methods for excluding fake solutions which are solutions that appear to be reasonable but are in fact several kilometers distant from the actual location. Some of the conclusions derived from the study are that bad data produces fakes, that no fool-proof method of excluding fakes was found, that a short base-line interferometer under development at Kennedy Space Center to measure the direction cosines of an event shows promise as a filter for excluding fakes. The experiments generated a number of open questions, some of which are discussed at the end of the report.

Cannon, John R.↗

ASpec: A New Spectrum and Line Analysis Package for IRAF

ASpec is a new spectrum and line analysis package developed at STScI. ASpec is designed as an add-on package for IRAF and incorporates a variety of analysis techniques for astronomical spectra. ASpec operates on spectra from a wide variety of ground-based and space-based instruments. ASpec allows simultaneous handling of spectra from different wavelength regimes. ASpec accommodates non-linear dispersion relations. ASpec provides a variety of functions, individually or in combination, with which to fit spectral features and the continuum. ASpec permits the masking of known bad data. ASpec provides a powerful, intuitive graphical user interface implemented using the new IRAF Object Manager and customized to handle: data input/output (I/O); on-line 'help'; selection of relevant features for analysis; plotting and graphical interaction; and data base management.

Hulbert, Stephen J.↗

Assessing Videogrammetry for Static Aeroelastic Testing of a Wind-Tunnel Model

The Videogrammetric Model Deformation (VMD) technique, developed at NASA Langley Research Center, was recently used to measure displacements and local surface angle changes on a static aeroelastic wind-tunnel model. The results were assessed for consistency, accuracy and usefulness. Vertical displacement measurements and surface angular deflections (derived from vertical displacements) taken at no-wind/no-load conditions were analyzed. For accuracy assessment, angular measurements were compared to those from a highly accurate accelerometer. Shewhart's Variables Control Charts were used in the assessment of consistency and uncertainty. Some bad data points were discovered, and it is shown that the measurement results at certain targets were more consistent than at other targets. Physical explanations for this lack of consistency have not been determined. However, overall the measurements were sufficiently accurate to be very useful in monitoring wind-tunnel model aeroelastic deformation and determining flexible stability and control derivatives. After a structural model component failed during a highly loaded condition, analysis of VMD data clearly indicated progressive structural deterioration as the wind-tunnel condition where failure occurred was approached. As a result, subsequent testing successfully incorporated near- real-time monitoring of VMD data in order to ensure structural integrity. The potential for higher levels of consistency and accuracy through the use of statistical quality control practices are discussed and recommended for future applications.

Spain, Charles V.↗

A Strategy for Successful Deep Space Information Transmission in Bad Weather

To retrieve data during bad weather, most missions slow the data rate to accommodate a certain amount of attenuation, or to allow for all but a very small percentage of all-weather conditions. This system has two well-known and balancing disadvantages: no data is received reliably during very bad weather, and the data rate is slowed during good weather. A system of processing is described that encodes the most critical data more heavily, allowing it to be retrieved under bad conditions, while at the same time allowing most of the data to be sent at a higher data rate.

Swanson, L.↗

Sonic Booms on Big Structures (SonicBOBS) Phase I Database; NASA Dryden Sensors

This DVD contains 13 channels of microphone and up to 22 channels of pressure transducer data collected in September, 2009 around several buildings located at Edwards Air Force Base. These data were recorded by NASA Dryden. Not included are data taken by NASA Langley and Gulfstream. Each day's data is in a separate folder and each pass is in a file beginning with "SonicBOBS_" (for microphone data) or "SonicBOBSBB_" (for BADS and BASS data) followed by the month, day, year as two digits each, followed by the hour, minute, sec after midnight GMT. The filename time given is for the END time of the raw recording file. In the case of the microphone data, this time may be several minutes after the sonic boom, and is according to the PC's uncalibrated clock. The Matlab data files have the actual time as provided by a GPS-based IRIG-B signal recorded concurrently with the data. Microphone data is given for 5 seconds prior to 20 seconds after the sonic boom. BADS and BASS data is given for the full recording, 6 seconds for the BADS and 10 seconds for the BASS. As an example of the naming convention, file "SonicBOBS_091209154618.mat" is from September 12, 2009 at 15:46:18 GMT. Note that data taken on September 12, 2009 prior to 01:00:00 GMT was of the Space Shuttle Discovery (a sonic boom of opportunity), which was on September 11, 2009 in local Pacific Daylight Time.

Haering, Edward A., Jr.↗

An Evaluation of Cosmological Models from the Expansion and Growth of Structure Measurements

Here, we compare a large suite of theoretical cosmological models to observational data from the cosmic microwave background, baryon acoustic oscillation measurements of expansion, Type Ia supernova measurements of expansion, redshift space distortion measurements of the growth of structure, and the local Hubble constant. Our theoretical models include parametrizations of dark energy as well as physical models of dark energy and modified gravity. We determine the constraints on the model parameters, incorporating the redshift space distortion data directly in the analysis. To determine whether models can be ruled out, we evaluate the p-value (the probability under the model of obtaining data as bad or worse than the observed data). In our comparison, we find the well-known tension of H 0 with the other data; no model resolves this tension successfully. Among the models we consider, the large-scale growth of structure data does not affect the modified gravity models as a category particularly differently from dark energy models; it matters for some modified gravity models but not others, and the same is true for dark energy models. We compute predicted observables for each model under current observational constraints, and identify models for which future observational constraints will be particularly informative.

79 ASTRONOMY AND ASTROPHYSICS↗