Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bad data detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Data smoothing and error detection based on linear interpolation

A method is presented, based on linear interpolation, for detecting and correcting bad data points in a set of data without contaminating the good data points. The method used is not concerned with the small random errors usually attributed to a noisy system. It assumes that the data points which are in error are relatively isolated from each other and that the number of such points is small compared to the total number of data points.

Guerra, V. M.↗

Health Monitor for Multitasking, Safety-Critical, Real-Time Software

Health Manager can detect Bad Health prior to a failure occurring by periodically monitoring the application software by looking for code corruption errors, and sanity-checking each critical data value prior to use. A processor s memory can fail and corrupt the software, or the software can accidentally write to the wrong address and overwrite the executing software. This innovation will continuously calculate a checksum of the software load to detect corrupted code. This will allow a system to detect a failure before it happens. This innovation monitors each software task (thread) so that if any task reports "bad health," or does not report to the Health Manager, the system is declared bad. The Health Manager reports overall system health to the outside world by outputting a square wave signal. If the square wave stops, this indicates that system health is bad or hung and cannot report. Either way, "bad health" can be detected, whether caused by an error, corrupted data, or a hung processor. A separate Health Monitor Task is started and run periodically in a loop that starts and stops pending on a semaphore. Each monitored task registers with the Health Manager, which maintains a count for the task. The registering task must indicate if it will run more or less often than the Health Manager. If the task runs more often than the Health Manager, the monitored task calls a health function that increments the count and verifies it did not go over max-count. When the periodic Health Manager runs, it verifies that the count did not go over the max-count and zeroes it. If the task runs less often than the Health Manager, the periodic Health Manager will increment the count. The monitored task zeroes the count, and both the Health Manager and monitored task verify that the count did not go over the max-count.

Zoerner, Roger↗

Extended observability of linear time-invariant systems under recurrent loss of output data

Recurrent loss of sensor data in integrated control systems of an advanced aircraft may occur under different operating conditions that include detected frame errors and queue saturation in computer networks, and bad data suppression in signal processing. This paper presents an extension of the concept of observability based on a set of randomly selected nonconsecutive outputs in finite-dimensional, linear, time-invariant systems. Conditions for testing extended observability have been established.

Luck, Rogelio↗

Error detection and data smoothing based on local procedures

An algorithm is presented which is able to locate isolated bad points and correct them without contaminating the rest of the good data. This work has been greatly influenced and motivated by what is currently done in the manual loft. It is not within the scope of this work to handle small random errors characteristic of a noisy system, and it is therefore assumed that the bad points are isolated and relatively few when compared with the total number of points. Motivated by the desire to imitate the loftsman a visual experiment was conducted to determine what is considered smooth data. This criterion is used to determine how much the data should be smoothed and to prove that this method produces such data. The method utimately converges to a set of points that lies on the polynomial that interpolates the first and last points; however convergence to such a set is definitely not the purpose of our algorithm. The proof of convergence is necessary to demonstrate that oscillation does not take place and that in a finite number of steps the method produces a set as smooth as desired.

Guerra, V. M.↗

Flash memory management system and method utilizing multiple block list windows

The present invention provides a flash memory management system and method with increased performance. The flash memory management system provides the ability to efficiently manage and allocate flash memory use in a way that improves reliability and longevity, while maintaining good performance levels. The flash memory management system includes a free block mechanism, a disk maintenance mechanism, and a bad block detection mechanism. The free block mechanism provides efficient sorting of free blocks to facilitate selecting low use blocks for writing. The disk maintenance mechanism provides for the ability to efficiently clean flash memory blocks during processor idle times. The bad block detection mechanism provides the ability to better detect when a block of flash memory is likely to go bad. The flash status mechanism stores information in fast access memory that describes the content and status of the data in the flash disk. The new bank detection mechanism provides the ability to automatically detect when new banks of flash memory are added to the system. Together, these mechanisms provide a flash memory management system that can improve the operational efficiency of systems that utilize flash memory.

Chow, James↗

Identification of Abnormal System Noise Temperature Patterns in Deep Space Network Antennas Using Neural Network Trained Fuzzy Logic

This paper presents the development of a fuzzy logic function trained by an artificial neural network to classify the system noise temperature (SNT) of antennas in the NASA Deep Space Network (DSN). The SNT data were classified into normal, marginal, and abnormal classes. The irregular SNT pattern was further correlated with link margin and weather data. A reasonably good correlation is detected among high SNT, low link margin and the effect of bad weather; however we also saw some unexpected non-correlations which merit further study in the future.

pattern identification↗

Functional Near-Infrared Spectroscopy Signals Measure Neuronal Activity in the Cortex

Functional near infrared spectroscopy (fNIRS) is an emerging optical neuroimaging technology that indirectly measures neuronal activity in the cortex via neurovascular coupling. It quantifies hemoglobin concentration ([Hb]) and thus measures the same hemodynamic response as functional magnetic resonance imaging (fMRI), but is portable, non-confining, relatively inexpensive, and is appropriate for long-duration monitoring and use at the bedside. Like fMRI, it is noninvasive and safe for repeated measurements. Patterns of [Hb] changes are used to classify cognitive state. Thus, fNIRS technology offers much potential for application in operational contexts. For instance, the use of fNIRS to detect the mental state of commercial aircraft operators in near real time could allow intelligent flight decks of the future to optimally support human performance in the interest of safety by responding to hazardous mental states of the operator. However, many opportunities remain for improving robustness and reliability. It is desirable to reduce the impact of motion and poor optical coupling of probes to the skin. Such artifacts degrade signal quality and thus cognitive state classification accuracy. Field application calls for further development of algorithms and filters for the automation of bad channel detection and dynamic artifact removal. This work introduces a novel adaptive filter method for automated real-time fNIRS signal quality detection and improvement. The output signal (after filtering) will have had contributions from motion and poor coupling reduced or removed, thus leaving a signal more indicative of changes due to hemodynamic brain activations of interest. Cognitive state classifications based on these signals reflect brain activity more reliably. The filter has been tested successfully with both synthetic and real human subject data, and requires no auxiliary measurement. This method could be implemented as a real-time filtering option or bad channel rejection feature of software used with frequency domain fNIRS instruments for signal acquisition and processing. Use of this method could improve the reliability of any operational or real-world application of fNIRS in which motion is an inherent part of the functional task of interest. Other optical diagnostic techniques (e.g., for NIR medical diagnosis) also may benefit from the reduction of probe motion artifact during any use in which motion avoidance would be impractical or limit usability.

Harrivel, Angela↗

Functional Near-Infrared Spectroscopy Signals Measure Neuronal Activity in the Cortex

Functional near infrared spectroscopy (fNIRS) is an emerging optical neuroimaging technology that indirectly measures neuronal activity in the cortex via neurovascular coupling. It quantifies hemoglobin concentration ([Hb]) and thus measures the same hemodynamic response as functional magnetic resonance imaging (fMRI), but is portable, non-confining, relatively inexpensive, and is appropriate for long-duration monitoring and use at the bedside. Like fMRI, it is noninvasive and safe for repeated measurements. Patterns of [Hb] changes are used to classify cognitive state. Thus, fNIRS technology offers much potential for application in operational contexts. For instance, the use of fNIRS to detect the mental state of commercial aircraft operators in near real time could allow intelligent flight decks of the future to optimally support human performance in the interest of safety by responding to hazardous mental states of the operator. However, many opportunities remain for improving robustness and reliability. It is desirable to reduce the impact of motion and poor optical coupling of probes to the skin. Such artifacts degrade signal quality and thus cognitive state classification accuracy. Field application calls for further development of algorithms and filters for the automation of bad channel detection and dynamic artifact removal. This work introduces a novel adaptive filter method for automated real-time fNIRS signal quality detection and improvement. The output signal (after filtering) will have had contributions from motion and poor coupling reduced or removed, thus leaving a signal more indicative of changes due to hemodynamic brain activations of interest. Cognitive state classifications based on these signals reflect brain activity more reliably. The filter has been tested successfully with both synthetic and real human subject data, and requires no auxiliary measurement. This method could be implemented as a real-time filtering option or bad channel rejection feature of software used with frequency domain fNIRS instruments for signal acquisition and processing. Use of this method could improve the reliability of any operational or real-world application of fNIRS in which motion is an inherent part of the functional task of interest. Other optical diagnostic techniques (e.g., for NIR medical diagnosis) also may benefit from the reduction of probe motion artifact during any use in which motion avoidance would be impractical or limit usability.

Harrivel, Angela↗

Comparison of the 1984 and 1985 AIS data over the Singatse Range (Yerington), Nevada

The Singatse Range is composed of a series of 53 types of volcanic, plutonic, metamorphic, and sedimentary rocks. In addition the Jurassic plutonic rocks are also of economic interest for their copper mineralization which is contained in a porphyry dike swarm. The 1984 and 1985 flight results from the Airborne Imaging Spectrometer (AIS) instrument flown in the NASA/JPL C-130 aircraft are contrasted and compared. The 1984 data are less noisy than the 1985, in which many sets of vertical stripings from bad detectors can be seen. Significantly however, enough of the hydrothermal alteration patterns can be seen in each line at the mutual crossing points that one can say that the specific targets were detected in both year's flights. The spectra of both years are corrupted by the second-order effect from the grating, but 0-H bond absorption at essentially correct wavelengths for sericite and/or kaolinite can be seen.

Lyon, R. J. P.↗

Polarimetric observations of Comet Kohoutek (1973f)

Radio, optical, and visual observations were made of Comet Kohoutek (1973f) using facilities of the National Radio Astronomy Observatory (NRAO) and of the Hawaii Night Sky Observatory, State University of New York at Albany (SUNYA). Transit observations were made using the NRAO 300 ft radio telescope on six consecutive days beginning November 24, 1973. Observations were carried out in the continuum at 11 cm using the 4-feed system at different position angles. The data were recorded on magnetic tape and were computer reduced. Results were negative, with an rms error of 62 milli flux units, giving an upper limit of 180 mfu for the 11 cm continuum emission from the Comet. This relatively high detection limit resulted from a combination of interference and bad weather that affected these pre-perihelion observations. No observations could be scheduled near or after perihelion.

Weinberg, J. L.↗

An analysis of redundancy management algorithms for asynchronous fault tolerant control systems

Redundancy management algorithms, commonly referred to as voters, are algorithms used in fault-tolerant control systems to vote on incoming redundant data, isolate bad signals, and output a single good value. In a synchronous environment, this algorithm is a straightforward signal-to-signal comparison with relatively low complexity. The technology of asynchronous control systems, recently realized in the Ultrareliable Fault Tolerant Control System research program at NASA Ames Research Center, requires more complex algorithms for fault detection and signal selection. A variety of algorithms used for this process, a means of testing them, and their basic performance under a simulated environment of the ultrareliable fault-tolerant control system are presented.

Davis, Gloria J.↗

Gamma-radiation with E gamma 5 MeV detected from Seyfert galaxy 3C120 and region with 1" = 190 deg and b" = 20 deg

The observation of the Galaxy anticenter region in gamma-rays with E gamma = 5 / 100 MeV was made by gamma-telescope Natalya-1 in a balloon flight. The flight was performed at the ceiling 5.1 + or - 0.1 g/sq cm, magnetic cutoff being 17 GV. The description of the instrument and the analysis of the experiment conditions are given. The tracks of electron-positron pairs generated by gamma-quanta in the convertors were detected by wire spark chambers. The recorded events were classified manually by an operator using a graphic display into three classes: pairs, single and bad events. The arrival angle of gamma-quanta and their energy for selected gamma-ray events (pairs and singles) were determined through multiple scattering of pair components in the convertors. On the basis of the data obtained the celestial maps were made in gamma-rays for E sub gamma 5 MeV and E gamma 20 MeV energy ranges.

Damle, S. V.↗

Characterizing Uranus with an Ice giant Planetary Origins Probe (Ice-POP)

We now know from studies of planetary transits and microlensing that Neptune-mass planets are ubitquitous and may be the most common class of planets in the Galaxy. As such it is crucial that we understand the formation and evolution of the ice giant planets in our own solar system so that we can better understand planet formation throughout the galaxy. An entry probe mission to Uranus would help accomplish this goal. In fact the Planetary Decadal Survey recommended a Uranus orbiter with entry probe but did not explore in detail the specifications for the entry probe. NASA Ames is currently studying thermal protection system requirements for such a mission and this has led to questions regarding the minimum interesting science payload of such an entry probe. The single most important in-situ measurement for an ice giant entry probe is a measurement of atmospheric composition. For Uranus this would specifically include the methane and noble gas abundances. An in situ measurement of the methane abundance, from below the methane cloud, would constrain the atmospheric carbon abundance, which is believed to be roughly 30 to 50 times solar. There are hints from the transiting planets that extrasolar ice giants show comparable or even greater enhancements of heavy elements compared to their primary stars. However the origin of this carbon enhancement is controversial. Is Uranus a "failed core" of a larger gas giant or was the atmosphere enhanced by accretion of icy planetesimals' Constraining atmospheric abundances of C and perhaps S or even N from below 5 bars would provide badly needed data to address such issues. A measurement of the N abundance would provide clues on the origin of the planetesimals that formed Uranus. Low N-abundance indicates planetesimals from 'warmer' regions where N was mainly in form of NH3, whereas a strong enrichment could indicate planetesimals / cometary material from the colder outer regions of the nebula. Furthermore CO and HCN have been detected in Neptune but not in Uranus. A measurement of the abundance of either would constrain the source mechanisms for these molecules (exogenic or internal). A major surprise from the Galileo Entry Probe was that the heavier noble gases Ar, Kr, and Xe are enhanced in Jupiter's atmosphere at a level comparable to what was seen for the chemically active volatiles N, C, and S. It had been generally expected that Ar, Kr, and Xe would be present in solar abundances, as all were expected to accrete with hydrogen during the gravitational capture of nebular gases. Enhanced abundances of Ar, Kr, and Xe is equivalent to saying that these noble gases have been separated from hydrogen. There are several mechanisms that could accomplish this but these hypotheses require further testing. Measurement of noble gas abundances in an ice giant would constrain the planetary formation and nebular mechanisms responsible for this enhancement. Standard three-layer models of Uranus find that the outer, predominantly H/He layer of Uranus does not reach pressures high enough (approximately 1 Mbar) for H2 to transition to liquid metallic hydrogen. However, valid models can also be constructed with a smaller intermediate water-rich layer, with hydrogen then reaching the metallic hydrogen phase. If this occurs, He should phase separate from the hydrogen and ``rain out," taking along a substantial abundance of Ne, as suggested for Jupiter (and likely also for Saturn). Hence He and Ne depletions could be probes of the planet's structure in the much deeper interior. A determination of Uranus' atmospheric abundances, particularly of the noble gasses, is thus critical to understanding the formation of Uranus, and giant planets in general. These measurements can only be performed with an entry probe. The second key measurement would be a temperature-pressure sounding to provide ground truth for remote measurements of atmospheric temperature and composition and to constrain the internal heat flow. This would also establish that the methane abundance measurements have indeed been made below any possible methane cloud. Finally an ultra stable oscillator would measure wind speeds and constrain atmospheric dynamics. In our presentation we will discuss the importance of all of these measurements and argue that an entry probe is a crucial component of any ice giant mission.

Marley, Mark S.↗

Remote Sensing Time Series Product Tool

The TSPT (Time Series Product Tool) software was custom-designed for NASA to rapidly create and display single-band and band-combination time series, such as NDVI (Normalized Difference Vegetation Index) images, for wide-area crop surveillance and for other time-critical applications. The TSPT, developed in MATLAB, allows users to create and display various MODIS (Moderate Resolution Imaging Spectroradiometer) or simulated VIIRS (Visible/Infrared Imager Radiometer Suite) products as single images, as time series plots at a selected location, or as temporally processed image videos. Manually creating these types of products is extremely labor intensive; however, the TSPT development tool makes the process simplified and efficient. MODIS is ideal for monitoring large crop areas because of its wide swath (2330 km), its relatively small ground sample distance (250 m), and its high temporal revisit time (twice daily). Furthermore, because MODIS imagery is acquired daily, rapid changes in vegetative health can potentially be detected. The new TSPT technology provides users with the ability to temporally process high-revisit-rate satellite imagery, such as that acquired from MODIS and from its successor, the VIIRS. The TSPT features the important capability of fusing data from both MODIS instruments onboard the Terra and Aqua satellites, which drastically improves cloud statistics. With the TSPT, MODIS metadata is used to find and optionally remove bad and suspect data. Noise removal and temporal processing techniques allow users to create low-noise time series plots and image videos and to select settings and thresholds that tailor particular output products. The TSPT GUI (graphical user interface) provides an interactive environment for crafting what-if scenarios by enabling a user to repeat product generation using different settings and thresholds. The TSPT Application Programming Interface provides more fine-tuned control of product generation, allowing experienced programmers to bypass the GUI and to create more user-specific output products, such as comparison time plots or images. This type of time series analysis tool for remotely sensed imagery could be the basis of a large-area vegetation surveillance system. The TSPT has been used to generate NDVI time series over growing seasons in California and Argentina and for hurricane events, such as Hurricane Katrina.

Predos, Don↗

Remote-Sensing Time Series Analysis, a Vegetation Monitoring Tool

The Time Series Product Tool (TSPT) is software, developed in MATLAB , which creates and displays high signal-to- noise Vegetation Indices imagery and other higher-level products derived from remotely sensed data. This tool enables automated, rapid, large-scale regional surveillance of crops, forests, and other vegetation. TSPT temporally processes high-revisit-rate satellite imagery produced by the Moderate Resolution Imaging Spectroradiometer (MODIS) and by other remote-sensing systems. Although MODIS imagery is acquired daily, cloudiness and other sources of noise can greatly reduce the effective temporal resolution. To improve cloud statistics, the TSPT combines MODIS data from multiple satellites (Aqua and Terra). The TSPT produces MODIS products as single time-frame and multitemporal change images, as time-series plots at a selected location, or as temporally processed image videos. Using the TSPT program, MODIS metadata is used to remove and/or correct bad and suspect data. Bad pixel removal, multiple satellite data fusion, and temporal processing techniques create high-quality plots and animated image video sequences that depict changes in vegetation greenness. This tool provides several temporal processing options not found in other comparable imaging software tools. Because the framework to generate and use other algorithms is established, small modifications to this tool will enable the use of a large range of remotely sensed data types. An effective remote-sensing crop monitoring system must be able to detect subtle changes in plant health in the earliest stages, before the effects of a disease outbreak or other adverse environmental conditions can become widespread and devastating. The integration of the time series analysis tool with ground-based information, soil types, crop types, meteorological data, and crop growth models in a Geographic Information System, could provide the foundation for a large-area crop-surveillance system that could identify a variety of plant phenomena and improve monitoring capabilities.

McKellip, Rodney↗

MISR Level 2 TOA/Cloud Stereo parameters (MIL2TCST_V2)

The MISR Top-of-Atmosphere (TOA)/Cloud Stereo geophysical parameters include stereoscopically-derived cloud motion vectors (winds), cloud-top heights, and an accompanying cloud mask. The Stereo product geophysical parameters include a stereoscopically-derived cloud mask and cloud height on a 1.1 km grid. It also includes cloud motion vectors on a 70.4 km grid. The three types of stereo heights are: the BestWind heights are only calculated for those regions where the associated wind vectors passed the quality tests. Therefore, they have sparse coverage but since the wind correction is included, these contain our 'best guess' as to what the true heights are. The WithoutWind heights are calculated assuming a constant wind vector of zero. They have almost complete coverage and therefore form a nice 'pretty picture' of the relative cloud heights over small areas. The RawWind heights are a diagnostic product as they are calculated using all available wind vectors (even the bad ones). It is therefore recommended that one only use the Best and Without wind products. It is important to remember that the stereo matchers pick up the layer of maximum contrast, which is not necessarily the same as the highest cloud so all the stereo heights are keyed to this level of maximum contrast. Therefore, higher and thinner cirrus layers may not be detected by any of the height fields. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1.1 km; Longitude_Resolution=1.1 km; Temporal_Resolution=about 15 orbits/day].

CLOUD MASK↗

MISR Level 2 TOA/Cloud Stereo parameters (MIL2TCST_V1)

The MISR Top-of-Atmosphere (TOA)/Cloud Stereo geophysical parameters include stereoscopically-derived cloud motion vectors (winds), cloud-top heights, and an accompanying cloud mask. The Stereo product geophysical parameters include a stereoscopically-derived cloud mask and cloud height on a 1.1 km grid. It also includes cloud motion vectors on a 70.4 km grid. The three types of stereo heights are: the BestWind heights are only calculated for those regions where the associated wind vectors passed the quality tests. Therefore, they have sparse coverage but since the wind correction is included, these contain our 'best guess' as to what the true heights are. The WithoutWind heights are calculated assuming a constant wind vector of zero. They have almost complete coverage and therefore form a nice 'pretty picture' of the relative cloud heights over small areas. The RawWind heights are a diagnostic product as they are calculated using all available wind vectors (even the bad ones). It is therefore recommended that one only use the Best and Without wind products. It is important to remember that the stereo matchers pick up the layer of maximum contrast, which is not necessarily the same as the highest cloud so all the stereo heights are keyed to this level of maximum contrast. Therefore, higher and thinner cirrus layers may not be detected by any of the height fields. [Location=GLOBAL] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1.1 km; Longitude_Resolution=1.1 km; Horizontal_Resolution_Range=1 km - < 10 km or approximately .01 degree - < .09 degree; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=Daily - < Weekly].

EOSDIS↗

Cell-Detection Technique for Automated Patch Clamping

A unique and customizable machinevision and image-data-processing technique has been developed for use in automated identification of cells that are optimal for patch clamping. [Patch clamping (in which patch electrodes are pressed against cell membranes) is an electrophysiological technique widely applied for the study of ion channels, and of membrane proteins that regulate the flow of ions across the membranes. Patch clamping is used in many biological research fields such as neurobiology, pharmacology, and molecular biology.] While there exist several hardware techniques for automated patch clamping of cells, very few of those techniques incorporate machine vision for locating cells that are ideal subjects for patch clamping. In contrast, the present technique is embodied in a machine-vision algorithm that, in practical application, enables the user to identify good and bad cells for patch clamping in an image captured by a charge-coupled-device (CCD) camera attached to a microscope, within a processing time of one second. Hence, the present technique can save time, thereby increasing efficiency and reducing cost. The present technique involves the utilization of cell-feature metrics to accurately make decisions on the degree to which individual cells are "good" or "bad" candidates for patch clamping. These metrics include position coordinates (x,y) in the image plane, major-axis length, minor-axis length, area, elongation, roundness, smoothness, angle of orientation, and degree of inclusion in the field of view. The present technique does not require any special hardware beyond commercially available, off-the-shelf patch-clamping hardware: A standard patchclamping microscope system with an attached CCD camera, a personal computer with an imagedata- processing board, and some experience in utilizing imagedata- processing software are all that are needed. A cell image is first captured by the microscope CCD camera and image-data-processing board, then the image data are analyzed by software that implements the present machine-vision technique. This analysis results in the identification of cells that are "good" candidates for patch clamping (see figure). Once a "good" cell is identified, a patch clamp can be effected by an automated patchclamping apparatus or by a human operator. This technique has been shown to enable reliable identification of "good" and "bad" candidate cells for patch clamping. The ultimate goal in further development of this technique is to combine artificial-intelligence processing with instrumentation and controls in order to produce a complete "turnkey" automated patch-clamping system capable of accurately and reliably patch clamping cells with a minimum intervention by a human operator. Moreover, this technique can be adapted to virtually any cellular-analysis procedure that includes repetitive operation of microscope hardware by a human.

McDowell, Mark↗