Search NASA⌕ Search

SEARCH · Search NASA

Results for “image classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Bayes classification of interferometric TOPSAR data

We report the Bayes classification of terrain types at different sites using airborne interferometric synthetic aperture radar (INSAR) data. A Gaussian maximum likelihood classifier was applied on multidimensional observations derived from the SAR intensity, the terrain elevation model, and the magnitude of the interferometric correlation. Training sets for forested, urban, agricultural, or bare areas were obtained either by selecting samples with known ground truth, or by k-means clustering of random sets of samples uniformly distributed across all sites, and subsequent assignments of these clusters using ground truth. The accuracy of the classifier was used to optimize the discriminating efficiency of the set of features that was chosen. The most important features include the SAR intensity, a canopy penetration depth model, and the terrain slope. We demonstrate the classifier's performance across sites using a unique set of training classes for the four main terrain categories. The scenes examined include San Francisco (CA) (predominantly urban and water), Mount Adams (WA) (forested with clear cuts), Pasadena (CA) (urban with mountains), and Antioch Hills (CA) (water, swamps, fields). Issues related to the effects of image calibration and the robustness of the classification to calibration errors are explored. The relative performance of single polarization Interferometric data classification is contrasted against classification schemes based on polarimetric SAR data.

Michel, T. R.↗

An AI-Based 3D Bat Movement Tracking System at Wind Energy Facilities Using Multi-Thermal Video Cameras

The poster at the 15th Wind Wildlife Research Meeting discusses how to leverage the potential of real-time thermal-imaging methodologies in quantifying nocturnal bat activities at wind turbines, using 3D computer vision techniques within a deep learning framework. This innovation enables the automatic detection and classification of bats, birds, and insects in thermal-imaging videos captured at wind turbine sites, facilitating efficient and accurate data analysis for enhanced understanding and mitigation of bat-wind turbine interactions.

AI↗

An AI-Based 3D Bat Movement Tracking System at Wind Energy Facilities Using Multi-Thermal Video Cameras

The talk at the NAWEA Wind Tech 2024 conference discusses how to leverage the potential of real-time thermal-imaging methodologies in quantifying nocturnal bat activities at wind turbines, using 3D computer vision techniques within a deep learning framework. This innovation enables the automatic detection and classification of bats, birds, and insects in thermal-imaging videos captured at wind turbine sites, facilitating efficient and accurate data analysis for enhanced understanding and mitigation of bat-wind turbine interactions.

AI↗

Water Across Synthetic Aperture Radar Data (WASARD): SAR Water Body Classification for the Open Data Cube

The detection of inland water bodies from Synthetic Aperture Radar (SAR) data provides a great advantage over water detection with optical data, since SAR imaging is not impeded by cloud cover. Traditional methods of detecting water from SAR data involves using thresholding methods that can be labor intensive and imprecise. This paper describes Water Across Synthetic Aperture Radar Data (WASARD): a method of water detection from SAR data which automates and simplifies the thresholding process using machine learning on training data created from Geoscience Australia’s WOFS algorithm. Of the machine learning models tested, the Linear Support Vector Machine was determined to be optimal, with the option of training using solely the VH polarization or a combination of the VH and VV polarizations. WASARD was able to identify water in the target area with a correlation of 97% with WOFS. Sentinel-1, Open Data Cube, Earth Observations, Machine Learning, Water Detection 1. INTRODUCTION Water classification is an important function of Earth imaging satellites, as accurate remote classification of land and water can assist in land use analysis, flood prediction, climate change research, as well as a variety of agricultural applications [2]. The ability to identify bodies of water remotely via satellite is immensely cheaper than contracting surveys of the areas in question, meaning that an application that can accurately use satellite data towards this function can make valuable information available to nations which would not be able to afford it otherwise. Highly reliable applications for the remote detection of water currently exist for use with optical satellite data such as that provided by LANDSAT. One such application, Geoscience Australia’s Water Observations from Space (WOFS) has already been ported for use with the Open Data Cube [6]. However, water detection using optical data from Landsat is constrained by its relatively long revisit cycle of 16 days [5], and water detection using any optical data is constrained in that it lacks the ability to make accurate classifications through cloud cover [2]. The alternative solution which solves these problems is water detection using SAR data, which images the Earth using cloud-penetrating microwaves. Because of its advantages over optical data, much research has been done into water detection using SAR data. Traditionally, this has been done using the thresholding method, which involves picking a polarization band and labeling all pixels for which this band’s value is below a certain threshold as containing water. The thresholding method works since water tends to return a much lower backscatter value to the satellite than land [1]. However, this method can be flawed since estimating the proper threshold is often imprecise, complicated, and labor intensive for the end user. Thresholding also tends to use data from only one SAR polarization, when a combination of polarizations can provide insight into whether water is present. [2] In order to alleviate these problems, this paper presents an application for the Open Data Cube to detect water from SAR data using support vector machine (SVM) classification. 2. PLATFORM WASARD is an application for the Open Data Cube, a mechanism which provides a simple yet efficient means of ingesting, storing, and retrieving remote sensing data. Data can be ingested and made analysis ready according to whatever specifications the researcher chooses, and easily resampled to artificially alter a scene’s resolution. Currently WASARD supports water detection on scenes from ESA’s Sentinel-1 and JAXA’s ALOS. When testing WASARD, Sentinel-1 was most commonly used due to its relatively high spatial resolution and its rapid 6 day revisit cycle [5]. With minor alterations to the application's code, however, it could support data from other satellites. 3. METHODOLOGY Using supervised classification, WASARD compares SAR data to a dataset pre-classified by WOFS in order to train an SVM classifier. This classifier is then used to detect water in other SAR scenes outside the training set. Accuracy was measured according to the following metrics:  Precision: a measure of what percentage of the points WASARD labels as water are truly water  Recall: a measure of what percentage of the total water cover WASARD was able to identify.  F1 Score: a harmonic average of the precision and recall scores Both precision and recall are calculated at the end of the training phase, when the trained classifier is compared to a testing dataset. Because the WOFS algorithm’s classifications are used as the truth values when training a WASARD classifier, when precision and recall are mentioned in this paper, they are always with respect to the values produced by WOFS on a similar scene of Landsat data, which themselves have a classification accuracy of 97% [6]. Visual representations of water identified by WASARD in this paper were produced using the function wasard_plot(), which is included in WASARD. 3.1 Algorithm Selection The machine learning model used by WASARD is the Linear Support Vector Machine (SVM). This model uses a supervised learning algorithm to develop a classifier, meaning it creates a vector which can be multiplied by the vector formed by the relevant data bands to determine whether a pixel in a SAR scene contains water. This classifier is trained by comparing data points from selected bands in a SAR scene to their respective labels, which in this case are “water” or “not water” as given by the WOFS algorithm. The SVM was selected over the Random Forest model, which outperformed the SVM in training speed, but had a greater classification time and lower accuracy, and the Multilayer Perceptron Artificial Neural Network, which had a slightly higher average accuracy than the SVM, but much greater training and classification times. Figure 1: Visual representation of the SVM Classifier. Each white point represents a pixel in a SAR scene. In Figure 1, the diagonal line separating pixels determined to be water from those determined not to be water represents the actual classification vector produced by the SVM. It is worth noting that once the model has been trained, classification of pixels is done in a similar manner as in the thresholding method. This is especially true if only one band was used to train the model. 3.1 Feature Selection Sentinel-1 collects data from two bands: the Vertical/Vertical polarization (VV) and the Vertical/Horizontal polarization (VH). When 100 SVM classifiers were created for each polarization individually, and for the combination of the two, the following results were achieved: Figure 2: Accuracy of classifiers trained using different polarization bands. Precision and Recall were measured with respect to the values produced by WOFS. Figure 2 demonstrates that using both the VV and VH bands trades slightly lower recall for significantly greater precision when compared with the VH band alone, and that using the VV band alone is inferior in both metrics. WASARD therefore defaults to using both the VV and VH bands, and includes the option to use solely the VH band. The VV polarization’s lower precision compared to the VH polarization is in contrast to results from previous research and may merit further analysis [4]. 3.2 Training a Classifier The steps in training a classifier with WASARD are 1. Selecting two scenes (one SAR, one optical) with the same spatial extents, and acquired close to each other in time, with a preference that the scenes are taken on the same day. 2. Using the WOFS algorithm to produce an array of the detected water in the scene of optical data, to be used as the labels during supervised learning 3. Data points from the selected bands from the SAR acquisition are bundled together into an array with the corresponding labels gathered from WOFS. A random sample with an equal number of points labeled “Water” and “Not Water” is selected to be partitioned into a training and a testing dataset 4. Using Scikit-Learn’s LinearSVC object, the training dataset is used to produce a classifier, which is then tested against the testing dataset to determine its precision and recall The result is a wasard_classifier object, which has the following attributes: 1. f1, recall, and precision: 3 metrics used to determine the classifier’s accuracy 2. Coefficient: Vector which the SVM uses to make its predictions. The classifier detects water when the dot product of the coefficient and the vector formed by the SAR bands is positive 3. Save(): allows a user to save a classifier to the disk in order to use it without retraining 4. wasard_classify(): Classifies an entire xarray of SAR data using the SVM classifier All of the above steps are performed automatically when the user creates a wasard_classifier object. 3.3 Classifying a Dataset Once the classifier has been created, it can be used to detect water in an xarray of SAR data using wasard_classify(). By taking the dot product of the classifier’s coefficients and the vector formed by the selected bands of SAR data, an array of predictions is constructed. A classifier can effectively be used on the same spatial extents as the ones where it was trained, or on any area with a similar landscape. While

Kreiser, Zachary↗

Low-cost data analysis systems for processing multispectral scanner data

A research-oriented data analysis system was developed which is used for evaluating complex remote sensor systems and for development of techniques for application of remotely sensed data. Some modular hardware components were developed which may be added to one's existing facilities to establish a low-cost data analysis system for processing multispectral scanner data. Software modules which are compatible with small general purpose digital computers process and analyze remote sensor data, and convert it to information needed by users. The software modules are written in FORTRAN IV language for ease of transfer to other computer systems. The basic hardware and software system requirements are defined for some low-cost data analysis systems consisting of an image display system, a small general purpose digital computer, and an output recording device. The hardware modules consist of: a LANDSAT MSS data reformatting program; a series of spectral pattern recognition programs required to generate surface classification maps and tabular information; programs to convert computer generated maps from image space to a geographically referenced base; programs to extract data and irregularly shaped areas and to produce thematic maps of the designated areas; and programs to tabulate acreages of selected classification categories. Some off-the-shelf, inexpensive digital image display systems are described.

Whitley, S. L.↗

Some confusion factors in radar image interpretation

Geologic interpretation of radar imagery for land use applications is discussed with reference to its dependence on classification of the radar return into categories related to some training area within the image. It is shown that such interpretation relies on the assumption that surface characteristics of areas with similar returns are truly similar. It is further shown that this may not always be true over water surfaces due to the influence of system parameters on the radar return. In imagery over land, both system parameters and scene parameters may lead to ambiguous returns which can ultimately lead to misinterpretation.

Blanchard, B. J.↗

Mapping of taiga forest units using AIRSAR data and/or optical data, and retrieval of forest parameters

A maximum a posteriori Bayesian classifier for multifrequency polarimetric SAR data is used to perform a supervised classification of forest types in the floodplains of Alaska. The image classes include white spruce, balsam poplar, black spruce, alder, non-forests, and open water. The authors investigate the effect on classification accuracy of changing environmental conditions, and of frequency and polarization of the signal. The highest classification accuracy (86 percent correctly classified forest pixels, and 91 percent overall) is obtained combining L- and C-band frequencies fully polarimetric on a date where the forest is just recovering from flooding. The forest map compares favorably with a vegetation map assembled from digitized aerial photos which took five years for completion, and address the state of the forest in 1978, ignoring subsequent fires, changes in the course of the river, clear-cutting of trees, and tree growth. HV-polarization is the most useful polarization at L- and C-band for classification. C-band VV (ERS-1 mode) and L-band HH (J-ERS-1 mode) alone or combined yield unsatisfactory classification accuracies. Additional data acquired in the winter season during thawed and frozen days yield classification accuracies respectively 20 percent and 30 percent lower due to a greater confusion between conifers and deciduous trees. Data acquired at the peak of flooding in May 1991 also yield classification accuracies 10 percent lower because of dominant trunk-ground interactions which mask out finer differences in radar backscatter between tree species. Combination of several of these dates does not improve classification accuracy. For comparison, panchromatic optical data acquired by SPOT in the summer season of 1991 are used to classify the same area. The classification accuracy (78 percent for the forest types and 90 percent if open water is included) is lower than that obtained with AIRSAR although conifers and deciduous trees are better separated due to the presence of leaves on the deciduous trees. Optical data do not separate black spruce and white spruce as well as SAR data, cannot separate alder from balsam poplar, and are of course limited by the frequent cloud cover in the polar regions. Yet, combining SPOT and AIRSAR offers better chances to identify vegetation types independent of ground truth information using a combination of NDVI indexes from SPOT, biomass numbers from AIRSAR, and a segmentation map from either one.

Rignot, Eric↗

Hydra: Computer Vision for Online Data Quality Monitoring

Hydra is a system utilizing computer vision for near real-time data quality monitoring. Currently operational across all of Jefferson Lab’s experimental halls, it reduces the workload of shift takers by autonomously monitoring diagnostic plots during experiments. Hydra uses "off-the-shelf" supervised learning technologies and is supported by a comprehensive MySQL database. To simplify access, web apps have been developed to facilitate both labeling and monitoring of Hydra’s inferences. Hydra can connect with the alarm system and incorporates complete historical tracking, enabling it to identify issues that shift takers could miss. When issues are detected, a natural first question is: "Why does Hydra think there is a problem?" To answer, Hydra employs Gradient-weighted Class Activation Maps (GradCAM) to identify regions of the image that are important for the specific classification. This interpretive layer enhances transparency and trustworthiness, which is essential for integration with experiment workflows and operation. The Hydra system, results, and sociological considerations for deployment will be discussed.

Jeske, Torri↗

ADP of multispectral scanner data for land use mapping

The advantages and disadvantages of various remote sensing instrumentation and analysis techniques are reviewed. The use of multispectral scanner data and the automatic data processing techniques are considered. A computer-aided analysis system for remote sensor data is described with emphasis on the image display, statistics processor, wavelength band selection, classification processor, and results display. Advanced techniques in using spectral and temporal data are also considered.

Hoffer, R. M.↗

The trophic classification of lakes using ERTS multispectral scanner data

Lake classification methods based on the use of ERTS data are described. Preliminary classification results obtained by multispectral and digital image processing techniques indicate satisfactory correlation between ERTS data and EPA-supplied water analysis. Techniques for determining lake trophic levels using ERTS data are examined, and data obtained for 20 lakes are discussed.

Blackwell, R. J.↗

Evaluation of LANDSAT-2 (ERTS) images applied to geologic structures and mineral resources of South America

The author has identified the following significant results. The Salar of Coposa is located in northern Chile along the frontier with Bolivia. The surface was divided into six general classes of materials. Analysis of LANDSAT image 1243-14001 by use of interactive multispectral computer (Image 100) enabled accurate repetition of these general classes based on reflectance. The Salar of Uyuni is the largest of the South American evaporite deposits. Using image 1243-13595, and parallel piped computer classification of reflectance units, the Salar was divided into nine classes ranging from deep to shallow water, water over salt, salt saturated with water, and several classes of dry salt.

Carter, W. D.↗

Instructional image processing on a university mainframe: The Kansas system

An interactive digital image processing program package was developed that runs on the University of Kansas central computer, a Honeywell Level 66 multi-processor system. The module form of the package allows easy and rapid upgrades and extensions of the system and is used in remote sensing courses in the Department of Geography, in regional five-day short courses for academics and professionals, and also in remote sensing projects and research. The package comprises three self-contained modules of processing functions: Subimage extraction and rectification; image enhancement, preprocessing and data reduction; and classification. Its use in a typical course setting is described. Availability and costs are considered.

Williams, T. H. L.↗

Evaluation of solar angle variation over digital processing of LANDSAT imagery

The effects of the seasonal variation of illumination over digital processing of LANDSAT images are evaluated. Original images are transformed by means of digital filtering to enhance their spatial features. The resulting images are used to obtain an unsupervised classification of relief units. After defining relief classes, which are supposed to be spectrally different, topographic variables (declivity, altitude, relief range and slope length) are used to identify the true relief units existing on the ground. The samples are also clustered by means of an unsupervised classification option. The results obtained for each LANDSAT overpass are compared. Digital processing is highly affected by illumination geometry. There is no correspondence between relief units as defined by spectral features and those resulting from topographic features.

Parada, N. D. J.↗

Spectroscopy of the extranuclear line-emitting regions associated with the gravitational lens system 2016 + 112

Moderate-resolution slit spectroscopy of the extended emission-line objects A1 and B1 located within 5 arcsec of the triple radio source 2016 + 112 shows that at least one is physically associated with the z = 3.273 quasar thought to be multiply imaged by a foreground galaxy. The data and theoretical models unanimously favor the identification of A1 and B1 with two separate clouds of ionized gas that lie within a few kiloparsecs of the primary A/B QSO and radio source. The available evidence does not support the view that they are multiple images of a single object or their classification as separate (companion) galaxies.

Schneider, D. P.↗

Canopy reflectance modeling in a tropical wooded grassland

The Li-Strahler canopy reflectance model, driven by LANDSAT Thematic Mapper (TM) data, provided regional estimates of tree size and density in two bioclimatic zones in Africa. This model exploits tree geometry in an inversion technique to predict average tree size and density from reflectance data using a few simple patameters measured in the field and in the imagery. Reflectance properties of the trees were measured in the study sites using a pole-mounted radiometer. The measurements showed that the assumptions of the simple Li-Strahler model are reasonable for these woodlands. The field radiometer measurements were used to calculate the normalized difference vegetation index (NDVI), and the integrated NDVI over the canopy was related to crown volume. Predictions of tree size and density from the canopy model were used with allometric equations from the literature to estimate woody biomass and potential foliar biomass for the sites and for the regions. Estimates were compared with independent measurements made in the Sahelian sites, and to typical values from the literature for these regions and for similar woodlands. In order to apply the inversion procedure regionally, an area must first be stratified into woodland cover classes, and dry-season TM data were used to generate a stratum map of the study areas with reasonable accuracy. The method used was unsupervised classification of multi-data principal components images.

Simonett, David↗

Classification and knowledge

Automated procedures to classify objects are discussed. The classification problem is reviewed, and the relation of epistemology and classification is considered. The classification of stellar spectra and of resolved images of galaxies is addressed.

Kurtz, Michael J.↗

Search for the Identification of 3EG J1835+5918: Evidence for a New Type of High-Energy Gamma-Ray Source

The EGRET source 3EG J1835+5918 is the brightest and most accurately positioned of the as-yet unidentified high-energy gamma-ray sources at high Galactic latitude (l, b = 89 deg, 25 deg). We present a multiwavelength study of the region around it, including X-ray, radio, and optical imaging surveys, as well as optical spectroscopic classification of most of the active objects in this area. Identifications are made of all but one of the ROSAT and ASCA sources in this region to a flux limit of approximately 5 x 10(exp -14) erg/sq cm s, which is 10(exp -4) of the gamma-ray flux. The identified X-ray sources in or near the EGRET error ellipse are radio-quiet QSOs, a galaxy cluster, and coronal emitting stars. We also find eight quasars using purely optical color selection, and we have monitored the entire field for variable optical objects on short and long time scales without any notable discoveries. The radio sources inside the error ellipse are all fainter than 4 mJy at 1.4 GHz. There are no flat-spectrum radio sources in the vicinity; the brightest neighboring radio sources are steep-spectrum radio galaxies or quasars. Since no blazar-like or pulsar-like candidate has been found as a result of these searches, 3EG J1835+5918 must be lacking one or more of the physically essential attributes of these known classes of gamma-ray emitters. If it is an AGN it lacks the beamed emission radio of blazars by at least a factor of 100 relative to identified EGRET blazars. If it is an isolated neutron star, it lacks the steady thermal X-rays from a cooling surface and the magnetospheric non-thermal X-ray emission that is characteristic of all EGRET pulsars. If a pulsar, 3EG J1835+5918 must be either older or more distant than Geminga, and probably an even more efficient or beamed gamma-ray engine. One intermittent ROSA T source falls on a blank optical field to a limit of B greater than 23.4, V greater than 23.3, and R greater than 22.5. In view of this conspicuous absence, RX J1836-2+5925 should be examined further as a candidate for identification with 3EG J1835+5918 and possibly the prototype of a new class of high-energy gamma-ray source.

Mirabal, N.↗

An Orbital "Virtual Radar" from TRMM Passive Microwave and Lightning Observations

The retrieval of vertical structure from joint passive microwave and lightning observations is demonstrated. Three years of data from the TRMM (Tropical Rainfall Measuring Mission) are used as a training dataset for regression and classification neural networks; the TMI (TRMM Microwave Imager) and LIS (Lightning Imaging Sensor) provide the inputs, the PR (Precipitation Radar) provides the training targets. Both vertical reflectivity profile categorization (into 9 convective, 7 stratiform, 2 mixed and 6 anvil types) and geophysical parameters (surface rainfall, vertically integrated liquid (VIL), ice water content (IWC) and echo tops) are retrieved. Retrievals are successful over both land and ocean surfaces. The benefit of using lightning observations as inputs to these retrievals is quantitatively demonstrated; lightning essentially provides an additional convective/stratiform discriminator, and is most important for isolation of midlevel (tops in the mixed phase region) convective profile types (this is because high frequency passive microwave observations already provide good convective/stratiform discrimination for deep convective profiles). This is highly relevant as midlevel convective profiles account for an extremely large fraction of tropical rainfall, and yet are most difficult to discriminate from comparable-depth stratiform profile types using passive microwave observations alone.

Boccippio, Dennis J.↗