Search NASA⌕ Search

SEARCH · Search NASA

Results for “image classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Analyst variability in labeling of unsupervised classifications

Analyst variability in the labeling of unsupervised classifications is tested for Landsat 5 Thematic Mapper image products covering two test sites in southern California. The accuracy of results are tested using samples from a photo interpreted base map of the area. The significance of differences between analysts is indicated by comparing Kappa statistics derived from error matrices. Analyst variability is found to be statistically significant in most cases. Certain analysts provided consistently better results for a given study area or degree of training. This work demonstrates the potential influence of analyst bias on what would otherwise seem to be a fairly objective method and suggests that controls for this subjectivity should be factored into experimental designs.

Mcgwire, Kenneth C.↗

A review and analysis of neural networks for classification of remotely sensed multispectral imagery

A literature survey and analysis of the use of neural networks for the classification of remotely sensed multispectral imagery is presented. As part of a brief mathematical review, the backpropagation algorithm, which is the most common method of training multi-layer networks, is discussed with an emphasis on its application to pattern recognition. The analysis is divided into five aspects of neural network classification: (1) input data preprocessing, structure, and encoding; (2) output encoding and extraction of classes; (3) network architecture, (4) training algorithms; and (5) comparisons to conventional classifiers. The advantages of the neural network method over traditional classifiers are its non-parametric nature, arbitrary decision boundary capabilities, easy adaptation to different types of data and input structures, fuzzy output values that can enhance classification, and good generalization for use with multiple images. The disadvantages of the method are slow training time, inconsistent results due to random initial weights, and the requirement of obscure initialization values (e.g., learning rate and hidden layer size). Possible techniques for ameliorating these problems are discussed. It is concluded that, although the neural network method has several unique capabilities, it will become a useful tool in remote sensing only if it is made faster, more predictable, and easier to use.

Paola, Justin D.↗

Communications: Mosquito Habitats, Land Use, and Malaria Risk in Belize from Satellite Imagery

Satellite imagery of northern Belize is used to examine the distribution of land use and breeding habitats of the malaria vector the Anopheles mosquito. A land cover classification based on multispectral SPOT and multitemporal Radarsat images identified eleven land cover classes, including agricultural, forest, and marsh types. Two of the land cover types, Typha domingensis marsh and flooded forest, are Anopheles vestitipennis larval habitats, and one, Eleocharis spp. marsh, is the larval habitat for Anopheles albimanus. Geographic Information Systems (GIS) analyses of land cover demonstrate that the amount of Typha domingensis in a marsh is positively correlated with the amount of agricultural land in the adjacent upland, and negatively correlated with the amount of adjacent forest. This finding is consistent with the hypothesis that nutrient (phosphorus) runoff from agricultural lands is causing an expansion of Typha domingensis in northern Belize. Thus, land use induced expansion of Anopheles vestitipennis larval habitat is potentially increasing malaria risk in Belize, and in other regions where Anopheles vestitipennis is a major malaria vector.

Pope, Kevin↗

Assessing Stratospheric Aerosols Contamination Due to Space Activities

The life cycle of a spacecraft starts and ends in the atmosphere: it interacts with the atmosphere right after the launch and during the atmospheric reentry when it usually mostly ablates. Both phases induce emissions of gases and solid particles, providing a source of these components in the middle atmosphere. Little is known about the exact nature, composition and effects of these emissions on the atmosphere and climate, but their impact is expected to rise as more and more orbiting satellites are launched. Ever since the years 2000, the number of space rockets launched per year has increased by a factor 3 globally. At the same time, the number of satellites launched in orbit around the Earth per year has been multiplied by about 30. One may wonder whether changes in the anthropogenic material injected in the terrestrial stratosphere can be detected and what its influence may be. In order to study the cosmic dust particles arriving on Earth, the NASA Johnson Space Center (JSC) has been systematically collecting solid dust particles from the Earth’s stratosphere by aircraft equipped with dedicated particle collectors since 1981. So far, 25 catalogs have been published, covering campaigns of collection from 1981 to 2020, with a total of 5071 solid particles that have been preliminary characterized and curated. In this work, we use the preliminary classification of the dust particles. Based on SEM images and X-ray EDS composition the collected dust is separated into four groups: C (Cosmic), TCN (Terrestrial Contaminant Natural), TCA (Terrestrial Contaminant Artificial) and AOS (Aluminum Oxide Sphere). The AOS being mostly generated by solid rocket propellant, they also belong to the TCA class. Our analysis of the data published indicates that from 1980 to 2009 the cosmic dust particles typically represent on average 40% of the collection with TCA and TCN corresponding to about 30% each. In the recent years, the TCA fraction has doubled to about 60% of the collection (2010-2020). This increase in anthropogenic particles is likely due to the overall human space activity and its recent increase. We will present the properties of the solid stratospheric dust particles collected and their evolution with time. Future work will be dedicated to better classify the natural and anthropogenic particles collected and described in the existing databases. We will use numerical modelling to produce quantitative estimates of the injected mass, the lifetime of particles in the middle atmosphere (stratosphere) and the relative abundance of the anthropogenic particles with respect to the stratospheric background particle population.

J Lasue↗

Status report: Data management program algorithm evaluation activity at Marshall Space Flight Center

An algorithm evaluation activity was initiated to study the problems associated with image processing by assessing the independent and interdependent effects of registration, compression, and classification techniques on LANDSAT data for several discipline applications. The objective of the activity was to make recommendations on selected applicable image processing algorithms in terms of accuracy, cost, and timeliness or to propose alternative ways of processing the data. As a means of accomplishing this objective, an Image Coding Panel was established. The conduct of the algorithm evaluation is described.

Jayroe, R. R., Jr.↗

Application of LANDSAT data to wetland study and land use classification in west Tennessee

The Obion-Forked Deer River Basin in northwest Tennessee is confronted with several acute land use problems which result in excessive erosion, sedimentation, pollution, and hydrologic runoff. LANDSAT data was applied to determine land use of selected watershed areas within the basin, with special emphasis on determining wetland boundaries. Densitometric analysis was performed to allow numerical classification of objects observed in the imagery on the basis of measurements of optical densities. Multispectral analysis of the LANDSAT imagery provided the capability of altering the color of the image presentation in order to enhance desired relationships. Manual mapping and classification techniques were performed in order to indicate a level of accuracy of the LANDSAT data as compared with high and low altitude photography for land use classification.

Jones, N. L.↗

Image analysis by geostatistical and neural-network methods applications in glaciology

The applicability of neural network techniques, in the classification of ice surfaces and crevasse patterns, was analyzed. The observations of the Bering Glacier (Alaska) obtained from a surface survey and from the global positioning system (GPS) were used. A geographical information system was applied to test the usefulness of standard approaches. The information in the image needed to be reduced prior to the classification. The reduction was performed with a fast variogram algorithm sampling in three oblique directions. The resultant vectors provided the input for the neural network.

Herzfeld, Ute Christina↗

Shuttle Imaging Radar-A (SIR-A) data as a complement to Landsat Multispectral Scanner (MSS) data

Principal components analysis and supervised classifications were performed on two dates of Landsat multispectral scanner (MSS) data registered to one date of Shuttle Imaging Radar-A (SIR-A) data in a wheat-growing area of New South Wales, Australia. The purpose was to evaluate SIR-A data as a complement to Landsat MSS data in an agricultural environment. The SIR-A data was filtered using a 7 x 7 pixel moving window median filter. Principal components analysis indicated the SIR-A data were discriminating between trees and agricultural fields. Supervised classifications using wheat, pasture, trees, and idle classes resulted in increased accuracies for wheat and pasture and slightly decreased accuracies for trees and idle for the Landsat MSS/SIR-A registered data sets over the Landsat MSS alone. Overall classification accuracies were unchanged for one date and substantially increased for the other when the SIR-A data were added to the Landsat MSS data.

Henninger, D. L.↗

Automated Recognition of 3D Features in GPIR Images

A method of automated recognition of three-dimensional (3D) features in images generated by ground-penetrating imaging radar (GPIR) is undergoing development. GPIR 3D images can be analyzed to detect and identify such subsurface features as pipes and other utility conduits. Until now, much of the analysis of GPIR images has been performed manually by expert operators who must visually identify and track each feature. The present method is intended to satisfy a need for more efficient and accurate analysis by means of algorithms that can automatically identify and track subsurface features, with minimal supervision by human operators. In this method, data from multiple sources (for example, data on different features extracted by different algorithms) are fused together for identifying subsurface objects. The algorithms of this method can be classified in several different ways. In one classification, the algorithms fall into three classes: (1) image-processing algorithms, (2) feature- extraction algorithms, and (3) a multiaxis data-fusion/pattern-recognition algorithm that includes a combination of machine-learning, pattern-recognition, and object-linking algorithms. The image-processing class includes preprocessing algorithms for reducing noise and enhancing target features for pattern recognition. The feature-extraction algorithms operate on preprocessed data to extract such specific features in images as two-dimensional (2D) slices of a pipe. Then the multiaxis data-fusion/ pattern-recognition algorithm identifies, classifies, and reconstructs 3D objects from the extracted features. In this process, multiple 2D features extracted by use of different algorithms and representing views along different directions are used to identify and reconstruct 3D objects. In object linking, which is an essential part of this process, features identified in successive 2D slices and located within a threshold radius of identical features in adjacent slices are linked in a directed-graph data structure. Relative to past approaches, this multiaxis approach offers the advantages of more reliable detections, better discrimination of objects, and provision of redundant information, which can be helpful in filling gaps in feature recognition by one of the component algorithms. The image-processing class also includes postprocessing algorithms that enhance identified features to prepare them for further scrutiny by human analysts (see figure). Enhancement of images as a postprocessing step is a significant departure from traditional practice, in which enhancement of images is a preprocessing step.

Park, Han↗

Computer program documentation for the patch subsampling processor

The programs presented are intended to provide a way to extract a sample from a full-frame scene and summarize it in a useful way. The sample in each case was chosen to fill a 512-by-512 pixel (sample-by-line) image since this is the largest image that can be displayed on the Integrated Multivariant Data Analysis and Classification System. This sample size provides one megabyte of data for manipulation and storage and contains about 3% of the full-frame data. A patch image processor computes means for 256 32-by-32 pixel squares which constitute the 512-by-512 pixel image. Thus, 256 measurements are available for 8 vegetation indexes over a 100-mile square.

Nieves, M. J.↗

Geocam Space: Enhancing Handheld Digital Camera Imagery from the International Space Station for Research and Applications

Handheld astronaut photography of the Earth has been collected from the International Space Station (ISS) since 2000, making it the most temporally extensive remotely sensed dataset from this unique Low Earth orbital platform. Exclusive use of digital handheld cameras to perform Earth observations from the ISS began in 2004. Nadir viewing imagery is constrained by the inclined equatorial orbit of the ISS to between 51.6 degrees North and South latitude, however numerous oblique images of land surfaces above these latitudes are included in the dataset. While unmodified commercial off-the-shelf digital cameras provide only visible wavelength, three-band spectral information of limited quality current cameras used with long (400+ mm) lenses can obtain high quality spatial information approaching 2 meters/ground pixel resolution. The dataset is freely available online at the Gateway to Astronaut Photography of Earth site (http://eol.jsc.nasa.gov), and now comprises over 2 million images. Despite this extensive image catalog, use of the data for scientific research, disaster response, commercial applications and visualizations is minimal in comparison to other data collected from free-flying satellite platforms such as Landsat, Worldview, etc. This is due primarily to the lack of fully-georeferenced data products - while current digital cameras typically have integrated GPS, this does not function in the Low Earth Orbit environment. The Earth Science and Remote Sensing (ESRS) Unit at NASA Johnson Space Center provides training in Earth Science topics to ISS crews, performs daily operations and Earth observation target delivery to crews through the Crew Earth Observations (CEO) Facility on board ISS, and also catalogs digital handheld imagery acquired from orbit by manually adding descriptive metadata and determining an image geographic centerpoint using visual feature matching with other georeferenced data, e.g. Landsat, Google Earth, etc. The lack of full geolocation information native to the data makes it difficult to integrate astronaut photographs with other georeferenced data to facilitate quantitative analysis such as urban land cover/land use classification, change detection, or geologic mapping. The manual determination of image centerpoints is both time and labor-intensive, leading to delays in releasing geolocated and cataloged data to the public, such as the timely use of data for disaster response. The GeoCam Space project was funded by the ISS Program in 2015 to develop an on-orbit hardware and ground-based software system for increasing the efficiency of geolocating astronaut photographs from the ISS (Fig. 1). The Intelligent Robotics Group at NASA Ames Research Center leads the development of both the ground and on-orbit systems in collaboration with the ESRS Unit. The hardware component consists of modified smartphone elements including cameras, central processing unit, wireless Ethernet, and an inertial measurement unit (gyroscopes/accelerometers/magnetometers) reconfigured into a compact unit that attaches to the base of the current Nikon D4 camera - and its replacement, the Nikon D5 - and connects using the standard Nikon peripheral connector or USB port. This provides secondary, side and downward facing cameras perpendicular to the primary camera pointing direction. The secondary cameras observe calibration targets with known internal X, Y, and Z position affixed to the interior of the ISS to determine the camera pose corresponding to each image frame. This information is recorded by the GeoCam Space unit and indexed for correlation to the camera time recorded for each image frame. Data - image, EXIF header, and camera pose information - is transmitted to the ground software system (GeoRef) using the established Ku-band USOS downlink system. Following integration on the ground, the camera pose information provides an initial geolocation estimate for the individual film frame. This new capability represents a significant advance in geolocation from the manual feature-matching approach for both nadir and off-nadir viewing imagery. With the initial geolocation estimate, full georeferencing of an image is completed using the rapid tie-pointing interface in GeoRef, and the resulting data is added to the Gateway to Astronaut Photography of Earth online database in both Geotiff and Keyhole Markup Language (kml) formats. The integration of the GeoRef software component of Geocam Space into the CEO image cataloging workflow is complete, and disaster response imagery acquired by the ISS crew is now fully georeferenced as a standard data product. The on-orbit hardware component (GeoSens) is in final prototyping phase, and is on-schedule for launch to the ISS in late 2016. Installation and routine use of the Geocam Space system for handheld digital camera photography from the ISS is expected to significantly improve the usefulness of this unique dataset for a variety of public- and private-sector applications.

Stefanov, William L.↗

Hyperspectral imaging for real-time waste materials characterization and recovery using endmember extraction and abundance detection

Hyperspectral imaging, combined with advanced spectral unmixing techniques and artificial intelligence, offers a powerful solution for improving material identification and classification. Here, this study evaluates the effectiveness of the pixel purity index and the sequential maximum angle convex cone algorithms in extracting and validating spectral signatures from pure samples of paper components (cellulose and lignin) and plastic (polypropylene). Principal-component analysis showed that both algorithms captured nearly all relevant variance for the tested materials. Spectral signatures were compared using the spectral angle mapper, revealing high similarity in the short-wave infrared region and greater variability in the visible near-infrared range. The methodology was then applied to a disposable coffee cup to detect and quantify mixed materials, accurately estimating material abundance and object area with less than 1% error. This approach enhances material classification, supporting product verification, quality control, and automated sorting for sustainable waste management and resource recovery.

36 MATERIALS SCIENCE↗

Up Periscope! Designing a New Perceptual Metric for Imaging System Performance

Modern electronic imaging systems include optics, sensors, sampling, noise, processing, compression, transmission and display elements, and are viewed by the human eye. Many of these elements cannot be assessed by traditional imaging system metrics such as the MTF. More complex metrics such as NVTherm do address these elements, but do so largely through parametric adjustment of an MTF-like metric. The parameters are adjusted through subjective testing of human observers identifying specific targets in a set of standard images. We have designed a new metric that is based on a model of human visual pattern classification. In contrast to previous metrics, ours simulates the human observer identifying the standard targets. One application of this metric is to quantify performance of modern electronic periscope systems on submarines.

imaging↗

An Intercomparison Between Radar Reflectivity and the IR Cloud Classification Technique for the TOGA-COARE Area

Satellite infrared (IR) and visible (VIS) images from the Tropical Ocean Global Atmosphere - Coupled Ocean Atmosphere Response Experiment (TOGA-COARE) experiment are investigated through the use of Clustering Analysis. The clusters are obtained from the values of IR and VIS counts and the local variance for both channels. The clustering procedure is based on the standardized histogram of each variable obtained from 179 pairs of images. A new approach to classify high clouds using only IR and the clustering technique is proposed. This method allows the separation of the enhanced convection in two main classes: convective tops, more closely related to the most active core of the storm, and convective systems, which produce regions of merged, thick anvil clouds. The resulting classification of different portions of cloudiness is compared to the radar reflectivity field for intensive events. Convective Systems and Convective Tops are followed during their life cycle using the IR clustering method. The areal coverage of precipitation and features related to convective and stratiform rain is obtained from the radar for each stage of the evolving Mesoscale Convective Systems (MCS). In order to compare the IR clustering method with a simple threshold technique, two IR thresholds (Tir) were used to identify different portions of cloudiness, Tir=240K which roughly defines the extent of all cloudiness associated with the MCS, and Tir=220K which indicates the presence of deep convection. It is shown that the IR clustering technique can be used as a simple alternative to identify the actual portion of convective and stratiform rainfall.

Carvalho, L. M. V.↗

Towards Explainability of UAV-Based Convolutional Neural Networks for Object Classification

f autonomous systems using trust and trustworthiness is the focus of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR), a new NASA Convergent Aeronautical Solutions (CAS) Project. One critical research element of ATTRACTOR is explainability of the decision-making across relevant subsystems of an autonomous system. The ability to explain why an autonomous system makes a decision is needed to establish a basis of trustworthiness to safely complete a mission. Convolutional Neural Networks (CNNs) are popular visual object classifiers that have achieved high levels of classification performances without clear insight into the mechanisms of the internal layers and features. To explore the explainability of the internal components of CNNs, we reviewed three feature visualization methods in a layer-by-layer approach using aviation related images as inputs. Our approach to this is to analyze the key components of a classification event in order to generate component labels for features of the classified image at different layers of depths. For example, an airplane has wings, engines, and landing gear. These could possibly be identified somewhere in the hidden layers from the classification and these descriptive labels could be provided to a human or machine teammate while conducting a shared mission and to engender trust. Each descriptive feature may also be decomposed to a combination of primitives such as shapes and lines. We expect that knowing the combination of shapes and parts that create a classification will enable trust in the system and insight into creating better structures for the CNN.

Dolph, Chester V.↗

An intelligent object recognizer and classification system for astronomical use

An account is given of an image-processing system based on AI concepts, which allows input images produced by the CCT/Transit Instrument to be compared with a standard-object hierarchylike network of prototypes presented within the computer as 'frames'. Each frame contains information concerning either a standard object or the links among such objects. This method, by comparison to conventional, statistically-based pattern recognition systems, classifies data as an astronomer would and thereby lends credibility to its conclusions; it also furnishes a natural avenue for the machine's serendipitous discovery of new classes of objects.

Bernat, Andrew P.↗

Global four-band spectral classification of Jupiter's clouds - Color/albedo units and trends

Voyager 2 digital images of Jupiter have been used to construct a global data base of cloud reflectance in four spectral bands: three wideband 'colors' with effective wavelengths at 431 nm, 564 nm, and 599 nm, plus the narrowband CH4 filter centered at 621 nm. This data base has been spectrally classified at 0.5 deg resolution to separate the complex scene into cloud color/albedo units on a pixel-by-pixel basis, revealing 20 distinct and five tentative units. These include both large, globally distributed units and very small, localized units. Global color maps and unit membership maps are used to highlight associations and trends.

Thompson, W. Reid↗

The Statistical Consulting Center for Astronomy (SCCA)

The process by which raw astronomical data acquisition is transformed into scientifically meaningful results and interpretation typically involves many statistical steps. Traditional astronomy limits itself to a narrow range of old and familiar statistical methods: means and standard deviations; least-squares methods like chi(sup 2) minimization; and simple nonparametric procedures such as the Kolmogorov-Smirnov tests. These tools are often inadequate for the complex problems and datasets under investigations, and recent years have witnessed an increased usage of maximum-likelihood, survival analysis, multivariate analysis, wavelet and advanced time-series methods. The Statistical Consulting Center for Astronomy (SCCA) assisted astronomers with the use of sophisticated tools, and to match these tools with specific problems. The SCCA operated with two professors of statistics and a professor of astronomy working together. Questions were received by e-mail, and were discussed in detail with the questioner. Summaries of those questions and answers leading to new approaches were posted on the Web (www.state.psu.edu/ mga/SCCA). In addition to serving individual astronomers, the SCCA established a Web site for general use that provides hypertext links to selected on-line public-domain statistical software and services. The StatCodes site (www.astro.psu.edu/statcodes) provides over 200 links in the areas of: Bayesian statistics; censored and truncated data; correlation and regression, density estimation and smoothing, general statistics packages and information; image analysis; interactive Web tools; multivariate analysis; multivariate clustering and classification; nonparametric analysis; software written by astronomers; spatial statistics; statistical distributions; time series analysis; and visualization tools. StatCodes has received a remarkable high and constant hit rate of 250 hits/week (over 10,000/year) since its inception in mid-1997. It is of interest to scientists both within and outside of astronomy. The most popular sections are multivariate techniques, image analysis, and time series analysis. Hundreds of copies of the ASURV, SLOPES and CENS-TAU codes developed by SCCA scientists were also downloaded from the StatCodes site. In addition to formal SCCA duties, SCCA scientists continued a variety of related activities in astrostatistics, including refereeing of statistically oriented papers submitted to the Astrophysical Journal, talks in meetings including Feigelson's talk to science journalists entitled "The reemergence of astrostatistics" at the American Association for the Advancement of Science meeting, and published papers of astrostatistical content.

Akritas, Michael↗