Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Agricultural scene understanding

The author has identified the following significant results. The LACIE field measurement data were radiometrically calibrated. Calibration enabled valid comparisons of measurements from different dates, sensors, and/or locations. Thermal band canopy results included: (1) Wind velocity had a significant influence on the overhead radiance temperature and the effect was quantized. Biomass and soil temperatures, temperature gradient, and canopy geometry were altered. (2) Temperature gradient was a function of wind velocity. (3) Temperature gradient of the wheat canopy was relatively constant during the day. (4) The laser technique provided good quality geometric characterization.

Landgrebe, D. A.↗

Computer image processing and recognition

A systematic introduction to the concepts and techniques of computer image processing and recognition is presented. Consideration is given to such topics as image formation and perception; computer representation of images; image enhancement and restoration; reconstruction from projections; digital television, encoding, and data compression; scene understanding; scene matching and recognition; and processing techniques for linear systems.

Hall, E. L.↗

Improved canopy reflectance modeling and scene inference through improved understanding of scene pattern

The Li-Strahler reflectance model, driven by LANDSAT Thematic Mapper (TM) data, provided regional estimates of tree size and density within 20 percent of sampled values in two bioclimatic zones in West Africa. This model exploits tree geometry in an inversion technique to predict average tree size and density from reflectance data using a few simple parameters measured in the field (spatial pattern, shape, and size distribution of trees) and in the imagery (spectral signatures of scene components). Trees are treated as simply shaped objects, and multispectral reflectance of a pixel is assumed to be related only to the proportions of tree crown, shadow, and understory in the pixel. These, in turn, are a direct function of the number and size of trees, the solar illumination angle, and the spectral signatures of crown, shadow and understory. Given the variance in reflectance from pixel to pixel within a homogeneous area of woodland, caused by the variation in the number and size of trees, the model can be inverted to give estimates of average tree size and density. Because the inversion is sensitive to correct determination of component signatures, predictions are not accurate for small areas.

Franklin, Janet↗

Comprehensive Understanding for Vegetated Scene Radiance Relationships

The improvement of our fundamental understanding of the dynamics of directional scattering properties of vegetation canopies through analysis of field data and model simulation data is discussed. Directional reflectance distributions spanning the entire existance hemisphere were measured in two field studies; one using a Mark III 3-band radiometer and one using rapid scanning bidirectional field instrument called PARABOLA. Surfaces measured included corn, soybeans, bare soils, grass lawn, orchard grass, alfalfa, cotton row crops, plowed field, annual grassland, stipa grass, hard wheat, salt plain shrubland, and irrigated wheat. Some structural and optical measurements were taken. Field data show unique reflectance distributions ranging from bare soil to complete vegetation canopies. Physical mechanisms causing these trends are proposed based on scattering properties of soil and vegetation. Soil exhibited a strong backscattering peak toward the Sun. Complete vegetation exhibited a bowl distribution with the minimum reflectance near nadir. Incomplete vegetation canopies show shifting of the minimum reflectance off of nadir in the forward scattering direction because both the scattering properties or the vegetation and soil are observed.

Kimes, D. S.↗

Online Self-Supervised Long-Range Scene Segmentation for MAVs

Recently, there have been numerous advances in the development of payload and power constrained lightweight Micro Aerial Vehicles (MAVs). As these robots aspire for high-speed autonomous flights in complex dynamic environments, robust scene understanding at long-range becomes critical. The problem is heavily characterized by either the limitations imposed by sensor capabilities for geometry-based methods, or the need for large-amounts of manually annotated training data required by data-driven methods. This motivates the need to build systems that have the capability to alleviate these problems by exploiting the complimentary strengths of both geometry and data-driven methods. In this paper, we take a step in this direction and propose a generic framework for adaptive scene segmentation using self-supervised online learning. We present this in the context of vision-based autonomous MAV flight, and demonstrate the efficacy of our proposed system through extensive experiments on benchmark datasets and real world field tests.

Matthies, Larry↗

Analytical design of multispectral sensors

An optimal design based on the criterion of minimum mean square representation error using the Karhunen-Loeve expansion was developed to represent the spectral response functions from a stratum based upon a stochastic process scene model. From the overall pattern recognition system perspective, the effect of the representation accuracy on a typical performance criterion (the probability of correct classification) is investigated. The optimum sensor design provides a standard against which practical (suboptimum) operational sensors can be compared. An example design is provided and its performance is illustrated. Although developed primarily for the purpose of sensor design, the procedure has potential for making important contributions to scene understanding. Spectral channels which have narrow bandwidths relative to current sensor systems may be necessary to provide adequate spectral representation and improved classification performance.

Wiersma, D. J.↗

Optical processing and Space Station automation

Optical information processing research aimed at Space Station automation applications is reviewed. The emphasis of the NASA Ames Research Center program is on intelligent optical pattern recognition and optical control processing. Attention is given to the primary functions of an overall scene understanding system: distortion-invariant optical feature generation, dimensionality reduction, object classification, and contextual information processing. A method of using synthetic discriminant functions to facilitate learning in a high-speed optical correlator is described. A discussion is presented of candidate analog and digital architectures for the optical implementation of state-estimation algorithms needed for the control of high-dimension dynamic systems. The multivariate system chosen for the optical control technology demonstration - a segmented, adaptive mirror and interferometrically based wavefront sensor - is also described.

Ennis, D. J.↗

Encoding spatial images: A fuzzy set theory approach

As the use of fuzzy set theory continues to grow, there is an increased need for methodologies and formalisms to manipulate obtained fuzzy subsets. Concepts involving relative position of fuzzy patterns are acknowledged as being of high importance in many areas. In this paper, we present an approach based on the concept of dominance in fuzzy set theory for modelling relative positions among fuzzy subsets of a plane. In particular, we define the following spatial relations: to the left (right), in front of, behind, above, below, near, far from, and touching. This concept has been implemented to define spatial relationships among fuzzy subsets of the image plane. Spatial relationships based on fuzzy set theory, coupled with a fuzzy segmentation, should therefore yield realistic results in scene understanding.

Sztandera, Leszek M.↗

Knowledge/geometry-based Mobile Autonomous Robot Simulator (KMARS)

Ongoing applied research is focused on developing guidance system for robot vehicles. Problems facing the basic research needed to support this development (e.g., scene understanding, real-time vision processing, etc.) are major impediments to progress. Due to the complexity and the unpredictable nature of a vehicle's area of operation, more advanced vehicle control systems must be able to learn about obstacles within the range of its sensor(s). A better understanding of the basic exploration process is needed to provide critical support to developers of both sensor systems and intelligent control systems which can be used in a wide spectrum of autonomous vehicles. Elcee Computek, Inc. has been working under contract to the Flight Dynamics Laboratory, Wright Research and Development Center, Wright-Patterson AFB, Ohio to develop a Knowledge/Geometry-based Mobile Autonomous Robot Simulator (KMARS). KMARS has two parts: a geometry base and a knowledge base. The knowledge base part of the system employs the expert-system shell CLIPS ('C' Language Integrated Production System) and necessary rules that control both the vehicle's use of an obstacle detecting sensor and the overall exploration process. The initial phase project has focused on the simulation of a point robot vehicle operating in a 2D environment.

Cheng, Linfu↗

Comprehensive Understanding for Vegetated Scene Radiance Relationships

Directional reflectance distributions spanning the entire existent hemisphere were measured in two field studies; one using a Mark III 3-band radiometer and one using the rapid scanning bidirectional field instrument called PARABOLA. Surfaces measured included corn, soybeans, bare soils, grass lawn, orchard grass, alfalfa, cotton row crops, plowed field, annual grassland, stipa grass, hard wheat, salt plain shrubland, and irrigated wheat. Analysis of field data showed unique reflectance distributions ranging from bare soil to complete vegetation canopies. Physical mechanisms causing these trends were proposed. A 3-D model was developed and is unique in that it predicts: (1) the directional spectral reflectance factors as a function of the sensor's azimuth and zenith angles and the sensor's position above the canopy; (2) the spectral absorption as a function of location within the scene; and (3) the directional spectral radiance as a function of the sensor's location within the scene. Initial verification of the model as applied to a soybean row crop showed that the simulated directional data corresponded relatively well in gross trends to the measured data. The model was expanded to include the anisotropic scattering properties of leaves as a function of the leaf orientation distribution in both the zenith and azimuth angle modes.

Kimes, D. S.↗

An overview of computer vision

An overview of computer vision is provided. Image understanding and scene analysis are emphasized, and pertinent aspects of pattern recognition are treated. The basic approach to computer vision systems, the techniques utilized, applications, the current existing systems and state-of-the-art issues and research requirements, who is doing it and who is funding it, and future trends and expectations are reviewed.

Gevarter, W. B.↗

Understanding the Radiant Scattering Behavior of Vegetated Scenes

Knowledge of the physics of the scattering behavior of vegetation will ultimately serve the remote sensing and earth science community in many ways. For example, it will provide: (1) insight and guidance in developing new extraction techniques of canopy characteristics, (2) a basis for better interpretation of off-nadir satellite and aircraft data, (3) a basis for defining specifications of future earth observing sensor systems, and (4) a basis for defining important aspects of physical and biological processes of the plant system. The overall objective of the three-year study is to improve our fundamental understanding of the dynamics of directional scattering properties of vegetation canopies through analysis of field data and model simulation data. The specific objectives are to: (1) collect directional reflectance data covering the entire exitance hemisphere for several common vegetation canopies with various geometric structure (both homogeneous and row crop structures), (2) develop a scene radiation model with a general mathematical framework which will treat 3-D variability in heterogeneous scenes and account for 3-D radiant interactions within the scene, (3) conduct validations of the model on collected data sets, and (4) test and expand proposed physical scattering mechanisms involved in reflectance distribution dynamics by analyzing both field and modeling data.

Kimes, D. S.↗

Improving our understanding of the remote sensing process

Plans for two fundamental research programs aimed at improving an understanding of the physics and mathematics of remote sensing are discussed. The first program, Scene Radiation and Atmospheric Research Program, is concerned with developing the capability to determine biophysical attributes of terrestrial scenes through an improved understanding of the relationships between those properties and remotely sensed radiation. The research issues in the second program, Mathematical Pattern Recognition and Image Analysis, are discussed with reference to the following five categories: preprocessing, digital image representation, object scene inference, computational structures, and continuing studies.

Calabrese, M. A.↗

Feature Selection for Classification of Polar Regions Using a Fuzzy Expert System

Labeling, feature selection, and the choice of classifier are critical elements for classification of scenes and for image understanding. This study examines several methods for feature selection in polar regions, including the list, of a fuzzy logic-based expert system for further refinement of a set of selected features. Six Advanced Very High Resolution Radiometer (AVHRR) Local Area Coverage (LAC) arctic scenes are classified into nine classes: water, snow / ice, ice cloud, land, thin stratus, stratus over water, cumulus over water, textured snow over water, and snow-covered mountains. Sixty-seven spectral and textural features are computed and analyzed by the feature selection algorithms. The divergence, histogram analysis, and discriminant analysis approaches are intercompared for their effectiveness in feature selection. The fuzzy expert system method is used not only to determine the effectiveness of each approach in classifying polar scenes, but also to further reduce the features into a more optimal set. For each selection method,features are ranked from best to worst, and the best half of the features are selected. Then, rules using these selected features are defined. The results of running the fuzzy expert system with these rules show that the divergence method produces the best set features, not only does it produce the highest classification accuracy, but also it has the lowest computation requirements. A reduction of the set of features produced by the divergence method using the fuzzy expert system results in an overall classification accuracy of over 95 %. However, this increase of accuracy has a high computation cost.

Penaloza, Mauel A.↗

Precipitable Water Variability Using SSM/I and GOES VAS Pathfinder Data Sets

Determining moisture variability for all weather scenes is critical to understanding the earth's hydrologic cycle and global climate changes. Remote sensing from geostationary satellites provides the necessary temporal and spatial resolutions necessary for global change studies. Due to antenna size constraints imposed with the use of microwave radiometers, geostationary satellites have carried instruments passively measuring radiation at infrared wavelengths or shorter. The shortfall of using infrared instruments in moisture studies lies in its inability to sense terrestrial radiation through clouds. Microwave emissions, on the other hand, are mostly unaffected by cloudy atmospheres. Land surface emissivity at microwave frequencies exhibit both high temporal and spatial variability thus confining moisture retrievals at microwave frequencies to over marine atmospheres (a near uniform cold background). This study intercompares the total column integrated water content Precipitable Water, (PW) as derived from both the Special Sensor Microwave Imager (SSM/I) and the Geostationary Operational Environmental Satellite (GOES) VISSR Atmospheric Sounder (VAS) pathfinder data sets. PW is a bulk parameter often used to quantify moisture variability and is important to understanding the earth's hydrologic cycle and climate system. This research has been spawned in an effort to combine two different algorithms which together can lead to a more comprehensive quantification of global water vapor. The approach taken here is to intercompare two independent PW retrieval algorithms and to validate the resultant retrievals against an existing data set, namely the European Center for Medium range Weather Forecasts (ECMWF) model analysis data.

Lerner, Jeffrey A.↗

Nonnegative Matrix Factorization for Efficient Hyperspectral Image Projection

Hyperspectral imaging for remote sensing has prompted development of hyperspectral image projectors that can be used to characterize hyperspectral imaging cameras and techniques in the lab. One such emerging astronomical hyperspectral imaging technique is wide-field double-Fourier interferometry. NASA's current, state-of-the-art, Wide-field Imaging Interferometry Testbed (WIIT) uses a Calibrated Hyperspectral Image Projector (CHIP) to generate test scenes and provide a more complete understanding of wide-field double-Fourier interferometry. Given enough time, the CHIP is capable of projecting scenes with astronomically realistic spatial and spectral complexity. However, this would require a very lengthy data collection process. For accurate but time-efficient projection of complicated hyperspectral images with the CHIP, the field must be decomposed both spectrally and spatially in a way that provides a favorable trade-off between accurately projecting the hyperspectral image and the time required for data collection. We apply nonnegative matrix factorization (NMF) to decompose hyperspectral astronomical datacubes into eigenspectra and eigenimages that allow time-efficient projection with the CHIP. Included is a brief analysis of NMF parameters that affect accuracy, including the number of eigenspectra and eigenimages used to approximate the hyperspectral image to be projected. For the chosen field, the normalized mean squared synthesis error is under 0.01 with just 8 eigenspectra. NMF of hyperspectral astronomical fields better utilizes the CHIP's capabilities, providing time-efficient and accurate representations of astronomical scenes to be imaged with the WIIT.

NMF↗