Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Local spatial frequency analysis for computer vision

A sense of vision is a prerequisite for a robot to function in an unstructured environment. However, real-world scenes contain many interacting phenomena that lead to complex images which are difficult to interpret automatically. Typical computer vision research proceeds by analyzing various effects in isolation (e.g., shading, texture, stereo, defocus), usually on images devoid of realistic complicating factors. This leads to specialized algorithms which fail on real-world images. Part of this failure is due to the dichotomy of useful representations for these phenomena. Some effects are best described in the spatial domain, while others are more naturally expressed in frequency. In order to resolve this dichotomy, we present the combined space/frequency representation which, for each point in an image, shows the spatial frequencies at that point. Within this common representation, we develop a set of simple, natural theories describing phenomena such as texture, shape, aliasing and lens parameters. We show these theories lead to algorithms for shape from texture and for dealiasing image data. The space/frequency representation should be a key aid in untangling the complex interaction of phenomena in images, allowing automatic understanding of real-world scenes.

Krumm, John↗
NASA NTRS1993

Extended ecosystem signatures with application to Eos synergism requirements

The primary objective is to define the advantages of synergistically combining optical and microwave remote sensing measurements for the determination of biophysical properties important in ecosystem modeling. This objective was approached in a stepwise fashion starting with ground-based observations of controlled agricultural and orchard canopies and progressing to airborne observations of more natural forest ecosystems. This observational program is complemented by a parallel effort to model the visible reflectance and microwave scattering properties of composite vegetation canopies. The goals of the modeling studies are to verify our basic understanding of the sensor-scene interaction physics and to provide the basis for development of inverse models optimized for retrieval of key biophysical properties. These retrieval algorithms can then be used to simulate the expected performance of various aspects of Eos including the need for simultaneous SAR and HIRIS observations or justification for other (non-synchronous) relative timing constraints and the frequency, polarization, and angle of incidence requirements for accurate biophysical parameter extractions. This program completed a very successful series of truck-mounted experiments, made remarkable progress in development and validation of optical reflectance and microwave scattering models for vegetation, extended the scattering models to accommodate discontinuous and periodic canopies, developed inversion approaches for surface and canopy properties, and disseminated these results widely through symposia and journal publications. In addition, the third generation of the computer code for the microwave scattering models was provided to a number of other US, Canadian, Australian, and European investigators who are currently presenting and publishing results using the MIMICS research code.

Ulaby, Fawwaz T.↗
NASA NTRS1990

MacDoctor: The Macintosh diagnoser

When the Macintosh computer was first released, the primary user was a computer hobbyist who typically had a significant technical background and was highly motivated to understand the internal structure and operational intricacies of the computer. In recent years the Macintosh computer has become a widely-accepted general purpose computer which is being used by an ever-increasing non-technical audience. This has lead to a large base of users which has neither the interest nor the background to understand what is happening 'behind the scenes' when the Macintosh is put to use - or what should be happening when something goes wrong. Additionally, the Macintosh itself has evolved from a simple closed design to a complete family of processor platforms and peripherals with a tremendous number of possible configurations. With the increasing popularity of the Macintosh series, software and hardware developers are producing a product for every user's need. As the complexity of configuration possibilities grows, the need for experienced or even expert knowledge is required to diagnose problems. This presents a problem to uneducated or casual users. This problem indicates a new Macintosh consumer need; that is, a diagnostic tool able to determine the problem for the user. As the volume of Macintosh products has increased, this need has also increased.

Lavery, David B.↗
NASA NTRS2019

How Qualitative Data Drives Design at NASA

There's a lot of paperwork to go to space! Building tools to help the folks "behind the scenes" at NASA takes a deep understanding of their complex worlds. In this lightning talk, David Luetger will discuss how San Jose State University Research Foundation at NASA Ames used qualitative data to support NASA's Space Launch System program, and introduced a new set of stakeholders to user-centered design.

User experience↗
NASA NTRS1980

A model of plant canopy polarization response

Sensors to remotely measure the linear polarization of ground scenes have been proposed for the Multispectral Resource Sampler (MRS), a satellite sensor system proposed to complement the Thematic Mapper. At present justification for a sensor on MRS to measure scene polarization is limited. This paper discusses a model for the amount of linearly polarized light reflected by the shiny leaves of such crops as wheat, corn, and sorghum. The theory demonstrates that, potentially, measurements of the linearly polarized light from a crop canopy may be used as an additional feature to discriminate between crops. Examination of the model suggests that, potentially, satellite polarization measurements may be used to monitor crop development stage, leaf water content, leaf area index, hail damage, and certain plant diseases. The model adds to the understanding of the potential information content of scene polarization measurements acquired by future satellite sensor systems such as MRS.

Vanderbilt, V. C.↗
NASA NTRS2018

WFIRST CGI Integral Field Spectrograph Performance and Post-Processing in the OS6 Observing Scenario

The WFIRST coronagraph instrument (CGI) will have an integral field spectrograph (IFS) backend to disperse the entire field of view at once and obtain spatially-resolved, low-resolution spectra of the speckles and science scene. The IFS will be key to understanding the spectral nature of the speckles, obtain science spectra of planets and disks, and will be used for broadband wavefront control. In order to characterize, predict, and optimize the performance of the instrument, we present a detailed model of the IFS in the context of the new OS6 observing scenario. The simulation includes spatial, spectral, and temporal variations of the speckle field on the IFS detector plane, which allows us to explore several post-processing methods and assess what gains can be expected. The simulator includes the latest models of the detector behavior when operating in photon-counting mode.

WFIRST coronagraph instrument (CGI)↗
NASA NTRS1990

Multiband radar characterization of forest biomes

The utility of airborne and orbital SAR in classification, assessment, and monitoring of forest biomes is investigated through analysis of orbital synthetic aperature radar (SAR) and multifrequency and multipolarized airborne SAR imagery relying on image tone and texture. Preliminary airborne SAR experiments and truck-mounted scatterometer observations demonstrated that the three dimensional structural complexity of a forest, and the various scales of temporal dynamics in the microwave dielectric properties of both trees and the underlying substrate would severely limit empirical or semi-empirical approaches. As a consequence, it became necessary to develop a more profound understanding of the electromagnetic properties of a forest scene and their temporal dynamics through controlled experimentation coupled with theoretical development and verification. The concatenation of various models into a physically-based composite model treating the entire forest scene became the major objective of the study as this is the key to development of a series of robust retrieval algorithms for forest biophysical properties. In order to verify the performance of the component elements of the composite model, a series of controlled laboratory and field experiments were undertaken to: (1) develop techniques to measure the microwave dielectric properties of vegetation; (2) relate the microwave dielectric properties of vegetation to more readily measured characteristics such as density and moisture content; (3) calculate the radar cross-section of leaves, and cylinders; (4) improve backscatter models for rough surfaces; and (5) relate attenuation and phase delays during propagation through canopies to canopy properties. These modeling efforts, as validated by the measurements, were incorporated within a larger model known as the Michigan Microwave Canopy Scattering (MIMICS) Model.

Dobson, M. Craig↗
NASA NTRS1990

Simulation of nap-of-Earth flight in helicopters

NASA-Ames in conjunction with U.S. Army has conducted extensive simulation investigations of rotorcraft in the nap-of-the-Earth (NOE) environment and has developed facility capabilities specifically designed for this flight regime. The experience gained to date in applying these facilities to the NOE flight regime are reported along with the results of specific experimental investigations conducted to understand the influence of both motion and visual scene on the fidelity of NOE simulation. Included are comparisons of results from concurrent piloted simulation and flight research investigations. The results of a recent simulation experiment to investigate simulator sickness in this flight regime is also discussed.

Condon, Gregory W.↗
NASA NTRS1991

Simulation of nap-of-the-Earth flight in helicopters

NASA-Ames along with the U.S. Army has conducted extensive simulation studies of rotorcraft in the nap-of-the-Earth (NOE) environment and has developed facility capabilities specifically designed for this flight regime. The experience gained to date in applying these facilities to the NOE flight regime are reported along with the results of specific experimental studies conducted to understand the influence of both motion and visual scene on the fidelity of NOE simulation. Included are comparisons of results from concurrent piloted simulation and flight research studies. The results of a recent simulation experiment to study simulator sickness in this flight regime is also discussed.

Condon, Gregory W.↗
NASA NTRS1981

Land cover classification accuracy as a function of sensor spatial resolution

The benefits obtained from sensor systems for monitoring earth resources will depend on the application and interpretation methods used. A frequently used analysis method is supervised per-pixel multispectral classification with a typical application being land cover classification. An investigation is conducted to evaluate the effect of spatial resolution on the ability to classify land cover types with per-pixel digital image classification techniques. Attention is also given to the documentation of changes in scene noise and the percentage of boundary pixels as a function of spatial resolution, in order to improve the understanding of the interrelationship between classification accuracy and spatial resolution. It is found that scene noise varies considerably between land cover categories. Changes in scene noise with coarsening resolution occur at different rates for different categories.

Markham, B. L.↗
NASA NTRS1989

Extracting text from real-world scenes

Many scenes contain significant textual information that can be extremely helpful for understanding and/or navigation. For example, text-based information can frequently be the primary cure used for navigating inside buildings. A subject might first read a marquee, then look for an appropriate hallway and walk along reading door signs and nameplates until the destination is found. Optical character recognition has been studied extensively in recent years, but has been applied almost exclusively to printed documents. As these techniques improve it becomes reasonable to ask whether they can be applied to an arbitrary scene in an attempt to extract text-based information. Before an automated system can be expected to navigate by reading signs, however, the text must first be segmented from the rest of the scene. This paper discusses the feasibility of extracting text from an arbitrary scene and using that information to guide the navigation of a mobile robot. Considered are some simple techniques for first locating text components and then tracking the individual characters to form words and phrases. Results for some sample images are also presented.

Bixler, J. Patrick↗
NASA NTRS1990

New computational control techniques and increased understanding for stereo 3-D displays

While conventional asymptotic transformations for mapping a visual scene onto a stereo viewing volume allow a single, specific scene-distance to be fixed at the screen location, the present piecewise linear approach allows creative partitioning of the depth viewing volume and affords the freedom to place depth-cueing emphasis wherever desired. Attention is given to the results of an experiment with the novel system which attempted to ascertain the effective region of stereopsis cueing. A practical viewing volume falls between -25 and +60 percent of the viewer-to-screen distance. The data indicate that increased viewer-to-CRT distances furnish increasing usable depth.

Williams, Steven P.↗
NASA NTRS1992

SAR backscatter from coniferous forest gaps

A study is in progress comparing Airborne Synthetic Aperture Radar (AIRSAR) backscatter from coniferous forest plots containing gaps to backscatter from adjacent gap-free plots. Issues discussed are how do gaps in the range of 400 to 1600 sq m (approximately 4-14 pixels at intermediate incidence angles) affect forest backscatter statistics and what incidence angles, wavelengths, and polarizations are most sensitive to forest gaps. In order to visualize the slant-range imaging of forest and gaps, a simple conceptual model is used. This strictly qualitative model has led us to hypothesize that forest radar returns at short wavelengths (eg., C-band) and large incidence angles (e.g., 50 deg) should be most affected by the presence of gaps, whereas returns at long wavelengths and small angles should be least affected. Preliminary analysis of 1989 AIRSAR data from forest near Mt. Shasta supports the hypothesis. Current forest backscatter models such as MIMICS and Santa Barbara Discontinuous Canopy Backscatter Model have in several cases correctly predicted backscatter from forest stands based on inputs of measured or estimated forest parameters. These models do not, however, predict within-stand SAR scene texture, or 'intrinsic scene variability' as Ulaby et al. has referred to it. For instance, the Santa Barbara model, which may be the most spatially coupled of the existing models, is not truly spatial. Tree locations within a simulated pixel are distributed according to a Poisson process, as they are in many natural forests, but tree size is unrelated to location, which is not the case in nature. Furthermore, since pixels of a simulated stand are generated independently in the Santa Barbara model, spatial processes larger than one pixel are not modeled. Using a different approach, Oliver modeled scene texture based on an hypothetical forest geometry. His simulated scenes do not agree well with SAR data, perhaps due to the simple geometric model used. Insofar as texture is the expression of biological forest processes, such as succession and disease, and physical ones, such as fire and wind-throw, it contains useful information about the forest, and has value in image interpretation and classification. Forest gaps are undoubtedly important contributors to scene variance. By studying the localized effects of gaps on forest backscatter, guided by our qualitative model, we hope to understand more clearly the manner in which spatial heterogeneities in forests produce variations in backscatter, which collectively give rise to scene texture.

Day, John L.↗
NASA NTRS1986

On the nature of models in remote sensing

An explicit framework can provide a better understanding of remote sensing models and their interrelationships. This framework distinguishes between the scene, which is real and exists on the ground, and the image, which is a collection of spatially arranged masurements drawn from the scene. The scene model generalizes and parameterizes the essential qualities of the scene. Scene models may be discrete, in which the scene model consists of discrete elements with boundaries, or continuous, in which matter and energy flows are taken to be continuous and there are no clear or sharp boundaries in the scene. In the discrete case, there are two possibilities for models: H- and L-resolution. In the H-resolution case, the resolution cells of the image are smaller than the elements, and thus the elements may be individually resolved. In the L-resolution case, the resolution cells are larger than the elements and cannot be resolved. Most canopy models are L-resolution, deterministic, and noninvertible in nature; image processing models, however, tend to be H-resolution, empirical, and invertible. This taxonomy helps add insight to the development of remote sensing theory and point the way to new, productive areas of research.

Strahler, A. H.↗
NASA NTRS1985

Fundamental remote sensing science research program: The Scene Radiation and Atmospheric Effects Characterization Project

The Scene Radiation and Atmospheric Effects Characterization (SRAEC) Project was established within the NASA Fundamental Remote Sensing Science Research Program to improve our understanding of the fundamental relationships of energy interactions between the sensor and the surface target, including the effect of the atmosphere. The current studies are generalized into the following five subject areas: optical scene modeling, Earth-space radiative transfer, electromagnetic properties of surface materials, microwave scene modeling, and scatterometry studies. This report has been prepared to provide a brief overview of the SRAEC Project history and objectives and to report on the scientific findings and project accomplishments made by the nineteen principal investigators since the project's initiation just over three years ago. This annual summary report derives from the most recent annual principal investigators meeting held January 29 to 31, 1985.

Deering, D. W.↗
NASA NTRS1991

Analysis and representation of complex structures in separated flows

We discuss our recent work on extraction and visualization of topological information in separated fluid flow data sets. As with scene analysis, an abstract representation of a large data set can greatly facilitate the understanding of complex, high-level structures. When studying flow topology, such a representation can be produced by locating and characterizing critical points in the velocity field and generating the associated stream surfaces. In 3D flows, the surface topology serves as the starting point. The 2D tangential velocity field near the surface of the body is examined for critical points. The tangential velocity field is integrated out along the principal directions of certain classes of critical points to produce curves depicting the topology of the flow near the body. The points and curves are linked to form a skeleton representing the 2D vector field topology. This skeleton provides a basis for analyzing the 3D structures associated with the flow separation. The points along the separation curves in the skeleton are used to start tangent curve integrations. Integration origins are successively refined to produce stream surfaces. The map of the global topology is completed by generating those stream surfaces associated with 3D critical points.

Helman, James↗
NASA NTRS2015

Improving AIRS Radiance Spectra in High Contrast Scenes Using MODIS

The Atmospheric Infrared Sounder (AIRS) on the EOS Aqua Spacecraft was launched on May 4, 2002. AIRS acquires hyperspectral infrared radiances in 2378 channels ranging in wavelength from 3.7-15.4 microns with spectral resolution of better than 1200, and spatial resolution of 13.5 km with global daily coverage. The AIRS is designed to measure temperature and water vapor profiles for improvement in weather forecast accuracy and improved understanding of climate processes. As with most instruments, the AIRS Point Spread Functions (PSFs) are not the same for all detectors. When viewing a non-uniform scene, this causes a significant radiometric error in some channels that is scene dependent and cannot be removed without knowledge of the underlying scene. The magnitude of the error depends on the combination of non-uniformity of the AIRS spatial response for a given channel and the non-uniformity of the scene, but is typically only noticeable in about 1% of the scenes and about 10% of the channels. The current solution is to avoid those channels when performing geophysical retrievals. In this effort we use data from the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument to provide information on the scene uniformity that is used to correct the AIRS data. For the vast majority of channels and footprints the technique works extremely well when compared to a Principal Component (PC) reconstruction of the AIRS channels. In some cases where the scene has high inhomogeneity in an irregular pattern, and in some channels, the method can actually degrade the spectrum. Most of the degraded channels appear to be slightly affected by random noise introduced in the process, but those with larger degradation may be affected by alignment errors in the AIRS relative to MODIS or uncertainties in the PSF. Despite these errors, the methodology shows the ability to correct AIRS radiances in non-uniform scenes under some of the worst case conditions and improves the ability to match AIRS and MODIS radiances in non-uniform scenes.

spatial↗
NASA NTRS1998

Satellite-Based Investigations of the Transition from an Oceanic to Continental Transform Margin

Detailed characterization of neotectonics evolution of the Valle de San Felipe and Arroyo Grande regions in northern Baja California. Reoccupied GEOMEX GPS sites, and occupied a regional GPS (Global Positioning System) network. The Baja California peninsula in Mexico offers a unique setting for studying the kinematic evolution of a complex, active strike-slip/rift plate boundary. We are currently conducting remote sensing, geologic, and geodetic studies of this boundary. The combined data sets will yield instantaneous and time integrated views of its evolution. This proposal solicits renewed funding from NASA to support remote sensing and geologic studies. During the late Cenozoic, Baja California has been the locus of changing fault geometry that has accommodated components of the relative motion between the North America and Pacific plates. Contemporary slip between the two plates occurs in a broad zone that encompasses much of southern California and the Baja California Peninsula. The transfer of slip across this zone in southern California is relatively well understood. South of the border, the geometry and role of specific faults and structural provinces in transferring plate margin deformation across the peninsula is enigmatic. Results We use Landsat Thematic Mapper imagery of the Baja California Peninsula to identify recent and active faults, and then conduct field studies that characterize the temporal and spatial structural evolution of the plate margin. These data address questions concerning the neotectonic development of the Gulf of California, the Baja California Peninsula, and their role in evolution of the post-Miocene Pacific - North American plate boundary. Moreover, these studies provide constraints on the geometry of active faults, allowing more exact understanding of the results of ongoing NASA-supported geodetic experiments. In addition, anticipated publication of the TM scenes will provide a widely available geological data base for relatively little-known peninsula California. Achievements include development of an ArcInfo data base of Landsat and SPOT imagery, detailed field studies of Neogene structures in northeastern Baja California, and new constraint on Pacific - North America plate motion at Baja California latitudes. These results are reported in maps, manuscripts and data products which are published or near completion.

Miller, M. Meghan↗