Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1989

Extracting text from real-world scenes

Many scenes contain significant textual information that can be extremely helpful for understanding and/or navigation. For example, text-based information can frequently be the primary cure used for navigating inside buildings. A subject might first read a marquee, then look for an appropriate hallway and walk along reading door signs and nameplates until the destination is found. Optical character recognition has been studied extensively in recent years, but has been applied almost exclusively to printed documents. As these techniques improve it becomes reasonable to ask whether they can be applied to an arbitrary scene in an attempt to extract text-based information. Before an automated system can be expected to navigate by reading signs, however, the text must first be segmented from the rest of the scene. This paper discusses the feasibility of extracting text from an arbitrary scene and using that information to guide the navigation of a mobile robot. Considered are some simple techniques for first locating text components and then tracking the individual characters to form words and phrases. Results for some sample images are also presented.

Bixler, J. Patrick↗
NASA NTRS1990

New computational control techniques and increased understanding for stereo 3-D displays

While conventional asymptotic transformations for mapping a visual scene onto a stereo viewing volume allow a single, specific scene-distance to be fixed at the screen location, the present piecewise linear approach allows creative partitioning of the depth viewing volume and affords the freedom to place depth-cueing emphasis wherever desired. Attention is given to the results of an experiment with the novel system which attempted to ascertain the effective region of stereopsis cueing. A practical viewing volume falls between -25 and +60 percent of the viewer-to-screen distance. The data indicate that increased viewer-to-CRT distances furnish increasing usable depth.

Williams, Steven P.↗
NASA NTRS1992

SAR backscatter from coniferous forest gaps

A study is in progress comparing Airborne Synthetic Aperture Radar (AIRSAR) backscatter from coniferous forest plots containing gaps to backscatter from adjacent gap-free plots. Issues discussed are how do gaps in the range of 400 to 1600 sq m (approximately 4-14 pixels at intermediate incidence angles) affect forest backscatter statistics and what incidence angles, wavelengths, and polarizations are most sensitive to forest gaps. In order to visualize the slant-range imaging of forest and gaps, a simple conceptual model is used. This strictly qualitative model has led us to hypothesize that forest radar returns at short wavelengths (eg., C-band) and large incidence angles (e.g., 50 deg) should be most affected by the presence of gaps, whereas returns at long wavelengths and small angles should be least affected. Preliminary analysis of 1989 AIRSAR data from forest near Mt. Shasta supports the hypothesis. Current forest backscatter models such as MIMICS and Santa Barbara Discontinuous Canopy Backscatter Model have in several cases correctly predicted backscatter from forest stands based on inputs of measured or estimated forest parameters. These models do not, however, predict within-stand SAR scene texture, or 'intrinsic scene variability' as Ulaby et al. has referred to it. For instance, the Santa Barbara model, which may be the most spatially coupled of the existing models, is not truly spatial. Tree locations within a simulated pixel are distributed according to a Poisson process, as they are in many natural forests, but tree size is unrelated to location, which is not the case in nature. Furthermore, since pixels of a simulated stand are generated independently in the Santa Barbara model, spatial processes larger than one pixel are not modeled. Using a different approach, Oliver modeled scene texture based on an hypothetical forest geometry. His simulated scenes do not agree well with SAR data, perhaps due to the simple geometric model used. Insofar as texture is the expression of biological forest processes, such as succession and disease, and physical ones, such as fire and wind-throw, it contains useful information about the forest, and has value in image interpretation and classification. Forest gaps are undoubtedly important contributors to scene variance. By studying the localized effects of gaps on forest backscatter, guided by our qualitative model, we hope to understand more clearly the manner in which spatial heterogeneities in forests produce variations in backscatter, which collectively give rise to scene texture.

Day, John L.↗
NASA NTRS1986

On the nature of models in remote sensing

An explicit framework can provide a better understanding of remote sensing models and their interrelationships. This framework distinguishes between the scene, which is real and exists on the ground, and the image, which is a collection of spatially arranged masurements drawn from the scene. The scene model generalizes and parameterizes the essential qualities of the scene. Scene models may be discrete, in which the scene model consists of discrete elements with boundaries, or continuous, in which matter and energy flows are taken to be continuous and there are no clear or sharp boundaries in the scene. In the discrete case, there are two possibilities for models: H- and L-resolution. In the H-resolution case, the resolution cells of the image are smaller than the elements, and thus the elements may be individually resolved. In the L-resolution case, the resolution cells are larger than the elements and cannot be resolved. Most canopy models are L-resolution, deterministic, and noninvertible in nature; image processing models, however, tend to be H-resolution, empirical, and invertible. This taxonomy helps add insight to the development of remote sensing theory and point the way to new, productive areas of research.

Strahler, A. H.↗
NASA NTRS1985

Fundamental remote sensing science research program: The Scene Radiation and Atmospheric Effects Characterization Project

The Scene Radiation and Atmospheric Effects Characterization (SRAEC) Project was established within the NASA Fundamental Remote Sensing Science Research Program to improve our understanding of the fundamental relationships of energy interactions between the sensor and the surface target, including the effect of the atmosphere. The current studies are generalized into the following five subject areas: optical scene modeling, Earth-space radiative transfer, electromagnetic properties of surface materials, microwave scene modeling, and scatterometry studies. This report has been prepared to provide a brief overview of the SRAEC Project history and objectives and to report on the scientific findings and project accomplishments made by the nineteen principal investigators since the project's initiation just over three years ago. This annual summary report derives from the most recent annual principal investigators meeting held January 29 to 31, 1985.

Deering, D. W.↗
NASA NTRS1991

Analysis and representation of complex structures in separated flows

We discuss our recent work on extraction and visualization of topological information in separated fluid flow data sets. As with scene analysis, an abstract representation of a large data set can greatly facilitate the understanding of complex, high-level structures. When studying flow topology, such a representation can be produced by locating and characterizing critical points in the velocity field and generating the associated stream surfaces. In 3D flows, the surface topology serves as the starting point. The 2D tangential velocity field near the surface of the body is examined for critical points. The tangential velocity field is integrated out along the principal directions of certain classes of critical points to produce curves depicting the topology of the flow near the body. The points and curves are linked to form a skeleton representing the 2D vector field topology. This skeleton provides a basis for analyzing the 3D structures associated with the flow separation. The points along the separation curves in the skeleton are used to start tangent curve integrations. Integration origins are successively refined to produce stream surfaces. The map of the global topology is completed by generating those stream surfaces associated with 3D critical points.

Helman, James↗
NASA NTRS2015

Improving AIRS Radiance Spectra in High Contrast Scenes Using MODIS

The Atmospheric Infrared Sounder (AIRS) on the EOS Aqua Spacecraft was launched on May 4, 2002. AIRS acquires hyperspectral infrared radiances in 2378 channels ranging in wavelength from 3.7-15.4 microns with spectral resolution of better than 1200, and spatial resolution of 13.5 km with global daily coverage. The AIRS is designed to measure temperature and water vapor profiles for improvement in weather forecast accuracy and improved understanding of climate processes. As with most instruments, the AIRS Point Spread Functions (PSFs) are not the same for all detectors. When viewing a non-uniform scene, this causes a significant radiometric error in some channels that is scene dependent and cannot be removed without knowledge of the underlying scene. The magnitude of the error depends on the combination of non-uniformity of the AIRS spatial response for a given channel and the non-uniformity of the scene, but is typically only noticeable in about 1% of the scenes and about 10% of the channels. The current solution is to avoid those channels when performing geophysical retrievals. In this effort we use data from the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument to provide information on the scene uniformity that is used to correct the AIRS data. For the vast majority of channels and footprints the technique works extremely well when compared to a Principal Component (PC) reconstruction of the AIRS channels. In some cases where the scene has high inhomogeneity in an irregular pattern, and in some channels, the method can actually degrade the spectrum. Most of the degraded channels appear to be slightly affected by random noise introduced in the process, but those with larger degradation may be affected by alignment errors in the AIRS relative to MODIS or uncertainties in the PSF. Despite these errors, the methodology shows the ability to correct AIRS radiances in non-uniform scenes under some of the worst case conditions and improves the ability to match AIRS and MODIS radiances in non-uniform scenes.

spatial↗
NASA NTRS1998

Satellite-Based Investigations of the Transition from an Oceanic to Continental Transform Margin

Detailed characterization of neotectonics evolution of the Valle de San Felipe and Arroyo Grande regions in northern Baja California. Reoccupied GEOMEX GPS sites, and occupied a regional GPS (Global Positioning System) network. The Baja California peninsula in Mexico offers a unique setting for studying the kinematic evolution of a complex, active strike-slip/rift plate boundary. We are currently conducting remote sensing, geologic, and geodetic studies of this boundary. The combined data sets will yield instantaneous and time integrated views of its evolution. This proposal solicits renewed funding from NASA to support remote sensing and geologic studies. During the late Cenozoic, Baja California has been the locus of changing fault geometry that has accommodated components of the relative motion between the North America and Pacific plates. Contemporary slip between the two plates occurs in a broad zone that encompasses much of southern California and the Baja California Peninsula. The transfer of slip across this zone in southern California is relatively well understood. South of the border, the geometry and role of specific faults and structural provinces in transferring plate margin deformation across the peninsula is enigmatic. Results We use Landsat Thematic Mapper imagery of the Baja California Peninsula to identify recent and active faults, and then conduct field studies that characterize the temporal and spatial structural evolution of the plate margin. These data address questions concerning the neotectonic development of the Gulf of California, the Baja California Peninsula, and their role in evolution of the post-Miocene Pacific - North American plate boundary. Moreover, these studies provide constraints on the geometry of active faults, allowing more exact understanding of the results of ongoing NASA-supported geodetic experiments. In addition, anticipated publication of the TM scenes will provide a widely available geological data base for relatively little-known peninsula California. Achievements include development of an ArcInfo data base of Landsat and SPOT imagery, detailed field studies of Neogene structures in northeastern Baja California, and new constraint on Pacific - North America plate motion at Baja California latitudes. These results are reported in maps, manuscripts and data products which are published or near completion.

Miller, M. Meghan↗
NASA NTRS2022

Terra and Aqua MODIS Collection 7 Level 1B Algorithm

MODIS continues to be an important instrument for NASA’s Earth Observing System (EOS). Terra and Aqua MODIS have produced more than 22 and 20 years of global datasets that have significantly helped scientists better understand the Earth’s systems respectively. The MODIS Level-1B (L1B) algorithms use the uncalibrated, geolocated Earth scene observations as input and convert the instrument response into calibrated reflectance and radiance, which are used to generate the downstream science products. The sustained calibration and characterization activities undertaken by the MODIS Characterization Support Team have resulted in several upgrades to the L1B algorithms in order to maintain accurate calibration in the data products. In this paper, we present an overview of the L1B algorithm designated as Collection 7. Various algorithm enhancements both in the reflective bands and thermal bands characterization, are currently under science testing and evaluation. Once applied in data processing (projected in early 2023), they are expected to manifest in improved science products, both in terms of radiometric accuracy and long-term stability.

MODIS↗
NASA NTRS2015

Software Development: 3D Animations and Creating User Interfaces for Realistic Simulations

My fall 2015 semester was spent at the Lyndon B. Johnson Space Center working in the Integrated Graphics, Operations, and Analysis Laboratory (IGOAL). My first project was to create a video animation that could tell the story of OMICS. OMICS is a term being used in the field of biomedical science to describe the collective technologies that study biological systems, such as what makes up a cell and how it functions with other systems. In the IGOAL I used a large 23 inch Wacom monitor to draw storyboards, graphics, and line art animations. I used Blender as the 3D environment to sculpt, shape, cut or modify the several scenes and models for the video. A challenge creating this video was to take a term used in biomedical science and describe it in such a way that an 8th grade student can understand. I used a line art style because it would visually set the tone for what we thought was an educational style. In order to get a handle on the perspective and overall feel for the animation without overloading my workspace, I split up the 2 minute animation into several scenes. I used Blender's python scripting capabilities which allowed for the addition of plugins to add or modify tools. The scripts can also directly interact with the objects to create naturalistic patterns or movements. After collecting the rendered scenes, I used Blender's built-in video editing workspace to output the animation. My second project was to write software that emulates a physical system's interface. The interface was to simulate a boat, ROV, and winch system. Simulations are a time and cost effective way to test complicated data and provide training for operators without having to use expensive hardware. We created the virtual controls with 3-D Blender models and 2-D graphics, and then add functionality in C# using the Unity game engine. The Unity engine provides several essential behaviors of a simulator, such as the start and update functions. A framework for Unity, which was developed in the lab, provided a way to place the different widgets on the virtual console dock and have them resize correctly based on the window dimensions.. My task in this project was to create the controls and visualizations for the data coming in from the simulator for the boat portion of the project. I wrote a class for each control window to handle the functionality of that widget. I implemented 11 widgets that make up the ship portion of the simulator. The members of the lab were each masters of their craft and I'm glad I had the opportunity to learn from them. I learned to plan strategically so I could finish this project on time. I allotted time for storyboarding, development, and refinement. In regards to animating I learned to use modifiers like lattice, boolean and build deformers. I also learned how to animate with drivers, how to use the dope sheet, and how to use the graph editor. In coding I learned to limit the chances for bugs by privatizing functions that should be exclusive to their class. I learned how to use the GIT repository to commit, stash and pull the latest build. I learned a bit of everything because I had the chance to see the entire application development process from the artwork, to the implementation.

Gordillo, Orlando Enrique↗
NASA NTRS1985

Atmospheric and Science Complexity Effects on Surface Bidirectional Reflectance

Among the tools used in passive remote sensing of Earth resources in the visible and near-infrared spectral regions are measurements of spectral signature and bidirectional reflectance functions (BDRFs). Determination of surface properties using these observables is complicated by a number of factors, including: (1) mixing of surface components, such as soil and vegetation, (2) multiple reflections of radiation due to complex geometry, such as in crop canopies, and (3) atmospheric effects. In order to bridge the diversity in these different approaches, there is a need for a fundamental physical understanding of the influence of the various effects and a quantiative measure of their relative importance. In particular, we consider scene complexity effects using the example of reflection by vegetative surfaces. The interaction of sunlight with a crop canopy and interpretation of the spectral and angular dependence of the emergent radiation is basically a multidimensional radiative transfer problem. The complex canopy geometry, underlying soil cover, and presence of diffuse as well as collimated illumination will modify the reflectance characteristics of the canopy relative to those of the individual elements.

Diner, D. J.↗
DOE OSTI2022

Transience of the Retinal Output Is Determined by a Great Variety of Circuit Elements

Retinal ganglion cells (RGCs) encrypt stimulus features of the visual scene in action potentials and convey them toward higher visual centers in the brain. Although there are many visual features to encode, our recent understanding is that the ~46 different functional subtypes of RGCs in the retina share this task. In this scheme, each RGC subtype establishes a separate, parallel signaling route for a specific visual feature (e.g., contrast, the direction of motion, luminosity), through which information is conveyed. The efficiency of encoding depends on several factors, including signal strength, adaptational levels, and the actual efficacy of the underlying retinal microcircuits. Upon collecting inputs across their respective receptive field, RGCs perform further analysis (e.g., summation, subtraction, weighting) before they generate the final output spike train, which itself is characterized by multiple different features, such as the number of spikes, the inter-spike intervals, response delay, and the rundown time (transience) of the response. These specific kinetic features are essential for target postsynaptic neurons in the brain in order to effectively decode and interpret signals, thereby forming visual perception. We review recent knowledge regarding circuit elements of the mammalian retina that participate in shaping RGC response transience for optimal visual signaling.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1983

Use of NOAA-N satellites for land/water discrimination and flood monitoring

A tool for monitoring the extent of major floods was developed using data collected by the NOAA-6 advanced very high resolution radiometer (AVHRR). A basic understanding of the spectral returns in AVHRR channels 1 and 2 for water, soil, and vegetation was reached using a large number of NOAA-6 scenes from different seasons and geographic locations. A look-up table classifier was developed based on analysis of the reflective channel relationships for each surface feature. The classifier automatically separated land from water and produced classification maps which were registered for a number of acquisitions, including coverage of a major flood on the Parana River of Argentina.

Tappan, G.↗
NASA NTRS2016

Hybrid Reality Lab Capabilities - Video 2

Our Hybrid Reality and Advanced Operations Lab is developing incredibly realistic and immersive systems that could be used to provide training, support engineering analysis, and augment data collection for various human performance metrics at NASA. To get a better understanding of what Hybrid Reality is, let's go through the two most commonly known types of immersive realities: Virtual Reality, and Augmented Reality. Virtual Reality creates immersive scenes that are completely made up of digital information. This technology has been used to train astronauts at NASA, used during teleoperation of remote assets (arms, rovers, robots, etc.) and other activities. One challenge with Virtual Reality is that if you are using it for real time-applications (like landing an airplane) then the information used to create the virtual scenes can be old (i.e. visualized long after physical objects moved in the scene) and not accurate enough to land the airplane safely. This is where Augmented Reality comes in. Augmented Reality takes real-time environment information (from a camera, or see through window, and places digitally created information into the scene so that it matches with the video/glass information). Augmented Reality enhances real environment information collected with a live sensor or viewport (e.g. camera, window, etc.) with the information-rich visualization provided by Virtual Reality. Hybrid Reality takes Augmented Reality even further, by creating a higher level of immersion where interactivity can take place. Hybrid Reality takes Virtual Reality objects and a trackable, physical representation of those objects, places them in the same coordinate system, and allows people to interact with both objects' representations (virtual and physical) simultaneously. After a short period of adjustment, the individuals begin to interact with all the objects in the scene as if they were real-life objects. The ability to physically touch and interact with digitally created objects that have the same shape, size, location to their physical object counterpart in virtual reality environment can be a game changer when it comes to training, planning, engineering analysis, science, entertainment, etc. Our Project is developing such capabilities for various types of environments. The video outlined with this abstract is a representation of an ISS Hybrid Reality experience. In the video you can see various Hybrid Reality elements that provide immersion beyond just standard Virtual Reality or Augmented Reality.

Delgado, Francisco J.↗
NASA NTRS1985

Polarization of light scattered by vegetation

The potential information in polarization data of both single leaves and plant canopies is investigated. Measurements demonstrate the relationship between polarization data and various optical and botanical properties of both pieces of foliage and plant canopies. The results provide a basis for gaining fundamental understanding of how light is scattered and polarized by a plant canopy. The results show the polarized and nonpolarized portions of the light scattered by a remotely sensed ground scene potentially are independent sources of information for discriminating species and assessing the condition of plant canopies.

Vanderbilt, V. C.↗
NASA NTRS1991

Modes of Visual Recognition and Perceptually Relevant Sketch-based Coding for Images

A review of visual recognition studies is used to define two levels of information requirements. These two levels are related to two primary subdivisions of the spatial frequency domain of images and reflect two distinct different physical properties of arbitrary scenes. In particular, pathologies in recognition due to cerebral dysfunction point to a more complete split into two major types of processing: high spatial frequency edge based recognition vs. low spatial frequency lightness (and color) based recognition. The former is more central and general while the latter is more specific and is necessary for certain special tasks. The two modes of recognition can also be distinguished on the basis of physical scene properties: the highly localized edges associated with reflectance and sharp topographic transitions vs. smooth topographic undulation. The extreme case of heavily abstracted images is pursued to gain an understanding of the minimal information required to support both modes of recognition. Here the intention is to define the semantic core of transmission. This central core of processing can then be fleshed out with additional image information and coding and rendering techniques.

Jobson, Daniel J.↗
NASA NTRSDate not supplied

TPSAS-NF1676L-32188-DND

Engineers rely on a wide variety of modern thermal tools to model thermal problems; many of these tools offer graphical “front ends” whereby users formulate their analytical models using a CAD interface. Behind the scenes, the analysis is performed on a thermal network – this is true whether the analyst uses finite differencing or finite element methodologies. While graphical front ends are very powerful, understanding the resulting thermal network representation used for a model gives the user the ability to check or even modify the models at a basic level. Additionally, there are instances where an engineer may prefer to develop network models from scratch or use heritage code that does not have a graphical front end. Some front-end programs output thermal networks in the widely used SINDA format; our lesson will focus on this input format.

Steven L Rickman↗
NASA NTRS2019

Application of High-Dimensional Fuzzy K-Means Cluster Analysis to CALIOP/CALIPSO Version 4.1 Cloud-Aerosol Discrimination

This study applies fuzzy k-means (FKM) cluster analyses to a subset of the parameters reported in the CALIPSO lidar level 2 data products in order to classify the layers detected as either clouds or aerosols. The results obtained are used to assess the reliability of the cloud–aerosol discrimination (CAD) scores reported in the version 4.1 release of the CALIPSO data products. FKM is an unsupervised learning algorithm, whereas the CALIPSO operational CAD algorithm (COCA) takes a highly supervised approach. Despite these substantial computational and architectural differences, our statistical analyses show that the FKM classifications agree with the COCA classifications for more than 94 % of the cases in the troposphere. This high degree of similarity is achieved because the lidar-measured signatures of the majority of the clouds and the aerosols are naturally distinct, and hence objective methods can independently and effectively separate the two classes in most cases. Classification differences most often occur in complex scenes (e.g., evaporating water cloud filaments embedded in dense aerosol) or when observing diffuse features that occur only intermittently (e.g., volcanic ash in the tropical tropopause layer). The two methods examined in this study establish overall classification correctness boundaries due to their differing algorithm uncertainties. In addition to comparing the outputs from the two algorithms, analysis of sampling, data training, performance measurements, fuzzy linear discriminants, defuzzification, error propagation, and key parameters in feature type discrimination with the FKM method are further discussed in order to better understand the utility and limits of the application of clustering algorithms to space lidar measurements. In general, we find that both FKM and COCA classification uncertainties are only minimally affected by noise in the CALIPSO measurements, though both algorithms can be challenged by especially complex scenes containing mixtures of discrete layer types. Our analysis results show that attenuated backscatter and color ratio are the driving factors that separate water clouds from aerosols; backscatter intensity, depolarization, and mid-layer altitude are most useful in discriminating between aerosols and ice clouds; and the joint distribution of backscatter intensity and depolarization ratio is critically important for distinguishing ice clouds from water clouds.

Zeng, Shan↗