SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A multi-modal scanning system to digitize CBRNE emergency response scenes

A handheld system developed to digitize a contextual understanding of the scene at a chemical, biological, radiological, nuclear and/or explosives (CBRNE) events is described. The system uses LiDAR and cameras to create a colorized 3D model of the environment, which helps domain experts that are supporting responders in the field. To generate the digitized model, a responder scans any suspicious objects and the surroundings by carrying the system through the scene. The scanning system provides a real-time user interface to inform the user about scanning progress and to indicate any areas that may have been missed either by the LiDAR sensors or the cameras. Currently, the collected data are post-processed on a different device, building a colorized triangular mesh of the encountered scene, with the intention of moving this pipeline to the scanner at a later point. The mesh is sufficiently compressed to be sent over a reduced bandwidth connection to a remote analyst. Furthermore, the system tracks fiducial markers attached to diagnostic equipment that is placed around the suspicious object. The resulting tracking information can be transmitted to remote analysts to further facilitate their supporting efforts. The paper will discuss the system's design, software components, the user interface used for scanning a scene, the necessary procedures for calibration of the sensors, and the processing steps of the resulting data. The discussion will close by evaluating the system's performance on 11 scenes.

Salathe, Marco↗

DOE OSTI2022

A multi-modal scanning system to digitize CBRNE emergency response scenes

Prins, Nicholas↗

NASA NTRS1985

Understanding the Radiant Scattering Behavior of Vegetated Scenes

Knowledge of the physics of the scattering behavior of vegetation will ultimately serve the remote sensing and earth science community in many ways. For example, it will provide: (1) insight and guidance in developing new extraction techniques of canopy characteristics, (2) a basis for better interpretation of off-nadir satellite and aircraft data, (3) a basis for defining specifications of future earth observing sensor systems, and (4) a basis for defining important aspects of physical and biological processes of the plant system. The overall objective of the three-year study is to improve our fundamental understanding of the dynamics of directional scattering properties of vegetation canopies through analysis of field data and model simulation data. The specific objectives are to: (1) collect directional reflectance data covering the entire exitance hemisphere for several common vegetation canopies with various geometric structure (both homogeneous and row crop structures), (2) develop a scene radiation model with a general mathematical framework which will treat 3-D variability in heterogeneous scenes and account for 3-D radiant interactions within the scene, (3) conduct validations of the model on collected data sets, and (4) test and expand proposed physical scattering mechanisms involved in reflectance distribution dynamics by analyzing both field and modeling data.

Kimes, D. S.↗

NASA NTRS1983

Improving our understanding of the remote sensing process

Plans for two fundamental research programs aimed at improving an understanding of the physics and mathematics of remote sensing are discussed. The first program, Scene Radiation and Atmospheric Research Program, is concerned with developing the capability to determine biophysical attributes of terrestrial scenes through an improved understanding of the relationships between those properties and remotely sensed radiation. The research issues in the second program, Mathematical Pattern Recognition and Image Analysis, are discussed with reference to the following five categories: preprocessing, digital image representation, object scene inference, computational structures, and continuing studies.

Calabrese, M. A.↗

NASA NTRS1996

Feature Selection for Classification of Polar Regions Using a Fuzzy Expert System

Labeling, feature selection, and the choice of classifier are critical elements for classification of scenes and for image understanding. This study examines several methods for feature selection in polar regions, including the list, of a fuzzy logic-based expert system for further refinement of a set of selected features. Six Advanced Very High Resolution Radiometer (AVHRR) Local Area Coverage (LAC) arctic scenes are classified into nine classes: water, snow / ice, ice cloud, land, thin stratus, stratus over water, cumulus over water, textured snow over water, and snow-covered mountains. Sixty-seven spectral and textural features are computed and analyzed by the feature selection algorithms. The divergence, histogram analysis, and discriminant analysis approaches are intercompared for their effectiveness in feature selection. The fuzzy expert system method is used not only to determine the effectiveness of each approach in classifying polar scenes, but also to further reduce the features into a more optimal set. For each selection method,features are ranked from best to worst, and the best half of the features are selected. Then, rules using these selected features are defined. The results of running the fuzzy expert system with these rules show that the divergence method produces the best set features, not only does it produce the highest classification accuracy, but also it has the lowest computation requirements. A reduction of the set of features produced by the divergence method using the fuzzy expert system results in an overall classification accuracy of over 95 %. However, this increase of accuracy has a high computation cost.

Penaloza, Mauel A.↗

DOE OSTI2020

Sampling Subjective Polygons for Patch-Based Deep Learning Land-Use Classification in Satellite Images

Model generalization remains a key challenge in the analysis of large amounts of heterogeneous satellite image data. One major limiting factor in developing generalizable models, in the context of supervised learning, is the lack of high quality training datasets. A model's capacity to perform well on new data is often inhibited by imbalance and bias in the data that was used for training. This is especially a problem when using convolutional neural networks to classify urban land-use in satellite images. Notable dataset imbalance issues in this application include land-use type imbalance and image scene imbalance. To begin understanding these dataset imbalance problems in more detail, we develop and test a number of sampling methods for generating training image datasets from subjective training polygons for urban land-use classification. We investigate sampling at different point densities as a means to reduce content repetition and therefore content imbalance and bias in the training image dataset.

Arndt, Jacob↗

NASA NTRS1996

Precipitable Water Variability Using SSM/I and GOES VAS Pathfinder Data Sets

Determining moisture variability for all weather scenes is critical to understanding the earth's hydrologic cycle and global climate changes. Remote sensing from geostationary satellites provides the necessary temporal and spatial resolutions necessary for global change studies. Due to antenna size constraints imposed with the use of microwave radiometers, geostationary satellites have carried instruments passively measuring radiation at infrared wavelengths or shorter. The shortfall of using infrared instruments in moisture studies lies in its inability to sense terrestrial radiation through clouds. Microwave emissions, on the other hand, are mostly unaffected by cloudy atmospheres. Land surface emissivity at microwave frequencies exhibit both high temporal and spatial variability thus confining moisture retrievals at microwave frequencies to over marine atmospheres (a near uniform cold background). This study intercompares the total column integrated water content Precipitable Water, (PW) as derived from both the Special Sensor Microwave Imager (SSM/I) and the Geostationary Operational Environmental Satellite (GOES) VISSR Atmospheric Sounder (VAS) pathfinder data sets. PW is a bulk parameter often used to quantify moisture variability and is important to understanding the earth's hydrologic cycle and climate system. This research has been spawned in an effort to combine two different algorithms which together can lead to a more comprehensive quantification of global water vapor. The approach taken here is to intercompare two independent PW retrieval algorithms and to validate the resultant retrievals against an existing data set, namely the European Center for Medium range Weather Forecasts (ECMWF) model analysis data.

Lerner, Jeffrey A.↗

NASA NTRS2015

Nonnegative Matrix Factorization for Efficient Hyperspectral Image Projection

Hyperspectral imaging for remote sensing has prompted development of hyperspectral image projectors that can be used to characterize hyperspectral imaging cameras and techniques in the lab. One such emerging astronomical hyperspectral imaging technique is wide-field double-Fourier interferometry. NASA's current, state-of-the-art, Wide-field Imaging Interferometry Testbed (WIIT) uses a Calibrated Hyperspectral Image Projector (CHIP) to generate test scenes and provide a more complete understanding of wide-field double-Fourier interferometry. Given enough time, the CHIP is capable of projecting scenes with astronomically realistic spatial and spectral complexity. However, this would require a very lengthy data collection process. For accurate but time-efficient projection of complicated hyperspectral images with the CHIP, the field must be decomposed both spectrally and spatially in a way that provides a favorable trade-off between accurately projecting the hyperspectral image and the time required for data collection. We apply nonnegative matrix factorization (NMF) to decompose hyperspectral astronomical datacubes into eigenspectra and eigenimages that allow time-efficient projection with the CHIP. Included is a brief analysis of NMF parameters that affect accuracy, including the number of eigenspectra and eigenimages used to approximate the hyperspectral image to be projected. For the chosen field, the normalized mean squared synthesis error is under 0.01 with just 8 eigenspectra. NMF of hyperspectral astronomical fields better utilizes the CHIP's capabilities, providing time-efficient and accurate representations of astronomical scenes to be imaged with the WIIT.

NMF↗

NASA NTRS1990

Local spatial frequency analysis for computer vision

A sense of vision is a prerequisite for a robot to function in an unstructured environment. However, real-world scenes contain many interacting phenomena that lead to complex images which are difficult to interpret automatically. Typical computer vision research proceeds by analyzing various effects in isolation (e.g., shading, texture, stereo, defocus), usually on images devoid of realistic complicating factors. This leads to specialized algorithms which fail on real-world images. Part of this failure is due to the dichotomy of useful representations for these phenomena. Some effects are best described in the spatial domain, while others are more naturally expressed in frequency. In order to resolve this dichotomy, we present the combined space/frequency representation which, for each point in an image, shows the spatial frequencies at that point. Within this common representation, we develop a set of simple, natural theories describing phenomena such as texture, shape, aliasing and lens parameters. We show these theories lead to algorithms for shape from texture and for dealiasing image data. The space/frequency representation should be a key aid in untangling the complex interaction of phenomena in images, allowing automatic understanding of real-world scenes.

Krumm, John↗

NASA NTRS1993

Extended ecosystem signatures with application to Eos synergism requirements

The primary objective is to define the advantages of synergistically combining optical and microwave remote sensing measurements for the determination of biophysical properties important in ecosystem modeling. This objective was approached in a stepwise fashion starting with ground-based observations of controlled agricultural and orchard canopies and progressing to airborne observations of more natural forest ecosystems. This observational program is complemented by a parallel effort to model the visible reflectance and microwave scattering properties of composite vegetation canopies. The goals of the modeling studies are to verify our basic understanding of the sensor-scene interaction physics and to provide the basis for development of inverse models optimized for retrieval of key biophysical properties. These retrieval algorithms can then be used to simulate the expected performance of various aspects of Eos including the need for simultaneous SAR and HIRIS observations or justification for other (non-synchronous) relative timing constraints and the frequency, polarization, and angle of incidence requirements for accurate biophysical parameter extractions. This program completed a very successful series of truck-mounted experiments, made remarkable progress in development and validation of optical reflectance and microwave scattering models for vegetation, extended the scattering models to accommodate discontinuous and periodic canopies, developed inversion approaches for surface and canopy properties, and disseminated these results widely through symposia and journal publications. In addition, the third generation of the computer code for the microwave scattering models was provided to a number of other US, Canadian, Australian, and European investigators who are currently presenting and publishing results using the MIMICS research code.

Ulaby, Fawwaz T.↗

NASA NTRS1990

MacDoctor: The Macintosh diagnoser

When the Macintosh computer was first released, the primary user was a computer hobbyist who typically had a significant technical background and was highly motivated to understand the internal structure and operational intricacies of the computer. In recent years the Macintosh computer has become a widely-accepted general purpose computer which is being used by an ever-increasing non-technical audience. This has lead to a large base of users which has neither the interest nor the background to understand what is happening 'behind the scenes' when the Macintosh is put to use - or what should be happening when something goes wrong. Additionally, the Macintosh itself has evolved from a simple closed design to a complete family of processor platforms and peripherals with a tremendous number of possible configurations. With the increasing popularity of the Macintosh series, software and hardware developers are producing a product for every user's need. As the complexity of configuration possibilities grows, the need for experienced or even expert knowledge is required to diagnose problems. This presents a problem to uneducated or casual users. This problem indicates a new Macintosh consumer need; that is, a diagnostic tool able to determine the problem for the user. As the volume of Macintosh products has increased, this need has also increased.

Lavery, David B.↗

NASA NTRS2019

How Qualitative Data Drives Design at NASA

There's a lot of paperwork to go to space! Building tools to help the folks "behind the scenes" at NASA takes a deep understanding of their complex worlds. In this lightning talk, David Luetger will discuss how San Jose State University Research Foundation at NASA Ames used qualitative data to support NASA's Space Launch System program, and introduced a new set of stakeholders to user-centered design.

User experience↗

NASA NTRS1980

A model of plant canopy polarization response

Sensors to remotely measure the linear polarization of ground scenes have been proposed for the Multispectral Resource Sampler (MRS), a satellite sensor system proposed to complement the Thematic Mapper. At present justification for a sensor on MRS to measure scene polarization is limited. This paper discusses a model for the amount of linearly polarized light reflected by the shiny leaves of such crops as wheat, corn, and sorghum. The theory demonstrates that, potentially, measurements of the linearly polarized light from a crop canopy may be used as an additional feature to discriminate between crops. Examination of the model suggests that, potentially, satellite polarization measurements may be used to monitor crop development stage, leaf water content, leaf area index, hail damage, and certain plant diseases. The model adds to the understanding of the potential information content of scene polarization measurements acquired by future satellite sensor systems such as MRS.

Vanderbilt, V. C.↗

NASA NTRS2018

WFIRST CGI Integral Field Spectrograph Performance and Post-Processing in the OS6 Observing Scenario

The WFIRST coronagraph instrument (CGI) will have an integral field spectrograph (IFS) backend to disperse the entire field of view at once and obtain spatially-resolved, low-resolution spectra of the speckles and science scene. The IFS will be key to understanding the spectral nature of the speckles, obtain science spectra of planets and disks, and will be used for broadband wavefront control. In order to characterize, predict, and optimize the performance of the instrument, we present a detailed model of the IFS in the context of the new OS6 observing scenario. The simulation includes spatial, spectral, and temporal variations of the speckle field on the IFS detector plane, which allows us to explore several post-processing methods and assess what gains can be expected. The simulator includes the latest models of the detector behavior when operating in photon-counting mode.

WFIRST coronagraph instrument (CGI)↗

NASA NTRS1990

Multiband radar characterization of forest biomes

The utility of airborne and orbital SAR in classification, assessment, and monitoring of forest biomes is investigated through analysis of orbital synthetic aperature radar (SAR) and multifrequency and multipolarized airborne SAR imagery relying on image tone and texture. Preliminary airborne SAR experiments and truck-mounted scatterometer observations demonstrated that the three dimensional structural complexity of a forest, and the various scales of temporal dynamics in the microwave dielectric properties of both trees and the underlying substrate would severely limit empirical or semi-empirical approaches. As a consequence, it became necessary to develop a more profound understanding of the electromagnetic properties of a forest scene and their temporal dynamics through controlled experimentation coupled with theoretical development and verification. The concatenation of various models into a physically-based composite model treating the entire forest scene became the major objective of the study as this is the key to development of a series of robust retrieval algorithms for forest biophysical properties. In order to verify the performance of the component elements of the composite model, a series of controlled laboratory and field experiments were undertaken to: (1) develop techniques to measure the microwave dielectric properties of vegetation; (2) relate the microwave dielectric properties of vegetation to more readily measured characteristics such as density and moisture content; (3) calculate the radar cross-section of leaves, and cylinders; (4) improve backscatter models for rough surfaces; and (5) relate attenuation and phase delays during propagation through canopies to canopy properties. These modeling efforts, as validated by the measurements, were incorporated within a larger model known as the Michigan Microwave Canopy Scattering (MIMICS) Model.

Dobson, M. Craig↗

NASA NTRS1990

Simulation of nap-of-Earth flight in helicopters

NASA-Ames in conjunction with U.S. Army has conducted extensive simulation investigations of rotorcraft in the nap-of-the-Earth (NOE) environment and has developed facility capabilities specifically designed for this flight regime. The experience gained to date in applying these facilities to the NOE flight regime are reported along with the results of specific experimental investigations conducted to understand the influence of both motion and visual scene on the fidelity of NOE simulation. Included are comparisons of results from concurrent piloted simulation and flight research investigations. The results of a recent simulation experiment to investigate simulator sickness in this flight regime is also discussed.

Condon, Gregory W.↗

NASA NTRS1991

Simulation of nap-of-the-Earth flight in helicopters

NASA-Ames along with the U.S. Army has conducted extensive simulation studies of rotorcraft in the nap-of-the-Earth (NOE) environment and has developed facility capabilities specifically designed for this flight regime. The experience gained to date in applying these facilities to the NOE flight regime are reported along with the results of specific experimental studies conducted to understand the influence of both motion and visual scene on the fidelity of NOE simulation. Included are comparisons of results from concurrent piloted simulation and flight research studies. The results of a recent simulation experiment to study simulator sickness in this flight regime is also discussed.

Condon, Gregory W.↗

NASA NTRS1981

Land cover classification accuracy as a function of sensor spatial resolution

The benefits obtained from sensor systems for monitoring earth resources will depend on the application and interpretation methods used. A frequently used analysis method is supervised per-pixel multispectral classification with a typical application being land cover classification. An investigation is conducted to evaluate the effect of spatial resolution on the ability to classify land cover types with per-pixel digital image classification techniques. Attention is also given to the documentation of changes in scene noise and the percentage of boundary pixels as a function of spatial resolution, in order to improve the understanding of the interrelationship between classification accuracy and spatial resolution. It is found that scene noise varies considerably between land cover categories. Changes in scene noise with coarsening resolution occur at different rates for different categories.

Markham, B. L.↗