Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Aerosol and Cloud Detection Using Machine Learning Algorithms and Space-Based Lidar Data

Clouds and aerosols play a significant role in determining the overall atmospheric radiation budget, yet remain a key uncertainty in understanding and predicting the future climate system. In addition to their impact on the Earth’s climate system, aerosols from volcanic eruptions, wildfires, man-made pollution events, and dust storms are hazardous to aviation safety and human health. Space-based lidar systems provide critical information about the vertical distributions of clouds and aerosols that greatly improve our understanding of the climate system. However, daytime data from backscatter lidars, such as the Cloud-Aerosol Transport System (CATS) on the International Space Station (ISS), must be averaged during science processing at the expense of spatial resolution to obtain sufficient signal-to-noise ratio (SNR) for accurately detecting atmospheric features. For example, 50% of all atmospheric features reported in daytime operational CATS data products require averaging to 60 km for detection. Furthermore, the single-wavelength nature of the CATS primary operation mode makes accurately typing these features challenging in complex scenes. This paper presents machine learning (ML) techniques that, when applied to CATS data, enable detection of atmospheric features during daytime operations with a horizontal resolution of 5 km compared to the 60 km horizontal resolution often required for daytime CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime.

lidar↗

Aerosol and Cloud Detection Using Machine Learning Algorithms and Space-Based Lidar Data

Clouds and aerosols play a significant role in determining the overall atmospheric radiation budget, yet remain a key uncertainty in understanding and predicting the future climate system. In addition to their impact on the Earth’s climate system, aerosols from volcanic eruptions, wildfires, man-made pollution events and dust storms are hazardous to aviation safety and human health. Space-based lidar systems provide critical information about the vertical distributions of clouds and aerosols that greatly improve our understanding of the climate system. However, daytime data from backscatter lidars, such as the Cloud-Aerosol Transport System (CATS) on the International Space Station (ISS), must be averaged during science processing at the expense of spatial resolution to obtain sufficient signal-to-noise ratio (SNR) for accurately detecting atmospheric features. For example, 50% of all atmospheric features reported in daytime operational CATS data products require averaging to 60 km for detection. Furthermore, the single-wavelength nature of the CATS primary operation mode makes accurately typing these features challenging in complex scenes. This paper presents machine learning (ML) techniques that, when applied to CATS data, (1) increased the 1064 nm SNR by 75%, (2) increased the number of layers detected (any resolution) by 30%, and (3) enabled detection of 40% more atmospheric features during daytime operations at a horizontal resolution of 5 km compared to the 60 km horizontal resolution often required for daytime CATS operational data products. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime.

lidar↗

Calculation of day and night emittance values

In July 1983, the Thermal Infrared Multispectral Scanner (TIMS) was flown over Death Valley, California on both a midday and predawn flight within a two-day period. The availability of calibrated digital data permitted the calculation of day and night surface temperature and surface spectral emittance. Image processing of the data included panorama correction and calibration to radiance using the on-board black bodies and the measured spectral response of each channel. Scene-dependent isolated-point noise due to bit drops, was located by its relatively discontinuous values and replaced by the average of the surrounding data values. A method was developed in order to separate the spectral and temperature information contained in the TIMS data. Night and day data sets were processed. The TIMS is unique in allowing collection of both spectral emittance and thermal information in digital format with the same airborne scanner. For the first time it was possible to produce day and night emittance images of the same area, coregistered. These data add to an understanding of the physical basis for the discrimination of difference in surface materials afforded by TIMS.

Kahle, Anne B.↗

Understanding the Possible Effect of Scan Mirror Contamination in the AIRS Instrument

AIRS has provided highly stable and accurate radiances since 2002. Stability at the 2 mK/yr has been demonstrated relative to the sea surface temperature (SST) in the 8-12 micron window channels. However, there is evidence of a larger trend in the shortwave channels: 8mK/yr when viewing clear ocean at about 300K, about 200 mK/yr when viewing 220K DCC at night in the tropical oceans, but a trend of less than 20 mK/yr for Dome C at 220K. Under these conditions, the 8-12 micron window channels show trends of less than 20 mK/yr. This study proposes that the trends in the shortwave channels are the result of a wavelength dependent contamination of the scan mirror and the on-board calibration (OBC) black body. Scattered light from nearby scenes is removed via linear regression. An experiment that assumes the OBC black body emissivity has slightly decreased is tested. The emissivity experiment results show similar stability drifts to 1231 cm-1 but not to other window channels. The emissivity decrease may explain some of the stability drift, but some other physical mechanism is likely as well.

Broberg, Steve↗

Lander imaging as a detector of life on Mars

Biological goals were among the important science objectives of the Viking lander camera. The camera performance characteristics relevant to these goals are discussed. They include the ability to observe (1) morphological detail, (2) color and reflectance spectra, and (3) motion and change. The scenes obtained by the cameras were scrutinized in many ways: monoscopically, stereoscopically, in color, and by computerized differencing of camera events. At the lander sites and during the times that observations were carried out on the surface of Mars, no evidence, direct or indirect, has been obtained for macroscopic biology on Mars. No obvious examples of geometric distortion that might have been motion induced have been observed. Using the repeated line scanning mode of the camera has revealed no changes or motion suggesting life. These negative results may be due to limitations in sampling, in camera design, or in our understanding of Martian biology, but they are certainly consistent with the hypothesis that macroscopic life is absent on Mars.

Levinthal, E. C.↗

Development of Level of Detail System and First-Person Camera for the GCAS Visualization Suite

The use of data-driven simulations has become standard practice as part of planning for future space missions. These simulations allow visualizing the data interactively to show what the data represents, as well as the importance of the data in the context of the mission. Using this visualized data can enhance users’ understanding of it and accelerate analysis efforts related to missions planned around it. Three-dimensional (3D) visualization software was developed to allow creating 3D representations of various communication systems, as well as the physical terrain of the Moon, for upcoming missions. The goal of this software development effort was to create interactive visualization capabilities in the Glenn Research Center Communication Analysis Suite (GCAS) using data exported from MATLAB® (MathWorks, Inc.) scripts. This software had the functionality to visualize the line of sight and dynamic link margins of the communication satellites orbiting the Earth and the Moon. One important addition to this was the visualization of the terrain data located within the GeoTIFF files, which were produced in an effort to understand the Moon’s terrain. Proper displacement values of this data have to be visualized to showcase where craters are located and how the shadow casting works with said craters at different points of the day, as well as analysis of possible landing sites for future lunar expeditions. The graphics library coded in JavaScript, three.js, had been previously selected for developing this visualization software. The software was revised to conform to modern standards, then further developed to convert the MATLAB® data into JavaScript 3D objects and Blender GL Transmission Format Binary file (GLB) objects, which were to be imported into the scene. In the process, a variety of other testing projects were created to be combined with this project at a later point; these included the first-person camera movements around spherical objects to portray human movement around the Moon, GeoTIFF loading methods, data transfer methods for incorporating the elevation data into the scene, and level of detail (LOD) capabilities to decrease memory usage and rendering time.

Visualization↗

RMIT AR Android Application Abstract

This summer, I've worked as an intern for IT-C1's Rapid Model Import Tool (RMIT) project under Bill Little. The goal of this project was to develop a mobile application for IT-C1's larger project, RMIT, so that it could be deployed in a convenient way. The current function of RMIT is to import file types that are not normally compatible with the Unity 3D software development engine and make them into files that can be placed into Unity for the specific purpose of viewing CAD models in virtual reality (VR). The mobile application that I worked on uses augmented reality (AR), using the camera on a mobile device, to show virtual models in the real world for the purpose of visualization and understanding. In addition to single-player capabilities, this application will include a multi-player mode so that collaborating engineers can see each other's work on their own devices.Working on this application required many steps. First, I hard to learn a lot about how mobile development is different from desktop development, and what the limitations of augmented reality are at its current state. From there, I was assigned new tasks and goals every two weeks, which included addingground plane and air plane functionality, designing a user interface, adding multi-player capability and allowing the user to manipulate models placed in a scene.

Dorian Thompson↗

Multi-angle Imaging SpectroRadiometer

MISR views the sunlit Earth simultaneously at nine widely spaced angles and provides ongoing global coverage with high spatial detail. Its imagery is carefully calibrated to provide accurate measures of the brightness, contrast, and color of reflected sunlight. MISR provides new types of information for scientists studying Earth's climate, such as the regional and global distribution of different types of atmospheric particles and aerosols. The change in reflection at different view angles provides the means to distinguish aerosol types, cloud forms, and land surface cover. Combined with stereoscopic techniques, this enables construction of 3-D cloud models and estimation of the total amount of sunlight reflected by Earth's diverse environments. MISR was built for NASA by the Jet Propulsion Laboratory (JPL) in Pasadena, California. It is part of NASA's first Earth Observing System (EOS) spacecraft, the Terra spacecraft, which was launched into polar orbit from Vandenberg Air Force Base on December 18, 1999. MISR has been continuously providing data since February 24, 2000. [Mission Objectives] The MISR instrument acquires systematic multi-angle measurements for global monitoring of top-of-atmosphere and surface albedos and for measuring the shortwave radiative properties of aerosols, clouds, and surface scenes in order to characterize their impact on the Earth's climate. The Earth's climate is constantly changing -- as a consequence of both natural processes and human activities. Scientists care a great deal about even small changes in Earth's climate, since they can affect our comfort and well-being, and possibly our survival. A few years of below-average rainfall, an unusually cold winter, or a change in emissions from a coal-burning power plant, can influence the quality of life of people, plants, and animals in the region involved. The goal of NASA's Earth Observing System (EOS) is to increase our understanding of the climate changes that are occurring on our planet, and the reasons for these changes, so we are better equipped to anticipate and prepare for the future. The MISR instrument is a part of EOS. Its role is to measure the amount of sunlight scattered in different directions under natural conditions. These measurements will help quantify the amount of solar energy that heats the Earth's surface and atmosphere, and the changes that occur in them over the lifetime of the MISR instrument. From the MISR observations, we are also learning more about those components of the Earth's environment that scatter sunlight: particles in the atmosphere, the planet's surface, and clouds. MISR monitors changes in surface reflection properties, in atmospheric aerosol content and composition, and in cloudiness. Scientists use these data to study land use changes, air pollution, volcanic eruptions, as well as processes such as desertification, deforestation, and soil erosion. As part of the EOS program, computer models that predict future climate will be improved by the results of these studies. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180].

Diner, David J.↗

The 3D widgets for exploratory scientific visualization

Computational fluid dynamics (CFD) techniques are used to simulate flows of fluids like air or water around such objects as airplanes and automobiles. These techniques usually generate very large amounts of numerical data which are difficult to understand without using graphical scientific visualization techniques. There are a number of commercial scientific visualization applications available today which allow scientists to control visualization tools via textual and/or 2D user interfaces. However, these user interfaces are often difficult to use. We believe that 3D direct-manipulation techniques for interactively controlling visualization tools will provide opportunities for powerful and useful interfaces with which scientists can more effectively explore their datasets. A few systems have been developed which use these techniques. In this paper, we will present a variety of 3D interaction techniques for manipulating parameters of visualization tools used to explore CFD datasets, and discuss in detail various techniques for positioning tools in a 3D scene.

Herndon, Kenneth P.↗

On the Response of the Special Sensor Microwave/Imager to the Marine Environment: Implications for Atmospheric Parameter Retrievals

A reasonably rigorous basis for understanding and extracting the physical information content of Special Sensor Microwave/Imager (SSM/I) satellite images of the marine environment is provided. To this end, a comprehensive algebraic parameterization is developed for the response of the SSM/I to a set of nine atmospheric and ocean surface parameters. The brightness temperature model includes a closed-form approximation to microwave radiative transfer in a non-scattering atmosphere and fitted models for surface emission and scattering based on geometric optics calculations for the roughened sea surface. The combined model is empirically tuned using suitable sets of SSM/I data and coincident surface observations. The brightness temperature model is then used to examine the sensitivity of the SSM/I to realistic variations in the scene being observed and to evaluate the theoretical maximum precision of global SSM/I retrievals of integrated water vapor, integrated cloud liquid water, and surface wind speed. A general minimum-variance method for optimally retrieving geophysical parameters from multichannel brightness temperature measurements is outlined, and several global statistical constraints of the type required by this method are computed. Finally, a unified set of efficient statistical and semi-physical algorithms is presented for obtaining fields of surface wind speed, integrated water vapor, cloud liquid water, and precipitation from SSM/I brightness temperature data. Features include: a semi-physical method for retrieving integrated cloud liquid water at 15 km resolution and with rms errors as small as approximately 0.02 kg/sq m; a 3-channel statistical algorithm for integrated water vapor which was constructed so as to have improved linear response to water vapor and reduced sensitivity to precipitation; and two complementary indices of precipitation activity (based on 37 GHz attenuation and 85 GHz scattering, respectively), each of which are relatively insensitive to variations in other environmental parameters.

Petty, Grant W.↗

Angular Distribution Models for Top-of-Atmosphere Radiative Flux Estimation from the Clouds and the Earth's Radiant Energy System Instrument on the Terra Satellite: Methodology - Part 1

The Clouds and Earth's Radiant Energy System (CERES) provides coincident global cloud and aerosol properties together with reflected solar, emitted terrestrial longwave and infrared window radiative fluxes. These data are needed to improve our understanding and modeling of the interaction between clouds, aerosols and radiation at the top of the atmosphere, surface, and within the atmosphere. This paper describes the approach used to estimate top-of-atmosphere (TOA) radiative fluxes from instantaneous CERES radiance measurements on the Terra satellite. A key component involves the development of empirical angular distribution models (ADMs) that account for the angular dependence of Earth's radiation field at the TOA. The CERES Terra ADMs are developed using 24 months of CERES radiances, coincident cloud and aerosol retrievals from the Moderate Resolution Imaging Spectroradiometer (MODIS), and meteorological parameters from the Global Modeling and Assimilation Office (GMA0) s Goddard Earth Observing System DAS (GEOS-DAS V4.0.3) product. Scene information for the ADMs is from MODIS retrievals and GEOS-DAS V4.0.3 properties over ocean, land, desert and snow, for both clear and cloudy conditions. Because the CERES Terra ADMs are global, and far more CERES data is available on Terra than was available from CERES on the Tropical Rainfall Measuring Mission (TRMM), the methodology used to define CERES Terra ADMs is different in many respects from that used to develop CERES TRMM ADMs, particularly over snow/sea-ice, under cloudy conditions, and for clear scenes over land and desert.

Loeb, N. G.↗

Fluorescence imaging to quantify crop residue cover

Crop residues, the portion of the crop left in the field after harvest, can be an important management factor in controlling soil erosion. Methods to quantify residue cover are needed that are rapid, accurate, and objective. Scenes with known amounts of crop residue were illuminated with long wave ultraviolet (UV) radiation and fluorescence images were recorded with an intensified video camera fitted with a 453 to 488 nm band pass filter. A light colored soil and a dark colored soil were used as background for the weathered soybean stems. Residue cover was determined by counting the proportion of the pixels in the image with fluorescence values greater than a threshold. Soil pixels had the lowest gray levels in the images. The values of the soybean residue pixels spanned nearly the full range of the 8-bit video data. Classification accuracies typically were within 3(absolute units) of measured cover values. Video imaging can provide an intuitive understanding of the fraction of the soil covered by residue.

Daughtry, C. S. T.↗

Accounting for 3D Radiative Effects in MODIS Aerosol Retrievals near Clouds using CALIPSO Observations

Retrievals of aerosol properties near clouds from passive remote sensing is challenging. Sunlight scattered by clouds into nearby clear regions can effectively enhance the clear area reflectance. These cloud 3D radiative effects may lead to large biases in aerosol retrievals if uncorrected, risking an incorrect interpretation of satellite observations for aerosol-cloud interaction in cloudy atmosphere. In earlier studies, we developed a simple two-layer model (2LM) to estimate the cloud-induced clear-sky radiance enhancements in cloud fields. In this study, we take advantage of CALIPSO lidar observations, which should not be affected by the 3D radiative effect, to study passive aerosol retrievals in cloud fields in the Amazon region, specifically those produced by the operational Dark Target algorithm applied to Aqua-MODIS. From two-years’ worth of co-located CALIPSO/MODIS aerosol retrievals, we find a larger increase in operationally retrieved MODIS AOD from clear to cloudy regions (~0.075 or ~40%) than for the CALIPSO AOD (~0.021 or ~20%). The much larger increase in MODIS AOD is mainly due to the 3D radiative effects. After using the 2LM model to account for cloud 3D radiative effects, the clear to cloudy increase in MODIS AOD was reduced to ~0.043 (~23%), much closer to CALIPSO observations. The 3D corrected average MODIS AOD for cloudy scenes is significantly larger than AOD for clear conditions, even for cloud fraction (CF) less than 0.1, suggesting aerosols in cloudy scenes are characteristically different from aerosols in clear conditions. Furthermore, the 3D correction of AOD (i.e., τ_1D-τ_3D) increases linearly with CF for a large range of CF. We have also examined the impact of the 3D effect on aerosol Ångström Exponent (AE) and fine model fraction (FMF) of AOD. We found that the uncorrected average AE and FMF depend strongly on CF, ~25% increase in AE (decrease in particle size) and ~60% increase in FMF as CF increases from 0.05 to 0.45. The 3D correction leads to smaller average AE (bigger particle size) and FMF that are almost independent of CF. Thus, the 3D corrected aerosol properties are expected to provide more accurate information for better understanding aerosol-cloud interactions.

MODIS↗

HOTEX: An Approach for Global Mapping of Human Built-Up and Settlement Extent

Understanding the impacts of urbanization requires accurate and updatable urban extent maps. Here we present an algorithm for mapping urban extent at global scale using Landsat data. An innovative hierarchical object-based texture (HOTex) classification approach was designed to overcome spectral confusion between urban and nonurban land cover types. VIIRS nightlights data and MODIS vegetation index datasets are integrated as high-level features under an object-based framework. We applied the HOTex method to the GLS-2010 Landsat images to produce a global map of human built-up and settlement extent. As shown by visual assessments, our method could effectively map urban extent and generate consistent results using images with inconsistent acquisition time and vegetation phenology. Using scene-level cross validation for results in Europe, we assessed the performance of HOTex and achieved a kappa coefficient of 0.91, compared to 0.74 from a baseline method using per-pixel classification using spectral information.

Wang, Panshi↗

Expert system-based mineral mapping using AVIRIS

Integrated analysis of imaging spectrometer data and field spectral measurements were used in conjunction with conventional geologic field mapping to characterize bedrock and surficial geology at the northern end of Death Valley, California and Nevada. A knowledge-based expert system was used to automatically produce image maps from Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data showing the principal surface mineralogy. The imaging spectrometer data show the spatial distribution of spectrally distinct minerals occurring both as primary rock-forming minerals and as alteration and weathering products. Field spectral measurements were used to verify the mineral maps and field mapping was used to extend the remote sensing results. Geographically referenced image-maps produced from these data form new base maps from which to develop improved understanding of the processes of deposition and erosion affecting the present land surface. The 'northern Grapevine Mountains' (NGM) study area was reported on in numerous papers. This area is an unnamed northwestward extension of the range. Most of the research here has concentrated on mapping of Jurassic-age plutons and associated hydrothermal alteration, however, the nature and scope of these studies is much broader, pertaining to the geologic history and development of the entire Death Valley region. AVIRIS data for the NGM site were obtained during May 1989. Additional AVIRIS data were acquired during September 1989 as part of the Geologic Remote Sensing Field Experiment (GRSFE). The area covered by these data overlaps slightly with the May 1989 data. Three and one-half AVIRIS scenes total were analyzed.

Kruse, Fred A.↗

Clouds and the Earth's Radiant Energy System (CERES) Algorithm Theoretical Basis Document: Cloud Analyses and Determination of Improved Top of Atmosphere Fluxes (Subsystem 4) - Volume 3

The theoretical bases for the Release 1 algorithms that will be used to process satellite data for investigation of the Clouds and Earth's Radiant Energy System (CERES) are described. The architecture for software implementation of the methodologies is outlined. Volume 3 details the advanced CERES methods for performing scene identification and inverting each CERES scanner radiance to a top-of-the-atmosphere (TOA) flux. CERES determines cloud fraction, height, phase, effective particle size, layering, and thickness from high-resolution, multispectral imager data. CERES derives cloud properties for each pixel of the Tropical Rainfall Measuring Mission (TRMM) visible and infrared scanner and the Earth Observing System (EOS) moderate-resolution imaging spectroradiometer. Cloud properties for each imager pixel are convolved with the CERES footprint point spread function to produce average cloud properties for each CERES scanner radiance. The mean cloud properties are used to determine an angular distribution model (ADM) to convert each CERES radiance to a TOA flux. The TOA fluxes are used in simple parameterization to derive surface radiative fluxes. This state-of-the-art cloud-radiation product will be used to substantially improve our understanding of the complex relationship between clouds and the radiation budget of the Earth-atmosphere system.

Source record↗

Some characteristics and advantages of LANDSAT 3 return beam vidicon images

One advantage of a LANDSAT 3 return beam vidicon (RBV) scene is the synoptic view it provides. A 1:500,000 paper print of the size 19.4 cm x 19.4 cm encompasses an area of about 3,721 square miles (9,637 sq. km.) and this compares very favorably in coverage to small scale aerial photography. A second important advantage is that the ground resolution is 38 by 38 meters. Compared to the resolution of the MSS which is 79 by 79 meters the RBV provides a wealth of detail useful for many purposes. A great variety of man made structures are visible including bridges, roads, docks, and small airfields. Agricultural field patterns are clear and settlements of various sizes can be identified and delineated. A third advantage is related to the approximate panchromatic spectral response displayed in RBV images. Since many aerial photographic interpreters are accustomed to working with panchromatic photographs, they should have no difficulty understanding and putting RBV images immediately into use.

Baker, S.↗

HYTHIRM Radiance Modeling and Image Analyses in Support of STS-119, STS-125 and STS-128 Space Shuttle Hypersonic Re-entries

We provide the first geometrically accurate (i.e., 3-D) temperature maps of the entire windward surface of the Space Shuttle during hypersonic reentry. To accomplish this task we began with estimated surface temperatures derived from CFD models at integral high Mach numbers and used them, the Shuttle's surface properties and reasonable estimates of the sensor-to-target geometry to predict the emitted spectral radiance from the surface (in units of W sr-1 m-2 nm-1). These data were converted to sensor counts using properties of the sensor (e.g. aperture, spectral band, and various efficiencies), the expected background, and the atmosphere transmission to inform the optimal settings for the near-infrared and midwave IR cameras on the Cast Glance aircraft. Once these data were collected, calibrated, edited, registered and co-added we formed both 2-D maps of the scene in the above units and 3-D maps of the bottom surface in temperature that could be compared with not only the initial inputs but also thermocouple data from the Shuttle itself. The 3-D temperature mapping process was based on the initial radiance modeling process. Here temperatures were guessed for each node in a well-resolved 3-D framework, a radiance model was produced and compared to the processed imagery, and corrections to the temperature were estimated until the iterative process converged. This process did very well in characterizing the temperature structure of the large asymmetric boundary layer transition the covered much of the starboard bottom surface of STS-119 Discovery. Both internally estimated accuracies and differences with CFD models and thermocouple measurements are at most a few percent. The technique did less well characterizing the temperature structure of the turbulent wedge behind the trip due to limitations in understanding the true sensor resolution. (Note: Those less inclined to read the entire paper are encouraged to read an Executive Summary provided at the end.)

Gibson, David M.↗