Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Aerolian erosion, transport, and deposition of volcaniclastic sands among the shifting sand dunes, Christmas Lake Valley, Oregon: TIMS image analysis

Remote sensing is a tool that, in the context of aeolian studies, offers a synoptic view of a dune field, sand sea, or entire desert region. Blount et al. (1990) presented one of the first studies demonstrating the power of multispectral images for interpreting the dynamic history of an aeolian sand sea. Blount's work on the Gran Desierto of Mexico used a Landsat TM scene and a linear spectral mixing model to show where different sand populations occur and along what paths these sands may have traveled before becoming incorporated into dunes. Interpretation of sand transport paths and sources in the Gran Desierto led to an improved understanding of the origin and Holocene history of the dunes. With the anticipated advent of the EOS-A platform and ASTER thermal infrared capability in 1998, it will become possible to look at continental sand seas and map sand transport paths using 8-12 mu m bands that are well-suited to tracking silicate sediments. A logical extension of Blount's work is to attempt a similar study using thermal infrared images. One such study has already begun by looking at feldspar, quartz, magnetite, and clay distributions in the Kelso Dunes of southern California. This paper describes the geology and application of TIMS image analysis of a less-well known Holocene dune field in south central Oregon using TIMS data obtained in 1991.

Edgett, Kenneth S.↗

Computer-Generated Movies for Mission Planning

Computer-generated movies help the viewer to understand mission dynamics and get quantitative details. Sample movie frames demonstrate the uses and effectiveness of movies in mission planning. Tools needed for movie-making include computer programs to generate images on film and film processing to give the desired result. Planning scenes to make an effective product requires some thought and experience. Viewpoints and timing are particularly important. Lessons learned so far and problems still encountered are discussed.

Roberts, P. H., Jr.↗

Comparing Tropopause-Penetrating Convection Identifications Derived from NEXRAD and GOES over the Contiguous United States

Overshooting cloud tops (OTs) are a result of powerful updrafts that rapidly transport air from the troposphere to the lower stratosphere. Aside from the well-known relationships between strong updrafts and severe weather, the boundaries of updrafts, including the OT, are turbulent, which leads to irreversible mixing of air between the stratosphere and troposphere, altering the composition of both layers. In order to better understand the impact of OTs, knowing precisely when and where they occur is vital. Within the last decade remote-sensing observations from satellites and radars have been used to identify OTs, but the results thus far have not been entirely consistent due to challenges with accurately identifying OTs with these sensor datasets. This study compares OTs identified using NEXRAD reflectivity data from the GridRad dataset with an approach that uses GOES infrared (IR) data. The GridRad method estimates the altitude of echo tops directly from the radar pointing geometry, merging a combination of radars that enables products every 5 mins, with 2 km spatial and 1 km vertical grid spacing. The GOES satellite method uses spatial patterns in tropopause-relative IR brightness temperature to derive an OT likelihood. The study region covers a large part of the contiguous United States during selected active convection dates in 2017 and includes data from GOES-13/16. A large sample of OTs observed by NEXRAD and GOES-13/16 satellites are analyzed to better understand NEXRAD and IR observations of OTs, quantify agreement between the OT detection methods, and demonstrate how the 4x increase in spatial resolution from GOES-13 to GOES-16 impacts OT algorithm detection performance. The results show that for nearly time-matched scenes, with many severe storms, GOES-13 and -16 detection accuracy is quite comparable; however, some missed detections are attributed to poorer GOES-13 image resolution. It was found that GOES-13 OT regions are ~2 K warmer than GOES-16 on average, but such differences exceed 5 K for the most intense OT regions. It is found that false GOES IR-based detections are unavoidable, given that cold cloud pixels significantly colder than the tropopause from nearby or recently decayed OTs can persist within anvils for 15 minutes or more.

John W. Cooney↗

Active microwave classification of sea ice

Radar backscatter studies of Arctic sea ice have been carried out over a number of years with the intent to acquire physical property information through the examination of microwave signatures. The breadth of these studies continues to expand; as an example, measurements are now conducted at frequencies from 500 MHz to about 100 GHz. One of the scientific goals of this work has been to develop an improved outstanding of the scattering processes at play. A second, equally important goal has been to apply the knowledge gained in examining the backscatter response of ice and snow made in conjunction with the detailed scene characterizations, the insight gained through theoretical modeling and parametric study, and the data entered into the radar signature library to develop procedures to convert microwave signal information (available in the very near future) into valuable data products. This should ultimately provide a better understanding of the environment. The author discusses what has been learned through the many efforts associated with the near-surface scatterometer measurement programs and how the knowledge gained is assisting in the development of future sea ice type satellite algorithms. The logic and mechanisms used in discriminating sea ice types are presented.

Onstott, Robert G.↗

Next-Generation Angular Distribution Models for Top-of-Atmosphere Radiative Flux Calculation from the CERES Instruments: Methodology

The top-of-atmosphere (TOA) radiative fluxes are critical components to advancing our understanding of the Earth's radiative energy balance, radiative effects of clouds and aerosols, and climate feedback. The Clouds and the Earth's Radiant Energy System (CERES) instruments provide broadband shortwave and longwave radiance measurements. These radiances are converted to fluxes by using scene-type-dependent angular distribution models (ADMs). This paper describes the next-generation ADMs that are developed for Terra and Aqua using all available CERES rotating azimuth plane radiance measurements. Coincident cloud and aerosol retrievals, and radiance measurements from the Moderate Resolution Imaging Spectroradiometer (MODIS), and meteorological parameters from Goddard Earth Observing System (GEOS) data assimilation version 5.4.1 are used to define scene type. CERES radiance measurements are stratified by scene type and by other parameters that are important for determining the anisotropy of the given scene type. Anisotropic factors are then defined either for discrete intervals of relevant parameters or as a continuous functions of combined parameters, depending on the scene type. Significant differences between the ADMs described in this paper and the existing ADMs are over clear-sky scene types and polar scene types. Over clear ocean, we developed a set of shortwave (SW) ADMs that explicitly account for aerosols. Over clear land, the SW ADMs are developed for every 1 latitude1 longitude region for every calendar month using a kernel-based bidirectional reflectance model. Over clear Antarctic scenes, SW ADMs are developed by accounting the effects of sastrugi on anisotropy. Over sea ice, a sea-ice brightness index is used to classify the scene type. Under cloudy conditions over all surface types, the longwave (LW) and window (WN) ADMs are developed by combining surface and cloud-top temperature, surface and cloud emissivity, cloud fraction, and precipitable water. Compared to the existing ADMs, the new ADMs change the monthly mean instantaneous fluxes by up to 5Wm(exp -2) on a regional scale of 1 deg. latitude x 1 deg. longitude, but the flux changes are less than 0.5Wm(exp -2) on a global scale.

Su, W.↗

IPL processing of the Mariner 10 images of Mercury

This paper describes the digital processing performed on the images of Mercury returned to earth from Mariner 10. Each image contains considerably more information than can be displayed in a single picture. Several specialized processing techniques and procedures are utilized to display the particular information desired for specific scientific analyses: radiometric decalibration for photometric investigations, high-pass filtering to characterize morphology, modulation transfer function restoration to provide the highest possible resolution, scene-dependent filtering of the terminator images to provide maximum feature discriminability in the regions of low illumination, and rectification to cartographic projections to provide known geometric relationships between features. A principal task was the construction of full disk mosaics as an aid to the understanding of surface structure on a global scale.

Soha, J. M.↗

Multidimensional Modeling of Atmospheric Effects and Surface Heterogeneities on Remote Sensing

The overall goal of this project is to establish a modeling capability that allows a quantitative determination of atmospheric effects on remote sensing including the effects of surface heterogeneities. This includes an improved understanding of aerosol and haze effects in connection with structural, angular, and spatial surface heterogeneities. One important objective of the research is the possible identification of intrinsic surface or canopy characteristics that might be invariant to atmospheric perturbations so that they could be used for scene identification. Conversely, an equally important objective is to find a correction algorithm for atmospheric effects in satellite-sensed surface reflectances. The technical approach is centered around a systematic model and code development effort based on existing, highly advanced computer codes that were originally developed for nuclear radiation shielding applications. Computational techniques for the numerical solution of the radiative transfer equation are adapted on the basis of the discrete-ordinates finite-element method which proved highly successful for one and two-dimensional radiative transfer problems with fully resolved angular representation of the radiation field.

Gerstl, S. A. W.↗

Microwave remote sensing of snowpacks

The interaction mechanisms responsible for the microwave backscattering and emission behavior of snow were investigated, and models were developed relating the backscattering coefficient (sigma) and apparent temperature (T) to the physical parameters of the snowpack. The microwave responses to snow wetness, snow water equivalent, snow surface roughness, and to diurnal variations were investigated. Snow wetness was shown to have an increasing effect with increasing frequency and angle of incidence for both active and passive cases. Increasing snow wetness was observed to decrease the magnitude sigma and increase T. Snow water equivalent was also observed to exhibit a significant influence sigma and T. Snow surface configuration (roughness) was observed to be significant only for wet snow surface conditions. Diurnal variations were as large as 15 dB for sigma at 35 GHz and 120 K for T at 37 GHz. Simple models for sigma and T of a snowpack scene were developed in terms of the most significant ground-truth parameters. The coefficients for these models were then evaluated; the fits to the sigma and T measurements were generally good. Finally, areas of needed additional observations were outlined and experiments were specified to further the understanding of the microwave-snowpack interaction mechanisms.

Stiles, W. H.↗

Effects of corn stalk orientation and water content on passive microwave sensing of soil moisture

A field experiment was conducted utilizing artificial arrangements of plant components during the summer of 1982 to examine the effects of corn canopy structure and plant water content on microwave emission. Truck-mounted microwave radiometers at C (5 GHz) and L (1.4 GHz) band sensed vertically and horizontally polarized radiation concurrent with ground observations of soil moisture and vegetation parameters. Results indicate that the orientation of cut stalks and the distribution of their dielectric properties through the canopy layer can influence the microwave emission measured from a vegetation/soil scene. The magnitude of this effect varies with polarization and frequency and with the amount of water in the plant, disappearing at low levels of vegetation water content. Although many of the canopy structures and orientations studied in this experiment are somewhat artificial, they serve to improve understanding of microwave energy interactions within a vegetation canopy and to aid in the development of appropriate physically based vegetation models.

Oneill, P. E.↗

Processing Motion Signals in Complex Environments

Motion information is critical for human locomotion and scene segmentation. Currently we have excellent neurophysiological models that are able to predict human detection and discrimination of local signals. Local motion signals are insufficient by themselves to guide human locomotion and to provide information about depth, object boundaries and surface structure. My research is aimed at understanding the mechanisms underlying the combination of motion signals across space and time. A target moving on an extended trajectory amidst noise dots in Brownian motion is much more detectable than the sum of signals generated by independent motion energy units responding to the trajectory segments. This result suggests that facilitation occurs between motion units tuned to similar directions, lying along the trajectory path. We investigated whether the interaction between local motion units along the motion direction is mediated by contrast. One possibility is that contrast-driven signals from motion units early in the trajectory sequence are added to signals in subsequent units. If this were the case, then units later in the sequence would have a larger signal than those earlier in the sequence. To test this possibility, we compared contrast discrimination thresholds for the first and third patches of a triplet of sequentially presented Gabor patches, aligned along the motion direction. According to this simple additive model, contrast increment thresholds for the third patch should be higher than thresholds for the first patch.The lack of a measurable effect on contrast thresholds for these various manipulations suggests that the pooling of signals along a trajectory is not mediated by contrast-driven signals. Instead, these results are consistent with models that propose that the facilitation of trajectory signals is achieved by a second-level network that chooses the strongest local motion signals and combines them if they occur in a spatio-temporal sequence consistent with a trajectory. These results parallel the lack of increased apparent contrast along a static contour made up of similarly oriented elements.

Verghese, Preeti↗

Terra and Aqua MODIS Design, Radiometry, and Geometry in Support of Land Remote Sensing

The NASA Earth Observing System (EOS) mission includes the construction and launch of two nearly identical Moderate Resolution Imaging Spectroradiometer (MODIS) instruments. The MODIS proto-flight model (PFM) is onboard the EOS Terra satellite (formerly EOS AM-1) launched on December 18, 1999 and hereafter referred to as Terra MODIS. Flight model-1 (FM1) is onboard the EOS Aqua satellite (formerly EOS PM-1) launched on May 04, 2002 and referred to as Aqua MODIS. MODIS was developed based on the science community s desire to collect multiyear continuous datasets for monitoring changes in the Earth s land, oceans and atmosphere, and the human contributions to these changes. It was designed to measure discrete spectral bands, which includes many used by a number of heritage sensors, and thus extends the heritage datasets to better understand both long- and short-term changes in the global environment (Barnes and Salomonson 1993; Salomonson et al. 2002; Barnes et al. 2002). The MODIS development, launch, and operation were managed by NASA/Goddard Space Flight Center (GSFC), Greenbelt, Maryland. The sensors were designed, built, and tested by Raytheon/ Santa Barbara Remote Sensing (SBRS), Goleta, California. Each MODIS instrument offers 36 spectral bands, which span the spectral region from the visible (0.41 m) to long-wave infrared (14.4 m). MODIS collects data at three different nadir spatial resolutions: 0.25, 0.5, and 1 km. Key design specifications, such as spectral bandwidths, typical scene radiances, required signal-to-noise ratios (SNR) or noise equivalent temperature differences (NEDT), and primary applications of each MODIS spectral band are summarized in Table 7.1. These parameters were the basis for the MODIS design. More details on the evolution of the NASA EOS and development of the MODIS instruments are provided in Chap. 1. This chapter focuses on the MODIS sensor design, radiometry, and geometry as they apply to land remote sensing. With near-daily coverage of the Earth's surface, MODIS provides comprehensive measurements that enable scientists and policy makers to better understand and effectively manage the natural resources on both regional and global scales. Terra, the first large multisensor EOS satellite, is operated in a 10:30 am (local equatorial crossing time, descending southwards) polar orbit. Aqua, the second multisensor EOS satellite is operated in a 1:30 pm (local equatorial crossing time, ascending northwards) polar orbit. With complementing morning and afternoon observations, the Terra and Aqua MODIS, together with other sensors housed on both satellites, have greatly improved our understanding of the dynamics of the global environmental system.

Xiong, Xiaoxiong↗

Utilizing remote sensing of thematic mapper data to improve our understanding of estuarine processes and their influence on the productivity of estuarine-dependent fisheries

A stochastic spatial computer model addressing coastal resource problems in Lousiana is being refined and validated using thematic mapper (TM) imagery. The TM images of brackish marsh sites were processed and data were tabulated on spatial parameters from TM images of the salt marsh sites. The Fisheries Image Processing Systems (FIPS) was used to analyze the TM scene. Activities were concentrated on improving the structure of the model and developing a structure and methodology for calibrating the model with spatial-pattern data from the TM imagery.

Browder, Joan A.↗

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part I: Background and Methods

Radiance observations from Earth-observing satellites have a significant positive impact on numerical weather prediction (NWP) forecasts, but some spectral regions are not fully exploited. Observations from hyperspectral infrared (IR) sounders in the longwave region (650-1100 cm -1 ), for instance, are routinely assimilated in many NWP models, but observations in the shortwave region (2155-2550 cm -1 ) are not. Each of these regions provides information on the temperature structure of the atmosphere, but the shortwave IR (SWIR) region is considered challenging to assimilate due to noise equivalent delta temperature (NEDT) that is highly variable depending on scene brightness temperature and to phenomena that are difficult to model, like non-Local Thermodynamic Equilibrium (NLTE) and solar reflectance. With recent advances in small-satellite technology, SWIR temperature sounders may provide an agile and cost-effective complement to the current constellation of IR sounders. Therefore, a better understanding of the use and impact of SWIR observations in data assimilation for NWP is warranted. In part one of this study, as presented here, the amount of unique information (as determined by Empirical Orthogonal Decomposition (EOD)) made available to a data assimilation system by Cross-track Infrared Sounder (CrIS) SWIR observations is reviewed, recent advancements to the Community Radiative Transfer Model (CRTM) for the simulation of CrIS shortwave radiances are tested, and enhancements to NOAA’s Global Data Assimilation System (GDAS) for the assimilation of CrIS SWIR observations are implemented and evaluated. Part two of this study, which seeks to assess the value of assimilating shortwave IR observations in global NWP, is also introduced.

Erin Jones↗

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks↗

Overcoming the Critical Shortage of STEM - Prepared Secondary Students Through Modeling and Simulation

In developing understanding of technological systems - modeling and simulation tools aid significantly in the learning and visualization processes. In design courses we sketch , extrude, shape, refine and animate with virtual tools in 3D. Final designs are built using a 3D printer. Aspiring architects create spaces with realistic materials and lighting schemes rendered on model surfaces to create breathtaking walk-throughs of virtual spaces. Digital Electronics students design systems that address real-world needs. Designs are simulated in virtual circuits to provide proof of concept before physical construction. This vastly increases students' ability to design and build complex systems. We find students using modeling and simulation in the learning process, assimilate information at a much faster pace and engage more deeply in learning. As Pre-Engineering educators within the Career and Technical Education program at our school division's Technology Academy our task is to help learners in their quest to develop deep understanding of complex technological systems in a variety of engineering disciplines. Today's young learners have vast opportunities to learn with tools that many of us only dreamed about a decade or so ago when we were engaged in engineering and other technical studies. Today's learner paints with a virtual brush - scenes that can aid significantly in the learning and visualization processes. Modeling and simulation systems have become the new standard tool set in the technical classroom [1-5]. Modeling and simulation systems are now applied as feedback loops in the learning environment. Much of the study of behavior change through the use of feedback loops can be attributed to Stanford Psychologist Alfred Bandura. "Drawing on several education experiments involving children, Bandura observed that giving individuals a clear goal and a means to evaluate their progress toward that goal greatly increased the likelihood that they would achieve it."

Spencer, Thomas↗

Future Lightning Instruments for Weather and Climate Monitoring From LEO

Lightning is not only a natural hazard, but it also holds information about physical processes at work in deep convection and influences atmospheric oxidants that modulate ozone and methane. Hence, spaceborne lightning observations are essential for monitoring extreme events and feedbacks in Earth’s climate system. Low-Earth orbiting (LEO) lightning mapping instruments established a 25-year record of global lightning activity and resulted in a wealth of studies that motivated its designation as an Essential Climate Variable by the World Meteorological Organization. Although geostationary observations of lightning have become increasingly available since 2017, LEO lightning mappers continue to serve critical needs given their unique vantage point and acceptance as a unifying reference for geostationary lightning mapper and ground-based global lightning datasets. At the close of 2023, the Lightning Imaging Sensor (LIS) will cease operations on the International Space Station, which introduces a critical gap in LEO-based monitoring of global lightning activity. To address this need, NASA is developing new lightning mapping technology that enables future LEO-based satellite missions. Existing LEO-based lightning mappers rely on narrowband optical emissions centered on 777.4-nm and detectors that capture 500 images per second to detect lightning both day and night. Lightning can also produce optical emissions in a narrowband centered on 337-nm without any corresponding emissions at the traditionally used near-infrared (NIR) wavelength. These near-ultraviolet (UV) emissions are associated with earlier stage electrical breakdown (e.g., streamers), may frequent intense regions of deep convective storms, and may be a significant source of nitrogen oxide production in the upper atmosphere. A new lightning mapping instrument called the CubeSat Lightning Imaging and Detection Experiment (CLIDE) is being designed at NASA Marshall Space Flight Center to use high-speed, scientific CMOS image sensors capable of detecting lightning’s transient optical emissions in the near-UV and NIR during both daylit and nighttime scenes. This will extend the record of global lightning activity and help pave the way for future small satellite missions that combine radio and optical lightning detectors to obtain novel three-dimensional maps of lightning on a global scale, which can revolutionize the way lightning is used to monitor weather and understand changes in climate.

lightning↗

High spatial resolution telescopic multispectral imaging and spectroscopy of the Moon. 1: The Serenitatis/Tranquillitatis border region

The region of the moon near the border between Mare Serenitatis and Mare Tranquillitatis is one of the most geologically and compositionally complex areas of the nearside. The geologic history of this region has been shaped by impacts of widely-varying spatial scale and temporal occurrence, by volcanism of variable style and composition with time, and by limited tectonism. We have been studying this region as part of a larger multi remote sensing technique effort to understand the composition, morphology, geology, and stratigraphy of the moon at spatial scales of 2 km or less. The effort has been aided by the proximity of this area to the Apollo 11, 15, and 17 landing sites and by the occurrence of one of the primary lunar spectroscopic 'standard areas' within our scene (MS2). Here, some of the findings from the multispectral imaging and spectroscopy part of this effort are reported.

Bell, James F., III↗

Nonlinear Detector Response of Aqua MODIS Land Imaging Bands

The detectors in Aqua MODIS reflective solar bands (RSB) are calibrated assuming a linear relationship between the observed top-of-atmosphere radiance and the instrument output response. Any non-linear behavior in the system response can contribute to errors in NASA’s Level 1B MODIS reflectance and radiance products, which are used in a wide variety of Earth science applications. While most RSB detectors continue to have very linear behavior even after more than 18 years of operation, we present evidence that the detectors in Aqua MODIS bands 1 (645 nm) and 2 (858 nm) have deviations from gain linearity that change over the mission by up to 3%. We show a clear divergence between gain measurements made with the on-board solar diffuser (SD) at two different radiance levels, achieved by collecting data both with and without an attenuation screen. Radiance trends from lunar calibrations and typical desert and ocean scenes are also compared. We present a simple method to characterize the response non-linearity using a quadratic function by combining the results of the two sets of SD calibrations. Applying this quadratic calibration algorithm to the desert and lunar data results in improved agreement in their long-term radiance trends. A clear understanding of the magnitude of the gain non-linearity could be useful to help improve the quality of numerous MODIS science products, including the land imaging applications that rely heavily on these bands.

MODIS↗