SEARCH · Search NASA

Results for “cloud mask algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2011

Validation of a Climate-Data Record of the "Clear-Kky" Surface Temperature of the Greenland Ice Sheet

Surface temperatures on the Greenland Ice Sheet have been studied on the ground, using automatic weather station (AWS) data from the Greenland-Climate Network (GC-Net), and from analysis of satellite sensor data. Using Advanced Very High Frequency Radiometer (AVHRR) weekly surface temperature maps, warming of the surface of the Greenland Ice Sheet has been documented since 1981. We extended and refined this record using higher-resolution Moderate-Resolution Imaging Spectroradiometer (MODIS) data from March 2000 to the present. We developed a daily and monthly climate-data record (CDR) of the "clear-sky" surface temperature of the Greenland Ice Sheet using an ice-surface temperature (1ST) algorithm developed for use with MODIS data. Validation of this CDR is ongoing. MODIS Terra swath data are projected onto a polar stereographic grid at 6.25-km resolution to develop binary, gridded daily and mean-monthly 1ST maps. Each monthly map also has a color-coded image map that is available to download. Also included with the monthly maps is an accompanying map showing number of days in the month that were used to calculate the mean-monthly 1ST. This is important because no 1ST decision is made by the algorithm for cells that are considered cloudy by the internal cloud mask, so a sufficient number of days must be available to produce a mean 1ST for each grid cell. Validation of the CDR consists of several facets: 1) comparisons between ISTs and in-situ measurements; 2) comparisons between ISTs and AWS data; and 3) comparisons of ISTs with surface temperatures derived from other satellite instruments such as the Thermal Emission and Reflection Radiometer (ASTER) and Enhanced Thematic Mapper Plus (ETM+). Previous work shows that Terra MODIS ISTs are about 3 C lower than in-situ temperatures measured at Summit Camp, during the winter of 2008-09 under clear skies. In this work we begin to compare surface temperatures derived from AWS data with ISTs from the MODIS CDR. The Greenland Ice Sheet 1ST CDR will be useful for monitoring surface-temperature trends and can be used as input or for validation of climate models. The CDR can be extended into the future using MODIS Terra, Aqua and NPOESS Preparatory Project Visible Infrared Imager Radiometer Suite (VII RS) data.

Hall, Dorothy K.↗

NASA NTRS2011

Validation of a Climate-Data Record of the "Clear-Sky" Surface Temperature of the Greenland Ice Sheet

Hall, Dorothy K.↗

NASA NTRS1995

Ice surface temperature retrieval from AVHRR, ATSR, and passive microwave satellite data: Algorithm development and application

During the second phase project year we have made progress in the development and refinement of surface temperature retrieval algorithms and in product generation. More specifically, we have accomplished the following: (1) acquired a new advanced very high resolution radiometer (AVHRR) data set for the Beaufort Sea area spanning an entire year; (2) acquired additional along-track scanning radiometer(ATSR) data for the Arctic and Antarctic now totalling over eight months; (3) refined our AVHRR Arctic and Antarctic ice surface temperature (IST) retrieval algorithm, including work specific to Greenland; (4) developed ATSR retrieval algorithms for the Arctic and Antarctic, including work specific to Greenland; (5) developed cloud masking procedures for both AVHRR and ATSR; (6) generated a two-week bi-polar global area coverage (GAC) set of composite images from which IST is being estimated; (7) investigated the effects of clouds and the atmosphere on passive microwave 'surface' temperature retrieval algorithms; and (8) generated surface temperatures for the Beaufort Sea data set, both from AVHRR and special sensor microwave imager (SSM/I).

Key, Jeff↗

NASA NTRS2012

Multi-Angle Implementation of Atmospheric Correction (MAIAC) Algorithm

Multi-Angle Implementation of Atmospheric Correction (MAIAC) is a new algorithm developed for MODIS. MAIAC uses a time series analysis and processing of groups of pixels to perform simultaneous retrievals of aerosol properties and surface bidirectional reflectance without typical assumptions about the surface. It is a generic algorithm which works over both dark and bright land surfaces, including deserts. MAIAC has an internal Cloud Mask, a dynamic land-water-snow classification and a surface change mask which allows it to flexibly choose processing path over different surfaces. A distinct feature of MAIAC is a high 1 km resolution of aerosol retrievals which is required in different applications including the air quality analysis. The novel features of MAIAC include the high quality cloud mask, discrimination of aerosol type, including biomass burning smoke and dust, and detection of surface change - all required for high quality aerosol retrievals. An overview of the algorithm, results of AERONET validation, and examples of comparison with MODIS Collection 5 aerosol product and Deep Blue algorithm for different parts of the world, will be presented.

Lyapustin, A.↗

NASA NTRS2021

Operational Detection of Sun Glints in DSCOVR EPIC Images

Satellite images often feature sun glints caused by the specular reflection of sunlight from water surfaces or from horizontally oriented ice crystals occurring in clouds. Such glints can prevent accurate retrievals of atmospheric and surface properties using existing algorithms, but the glints can also be used to infer more about the glint-causing objects—for example about the microphysical properties and radiative effects of ice clouds. This paper introduces the recently released operational glint product of the Earth Polychromatic Camera (EPIC) onboard the Deep Space Climate Observatory (DSCOVR) spacecraft. Most importantly, the paper describes the algorithm used for generating the key component of the new product: a glint mask indicating the presence of sun glint caused by the specular reflection of sunlight from ice clouds and smooth water surfaces. After describing the glint detection algorithm and glint product, the paper shows some examples of the detected glints and discusses some basic statistics of the glint population in a yearlong dataset of EPIC images. These statistics provide insights into the performance of glint detection and point toward possibilities for using the glint product to gain scientific insights about ice clouds and water surfaces.

DSCOVR↗

NASA NTRS2005

Algorithm Science to Operations for the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Visible/Infrared Imager/Radiometer Suite (VIIRS)

The VIIRS sensor provides measurements for 22 Environmental Data Records (EDRs) addressing the atmosphere, ocean surface temperature, ocean color, land parameters, aerosols, imaging for clouds and ice, and more. That is, the VIIRS collects visible and infrared radiometric data of the Earth's atmosphere, ocean, and land surfaces. Data types include atmospheric, clouds, Earth radiation budget, land/water and sea surface temperature, ocean color, and low light imagery. This wide scope of measurements calls for the preparation of a multiplicity of Algorithm Theoretical Basis Documents (ATBDs), and, additionally, for intermediate products such as cloud mask, et al. Furthermore, the VIIRS interacts with three or more other sensors. This paper addresses selected and crucial elements of the process being used to convert and test an immense volume of a maturing and changing science code to the initial operational source code in preparation for launch of NPP. The integrity of the original science code is maintained and enhanced via baseline comparisons when re-hosted, in addition to multiple planned code performance reviews.

NPOESS (NATIONAL POLAR-ORBITING OPERATIONAL ENVIRO↗

NASA NTRS2012

Using Information From Prior Satellite Scans to Improve Cloud Detection Near the Day-Night Terminator

With geostationary satellite data it is possible to have a continuous record of diurnal cycles of cloud properties for a large portion of the globe. Daytime cloud property retrieval algorithms are typically superior to nighttime algorithms because daytime methods utilize measurements of reflected solar radiation. However, reflected solar radiation is difficult to accurately model for high solar zenith angles where the amount of incident radiation is small. Clear and cloudy scenes can exhibit very small differences in reflected radiation and threshold-based cloud detection methods have more difficulty setting the proper thresholds for accurate cloud detection. Because top-of-atmosphere radiances are typically more accurately modeled outside the terminator region, information from previous scans can help guide cloud detection near the terminator. This paper presents an algorithm that uses cloud fraction and clear and cloudy infrared brightness temperatures from previous satellite scan times to improve the performance of a threshold-based cloud mask near the terminator. Comparisons of daytime, nighttime, and terminator cloud fraction derived from Geostationary Operational Environmental Satellite (GOES) radiance measurements show that the algorithm greatly reduces the number of false cloud detections and smoothes the transition from the daytime to the nighttime clod detection algorithm. Comparisons with the Geoscience Laser Altimeter System (GLAS) data show that using this algorithm decreases the number of false detections by approximately 20 percentage points.

Yost, Christopher R.↗

NASA NTRS1995

SeaWiFS technical report series. Volume 28: SeaWiFS algorithms, part 1

This document provides five brief reports that address several algorithm investigations sponsored by the Calibration and Validation Team (CVT) within the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Project. This volume, therefore, has been designated as the first in a series of algorithm volumes. Chapter 1 describes the initial suite of masks, used to prevent further processing of contaminated radiometric data, and flags, which are employed to mark data whose quality (due to a variety of factors) may be suspect. In addition to providing the mask and flag algorithms, this chapter also describes the initial strategy for their implementation. Chapter 2 evaluates various strategies for the detection of clouds and ice in high latitude (polar and sub-polar regions) using Coastal Zone Color Scanner (CZCS) data. Chapter 3 presents an algorithm designed for detecting and masking coccolithosphore blooms in the open ocean. Chapter 4 outlines a proposed scheme for correcting the out-of-band response when SeaWiFS is in orbit. Chapter 5 gives a detailed description of the algorithm designed to apply sensor calibration data during the processing of level-1b data.

Hooker, Stanford B.↗

NASA NTRS2010

The MODIS Aerosol Algorithm: Critical Evaluation and Plans for Collection 6

For ten years the MODIS aerosol algorithm has been applied to measured MODIS radiances to produce a continuous set of aerosol products, over land and ocean. The MODIS aerosol products are widely used by the scientific and applied science communities for variety of purposes that span operational air quality forecasting in estimates o[ clear-sky direct radiative effects over ocean and aerosol-cloud interactions. The products undergo continual evaluation, including self-consistency checks and comparisons with highly accurate ground-based instruments. The result of these evaluation exercises is a quantitative understanding of the strengths and weaknesses of the retrieval, where and when the products are accurate and the situations where and when accuracy degrades. We intend 10 present results of the most recent critical evaluations including the first comparison of the over ocean products against the shipboard aerosol optical depth measurements of the Marine Aerosol Network (MAN), the demonstration of the lack of sensitivity to size parameter in the over land products and identification of residual problems and regional issues. While the current data set is undergoing evaluation, we are preparing for the next data processing, labeled Collection 6. Collection 6 will include transparent Quality Flags, a 3 km aerosol product and the 500m resolution cloud mask used within the aerosol n:bicvu|. These new products and adjustments to algorithm assumptions should provide users with more options and greater control, as they adapt the product for their own purposes.

Remer, Lorraine↗

NASA NTRS2011

Current Status of Multi-Angle Implementation of Atmospheric Correction (MAIAC) Algorithm

A new Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm has been developed for MODIS. MAIAC uses a time series and an image based rather than pixel-based processing to perform simultaneous retrievals of aerosol properties and surface bidirectional reflectance. It is a generic algorithm which works over all land surface types with the exception of snow. MAIAC has an internal Cloud Mask, a dynamic land-water-snow classification and a surface change mask which allows it to flexibly choose processing path over different surfaces. A distinct feature of MAIAC is a high 1 km resolution of aerosol retrievals including optical thickness and fine mode fraction, which is required in different applications including the air quality analysis. An overview of the algorithm, results of AERONET validation, and examples of comparison with MODIS Collection 5 aerosol product, including Deep Blue algorithm, will be presented for different parts of the world including continental USA, Persian Gulf region and India.

Lyapustin, A.↗

NASA NTRS2004

The Geostationary Operational Environmental Satellite (GOES) Product Generation System

The Geostationary Operational Environmental Satellite (GOES) Product Generation System (GPGS) is introduced and described. GPGS is a set of computer programs developed and maintained at the Global Hydrology and Climate Center and is designed to generate meteorological data products using visible and infrared measurements from the GOES-East Imager and Sounder instruments. The products that are produced by GPGS are skin temperature, total precipitable water, cloud top pressure, cloud albedo, surface albedo, and surface insolation. A robust cloud mask is also generated. The retrieval methodology for each product is described to include algorithm descriptions and required inputs and outputs for the programs. Validation is supplied where applicable.

Haines, S. L.↗

NASA NTRS2018

Harmonized Landsat/Sentinel-2 Products for Land Monitoring

The Harmonized Landsat-8 and Sentinel-2 (HLS) project is a NASA initiative aiming to produce a seamless, harmonized surface reflectance record from the Operational Land Imager (OLI) and Multi-Spectral Instrument (MSI) aboard Landsat-8 and Sentinel-2 remote sensing satellites, respectively. The HLS products are based on a set of algorithms to obtain seamless products from both sensors (OLI and MSI): atmospheric correction, cloud and cloud-shadow masking, geographic co-registration and common gridding, bidirectional reflectance distribution function normalization and bandpass adjustment. As of version 1.3, the HLS v1.3 data set covers 9.12 million km2 and spans from first Landsat-8 data (2013) to present. HLS products provide near-daily surface reflectance information with a common geometric framework, and are suitable for a variety of agricultural and vegetation monitoring tasks, including analysis of crop type, condition, and phenology.

Masek, Jeffrey↗

NASA NTRS2018

The Harmonized Landsat and Sentinel-2 Surface Reflectance Data Set

The Harmonized Landsat and Sentinel-2 (HLS) project is a NASA initiative aiming to produce a VirtualConstellation (VC) of surface reflectance (SR) data acquired by the Operational Land Imager (OLI) and MultiSpectral Instrument (MSI) aboard Landsat 8 and Sentinel-2 remote sensing satellites, respectively. The HLS products are based on a set of algorithms to obtain seamless products from both sensors (OLI and MSI): atmospheric correction, cloud and cloud-shadow masking, spatial co-registration and common gridding, bidirectional reflectance distribution function normalization and spectral bandpass adjustment. Three products are derivedfrom the HLS processing chain: (i) S10: full resolution MSI SR at 10 m, 20 m and 60 m spatial resolutions; (ii)S30: a 30 m MSI Nadir BRDF (Bidirectional Reflectance Distribution Function)-Adjusted Reflectance (NBAR);(iii) L30: a 30 m OLI NBAR. All three products are processed for every Level-1 input products from Landsat 8/OLI (L1T) and Sentinel-2/MSI (L1C). As of version 1.3, the HLS data set covers 10.35 million km2 and spans from first Landsat 8 data (2013); Sentinel-2 data spans from October 2015. The L30 and S30 show a good consistency with coarse spatial resolution products, in particular MODIS Collection 6 MCD09CMG products (overall deviations do not exceed 11%) that are used as a reference for quality assurance. The spatial co-registration of the HLS is improved compared to original Landsat 8 L1T and Sentinel 2A L1C products, for which misregistration issues between multi-temporal data are known. In particular, the resulting computed circular errors at 90% for the HLS product are 6.2 m and 18.8 m, for S10 and L30 products, respectively. The main known issue of the current data set remains the Sentinel-2 cloud mask with many cloud detection omissions. The cross-comparison with MODIS was used to flag products with most evident non-detected clouds. A time series outlier filtering approach is suggested to detect remaining clouds. Finally, several time series are presented to highlight the high potential of the HLS data set for crop monitoring.

Landsat Sentinel-2↗

NASA NTRS2017

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1↗

NASA NTRS2006

Improved Thin Cirrus and Terminator Cloud Detection in CERES Cloud Mask

Thin cirrus clouds account for about 20-30% of the total cloud coverage and affect the global radiation budget by increasing the Earth's albedo and reducing infrared emissions. Thin cirrus, however, are often underestimated by traditional satellite cloud detection algorithms. This difficulty is caused by the lack of spectral contrast between optically thin cirrus and the surface in techniques that use visible (0.65 micron ) and infrared (11 micron ) channels. In the Clouds and the Earth s Radiant Energy System (CERES) Aqua Edition 1 (AEd1) and Terra Edition 3 (TEd3) Cloud Masks, thin cirrus detection is significantly improved over both land and ocean using a technique that combines MODIS high-resolution measurements from the 1.38 and 11 micron channels and brightness temperature differences (BTDs) of 11-12, 8.5-11, and 3.7-11 micron channels. To account for humidity and view angle dependencies, empirical relationships were derived with observations from the 1.38 micron reflectance and the 11-12 and 8.5-11 micron BTDs using 70 granules of MODIS data in 2002 and 2003. Another challenge in global cloud detection algorithms occurs near the day/night terminator where information from the visible 0.65 micron channel and the estimated solar component of 3.7 micron channel becomes less reliable. As a result, clouds are often underestimated or misidentified near the terminator over land and ocean. Comparisons between the CLAVR-x (Clouds from Advanced Very High Resolution Radiometer [AVHRR]) cloud coverage and Geoscience Laser Altimeter System (GLAS) measurements north of 60 N indicate significant amounts of missing clouds from CLAVR-x because this part of the world was near the day/night terminator viewed by AVHRR. Comparisons between MODIS cloud products (MOD06) and GLAS in the same region also show similar difficulties with MODIS cloud retrievals. The consistent detection of clouds through out the day is needed to provide reliable cloud and radiation products for CERES and other research efforts involving the modeling of clouds and their interaction with the radiation budget.

Trepte, Qing↗

NASA NTRS2020

Dust Aerosol Retrieval Over the Oceans With the MODIS/VIIRS Dark‐Target Algorithm: 1. Dust Detection

To prepare for implementation of a new aerosol retrieval specifically designed for dust aerosol over ocean in the operational Dark-Target (DT) algorithms for the Moderate-resolution Imaging Spectrometer (MODIS) and Visible Infrared Imaging Radiometer Suite (VIIRS) satellite sensors, we focus on the challenge of detecting dust. We first survey the literature on existing dust detection algorithms and then develop an innovative algorithm that combines near-UV (deep blue), visible, and thermal infrared (TIR) wavelength spectral tests. The new detection algorithm is applied to Terra and Aqua MODIS granules and compared with other dust detection possibilities from existing MODIS products. Quantitative evaluation of the new dust detection algorithm is conducted using both a collocated AERONET-MODIS data set and collocated Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO)-MODIS data set. From comparison with both AERONET and CALIOP measurements, we estimate the new dust detection algorithm detects about 30% of weakly dusty pixels and more than 80% of heavily dusty pixels, with false detections in the range of 1–2%. The very low false detection rate is particularly noteworthy in comparison with existing literature. Compared with the dust flag currently available as part of the MODIS cloud mask product (MOD35/MYD35), and dust classification based on commonly used thresholds with aerosol optical depth (AOD) and Angstrom exponent (AE), the new dust detection algorithm finds more dusty pixels and fewer false detections.

spectral dust detection↗

NASA NTRS2020

Synergistic Use of Hyperspectral UV-Visible OMI and Broadband Meteorological Imager MODIS Data for a Merged Aerosol Product

The retrieval of optimal aerosol datasets by the synergistic use of hyperspectral ultraviolet(UV)–visible and broadband meteorological imager (MI) techniques was investigated. The Aura Ozone Monitoring Instrument (OMI) Level 1B (L1B) was used as a proxy for hyperspectral UV–visible instrument data to which the Geostationary Environment Monitoring Spectrometer (GEMS) aerosol algorithm was applied. Moderate-Resolution Imaging Spectroradiometer (MODIS) L1B and dark target aerosol Level 2 (L2) data were used with a broadband MI to take advantage of the consistent time gap between the MODIS and the OMI. First, the use of cloud mask information from the MI infrared (IR) channel was tested for synergy. High-spatial-resolution and IR channels of the MI helped mask cirrus and sub-pixel cloud contamination of GEMS aerosol, as clearly seen in aerosol optical depth (AOD) validation with Aerosol Robotic Network (AERONET) data. Second, dust aerosols were distinguished in the GEMS aerosol-type classification algorithm by calculating the total dust confidence index (TDCI) from MODIS L1B IR channels. Statistical analysis indicates that the Probability of Correct Detection (POCD) between the forward and inversion aerosol dust models (DS) was increased from 72% to 94% by use of the TDCI for GEMS aerosol-type classification, and updated aerosol types were then applied to the GEMS algorithm. Use of the TDCI for DS type classification in the GEMS retrieval procedure gave improved single-scattering albedo (SSA) values for absorbing fine pollution particles (BC) and DS aerosols. Aerosol layer height (ALH) retrieved from GEMS was compared with Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data, which provides high-resolution vertical aerosol profile information. The CALIOP ALH was calculated from total attenuated backscatter data at 1064 nm, which is identical to the definition of GEMS ALH. Application of the TDCI value reduced the median bias of GEMS ALH data slightly. The GEMS ALH bias approximates zero, especially for GEMS AOD values of>~0.4 and GEMS SSA values of<~0.95.Finally, the AOD products from the GEMS algorithm and MI were used in aerosol merging with the maximum-likelihood estimation method, based on a weighting factor derived from the standard deviation of the original AOD products. With the advantage of the UV–visible channel in retrieving aerosol properties over bright surfaces, the combined AOD products demonstrated better spatial data availability than the original AOD products, with comparable accuracy. Furthermore, pixel-level error analysis of GEMS AOD data indicates improvement through MI synergy.

aerosol↗

NASA NTRS2001

Operational Cloud Detection in GEOS Imagery

The bispectral spatial coherence approach for the detection and masking of clouds is revisited with modifications for operational applications to Geostationary Operational Environmental Satellite (GOES) Imager and Sounder data. The approach applies an edge detection algorithm to a "difference" image to identify the edges or contours of the clouds. The difference image is generated as the difference between the 3.9 and 11 micrometer channels of the GOES sensors. This difference image better highlights cloud edges than either image alone and draws upon the emissivity differences in the various channels. The cloud contours are "filled-in" by referencing the thermal gradients in the 11-micrometer channel or difference image associated with the cloud edge. This paper and associate poster will present a preliminary validation of the bispectral spatial coherence approach and will compare the cloud masks generated with this approach to the National Oceanic and Atmospheric Administration/National Environmental Satellite, Data, and Information Service (NOAA/NESDIS) operational cloud products.

Jedlovec, Gary J.↗