Search NASASearch

SEARCH · Search NASA

Results for “cloud detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Improved Thin Cirrus and Terminator Cloud Detection in CERES Cloud Mask

Thin cirrus clouds account for about 20-30% of the total cloud coverage and affect the global radiation budget by increasing the Earth's albedo and reducing infrared emissions. Thin cirrus, however, are often underestimated by traditional satellite cloud detection algorithms. This difficulty is caused by the lack of spectral contrast between optically thin cirrus and the surface in techniques that use visible (0.65 micron ) and infrared (11 micron ) channels. In the Clouds and the Earth s Radiant Energy System (CERES) Aqua Edition 1 (AEd1) and Terra Edition 3 (TEd3) Cloud Masks, thin cirrus detection is significantly improved over both land and ocean using a technique that combines MODIS high-resolution measurements from the 1.38 and 11 micron channels and brightness temperature differences (BTDs) of 11-12, 8.5-11, and 3.7-11 micron channels. To account for humidity and view angle dependencies, empirical relationships were derived with observations from the 1.38 micron reflectance and the 11-12 and 8.5-11 micron BTDs using 70 granules of MODIS data in 2002 and 2003. Another challenge in global cloud detection algorithms occurs near the day/night terminator where information from the visible 0.65 micron channel and the estimated solar component of 3.7 micron channel becomes less reliable. As a result, clouds are often underestimated or misidentified near the terminator over land and ocean. Comparisons between the CLAVR-x (Clouds from Advanced Very High Resolution Radiometer [AVHRR]) cloud coverage and Geoscience Laser Altimeter System (GLAS) measurements north of 60 N indicate significant amounts of missing clouds from CLAVR-x because this part of the world was near the day/night terminator viewed by AVHRR. Comparisons between MODIS cloud products (MOD06) and GLAS in the same region also show similar difficulties with MODIS cloud retrievals. The consistent detection of clouds through out the day is needed to provide reliable cloud and radiation products for CERES and other research efforts involving the modeling of clouds and their interaction with the radiation budget.

Trepte, Qing

A New Algorithm for Detecting Cloud Height using OMPS/LP Measurements

The Ozone Mapping and Profiler Suite Limb Profiler (OMPS/LP) ozone product requires the determination of cloud height for each event to establish the lower boundary of the profile for the retrieval algorithm. We have created a revised cloud detection algorithm for LP measurements that uses the spectral dependence of the vertical gradient in radiance between two wavelengths in the visible and near-IR spectral regions. This approach provides better discrimination between clouds and aerosols than results obtained using a single wavelength. Observed LP cloud height values show good agreement with coincident Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) measurements.

Chen, Zhong

Evaluation of the MODIS Collection 6 Multilayer Cloud Detection Algorithm Through Comparisons with Cloudsat Cloud Profiling Radar and CALIPSO CALIOP Products

Since multilayer cloud scenes are common in the atmosphere and can be an important source of uncertainty in passive satellite sensor cloud retrievals, the MODIS MOD06 and MYD06 standard cloud optical property products include a multilayer cloud detection algorithm to assist with data quality assessment. This paper presents an evaluation of the Aqua MODIS MYD06 Collection 6 multilayer cloud detection algorithm through comparisons with active Cloud Profiling Radar (CPR) and Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) products that have the ability to provide cloud vertical distributions and directly classify multilayer cloud scenes and layer properties. To compare active sensor products with an imager such as MODIS, it is first necessary to define multilayer clouds in the context of their radiative impact on cloud retrievals. Three main parameters have thus been considered in this evaluation: (1) the maximum separation distance between two cloud layers, (2) the thermodynamic phase of those layers and (3) the upper-layer cloud optical thickness. The impact of including the Pavolonis–Heidinger multilayer cloud detection algorithm, introduced in Collection 6, to assist with multilayer cloud detection has also been assessed. For the year 2008, the MYD06 C6 multilayer cloud detection algorithm identifies roughly 20% of all cloudy pixels as multilayer (decreasing to about 13% if the Pavolonis–Heidinger algorithm output is not used). Evaluation against the merged CPR and CALIOP2B-CLDCLASS-lidar product shows that the MODIS multilayer detection results are quite sensitive to how multilayer clouds are defined in the radar and lidar product and that the algorithm performs better when the optical thickness of the upper cloud layer is greater than about 1.2 with a minimum layer separation distance of 1 km. Finally, we find that filtering the MYD06 cloud optical properties retrievals using the multilayer cloud flag improves aggregated statistics, particularly for ice cloud effective radius.

MODIS

Multilayer Cloud Detection with the MODIS Near-Infrared Water Vapor Absorption Band

Data Collection 5 processing for the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the NASA Earth Observing System EOS Terra and Aqua spacecraft includes an algorithm for detecting multilayered clouds in daytime. The main objective of this algorithm is to detect multilayered cloud scenes, specifically optically thin ice cloud overlying a lower-level water cloud, that presents difficulties for retrieving cloud effective radius using single layer plane-parallel cloud models. The algorithm uses the MODIS 0.94 micron water vapor band along with CO2 bands to obtain two above-cloud precipitable water retrievals, the difference of which, in conjunction with additional tests, provides a map of where multilayered clouds might potentially exist. The presence of a multilayered cloud results in a large difference in retrievals of above-cloud properties between the CO2 and the 0.94 micron methods. In this paper the MODIS multilayered cloud algorithm is described, results of using the algorithm over example scenes are shown, and global statistics for multilayered clouds as observed by MODIS are discussed. A theoretical study of the algorithm behavior for simulated multilayered clouds is also given. Results are compared to two other comparable passive imager methods. A set of standard cloudy atmospheric profiles developed during the course of this investigation is also presented. The results lead to the conclusion that the MODIS multilayer cloud detection algorithm has some skill in identifying multilayered clouds with different thermodynamic phases

Wind, Galina

Improvements in Night-Time Low Cloud Detection and MODIS-Style Cloud Optical Properties from MSG SEVIRI

The MODIS cloud optical properties algorithm (MOD06IMYD06 for Terra and Aqua MODIS, respectively) slated for production in Data Collection 6 has been adapted to execute using available channels on MSG SEVIRI. Available MODIS-style retrievals include IR Window-derived cloud top properties, using the new Collection 6 cloud top properties algorithm, cloud optical thickness from VISINIR bands, cloud effective radius from 1.6 and 3.7Jlm and cloud ice/water path. We also provide pixel-level uncertainty estimate for successful retrievals. It was found that at nighttime the SEVIRI cloud mask tends to report unnaturally low cloud fraction for marine stratocumulus clouds. A correction algorithm that improves detection of such clouds has been developed. We will discuss the improvements to nighttime low cloud detection for SEVIRI and show examples and comparisons with MODIS and CALIPSO. We will also show examples of MODIS-style pixel-level (Level-2) cloud retrievals for SEVIRI with comparisons to MODIS.

Wind, Galina (Gala)

Spatial and Temporal Varying Thresholds for Cloud Detection in Satellite Imagery

A new cloud detection technique has been developed and applied to both geostationary and polar orbiting satellite imagery having channels in the thermal infrared and short wave infrared spectral regions. The bispectral composite threshold (BCT) technique uses only the 11 micron and 3.9 micron channels, and composite imagery generated from these channels, in a four-step cloud detection procedure to produce a binary cloud mask at single pixel resolution. A unique aspect of this algorithm is the use of 20-day composites of the 11 micron and the 11 - 3.9 micron channel difference imagery to represent spatially and temporally varying clear-sky thresholds for the bispectral cloud tests. The BCT cloud detection algorithm has been applied to GOES and MODIS data over the continental United States over the last three years with good success. The resulting products have been validated against "truth" datasets (generated by the manual determination of the sky conditions from available satellite imagery) for various seasons from the 2003-2005 periods. The day and night algorithm has been shown to determine the correct sky conditions 80-90% of the time (on average) over land and ocean areas. Only a small variation in algorithm performance occurs between day-night, land-ocean, and between seasons. The algorithm performs least well. during he winter season with only 80% of the sky conditions determined correctly. The algorithm was found to under-determine clouds at night and during times of low sun angle (in geostationary satellite data) and tends to over-determine the presence of clouds during the day, particularly in the summertime. Since the spectral tests use only the short- and long-wave channels common to most multispectral scanners; the application of the BCT technique to a variety of satellite sensors including SEVERI should be straightforward and produce similar performance results.

Jedlovec, Gary

Development of a Consistent MODIS and VIIRS Cloud Detection Approach for CERES

A consistent cloud fraction record across various satellite platforms is essential for maintaining a long-term and stable climate data record of Earth's energy budget. With the Aqua satellite nearing the end of its operational lifetime, the continuation of this record relies on utilizing VIIRS observations from NOAA20 for cloud detection in NASA’s Clouds and Earth’s Radiant Energy System (CERES) project. However, integrating data from VIIRS and MODIS instruments poses challenges due to their distinct characteristics, such as varying spatial resolutions and different spectral channels. As a result, deriving consistent cloud properties from these two sensors without introducing artificial discontinuities in the time series remains a complex and challenging task. This paper will present progress toward developing a unified MODIS and VIIRS cloud mask using common channels to produce consistent cloud properties for CERES next edition (Ed5) Earth radiation budget data products. The fundamental approach taken in the CERES cloud mask is to compare the observed radiances to the expected background clear sky radiances. Therefore, one vital step is to compute clear sky radiances with a radiative transfer model that accurately accounts for satellite-specific, spectrally dependent surface reflectance, surface emission, and atmospheric absorption. Refined radiative transfer models and updated ancillary data inputs including surface emissivity maps, IGBP, snow and ice maps are incorporated into the processing framework to improve cloud detection consistency and accuracy. Pixel level cloud mask results and monthly global cloud fraction comparisons between MODIS and VIIRS will be presented to evaluate their consistency. Remaining challenges will be discussed. It is expected that this work will contribute consistent cloud properties for CERES that adequately bridges the MODIS and VIIRS imager data records.

CERES

A Cloud Detection Neural Network for Above-Aircraft Clouds Using Airborne Cameras

We introduce a method convolutional neural networks to detect the presence of clouds in airborne camera images. We quantify the performance of this Cloud Detection Neural Network (CDNN) using human-labeled validation data where we report a 96% accuracy in detecting clouds in testing datasets for both Zenith- viewing and Forward-viewing models. We assess our performance by comparing the flight-averaged cloud fraction of zenith and forward CDNN retrievals, with that of the prototype hyperspectral total-diffuse Sunshine Pyranometer (SPN-S) instrument’s cloud optical depth data. Comparison of the CDNN with the SPN-S on time specific intervals resulted in 93% accuracy for the zenith- viewing CDNN and 84% for the forward- viewing CDNN. The comparison of the CDNNs with the SPN-S on flight-averaged cloud fraction resulted in an agreement of 0.15 for the Forward CDNN and 0.07 for the Zenith CDNN. We then quantify the ability of the CDNN to identify the presence of clouds above the aircraft using a forward- looking camera mounted inside the aircraft cockpit compared to the use of an All- Sky upward-looking camera that is mounted outside the fuselage on top of the aircraft. We present results from the CDNN based on airborne imagery from the NASA Aerosol Cloud Meteorology Interactions Over the Western Atlantic Experiment (ACTIVATE) and the Clouds, Aerosol and Monsoon Processes- Philippines Experiment (CAMP2Ex). For CAMP2Ex 53% of flight dates had above- aircraft cloud fraction above 50%, while for ACTIVATE 52% and 54% of flight dates observed above-aircraft cloud fraction above 50% for 2020 and 2021, respectively.

Joseph D Nied

A Bispectral Composite Threshold Approach for Automatic Cloud Detection in VIIRS Imagery

The detection of clouds in satellite imagery has a number of important applications in weather and climate studies. The presence of clouds can alter the energy budget of the Earth‐atmosphere system through scattering and absorption of shortwave radiation and the absorption and re‐emission of infrared radiation at longer wavelengths. The scattering and absorption characteristics of clouds vary with the microphysical properties of clouds, hence the cloud type. Thus, detecting the presence of clouds over a region in satellite imagery is important in order to derive atmospheric or surface parameters that give insight into weather and climate processes. For many applications however, clouds are a contaminant whose presence interferes with retrieving atmosphere or surface information. In these cases, is important to isolate cloud‐free pixels, used to retrieve atmospheric thermodynamic information or surface geophysical parameters, from cloudy ones. This abstract describes an application of a two‐channel bispectral composite threshold (BCT) approach applied to VIIRS imagery. The simplified BCT approach uses only the 10.76 and 3.75 micrometer spectral channels from VIIRS in two spectral tests; a straight‐forward infrared threshold test with the longwave channel and a shortwave - longwave channel difference test. The key to the success of this approach as demonstrated in past applications to GOES and MODIS data is the generation of temporally and spatially dependent thresholds used in the tests from a previous number of days at similar observations to the current data. The paper and subsequent presentation will present an overview of the approach and intercomparison results with other satellites, methods, and against verification data.

LaFontaine Frank J.

Spatially Varying Spectrally Thresholds for MODIS Cloud Detection

The EOS science team has developed an elaborate global MODIS cloud detection procedure, and the resulting MODIS product (MOD35) is used in the retrieval process of several geophysical parameters to mask out clouds. While the global application of the cloud detection approach appears quite robust, the product has some shortcomings on the regional scale, often over determining clouds in a variety of settings, particularly at night. This over-determination of clouds can cause a reduction in the spatial coverage of MODIS derived clear-sky products. To minimize this problem, a new regional cloud detection method for use with MODIS data has been developed at NASA's Global Hydrology and Climate Center (GHCC). The approach is similar to that used by the GHCC for GOES data over the continental United States. Several spatially varying thresholds are applied to MODIS spectral data to produce a set of tests for detecting clouds. The thresholds are valid for each MODIS orbital pass, and are derived from 20-day composites of GOES channels with similar wavelengths to MODIS. This paper and accompanying poster will introduce the GHCC MODIS cloud mask, provide some examples, and present some preliminary validation.

Haines, S. L.

Automated, per pixel Cloud Detection from High-Resolution VNIR Data

CASA is a fully automated software program for the per-pixel detection of clouds and cloud shadows from medium- (e.g., Landsat, SPOT, AWiFS) and high- (e.g., IKONOS, QuickBird, OrbView) resolution imagery without the use of thermal data. CASA is an object-based feature extraction program which utilizes a complex combination of spectral, spatial, and contextual information available in the imagery and the hierarchical self-learning logic for accurate detection of clouds and their shadows.

Varlyguin, Dmitry L.

Improvements in AVHRR Daytime Cloud Detection Over the ARM NSA Site

Clouds play an important role in the radiation budget over Arctic and Antarctic. Because of limited surface observing capabilities, it is necessary to detect clouds over large areas using satellite imagery. At low and mid-latitudes, satellite-observed visible (VIS; 0.65 micrometers) and infrared (IR; 11 micrometers) radiance data are used to derive cloud fraction, temperature, and optical depth. However, the extreme variability in the VIS surface albedo makes the detection of clouds from satellite a difficult process in polar regions. The IR data often show that the surface is nearly the same temperature or even colder than clouds, further complicating cloud detection. Also, the boundary layer can have large areas of haze, thin fog, or diamond dust that are not seen in standard satellite imagery. Other spectral radiances measured by satellite imagers provide additional information that can be used to more accurately discriminate clouds from snow and ice. Most techniques currently use a fixed reflectance or temperature threshold to decide between clouds and clear snow. Using a subjective approach, Minnis et al. (2001) found that the clear snow radiance signatures vary as a function of viewing and illumination conditions as well as snow condition. To routinely process satellite imagery over polar regions with an automated algorithm, it is necessary to account for this angular variability and the change in the background reflectance as snow melts, vegetation grows over land, and melt ponds form on pack ice. This paper documents the initial satellite-based cloud product over the Atmospheric Radiation Measurement (ARM) North Slope of Alaska (NSA) site at Barrow for use by the modeling community. Cloud amount and height are determined subjectively using an adaptation of the methodology of Minnis et al. (2001) and the radiation fields arc determined following the methods of Doelling et al. (2001) as applied to data taken during the Surface Heat and Energy Budget of the Arctic (SHEBA). The procedures and data produced in this empirically based analysis will also facilitate the development of the automated algorithm for future processing of satellite data over the ARM NSA domain. Results are presented for May, June, and July 1998. ARM surface data are use to partially validate the results taken directly over the ARM site.

Chakrapani, V.

A Comparison of Satellite-Based Multilayered Cloud Detection Methods

Both techniques show skill in detecting multilayered clouds, but they disagree more than 50% of the time. BTD method tends to detect more ML clouds than CO2 method and has slightly higher detection accuracy. CO2 method might be better for minimizing false positives, but further study is needed. Neither method as been optimized for GOES data. BTD technique developed on AVHRR, better BTD signals & resolution. CO2 developed on MODIS, better resolution & 4 CO2 channels. Many additional comparisons with ARSCL data will be used to optimize both techniques. A combined technique will be examined using MODIS & Meteosat-8 data. After optimization, the techniques will be implemented in the ARM operational satellite cloud processing.

Minnis, Patrick

Evaluation of Decision Trees for Cloud Detection from AVHRR Data

Automated cloud detection and tracking is an important step in assessing changes in radiation budgets associated with global climate change via remote sensing. Data products based on satellite imagery are available to the scientific community for studying trends in the Earth's atmosphere. The data products include pixel-based cloud masks that assign cloud-cover classifications to pixels. Many cloud-mask algorithms have the form of decision trees. The decision trees employ sequential tests that scientists designed based on empirical astrophysics studies and simulations. Limitations of existing cloud masks restrict our ability to accurately track changes in cloud patterns over time. In a previous study we compared automatically learned decision trees to cloud masks included in Advanced Very High Resolution Radiometer (AVHRR) data products from the year 2000. In this paper we report the replication of the study for five-year data, and for a gold standard based on surface observations performed by scientists at weather stations in the British Islands. For our sample data, the accuracy of automatically learned decision trees was greater than the accuracy of the cloud masks p < 0.001.

AVHRR (ADVANCED VERY HIGH RESOLUTION RADIOMETER)

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1

Validation of ISCCP cloud detections

This paper describes the validation of the International Satellite Cloud Climatology project (ISCCP)cloud detections by verifying the accuracy of the infrared clear-sky radiances. Comparison of retrieved surface temperatures to other measurements shows that bias errors are less than 2 K and random errors are about 2 K for sea surface (monthly means at 280-km scales) and that bias errors are less than 2 K and random errors are about 4 K for land surfaces (3 hourly at 280-km scales). Bias errors over a few persistently cloudy locations are sometimes -(2-4) K and over winter sea ice may be about +2 K. Surface reflectances are confirmed to be within 3% of other measurements and models for ocean, except for sun glint geometries, and to be within 3%-5% for land surfaces. Sufficiently accurate validation data are not avilable for visible reflectances of sea ice and snow-covered land, but some tests of specific cases suggest that errors are approximately 10%. These errors in clear-sky radiances suggest uncertainties in the ISCCP cloud detections of about 10% with a small (3%-6%) negative bias over land. Some specific regions exhibit both larger rms uncertainties and somewhat larger biases in cloud amount approaching 10%. ISCCP cloud detections are more in error over the polar regions than anywhere else. Based on comparisons with an anlysis of radiances measured at other wavelengths, the ISCCP analysis appears to miss 15%-25% of the clouds in summer but only 5%-10% of the winter clouds.

Rossow, William B.

Comparison of Cloud Detection Algorithms for Sentinel-2 Imagery

Accurate, automated cloud and cloud shadow detection is a key component of the processing needed to prepare optical satellite imagery for scientific analysis. Many existing cloud detection algorithms rely on temperature information to identify clouds, making detection difficult for imagers that lack a thermal band, like Sentinel-2. To get maximum benefit from Sentinel-2 products it is critical to understand which algorithms best identify clouds and their shadows in images. We examined the relative performance of five different cloud-masking algorithms (Sen2Cor, MAJA, LaSRC, Fmask and Tmask) in 6 Sentinel-2 scenes (28 total images) distributed across the Eastern Hemisphere. Expanding on these comparisons, we tested ensemble approaches to improve results. We tested three ensemble approaches to cloud and shadow classification based on the outputs of the five initial algorithms using the cloud masks in: (1) a majority prediction model; (2) a random forests model; and (3) a conditional logic model. Accuracy assessments show a trade-off between omission and commission errors in cloud detection for individual algorithms across all sites, and some algorithms are better at detecting either clouds or cloud shadows. No single algorithm outperforms the others for both clouds and shadows. Aggregating the results from multiple algorithms produces fewer undetected clouds and higher overall accuracy than any single algorithm, with as high as 2.7% improvement over the top-performing algorithm, suggesting an ensemble approach may be the most useful for processing of Sentinel-2 data.

Sentinel-2

Using Information From Prior Satellite Scans to Improve Cloud Detection Near the Day-Night Terminator

With geostationary satellite data it is possible to have a continuous record of diurnal cycles of cloud properties for a large portion of the globe. Daytime cloud property retrieval algorithms are typically superior to nighttime algorithms because daytime methods utilize measurements of reflected solar radiation. However, reflected solar radiation is difficult to accurately model for high solar zenith angles where the amount of incident radiation is small. Clear and cloudy scenes can exhibit very small differences in reflected radiation and threshold-based cloud detection methods have more difficulty setting the proper thresholds for accurate cloud detection. Because top-of-atmosphere radiances are typically more accurately modeled outside the terminator region, information from previous scans can help guide cloud detection near the terminator. This paper presents an algorithm that uses cloud fraction and clear and cloudy infrared brightness temperatures from previous satellite scan times to improve the performance of a threshold-based cloud mask near the terminator. Comparisons of daytime, nighttime, and terminator cloud fraction derived from Geostationary Operational Environmental Satellite (GOES) radiance measurements show that the algorithm greatly reduces the number of false cloud detections and smoothes the transition from the daytime to the nighttime clod detection algorithm. Comparisons with the Geoscience Laser Altimeter System (GLAS) data show that using this algorithm decreases the number of false detections by approximately 20 percentage points.

Yost, Christopher R.