Search NASASearch

SEARCH · Search NASA

Results for “cloud detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Cloud Mask Intercomparison eXercise (CMIX): An evaluation of cloud masking algorithms for Landsat 8 and Sentinel-2

Cloud cover is a major limiting factor in exploiting time-series data acquired by optical spaceborne remote sensing sensors. Multiple methods have been developed to address the problem of cloud detection in satellite imagery and a number of cloud masking algorithms have been developed for optical sensors but very few studies have carried out quantitative intercomparison of state-of-the-art methods in this domain. This paper summarizes results of the first Cloud Masking Intercomparison eXercise (CMIX) conducted within the Committee Earth Observation Satellites (CEOS) Working Group on Calibration & Validation (WGCV). CEOS is the forum for space agency coordination and cooperation on Earth observations, with activities organized under working groups. CMIX, as one such activity, is an international collaborative effort aimed at intercomparing cloud detection algorithms for moderate-spatial resolution (10–30 m) spaceborne optical sensors. The focus of CMIX is on open and free imagery acquired by the Landsat 8 (NASA/USGS) and Sentinel-2 (ESA) missions. Ten algorithms developed by nine teams from fourteen different organizations representing universities, research centers and industry, as well as space agencies (CNES, ESA, DLR, and NASA), are evaluated within the CMIX. Those algorithms vary in their approach and concepts utilized which were based on various spectral properties, spatial and temporal features, as well as machine learning methods. Algorithm outputs are evaluated against existing reference cloud mask datasets. Those datasets vary in sampling methods, geographical distribution, sample unit (points, polygons, full image labels), and generation approaches (experts, machine learning, sky images). Overall, the performance of algorithms varied depending on the reference dataset, which can be attributed to differences in how the reference datasets were produced. The algorithms were in good agreement for thick cloud detection, which were opaque and had lower uncertainties in their identification, in contrast to thin/semi-transparent clouds detection. Not only did CMIX allow identification of strengths and weaknesses of existing algorithms and potential areas of improvements, but also the problems associated with the existing reference datasets. The paper concludes with recommendations on generating new reference datasets, metrics, and an analysis framework to be further exploited and additional input datasets to be considered by future CMIX activities.

Sergii Skakun

Broadband and filter radiometers at Ross Island, Antarctica: detection of cloud ice phase versus liquid water influences on shortwave and longwave radiation

Abstract. Surface radiometer data from Ross Island, Antarctica, collected during the austral summer 2015–2016 by the US Department of Energy Atmospheric Radiation Measurement (ARM) program West Antarctic Radiation Experiment (AWARE), are used to evaluate how shortwave and longwave irradiance respond to changing cloud properties as governed by contrasting meteorological regimes. Shortwave atmospheric transmittance is derived from pyranometer measurements, and cloud conservative-scattering optical depth is derived from filter radiometer measurements at 870 nm. With onshore flow associated with marine air masses, clouds contain mostly liquid water. With southerly flow over the Transantarctic Mountains, orographic forcing induces substantial cloud ice water content. These ice and mixed-phase clouds attenuate more surface shortwave irradiance than the maritime-influenced clouds and also emit less longwave irradiance due to colder cloud base temperature. These detected irradiance changes are in a range that can mean onset or inhibition of surface melt over ice shelves. This study demonstrates how basic and relatively low-cost broadband and filter radiometers can be used to detect subtle climatological influences of contrasting cloud microphysical properties at very remote locations.

54 ENVIRONMENTAL SCIENCES

Cloud Overlapping Detection Algorithm Using Solar and IR Wavelengths With GOSE Data Over ARM/SGP Site

One of the most perplexing problems in satellite cloud remote sensing is the overlapping of cloud layers. Although most techniques assume a 1-layer cloud system in a given retrieval of cloud properties, many observations are affected by radiation from more than one cloud layer. As such, cloud overlap can cause errors in the retrieval of many properties including cloud height, optical depth, phase, and particle size. A variety of methods have been developed to identify overlapped clouds in a given satellite imager pixel. Baum el al. (1995) used CO2 slicing and a spatial coherence method to demonstrate a possible analysis method for nighttime detection of multilayered clouds. Jin and Rossow (1997) also used a multispectral CO2 slicing technique for a global analysis of overlapped cloud amount. Lin et al. (1999) used a combination infrared, visible, and microwave data to detect overlapped clouds over water. Recently, Baum and Spinhirne (2000) proposed 1.6 and 11 microns. bispectral threshold method. While all of these methods have made progress in solving this stubborn problem, none have yet proven satisfactory for continuous and consistent monitoring of multilayer cloud systems. It is clear that detection of overlapping clouds from passive instruments such as satellite radiometers is in an immature stage of development and requires additional research. Overlapped cloud systems also affect the retrievals of cloud properties over the ARM domains (e.g., Minnis et al 1998) and hence should identified as accurately as possible. To reach this goal, it is necessary to determine which information can be exploited for detecting multilayered clouds from operational meteorological satellite data used by ARM. This paper examines the potential information available in spectral data available on the Geostationary Operational Environmental Satellite (GOES) imager and the NOAA Advanced Very High Resolution Radiometer (AVHRR) used over the ARM SGP and NSA sites to study the capability of detecting overlapping clouds

Kawamoto, Kazuaki

Cloud Overlapping Detection Algorithm Using Solar and IR Wavelengths with GOES Data Over ARM/SGP Site

One of the most perplexing problems in satellite cloud remote sensing is the overlapping of cloud layers. Although most techniques assume a one layer cloud system in a given retrieval of cloud properties, many observations are affected by radiation from more than one cloud layer. As such, cloud overlap can cause errors in the retrieval of many properties including cloud height, optical depth, phase, and particle size. A variety of methods have been developed to identify overlapped clouds in a given satellite imager pixel. Baum et al used CO2 slicing and a spatial coherence method to demonstrate a possible analysis method for nighttime detection of multilayered clouds. Jin and Rossow also used a multispectral CO2 slicing technique for a global analysis of overlapped cloud amount. Lin et al. used a combination infrared (IR), visible (VIS), and microwave data to detect overlapped clouds over water. Recently, Baum and Spinhirne proposed a 1.6 and 11 micron bispectral threshold method. While all of these methods have made progress in solving this stubborn problem none have yet proven satisfactory for continuous and consistent monitoring of multilayer cloud systems. It is clear that detection of overlapping clouds from passive instruments such as satellite radiometers is in an immature stage of development and requires additional research. Overlapped cloud systems also affect the retrievals of cloud properties over the Atmospheric Radiation Measurement (ARM) domains and hence should be identified as accurately as possible. To reach this goal, it is necessary to determine which information can be exploited for detecting multilayered clouds from operational meteorological satellite data used by ARM. This paper examines the potential information available in spectral data available on the Geostationary Operational Environmental Satellite (GOES) imager and the National Oceanic Atmospheric Administration (NOAA) Advanced Very High Resolution Radiometer (AVHRR) used over the ARM Program's Southern Great Plains (SGP), and North Slope of Alaska (NSA) sites to study the capability of detecting overlapping clouds.

Kawamoto, K.

HyspIRI Cloud Mask Detection Algorithm Theoretical Basis Document

The Hyperspectral Infrared Imager (HyspIRI) satellite includes a thermal infrared (TIR) multispectral scanner with seven spectral bands in the thermal infrared (TIR) between 7 and 12 μm and one band in the mid-infrared between 3 and 5 μm designed to measure hot targets. The TIR bands have a NEΔT of <0.2 K at 300K and all bands have a spatial scale of 60 m. The two primary Level-2 products that will be generated by HyspIRI TIR data are land surface temperature and emissivity. A critical aspect of minimizing uncertainties in these products and in generating global Level-3 products is an accurate and reliable cloud mask algorithm. This document describes the methodology behind developing the HyspIRI Cloud Mask Algorithm (HyCMA), and challenges associated with cloud detection. The HyCMA will derive its heritage from previously well established cloud mask algorithms such as the Landsat ACCAA, MODIS MOD35 and AVHRR.

Hook, Simon J.

The Role of Clear Sky Identification in the Study of Cloud Radiative Effects: Combine Analysis from ISCCP and the Scanner of Radiation Budget (ScaRaB)

Since the effect of clouds on the earth's radiation balance is often estimated as the difference of net radiative fluxes at the top of the atmosphere between all situations and monthly averaged clear sky situations of the same regions, a reliable identification of clear sky is important for the study of cloud radiative effects. The Scanner for Radiation Balance (ScaRaB) radiometer on board the Russian Meteor-3/7 satellite provided earth radiation budget observations from March 1994 to February 1995 with two ERBE-Re broad-band longwave and shortwave channels. Two narrow-band channels, in the infrared atmospheric window and in the visible band, have been added to the ScaRaB instrument to improve the cloud scene identification. The International Satellite Cloud Climatology Project (ISCCP) method for cloud detection and determination of cloud and surface properties uses the same narrow-band channels as ScaRaB, but is employed to a collection of measurements at a better spatial resolution of about 5 km. By applying the original ISCCP algorithms to the ScaRaB data, the clear sky frequency is about 5% lower than the one over quasi-simultaneous original ISCCP data, an indication that the ISCCP cloud detection is quite stable. However, one would expect an about 10 to 20% smaller clear sky occurrence over the larger ScaRaB pixels. Adapting the ISCCP algorithms to the reduced spatial resolution of 60 km and to the different time sampling of the ScaRaB data leads therefore to a reduction of a residual cloud contamination. A sensitivity study with time-space collocated ScaRaB and original ISCCP data at a spatial resolution of 1deg longitude x 1deg latitude shows that the effect of clear sky identification method plays a higher role on the clear sky frequency and therefore on the statistics than on the zonal mean values of the clear sky fluxes. Nevertheless, the zonal outgoing longwave fluxes corresponding to ERBE clear sky are in general about 2 to 10 W/sq m higher than those obtained from the ScaRaB adapted ISCCP clear sky identifications. The latter are close to (about 1 W/sq m higher) fluxes corresponding to clear sky regions from original ISCCP data, whereas ScaRaB clear sky LW fluxes obtained with the original ISCCP identification lie about 1 to 2 W/sq m below. Especially in the tropics where water vapor abundance is high, the ERBE clear sky LW fluxes seem to be systematically overestimated by about 4 W/sq m, and SW fluxes are lower by about 5 to 10 W/sq m. However, the uncertainty in the analysis of monthly mean zonal cloud radiative effects is also produced by the low frequency of clear sky occurrence, illustrated when averaging over pixels or even over regions of 4deg longitude x 5deg latitude, corresponding to the spatial resolution of General Circulation Models. The systematic bias in the clear sky fluxes is not reflected in the zonal cloud radiative effects, because the clear sky regions selected by the different algorithms can occur in different geographic regions with different cloud properties.

Rossow, W. B.

Wavelength dependence of coherent and incoherent satellite-based lidar measurements of wind velocity and aerosol backscatter

The results are presented of a capability study of Earth orbiting lidar systems, at various wavelengths from 1.06 to 10.6 microns, for the measurement of wind velocity and aerosol backscatter, and for the detection of clouds. Both coherent and incoherent lidar systems were modeled and compared for the aerosol backscatter and cloud detection applications.

Kavaya, M. J.

Investigation of Cloud Properties and Atmospheric Profiles with MODIS

The WINter Cloud Experiment (WINCE) was directed and supported by personnel from the University of Wisconsin in January and February. Data sets of good quality were collected by the MODIS Airborne Simulator (MAS) and other instruments on the NASA ER2; they will be used to develop and validate cloud detection and cloud property retrievals over winter scenes (especially over snow). Software development focused on utilities needed for all of the UW product executables; preparations for Version 2 software deliveries were almost completed. A significant effort was made, in cooperation with SBRS and MCST, in characterizing and understanding MODIS PFM thermal infrared performance; crosstalk in the longwave infrared channels continues to get considerable attention.

Menzel, Paul

Processing AIRS Scientific Data Through Level 2

The Atmospheric Infrared Spectrometer (AIRS) Science Processing System (SPS) is a collection of computer programs, denoted product generation executives (PGEs), for processing the readings of the AIRS suite of infrared and microwave instruments orbiting the Earth aboard NASA s Aqua spacecraft. AIRS SPS at an earlier stage of development was described in "Initial Processing of Infrared Spectral Data' (NPO-35243), NASA Tech Briefs, Vol. 28, No. 11 (November 2004), page 39. To recapitulate: Starting from level 0 (representing raw AIRS data), the PGEs and their data products are denoted by alphanumeric labels (1A, 1B, and 2) that signify the successive stages of processing. The cited prior article described processing through level 1B (the level-2 PGEs were not yet operational). The level-2 PGEs, which are now operational, receive packages of level-1B geolocated radiance data products and produce such geolocated geophysical atmospheric data products such as temperature and humidity profiles. The process of computing these geophysical data products is denoted "retrieval" and is quite complex. The main steps of the process are denoted microwave-only retrieval, cloud detection and cloud clearing, regression, full retrieval, and rapid transmittance algorithm.

Oliphant, Robert

Updated Observations of Clouds By MODIS for Global Model Assessment

This paper describes a new global dataset of cloud properties observed by MODIS relying on the current (collection 6.1) processing of MODIS data and produced to facilitate comparison with results from the MODIS observational proxy used in climate models. The dataset merges observations from the two MODIS instruments into a single netCDF file. Statistics (mean, standard deviation, and number of observations) are accumulated over daily and monthly timescales on an equal-angle grid for viewing and illumination geometry, cloud detection, cloud-top pressure, and cloud properties (optical thickness, effective particle size, and water path) partitioned by thermodynamic phase and an assessment as to whether the underlying observations come from fully or partly cloudy pixels. Similarly partitioned joint histograms are available for (1) optical thickness and cloud-top pressure, (2) optical thickness and particle size, and (3) cloud water path and particle size. Differences with standard data products, caveats for data use, and guidelines for comparison to the MODIS simulator are described.

Robert Pincus

Understanding Relationships Between Satellite, Model, and Ground-Based Surface Temperature Characterizations From Overcast to Clear Conditions in Support of Satellite Remote Sensing of Clouds and Radiation

Accurate and consistent global estimates of cloud coverage and their properties are fundamental to long-term Earth radiation budget (ERB) monitoring efforts like the Clouds and the Earth’s Radiant Energy System (CERES) project. Cloud detection algorithms often apply thresholding approaches to identify where clouds occur by comparing satellite-measured radiances with those that are expected under cloud-free conditions. In addition, once a cloud is detected, the derivation of cloud optical and microphysical properties also requires knowledge of the background radiances below the cloud. In the infrared, knowledge of the surface emissivity and the expected skin temperature under both cloudy and cloud-free conditions is needed. These traits are generally well known over the oceans. Over land, however, comparisons between satellite-derived land surface temperature (LST) with that characterized in numerical weather analyses reveal large differences in many parts of the world, often exceeding 5 K, which can lead to significant satellite cloud detection and cloud property retrieval errors. Furthermore, clouds have a dramatic influence on the LST, and therefore characterization of that model parameter also depends on the capability of the model to accurately resolve clouds. Thus, the LST characterized in models is, at times, a poor approximation for what would otherwise be observed, thereby impeding accurate satellite cloud retrievals. As a result, we seek to develop a more robust method for estimating the LST required for satellite cloud characterizations. This effort is accomplished through a combination of surface emission/air temperature relationship studies in all-sky conditions using ground measurement stations, along with deep neural network (DNN) estimates of expected LST under overcast and cloud-free conditions. We demonstrate that substituting DNN-predicted LST for that generated by numerical models can mitigate model-inherent diurnal dependencies and reduce overall bias and uncertainty relative to satellite/ground observations by 0.5–4 K and 0.5–2 K, respectively. It is expected that this work will lead to improved satellite cloud retrievals that enhance ERB monitoring efforts.

B Scarino

Novel Hourly-Resolved Global Cloud Property Composite from Operational Satellites Imagers

Numerous applications in satellite remote sensing of surface properties, atmospheric state, composition, and radiation require accurate knowledge of the location and characteristics of clouds. Operational satellite imager radiances are valuable for cloud detection and for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. This paper describes a new global high-resolution dataset of cloud properties made available for community use that is constructed from analyses of a constellation of meteorological satellite imagers. Data taken from Meteosat-8/9 and -11, Himawari-8/9, GOES-16, and -17/-18, Aqua, Terra, Suomi-NPP and NOAA-20 are processed and composited on a 3-km grid to provide hourly global coverage. A historical multi-year dataset is available to serve various needs including modeling challenges related to cloud evaluations and parameterizations. Near real-time data products are also currently available between 60N and 60S. Efforts are underway to operationalize polar orbiting satellite cloud detection methods for low-latency applications over polar regions. The cloud detection and retrieval algorithms have been developed over many years to support NASA weather and climate programs such as the Clouds and Earth’s Radiant Energy System (CERES). To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. A brief description of the methods highlighting the unique aspects of the SatCORPS data products will be presented along with information on their status and availability.

SatCORPS

Cloud cover determination in polar regions from satellite imagery

The objectives are to develop a suitable validation data set for evaluating the effectiveness of the International Satellite Cloud Climatology Project (ISCCP) algorithm for cloud retrieval in polar regions, to identify limitations of current procedures and to explore potential means to remedy them using textural classifiers, and to compare synoptic cloud data from model runs with observations. Toward the first goal, a polar data set consisting of visible, thermal, and passive microwave data was developed. The AVHRR and SMMR data were digitally merged to a polar stereographic projection with an effective pixel size of 5 sq km. With this data set, two unconventional methods of classifying the imagery for the analysis of polar clouds and surfaces were examined: one based on fuzzy sets theory and another based on a trained neural network. An algorithm for cloud detection was developed from an early test version of the ISCCP algorithm. This algorithm includes the identification of surface types with passive microwave, then temporal tests at each pixel location in the cloud detection phase. Cloud maps and clear sky radiance composites for 5 day periods are produced. Algorithm testing and validation was done with both actural AVHRR/SMMR data, and simulated imagery. From this point in the algorithm, groups of cloud pixels are examined for their spectral and textural characteristics, and a procedure is developed for the analysis of cloud patterns utilizing albedo, IR temperature, and texture. In a completion of earlier work, empirical analyses of arctic cloud cover were explored through manual interpretations of DMSP imagery and compared to U.S. Air Force 3D-nephanalysis. Comparisons of observed cloudiness from existing climatologies to patterns computed by the GISS climate model were also made.

Barry, R. G.

EPIC Cloud Observations with Oxygen Bands Over Snow, Ice and Sunglint Regions

Cloud detections over snow/ice surfaces and sunglint regions are challenging with passive remote sensing instrument due to lack of contract between cold/bright surfaces in the former and glint reflectance that could exceed that of cloudy sky in the latter. We developed novel cloud detection algorithms for these regions utilizing EPIC’s unique oxygen-bands. Over the snow and ice surfaces, a dynamic threshold scheme based on the ratios of two pairs of EPIC’s oxygen bands are developed to significantly improve the existing algorithm in these regions. Over the ocean, we improved the EPIC’s ocean cloud mask algorithm by implementing a dynamic reflectance threshold and supplemental A-band ratio test for cloud detection in the sun glint regions. The new ocean cloud mask algorithm improves the diurnal cycles of cloud fraction over ocean by reducing the artificial peak at local noon time in the glint center latitudes and reducing early morning and afternoon cloud fraction in most oceanic regions.

EPIC

Cloud Features Detected by MODIS But Not by CloudSat and CALIOP

The ability to characterize the global cloud cover from space has been greatly enhanced by the availability of MODIS, CloudSat, and CALIOP data. The three sensors provide good complementary information about clouds. In this study, we investigated unexpected observations of certain types of clouds apparent in the MODIS data but not detected by CloudSat and CALIOP. Several examples are presented and generally these undetected clouds are geometrically thin, low-level clouds. In particular, they are located in the Arctic region and have optical thicknesses of less than 14, top height altitudes of below 2.5 km, and layer thickness of less than 1 km. CloudSat may miss such low-level clouds because of its coarse vertical resolution of about 500 m and it has limited sensitivity near the surface. Unexpectedly, CALIOP with a much higher vertical resolution of 30 m also misses these clouds and this is due to the cloud s geometrically thin nature and surface proximity.

Chan, Mark Aaron

Improvements in Near-Terminator and Nocturnal Cloud Masks using Satellite Image Data over the Atmospheric Radiation Measurement Sites

Cloud detection using satellite measurements presents a big challenge near the terminator where the visible (VIS; 0.65 (micro)m) channel becomes less reliable and the reflected solar component of the solar infrared 3.9-(micro)m channel reaches very low signal-to-noise ratio levels. As a result, clouds are underestimated near the terminator and at night over land and ocean in previous Atmospheric Radiation Measurement (ARM) Program cloud retrievals using Geostationary Operational Environmental Satellite (GOES) imager data. Cloud detection near the terminator has always been a challenge. For example, comparisons between the CLAVR-x (Clouds from Advanced Very High Resolution Radiometer (AVHRR)) cloud coverage and Geoscience Laser Altimeter System (GLAS) measurements north of 60 degrees N indicate significant amounts of missing clouds from AVHRR because this part of the world was near the day/night terminator viewed by AVHRR. Comparisons between MODIS cloud products and GLAS at the same regions also shows the same difficulty in the MODIS cloud retrieval (Pavolonis and Heidinger 2005). Consistent detection of clouds at all times of day is needed to provide reliable cloud and radiation products for ARM and other research efforts involving the modeling of clouds and their interaction with the radiation budget. To minimize inconsistencies between daytime and nighttime retrievals, this paper develops an improved twilight and nighttime cloud mask using GOES-9, 10, and 12 imager data over the ARM sites and the continental United States (CONUS).

Detection

Measured electric field intensities near electric cloud discharges detected by the Kennedy Space Center's Lightning Detection and Ranging System, LDAR

For a summer thunderstorm, for which simultaneous, airborne electric field measurements and Lightning Detection and Ranging (LDAR) System data was available, measurements were coordinated to present a picture of the electric field intensity near cloud electrical discharges detected by the LDAR System. Radar precipitation echos from NOAA's 10 cm weather radar and measured airborne electric field intensities were superimposed on LDAR PPI plots to present a coordinated data picture of thunderstorm activity.

Poehler, H. A.

ISCCP cloud algorithm intercomparison

Research related to the International Satellite Cloud Climatology Project (ISCCP) began with a pilot study initiated in late 1981 to evaluate currently available cloud analysis algorithms. Other objectives of this study are related to a test of the effects of data volume compression schemes and the design of the operational algorithms for ISCCP. The present paper summarizes the pilot study by focusing on the most fundamental step of any cloud algorithm, that of cloud detection. An outline is provided of the objectives and limitations of the pilot study, and a description is given of the criteria used to design the operational analysis algorithm. Attention is given to the pilot study data set, a cloud detection intercomparison, a cloud analysis, and ISCCP cloud algorithm design.

Rossow, W. B.