Markovian Statistical Model of Cloud Optical Thickness. Part I: Theory and Examples
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
Engineering topics
Marshak, Alexander
Publications and source records attributed to Marshak, Alexander.
Near‐Cloud Aerosol Retrieval Using Machine Learning Techniques, and Implied Direct Radiative Effects
Abstract There is a lack of satellite‐based aerosol retrievals in the vicinity of low‐topped clouds, mainly because reflectance from aerosols is overwhelmed by three‐dimensional cloud radiative effects. To account for cloud radiative effects on reflectance observations, we develop a Convolutional Neural Network and retrieve aerosol optical depth (AOD) with 100–500 m horizontal resolution for all cloud‐free regions regardless of their distances to clouds. The retrieval uncertainty is 0.01 + 5%AOD, and the mean bias is approximately −2%. In an application to satellite observations, aerosol hygroscopic growth due to humidification near clouds enhances AOD by 100% in regions within 1 km of cloud edges. The humidification effect leads to an overall 55% increase in the clear‐sky aerosol direct radiative effect. Although this increase is based on a case study, it highlights the importance of aerosol retrievals in near‐cloud regions, and the need to incorporate the humidification effect in radiative forcing estimates.
54 ENVIRONMENTAL SCIENCES↗
EarthShine: Observing our world as an exoplanet from the surface of the Moon
NASA’s return to the Moon coincides with explosive growth in exoplanet discovery. Missions are being formulated to search for habitable planets orbiting other stars, making this the ideal time to deploy an instrument suite to the lunar surface to help us recognize a habitable exoplanet when we see it. We present EarthShine, a technically mature, three-instrument suite to observe the whole Earth from the Moon as an exoplanet proxy. EarthShine data will validate and improve models critical for designing missions to image and characterize exoplanets, thus informing observing strategies for flagship missions to directly image exoplanets. EarthShine will answer interconnected questions in Earth and lunar science, exoplanets, and astrobiology, related to the credo “follow the water.” EarthShine can take advantage of current NASA programs to conduct science from the Moon with low-cost, mature space hardware to reduce risk and assure success. Like the 1968 Apollo Earthrise image of our home planet, lonely in the black sky, the appeal of EarthShine to a multidisciplinary array of researchers in Earth Science, Planetary Science, and astrophysics will maximize both its scientific impact and its impact on the general public.
79 ASTRONOMY AND ASTROPHYSICS↗
The Shortwave Spectral Radiometer for Atmospheric Science: Capabilities and Applications from the ARM User Facility
Industry advances have greatly reduced the cost and size of ground-based shortwave (SW) sensors for the ultraviolet, visible, and near-infrared spectral ranges that make up the solar spectrum, while simultaneously increasing their ruggedness, reliability, and calibration accuracy needed for outdoor operation. These sensors and collocated meteorological equipment are an important part of the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility, which has supported parallel integrated measurements of atmospheric and surface properties for more than two decades at fixed and mobile sites around the world. The versatile capability of these ground-based measurements includes 1) rich spectral information required for retrieving cloud and aerosol microphysical properties, such as cloud phase, cloud particle size, and aerosol size distributions, and 2) high temporal resolution needed for capturing fast evolution of cloud microphysical properties in response to rapid changes in meteorological conditions. Here we describe examples of how ARM's spectral radiation measurements are being used to improve understanding of the complex processes governing microphysical, optical, and radiative properties of clouds and aerosol.
54 ENVIRONMENTAL SCIENCES↗
Study of shortwave spectra in fully 3D environment: synergy between scanning radars and spectral radiation measurements (final Report)
Overview of 3D atmospheric radiative transfer in cloudy atmosphere for Reports on Progress in Physics. We surveyed the 3D atmospheric radiative transfer literature over the past 50 years and identify three concurrent and intertwining themes: first, how to assess the damage (bias) caused by 3D effects in the operational 1D radiative transfer models? Second, how to mitigate this damage? Third, can we exploit 3D radiative transfer phenomena to invent new observation methods and technologies? Two equally important application areas for atmospheric radiative transfer in general, and 3D in particular, were identified: broadband radiative energy budget estimation and wavelength-specific optical remote sensing signal modeling. As illustrations, both satellite and ARM observations were highly used.
54 ENVIRONMENTAL SCIENCES↗
ARM Shortwave Spectral Radiometry Strategy Review Report
A meeting of experts in shortwave (SW) spectral measurements was held in February 2019 to discuss the current state of the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility instrumentation and the potential scientific impact of these measurements. Instrument mentors and users reported significant progress in hyperspectral measurement quality, with good-quality data sets now possible at several field campaigns and fixed sites. Ongoing filter-based measurement improvements, including addition of the 1.6-micron channel to the multifilter rotating shadowband radiometer (MFRSR) and lunar tracking mode of the Cimel sun photometers, were also lauded as exciting developments to improve retrievals of aerosol radiative properties and size distributions.
54 ENVIRONMENTAL SCIENCES↗
Analyzing Changes in the Complexity of Climate in the Last Four Decades Using MERRA-2 Radiation Data
The energy balance of the Earth is controlled by the shortwave and longwave radiation emitted to space. Changes in the thermodynamic state of the system over time afect climate and are noticeable when viewing the system as a whole. In this paper, we study the changes in the complexity of climate in the last four decades using data from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2). First, we study the complexity of the shortwave and longwave radiation felds independently using Approximate Entropy and Sample Entropy, observing that the rate of complexity change is faster for shortwave radiation. Then, we study the causality of those changes using Transfer Entropy to capture the non-linear dynamics of climate, showing that the changes are mainly driven by the variations in shortwave radiation. The observed behavior of climatic complexity could be explained by the changes in cloud amount, and we research that possibility by investigating its evolution from a complexity perspective using data from the International Satellite Cloud Climatology Project (ISCCP).
Delgado-Bonal, Alfonso↗
The impact of neglecting ice phase on cloud optical depth retrievals from AERONET cloud mode observations
Clouds present many challenges to climate modelling. To develop and verify the parameterisations needed to allow climate models to represent cloud structure and processes, there is a need for high-quality observations of cloud optical depth from locations around the world.Retrievals of cloud optical depth are obtainable from radiances measured by Aerosol Robotic Network (AERONET) radiometers in “cloud mode” using a two-wavelength retrieval method. However, the method is unable to detect cloud phase, and hence assumes that all of the cloud in a profile is liquid.This assumption has the potential to introduce errors into long-term statistics of retrieved optical depth for clouds that also contain ice.Using a set of idealised cloud profiles we find that, for optical depths above 20, the fractional error in retrieved optical depth is a linear function of the fraction of the optical depth that is due to the presence ofice cloud (“ice fraction”). Clouds that are entirely ice have positive errors with magnitudes of the order of 55 % to 70 %. We derive a simple linear equation that can be used as a correction at AERONET sites where ice fraction can be independently estimated. Using this linear equation, we estimate the magnitude of the error for a set of cloud profiles from five sites of the Atmospheric Radiation Measurement programme. The dataset contains separate retrievals of ice and liquid retrievals; hence ice fraction can be estimated. The magnitude of the error at each location was related to the relative frequencies of occurrence in thick frontal cloud at the mid-latitude sites and of deep convection at the tropical sites – that is, of deep cloud containing both ice and liquid particles. The long-term mean optical depth error at the five locations spans the range 2–4, which we show to be small enough to allow calculation of top-of-atmosphere flux to within 10 % and surface flux to about 15 %.
54 ENVIRONMENTAL SCIENCES↗
The Impact of Neglecting Ice Phase on Cloud Optical Depth Retrievals from AERONET Cloud Mode Observations
Clouds present many challenges to climate modelling. To develop and verify the parameterisations needed to allow climate models to represent cloud structure and processes, there is a need for high-quality observations of cloud optical depth from locations around the world. Retrievals of cloud optical depth are obtainable from radiances measured by Aerosol Robotic Network (AERONET) radiometers in “cloud mode” using a two-wavelength retrieval method. However, the method is unable to detect cloud phase, and hence assumes that all of the cloud in a profile is liquid. This assumption has the potential to introduce errors into long term statistics of retrieved optical depth for clouds that also contain ice. Using a set of idealized cloud profiles we find that, for optical depths above 20, the fractional error in retrieved optical depth is a linear function of the fraction of the optical depth that is due to the presence of ice cloud (“ice fraction”). Clouds that are entirely ice have positive errors with magnitudes of the order of 55% to 70 %. We derive a simple linear equation that can be used as a correction at AERONET sites where ice fraction can be independently estimated. Using this linear equation, we estimate the magnitude of the error for a set of cloud profiles from five sites of the Atmospheric Radiation Measurement programme. The dataset contains separate retrievals of ice and liquid retrievals; hence ice fraction can be estimated. The magnitude of the error at each location was related to the relative frequencies of occurrence in thick frontal cloud at the mid-latitude sites and of deep convection at the tropical sites – that is, of deep cloud containing both ice and liquid particles. The long-term mean optical depth error at the five locations spans the range 2– 4, which we show to be small enough to allow calculation of top-of-atmosphere flux to within 10% and surface flux to about 15 %.
Shonk, Jonathan K. P.↗
Cloud Edge Properties Measured by the ARM Shortwave Spectrometer Over Ocean and Land
In this paper, we use the spectrally invariant method to study the variability of cloud optical thickness (τ) and droplet effective radius (r eff ) in transition zones between the cloudy and clear-sky columns observed by Shortwave Array Spectroradiometer-Zenith at the Southern Great Plains Central Facility site (SGP C1) and during the Marine ARM GPCI Investigation of Clouds (MAGIC) field campaign. The spectrally invariant method approximates the spectra in the transition zone as a linear combination of definitely clear and definitely cloudy spectra. The slope and intercept of the linear relations characterize τ and r eff in the transition region, respectively. The radiative transfer model simulations show that that (i) the slope of the visible band is positively correlated with τ, while (ii) the intercept of the near-infrared band has a high negative correlation with r eff . We have analyzed 22 cloud edge cases from the SGP and MAGIC and found that from cloud to clear in the transitions, (a) the slopes of the visible band decrease, indicating the decrease of τ toward cloud edges, and (b) the intercepts of the near-infrared band show a much more significant increase at the SGP than from the MAGIC. The results from observed cases suggest that while τ decreases for all cases, the decrease in r eff is much more significant for cloud over land at the SGP site compared to the ocean counterpart during the MAGIC campaign.
54 ENVIRONMENTAL SCIENCES↗
Cloud Edge Properties Measured by the ARM Shortwave Spectrometer over Ocean and Land
We use the spectrally-invariant method to study the variability of cloud optical thickness () and droplet effective radius (reff) in transition zones between the cloudy and clear sky columns observed by Shortwave Array Spectroradiometer-Zenith (SASZe) at the Southern Great Plains Central Facility site (SGP C1) and during the Marine ARM GPCI Investigation of Clouds (MAGIC) field campaign. The spectrally-invariant method approximates the spectra in the transition zone as a linear combination of definitely clear and definitely cloudy spectra. The slope and intercept of the linear relations characterize and reff in the transition region, respectively. The radiative transfer model simulations show that that (i) the slope of the visible (VIS) band is positively correlated with while (ii) the intercept of the near-infrared (NIR) band has a high negative correlation with reff. We have analyzed 22 cloud edge cases from the SGP and MAGIC and found that from cloud to clear in the transitions (a) the slopes of the VIS band decrease, indicating the decrease of towards cloud edges; (b) the intercepts of the NIR band show a much more significant increase at the SGP than from the MAGIC. The results from observed cases suggest that while decreases for all cases, the decrease in reff is much more significant for cloud over land at the SGP site compared to the ocean counterpart during the MAGIC campaign.
Yang, Weidong↗
Approximate Entropy and Sample Entropy: A Comprehensive Tutorial
Approximate Entropy and Sample Entropy are two algorithms for determining the regularity of series of data based on the existence of patterns. Despite their similarities, the theoretical ideas behind those techniques are different but usually ignored. This paper aims to be a complete guideline of the theory and application of the algorithms, intended to explain their characteristics in detail to researchers from different fields. While initially developed for physiological applications, both algorithms have been used in other fields such as medicine, telecommunications, economics or Earth sciences. In this paper, we explain the theoretical aspects involving Information Theory and Chaos Theory, provide simple source codes for their computation, and illustrate the techniques with a step by step example of how to use the algorithms properly. This paper is not intended to be an exhaustive review of all previous applications of the algorithms but rather a comprehensive tutorial where no previous knowledge isrequired to understand the methodology.
Delgado-Bonal, Alfonso↗
Satellite Observations of Cloud-Related Variations in Aerosol Properties
This paper presents an overview of our efforts to characterize and better understandcloud-related changes in aerosol properties. These efforts primarily involved the statistical analysisof global or regional datasets of Moderate Resolution Imaging Spectroradiometer (MODIS) andCloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) aerosol and cloud observations. Theresults show that in oceanic regions, more than half of all aerosol measurements by passive satelliteinstruments come from near-cloud areas, where clouds and cloud-related processes may significantlymodify aerosol optical depth and particle size. Aerosol optical depth is also shown to increasesystematically with regional cloud amount throughout the Earth. In contrast, it is shown thateffective particle size can either increase or decrease with increasing cloud cover. In bimodal aerosolpopulations, the sign of changes depends on whether coarse mode or small mode aerosols are mostaffected by clouds. The results also indicate that over large parts of Earth, undetected cloud particlesare not the dominant reason for the satellite-observed changes with cloud amount, and that 3Dradiative processes contribute about 30% of the observed near-cloud changes. The findings underlinethe need for improving our ability to accurately measure aerosols near clouds.
aerosol; cloud; satellite↗
Implications of Whole-Disc DSCOVR EPIC Spectral Observations for Estimating Earth's Spectral Reflectivity Based on Low-Earth-Orbiting and Geostationary Observations
Earth's reflectivity is among the key parameters of climate research. National Aeronautics and Space Administration (NASA)'s Earth Polychromatic Imaging Camera (EPIC) onboard National Oceanic and Atmospheric Administration (NOAA)'s Deep Space Climate Observatory (DSCOVR) spacecraft provides spectral reflectance of the entire sunlit Earth in the near backscattering direction every 65 to 110 min. Unlike EPIC, sensors onboard the Earth Orbiting Satellites (EOS) sample reflectance over swaths at a specific local solar time (LST) or over a fixed area. Such intrinsic sampling limits result in an apparent Earth's reflectivity. We generated spectral reflectance over sampling areas using EPIC data. The difference between the EPIC and EOS estimates is an uncertainty in Earth's reflectivity. We developed an Earth Reflector Type Index (ERTI) to discriminate between major Earth atmosphere components: clouds, cloud-free ocean, bare and vegetated land. Temporal variations in Earth's reflectivity are mostly determined by clouds. The sampling area of EOS sensors may not be sufficient to represent cloud variability, resulting in biased estimates. Taking EPIC reflectivity as a reference, low-earth-orbiting-measurements at the sensor-specific LST tend to overestimate EPIC values by 0.8% to 8%. Biases in geostationary orbiting approximations due to a limited sampling area are between −0.7% and 12%. Analyses of ERTI-based Earth component reflectivity indicate that the disagreement between EPIC and EOS estimates depends on the sampling area, observation time and vary between −10% and 23%.
DSCOVR↗
Reduction in 317-780 nm Radiance Reflected from the Sunlit Earth During the Eclipse of 21 August 2017
Ten wavelength channels of calibrated radiance image data from the sunlit Earth are obtained every 65 min during Northern Hemisphere summer from the EPIC (Earth Polychromatic Imaging Camera) instrument on the DSCOVR (Deep Space Climate Observatory) satellite located near the Earth-Sun Lagrange 1 point (L1), about 1.5 million km from the Earth. The L1 location permitted seven observations of the Moon's shadow on the Earth for about 3 h during the 21 August 2017 eclipse. Two of the observations were timed to coincide with totality over Casper, Wyoming, and Columbia, Missouri. Since the solar irradiances within five channels (λi = 388, 443, 551, 680, and 780 nm) are not strongly absorbed in the atmosphere, they can be used for characterizing the eclipse reduction in reflected radiances for the Earth's sunlit face containing the eclipse shadow. Five channels (λi = 317:5, 325, 340, 688, and 764 nm) that are partially absorbed in the atmosphere give consistent reductions compared to the non-absorbed channels. This indicates that cloud reflectivities dominate the 317.5-780 nm radiances reflected back to space from the sunlit Earth's disk with a significant contribution from Rayleigh scattering for the shorter wavelengths. An estimated reduction of 10% was obtained for spectrally integrated radiance (387 to 781 nm) reflected from the sunlit Earth towards L1 for two sets of observations on 21 August 2017, while the shadow was in the vicinity of Casper, Wyoming (42.8666° N, 106.3131° W; centered on 17:44:50 UTC), and Columbia, Missouri (38.9517° N, 92.3341° W; centered on 18:14:50 UTC). In contrast, when non-eclipse days (20 and 23 August) are compared for each wavelength channel, the change in reflected light is much smaller (less than 1% for 443 nm compared to 9% (Casper) and 8% (Columbia) during the eclipse). Also measured was the ratio R(sub EN)(λi) of reflected radiance on adjacent non-eclipse days divided by radiances centered in the eclipse totality region with the same geometry for all 10 wavelength channels. The measured R(sub EN)(443 nm) was smaller for Columbia (169) than for Casper (935), because Columbia had more cloud cover than Casper. R(sub EN)(λi) forms a useful test of a 3-D radiative transfer models for an eclipse in the presence of optically thin clouds. Specific values measured at Casper with thin clouds are R(sub EN)(340 nm)=475, R(sub EN)(388 nm)=3500, REN(443 nm)=935, REN(551 nm)=5455, REN(680 nm)=220, and R(sub EN)(780 nm)=395. Some of the variability is caused by changing cloud amounts within the moving region of totality during the 2.7 min needed to measure all 10 wavelength channels.
DSCOVR↗