csphotsdalunarv3: Lunar Spectral Deconvolution Algorithm (SDA) Retrieval Version 4.1 Level 1.0
Spectral Deconvolution Algorithm (SDA) produces fine-mode and coarse-mode aerosol optical depths at a standard wavelength of 500 nm.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Spectral Deconvolution Algorithm (SDA) produces fine-mode and coarse-mode aerosol optical depths at a standard wavelength of 500 nm.
A first-of-a-kind, extended-term cloud aircraft campaign was conducted to obtain an in-situ statistical characterization of boundary-layer clouds needed to investigate cloud processes and refine retrieval algorithms. Coordinated by the Atmospheric Radiation Measurement (ARM) Aerial Facility (AAF), the Routine AAF Clouds with Low Optical Water Depths (CLOWD) Optical Radiative Observations (RACORO) field campaign operated over the ARM Southern Great Plains (SGP) site from 22 January to 30 June 2009, collecting 260 h of data during 59 research flights. A comprehensive payload aboard the Center for Interdisciplinary Remotely-Piloted Aircraft Studies (CIRPAS) Twin Otter aircraft measured cloud microphysics, solar and thermal radiation, aerosol properties, and atmospheric state parameters. Proximity to the SGP's extensive complement of surface measurements provides ancillary data that supports modeling studies and enables evaluating a variety of surface retrieval algorithms. The five-month duration enabled sampling a range of conditions associated with the seasonal transition from winter to summer. Although about two-thirds of the cloud flights occurred in May and June, boundary-layer cloud fields were sampled under a variety of environmental and aerosol conditions, with about 75% of the flights occurring in cumulus and stratocumulus. Preliminary analyses show how these data are being used to analyze cloud-aerosol relationships, determine the aerosol sizes that are responsible for nucleating cloud drops, characterize the horizontal variability of the cloud radiative impacts, and evaluate air-borne and surface-based cloud property retrievals. We discuss how conducting an extended-term campaign requires a simplified operating paradigm that is different from that used for typical, short-term, intensive aircraft field programs.
We consider an algorithm for processing lidar signals, which for a lidar path with constant qualitative aerosol characteristics (particle size distribution in each aerosol mode, complex refractive index of the particles) lets us obtain a concentration profile for the fine aerosol component without using additional a priori information. The algorithm was verified based on lidar data from the Institute of Physics (National Academy of Sciences of Belarus). The vertical volume concentration profile for fine particles obtained by our algorithm is quite consistent with the results of its independent retrieval, based on integrated processing of lidar and sun photometer data.
Research was conducted for 3-4 years to use ARM data to validate satellite cloud retrievals and help the development of improved techniques for remotely sensing clouds and radiative fluxes from space to complement the ARM surface measurement program. This final report summarizes the results and publications during the last 2 years of the studies. Since our last report covering the 2009 period, we published four papers that were accepted during the previous reporting period and revised and published a fifth one. Our efforts to intercalibrate selected channels on several polar orbiting and geostationary satellite imagers, which are funded in part by ASR, resulted in methods that were accepted as part of the international Global Space-based Intercalibration System (GSICS) calibration algorithms. We developed a new empirical method for correcting the spectral differences between comparable channels on various imagers that will be used to correct the calibrations of the satellite data used for ARM. We documented our cloud retrievals for the VAMOS Ocean-Cloud-Atmosphere-Land Study Regional Experiment (VOCALS-Rex; ARM participated with an AAF contribution) in context of the entire experiment. We used our VOCALS satellite data along with the aircraft measurements to better understand the relationships between aerosols and liquid water path in marine stratus clouds. We continued or efforts to validate and improve the satellite cloud retrievals for ARM and using ARM data to validate retrievals for other purposes.
Spectral Deconvolution Algorithm (SDA) produces fine-mode and coarse-mode aerosol optical depths at a standard wavelength of 500 nm.
This project focuses on cloud-radiation processes in a general three-dimensional cloud situation, with particular emphasis on cloud optical depth and effective particle size. The proposal has two main parts. Part one exploits the large number of new wavelengths offered by the Atmospheric Radiation Measurement (ARM) zenith-pointing ShortWave Spectrometer (SWS), to develop better retrievals not only of cloud optical depth but also of cloud particle size. We also take advantage of the SWS’ high sampling resolution to study the “twilight zone” around clouds where strong aerosol-cloud interactions are taking place. Part two involves continuing our cloud optical depth and cloud fraction retrieval research with ARM’s 2-channel narrow field-of-view radiometer and sunphotometer instrument by, first, analyzing its data from the ARM Mobile Facility deployments, and second, making our algorithms part of ARM’s operational data processing.
The Planetary Boundary Layer Height (PBLH) significantly impacts weather, climate, and air quality. Understanding the global diurnal variation of the PBLH is particularly challenging due to the necessity of extensive observations and suitable retrieval algorithms that can adapt to diverse thermodynamic and dynamic conditions. This study utilized data from the Cloud-Aerosol Transport System (CATS) to analyze the diurnal variation of PBLH in both continental and marine regions. By leveraging CATS data and a modified version of the Different Thermo-Dynamics Stability (DTDS) algorithm, along with machine learning denoising, the study determined the diurnal variation of the PBLH in continental mid-latitude and marine regions. The CATS DTDS-PBLH closely matches ground-based lidar and radiosonde measurements at the continental sites, with correlation coefficients above 0.6 and well-aligned diurnal variability, although slightly overestimated at nighttime. In contrast, PBLH at the marine site was consistently overestimated due to the viewing geometry of CATS and complex cloud structures. The study emphasizes the importance of integrating meteorological data with lidar signals for accurate and robust PBLH estimations, which are essential for effective boundary layer assessment from satellite observations.
The arctic region is rapidly evolving, and enhanced predictive capabilities, for both weather and climate, are urgently required. Therefore, the international community has formulated plans for the execution of an extended period of focused observations and modeling of the arctic environment, dubbed the “Year of Polar Prediction” or YOPP. The YOPP will feature “special observing periods” (SOPs), with the first occurring in the spring of 2018, and a second during the late summer and early fall. This project deploys additional U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) facility resources to Oliktok Point, Alaska during the second three-month special observing period (1 July 2018-30 September 2018). These resources include additional radiosondes (1 more per day), ARM-operated unmanned aircraft (DH2) and ARM-operated tethered balloon systems (TBS). These instruments will conduct routine profiling activities over the course of the SOP to obtain measurements of atmospheric thermodynamic structure, cloud and precipitation properties, and aerosol properties, enhancing the measurements obtained from the third ARM Mobile Facility at Oliktok Point (AMF3). We anticipate that these measurements will be used for a variety of purposes, including: 1) to conduct detailed studies of arctic cloud and aerosol processes; 2) to inform YOPP modeling efforts through real-time availability for assimilation into operational and research analysis products; 3) to evaluate and improve retrieval algorithms involving ARM remote sensors; 4) to evaluate and improve a variety of modeling tools being used to forecast arctic weather and climate; and 5) to initialize and evaluate simulations associated with a potential arctic large-eddy simulation (LES) framework similar to the ongoing LES ARM Symbiotic Simulation and Observation (LASSO) project.
The arctic region is rapidly evolving, and enhanced predictive capabilities, for both weather and climate, are urgently required. Therefore, the international community is executing an extended period of focused observations and modeling of the arctic environment, dubbed the Year of Polar Prediction or YOPP. The YOPP featured two special observing periods (SOPs) (and will feature a third in 2020). The first of the completed SOPs occurred in the spring of 2018, and the second during the late summer and early fall of 2018. Here, we summarize the deployment of additional U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility resources to the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska during the second three-month SOP (1 July 2018–30 September 2018). This deployment, named POPEYE (Profiling at Oliktok Point to Enhance YOPP Experiments), included the launching of extra radiosondes (one more per day) and operation of ARM-operated unmanned aircraft (DataHawk 2s) and ARM-operated tethered balloons. These instruments conducted routine profiling activities over the course of the special observing period to obtain measurements of atmospheric thermodynamic structure, cloud and precipitation properties, and aerosol properties. These measurements are expected to be used for a variety of purposes, including: 1) to conduct detailed studies of arctic cloud and aerosol processes; 2) to inform YOPP modeling efforts through real-time availability for assimilation into operational and research analysis products; 3) to evaluate and improve retrieval algorithms involving ARM remote sensors; 4) to evaluate and improve a variety of modeling tools being used to forecast arctic weather and climate; and 5) to initialize and evaluate simulations associated with a potential arctic large-eddy (LES) simulation framework similar to the ongoing LES ARM Symbiotic Simulation and Observation (LASSO) project.
The objective of this project is to improve the simulation and predictability of mixed-phase clouds and aerosol interactions in the Community Earth System Model (CESM) through comparisons with the DOE ARM observations. There are four major goals of the proposed study: (1) Improve the representation of ice microphysical processes in mixed-phase clouds; (2) Develop a long-term multi-sensor mixed-phase cloud dataset; (3) Test the performance of improved ice microphysics in CESM-CAM5 with the ARM data; and (4) Examine mixed-phase cloud microphysics-aerosol-dynamics-radiation interactions in CESM-CAM5. In this project, we have (1) Improved the representation of ice microphysical processes in mixed-phase clouds that include ice nucleation, ice depositional growth through the Wegener–Bergeron–Findeisen (WBF) process, feedbacks between cloud microphysics, dynamics and radiation, and provides links to aerosol properties in the Community Earth System Model (CESM)-Community Atmosphere Model version 5 (CAM5); (2) Developed a long-term multi-sensor mixed-phase cloud dataset. The mixed-phase cloud retrieval algorithms are improved by refining the phase determinations and ice number concentration retrievals. A multi-year mixed-phase cloud observation dataset (1999-2004; October 2013-February 2017) is regenerated at the ARM Barrow site with the improved algorithms. The dataset has been used in the global model evaluation to improve the model parameterizations; (3) Tested the performance of improved ice microphysics in CESM-CAM5 with the ARM data. CESM-CAM5 is run in the DOE Cloud-Associated Parameterizations Testbed (CAPT) and in the single-column model (SCM) mode to facilitate comparison with ARM observations. Multi-year CAPT simulations of seasonal variations of cloud microphysical properties, cloud liquid water path (LWP) and ice water path (IWP), cloud longwave and shortwave forcings, cloud occurrence frequency are evaluated against the ARM multi-sensor mixed-phase cloud retrievals; and (4) Examined mixed-phase cloud microphysics-aerosol-dynamics-radiation interactions in CESM-CAM5 that include the impacts of different ice nucleation mechanisms, sensitivity to dust IN concentration, treatment of the WBF process on mixed-phase cloud properties. Aerosol effect on mixed-phase clouds through the liquid phase (droplet activation) and ice phase processes (e.g., the glaciation indirect effect) is investigated.
Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.
The Planetary Boundary Layer height (PBLH) is essential for studying PBL and ocean-atmosphere interactions. Marine PBL is usually defined to include a mixed layer (ML) and a capping inversion layer. The ML height (MLH) estimated from the measurements of aerosol backscatter by a lidar was usually compared with PBLH determined from radiosondes/dropsondes in the past, as the PBLH is usually similar to MLH in nature. However, PBLH can be much greater than MLH for decoupled PBL. Here, in this study, we evaluate the retrieved MLH from an airborne lidar (HSRL-2) by utilizing 506 co-located dropsondes during the ACTIVATE field campaign over the Northwest Atlantic from 2020 to 2022. First, we define and determine the MLH and PBLH from the temperature and humidity profiles of each dropsonde, and find that the MLH values from HSRL-2 and dropsondes agree well with each other, with a coefficient of determination of 0.66 and median difference of 18 m. In contrast, the HSRL-2 MLH data do not correspond to dropsonde-derived PBLH, with a median difference of -47 m. Therefore, we modify the current operational and automated HSRL-2 wavelet-based algorithm for PBLH retrieval, decreasing the median difference significantly to -8 m. Further data analysis indicates that these conclusions remain the same for cases with higher or lower cloud fractions, and for decoupled PBLs. These results demonstrate the potential of using HSRL-2 aerosol backscatter data to estimate both marine MLH and PBLH and suggest that lidar-derived MLH should be compared with radiosonde/dropsonde-determined MLH (not PBLH) in general.
Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.
We inter-compare the above-cloud aerosol optical depth (ACAOD) of biomass burning plumes retrieved from different A-train sensors, i.e., MODIS, CALIOP, POLDER, and OMI. These sensors have shown independent capabilities to detect and retrieve aerosol loading above marine boundary layer clouds--a kind of situation often found over the Southeast Atlantic Ocean during dry burning season. A systematic one-to-one comparison reveals that, in general, all passive sensors and CALIOP-based research methods derive comparable ACAOD with differences mostly within 0.2 over homogeneous cloud fields. The 532-nm ACAOD retrieved by CALIOP operational algorithm is largely underestimated; however, it’s 1064-nm AOD when converted to 500 nm shows closer agreement to the passive sensors. Given the different types of sensor measurements processed with different algorithms, the close agreement between them is encouraging. Due to lack of adequate direct measurements above cloud, the validation of satellite-based ACAOD retrievals remains an open challenge. The inter-satellite comparison, however, can be useful for the relative evaluation and consistency check.
Abstract Warm clouds strongly affect Earth's energy budget but remain imperfectly represented in climate models, partly due to the complexity and covariability of relevant processes influencing warm rain. This work presents a detailed analysis of different factors affecting rain rate peak intensity (RR) in continental warm clouds. Clouds were identified with vertically pointing radar and lidar observations and categorized via a temperature‐based cloud type classification algorithm from which warm clouds were isolated. Observations and retrievals of liquid water path (LWP), cloud condensation nuclei concentration (N CCN ), cloud depth, and cloud duration of more than 3,000 separate warm clouds sampled during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign are analyzed in this work. Multiple linear regression (MLR) and random forest (RF) models are applied to assess the relative impact of these variables on RR. Overall, RR tends to increase as cloud depth, LWP, and cloud duration increase, or N CCN decreases. Cloud depth affects RR the most while N CCN impacts it the least. When considering over 170 warm clouds observed at least 1 hr in which in‐cloud turbulence is retrieved, the effect of N CCN on RR remains most likely suppressive, but it is not significant at a 75% level for MLR and is highly uncertain for RF. The impact of in‐cloud turbulence depends on the moment and location it is sampled. Cloud base turbulence around the time of RR suppresses RR, while cloud top turbulence effects are inconclusive. Possible difficulties in isolating robust CCN and turbulence effects on RR are discussed.
Abstract. Cloud droplet number concentration (Nd) is crucial for understanding aerosol–cloud interactions (ACI) and associated radiative effects. We present evaluations of four ground-based Nd retrievals based on comprehensive datasets from the Atmospheric Radiation Measurement (ARM) Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. The Nd retrieval methods use ARM ENA observatory ground-based remote sensing observations from a micropulse lidar, Raman lidar, cloud radar, and the ARM NDROP (Droplet Number Concentration) value-added product (VAP), all of which also retrieve cloud effective radius (re). The retrievals are compared against aircraft measurements from the fast cloud droplet probe (FCDP) and the cloud and aerosol spectrometer (CAS) obtained from low-level marine boundary layer clouds on 12 flight days during summer and winter seasons. Additionally, the in situ measurements are used to validate the assumptions and characterizations used in the retrieval algorithms. Statistical comparisons of the probability distribution function (PDF) of the Nd and cloud re retrievals with aircraft measurements demonstrate that these retrievals align well with in situ measurements for overcast clouds, but they may substantially differ for broken clouds or clouds with low liquid water path (LWP). The retrievals are applied to 4 years of ground-based remote sensing measurements of overcast marine boundary layer clouds at the ARM ENA observatory to find that Nd (re) values exhibit seasonal variations, with higher (lower) values during the summer season and lower (higher) values during the winter season. The ensemble of various retrievals using different measurements and retrieval algorithms such as those in this paper can help to quantify Nd retrieval uncertainties and identify reliable Nd retrieval scenarios. Of the retrieval methods, we recommend using the micropulse lidar-based method. This method has good agreement with in situ measurements, less sensitivity to issues arising from precipitation and low cloud LWP and/or optical depth, and broad applicability by functioning for both daytime and nighttime conditions.
Cloud droplet number concentration (N d ) is crucial for understanding aerosol-cloud interactions (ACI) and associated radiative effects. We present evaluations of four ground-based N d retrievals based on comprehensive datasets from the Atmospheric Radiation Measurements (ARM) Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. The N d retrieval methods use ARM ENA observatory ground-based remote sensing observations from a Micropulse lidar, Raman lidar, cloud radar, and the ARM NDROP Value-added Product (VAP), all of which also retrieve cloud effective radius (r e ). The retrievals are compared against aircraft measurements from the Fast-Cloud Droplet Probe (FCDP) and the Cloud and Aerosol Spectrometer (CAS) obtained from low-level marine boundary layer clouds on 12 flight days during summer and winter seasons. Additionally, the in situ measurements are used to validate the assumptions and characterizations used in the retrieval algorithms. Statistical comparisons of the probability distribution function (PDF) of the N d and cloud r e retrievals with aircraft measurements demonstrate that these retrievals align well with in situ measurements for overcast clouds, but they may substantially differ for broken clouds or clouds with low liquid water path (LWP). The retrievals are applied to four years of ground-based remote sensing measurements of overcast marine boundary layer clouds at the ARM ENA observatory to find that N d (r e ) values exhibit seasonal variations, with higher (lower) values during the summer season and lower (higher) values during the winter season. The ensemble of various retrievals using different measurements and retrieval algorithms such as those in this paper can help to quantify N d retrieval uncertainties and identify reliable N d retrieval scenarios. Of the retrieval methods, we recommend using the using the Micropulse lidar-based method given its good agreement with in situ measurements, it has less sensitivity to issues arising from precipitation and low cloud LWP/optical depth, and it has broad applicability by functioning for both day and nighttime conditions.
The Department of Energy Atmospheric Radiation Measurement (ARM) Program is a climate research user facility operating stationary ground sites that provide long-term measurements of climate relevant properties, mobile ground- and ship-based facilities to conduct shorter field campaigns (6-12 months), and the ARM Aerial Facility (AAF). The airborne observations acquired by the AAF enhance the surface-based ARM measurements by providing high-resolution in-situ measurements for process understanding, retrieval-algorithm development, and model evaluation that are not possible using ground- or satellite-based techniques. Several ARM aerial efforts were consolidated into the AAF in 2006. With the exception of a small aircraft used for routine measurements of aerosols and carbon cycle gases, AAF at the time had no dedicated aircraft and only a small number of instruments at its disposal. In this "virtual hangar" mode, AAF successfully carried out several missions contracting with organizations and investigators who provided their research aircraft and instrumentation. In 2009, AAF started managing operations of the Battelle-owned Gulfstream I (G-1) large twin-turboprop research aircraft. Furthermore, the American Recovery and Reinvestment Act of 2009 provided funding for the procurement of over twenty new instruments to be used aboard the G-1 and other AAF virtual-hangar aircraft. AAF now executes missions in the virtual- and real-hangar mode producing freely available datasets for studying aerosol, cloud, and radiative processes in the atmosphere. AAF is also engaged in the maturation and testing of newly developed airborne sensors to help foster the next generation of airborne instruments.