Search NASA⌕ Search

Engineering topics

Jackson, Robert C.

Publications and source records attributed to Jackson, Robert C..

OpenCRUMS USA: An Open Machine Learning Framework for Characterizing Variability in Aerosol Reanalysis Data

Advances in artificial intelligence (AI) have called for exploring how these techniques can be used for exploring patterns in large climate datasets. To that regard, the U.S. Department of Energy AI for Earth System Predictability (AI4ESP) supported a pilot initiative called the Open Classification of Regimes in the Southeast USA (OpenCRUMS USA) project to explore how AI can be used to characterize modes of spatial variability in large climate datasets. For this study, we focus on comparing two methods for characterizing the modes of spatial variability of surface aerosol concentration over the Houston region: empirical orthogonal functions (EOFs) and layerwise relevance propagation (LRP) applied to a convolutional neural network (CNN) classifier. We show that EOF analysis typically attributes spatial variability modes that span all of southeast Texas, prohibiting the attribution of spatial variability to localized regions. However, using LRP on the CNN classifier resolves the explanatory parameters at a finer spatial resolution than EOFs. This allows for the attribution of the spatial variability of surface aerosols to local regions of organic carbon which was not possible using EOFs. In addition, the LRP analysis also suggests that synoptic-scale transport of dust is most prevalent during anticyclonic and pretrough synoptic conditions as categorized by self-organizing maps.

54 ENVIRONMENTAL SCIENCES↗

Extracted Radar Columns and In Situ Sensors (RadCLss) Value-Added Product Report

In order to validate precipitation, in 2010 the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility procured 3- and 5-cm wavelength radars for documenting the macrophysical, microphysical, and dynamical structure of precipitating systems. To maximize the scientific impact, ARM supported the development of an application chain to correct for various phenomena in order to retrieve the “point” values of moments of the radar spectrum and polarimetric measurements. In estimation from ARM radars, a workflow was created to directly compare radar “point” values with various in situ observations at the surface.

54 ENVIRONMENTAL SCIENCES↗

tobac v1.5: introducing fast 3D tracking, splits and mergers, and other enhancements for identifying and analysing meteorological phenomena

There is a continuously increasing need for reliable feature detection and tracking tools based on objective analysis principles for use with meteorological data. Many tools have been developed over the previous 2 decades that attempt to address this need but most have limitations on the type of data they can be used with, feature computational and/or memory expenses that make them unwieldy with larger datasets, or require some form of data reduction prior to use that limits the tool's utility. The Tracking and Object-Based Analysis of Clouds (tobac) Python package is a modular, open-source tool that improves on the overall generality and utility of past tools. A number of scientific improvements (three spatial dimensions, splits and mergers of features, an internal spectral filtering tool) and procedural enhancements (increased computational efficiency, internal regridding of data, and treatments for periodic boundary conditions) have been included in tobac as a part of the tobac v1.5 update. These improvements have made tobac one of the most robust, powerful, and flexible identification and tracking tools in our field to date and expand its potential use in other fields. Future plans for tobac v2 are also discussed.

54 ENVIRONMENTAL SCIENCES↗

Single-Particle Soot Photometer (SP2) Black Carbon Number and Mass Concentrations

The single-particle soot photometer (SP2) records particle-by-particle measurements of the intensity of both the scattering signature and incandescence signature of particles that enter its laser beam. These intensities are then used to calculate refractory black carbon (rBC) masses and particle diameters. In previous U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility field campaigns, the SP2 data was difficult to process because the manufacturer-supplied code was not scalable to distributed machines, making it unusable for the large amounts of data output by the SP2. This prohibited the SP2 from becoming an operational instrument for ARM. Therefore, PySP2 was developed to solve this issue and enable SP2 to be an operational instrument for ARM. This technical document summarizes the test data sets from the ARM North Slope of Alaska (NSA) site and the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) field campaign that were used to develop and test PySP2.

54 ENVIRONMENTAL SCIENCES↗

ARMing the Edge: Designing Edge Computing–Capable Machine Learning Algorithms to Target ARM Doppler Lidar Processing

Abstract There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. However, due to bandwidth and storage constraints, the Doppler spectra are not routinely stored. This calls for the automation of cloud and rain detection in ARM Doppler lidar data so that the spectral data in clouds can be selectively saved and further analyzed. During the ARMing the Edge field experiment, a Waggle node capable of performing machine learning applications in situ was deployed at the ARM SGP site for this purpose. In this paper, we develop and test four algorithms for the Waggle node to automatically classify ARM Doppler lidar data. We demonstrate that supervised learning using a ResNet50-based classifier will classify 97.6% of the clear-air images and 94.7% of cloudy images correctly, outperforming traditional peak detection methods. We also show that a convolutional autoencoder paired with k -means clustering identifies 10 clusters in the ARM Doppler lidar data. Three clusters correspond to mostly clear conditions with scattered high clouds, and seven others correspond to cloudy conditions with varying cloud-base heights.

54 ENVIRONMENTAL SCIENCES↗

SAIL Field Campaign X-Band Precipitation Radar Surface Quantitative Precipitation Estimation (SQUIRE) Value-Added Product Report

In 2010, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility procured 3- and 5-cm wavelength radars for documenting the macrophysical, microphysical, and dynamical structure of precipitating systems. In order to maximize the scientific impact, ARM supported the development of an application chain to correct for various phenomena in order to retrieve the lowest retrieved value on a Cartesian grid. This report details the motivation, science, and progress to date, as well as charting a path forward.

54 ENVIRONMENTAL SCIENCES↗

Optimizing cloud motion estimation on the edge with phase correlation and optical flow

Abstract. Phase correlation (PC) is a well-known method for estimating cloud motion vectors (CMVs) from infrared and visible spectrum images. Commonly, phase shift is computed in the small blocks of the images using the fast Fourier transform. In this study, we investigate the performance and the stability of the blockwise PC method by changing the block size, the frame interval, and combinations of red, green, and blue (RGB) channels from the total sky imager (TSI) at the United States Atmospheric Radiation Measurement user facility's Southern Great Plains site. We find that shorter frame intervals, followed by larger block sizes, are responsible for stable estimates of the CMV, as suggested by the higher autocorrelations. The choice of RGB channels has a limited effect on the quality of CMVs, and the red and the grayscale images are marginally more reliable than the other combinations during rapidly evolving low-level clouds. The stability of CMVs was tested at different image resolutions with an implementation of the optimized algorithm on the Sage cyberinfrastructure test bed. We find that doubling the frame rate outperforms quadrupling the image resolution in achieving CMV stability. The correlations of CMVs with the wind data are significant in the range of 0.38–0.59 with a 95 % confidence interval, despite the uncertainties and limitations of both datasets. A comparison of the PC method with constructed data and the optical flow method suggests that the post-processing of the vector field has a significant effect on the quality of the CMV. The raindrop-contaminated images can be identified by the rotation of the TSI mirror in the motion field. The results of this study are critical to optimizing algorithms for edge-computing sensor systems.

54 ENVIRONMENTAL SCIENCES↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

Corrected Moments in Antenna Coordinates (CMAC) X-SAPR Technical Report

In 2010 the Atmospheric Radiation Measurement user facility procured 3- and 5-cm wavelength radars for documenting the macrophysical, microphysical, and dynamical structure of precipitating systems. In order to maximize the scientific impact, the program supported the development of an application chain to correct for various phenomena in order to retrieve the “point” values of moments of the radar spectrum and polarimetric measurements. This report details the motivation, science, and progress to date as well as charting a path forward.

54 ENVIRONMENTAL SCIENCES↗

The Earth Model Column Collaboratory (EMC 2 ) v1.1: an open-source ground-based lidar and radar instrument simulator and subcolumn generator for large-scale models

Abstract. Climate models are essential for our comprehensive understanding of Earth's atmosphere and can provide critical insights on future changes decades ahead. Because of these critical roles, today's climate models are continuously being developed and evaluated using constraining observations and measurements obtained by satellites, airborne, and ground-based instruments. Instrument simulators can provide a bridge between the measured or retrieved quantities and their sampling in models and field observations while considering instrument sensitivity limitations. Here we present the Earth Model Column Collaboratory (EMC2), an open-source ground-based lidar and radar instrument simulator and subcolumn generator, specifically designed for large-scale models, in particular climate models, but also applicable to high-resolution model output. EMC2 provides a flexible framework enabling direct comparison of model output with ground-based observations, including generation of subcolumns that may statistically represent finer model spatial resolutions. In addition, EMC2 emulates ground-based (and air- or space-borne) measurements while remaining faithful to large-scale models' physical assumptions implemented in their cloud or radiation schemes. The simulator uses either single particle or bulk particle size distribution lookup tables, depending on the selected scheme approach, to perform the forward calculations. To facilitate model evaluation, EMC2 also includes three hydrometeor classification methods, namely, radar- and sounding-based cloud and precipitation detection and classification, lidar-based phase classification, and a Cloud Feedback Model Intercomparison Project Observational Simulator Package (COSP) lidar simulator emulator. The software is written in Python, is easy to use, and can be straightforwardly customized for different models, radars, and lidars. Following the description of the logic, functionality, features, and software structure of EMC2, we present a case study of highly supercooled mixed-phase cloud based on measurements from the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE). We compare observations with the application of EMC2 to outputs from four configurations of the NASA Goddard Institute for Space Studies (GISS) climate model (ModelE3) in single-column model (SCM) mode and from a large-eddy simulation (LES) model. We show that two of the four ModelE3 configurations can form and maintain highly supercooled precipitating cloud for several hours, consistent with observations and LES. While our focus is on one of these ModelE3 configurations, which performed slightly better in this case study, both of these configurations and the LES results post-processed with EMC2 generally provide reasonable agreement with observed lidar and radar variables. As briefly demonstrated here, EMC2 can provide a lightweight and flexible framework for comparing the results of both large-scale and high-resolution models directly with observations, with relatively little overhead and multiple options for achieving consistency with model microphysical or radiation scheme physics.

58 GEOSCIENCES↗

UNRAVEL: A Robust Modular Velocity Dealiasing Technique for Doppler Radar

Unfold Radar Velocity (UNRAVEL) is an open-source modular Doppler velocity dealiasing algorithm for weather radars. UNRAVEL is an algorithm that does not need external reference velocity data, making it easily applicable. The proposed algorithm includes 11 core modules and 2 dealiasing strategies. UNRAVEL is an iterative algorithm. The goal is to build the dealiasing results starting with the strictest possible continuity tests in azimuth and range and, after each step, relaxing the parameters to include more results from a progressively growing number of reference points. UNRAVEL also has modules that perform 3D continuity checks. Thanks to this modular design, the number of dealiasing strategies can be expanded in order to optimize the dealiasing results. While the first driver dealiases Doppler velocity from each tilt independently from one another, the second driver also performs a three-dimensional continuity check of the velocity using successive elevations. The proposed dealiasing algorithm is tested using severe weather data from an S-band Doppler radar that have been aliased to mimic aliased radial velocity patterns that would be observed by a C-band Doppler radar. Artificially aliasing S-band data permits creation of a reference to which the performance of various dealiasing techniques can be compared. Comparisons show that UNRAVEL consistently outperforms other established dealiasing algorithms for the test period selected in this work.

47 OTHER INSTRUMENTATION↗

Use of polarimetric radar measurements to constrain simulated convective cell evolution: a pilot study with Lagrangian tracking

Abstract. To probe the potential value of a radar-driven field campaign to constrain simulation of isolated convection subject to a strong aerosol perturbation, convective cells observed by the operational KHGX weather radar in the vicinity of Houston, Texas, are examined individually and statistically. Cells observed in a single case study of onshore flow conditions during July 2013 are first examined and compared with cells in a regional model simulation. Observed and simulated cells are objectively identified and tracked from observed or calculated positive specific differential phase ( K DP ) above the melting level, which is related to the presence of supercooled liquid water. Several observed and simulated cells are subjectively selected for further examination. Below the melting level, we compare sequential cross sections of retrieved and simulated raindrop size distribution parameters. Above the melting level, we examine time series of K DP and radar differential reflectivity ( Z DR ) statistics from observations and calculated from simulated supercooled rain properties, alongside simulated vertical wind and supercooled rain mixing ratio statistics. Results indicate that the operational weather radar measurements offer multiple constraints on the properties of simulated convective cells, with substantial value added from derived K DP and retrieved rain properties. The value of collocated three-dimensional lightning mapping array measurements, which are relatively rare in the continental US, supports the choice of Houston as a suitable location for future field studies to improve the simulation and understanding of convective updraft physics. However, rapid evolution of cells between routine volume scans motivates consideration of adaptive scan strategies or radar imaging technologies to amend operational weather radar capabilities. A 3-year climatology of isolated cell tracks, prepared using a more efficient algorithm, yields additional relevant information. Isolated cells are found within the KHGX domain on roughly 40 % of days year-round, with greatest concentration in the northwest quadrant, but roughly 5-fold more cells occur during June through September. During this enhanced occurrence period, the cells initiate following a strong diurnal cycle that peaks in the early afternoon, typically follow a south-to-north flow, and dissipate within 1 h, consistent with the case study examples. Statistics indicate that ~  150 isolated cells initiate and dissipate within 70 km of the KHGX radar during the enhanced occurrence period annually, and roughly 10 times as many within 200 km, suitable for multi-instrument Lagrangian observation strategies. In addition to ancillary meteorological and aerosol measurements, robust vertical wind speed retrievals would add substantial value to a radar-driven field campaign.

54 ENVIRONMENTAL SCIENCES↗

Use of Polarimetric Radar Measurements to Constrain Simulated Convective Cell Evolution: A Pilot Study with Lagrangian Tracking

To probe the potential value of a radar-driven field campaign to constrain simulation of isolated convection subject to a strong aerosol perturbation, convective cells observed by the operational KHGX weather radar in the vicinity of Houston, Texas, are examined individually and statistically. Cells observed in a single case study of onshore flow conditions during July 2013 are first examined and compared with cells in a regional model simulation. Observed and simulated cells are objectively identified and tracked from observed or calculated positive specific differential phase (K(sub DP)) above the melting level, which is related to the presence of supercooled liquid water. Several observed and simulated cells are subjectively selected for further examination. Below the melting level, we compare sequential cross sections of retrieved and simulated raindrop size distribution parameters. Above the melting level, we examine time series of KDP and radar differential reflectivity (Z(sub DR)) statistics from observations and calculated from simulated supercooled rain properties, alongside simulated vertical wind and supercooled rain mixing ratio statistics. Results indicate that the operational weather radar measurements offer multiple constraints on the properties of simulated convective cells, with substantial value added from derived K(sub DP) and retrieved rain properties. The value of collocated three-dimensional lightning mapping array measurements, which are relatively rare in the continental US, supports the choice of Houston as a suitable location for future field studies to improve the simulation and understanding of convective updraft physics. However, rapid evolution of cells between routine volume scans motivates consideration of adaptive scan strategies or radar imaging technologies to amend operational weather radar capabilities. A 3-year climatology of isolated cell tracks, prepared using a more efficient algorithm, yields additional relevant information. Isolated cells are found within the KHGX domain on roughly 40 % of days year-round, with greatest concentration in the northwest quadrant, but roughly 5-fold more cells occur during June through September. During this enhanced occurrence period, the cells initiate following a strong diurnal cycle that peaks in the early afternoon, typically follow a south-to-north flow, and dissipate within 1 h, consistent with the case study examples. Statistics indicate that ∼ 150 isolated cells initiate and dissipate within 70 km of the KHGX radar during the enhanced occurrence period annually, and roughly 10 times as many within 200 km, suitable for multi-instrument Lagrangian observation strategies. In addition to ancillary meteorological and aerosol measurements, robust vertical wind speed retrievals would add substantial value to a radar-driven field campaign.

Fridlind, Ann M.↗

A 17 year climatology of the macrophysical properties of convection in Darwin

Abstract. The validation of convective processes in global climate models (GCMs) could benefit from the use of large datasets that provide long-term climatologies of the spatial statistics of convection. To that regard, echo top heights (ETHs), convective areas, and frequencies of mesoscale convective systems (MCSs) from 17 years of data from a C-band polarization (CPOL) radar are analyzed in varying phases of the Madden–Julian Oscillation (MJO) and northern Australian monsoon in order to provide ample validation statistics for GCM validation. The ETHs calculated using velocity texture and reflectivity provide similar results, showing that the ETHs are insensitive to various techniques that can be used. Retrieved ETHs are correlated with those from cloud top heights retrieved by Multifunctional Transport Satellites (MTSATs), showing that the ETHs capture the relative variability in cloud top heights over seasonal scales. Bimodal distributions of ETH, likely attributable to the cumulus congestus clouds and mature stages of convection, are more commonly observed when the active phase of the MJO is over Australia due to greater mid-level moisture during the active phase of the MJO. The presence of a convectively stable layer at around 5 km altitude over Darwin inhibiting convection past this level can explain the position of the modes at around 2–4 km and 7–9 km. Larger cells were observed during break conditions compared to monsoon conditions, but only during the inactive phase of the MJO. The spatial distributions show that Hector, a deep convective system that occurs almost daily during the wet season over the Tiwi Islands, and sea-breeze convergence lines are likely more common in break conditions. Oceanic MCSs are more common during the night over Darwin. Convective areas were generally smaller and MCSs more frequent during active monsoon conditions. In general, the MJO is a greater control on the ETHs in the deep convective mode observed over Darwin, with higher distributions of ETH when the MJO is active over Darwin.

54 ENVIRONMENTAL SCIENCES↗

The Dependence of Cirrus Gamma Size Distributions Expressed as Volumes in N(sub 0)-Lambda-Mu Phase Space and Bulk Cloud Properties on Environmental Conditions: Results from the Small Ice Particles in Cirrus Experiment (SPARTICUS)

The variability of cirrus ice microphysical properties is investigated using observations obtained during the Small Particles in Cirrus (SPARTICUS) campaign. An existing approach that represents a size distribution (SD) as a single gamma function using an ellipsoid of equally realizable solutions in (N(sub 0), lambda, mu) phase space is modified to automatically identify multiple modes in SDs and characterize each mode by such an ellipsoid. The modified approach is applied to ice crystals with maximum dimension D greater than15 micrometers collected by the 2-D stereo and 2-D precipitation probes on the Stratton Park Engineering Company Learjet. The dependencies of N(sub 0), mu, and lambda from each mode, total number concentration, bulk extinction, ice water content (IWC), and mass median maximum dimension D(sub mm) as a function of temperature T and cirrus type are then analyzed. The changes in the observed codependencies between N(sub 0), mu, and lambda, bulk extinction, IWC, and D(sub mm) with environmental conditions indicate that particles were larger at higher T during SPARTICUS. At most two modes were observed in any SD during SPARTICUS, with the average boundary between them at 115 micrometers, similar to past studies not using probes with shatter mitigating tips and artifact removal algorithms. The bimodality of the SDs increased with T. This and the differences in N(sub 0), mu, and lambda between the modes suggest that particles with smaller D nucleated more recently than particles with larger D, which grew via vapor deposition and aggregation. Because smaller crystals, whose concentrations are uncertain, make marginal contributions to higher order moments, the use of higher moments for evaluating model fields is suggested.

Ellipsoids↗

RACORO continental boundary layer cloud investigations. 2. Large-eddy simulations of cumulus clouds and evaluation with in-situ and ground-based observations

A 60-hour case study of continental boundary layer cumulus clouds is examined using two large-eddy simulation (LES) models. The case is based on observations obtained during the RACORO Campaign (Routine Atmospheric Radiation Measurement [ARM] Aerial Facility [AAF] Clouds with Low Optical Water Depths [CLOWD] Optical Radiative Observations) at the ARM Climate Research Facility's Southern Great Plains site. The LES models are driven by continuous large-scale and surface forcings, and are constrained by multi-modal and temporally varying aerosol number size distribution profiles derived from aircraft observations. We compare simulated cloud macrophysical and microphysical properties with ground-based remote sensing and aircraft observations. The LES simulations capture the observed transitions of the evolving cumulus-topped boundary layers during the three daytime periods, and generally reproduce variations of droplet number concentration with liquid water content (LWC), corresponding to the gradient between the cloud centers and cloud edges at given heights. The observed LWC values fall within the range of simulated values; the observed droplet number concentrations are commonly higher than simulated, but differences remain on par with potential estimation errors in the aircraft measurements. Sensitivity studies examine the influences of bin microphysics versus bulk microphysics, aerosol advection, supersaturation treatment, and aerosol hygroscopicity. Simulated macrophysical cloud properties are found to be insensitive in this non-precipitating case, but microphysical properties are especially sensitive to bulk microphysics supersaturation treatment and aerosol hygroscopicity.

54 ENVIRONMENTAL SCIENCES↗