DOE TRACER CSAPR2 Cell Tracking Cloud Mask
C-Band Scanning ARM Precipitation Radar, CF/Radial Formatted, Quality Controlled Tobac Tracking Cloud Mask
Radar reflectivity↗
SEARCH · Search NASA
Results for “CLOUD MASK”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
NREL GOES Reference Document
The purpose of this document is to create a single reference document representing abridged versions of the PATMOS-x Algorithm Theoretical Basis Documents (ATBDs) specifically relevant to GOES 16-18 processing. This document has been compiled from several documents: Cloud Mask ATBD, AWG Cloud Height Algorithm (ACHA) ATBD, Daytime Cloud Optical and Microphysical Properties (DCOMP) ATBD, and CLAVR-x User's Guide.
14 SOLAR ENERGY↗
The influence of cloud cover on the reliability of satellite-based solar resource data
Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.
14 SOLAR ENERGY↗
Radar and lidar based cloud type product at the ARM ENA observatory
Following methods outlined in Remillard et al. (2012), we classify seven cloud types using radar reflectivity, best-estimated cloud base, and cloud-layer product from the Active Remotely Sensed Cloud Locations (ARSCL) product (Kollias et al. 2007). A cloud mask is created based on the detectable radar reflectivity (>-40 dBZ) combined with the best-estimated cloud base height. Each cloud object is analyzed individually as contiguous cloudy pixels, and its type is determined based on the cloud’s boundaries and duration. Focusing on marine boundary-layer clouds, low clouds are further classified into four types: shallow cumulus, broken stratocumulus (Sc) or cumulus clouds, single-layer Sc, and multi-layer Sc or Sc coupled with cumulus. The remaining three categories are middle clouds, high clouds, and deep convective clouds. For detailed definition of each cloud type, please refer to Zheng et al. (2024).
54 ENVIRONMENTAL SCIENCES↗
Constraining microphysical processes of warm rain formulation using advanced spectral separations, an ensemble retrieval framework and machine learning techniques
Drizzle, a common feature of marine boundary layer clouds formed through collision coalescence, plays a key role in cloud microphysics and evolution. Yet, simultaneously retrieving cloud and drizzle properties from remote-sensing observations remains challenging because drizzle droplets often dominate radar signals, masking cloud contributions. The goal of the proposed research is to provide constraints for the process of autoconversion and accretion using ARM cloud measurements. Specifically, we provide concurrent retrievals of cloud and drizzle that allows users to derive corresponding autoconversion and accretion rates.
54 ENVIRONMENTAL SCIENCES↗
Stereo Cameras for Clouds (STEREOCAM) Instrument Handbook
The three pairs of stereo camera setups aim to provide synchronized and stereo calibrated time series of images that can be used for 3D cloud mask reconstruction. Each camera pair is positioned at approximately 120 degrees from the other pair, with a 17o-19o pitch angle from the ground, and at 5-6 km distance from the U.S. Department of Energy (DOE) Central Facility at the Atmospheric Radiation Measurement (ARM) Climate Research Facility Southern Great Plains (SGP) observatory to cover the region from northeast, northwest, and southern views. Images from both cameras of the same stereo setup can be paired together to obtain 3D reconstruction by triangulation. 3D reconstructions from the ring of three stereo pairs can be combined together to generate a 3D mask from surrounding views. This handbook delivers all stereo reconstruction parameters of the cameras necessary to make 3D reconstructions from the stereo camera images.
47 OTHER INSTRUMENTATION↗
Advanced Precipitation and Boundary Layer Data Products Derived from ARM Radar Wind Profilers
This research project was successful in delivering on four main objectives. First, software was developed to accurately calculate 915-MHz radar wind profiler (RWP) spectrum moments from the recorded Doppler velocity power spectra. Second, software was developed to calibrate the RWP reflectivity factor using collocated surface disdrometer observations. Third, the Python processing code was documented and given to the ARM Infrastructure to produce ARM ‘b level’ calibrated RWP products. Fourth, calibrated RWP products were uploaded to the ARM Archive as PI Products for 10 years of SGP RWP observations and for GoAmazon and TRACER field campaign RWP observations. In addition to working with RWP observations, this research project also worked with KAZR observations to distinguish insects from boundary layer clouds to help improve the ARSCL cloud mask product. The PI worked with senior and early career ARM funded scientists at BNL exploring how to include calibrated RWP moments into future versions of the ARSCL product.
54 ENVIRONMENTAL SCIENCES↗
Evaluation of cloud height, optical thickness, and phase retrievals from the CHROMA algorithm applied to Sentinel-3 OLCI data
We previously developed the Cloud Height Retrieval from O 2 Molecular Absorption (CHROMA) algorithm for the Ocean Color Instrument (OCI) on the new NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Here, we apply CHROMA to observations from the Ocean Land Colour Instrument (OLCI) to guide expectations for PACE, as it will take some time to obtain large-scale validation data for OCI. We use cloud top height (CTH), phase, and (for liquid clouds) cloud optical thickness (COT) data from the ground-based Atmospheric Radiation Measurement (ARM) network to evaluate the OLCI retrievals. We found that OLCI and Moderate Resolution Imaging Spectroradiometer (MODIS) CTH compare similarly well to the ARM reference. OLCI has a tendency to underestimate CTH as CTH increases, and algorithm assumptions about cloud geometric thickness may contribute to this. ARM COT from multifilter shadowband radiometers (MFRSR) and Sun photometers are well-correlated with one another, albeit with a roughly 30 % offset on average; OLCI and MODIS COT agree more closely with the MFRSR data. OLCI retrieval uncertainty estimates show skill at telling low-uncertainty cases from high-uncertainty ones, although CTH uncertainties are underestimated. Additionally, we compare the OLCI data to satellite retrievals based on thermal infrared measurements from MODIS and Sea and Land Surface Temperature Radiometer (SLSTR) data. Differences are broadly consistent with physical expectations based on the A-band vs. thermal techniques, although one key challenge in such aggregated comparisons is different cloud masking sensitivities and algorithm failure rates meaning additional sampling differences are introduced. We conclude by discussing the transition to and possible enhancements for PACE OCI.
Sayer, Andrew M. [Univ. of Maryland Baltimore Coun↗
NWB Sensors Infrared Cloud Imager Data Products from SGP
NWB Sensors is a company which has developed a commercially available Infrared Cloud Imager (ICI). For more information, consult the company's webpage, https://www.nwbsensors.com/infrared-cloud-imager. To validate the radiometric accuracy of the ICI, NWB Sensors deployed it to the ARM SGP User Facility in 2023. The primary motivation of this deployment was to perform an intercomparison between the ICI and the Atmospheric Emitted Radiance Interferometer (AERI). The AERI spectral radiance data product can be integrated across the response function of the ICI and directly compared to the zenith radiance observed by the ICI. In addition, the ICI uses proprietary models of the downwelling clear-sky radiance in its cloud processing algorithms. They are based on surface meteorology and precipitable water vapor (PWV). These models were validated by comparing their predicted radiances to those derived from radiative transfer models of the ARM radiosondes. Finally, PWV observations derived from the ICI's onboard GNSS-based PWV retrieval system were compared against those from the microwave radiometer. This dataset contains the ICI radiance and cloud data products.
Atmosphere↗
Global models predict clouds at the wrong time of day: Does it matter for radiation and climate?
Accurate prediction of future climate change hinges upon the ability of Earth system models (ESMs) to simulate clouds and their radiative effects. Even if an ESM can simulate the correct clouds, a systematic error in the amount of sunlight reflected by clouds (and, thus, cloud radiative effect) can exist if the clouds are simulated at the incorrect time of day. In this work, we develop an analytical model connecting diurnal cloud biases to emergent mean state radiative biases. With the use of satellite observations, we demonstrate that there are errors in the time of day that clouds are occurring in ESMs that would cause bias in shortwave cloud radiative effect (SWCRE) that is greater than 45% of the total SWCRE bias, but such errors in the cloud diurnal cycle are masked by other compensating errors, indicating that these ESMs are getting the right answer for the wrong reasons.
Geosciences↗
Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations
Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.
Crack detection, Dimensional Measurement↗
Image masks of global ship tracks for NASA MODIS data products
Ship tracks, long thin artificial cloud features formed from the pollutants in ship exhaust, are satellite-observable examples of aerosol-cloud interactions (ACI) that can lead to increased cloud albedo and thus increased solar reflectivity, phenomena of interest in solar radiation management. In addition to ship tracks being of interest to meteorologists and policy makers, their observed cloud perturbations provide benchmark evidence of ACI that remain poorly captured by climate models. To broadly analyze the effects of ship tracks, high-resolution satellite imagery data highlighting their presence are required. To support this, we provide a hand labelled dataset to serve as a benchmark for a variety of subsequent analyses. Established from a previous dataset that identified ship track presence using NASA’s MODIS Aqua satellite imager, our first-of-its-kind dataset is comprised of image masks: capturing full ship track regions, including their contours, emission points and dispersive patterns. In total, 300 images, or around 2,500 masked ship tracks, observed under varying conditions are provided, and may facilitate training of machine learning algorithms to automate extraction.
Atmospheric dynamics↗
An Evaluation of Representation Learning Methods in Particle Physics Foundation Models
We present a systematic evaluation of representation learning objectives for particle physics within a unified framework. Our study employs a shared transformer-based particle-cloud encoder with standardized preprocessing, matched sampling, and a consistent evaluation protocol on a jet classification dataset. We compare contrastive (supervised and self-supervised), masked particle modeling, and generative reconstruction objectives under a common training regimen. In addition, we introduce targeted supervised architectural modifications that achieve state-of-the-art performance on benchmark evaluations. This controlled comparison isolates the contributions of the learning objective, highlights their respective strengths and limitations, and provides reproducible baselines. We position this work as a reference point for the future development of foundation models in particle physics, enabling more transparent and robust progress across the community.
Chen, Michael [Caltech]↗
Custom surface reflectance, shade mask, and equivalent water thickness maps for the Colorado Headwaters Ecological Spectroscopy Study (2025)
This dataset contains land surface reflectance estimates and additional derived products generated from NEON Imaging Spectrometer (NIS) data collected in the Upper Gunnison river basin during June and July of 2025. Data was collected over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). These products were derived from radiance and LiDAR data collected by the NEON Airborne Observation Platform (AOP) campaign funded by the Colorado Headwaters Ecological Spectroscopy Study (CHESS) (doi:10.15485/3017965). Products include per-pixel surface reflectance (rfl) and reflectance uncertainty (rfl_unc), observational data (obs), canopy equivalent water thickness (ewt), and shade masks. Atmospheric correction was performed per flightline using the ISOFIT (Imaging Spectrometer Optimal FITting) optimal estimation framework to estimate surface reflectance and the associated per-band reflectance uncertainty. Reflectance retrievals achieved a mean absolute error of 1.5% across diverse validation surfaces (see validation report.pdf). Equivalent water thickness was calculated from surface reflectance using the Beer–Lambert absorption of liquid water. Shade masks were generated based on the geometry between the sun angle, ground surface, and sensor at the time of flight. Data products are provided per-flightline and as mosaics for each domain. Flightline data products are provided as ENVI-formatted binary files (rfl, rfl_unc, ewt) and GeoTIFFs (shade). Reflectance and uncertainty mosaics are provided as tiled NetCDFs, while all other mosaicked products are provided as cloud-optimized GeoTIFFs. These formats are supported by common geospatial software (e.g., QGIS, ArcGIS, ENVI) and programmatic libraries in Python (e.g., rasterio, xarray, spectral, netCDF4) and R (e.g., terra, ncdf4). Processing workflows were designed to be equivalent to those used to generate the 2018 CHESS campaign airborne imaging spectroscopy data products (doi:10.15485/3013527). All outputs were co-registered to a common spatial grid to support time series analyses. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgment: Data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). Computational research was carried out at the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004) and was funded by EMIT Extended Mission Phase E Science.
2018 NEON and 2025 CHESS Campaigns↗
Broad absorption line quasars in the Dark Energy Spectroscopic Instrument Early Data Release
Broad absorption line (BAL) quasars are characterized by gas clouds that absorb flux at the wavelength of common quasar spectral features, although blueshifted by velocities that can exceed $0.1c$. BAL features are interesting as signatures of significant feedback, yet they can also compromise cosmological studies with quasars by distorting the shape of the most prominent quasar emission lines, impacting redshift accuracy and measurements of the matter density distribution traced by the Lyman $\alpha$ forest. We present a catalogue of BAL quasars discovered in the Dark Energy Spectroscopic Instrument (DESI) survey Early Data Release, which were observed as part of DESI Survey Validation, as well as the first two months of the main survey. We describe our method to automatically identify BAL quasars in DESI data, the quantities we measure for each BAL, and investigate the completeness and purity of this method with mock DESI observations. We mask the wavelengths of the BAL features and re-evaluate each BAL quasar redshift, finding new redshifts which are $243\, {\rm km}\, {\rm s}^{-1}$ smaller on average for the BAL quasar sample. These new, more accurate redshifts are important to obtain the best measurements of quasar clustering, especially at small scales. Finally, we present some spectra of rarer classes of BALs that illustrate the potential of DESI data to identify such populations for further study.
79 ASTRONOMY AND ASTROPHYSICS↗
A Cloud-Tracking Data Set for the CSAPR2 Adaptive Scanning during TRACER
The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility (Mather and Voyles 2013) deployed the first ARM Mobile Facility (AMF1; Miller et al. 2016) near LaPorte, Texas to support the Tracking Aerosol Convection Interactions Experiment (TRACER) (Jensen et al. 2025) near Houston, Texas. From October 2021 to September 2022, AMF1 was deployed to 29.67° N, 95.06° W near LaPorte, Texas and the 2nd Generation C-band Scanning ARM Precipitation Radar (CSAPR2) was deployed to a supplementary site at 29.53° N, 95.28° W (Figure 1). During an intensive operational period (IOP) from 1 June to 30 September 2022, the CSAPR2 sampled precipitation echoes in an adaptive scanning mode following the Multisensor Agile Adaptive Scanning (MAAS) framework (Kollias et al. 2020). MAAS helped optimize the CSAPR2 scan strategy to perform frequent plan position indicator (PPI) and range height indicator (RHI) scans (Lamer et al. 2023). Details of the CSAPR2 scanning, data processing, and calibration procedures used by the principal investigator (PI), and the PI data files are described by Oue et al. (2023). Details of the CSAPR2 operational performance, ARM data processing and correction procedures, and data quality masks are described by Feng et al. (2024a).
54 ENVIRONMENTAL SCIENCES↗