Results for “cloud related quantities”

DOE OSTI2026

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Infrastructure Team at Lawrence Livermore National Laboratory (LLNL) to facilitate the use of long-term, high-frequency measurements from the ARM Facility in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The Coupled Model Intercomparison Project (CMIP) model data sets are also included in the package to enable model intercomparison as demonstrated in Zhang et al. (2017). The mean of the CMIP model can serve as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, and radiative fluxes, with plan to extend to more fields, such as aerosol and microphysics properties. Process-oriented diagnostics focusing on individual cloud- and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. The version 1.0 package is designed based on data collected at ARM’s Southern Great Plains (SGP) Research Facility, with the plan to extend to other ARM sites. The metrics and diagnostics package is currently built upon standard Python libraries and additional Python packages developed by DOE (such as CDMS and CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first present the input data, which constitutes the core content of the metrics and diagnostics package in section 2, and a user's guide documenting the workflow/structure of the version 1.0 codes, and including step-by-step instruction for running the package in section 3.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Marine and continental stratocumulus cloud microphysical properties obtained from routine ARM Cimel sunphotometer observations

This study investigates marine and continental stratocumulus (Sc) cloud properties obtained from an automated implementation of a multispectral photometer retrieval. Photometer methods simultaneously retrieve cloud optical depth (τ) and cloud droplet effective radius (r e ), with estimates for liquid water path (LWP) calculated on the availability of those quantities. These applied methods evaluate retrieved cloud properties for Sc identified during a recent 6 year period over the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) program sites in Oklahoma, USA (SGP) and in the Azores, Portugal (ENA). Modest agreement in key quantity retrievals is found between the routine photometer products and multisensor collocated profiling references. Cumulative breakdowns contingent on cloud thickness indicate increases in all retrieved quantities in thicker clouds, with larger discrepancies in the relative performance between the retrievals collected in the presence of drizzle. Under continental cloud conditions, the clouds of a similar thickness and r e to those sampled under marine conditions report a factor of 1.5 larger τ and LWP. An r 2 ≅0.65 is found between photometer τ retrievals and shadowband radiometer measurements, with photometer retrievals reporting a high (relative) bias. The τ intercomparisons indicate that variability between retrievals is a factor of three larger than errors reported from individual retrieval input perturbation tests. Photometer r e retrievals suggest a low r 2 (< 0.1) having a standard deviation ≅ 3 µm when compared to ARM baseline multi-sensor radar/radiometer references (accounting for offsets in the cloud droplet number concentration assumptions of the latter). However, photometer LWP calculations remain relatively unbiased in non-drizzling conditions, with errors O (50 g m −2 ) and r 2 ≅0.5 to collocated radiometer and interferometer references. Additional sensitivity tests for island influences on marine Sc properties suggest that while island-influenced winds may promote larger cloud LWP or thickness, the influence could be within retrieval method uncertainty and/or collocated instrument variability.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Impacts of Synoptic-Scale Dynamics on Clouds and Radiation in High Southern Latitudes

High-latitudinal mixed-phase clouds significantly affect Earth's radiative balance. Observations of cloud and radiative properties from two field campaigns in the Southern Ocean and Antarctica were compared with two global climate model simulations. A cyclone compositing method was used to quantify “dynamics-cloud-radiation” relationships relative to the extratropical cyclone centers. Observations show larger asymmetry in cloud and radiative properties between western and eastern sectors at McMurdo compared with Macquarie Island. Most observed quantities at McMurdo are higher in the western (i.e., post-frontal) than the eastern (frontal) sector, including cloud fraction, liquid water path (LWP), net surface shortwave and longwave radiation (SW and LW), except for ice water path (IWP) being higher in the eastern sector. Here, the two models were found to overestimate cloud fraction and LWP at Macquarie Island but underestimate them at McMurdo Station. IWP is consistently underestimated at both locations, both sectors, and in all seasons. Biases of cloud fraction, LWP, and IWP are negatively correlated with SW biases and positively correlated with LW biases. The persistent negative IWP biases may have become one of the leading causes of radiative biases over the high southern latitudes, after correcting the underestimation of supercooled liquid water in the older model versions. By examining multi-scale factors from cloud microphysics to synoptic dynamics, this work will help increase the fidelity of climate simulations in this remote region.

58 GEOSCIENCES↗

DOE OSTI2025

Multiscale ACI Satellite Database

The SATELLITE_EAGLES_PNNL NetCDF dataset contains a suite of satellite- and reanalysis-derived atmospheric and surface parameters on a regular latitude–longitude grid. The dataset includes core geophysical fields such as land fraction, aerosol optical depth at multiple wavelengths (465, 550, 667, and 865 nm), sea surface temperature, estimated inversion strength, and various thermodynamic and dynamic quantities (e.g., relative humidity, vertical velocity, boundary-layer height, and surface fluxes) from both MERRA and ERA reanalysis products, provided as daily-mean and instantaneous values. A major component of the dataset consists of MODIS-retrieved cloud microphysical properties, including cloud droplet number concentration, cloud effective radius, optical thickness, and liquid water path, provided for three compositing regimes (“All,” “Q06,” and “G18”). Corresponding cloud-top parameters—temperature, height, and pressure—along with total and domain-mean cloud fraction fields are also included. The file further integrates additional satellite data from AMSR-E (for cloud water, rain water, and surface precipitation retrievals) and CERES (for top-of-atmosphere radiative fluxes, cloud fractions, and albedo). This dataset is designed to evaluate aerosol–cloud interactions in warm clouds, emphasizing the use of MODIS for deriving cloud droplet number concentration and liquid water path statistics. The complementary satellite and reanalysis fields are co-located and time-matched to the same instantaneous MODIS observations, enabling consistent comparisons between cloud properties, aerosol loading, and large-scale meteorological conditions. The dataset is recently featured in Christensen et al. (2025), Machine Learning Reveals Strong Grid-Scale Dependence in the Satellite Nd–LWP Relationship, EGUsphere [preprint], https://doi.org/10.5194/egusphere-2025-3850, 2025.

Christensen, Matthew [Pacific Northwest National L↗

DOE OSTI2025

Multiscale ACI Satellite Database

The SATELLITE_EAGLES_PNNL NetCDF dataset contains a suite of satellite- and reanalysis-derived atmospheric and surface parameters on a regular latitude–longitude grid. The dataset includes core geophysical fields such as land fraction, aerosol optical depth at multiple wavelengths (465, 550, 667, and 865 nm), sea surface temperature, estimated inversion strength, and various thermodynamic and dynamic quantities (e.g., relative humidity, vertical velocity, boundary-layer height, and surface fluxes) from both MERRA and ERA reanalysis products, provided as daily-mean and instantaneous values. A major component of the dataset consists of MODIS-retrieved cloud microphysical properties, including cloud droplet number concentration, cloud effective radius, optical thickness, and liquid water path, provided for three compositing regimes (“All,” “Q06,” and “G18”). Corresponding cloud-top parameters—temperature, height, and pressure—along with total and domain-mean cloud fraction fields are also included. The file further integrates additional satellite data from AMSR-E (for cloud water, rain water, and surface precipitation retrievals) and CERES (for top-of-atmosphere radiative fluxes, cloud fractions, and albedo). This dataset is designed to evaluate aerosol–cloud interactions in warm clouds, emphasizing the use of MODIS for deriving cloud droplet number concentration and liquid water path statistics. The complementary satellite and reanalysis fields are co-located and time-matched to the same instantaneous MODIS observations, enabling consistent comparisons between cloud properties, aerosol loading, and large-scale meteorological conditions. The dataset is recently featured in Christensen et al. (2025), Machine Learning Reveals Strong Grid-Scale Dependence in the Satellite Nd–LWP Relationship, EGUsphere [preprint], https://doi.org/10.5194/egusphere-2025-3850, 2025.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE's) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and helping users access data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data. This paper provides an update on recent improvements made to the GDR's data lakes and automated data pipelines, including: (1) streamlining the data lake intake process, (2) better educating users on the process and requirements through a new data lakes page, (3) adding data lake direct access links to GDR data lake submission pages, (4) implementing a DAS data pipeline to convert DAS data uploaded in SEG-Y format to a standardized hierarchical data format v5 (HDF5), (5) extending this pipeline to encompass data in the GDR data lake, (6) adding metadata requirements for geospatial data, (7) making user interface/user experience (UX) enhancements to the data pipelines' documentation pages, and (8) improving the GDR's data standards and pipelines pages to better guide users in ensuring that their data is standardized by the GDR's automated data pipelines. 2024 Geothermal Resources Council. All rights reserved.

accessibility↗

DOE OSTI2026

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and aiding users in accessing data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data.

15 GEOTHERMAL ENERGY↗

DOE OSTI2024

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository: Preprint

The Department of Energy's (DOE) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and aiding users in accessing data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data.

accessibility↗

DOE OSTI2024

Cumulonimbus Clouds Convert a Smaller Fraction of CAPE into Kinetic Energy in a Warmer Atmosphere

Abstract This study investigates how entrainment’s diluting effect on cumulonimbus updraft buoyancy is affected by the temperature of the troposphere, which is expected to increase by the end of the century. A parcel model framework is constructed that allows for independent variations in the temperature ( T ), the entrainment rate ε , the free-tropospheric relative humidity (RH), and the convective available potential energy (CAPE). Using this framework, dilution of buoyancy is evaluated with T and RH independently varied and with CAPE either held constant or increased with temperature. When CAPE is held constant, buoyancy decreases as T increases, with parcels in warmer environments realizing substantially smaller fractions of their CAPE as kinetic energy (KE). This occurs because the increased moisture difference between an updraft and its surroundings at warmer temperatures drives greater updraft dilution. Similar results are found in midlatitude and tropical conditions when CAPE is increased with temperature. With the expected 6%–7% increase in CAPE per kelvin of warming, KE only increases at 2%–4% K −1 in narrow updrafts but tracks more closely with CAPE at 4%–6% in wider updrafts. Interestingly, the rate of increase in the KE with T becomes larger than that of CAPE when the later quantity increases at more than 10% K −1 . These findings emphasize the importance of considering entrainment in studies of moist convection’s response to climate change, as the entrainment-driven dilution of buoyancy may partially counteract the influence of increases in CAPE on updraft intensity. Significance Statement Cumulonimbus clouds mix air with their surrounding environment through a process called entrainment, which controls how efficiently environmental energy is converted into upward speed in thunderstorm updrafts. Our research shows that warmer temperatures will exacerbate the moisture difference between cumulonimbus updrafts and their surroundings, leading to greater mixing and less efficient conversion of environmental energy into updraft speeds. This effect should be considered in future research that investigates how climate change will affect cumulonimbus clouds.

Peters, John M.↗

DOE OSTI2025

Evaluating Cloud Properties at Scott Base: Comparing Ceilometer Observations With ERA5, JRA55, and MERRA2 Reanalyses Using an Instrument Simulator

This study compares CL51 ceilometer observations made at Scott Base, Antarctica, with statistics from the ERA5, JRA55, and MERRA2 reanalyses. To enhance the comparison we use a lidar instrument simulator to derive cloud statistics from the reanalyses which account for instrumental factors. The cloud occurrence in the three reanalyses is slightly overestimated above 3 km, but displays a larger underestimation below 3 km relative to observations. Unlike previous studies, we see no relationship between relative humidity and cloud occurrence biases, suggesting that the cloud biases do not result from the representation of moisture. We also show that the seasonal variation of cloud occurrence and cloud fraction, defined as the vertically integrated cloud occurrence, are small in both the observations and the reanalyses. We also examine the quality of the cloud representation for a set of weather states derived from ERA5 surface winds. The variability associated with grouping cloud occurrence based on weather state is much larger than the seasonal variation, highlighting weather state is a strong control of cloud occurrence. All the reanalyses continue to display underestimates below 3 km and overestimates above 3 km for each weather state. But the variability in ERA5 statistics matches the changes in the observations better than the other reanalyses. We also use a machine learning scheme to estimate the quantity of supercooled liquid water cloud from the ceilometer observations. Ceilometer low-level supercooled liquid water cloud occurrences are considerably larger than values derived from the reanalyses, further highlighting the poor representation of low-level clouds in the reanalyses.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Dual-frequency (Ka-band and G-band) radar estimates of liquid water content profiles in shallow clouds

The profile of the liquid water content (LWC) in clouds provides fundamental information for understanding the internal structure of clouds, their radiative effects, propensity to precipitate, and degree of entrainment and mixing with the surrounding environment. In principle, differential absorption techniques based on coincident dual-frequency radar reflectivity observations have the potential to provide the LWC profile. Previous differential frequency radar reflectivity (DFR) efforts were challenged by the fact that the measurable differential attenuation for small quantities of LWC is usually comparable to the system measurement error. This typically renders the retrieval impractical, as the uncertainty can become many times greater than the retrieved value itself. Theoretically, this drawback can be mitigated following two interconnected approaches: (1) increasing the frequency separation between the dual-frequency radar system to measure greater differential attenuation and (2) increasing the radar operating frequency to reduce the instrument measurement random error. Our recently developed 239 GHz radar was deployed during the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) along with a variety of collocated remote sensing and in situ instruments. We have combined Ka-band (35 GHz) and G-band (239 GHz) observations to retrieve the LWC from more than 100 vertical profiles of shallow clouds with typical amounts of LWC smaller than 1 g m -3 . We theoretically and experimentally demonstrate that the Ka-band and G-band pair of frequencies offers at least a 65 % relative improvement in the LWC retrieval sensitivity compared to previous works reported in the literature using lower-frequency radars. This new technique provides a missing capability to determine the LWC in the challenging low liquid water path (LWP) range (< 200 g m -2 ) and suggests a way forward to characterize microphysical and dynamical processes more precisely in shallow clouds.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Synthesis of ARM User Facility Surface Rainfall Datasets to Construct a Best Estimate Value Added Product (PrecipBE)

Surface precipitation measurements are essential for Earth system model (ESM) evaluation and understanding cloud processes. An ever-growing need for robust, temporally evolving, and easy-to-use statistical datasets provides motivation for a baseline ground-based precipitation properties data product. The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility operates an extensive suite of precipitation instruments with various sensitivities and operating mechanisms, which render the decision of which instrument to use based on one or more fixed thresholds challenging and prone to errors and bias. Using a long-term instrument inter-comparison from a unique per-precipitation event perspective, rather than instantaneous sample comparison, we demonstrate that ARM rainfall-measuring instruments are generally consistent with each other at the statistical level. Inter-instrument deviations at the single event level can be large, especially for specific rainfall event properties such as maximum precipitation rates. A machine-learning (ML) analysis using a random forest regressor indicates that in some cases, depending on instrument, local site climatology, and/or specific deployment configuration, certain atmospheric state variables influence the measured quantities in an unpredictable manner. Thus, a-priori weighting of different instruments does not necessarily lead to more accurate and less biased synthesis of instrument data. These results motivate the design of the ARM precipitation best-estimate (PrecipBE) value-added product, which incorporates all valid precipitation data while considering data quality and other instrument limitations. PrecipBE consists of time series and tabular statistics datasets in an easy-to-use and insightful per-precipitation event format. It provides a large set of precipitation event properties supplemented with ancillary data from ARM datasets that correspond to the detected precipitation events. We describe the PrecipBE algorithm and demonstrate its use via the examination of a single-day output as well as a long-term trend analysis of precipitation events at the ARM Southern Great Plains (SGP) site, covering more than 30 years of data. The trend analysis tentatively suggests a long-term temporal tendency for mainly shorter and less intense precipitation events at the SGP site, but a long-term increase in annual rainfall by more than 36 mm (5 %) per decade. This rainfall trend is catalyzed primarily by more extreme event properties of relatively rare, intense precipitation events, with event total and 1 min maximum precipitation rate at a 1 year timeframe increasing up to 5 mm and 9 mm h −1 (several percent) per decade, respectively. While the currently available PrecipBE datasets (at https://adc.arm.gov/discovery/, last access: 8 December 2025) cover rainfall from multiple ARM deployments up to March 2025, PrecipBE is planned to be expanded to include solid-phase precipitation and will soon become an operational product with a several-day lag from real-time. We invite the ARM user community to leverage this new product and welcome user feedback to further enhance the dataset.

Silber, Israel [Pacific Northwest National Laborat↗