Search NASA⌕ Search

SEARCH · Search NASA

Results for “Climate Model Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Efficient Super-Resolution of Near-Surface Climate Modeling Using the Fourier Neural Operator

Downscaling methods are critical in efficiently generating high-resolution atmospheric data. However, state-of-the-art statistical or dynamical downscaling techniques either suffer from the high computational cost of running a physical model or require high-resolution data to develop a downscaling tool. Here, we demonstrate a recently proposed zero-shot super-resolution method, the Fourier neural operator (FNO), to efficiently perform downscaling without the need for high-resolution data. Because the FNO learns dynamics in Fourier space, FNO is a resolution-invariant emulator; it can be trained at a coarse resolution and produces emulation at any high resolution. We applied FNO to downscale a 4-km resolution Weather Research and Forecasting (WRF) Model simulation of near-surface heat-related variables over the Great Lakes region. The FNO is driven by the atmospheric forcings, and topographic features used in the WRF model at the same resolution. We incorporated a physics-constrained loss in FNO by using the Clausius-Clapeyron relation to better constrain the relations among the emulated states. Trained on merely 600 WRF snapshots at 4-km resolution, the FNO shows comparable performance with a widely used convolutional network, U-Net, achieving averaged modified Kling-Gupta Efficiency of 0.88 and 0.94 on the test dataset for temperature and pressure, respectively. We then employed the FNO to produce 1-km emulations to reproduce the fine climate features. Further, by taking the WRF simulation as ground truth, we show consistent performances at the two resolutions, suggesting the reliability of FNO in producing high-resolution dynamics. Our study demonstrates the potential of using FNO for zero-shot super-resolution in generating first-order estimation on atmospheric modeling.

54 ENVIRONMENTAL SCIENCES↗

A Surface Radiation Balance Dataset from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

Abstract A field campaign at Siple Dome in West Antarctica during the austral summer 2019/20 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-powered equipment, includes surface energy balance measurements, meteorology, and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model’s snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6- μ m atmospheric window reveal cloud phase transitions associated with cloud life cycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations. significance statement Antarctica is a critical region for understanding climate change and sea level rise, as the great ice sheets and the ice shelves are subject to increasing risk as global climate warms. Climate models have difficulties over Antarctica, particularly with simulation of cloud properties that regulate snow surface melting or refreezing. Atmospheric and climate-related field work has significant challenges in the Antarctic, due to the small number of research stations that can support state-of-the-art equipment. Here we present new data from a suite of transportable and solar-powered instruments that can be deployed to remote Antarctic sites, including regions where ice shelves are most at risk, and we demonstrate how key components of climate model simulations can be evaluated against these data.

54 ENVIRONMENTAL SCIENCES↗

Decadal Covariability of the Northern Wintertime Land Surface Temperature and Atmospheric Circulation

The decadal covariability of northern wintertime land surface temperature and 500-hPa geopotential anomalies is examined using the National Centers for Environmental Prediction–National Center for Atmospheric Research and the Twentieth-Century Reanalyses over the twentieth century and a 996-yr preindustrial climate simulation from the Canadian Earth System Model. Based on the reanalysis data, the covariability is dominated by two leading maximum covariance analysis (MCA) modes. MCA1 is characterized by temperature anomalies over most of Canada, the eastern United States, Mexico, and Eurasian mid- to high latitudes, accompanied by anomalies of opposite sign elsewhere over northern landmasses. MCA2 features temperature anomalies over most of North America, Eurasia, and Greenland with opposite anomalies elsewhere. In the upper troposphere the synoptic vorticity fluxes reinforce the anomalous circulation, while in the lower troposphere advection by the anomalous mean flow offsets the eddy forcing and maintains the decadal temperature perturbation. The MCA1-associated variability has a broad spectrum over decadal–interdecadal time scales, while the MCA2-related variability has a significant power peak around 20 yr. The change of temperature and geopotential trends around 1990 tends to be a decadal-scale shift in winter and has significant features of the leading mode of the decadal covariability. The climate model has broadly similar decadal covariability, including the leading MCA patterns as well as the temporal evolution of the patterns. The decadal temperature and geopotential anomalies primarily covary with the North Atlantic Oscillation but also with the variability of the North Pacific index, while the Southern Oscillation index variability tends to be the least important predictor for the northern decadal temperature and geopotential anomalies.

54 ENVIRONMENTAL SCIENCES↗

The North American Carbon Program Multi-scale Synthesis and Terrestrial Model Intercomparison Project – Part 2: Environmental driver data

Ecosystems are important and dynamic components of the global carbon cycle, and terrestrial biospheric models (TBMs) are crucial tools in further understanding of how terrestrial carbon is stored and exchanged with the atmosphere across a variety of spatial and temporal scales. Improving TBM skills, and quantifying and reducing their estimation uncertainties, pose significant challenges. The Multi-scale Synthesis and Terrestrial Model Intercomparison Project (MsTMIP) is a formal multi-scale and multi-model intercomparison effort set up to tackle these challenges. The MsTMIP protocol prescribes standardized environmental driver data that are shared among model teams to facilitate model model and model observation comparisons. In this article, we describe the global and North American environmental driver data sets prepared for the MsTMIP activity to both support their use in MsTMIP and make these data, along with the processes used in selecting/processing these data, accessible to a broader audience. Based on project needs and lessons learned from past model intercomparison activities, we compiled climate, atmospheric CO 2 concentrations, nitrogen deposition, land use and land cover change (LULCC), C3 / C4 grasses fractions, major crops, phenology and soil data into a standard format for global (0.5⁰ x 0.5⁰ resolution) and regional (North American: 0.25⁰ x 0.25⁰ resolution) simulations. In order to meet the needs of MsTMIP, improvements were made to several of the original environmental data sets, by improving the quality, and/or changing their spatial and temporal coverage, and resolution. The resulting standardized model driver data sets are being used by over 20 different models participating in MsTMIP. Lastly, the data are archived at the Oak Ridge National Laboratory Distributed Active Archive Center (ORNL DAAC, http://daac.ornl.gov) to provide long-term data management and distribution.

54 ENVIRONMENTAL SCIENCES↗

Data Descriptor: A Land Data Assimilation System for Sub-Saharan Africa Food and Water Security Applications

Seasonal agricultural drought monitoring systems, which rely on satellite remote sensing and land surface models (LSMs), are important for disaster risk reduction and famine early warning. These systems require the best available weather inputs, as well as a long-term historical record to contextualize current observations. This article introduces the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS), a custom instance of the NASA Land Information System (LIS) framework. The FLDAS is routinely used to produce multi-model and multi-forcing estimates of hydro-climate states and fluxes over semi-arid, food insecure regions of Africa. These modeled data and derived products, like soil moisture percentiles and water availability, were designed and are currently used to complement FEWSNETs operational remotely sensed rainfall, evapotranspiration, and vegetation observations. The 30+ years of monthly outputs from the FLDAS simulations are publicly available from the NASA Goddard Earth Science Data and Information Services Center (GES DISC) and recommended for use in hydroclimate studies, early warning applications, and by agro-meteorological scientists in Eastern, Southern, and Western Africa.

albedo↗

Coarse Woody Debris Decomposition Assessment Tool: Model validation and application

Coarse woody debris (CWD) is a significant component of the forest biomass pool; hence a model is warranted to predict CWD decomposition and its role in forest carbon (C) and nutrient cycling under varying management and climatic conditions. A process-based model, CWDDAT (Coarse Woody Debris Decomposition Assessment Tool) was calibrated and validated using data from the FACE (Free Air Carbon Dioxide Enrichment) Wood Decomposition Experiment utilizing pine ( Pinus taeda ), aspen ( Populous tremuloides ) and birch ( Betula papyrifera ) on nine Experimental Forests (EF) covering a range of climate, hydrology, and soil conditions across the continental USA. The model predictions were evaluated against measured FACE log mass loss over 6 years. Four widely applied metrics of model performance demonstrated that the CWDDAT model can accurately predict CWD decomposition. The R 2 (squared Pearson’s correlation coefficient) between the simulation and measurement was 0.80 for the model calibration and 0.82 for the model validation ( P <0.01). The predicted mean mass loss from all logs was 5.4% lower than the measured mass loss and 1.4% lower than the calculated loss. The model was also used to assess the decomposition of mixed pine-hardwood CWD produced by Hurricane Hugo in 1989 on the Santee Experimental Forest in South Carolina, USA. The simulation reflected rapid CWD decomposition of the forest in this subtropical setting. The predicted dissolved organic carbon (DOC) derived from the CWD decomposition and incorporated into the mineral soil averaged 1.01 g C m -2 y -1 over the 30 years. The main agents for CWD mass loss were fungi (72.0%) and termites (24.5%), the remainder was attributed to a mix of other wood decomposers. These findings demonstrate the applicability of CWDDAT for large-scale assessments of CWD dynamics, and fine-scale considerations regarding the fate of CWD carbon.

54 ENVIRONMENTAL SCIENCES↗

Integrating Online Compression to Accelerate Large-Scale Data Analytics Applications

Abstract—With growing dataset sizes, and as computing cycles are increasing faster than storage and wide-area bandwidths, compression appears like a promising approach for improving the performance of large-scale data analytics applications. In this context, this paper makes the following contributions. First, we develop a new compression methodology, which exploits the similarities between spatial and/or temporal neighbors in a simulation dataset, and enables high compression ratios and low decompression costs. Second, we have developed a framework that can be used to incorporate a variety of compression and decompression algorithms. This framework also supports a simple API to allow integration with an existing application or data processing middleware. Once a compression algorithm is implemented, this framework can allow multi-threaded retrieval, multi-threaded data decompression, and use of informed prefetching and caching. By integrating this framework with a data-intensive middleware, we have applied our compression methodology and framework to three applications over two datasets, including a GCRM climate model dataset. We obtained an average compression ratio of 51.68%, and up to 53.27% improvement in execution time of data analysis applications.

Big Data, I/O, HPC↗

Remote Sensing of Snow Cover: Snow Extent - Section

Snow was easily identified in the first image obtained from the Television Infrared Operational Satellite-1 (TIROS-1) weather satellite in 1960 because the high albedo of snow presents a good contrast with most other natural surfaces. Subsequently, the National Oceanic and Atmospheric Administration (NOAA) began to map snow using satellite-borne instruments in 1966. Snow plays an important role in the Earth s energy balance, causing more solar radiation to be reflected back into space as compared to most snow-free surfaces. Seasonal snow cover also provides a critical water resource through meltwater emanating from rivers that originate from high-mountain areas such as the Tibetan Plateau. Meltwater from mountain snow packs flows to some of the world s most densely-populated areas such as Southeast Asia, benefiting over 1 billion people (Immerzeel et al., 2010). In this section, we provide a brief overview of the remote sensing of snow cover using visible and near-infrared (VNIR) and passive-microwave (PM) data. Snow can be mapped using the microwave part of the electromagnetic spectrum, even in darkness and through cloud cover, but at a coarser spatial resolution than when using VNIR data. Fusing VNIR and PM algorithms to produce a blended product offers synergistic benefits. Snow-water equivalent (SWE), snow extent, and melt onset are important parameters for climate models and for the initialization of atmospheric forecasts at daily and seasonal time scales. Snowmelt data are also needed as input to hydrological models to improve flood control and irrigation management.

Hall, Dorothy K.↗

Evaluating Secondary Inorganic Aerosols in Three Dimensions

The spatial distribution of aerosols and their chemical composition dictates whether aerosols have a cooling or a warming effect on the climate system. Hence, properly modeling the three-dimensional distribution of aerosols is a crucial step for coherent climate simulations. Since surface measurement networks only give 2-D data, and most satellites supply integrated column information, it is thus important to integrate aircraft measurements in climate model evaluations. In this study, the vertical distribution of secondary inorganic aerosol (i.e., sulfate, ammonium, and nitrate) is evaluated against a collection of 14 AMS flight campaigns and surface measurements from 2000 to 2010 in the USA and Europe. GISS ModelE2 is used with multiple aerosol microphysics (MATRIX, OMA) and thermodynamic (ISORROPIA II, EQSAM) configurations. Our results show that the MATRIX microphysical scheme improves the model performance for sulfate, but that there is a systematic underestimation of ammonium and nitrate over the USA and Europe in all model configurations. In terms of gaseous precursors, nitric acid concentrations are largely underestimated at the surface while overestimated in the higher levels of the model. Heterogeneous reactions on dust surfaces are an important sink for nitric acid, even high in the troposphere. At high altitudes, nitrate formation is calculated to be ammonia limited. The underestimation of ammonium and nitrate in polluted regions is most likely caused by a too simplified treatment of the NH3/NH4(+) partitioning which affects the HNO3/NO3(-) partitioning.

aerosols↗

The AgMIP GRIDded Crop Modeling Initiative (AgGRID) and the Global Gridded Crop Model Intercomparison (GGCMI)

Climate change is a significant risk for agricultural production. Even under optimistic scenarios for climate mitigation action, present-day agricultural areas are likely to face significant increases in temperatures in the coming decades, in addition to changes in precipitation, cloud cover, and the frequency and duration of extreme heat, drought, and flood events (IPCC, 2013). These factors will affect the agricultural system at the global scale by impacting cultivation regimes, prices, trade, and food security (Nelson et al., 2014a). Global-scale evaluation of crop productivity is a major challenge for climate impact and adaptation assessment. Rigorous global assessments that are able to inform planning and policy will benefit from consistent use of models, input data, and assumptions across regions and time that use mutually agreed protocols designed by the modeling community. To ensure this consistency, large-scale assessments are typically performed on uniform spatial grids, with spatial resolution of typically 10 to 50 km, over specified time-periods. Many distinct crop models and model types have been applied on the global scale to assess productivity and climate impacts, often with very different results (Rosenzweig et al., 2014). These models are based to a large extent on field-scale crop process or ecosystems models and they typically require resolved data on weather, environmental, and farm management conditions that are lacking in many regions (Bondeau et al., 2007; Drewniak et al., 2013; Elliott et al., 2014b; Gueneau et al., 2012; Jones et al., 2003; Liu et al., 2007; M¨uller and Robertson, 2014; Van den Hoof et al., 2011;Waha et al., 2012; Xiong et al., 2014). Due to data limitations, the requirements of consistency, and the computational and practical limitations of running models on a large scale, a variety of simplifying assumptions must generally be made regarding prevailing management strategies on the grid scale in both the baseline and future periods. Implementation differences in these and other modeling choices contribute to significant variation among global-scale crop model assessments in addition to differences in crop model implementations that also cause large differences in site-specific crop modeling (Asseng et al., 2013; Bassu et al., 2014).

climate↗

Joint Modeling of Wind Speed and Wind Direction Through a Conditional Approach

Atmospheric near surface wind speed and wind direction play an important role in many applications, ranging from air quality modeling, building design, wind turbine placement to climate change research. It is therefore crucial to accurately estimate the joint probability distribution of wind speed and direction. In this work, we develop a conditional approach to model these two variables, where the joint distribution is decomposed into the product of the marginal distribution of wind direction and the conditional distribution of wind speed given wind direction. To accommodate the circular nature of wind direction, a von Mises mixture model is used; the conditional wind speed distribution is modeled as a directional dependent Weibull distribution via a two-stage estimation procedure, consisting of a directional binned Weibull parameter estimation, followed by a harmonic regression to estimate the dependence of the Weibull parameters on wind direction. A Monte Carlo simulation study indicates that our method outperforms two other approaches in estimation efficiency: one that utilizes periodic spline quantile regression and another that generates data from the commonly used Abe-Ley distribution for cylindrical data. We illustrate our method by using the output from a regional climate model to investigate how the joint distribution of wind speed and direction may change under some future climate scenarios. Our method indicates significant changes in the variation of wind speed with respect to some directions.

17 WIND ENERGY↗

Evapotranspiration in Northern Eurasia: Impact of forcing uncertainties on terrestrial ecosystem model estimates

Abstract The ecosystems in Northern Eurasia (NE) play an important role in the global water cycle and the climate system. While evapotranspiration (ET) is a critical variable to understand this role, ET over this region remains largely unstudied. Using an improved version of the Terrestrial Ecosystem Model with five widely used forcing data sets, we examine the impact that uncertainties in climate forcing data have on the magnitude, variability, and dominant climatic drivers of ET for the period 1979–2008. Estimates of regional average ET vary in the range of 241.4–335.7 mm yr −1 depending on the choice of forcing data. This range corresponds to as much as 32% of the mean ET. Meanwhile, the spatial patterns of long‐term average ET across NE are generally consistent for all forcing data sets. Our ET estimates in NE are largely affected by uncertainties in precipitation ( P ), air temperature ( T ), incoming shortwave radiation ( R ), and vapor pressure deficit (VPD). During the growing season, the correlations between ET and each forcing variable indicate that T is the dominant factor in the north and P in the south. Unsurprisingly, the uncertainties in climate forcing data propagate as well to estimates of the volume of water available for runoff (here defined as P‐ET). While the Climate Research Unit data set is overall the best choice of forcing data in NE according to our assessment, the quality of these forcing data sets remains a major challenge to accurately quantify the regional water balance in NE.

Liu, Yaling↗

Constraints on cloud feedback from analysis of ARM observations and models

Over the performance period, the PI and his team performed innovative analyses of surface remote sensing data from the Atmospheric Radiation Measurement (ARM) Program Southern Great Plains, Tropical Western Pacific, and North Slope of Alaska sites to elucidate some of the physical processes underlying cloud feedbacks on anthropogenic climate change. ARM data strongly influenced parameterization evaluation and development in the GISS (Goddard Institute for Space Studies) General Circulation Model (GCM) over this time. In this report we discuss how ARM funding was utilized for data analyses, model evaluation, and cumulus and stratiform cloud parameterization improvements, highlighting especially the areas of low-cloud feedbacks, cloud phase, and convective entrainment and downdrafts.

54 ENVIRONMENTAL SCIENCES↗

Modeling Analysis of the Swell and Wind-Sea Climate in the Salish Sea

Accurate model hindcast of wave climate in complex estuarine systems is challenging because high-resolution wave model and wind forcing are required. In this study, a modeling approach using the unstructured-grid Simulating WAves Nearshore and wind product from a high-resolution regional Weather Research and Forecasting hindcast was used to simulate the swell and wind-sea climate in the Salish Sea, a large estuary with many interconnected waterways on the Pacific Northwest coast of North America. The model hindcast was validated with observed data at four wave buoys in the Salish Sea. Spatial distribution and seasonal variations of wave climate in the Salish Sea were analyzed. Of the three major basins in the Salish Sea, the Strait of Juan de Fuca has the largest waves and is dominated by swells propagated from the Pacific Ocean. Significant wave heights in the Strait of Georgia have spatial and seasonal distribution patterns similar to those found in the Strait of Juan de Fuca. Waves in Puget Sound are small and primarily dominated by the wind-sea climate. Strong seasonal variations are observed in the Strait of Juan de Fuca and Strait of Georgia, but there is little seasonality of wave climate in Puget Sound. The high-resolution wave hindcast conducted in this study provides a comprehensive and important data set for better understanding the role of wave climate in coastal processes and natural hazards assessment in the Salish Sea.

wave climate, salish sea, modeling, swell, sea sta↗

Large Ensemble Particle Filter for Spatial Climate Reconstructions Using a Linear Inverse Model

Proxy records that document the last 2000 years of climate provide evidence for the wide range of the natural climate variability from inter-annual to secular timescales not captured by the short window of recent direct observations. Assessing climate models ability to reproduce such natural variations is crucial to understand climate sensitivity and impacts of future climate change. Paleoclimate data assimilation (PDA) offers a powerful way to extend the short instrumental period by optimally combining the physics described by General Circulation Climate Models (GCMs) with information from available proxy records while taking into account their uncertainties. Here we present a new PDA approach based on a sequential importance resampling (SIR) Particle filter (PF) that uses Linear Inverse Modeling (LIM) as an emulator of several CMIP-class GCMs. We examine in a perfect-model framework the skill of the various LIMs to forecast the dynamics of the surface temperatures and provide spatial field reconstructions over the last millennium in a SIR PF. Our results show that the LIMs allow for skillful ensemble forecasts at 1-year lead-time based on GCMs dynamical knowledge with best prediction in the tropics and the North Atlantic. The PDA further provides a set of physically consistent spatial fields allowing robust uncertainty quantification related to climate models biases and proxy spatial sampling. Our results indicate that the LIM yields dynamical memory improving climate variability reconstructions and support the use of the LIM as a GCM-emulator in real reconstruction to propagate large ensembles of particles at low cost in SIR PF.

54 ENVIRONMENTAL SCIENCES↗

Contrasting Carbon–Water–Energy Dynamics in Perennial and Annual Bioenergy Agroecosystems Using Eddy Covariance and Interpretable Machine Learning

Understanding how agroecosystems respond to environmental variability is fundamental to predicting productivity and sustainability under a changing climate. We analyzed 55 site-years of high-frequency eddy covariance observations from five agroecosystems—two perennial grasses (miscanthus and switchgrass), two annual rotation systems (maize–soybean and sorghum–soybean), and a restored native prairie—to examine ecosystem-scale carbon, water, and energy fluxes. Using an interpretable machine-learning framework with regression tree ensembles, Shapley Additive Explanations, and Accumulated Local Effects, we quantified how environmental and temporal factors regulate gross primary productivity (GPP), evapotranspiration (ET), water-use efficiency, and the Bowen ratio. Perennials exhibited stronger physiological buffering and maintained fluxes across a broader range of temperature and moisture conditions, reflecting deeper rooting and persistent canopy cover. Annuals, in contrast, showed greater short-term variability and stronger coupling to atmospheric demand, with GPP and ET declining rapidly under low humidity or soil moisture. Differences in temperature sensitivity of Bowen ratio further revealed that perennials sustained proportionally greater sensible heat flux under cool conditions, whereas annuals exhibited constrained energy exchange when evaporative demand was low. Together, these results demonstrate that crop life cycle and canopy structure are fundamental determinants of ecosystem-scale carbon–water–energy coupling. By integrating long-term flux observations with interpretable machine learning, this study identifies the environmental drivers that shape agroecosystem function and highlights how conversion from annual to perennial feedstocks can enhance climatic resilience and alter land–atmosphere energy feedbacks. These findings provide a data-driven basis for improving crop and Earth-system models and for guiding bioenergy landscape design under future climate scenarios.

Accumulated Local Effects↗

Disturbance and Vegetation Dynamics in Earth System Models: Workshop Report

This report summarizes discussion and outcomes from the March 2018 workshop, Disturbance and Vegetation Dynamics in Earth System Models, sponsored by the Office of Biological and Environmental Research (BER) within the U.S. Department of Energy Office of Science. The goals of this workshop, held in Gaithersburg, Maryland, were to (1) identify key uncertainties in current dynamic vegetation models limiting the ability to adequately represent vegetation in Earth System Models (ESMs) and (2) identify and prioritize research directions that can improve models, including forest structural change and feedbacks and responses to disturbance. Failure to capture disturbance dynamics and feedbacks limits the utility of ESMs for predictive understanding and application to societally important problems. This workshop considered (a) dynamic processes that significantly affect terrestrial ecosystems and the coupled Earth system and (b) the data constraints and modeling challenges important for future progress. There were three dominant workshop conclusions: vegetation changes, including disturbance- driven changes, are affecting climate and natural resources; these impacts are expected to increase in the future; and, yet, current models have insufficient data and process representations to adequately predict these changes.

54 ENVIRONMENTAL SCIENCES↗

Parallel k-means Clustering of Geospatial Data Sets Using Manycore CPU Architectures

The increasing availability of high-resolution geospatiotemporal data sets from sources such as observatory networks, remote sensing platforms, and computational Earth system models has opened new possibilities for knowledge discovery and mining of weather, climate, ecological, and other geoscientific data sets fused from disparate sources. Many of the standard tools used on individual workstations are impractical for the analysis and synthesis of data sets of this size; however, new algorithmic approaches that can effectively utilize the complex memory hierarchies and the extremely high levels of parallelism available in state-of-the-art high-performance computing platforms can enable such analysis. Here, we describe pKluster, an open-source tool we have developed for accelerated k-means clustering of geospatial and geospatiotemporal data, and discuss algorithmic modifications and code optimizations we have made to enable it to effectively use parallel machines based on novel CPU architectures—such as the Intel “Knights Landing” Xeon Phi and Skylake Xeon processors—with many cores and hardware threads, and employing significant single instruction, multiple data (SIMD) parallelism. We outline some applications of the code in ecology and climate science contexts and present a detailed discussion of the performance of the code for one such application, LiDAR-derived vertical vegetation structure classification.

Mills, Richard T↗