Search NASA⌕ Search

Engineering topics

Sperber, Kenneth R.

Publications and source records attributed to Sperber, Kenneth R..

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗

Robust evaluation of ENSO in climate models: How many ensemble members are needed?

Large ensembles of model simulations require considerable resources, and thus defining an appropriate ensemble size for a particular application is an important experimental design criterion. We estimate the ensemble size (N) needed to assess a model's ability to capture observed El Niño-Southern Oscillation (ENSO) behavior by utilizing the recently developed International CLIVAR ENSO Metrics Package (Planton et al., 2021). Using the larger ensembles available from CMIP6 and the US CLIVAR Large Ensemble Working Group, we find that larger ensembles are needed to robustly capture baseline ENSO characteristics (N > 50) and physical processes (N > 50) than the background climatology (N ≥ 12) and remote ENSO teleconnections (N ≥ 6). While these results vary somewhat across metrics and models, our study quantifies how larger ensembles are required to robustly evaluate simulated ENSO behavior, thereby providing some guidance for the design of model ensembles.

54 ENVIRONMENTAL SCIENCES↗

Benchmarking performance changes in the simulation of extratropical modes of variability across CMIP generations

In this work, we evaluate extratropical modes of variability in the three most recent phases of the Coupled Model Intercomparison Project (CMIP3, 5, and 6) to gauge improvement of climate models over time. A suite of high-level metrics is employed to objectively evaluate how well climate models simulate the qobserved Northern Annular Mode (NAM), North Atlantic Oscillation (NAO), Pacific North America pattern (PNA), Southern Annular Mode (SAM), Pacific Decadal Oscillation (PDO), North Pacific Oscillation (NPO), and North Pacific Gyre Oscillation (NPGO). We apply a Common Basis Function (CBF) approach that projects model anomalies onto observed empirical orthogonal functions (EOFs), together with the traditional EOF approach, to CMIP Historical and AMIP models. We find simulated spatial patterns of those modes have been significantly improved in the newer models, although the skill improvement is sensitive to the mode and season considered. We identify some potential contributions to the pattern improvement of certain modes (e.g., the Southern Hemisphere jet and High-top vertical coordinate), however the performance changes are likely attributed to gradual improvement of the base climate and multiple relevant processes. Less performance improvement is evident in the mode amplitude of these modes and systematic overestimation of the mode amplitude in spring remains in the newer climate models. We find that the post-dominant season amplitude errors in atmospheric modes are not limited to coupled runs but are often already evident in AMIP simulations. This suggests that rectifying the egregious post-dominant season amplitude errors found in many models can be addressed in an atmospheric-only framework making it more tractable to address in the model development process.

54 ENVIRONMENTAL SCIENCES↗

Representation of Modes of Variability in Six U.S. Climate Models

We compare the performance of several modes of variability across six U.S. climate modeling groups, with a focus on identifying robust improvements in recent models [including those participating in phase 6 of the Coupled Model Intercomparison Project (CMIP)] compared to previous versions. In particular, we examine the representation of the Madden–Julian oscillation (MJO), El Niño–Southern Oscillation (ENSO), the Pacific decadal oscillation (PDO), the quasi-biennial oscillation (QBO) in the tropical stratosphere, and the dominant modes of extratropical variability, including the southern annular mode (SAM), the northern annular mode (NAM) [and the closely related North Atlantic Oscillation (NAO)], and the Pacific–North American pattern (PNA). Where feasible, we explore the processes driving these improvements through the use of “intermediary” experiments that utilize model versions between CMIP3/5 and CMIP6 as well as targeted sensitivity experiments in which individual modeling parameters are altered. We find clear and systematic improvements in the MJO and QBO and in the teleconnection patterns associated with the PDO and ENSO. Some gains arise from better process representation, while others (e.g., the QBO) from higher resolution that allows for a greater range of interactions. Our results demonstrate that the incremental development processes in multiple climate model groups lead to more realistic simulations over time.

54 ENVIRONMENTAL SCIENCES↗

Simulation of the Intraseasonal Variability over the Eastern Pacific ITCZ in Climate Models

During boreal summer, convective activity over the eastern Pacific (EPAC) inter-tropical convergence zone (ITCZ) exhibits vigorous intraseasonal variability (ISV). Previous observational studies identified two dominant ISV modes over the EPAC, i.e., a 40-day mode and a quasi-biweekly mode (QBM). The 40-day ISV mode is generally considered a local expression of the Madden-Julian Oscillation. However, in addition to the eastward propagation, northward propagation of the 40-day mode is also evident. The QBM mode bears a smaller spatial scale than the 40-day mode, and is largely characterized by northward propagation. While the ISV over the EPAC exerts significant influences on regional climate/weather systems, investigation of contemporary model capabilities in representing these ISV modes over the EPAC is limited. In this study, the model fidelity in representing these two dominant ISV modes over the EPAC is assessed by analyzing six atmospheric and three coupled general circulation models (GCMs), including one super-parameterized GCM (SPCAM) and one recently developed high-resolution GCM (GFDL HIRAM) with horizontal resolution of about 50 km. While it remains challenging for GCMs to faithfully represent these two ISV modes including their amplitude, evolution patterns, and periodicities, encouraging simulations are also noted. In general, SPCAM and HIRAM exhibit relatively superior skill in representing the two ISV modes over the EPAC. While the advantage of SPCAM is achieved through explicit representation of the cumulus process by the embedded 2-D cloud resolving models, the improved representation in HIRAM could be ascribed to the employment of a strongly entraining plume cumulus scheme, which inhibits the deep convection, and thus effectively enhances the stratiform rainfall. The sensitivity tests based on HIRAM also suggest that fine horizontal resolution could also be conducive to realistically capture the ISV over the EPAC, particularly for the QBM mode. Further analysis illustrates that the observed 40-day ISV mode over the EPAC is closely linked to the eastward propagating ISV signals from the Indian Ocean/Western Pacific, which is in agreement with the general impression that the 40-day ISV mode over the EPAC could be a local expression of the global Madden-Julian Oscillation (MJO). In contrast, the convective signals associated with the 40-day mode over the EPAC in most of the GCM simulations tend to originate between 150degE and 150degW, suggesting the 40-day ISV mode over the EPAC might be sustained without the forcing by the eastward propagating MJO. Further investigation is warranted towards improved understanding of the origin of the ISV over the EPAC.

Intraseasonal Variability↗

Sun's inertial motion and luminosity

Fast Fourier analysis of the detrended record of solar irradiance obtained by the Nimbus-7 cavity pyrheliometer shows a rich spectrum of significant frequencies between about 30 and 850 nHz (periods between 13 and 400 days). Wolff and Hickey (1987), elaborating on a model developed by Wolff (1974, 1976, 1983, and 1984), suggest that many of these peaks arise due to interference of rigidly rotating global solar oscillations (r- and g-modes). Their model fit is quite good in the region above about 135 nHz, but less satisfactory below this threshold. It is noted that the FFT spectrum of d-sq L/d-sq t, the second derivative of angular momentum of the solar inertial motion, contains peaks matching the large peaks in the irradiance spectrum below 400 nHz with periods near 0.08, 0.24, 0.65, and about 1 yr. The origins of the peaks in the d-sq L/d-sq t spectra are discussed, and some previous studies are reviewed bearing on the question of a possible relationship of solar motion and solar activity.

Sperber, Kenneth R.↗