Search NASA⌕ Search

SEARCH · Search NASA

Results for “Skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
DOE OSTI2020

14 Steps to Creating Value in Cost and Schedule Resources for Nuclear Waste Management - 20188

While Waste Management budgets are shrinking, DOE required cost and schedule controls are becoming increasingly stringent. At the same time, there is a scarcity of adept, qualified, and competent projects controls staff who both understand nuclear waste management and are capable of addressing today's cost and schedule challenges. In response, we have developed a systematic approach to training and mentoring project controls staff. The approach is based on the observations and lessons learned on projects, both successful and unsuccessful, over the past 20 years. During that time, we evaluated staff development and used that experience to design a program that progresses the maturity, knowledge and experience of the individual. The program is based on the unique needs of cost and schedule specialists while incorporating the best leadership and managerial applications. The system is not limited to developing individual software skills, which is a primary focus of many project controls training programs. Instead, our system develops an individual's soft and hard skill sets. The system develops the user's skill, talent, attitude, and drive to do the best job possible. It focuses on all aspects of becoming a more productive technical team while accepting responsibility for individual growth. It also enhances the project controls team by setting up checks and balances that everyone is aware of and participates in. The system is based on 14 steps of increasing complexity in knowledge and application. The system clarifies roles, responsibilities and expectations. It helps eliminate uncertainty and reduces stress on staff and managers. It contains everyday routine actions and is simple to implement. It allows the development of a consistent rhythm to staff growth and development. Mastering the steps will allow the user to achieve excellence in cost and schedule control. The 14 steps are: 1 - Key Performance Objectives, 2 - Check Lists, 3 - Desktop Guides, 4 - System Description, 5 - Procedures, 6 - Software and On the Job Training (OTJ), 7 - Traceability Checks, 8 - Surveillances, 9 - 32 Criteria, 10 - The Contract, 11 - Customer/Government Guidance, 12 - Training and Mentoring Others, 13 - Master your weekly and daily schedules, 14 - Improving your interpersonal skills. Application and mastery of this system will produce better cost and schedule control results. Your project controls staff will write better reports, analyze data better, make better use of their time, and be more valuable to decision makers. If followed rigorously, our system will produce a great project controls team, which is invaluable to the success of each project. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Projected increase of the East Asian summer monsoon ( Meiyu ) in Taiwan by climate models with variable performance

Abstract The active phase of the East Asian summer monsoon (EASM) in Taiwan during May and June, known as Meiyu , produces substantial precipitation for water uses in all sectors of society. Following a companion study that analysed the historical increase in the Meiyu precipitation, the present study conducted model evaluation and diagnosis based on the EASM lifecycle over Taiwan. Higher and lower skill groups were identified from 17 Couple Model Intercomparison Project Phase 5 (CMIP5) models, with five models in each group. Despite the difference in model performance, both groups projected a substantial increase in the Meiyu precipitation over Taiwan. In the higher skill group, weak circulation changes and reduced low‐level convergence point to a synoptically unfavourable condition for precipitation. In the lower skill group, intensified low‐level southwesterly winds associated with a deepened upper level trough enhance moisture pooling. Thus, the projected increase in Meiyu precipitation will likely occur through the combined effects of (1) the extension of a strengthened North Pacific anticyclone enhancing southwesterlies; and (2) more systematically, the Clausius–Clapeyron relationship that increases precipitation intensity in a warmer climate. The overall increase in the Meiyu precipitation projected by climate models of variable performance supports the observed tendency toward more intense rainfall in Taiwan and puts its early June 2017 extreme precipitation events into perspective.

Tung, Yu‐Shiang↗
DOE OSTI2024

Predictability of the early summer surface air temperature over Western South Asia

Variability of the Surface Air Temperature (SAT) over the Western South Asia (WSA) region leads to frequent heatwaves during the early summer (May-June) season. The present study uses the European Centre for Medium-Range Weather Forecast’s fifth-generation seasonal prediction system, SEAS5, from 1981 to 2022 based on April initial conditions (1-month lead) to assess the SAT predictability during early summer season. The goal is to evaluate the SEAS5’s ability to predict the El Niño-Southern Oscillation (ENSO) related interannual variability and predictability of the SAT over WSA, which is mediated through upper-level (200-hPa) geopotential height anomalies. This teleconnection leads to anomalously warm surface conditions over the region during the negative ENSO phase, as observed in the reanalysis and SEAS5. We evaluate SEAS5 prediction skill against two observations and three reanalyses datasets. The SEAS5 SAT prediction skill is higher with high spatial resolution observations and reanalysis datasets compared to the ones with low-resolution. Overall, SEAS5 shows reasonable skill in predicting SAT and its variability over the WSA region. Moreover, the predictability of SAT during La Niña is comparable to El Niño years over the WSA region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating Multimodel Ensemble Seasonal Climate Forecasts on Rangeland Plant Production in the California Annual Grassland

Seasonal precipitation and temperature directly affect total plant production in the California Annual Grassland (CAG). Technological advances have resulted in skillful seasonal climate forecasts (i.e., significant correlations between actual and forecasted climate), which could be input into plant production models to inform stocking and other rangeland management decisions. This study presents a procedure for forecasting plant production in the CAG ecosystem to predict annual plant production for grazing, restoration, or other rangeland management practices using a combination of historical gridMET climate data and seasonal hindcasts (i.e., retrospective forecasts, from the North American Multi-Model Ensemble program). Further, the results of this study first confirmed high forecast skill, throughout the growing season at all sites. We also identified skillful plant production forecasts across most of the growing season at two sites and in three of the seven forecasting months at one study site. Forecasting climate and end-of-year plant production across the growing season at three CAG sites allowed us to identify the places and times in the growing season when forecasting might be most helpful in informing management decisions. Integrating plant production forecasting into rangeland management practices could significantly improve rangeland management outcomes. These procedures provide a user guide for creating plant production forecasts for any given area of interest and may be applicable across a wide range of other agricultural and rangeland management systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluating wind speed and power forecasts for wind energy applications using an open-source and systematic validation framework

Building on the verification and validation work developed under the Second Wind Forecast Improvement Project, this work exhibits the value of a consistent procedure to evaluate wind power forecasts. We established an open-source Python code base tailored for wind speed and wind power forecast validation, WE-Validate. The code base can evaluate model forecasts with observations in a coherent manner. To demonstrate the systematic validation framework of WE-Validate, we designed and hosted a forecast evaluation benchmark exercise. We invited forecast providers in industry and academia to participate and submit forecasts for two case studies. We then evaluated the submissions with WE-Validate. Our findings suggest that ensemble means have reasonable skills in time series forecasting, whereas they are often inferior to single ensemble members in wind ramp forecasting. Adopting a voting scheme in ramp forecasting that allows ensemble members to detect ramps independently leads to satisfactory skill scores. Throughout this document, we also emphasize the importance of using statistically robust and resistant metrics as well as equitable skill scores in forecast evaluation.

17 WIND ENERGY↗
DOE OSTI2022

Seasonality of Interbasin SST Contributions to Atlantic Tropical Cyclone Activity

Abstract Recent studies have demonstrated that the difference in sea surface temperature anomalies (SSTAs) between the tropical Atlantic main development region (MDR) and the tropical Pacific (Niño 3) modulates Atlantic tropical cyclone activity. This study further explores the seasonality of Pacific and Atlantic contributions to Atlantic hurricane activity. Our analysis shows that while MDR and Niño 3 SSTAs are equally important for late‐season (September–November) activity, early‐season (June‐August) activity is largely modulated by MDR SSTAs. This reflects the increased (reduced) variance of MDR (Niño 3) SSTAs in the early‐season due to their phase locking to the seasonal cycle. Further analysis yields skillful forecasts using an MDR‐Niño 3 interbasin index derived from hindcasts of the North American Multi‐Model Ensemble with May initial conditions. However, the prediction skill for MDR SSTAs is lower than that of Niño 3 SSTAs, suggesting that increasing the prediction skill for MDR SSTAs is key to improving seasonal outlooks.

West, Robert↗
DOE OSTI2022

Short–Term Forecasting of Wind Gusts at Airports Across CONUS Using Machine Learning

Short–term forecasting of wind gusts, particularly those of higher intensity, is of great societal importance but is challenging due to the presence of multiple gust generation mechanisms. Wind gust observations from eight high–passenger–volume airports across the continental United States (CONUS) are summarized and used to develop predictive models of wind gust occurrence and magnitude. These short–term (same hour) forecast models are built using multiple logistic and linear regression, as well as artificial neural networks (ANNs) of varying complexity. A suite of 19 upper–air predictors drawn from the ERA5 reanalysis and an autoregressive (AR) term are used. Stepwise procedures instruct predictor selection, and resampling is used to quantify model stability. All models are developed separately for the warm (April–September) and cold (October–March) seasons. Results show that ANNs of 3–5 hidden layers (HLs) generally exhibit higher hit rates than logistic regression models and also improve skill with respect to wind gust magnitudes. However, deeper networks with more HLs increase false alarm rates in occurrence models and mean absolute error in magnitude models due to model overfitting. For model skill, inclusion of the AR term is critical while the majority of the remaining skill derives from wind speeds and lapse rates. A predictive ceiling is also clearly demonstrated, particularly for the strong and damaging gust magnitudes, which appears to be partially due to ERA5 predictor characteristics and the presence of mixed wind climates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Optimizing Seasonal‐To‐Decadal Analog Forecasts With a Learned Spatially‐Weighted Mask

Abstract Seasonal‐to‐decadal climate prediction is crucial for decision‐making in a number of industries, but forecasts on these timescales have limited skill. Here, we develop a data‐driven method for selecting optimal analogs for seasonal‐to‐decadal analog forecasting. Using an interpretable neural network, we learn a spatially‐weighted mask that quantifies how important each grid point is for determining whether two climate states will evolve similarly. We show that analogs selected using this weighted mask provide more skillful forecasts than analogs that are selected using traditional spatially‐uniform methods. This method is tested on two prediction problems using the Max Planck Institute for Meteorology Grand Ensemble: multi‐year prediction of North Atlantic sea surface temperatures, and seasonal prediction of El Niño Southern Oscillation. This work demonstrates a methodical approach to selecting analogs that may be useful for improving seasonal‐to‐decadal forecasts and understanding their sources of skill.

Geology↗
DOE OSTI2024

Computing in AEC Education: Hindsight, Insight, and Foresight

In the architecture, engineering, and construction (AEC) fields, computing and information technologies play an increasingly prevalent and complex role in day-to-day work. Consequently, educators must adjust and, in many cases, reimagine curricula and teaching methodologies to adapt to the changing landscape. Past research efforts led by the ASCE Computing Division Education Committee, formerly called the Task Committee on Computing Education of the Technical Council on Computing and Information Technology (TCCIT), have regularly surveyed AEC educators to understand computing trends in AEC curricula, with the latest survey taking place nearly a decade ago. This work presents the results of an updated survey that used this prior work as a springboard, providing timely insights into the computing skills and curricular barriers faced by AEC educators today. The results showed that the technical skills used by students have evolved, but the barriers faced in incorporating new skills into curricula have remained largely the same. In addition to comparisons with prior surveys, this work presents the results of an expanded, open-ended portion of the survey that explores educator perspectives on the future of the AEC workforce in a broader lens than used in previous surveys. Thematic analysis of these open-ended responses revealed themes that were common among responses and provided organization to the findings. For example, educators provided their vision of what competencies the future AEC workforce would need, which were thematically organized into a continuum based on the level of interaction between humans and technology. These results suggest an increasingly complex and evolving relationship between the AEC workforce and emerging technology, highlighting the need for educators to encourage the development of technological adaptability and agility. Overall, this work provides a systematic comparison of current educational practices in AEC computing with a decade ago to illustrate educational shifts and adds a prediction of AEC trends from experts in AEC education, providing crucial discussion of curricular transformations that will better position students for success in the workforce.

42 ENGINEERING↗
DOE OSTI2020

GHEP WIBT (Guidelines for Home Energy Professionals Weatherization Installer Badges Toolkit) [SWR-20-69]

The National Renewable Energy Laboratory (NREL) and the U.S. Department of Energy's (DOE) Weatherization Assistance Program (WAP) are collaborating with the home energy retrofit industry to support the development of skilled workers. The Installer Badges Toolkit provides a flexible, customizable, and voluntary approach to training and skills recognition for WAP implementers, utility programs, private-sector workers, and contractors. In Fiscal Year 2018, DOE, along with the Crew Leader scheme committee, determined the Retrofit Installer Technician (RIT) Job Task Analysis (JTA) could be eliminated and its tasks inserted in the Crew Leader JTA. The RIT tasks became the basis of the Installer Badges. The Badges Toolkit was updated in 2020 to add licensing and copyright agreements. Users must cite the copyright information when using or distributing copies of the Badges Toolkit in any way. The technical content has remained unchanged from previous versions of the Badges Toolkit. The Toolkit for home retrofits consists of 25 Badges, each representing different energy efficiency tasks that an installer could perform on a home. Each Badge defines the desired outcome, criteria to verify, applicable material requirements, and references to Standard Work Specifications (SWS) or other relevant standards. The Badges provide a consistent approach to training by ensuring that installers in different regions are learning the same skills nationwide. Organizations can also customize the Toolkit by choosing only those Badges that are relevant to their program. The Badges Toolkit includes five pieces: "How to Use the Badges Toolkit" provides a brief overview of how a Grantee, Subgrantee, or training provider may approach using the toolkit. The "Badges Toolkit: Worksheet" includes what to consider when determining whether and how to best incorporate the Badges into a weatherization assistance program. The "Crew Leader Job Task Analysis Spreadsheet" indicates how the Badges align with specific areas of the JTA. The "Installer Badges Passport" features separate pages for each Badge, which include places for the installer and the supervisor/trainer to record the number of times a task has been successfully completed. The "Installer Badges Verification Criteria" includes sample inspection checklists for each Badge. These can be modified as needed based on approved variance requests or more stringent requirements. They also provide a basis for consistent inspections and awarding of Badges. Note: All elements of the Badges Toolkit are designed for use by potential program implementers. They are not off-the-shelf products intended for immediate deployment. Program implementers must review and modify as needed, revise verification criteria to match local requirements, complete worksheets, and otherwise define the parameters of their own badging program.

Desai, Jal↗
DOE OSTI2020

PERSIANN Dynamic Infrared–Rain Rate Model (PDIR) for High-Resolution, Real-Time Satellite Precipitation Estimation

Precipitation measurements with high spatiotemporal resolution are a vital input for hydrometeorological and water resources studies; decision-making in disaster management; and weather, climate, and hydrological forecasting. Moreover, real-time precipitation estimation with high precision is pivotal for the monitoring and managing of catastrophic hydroclimate disasters such as flash floods, which frequently transpire after extreme rainfall. While algorithms that exclusively use satellite infrared data as input are attractive owing to their rich spatiotemporal resolution and near-instantaneous availability, their sole reliance on cloud-top brightness temperature (T b ) readings causes underestimates in wet regions and overestimates in dry regions—this is especially evident over the western contiguous United States (CONUS). We introduce an algorithm, the Precipitation Estimations from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN) Dynamic Infrared–Rain rate model (PDIR), which utilizes climatological data to construct a dynamic (i.e., laterally shifting) T b –rain rate relationship that has several notable advantages over other quantitative precipitation-estimation algorithms and noteworthy skill over the western CONUS. Validation of PDIR over the western CONUS shows a promising degree of skill, notably at the annual scale, where it performs well in comparison to other satellite-based products. Analysis of two extreme landfalling atmospheric rivers show that solely IR-based PDIR performs reasonably well compared to other IR- and PMW-based satellite rainfall products, marking its potential to be effective in real-time monitoring of extreme storms. This research suggests that IR-based algorithms that contain the spatiotemporal richness and near-instantaneous availability needed for rapid natural hazards response may soon contain the skill needed for hydrologic and water resource applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A Bayesian Approach to Regional Decadal Predictability: Sparse Parameter Estimation in High-Dimensional Linear Inverse Models of High-Latitude Sea Surface Temperature Variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies—typically focusing more on tropical or midlatitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation–dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on 1) estimating parameter values on a perfect model experiment and 2) producing calibrated 1-yr SST anomaly forecast distributions using a preindustrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which an LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model’s ability to capture variability of SST anomalies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Differential Credibility of Climate Modes in CMIP6

This work quantitatively evaluates the fidelity with which the northern annular mode (NAM), southern annular mode (SAM), Pacific–North American pattern (PNA), El Niño–Southern Oscillation (ENSO), Pacific decadal oscillation (PDO), Atlantic multidecadal oscillation (AMO), and the first-order mode interactions are represented in Earth system model (ESM) output from the CMIP6 archive. Several skill metrics are used as part of a differential credibility assessment (DCA) of both spatial and temporal characteristics of the modes across ESMs, ESM families, and specific ESM realizations relative to ERA5. The spatial patterns and probability distributions are generally well represented but skill scores that measure the degree to which the frequencies of maximum variance are captured are consistently lower for most ESMs and climate modes. Substantial variability in skill scores manifests across realizations from individual ESMs for the PNA and oceanic modes. Further, the ESMs consistently overestimate the strength of the NAM–PNA first-order interaction and underestimate the NAM–AMO connection. Furthermore, these results suggest that the choice of ESM and ESM realizations will continue to play a critical role in determining climate projections at the global and regional scale at least in the near term.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based

Abstract Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evolution of the Internal Climate Modes under Future Warming

Abstract Climate modes play an important role in weather and climate variability over multiple spatial and temporal scales. This research assesses Earth system model (ESM) projections of the spatiotemporal characteristics of key internal climate modes (NAM, SAM, PNA, ENSO, PDO, and AMO) under high (SSP585) and low (SSP126) radiative forcing scenarios and contextualizes those projections using historical fidelity. Time series analyses are used to assess trends and mode phase characteristics are summarized for the historical period and for the end of the twenty-first century. Spatial patterns are compared to infer morphological changes. Shifts in the power spectra are used to examine changes in variability at subannual, interannual, and interdecadal scales. Changes in time-lagged correlations are used to capture the evolution of first-order interactions. While differences in historical skill are predominantly ESM dependent, changing mode characteristics in a warmer climate also exhibit variability between individual ensemble realizations. NAM, SAM, and ENSO tend to evolve toward increased prevalence of the positive phase up to 2100 across the multimodel ensemble while the PNA and PDO exhibit little trend but increasing phase intensity. AMO characteristics are shown to depend on the method used to remove the external signal. ESMs that show higher historical fidelity tend to show more modest changes in those modes under global nonstationarity. Changes in mode interactions are found to be highly ESM dependent but exhibit broadly similar behavior to historical relationships. These findings have implications for our understanding of internal variability and make clear that the choice of ESM, and even the ESM realization, matters for applications of climate projections. Significance Statement Internal modes of variability are important to understand due to their impact on local, regional, and global weather and climate patterns. Future climate changes will not only be affected by the variability arising from these modes, but the modes will themselves change in response to the changing climate. Spatial and temporal aspects of the modes are assessed from projections of future climate and related to how well they are captured in the historical climate. This yields some measure of confidence in the changes exhibited by the models. In most cases, when historically skillful models exhibit changes that are different from those produced by less skillful models, they tend to produce more modest changes. These results, as well as the variability between model outcomes, mean decisions on which ESM to use for projections of the future climate matter significantly.

Meteorology & Atmospheric Sciences↗
DOE OSTI2026

Forced Component Estimation Statistical Method Intercomparison Project (ForceSMIP)

Anthropogenic climate change is unfolding rapidly, yet its regional manifestation can be obscured by internal variability. A primary goal of climate science is to identify the externally forced climate response from among the noise of internal variability. Separating the forced response from internal variability can be addressed in climate models by using a large ensemble to average over different possible realizations of internal variability. However, with only one realization of the real world, it is a major challenge to isolate the forced response directly in observations. In the Forced Component Estimation Statistical Method Intercomparison Project (ForceSMIP), contributors used existing and newly developed statistical and machine learning methods to estimate the forced response over 1950–2022 within individual realizations of the climate system. Participants used neural networks, linear inverse models, fingerprinting methods, and low-frequency component analysis, among other approaches. These methods were trained using large ensembles from multiple climate models and then applied to observations. Here, we evaluate method performance within large ensembles and investigate the estimates of the forced response in observations. Our results show that many different types of methods are skillful for estimating the forced response in climate models, though the relative skill of individual methods varies depending on the variable and evaluation metric. Methods with comparable skill in models can give a wide range of estimates of the forced response pattern in observations, illustrating the epistemic uncertainty in forced response estimates. ForceSMIP gives new insights into the forced response in observations, its uncertainty, and methods for its estimation.

Climate attribution↗