Search NASA⌕ Search

SEARCH · Search NASA

Results for “Skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Initialized Earth system prediction from subseasonal to decadal timescales

Initialized Earth system predictions are made by starting a numerical prediction model in a state as consistent as possible to observations, and running it forward in time for up to ten years. Skillful predictions at time slices from subseasonal to seasonal (S2S), seasonal to interannual (S2I) and seasonal to decadal (S2D) offer information useful for various stakeholders, from agriculture to water resource management, and human and infrastructure safety. In this Review, we examine the processes influencing predictability, and discuss estimates of skill across S2S, S2I and S2D timescales. There are encouraging signs that skillful predictions can be made: at S2S timescales, there has been some skill in predicting the Madden-Julian Oscillation and North Atlantic Oscillation; at S2I in predicting the El Niño-Southern Oscillation; and at S2D, in predicting variability in North Atlantic sea surface temperatures. However, challenges remain, and future work must prioritise reducing model error, more effectively communicating forecasts to users, and increasing process and mechanistic understanding that could increase predictive skill and, in turn, confidence. As numerical models progress towards Earth system models, initialized predictions are expanding to include prediction of sea-ice, air pollution, terrestrial and ocean biochemistry which can bring clear benefit to society and various stakeholders.

climate prediction↗
DOE OSTI2022

Subseasonal Tropical Cyclone Prediction and Modulations by MJO and ENSO in CESM2

Subseasonal tropical cyclone (TC) reforecasts from the Community Earth System Model version 2 (CAM6) subseasonal prediction system are examined in this study. Here, we evaluate the modeled TC climatology and the probabilistic forecast skill of basin-wide TC genesis at weekly temporal resolution. Prediction skill is calculated using the Brier skill score relative to a constant annual mean climatology and to a monthly varying seasonal climatology during TC season. The model captures the observed basin-wide climatological TC seasonality and spatial distributions at weeks 1–6, but TC genesis is largely underestimated from Week 2 onward. For some basins and lead times, the predicted TC genesis is primarily controlled by the number of TC “seeds” and the mean-state climate condition. The model has good prediction skill relative to the constant climatology across all the basins and lead times, but is only skillful in the eastern Pacific, North Indian Ocean, and Southern Hemisphere at Week 1 when compared to the seasonal climatology, indicating limited skill in predicting deviations from the seasonal cycle. We find strong modulations of the predicted TC genesis at up to 3 weeks of forecast lead time by the Madden-Julian Oscillation. The interannual variability of predicted TC genesis and accumulated cyclone energy are skillfully predicted in the North Atlantic and the Northwestern Pacific, with a strong modulation by the El Nino-Southern Oscillation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Evaluation of Subseasonal-to-Seasonal (S2S) precipitation forecast from the North American Multi-Model ensemble phase II (NMME-2) over the contiguous U.S.

The second phase of the North America Multi-Model Ensemble (NMME-2) provides globally available Subseasonal-to-Seasonal (S2S) precipitation forecasts with a daily resolution. The S2S precipitation forecasts are getting increasing attention for their potentials in providing hydrometeorological forcing information for water resources planning at an extended range. However, the forecast skills of many existing S2S forecast products will significantly decrease when the lead time increases, hindering their applicability for watershed-scale hydrologic modeling. Therefore, forecast validation and large-scale evaluation are of great importance for water resources planning and hydrological applications. In this study, we comprehensively evaluate the S2S precipitation forecasts from the NMME-2 dataset over the contiguous United States (CONUS) and during the study period from 1982 to 2011. Three aspects of precipitation forecast capabilities are compared and analyzed: bias, skill scores, and the ability to predict extreme precipitation events. The Parameter-elevation Regressions on Independent Slopes Model (PRISM) is used as ground truth reference. Differs from other regional forecast validation study, we further examined and analyzed the dependences of NMME-2 precipitation forecast skills according to different seasonality, geographical locations, and lead times. Results show that the forecast biases are not sensitive to lead times but are seasonally dependent of all NMME-2 models. Overestimations are found in the Western U.S. in cooler seasons while underestimations are observed in the central regions of the U.S. in warmer seasons. The forecast skill of all individual NMME-2 models generally decreases as increases of lead times. The simple model averaging (SMA) of five NMME-2 models demonstrates a higher forecast skill than any individual NMME-2 models. Spatially, the highest forecast skill scores are observed at coastal areas in the Western U.S. with an one-week lead time. As compared to the historical resampled forecasts, NMME-2 also shows better performance in predicting extreme precipitation events above 99% percentiles and below 1% percentiles with higher probability of detections and lower false alarm ratios. Finally, the obtained results suggest the great potentials of NMME-2 precipitation forecasts in assisting ensemble hydrologic forecasts at the S2S scale over the CONUS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Winter precipitation predictability in Central Southwest Asia and its representation in seasonal forecast systems

In Central Southwest Asia (CSWA; 22°N to 40°N and 30°E to 70°E), winter (November to February) precipitation contributes up to 70% of the annual mean, but substantial interannual variations exist. Dynamical models exhibit subpar predictability in this region, but the limits of their skills are not well established. Here, we identify the tropical and extratropical forcings that explain ~75% of area-averaged seasonal variability in CSWA winter precipitation. Tropical forcing comes from the indirect El Niño-Southern Oscillation (ENSO) pathway, the leading mode of tropical Indian Ocean precipitation variability. This mode is coupled with ENSO-related Pacific Ocean sea surface temperature variability. A direct ENSO influence on CSWA does not extend beyond its Indian Ocean connection. Extratropical forcing comes from a large-scale mode of internal atmospheric variability. The spatial structure, variability of tropical forcing, and teleconnection with CSWA winter precipitation are skillfully depicted in two seasonal forecasting systems: the fifth-generation seasonal forecasting system (SEAS5) and Seamless System for Prediction and Earth System Research (SPEAR). Extratropical forcing’s spatial structure is also produced skillfully in the two modelling systems; however, the representation of its interannual variability and teleconnection requires improvement. While SEAS5 displays skill in representing extratropical forcing influence on CSWA winter precipitation and marginal skill in reproducing interannual variability, SPEAR has negligible ability in both areas. Consequently, these models have limited predictive skills over CSWA in winter. While improvements in representing extratropical forcing may be inherently limited as it arises from internal atmospheric variability, further research is needed to establish its predictability limits fully.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Evaluating the WFIP2 updates to the HRRR model using scanning Doppler lidar measurements in the complex terrain of the Columbia River Basin

The wind-energy (WE) industry relies on numerical weather prediction (NWP) forecast models as foundational or base models for many purposes, including wind-resource assessment and wind-power forecasting. During the Second Wind Forecast Improvement Project (WFIP2) in the Columbia River Basin of Oregon and Washington, a significant effort was made to improve NWP forecasts through focused model development, to include experimental refinements to the High Resolution Rapid Refresh (HRRR) model physics and horizontal grid spacing. In this study, the performance of an experimental version of HRRR that includes these refinements is tested against a control version, which corresponds to that of the operational HRRR run by National Oceanic and Atmospheric Administration/National Centers for Environmental Protection at the outset of WFIP2. Furthermore, the effects of horizontal grid resolution were also tested by comparing wind forecasts from the HRRR (with 3-km grid spacing) with those from a finer-resolution HRRR nest with 750-m grid spacing. Model forecasts are validated against accurate wind-profile measurements by three scanning, pulsed Doppler lidars at sites separated by a total distance of 71 km. Model skill and improvements in model skill, attributable to physics refinements and improved horizontal grid resolution, varied by season, by site, and during periods of atmospheric phenomena relevant to WE. In general, model errors were the largest below 150 m above ground level (AGL). Experimental HRRR refinements tended to reduce the mean absolute error (MAE) and other error metrics for many conditions, but degradation in skill (increased MAE) was noted below 150 m AGL at the two lowest-elevation sites at night. Finer resolution was found to produce the most significant reductions in the error metrics.

17 WIND ENERGY↗
DOE OSTI2020

Wind ramp events validation in NWP forecast models during the second Wind Forecast Improvement Project (WFIP2) using the Ramp Tool and Metric (RT&M)

The second Wind Forecast Improvement Project (WFIP2) is a multi-agency field campaign held in the Columbia Gorge area (October 2015 - March 2017). The main goal of the project is to understand and improve the forecast skill of numerical weather prediction (NWP) models in complex terrain, particularly beneficial for the wind energy industry. This region is well-known for its excellent wind resource. One of the biggest challenges for wind power production is the accurate forecasting of wind ramp events (large changes of generated power over short periods of time). Poor forecasting of the ramps requires large and sudden adjustments in conventional power generation, ultimately increasing the costs of power. A Ramp Tool and Metric (RT&M) was developed during the first WFIP experiment, held in the U.S. Great Plains (September 2011 - August 2012). The RT&M was designed to explicitly measure the skill of NWP models at forecasting wind ramp events. Here we apply the RT&M to 80-m (turbine hub-height) wind speeds measured by 19 sodars and 3 lidars, and to forecasts from the High Resolution Rapid Refresh (HRRR), 3-km, and from the High Resolution Rapid Refresh Nest (HRRRNEST), 750-m horizontal grid spacing, models. The diurnal and seasonal distribution of ramp events are analyzed, finding a noticeable diurnal variability for spring and summer but less for fall and especially winter. Also, winter has fewer ramps compared to the other seasons. The model skill at forecasting ramp events, including the impact of the modification to the model physical parameterizations, was finally investigated.

Djalalova, Irina V.↗
DOE OSTI2023

Assessing decadal variability of subseasonal forecasts of opportunity using explainable AI

Abstract Identifying predictable states of the climate system allows for enhanced prediction skill on the generally low-skill subseasonal timescale via forecasts with higher confidence and accuracy, known as forecasts of opportunity. This study takes a neural network approach to explore decadal variability of subseasonal predictability, particularly during forecasts of opportunity. Specifically, this work quantifies subseasonal prediction skill provided by the tropics within the Community Earth System Model Version 2 (CESM2) Large Ensemble and assesses how this skill evolves on decadal timescales. Utilizing the networks’ confidence and explainable artificial intelligence, physically meaningful sources of predictability associated with periods of enhanced skill are identified. Using these networks, we find that tropically-driven subseasonal predictability varies on decadal timescales during forecasts of opportunity. Further, we investigate the drivers of the low frequency modulation of the tropical-extratropical teleconnection and discuss the implications. Analysis is extended to ECMWF Reanalysis v5 data, revealing that the relationships learned within the CESM2-Large Ensemble holds in modern reanalysis data. These results indicate that the neural networks are capable of identifying predictable decadal states of the climate system within CESM2 that are useful for making confident, accurate subseasonal precipitation predictions in the real world.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Subseasonal Representation and Predictability of North American Weather Regimes Using Cluster Analysis

Abstract This study focuses on assessing the representation and predictability of North American weather regimes, which are persistent large-scale atmospheric patterns, in a set of initialized subseasonal reforecasts created using the Community Earth System Model, version 2 (CESM2). The k -means clustering was used to extract four key North American (10°–70°N, 150°–40°W) weather regimes within ERA5 reanalysis, which were used to interpret CESM2 subseasonal forecast performance. Results show that CESM2 can recreate the climatology of the four main North American weather regimes with skill but exhibits biases during later lead times with overoccurrence of the West Coast high regime and underoccurrence of the Greenland high and Alaskan ridge regimes. Overall, the West Coast high and Pacific trough regimes exhibited higher predictability within CESM2, partly related to El Niño. Despite biases, several reforecasts were skillful and exhibited high predictability during later lead times, which could be partly attributed to skillful representation of the atmosphere from the tropics to extratropics upstream of North America. The high predictability at the subseasonal time scale of these case-study examples was manifested as an “ensemble realignment,” in which most ensemble members agreed on a prediction despite ensemble trajectory dispersion during earlier lead times. Weather regimes were also shown to project distinct temperature and precipitation anomalies across North America that largely agree with observational products. This study further demonstrates that unsupervised learning methods can be used to uncover sources and limits of subseasonal predictability, along with systematic biases present in numerical prediction systems. Significance Statement North American weather regimes are large-scale atmospheric patterns that can persist for several days. Their skillful subseasonal (2 weeks or greater) prediction can provide valuable lead time to prepare for temperature and precipitation anomalies that can stress energy and water resources. The purpose of this study was to assess the climatological representation and subseasonal predictability of four key North American weather regimes using a research subseasonal prediction system and clustering analysis. We found that the Pacific trough and West Coast high regimes exhibited higher predictability than other regimes and that skillful representation of conditions across the tropics and extratropics can increase predictability during later lead times. Future work will quantify causal pathways associated with high predictability.

58 GEOSCIENCES↗
DOE OSTI2022

Subseasonal Earth System Prediction with CESM2

Abstract Prediction systems to enable Earth system predictability research on the subseasonal time scale have been developed with the Community Earth System Model, version 2 (CESM2) using two configurations that differ in their atmospheric components. One system uses the Community Atmosphere Model, version 6 (CAM6) with its top near 40 km, referred to as CESM2(CAM6). The other employs the Whole Atmosphere Community Climate Model, version 6 (WACCM6) whose top extends to ∼140 km, and it includes fully interactive tropospheric and stratospheric chemistry [CESM2(WACCM6)]. Both systems are utilized to carry out subseasonal reforecasts for the 1999–2020 period following the Subseasonal Experiment’s (SubX) protocol. Subseasonal prediction skill from both systems is compared to those of the National Oceanic and Atmospheric Administration CFSv2 and European Centre for Medium-Range Weather Forecasts (ECMWF) operational models. CESM2(CAM6) and CESM2(WACCM6) show very similar subseasonal prediction skill of 2-m temperature, precipitation, the Madden–Julian oscillation, and North Atlantic Oscillation to its previous version and to the NOAA CFSv2 model. Overall, skill of CESM2(CAM6) and CESM2(WACCM6) is a little lower than that of the ECMWF system. In addition to typical output provided by subseasonal prediction systems, CESM2 reforecasts provide comprehensive datasets for predictability research of multiple Earth system components, including three-dimensional output for many variables, and output specific to the mesosphere and lower-thermosphere (MLT) region from CESM2(WACCM6). It is shown that sudden stratosphere warming events, and the associated variability in the MLT, can be predicted ∼10 days in advance. Weekly real-time forecasts and reforecasts with CESM2(CAM6) and CESM2(WACCM6) are freely available. Significance Statement We describe here the design and prediction skill of two subseasonal prediction systems based on two configurations of the Community Earth System Model, version 2 (CESM2): CESM2 with the Community Atmosphere Model, version 6 [CESM2(CAM6)] and CESM 2 with Whole Atmosphere Community Climate Model, version 6 [CESM2(WACCM6)] as its atmospheric component. These two systems provide a foundation for community-model based subseasonal prediction research. The CESM2(WACCM6) system provides a novel capability to explore the predictability of the stratosphere, mesosphere, and lower thermosphere. Both CESM2(CAM6) and CESM2(WACCM6) demonstrate subseasonal surface prediction skill comparable to that of the NOAA CFSv2 model, and a little lower than that of the ECMWF forecasting system. CESM2 reforecasts provide a comprehensive dataset for predictability research of multiple aspects of the Earth system, including the whole atmosphere up to 140 km, land, and sea ice. Weekly real-time forecasts, reforecasts, and models are publicly available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Predicting spring phenology in deciduous broadleaf forests: NEON phenology forecasting community challenge

Accurate models are important to predict how global climate change will continue to alter plant phenology and near-term ecological forecasts can be used to iteratively improve models and evaluate predictions that are made a priori. The Ecological Forecasting Initiative's National Ecological Observatory Network (NEON) Forecasting Challenge, is an open challenge to the community to forecast daily greenness values, measured through digital images collected by the PhenoCam Network at NEON sites before the data are collected. For the first round of the challenge, which is presented here, we forecasted canopy greenness throughout the spring at eight deciduous broadleaf sites to investigate when, where, and for what model type phenology forecast skill is highest. A total of 192,536 predictions were submitted, representing eighteen models, including a persistence and a day of year mean null models. We found that overall forecast skill was highest when forecasting earlier in the greenup curve compared to the end, for shorter lead times, for sites that greened up earlier, and when submitting forecasts during times other than near budburst. The models based on day of year historical mean had the highest predictive skill across the challenge period. In this first round of the challenge, by synthesizing across forecasts, we started to elucidate what factors affect the predictive skill of near-term phenology forecasts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Optimizing Earthquake Nowcasting With Machine Learning: The Role of Strain Hardening in the Earthquake Cycle

Abstract Nowcasting is a term originating from economics, finance, and meteorology. It refers to the process of determining the uncertain state of the economy, markets or the weather at the current time by indirect means. In this paper, we describe a simple two‐parameter data analysis that reveals hidden order in otherwise seemingly chaotic earthquake seismicity. One of these parameters relates to a mechanism of seismic quiescence arising from the physics of strain‐hardening of the crust prior to major events. We observe an earthquake cycle associated with major earthquakes in California, similar to what has long been postulated. An estimate of the earthquake hazard revealed by this state variable time series can be optimized by the use of machine learning in the form of the Receiver Operating Characteristic skill score. The ROC skill is used here as a loss function in a supervised learning mode. Our analysis is conducted in the region of 5° × 5° in latitude‐longitude centered on Los Angeles, a region which we used in previous papers to build similar time series using more involved methods (Rundle & Donnellan, 2020, https://doi.org/10.1029/2020EA001097 ; Rundle, Donnellan et al., 2021, https://doi.org/10.1029/2021EA001757 ; Rundle, Stein et al., 2021, https://doi.org/10.1088/1361-6633/abf893 ). Here we show that not only does the state variable time series have forecast skill, the associated spatial probability densities have skill as well. In addition, use of the standard ROC and Precision (PPV) metrics allow probabilities of current earthquake hazard to be defined in a simple, straightforward, and rigorous way.

58 GEOSCIENCES↗
DOE OSTI2022

Clinical practice gaps and challenges in non‐alcoholic steatohepatitis care: An international physician needs assessment

Abstract Background and aims Even as several pharmacological treatments for non‐alcoholic steatohepatitis (NASH) are in development, the incidence of NASH is increasing on an international scale. We aim to assess clinical practice gaps and challenges of hepatologists and endocrinologists when managing patients with NASH in four countries (Germany/Italy/United Kingdom/United States) to inform educational interventions. Methods A sequential mixed‐method design was used: qualitative semi‐structured interviews followed by quantitative online surveys. Participants were hepatologists and endocrinologists practising in one of the targeted countries. Interview data underwent thematic analysis and survey data were analysed with chi‐square and Kruskal‐Wallis tests. Results Most interviewees ( n = 24) and surveyed participants (89% of n = 224) agreed that primary care must be involved in screening for NASH, yet many faced challenges involving and collaborating with them. Endocrinologists reported low knowledge of which blood markers to use when suspecting NASH (56%), when to order an MRI (65%) or ultrasound/FibroScan® (46%), and reported sub‐optimal skills interpreting alanine aminotransferase (ALT, 37%) and aspartate aminotransferase (AST, 38%) blood marker test results, causing difficulty during diagnosis. Participants believed that more evidence is needed for upcoming therapeutic agents; yet, they reported sub‐optimal knowledge of eligibility criteria for clinical trials. Knowledge and skill gaps when managing comorbidities, as well as skill gaps facilitating patient lifestyle changes were reported. Conclusions Educational interventions are needed to address the knowledge and skill gaps identified and to develop strategies to optimize patient care, which include implementing relevant care pathways, encouraging referrals and testing, and multidisciplinary collaboration, as suggested by the recent Global Consensus statement on NAFLD.

Lazure, Patrice↗
DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗
DOE OSTI2024

Understanding the Biases in Global Monsoon Simulations from the Perspective of Atmospheric Energy Transport

Understanding global monsoon (GM) variability and projecting its future changes rely heavily on climate models. However, climate models generally show pronounced biases in GM simulations, and the reasons for this remain unclear. Here, in this study, we evaluate the performance of 20 pairs of climate models that participated in both phase 5 of the Coupled Model Intercomparison Project (CMIP5) and phase 6 of CMIP (CMIP6) and identify the sources of their GM simulation biases from an energy transport perspective. The multimodel mean improvement in CMIP6 compared to CMIP5 is demonstrated by the increasing skill scores for various GM metrics from 0.20–0.79 to 0.48–0.83. More specifically, the dry biases in the Northern Hemisphere Summer Monsoon (NHSM) precipitation in CMIP5 [root-mean-square error (RMSE): 1.85 mm day −1 ] are reduced in CMIP6 (RMSE: 1.66 mm day −1 ). This higher simulation skill is associated with higher skill in simulating the precipitation-solstitial mode, monsoon intensity, and monsoon domains. The improvement in the NHSM precipitation simulation results from that in the meridional transport of atmospheric energy. Atmospheric energy budget analysis shows that the negative biases in downward surface longwave radiation and northward energy transport are smaller in CMIP6 than in CMIP5 in the boreal summer, resulting in a more realistic interhemispheric thermal contrast and meridional gradient of moist static energy. However, a major weakness of the CMIP6 models is found in the Southern Hemisphere Summer Monsoon precipitation simulation due to the positive bias in the top-of-the-atmosphere downward longwave radiation. This study shows that reasonably reproducing the meridional global atmospheric energy transportation is necessary for skillful GM simulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Subseasonal prediction with and without a well-represented stratosphere in CESM1

There is a growing demand for understanding sources of predictability on subseasonal to seasonal (S2S) time scales. Predictability at subseasonal time scales is believed to come from processes varying slower than the atmosphere such as soil moisture, snowpack, sea ice, and ocean heat content. The stratosphere as well as tropospheric modes of variability can also provide predictability at subseasonal time scales. Furthermore, the contributions of the above sources to S2S predictability are not well quantified. Here we evaluate the subseasonal prediction skill of the Community Earth System Model, version 1 (CESM1), in the default version of the model as well as a version with the improved representation of stratospheric variability to assess the role of an improved stratosphere on prediction skill. We demonstrate that the subseasonal skill of CESM1 for surface temperature and precipitation is comparable to that of operational models. We find that a better-resolved stratosphere improves stratospheric but not surface prediction skill for weeks 3–4.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Mid-Century Net-Zero Scenario for the State of Wyoming and its Economic Impacts

Clean hydrogen has the potential to help achieve 10% economy-wide emissions reductions by 2050 relative to 2005, promote energy security and resilience, and develop a new economy in the United States. In 2030, the hydrogen economy could create about 100,000 new jobs to build new capital projects and clean hydrogen infrastructure. The Wyoming Energy Authority recently announced the state’s energy strategy, which establishes a goal of net-zero emissions by 2050. Under all likely scenarios, achieving a mid-century net-zero target will pose challenges and create opportunities for Wyoming’s energy sector. If executed properly, the transition could favorably affect the state’s economy overall in the long term. This research program examines the economic impact of fossil energy production in Wyoming and provides various predictions for future energy mixes to achieve net-zero emissions. Preliminary work suggests that Wyoming-based hydrogen production could have significant economic benefits and job creation implications for Wyoming. This study further assesses Wyoming’s opportunities to create hydrogen-based industries, assess economic impacts, identify knowledge gaps and research needs, and create a Hydrogen Center of Excellence to accelerate commercialization and deployment. This project helped to understand Wyoming's areas of focus for research and development and identified its areas of strength and potential challenges in creating a hydrogen ecosystem. As a result of this study, we estimate that for blue hydrogen produced from coal and gas resources, the overall cost reduction will be driven mainly by the carbon-sequestration tax credit and the improvement in carbon capture. Mature technologies, like SMR and PSA, will make limited contributions. They have no or limited reductions from an additional capacity deployment in future costs. We also understand the importance of continued support from public and private sectors for Carbon Capture and Storage (CCS)-related research, development, and demonstration programs at federal and state levels. The successful and efficient production of blue hydrogen requires a unique blend of energy resources, geology, regulation, law, and infrastructure. Wyoming has the distinction of meeting all these demands. The team also estimates that the availability and command of water resources accessible for hydrogen production are crucial for developing new projects. Water treatment, use, and disposal after treatment will also make projects possible. Primarily, this is relevant for hydrogen made using renewable energy. Wyoming has one of the best wind resource capacity in the nation. Harnessing this resource is challenging due to limited transmission line availability. Hydrogen could become one of the solutions to the stranded resource problem, primarily if the water availability challenge is addressed. Using produced oil & gas water could help to solve the problem. A commonly cited barrier to the expansion of hydrogen markets is the cost associated with constructing new pipelines, which typically require large amounts of capital to develop. Wyoming already possesses much of the export infrastructure needed to connect Wyoming’s hydrogen production with major markets across the West Coast, Pacific Northwest, Midwest, and Front Range regions of the United States, where a large portion of Wyoming’s natural gas is already transported. In addition to transportation by pipeline, rail transportation of hydrogen has also proven feasible. Wyoming uses its extensive railway system to transport large amounts of coal to its export partners across the United States. By using cryogenic or compressed-gas cars, Wyoming has the potential to add hydrogen to its existing network of railroad energy exports. The same technology may also be applied to hydrogen transport via trucks traveling interstate highways. Wyoming’s workforce is ready to meet the demands of clean hydrogen development. Many of the skills and training needed for hydrogen production are the same skills already possessed by Wyoming’s oil & gas and coal workforce. Many government and industry leaders expect clean hydrogen and other low-carbon energy projects to generate significant job growth and to recruit many already-trained oil & gas and coal workers whose jobs may be displaced. As energy companies seek to penetrate the markets for Wyoming hydrogen production, there is a natural mutual benefit to Wyoming’s workers and companies seeking to launch projects with the assistance of a trained workforce. Wyoming’s university and community college system have adopted several programs to ensure that highly qualified engineers and other technically skilled employees continue to graduate with skills to support the development of hydrogen and other innovative energy projects moving forward. Throughout the project, stakeholder outreach and education took many forms, including meetings with several major companies in the industry, collaborating with local government organizations, educational organizations, and national laboratories, tribal outreach and engagement, the sponsoring of several hydrogen-focused projects in many departments throughout the University of Wyoming, and developing a collaboration with international universities. The products of these collaborations consist of working relationships with several companies in the industry, educational institutions, national labs, and local government, as well as strong connections with individuals who will play an essential role in the success of the Hydrogen Energy Research Center.

08 HYDROGEN↗