Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Mesoscale to Microscale Simulations over Complex Terrain with the Immersed Boundary Method in the Weather Research and Forecasting Model

Improvements to the Weather Research and Forecasting (WRF) Model are made to enable multiscale simulations over highly complex terrain with dynamically downscaled boundary conditions from the mesoscale to the microscale. Over steep terrain, the WRF Model develops numerical errors that are due to grid deformation of the terrain-following coordinates. An alternative coordinate system, the immersed boundary method (IBM), has been implemented into WRF, allowing for simulations over highly complex terrain; however, the new coordinate system precluded nesting within mesoscale simulations using WRF’s native terrain-following coordinates. Here, the immersed boundary method and WRF’s grid-nesting framework are modified to seamlessly work together. This improved framework for the first time allows for large-eddy simulation over complex (urban) terrain with IBM to be nested within a typical mesoscale WRF simulation. Simulations of the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma, are performed using a multiscale five-domain nested configuration, spanning horizontal grid resolutions from 6 km to 2 m. These are compared with microscale-only simulations with idealized lateral boundary conditions and with observations of wind speed/direction and SF 6 concentrations from a controlled release from intensive observation period 3. The multiscale simulation, which is configured independent of local observations, shows similar model skill predicting wind speed/direction and improved skill predicting SF 6 concentrations when compared with the idealized simulations, which require use of observations to set mean flow conditions. Use of this improved multiscale framework shows promise for enabling large-eddy simulation over highly complex terrain with dynamically downscaled boundary conditions from mesoscale models.

42 ENGINEERING↗
DOE OSTI2020

Subseasonal prediction with and without a well-represented stratosphere in CESM1

There is a growing demand for understanding sources of predictability on subseasonal to seasonal (S2S) time scales. Predictability at subseasonal time scales is believed to come from processes varying slower than the atmosphere such as soil moisture, snowpack, sea ice, and ocean heat content. The stratosphere as well as tropospheric modes of variability can also provide predictability at subseasonal time scales. Furthermore, the contributions of the above sources to S2S predictability are not well quantified. Here we evaluate the subseasonal prediction skill of the Community Earth System Model, version 1 (CESM1), in the default version of the model as well as a version with the improved representation of stratospheric variability to assess the role of an improved stratosphere on prediction skill. We demonstrate that the subseasonal skill of CESM1 for surface temperature and precipitation is comparable to that of operational models. We find that a better-resolved stratosphere improves stratospheric but not surface prediction skill for weeks 3–4.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Reservoir Computing as a Tool for Climate Predictability Studies

Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate models. In this context, the linear inverse modeling (LIM) approach, by capturing a few essential interactions between dynamical components of the full system, has proven valuable in providing insights into predictability of the full system. We demonstrate that reservoir computing (RC), a form of learning suitable for systems with chaotic dynamics, provides an alternative nonlinear approach that improves on the predictive skill of the LIM approach. We do this in the example setting of predicting sea surface temperature in the North Atlantic in the preindustrial control simulation of a popular earth system model, the Community Earth System Model so that we can compare the performance of the new RC-based approach with the traditional LIM approach both when learning data are plentiful and when such data are more limited. The improved predictive skill of the RC approach over a wide range of conditions—larger number of retained EOF coefficients, extending well into the limited data regime, etc.—suggests that this machine-learning technique may have a use in climate predictability studies. While the possibility of developing a climate emulator—the ability to continue the evolution of the system on the attractor long after failing to be able to track the reference trajectory—is demonstrated in the Lorenz-63 system, it is suggested that further development of the RC approach may permit such uses of the new approach in more realistic predictability studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessing decadal variability of subseasonal forecasts of opportunity using explainable AI

Abstract Identifying predictable states of the climate system allows for enhanced prediction skill on the generally low-skill subseasonal timescale via forecasts with higher confidence and accuracy, known as forecasts of opportunity. This study takes a neural network approach to explore decadal variability of subseasonal predictability, particularly during forecasts of opportunity. Specifically, this work quantifies subseasonal prediction skill provided by the tropics within the Community Earth System Model Version 2 (CESM2) Large Ensemble and assesses how this skill evolves on decadal timescales. Utilizing the networks’ confidence and explainable artificial intelligence, physically meaningful sources of predictability associated with periods of enhanced skill are identified. Using these networks, we find that tropically-driven subseasonal predictability varies on decadal timescales during forecasts of opportunity. Further, we investigate the drivers of the low frequency modulation of the tropical-extratropical teleconnection and discuss the implications. Analysis is extended to ECMWF Reanalysis v5 data, revealing that the relationships learned within the CESM2-Large Ensemble holds in modern reanalysis data. These results indicate that the neural networks are capable of identifying predictable decadal states of the climate system within CESM2 that are useful for making confident, accurate subseasonal precipitation predictions in the real world.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Combined effects of horizontal and vertical resolution on reliable turbulence prediction at tidal energy sites: A systematic study in the Salish Sea, WA

Predicting turbulence characteristics with coastal ocean models is essential for tidal energy converter deployment. While large eddy simulation provides a detailed turbulence representation, computational limitations restrict its use to smaller domains. We systematically evaluate whether well-configured coastal models can provide reliable turbulence prediction through progressive refinement of 3D model representation. We implemented four model configurations (Levels 1–4) using terrain-following coordinates, isolating the impacts of horizontal resolution, vertical resolution, and layer distribution. We validated all configurations against field measurements from the Salish Sea, WA. Results show that tidal current velocity predictions remain unchanged regarding model configuration, but turbulence properties are sensitive to resolution refinement. Increasing vertical resolution alone proved insufficient; even with vertical sigma-levels rising from 11 to 41, significant underprediction persisted until finer horizontal resolution better captured bathymetric variations. The Level 4 configuration, incorporating geometric sigma-levels distribution, achieved turbulence prediction skill scores exceeding 0.90. Turbulence closure comparison revealed Mellor- Yamada 2.5 outperformed k-epsilon in TKE prediction (skill scores 0.84–0.94 versus 0.72–0.81) due to better boundary layer parameterization. This study shows that well-configured coastal models effectively bridge the gap between simplified tools and costly high-fidelity modeling, offering the tidal energy industry practical and cost-effective turbulence data at commercially relevant scales.

Marine Energy↗
DOE OSTI2022

Seasonality of Interbasin SST Contributions to Atlantic Tropical Cyclone Activity

Abstract Recent studies have demonstrated that the difference in sea surface temperature anomalies (SSTAs) between the tropical Atlantic main development region (MDR) and the tropical Pacific (Niño 3) modulates Atlantic tropical cyclone activity. This study further explores the seasonality of Pacific and Atlantic contributions to Atlantic hurricane activity. Our analysis shows that while MDR and Niño 3 SSTAs are equally important for late‐season (September–November) activity, early‐season (June‐August) activity is largely modulated by MDR SSTAs. This reflects the increased (reduced) variance of MDR (Niño 3) SSTAs in the early‐season due to their phase locking to the seasonal cycle. Further analysis yields skillful forecasts using an MDR‐Niño 3 interbasin index derived from hindcasts of the North American Multi‐Model Ensemble with May initial conditions. However, the prediction skill for MDR SSTAs is lower than that of Niño 3 SSTAs, suggesting that increasing the prediction skill for MDR SSTAs is key to improving seasonal outlooks.

West, Robert↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Large Ensemble Diagnostic Evaluation of Hydrologic Parameter Uncertainty in the Community Land Model Version 5 (CLM5)

Abstract Land surface models such as the Community Land Model version 5 (CLM5) seek to enhance understanding of terrestrial hydrology and aid in the evaluation of anthropogenic and climate change impacts. However, the effects of parametric uncertainty on CLM5 hydrologic predictions across regions, timescales, and flow regimes have yet to be explored in detail. The common use of the default hydrologic model parameters in CLM5 risks generating streamflow predictions that may lead to incorrect inferences for important dynamics and/or extremes. In this study, we benchmark CLM5 streamflow predictions relative to the commonly employed default hydrologic parameters for 464 headwater basins over the conterminous United States (CONUS). We evaluate baseline CLM5 default parameter performance relative to a large (1,307) Latin Hypercube Sampling‐based diagnostic comparison of streamflow prediction skill using over 20 error measures. We provide a global sensitivity analysis that clarifies the significant spatial variations in parametric controls for CLM5 streamflow predictions across regions, temporal scales, and error metrics of interest. The baseline CLM5 shows relatively moderate to poor streamflow prediction skill in several CONUS regions, especially the arid Southwest and Central U.S. Hydrologic parameter uncertainty strongly affects CLM5 streamflow predictions, but its impacts vary in complex ways across U.S. regions, timescales, and flow regimes. Overall, CLM5's surface runoff and soil water parameters have the largest effects on simulated high flows, while canopy water and evaporation parameters have the most significant effects on the water balance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Subseasonal-to-seasonal Prediction of Atmospheric Rivers in the Western United States

Atmospheric rivers (ARs) account for a large portion of winter total precipitation (especially heavy precipitation) in the coastal states of western US (Dettinger et al., 2011; Rutz et al., 2014), but accurate subseasonal-to-seasonal predictions of ARs remain challenging. The challenge stems from relatively short observational records, the interactions of different climate modes and their nonlinear impacts on ARs, and uncertainties in AR activity due to AR detection methods (Huang et al., 2021). Important sources of AR prediction skill include different climate modes, such as the El Niño/Southern Oscillation (ENSO), Madden–Julian oscillation (MJO), and quasi-biennial oscillation (QBO) (DeFlorio et al., 2018, 2019; Mundhenk et al., 2018). Nevertheless, a lack of consensus on climate mode–AR relationship limits the subseasonal-to-seasonal predictive skills on ARs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Leading Modes of Asian Summer Monsoon Variability as Pulses of Atmospheric Energy Flow

Monsoon rainfall anomalies are often organized into dynamical modes that are more predictable than rainfall at specific locations. Here a linear response function (LRF) is constructed to extract the neutral modes (NM) of the dynamical atmospheric system and their optimal forcing that govern precipitation variability, providing a dynamical underpinning for the empirically derived, recurrent rainfall patterns. The leading mode (NM1) features a shift in the Atlantic ITCZ, a drying over the Indian Ocean and Indian subcontinent, and a “South-Flood-North Drought (SFND)” pattern over eastern China, a pattern inferable from changes in the atmospheric energy flow forced by the corresponding optimal forcing and further enhanced by the water vapor and cloud feedbacks. Moreover, the slow evolving component of the NM1 in response to CO2 forcing can be skillfully predicted by running the ocean heat uptake through the LRF, implicating a deterministic ocean dynamic source for the NM1-like trend under climate warming.

monsoon mode of variability, EBM, climate change, ↗
DOE OSTI2023

Skillful Multi‐Month Predictions of Ecosystem Stressors in the Surface and Subsurface Ocean

Abstract Anthropogenic carbon emissions and associated climate change are driving rapid warming, acidification, and deoxygenation in the ocean, which increasingly stress marine ecosystems. On top of long‐term trends, short term variability of marine stressors can have major implications for marine ecosystems and their management. As such, there is a growing need for predictions of marine ecosystem stressors on monthly, seasonal, and multi‐month timescales. Previous studies have demonstrated the ability to make reliable predictions of the surface ocean physical and biogeochemical state months to years in advance, but few studies have investigated forecast skill of multiple stressors simultaneously or assessed the forecast skill below the surface. Here, we use the Community Earth System Model (CESM) Seasonal to Multiyear Large Ensemble (SMYLE) along with novel observation‐based biogeochemical and physical products to quantify the predictive skill of dissolved inorganic carbon (DIC), dissolved oxygen, and temperature in the surface and subsurface ocean. CESM SMYLE demonstrates high physical and biogeochemical predictive skill multiple months in advance in key oceanic regions and frequently outperforms persistence forecasts. We find up to 10 months of skillful forecasts, with particularly high skill in the Northeast Pacific (Gulf of Alaska and California Current Large Marine Ecosystems) for temperature, surface DIC, and subsurface oxygen. Our findings suggest that dynamical marine ecosystem prediction could support actionable advice for decision making.

Environmental Sciences & Ecology↗
DOE OSTI2022

The Seasonal-to-Multiyear Large Ensemble (SMYLE) prediction system using the Community Earth System Model version 2

Abstract. The potential for multiyear prediction of impactful Earth system change remains relatively underexplored compared to shorter (subseasonal to seasonal) and longer (decadal) timescales. In this study, we introduce a new initialized prediction system using the Community Earth System Model version 2 (CESM2) that is specifically designed to probe potential and actual prediction skill at lead times ranging from 1 month out to 2 years. The Seasonal-to-Multiyear Large Ensemble (SMYLE) consists of a collection of 2-year-long hindcast simulations, with four initializations per year from 1970 to 2019 and an ensemble size of 20. A full suite of output is available for exploring near-term predictability of all Earth system components represented in CESM2. We show that SMYLE skill for El Niño–Southern Oscillation is competitive with other prominent seasonal prediction systems, with correlations exceeding 0.5 beyond a lead time of 12 months. A broad overview of prediction skill reveals varying degrees of potential for useful multiyear predictions of seasonal anomalies in the atmosphere, ocean, land, and sea ice. The SMYLE dataset, experimental design, model, initial conditions, and associated analysis tools are all publicly available, providing a foundation for research on multiyear prediction of environmental change by the wider community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Simulation of African Easterly Waves in a Global Climate Model

Abstract African easterly waves (AEWs) exert significant influence on local and downstream high-impact weather including tropical cyclone (TC) genesis over the Atlantic. Accurate representation of AEWs in climate and weather prediction models therefore is necessary for skillful predictions. In this study, we examine simulated AEWs, including their evolution, vertical structure, and linkage to tropical cyclone genesis, in the NASA Goddard Earth Observing System Model, version 5 (GEOS-5) atmospheric global climate model. Identified by the leading empirical orthogonal function mode of time-filtered precipitation, the observed westward propagating AEWs along the southern track over the Atlantic are largely captured in GEOS-5, but with a slower phase speed and significantly weaker amplitude downstream off the West Africa coast. The weak downstream development of AEWs in GEOS-5 is accompanied by much reduced TC genesis over the main development region. Further analyses suggest that the slow westward propagation and weaker AEW amplitude downstream can be ascribed to a weak African easterly jet, while overestimated negative (positive) meridional potential vorticity (PV) gradients appear to the north (south) of 10°N in GEOS-5. The greatly overestimated positive meridional PV gradient to the south of 10°N is expected to generate strong horizontal stretching in the AEW wave pattern in the model, which hinders organization of convection and its feedback to sustain the AEW development. Persistent and vigorous AEW precipitation in the Guinea Highlands of the West Africa coast could also be responsible for reduced westward propagation of AEWs in the model.

Meteorology & Atmospheric Sciences↗
DOE OSTI2021

Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) (Field Campaign Report)

The Arctic is rapidly changing, and these changes have substantial societal relevance. First, arctic change is a leading sign of global change, as the warming observed in the Arctic is 2-3 times faster than observed across the rest of the globe. This so-called arctic amplification is due to numerous feedbacks, including those linked to the declining sea ice. Broad arctic changes are also hypothesized to be related to shifts in large-scale circulation patterns that may have implications for mid-latitude weather and ocean circulation. Arctic change is further affecting the oceans through acidification that threatens food supplies. Declining sea ice also opens the Arctic for new resource development, shipping routes, tourism, and other commercial activities. Lastly, the changing Arctic is a hotbed for geopolitical challenges as nations vie for influence and control of this resource-rich and newly accessible region. Clearly the Arctic and its changes are playing a huge role in our Earth both from a geophysical and socio-political standpoint. To navigate, manage, and respond to the challenges associated with arctic change requires a vastly improved understanding of the coupled arctic system, and the drivers and implications of these changes. It is essential to better understand the physical basis for why the arctic sea ice is declining, the associated feedbacks that work to amplify or modulate this decline, and the myriad ways that the Earth system is responding. As a result of these changes and uncertainties, there are increasing societal needs for improved model predictive skill in the Arctic, to address pressing gaps in global climate prediction, to advance forecast skills for regional and hemispheric weather and sea ice, and to ensure robust ecosystem models that realistically link physical and biological systems. To fulfill these core needs requires new, sophisticated, and cross-cutting observations within the rapidly changing arctic ice pack.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Tropical Interbasin Interaction as Effective Predictors of Late-Spring Precipitation Variability in the Southern Great Plains

Abstract The southern Great Plains experience fluctuating precipitation extremes that significantly impact agriculture and water management. Despite ongoing efforts to enhance forecast accuracy, the underlying causes of these climatic phenomena remain inadequately understood. This study elucidates the relative influence of the tropical Pacific and Atlantic basins on April–May–June precipitation variability in this region. Our partial ocean assimilation experiments using the Community Earth System Model unveil the prominent role of interbasin interaction, with the Pacific and Atlantic contributing approximately 70% and 30%, respectively, to these interbasin contrasts. Our statistical analyses suggest that these tropical interbasin contrasts could serve as a more reliable indicator for late-spring precipitation anomalies than El Niño–Southern Oscillation. The conclusions are reinforced by analyses of seven climate forecasting systems within the North American Multi-Model Ensemble, offering an optimistic outlook for enhancing real-time forecasting of late-spring precipitation in the southern plains. However, the current predictive skills of the interbasin contrasts across the prediction systems are hindered by the lower predictability of the tropical Atlantic Ocean, pointing to the need for future research to refine climate prediction models further. Significance Statement Agriculture and infrastructure in the southern plains face challenges from severe late-spring precipitation extremes. Traditional predictors like El Niño–Southern Oscillation (ENSO) lose effectiveness during the critical spring-to-summer transition, creating a forecasting gap. This study introduces the concept of tropical interbasin interactions, known to enhance seasonal predictability for late-spring precipitation in the southern plains. Novel climate model experiments highlight contributions from the tropical Pacific and Atlantic, offering a promising predictability that potentially surpasses the limitations of ENSO-based predictions. These outcomes hold the potential for developing operational forecasts of late-spring precipitation anomalies in the southern plains, enabling proactive risk management.

Chikamoto, Yoshimitsu↗
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
DOE OSTI2020

Quantifying the drivers and predictability of seasonal changes in African fire

Africa contains some of the most vulnerable ecosystems to fires. Successful seasonal prediction of fire activity over these fire-prone regions remains a challenge and relies heavily on in-depth understanding of various driving mechanisms underlying fire evolution. Here, we assess the seasonal environmental drivers and predictability of African fire using the analytical framework of Stepwise Generalized Equilibrium Feedback Assessment (SGEFA) and machine learning techniques (MLTs). The impacts of sea-surface temperature, soil moisture, and leaf area index are quantified and found to dominate the fire seasonal variability by regulating regional burning condition and fuel supply. Compared with previously-identified atmospheric and socioeconomic predictors, these slowly evolving oceanic and terrestrial predictors are further identified to determine the seasonal predictability of fire activity in Africa. Our combined SGEFA-MLT approach achieves skillful prediction of African fire one month in advance and can be generalized to provide seasonal estimates of regional and global fire risk.

54 ENVIRONMENTAL SCIENCES↗