Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Combined effects of horizontal and vertical resolution on reliable turbulence prediction at tidal energy sites: A systematic study in the Salish Sea, WA

Predicting turbulence characteristics with coastal ocean models is essential for tidal energy converter deployment. While large eddy simulation provides a detailed turbulence representation, computational limitations restrict its use to smaller domains. We systematically evaluate whether well-configured coastal models can provide reliable turbulence prediction through progressive refinement of 3D model representation. We implemented four model configurations (Levels 1–4) using terrain-following coordinates, isolating the impacts of horizontal resolution, vertical resolution, and layer distribution. We validated all configurations against field measurements from the Salish Sea, WA. Results show that tidal current velocity predictions remain unchanged regarding model configuration, but turbulence properties are sensitive to resolution refinement. Increasing vertical resolution alone proved insufficient; even with vertical sigma-levels rising from 11 to 41, significant underprediction persisted until finer horizontal resolution better captured bathymetric variations. The Level 4 configuration, incorporating geometric sigma-levels distribution, achieved turbulence prediction skill scores exceeding 0.90. Turbulence closure comparison revealed Mellor- Yamada 2.5 outperformed k-epsilon in TKE prediction (skill scores 0.84–0.94 versus 0.72–0.81) due to better boundary layer parameterization. This study shows that well-configured coastal models effectively bridge the gap between simplified tools and costly high-fidelity modeling, offering the tidal energy industry practical and cost-effective turbulence data at commercially relevant scales.

Marine Energy↗
DOE OSTI2022

Seasonality of Interbasin SST Contributions to Atlantic Tropical Cyclone Activity

Abstract Recent studies have demonstrated that the difference in sea surface temperature anomalies (SSTAs) between the tropical Atlantic main development region (MDR) and the tropical Pacific (Niño 3) modulates Atlantic tropical cyclone activity. This study further explores the seasonality of Pacific and Atlantic contributions to Atlantic hurricane activity. Our analysis shows that while MDR and Niño 3 SSTAs are equally important for late‐season (September–November) activity, early‐season (June‐August) activity is largely modulated by MDR SSTAs. This reflects the increased (reduced) variance of MDR (Niño 3) SSTAs in the early‐season due to their phase locking to the seasonal cycle. Further analysis yields skillful forecasts using an MDR‐Niño 3 interbasin index derived from hindcasts of the North American Multi‐Model Ensemble with May initial conditions. However, the prediction skill for MDR SSTAs is lower than that of Niño 3 SSTAs, suggesting that increasing the prediction skill for MDR SSTAs is key to improving seasonal outlooks.

West, Robert↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Large Ensemble Diagnostic Evaluation of Hydrologic Parameter Uncertainty in the Community Land Model Version 5 (CLM5)

Abstract Land surface models such as the Community Land Model version 5 (CLM5) seek to enhance understanding of terrestrial hydrology and aid in the evaluation of anthropogenic and climate change impacts. However, the effects of parametric uncertainty on CLM5 hydrologic predictions across regions, timescales, and flow regimes have yet to be explored in detail. The common use of the default hydrologic model parameters in CLM5 risks generating streamflow predictions that may lead to incorrect inferences for important dynamics and/or extremes. In this study, we benchmark CLM5 streamflow predictions relative to the commonly employed default hydrologic parameters for 464 headwater basins over the conterminous United States (CONUS). We evaluate baseline CLM5 default parameter performance relative to a large (1,307) Latin Hypercube Sampling‐based diagnostic comparison of streamflow prediction skill using over 20 error measures. We provide a global sensitivity analysis that clarifies the significant spatial variations in parametric controls for CLM5 streamflow predictions across regions, temporal scales, and error metrics of interest. The baseline CLM5 shows relatively moderate to poor streamflow prediction skill in several CONUS regions, especially the arid Southwest and Central U.S. Hydrologic parameter uncertainty strongly affects CLM5 streamflow predictions, but its impacts vary in complex ways across U.S. regions, timescales, and flow regimes. Overall, CLM5's surface runoff and soil water parameters have the largest effects on simulated high flows, while canopy water and evaporation parameters have the most significant effects on the water balance.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1987

The effect of increased horizontal resolution on GLA Fourth Order model forecasts

A benchmark series of ten-day weather forecasts has been run with the GLA Fourth Order GCM with both a 4 deg latitude by 5 deg longitude resolution and a 2 deg latitude by 2.5 deg longitude resolution. Ensemble statistics of forecast skill and maps of systematic error fields have been generated for both resolutions. The enhanced resolution added 24 hours of useful predictive skill to the sea level pressure forecasts and 6 hours to the 500 mb height forecasts, but 5 to 6 days into the forecasts the advantage of the finer resolution was lost. The systematic error fields showed that by 8 days the 'climate drift' of the 2 x 2.5 deg forecasts had become pronounced and had caused the loss of predictive skill relative to the 4 x 5 deg forecasts. Additional results indicate that a gravity wave drag parameterization scheme might alleviate the climate drift problem.

Helfand, H. M.↗
NASA NTRS2013

Prediction of the Arctic Oscillation in Boreal Winter by Dynamical Seasonal Forecasting Systems

This study assesses the prediction skill of the boreal winter Arctic Oscillation (AO) in the state-of-the-art dynamical ensemble prediction systems (EPSs): the UKMO GloSea4, the NCEP CFSv2, and the NASA GEOS-5. Long-term reforecasts made with the EPSs are used to evaluate representations of the AO, and to examine skill scores for the deterministic and probabilistic forecast of the AO index. The reforecasts reproduce the observed changes in the large-scale patterns of the Northern Hemispheric surface temperature, upper-level wind, and precipitation according to the AO phase. Results demonstrate that all EPSs have better prediction skill than the persistence prediction for lead times up to 3-month, suggesting a great potential for skillful prediction of the AO and the associated climate anomalies in seasonal time scale. It is also found that the deterministic and probabilistic forecast skill of the AO in the recent period (1997-2010) is higher than that in the earlier period (1983-1996).

Coupled Models↗
NASA NTRS2007

Using a Magnetic Flux Transport Model to Predict the Solar Cycle

We present the results of an investigation into the use of a magnetic flux transport model to predict the amplitude of future solar cycles. Recently Dikpati, de Toma, & Gilman (2006) showed how their dynamo model could be used to accurately predict the amplitudes of the last eight solar cycles and offered a prediction for the next solar cycle - a large amplitude cycle. Cameron & Schussler (2007) found that they could reproduce this predictive skill with a simple 1-dimensional surface flux transport model - provided they used the same parameters and data as Dikpati, de Toma, & Gilman. However, when they tried incorporating the data in what they argued was a more realistic manner, they found that the predictive skill dropped dramatically. We have written our own code for examining this problem and have incorporated updated and corrected data for the source terms - the emergence of magnetic flux in active regions. We present both the model itself and our results from it - in particular our tests of its effectiveness at predicting solar cycles.

Lyatskaya, S.↗
DOE OSTI2021

Subseasonal-to-seasonal Prediction of Atmospheric Rivers in the Western United States

Atmospheric rivers (ARs) account for a large portion of winter total precipitation (especially heavy precipitation) in the coastal states of western US (Dettinger et al., 2011; Rutz et al., 2014), but accurate subseasonal-to-seasonal predictions of ARs remain challenging. The challenge stems from relatively short observational records, the interactions of different climate modes and their nonlinear impacts on ARs, and uncertainties in AR activity due to AR detection methods (Huang et al., 2021). Important sources of AR prediction skill include different climate modes, such as the El Niño/Southern Oscillation (ENSO), Madden–Julian oscillation (MJO), and quasi-biennial oscillation (QBO) (DeFlorio et al., 2018, 2019; Mundhenk et al., 2018). Nevertheless, a lack of consensus on climate mode–AR relationship limits the subseasonal-to-seasonal predictive skills on ARs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Leading Modes of Asian Summer Monsoon Variability as Pulses of Atmospheric Energy Flow

Monsoon rainfall anomalies are often organized into dynamical modes that are more predictable than rainfall at specific locations. Here a linear response function (LRF) is constructed to extract the neutral modes (NM) of the dynamical atmospheric system and their optimal forcing that govern precipitation variability, providing a dynamical underpinning for the empirically derived, recurrent rainfall patterns. The leading mode (NM1) features a shift in the Atlantic ITCZ, a drying over the Indian Ocean and Indian subcontinent, and a “South-Flood-North Drought (SFND)” pattern over eastern China, a pattern inferable from changes in the atmospheric energy flow forced by the corresponding optimal forcing and further enhanced by the water vapor and cloud feedbacks. Moreover, the slow evolving component of the NM1 in response to CO2 forcing can be skillfully predicted by running the ocean heat uptake through the LRF, implicating a deterministic ocean dynamic source for the NM1-like trend under climate warming.

monsoon mode of variability, EBM, climate change, ↗
DOE OSTI2023

Skillful Multi‐Month Predictions of Ecosystem Stressors in the Surface and Subsurface Ocean

Abstract Anthropogenic carbon emissions and associated climate change are driving rapid warming, acidification, and deoxygenation in the ocean, which increasingly stress marine ecosystems. On top of long‐term trends, short term variability of marine stressors can have major implications for marine ecosystems and their management. As such, there is a growing need for predictions of marine ecosystem stressors on monthly, seasonal, and multi‐month timescales. Previous studies have demonstrated the ability to make reliable predictions of the surface ocean physical and biogeochemical state months to years in advance, but few studies have investigated forecast skill of multiple stressors simultaneously or assessed the forecast skill below the surface. Here, we use the Community Earth System Model (CESM) Seasonal to Multiyear Large Ensemble (SMYLE) along with novel observation‐based biogeochemical and physical products to quantify the predictive skill of dissolved inorganic carbon (DIC), dissolved oxygen, and temperature in the surface and subsurface ocean. CESM SMYLE demonstrates high physical and biogeochemical predictive skill multiple months in advance in key oceanic regions and frequently outperforms persistence forecasts. We find up to 10 months of skillful forecasts, with particularly high skill in the Northeast Pacific (Gulf of Alaska and California Current Large Marine Ecosystems) for temperature, surface DIC, and subsurface oxygen. Our findings suggest that dynamical marine ecosystem prediction could support actionable advice for decision making.

Environmental Sciences & Ecology↗
NASA NTRSDate not supplied

Improving Regional Air Quality Forecasting Through Chemical Data Assimilation and Dynamic Emissions Adjustment

Poor air quality (AQ) is one of the most important human-health and environmental problems facing the United States (US). In addition to the detrimental impacts on human- and environmental-health, poor AQ has an economic cost of ~5% of the US gross domestic product (~$790 billion). AQ managers use AQ analyses and modeling to better understand, anticipate, and avoid poor AQ events. Our research focuses on improving AQ analysis/forecast skill, predictability, and emission estimates through improved and more efficient: (i) modeling and data assimilation strategies; (ii) dynamic emissions adjustment strategies; and (iii) use of satellite remote-sensing Earth observations (e.g., MOPITT, IASI, MODIS, OMI, TROPOMI, TEMPO, etc.). This seminar will review: (i) regional chemical weather forecasting/data assimilation with dynamic emissions adjustment with WRF-Chem/DART; (ii) strategies for efficiently assimilating satellite retrieval profiles with ‘compact phase space retrievals’ (CPSRs); (iii) results from joint assimilation of multiple satellite retrievals at medium (12 km × 12 km) and high (4 km × 4 km) spatial resolutions; and (iv) results from observing system simulation experiments (OSSEs) to investigate whether we can recover COVID-period anthropogenic emissions by assimilating synthetic TEMPO NO2 tropospheric column retrievals with dynamic emissions adjustment. Biographical Sketch: Dr. Mizzi is a Senior Research Fellow working and Dr. Johnson at the NASA Ames Research Center. He holds BA and MS degrees in Environmental Science from the University of Virginia, MS and PhD degrees in Applied Mathematics from the University of Colorado at Boulder (CUB), and a JD degree (with an emphasis in Environmental Law) from the University of Colorado School of Law. He worked at the National Center for Atmospheric Research for nearly 25 years on global atmospheric modeling, dynamic and physical initialization, regional hybrid data assimilation, and most recently on regional chemical data assimilation. He also worked as an environmental attorney and consultant for nearly 15 years. He is an expert in numerical modeling and is recognized internationally as a leading expert in regional, chemical data assimilation with dynamic emissions adjustment. Dr. Mizzi became affiliated with NASA Ames in March 2020 to work on improving AQ analysis/forecast skill, predictability, and ‘top-down’ emissions adjustment though the assimilation of Earth observations. An emphasis of his current work is developing methods for assimilating synthetic TEMPO retrievals to quantify the expected benefits of TEMPO relative to existing AQ observations.

Arthur P. Mizzi↗
NASA NTRS2020

Windows of Opportunity for Skillful Forecasts Subseasonal to Seasonal and Beyond

There is high demand and a growing expectation for predictions of environmental conditions that go beyond 0–14-day weather forecasts with outlooks extending to one or more seasons and beyond. This is driven by the needs of the energy, water management, and agriculture sectors, to name a few. There is an increasing realization that, unlike weather forecasts, prediction skill on longer time scales can leverage specific climate phenomena or conditions for a predictable signal above the weather noise. Currently, it is understood that these conditions are intermittent in time and have spatially heterogeneous impacts on skill, hence providing strategic windows of opportunity for skillful forecasts. Research points to such windows of opportunity, including El Niño or La Niña events, active periods of the Madden–Julian oscillation, disruptions of the stratospheric polar vortex, when certain large-scale atmospheric regimes are in place, or when persistent anomalies occur in the ocean or land surface. Gains could be obtained by increasingly developing prediction tools and metrics that strategically target these specific windows of opportunity. Across the globe, reevaluating forecasts in this manner could find value in forecasts previously discarded as not skillful. Users’ expectations for prediction skill could be more adequately met, as they are better aware of when and where to expect skill and if the prediction is actionable. Given that there is still untapped potential, in terms of process understanding and prediction methodologies, it is safe to expect that in the future forecast opportunities will expand. Process research and the development of innovative methodologies will aid such progress.

Annarita Mariotti↗
NASA NTRS1979

The impact of Sun-weather research on forecasting

The possible impact of Sun-weather research on forecasting is examined. The type of knowledge of the effect is evaluated to determine if it is in a form that can be used for forecasting purposes. It is concluded that the present understanding of the effect does not lend itself readily to applications for forecast purposes. The limits of present predictive skill are examined and it is found that skill is most lacking for prediction of the smallest scales of atmospheric motion. However, it is not expected that Sun-weather research will have any significant impact on forecasting the smaller scales since predictability at these scales is limited by the finite grid size resolution and the time scales of turbulent diffusion. The predictability limits for the largest scales are on the order of several weeks although presently only a one week forecast is achievable.

Larsen, M. F.↗
DOE OSTI2022

The Seasonal-to-Multiyear Large Ensemble (SMYLE) prediction system using the Community Earth System Model version 2

Abstract. The potential for multiyear prediction of impactful Earth system change remains relatively underexplored compared to shorter (subseasonal to seasonal) and longer (decadal) timescales. In this study, we introduce a new initialized prediction system using the Community Earth System Model version 2 (CESM2) that is specifically designed to probe potential and actual prediction skill at lead times ranging from 1 month out to 2 years. The Seasonal-to-Multiyear Large Ensemble (SMYLE) consists of a collection of 2-year-long hindcast simulations, with four initializations per year from 1970 to 2019 and an ensemble size of 20. A full suite of output is available for exploring near-term predictability of all Earth system components represented in CESM2. We show that SMYLE skill for El Niño–Southern Oscillation is competitive with other prominent seasonal prediction systems, with correlations exceeding 0.5 beyond a lead time of 12 months. A broad overview of prediction skill reveals varying degrees of potential for useful multiyear predictions of seasonal anomalies in the atmosphere, ocean, land, and sea ice. The SMYLE dataset, experimental design, model, initial conditions, and associated analysis tools are all publicly available, providing a foundation for research on multiyear prediction of environmental change by the wider community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Simulation of African Easterly Waves in a Global Climate Model

Abstract African easterly waves (AEWs) exert significant influence on local and downstream high-impact weather including tropical cyclone (TC) genesis over the Atlantic. Accurate representation of AEWs in climate and weather prediction models therefore is necessary for skillful predictions. In this study, we examine simulated AEWs, including their evolution, vertical structure, and linkage to tropical cyclone genesis, in the NASA Goddard Earth Observing System Model, version 5 (GEOS-5) atmospheric global climate model. Identified by the leading empirical orthogonal function mode of time-filtered precipitation, the observed westward propagating AEWs along the southern track over the Atlantic are largely captured in GEOS-5, but with a slower phase speed and significantly weaker amplitude downstream off the West Africa coast. The weak downstream development of AEWs in GEOS-5 is accompanied by much reduced TC genesis over the main development region. Further analyses suggest that the slow westward propagation and weaker AEW amplitude downstream can be ascribed to a weak African easterly jet, while overestimated negative (positive) meridional potential vorticity (PV) gradients appear to the north (south) of 10°N in GEOS-5. The greatly overestimated positive meridional PV gradient to the south of 10°N is expected to generate strong horizontal stretching in the AEW wave pattern in the model, which hinders organization of convection and its feedback to sustain the AEW development. Persistent and vigorous AEW precipitation in the Guinea Highlands of the West Africa coast could also be responsible for reduced westward propagation of AEWs in the model.

Meteorology & Atmospheric Sciences↗
NASA NTRS2001

Statistical Mining of Predictability of Seasonal Precipitation over the United States

Results from a new ensemble canonical correlation (ECC) prediction model yield a remarkable (10-20%) increases in baseline prediction skills for seasonal precipitation over the US for all seasons, compared to traditional statistical predictions. While the tropical Pacific, i.e., El Nino, contributes to the largest share of potential predictability in the southern tier States during boreal winter, the North Pacific and the North Atlantic are responsible for enhanced predictability in the northern Great Plains, Midwest and the southwest US during boreal summer. Most importantly, ECC significantly reduces the spring predictability barrier over the conterminous US, thereby raising the skill bar for dynamical predictions.

Lau, William K. M.↗
DOE OSTI2021

Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) (Field Campaign Report)

The Arctic is rapidly changing, and these changes have substantial societal relevance. First, arctic change is a leading sign of global change, as the warming observed in the Arctic is 2-3 times faster than observed across the rest of the globe. This so-called arctic amplification is due to numerous feedbacks, including those linked to the declining sea ice. Broad arctic changes are also hypothesized to be related to shifts in large-scale circulation patterns that may have implications for mid-latitude weather and ocean circulation. Arctic change is further affecting the oceans through acidification that threatens food supplies. Declining sea ice also opens the Arctic for new resource development, shipping routes, tourism, and other commercial activities. Lastly, the changing Arctic is a hotbed for geopolitical challenges as nations vie for influence and control of this resource-rich and newly accessible region. Clearly the Arctic and its changes are playing a huge role in our Earth both from a geophysical and socio-political standpoint. To navigate, manage, and respond to the challenges associated with arctic change requires a vastly improved understanding of the coupled arctic system, and the drivers and implications of these changes. It is essential to better understand the physical basis for why the arctic sea ice is declining, the associated feedbacks that work to amplify or modulate this decline, and the myriad ways that the Earth system is responding. As a result of these changes and uncertainties, there are increasing societal needs for improved model predictive skill in the Arctic, to address pressing gaps in global climate prediction, to advance forecast skills for regional and hemispheric weather and sea ice, and to ensure robust ecosystem models that realistically link physical and biological systems. To fulfill these core needs requires new, sophisticated, and cross-cutting observations within the rapidly changing arctic ice pack.

54 ENVIRONMENTAL SCIENCES↗