Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS1982

Integrated and spectral energetics studies of the GLAS general circulation model

Integrated and spectral energetics of the Goddard Laboratory for Atmospheric Sciences (GLAS) general circulation model are compared with observations and examined when subdivided beyond hemispheric integrals. In the monthly mean zonal averages, qualitative improvements are found over previous versions of the model in eddy kinetic energy and barotropic conversions although vertical shear above the subtropical jet remains weak. This paper traces this problem to the erroneous growth of kinetic energy above strong jets, shows that this difficulty is common to all orographic general circulation models, and suggests that this problem has significant effects on upper-level long-wave predictability. In particular, it is considered whether hemispherically integrated kinetic energy or low-wavenumber spectral coefficients retain any skill as the predictability limit. In the time-dependent comparisons, the model shows significant skill in predicting the hemispherically integrated eddy kinetic energy out to two weeks for one of two cases.

Tenenbaum, J.↗
DOE OSTI2020

A Bayesian Approach to Regional Decadal Predictability: Sparse Parameter Estimation in High-Dimensional Linear Inverse Models of High-Latitude Sea Surface Temperature Variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies—typically focusing more on tropical or midlatitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation–dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on 1) estimating parameter values on a perfect model experiment and 2) producing calibrated 1-yr SST anomaly forecast distributions using a preindustrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which an LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model’s ability to capture variability of SST anomalies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗
NASA NTRS2019

GMAO Seasonal Forecast Ensemble Exploration

GMAO Sub/Seasonal prediction system (S2S) has recently been upgraded. A complete set (1981-2016) of 9-months hindcasts for the previous and current versions (S2S-1.0 and S2S-2.1 respectively) allows for the evaluation of the forecast skill and a study of various characteristics of the ensemble forecasts in particular. We compared the intra-seasonal, interannual and intra-ensemble SST variability of the two systems against the observed. Focusing on the ENSO SST indices, we analyzed the consistency of the forecasts ensembles by studying rank histograms and comparing the ensemble spread with the standard error of the estimate.The S2S-2.1 ensemble appears to be more consistent with observations in Niño1+2 region compared to S2S-1.0, while in the central equatorial Pacific ocean this measure is comparably good for both systems. The S2S-1.0 system tends to be under dispersive, while the new system is under dispersive only at very short lead times, but tends to be over dispersive at long leads and for forecasts verifying in spring in Niño 3.4 region.Overall, the new system has greater skill in predicting ENSO. The evaluation techniques tested here will be applied for testing of the next generation sub/seasonal forecast system under development.

Borovikov, Anna↗
NASA NTRS2004

GEWEX America Prediction Project (GAPP) Science and Implementation Plan

The purpose of this Science and Implementation Plan is to describe GAPP science objectives and the activities required to meet these objectives, both specifically for the near-term and more generally for the longer-term. The GEWEX Americas Prediction Project (GAPP) is part of the Global Energy and Water Cycle Experiment (GEWEX) initiative that is aimed at observing, understanding and modeling the hydrological cycle and energy fluxes at various time and spatial scales. The mission of GAPP is to demonstrate skill in predicting changes in water resources over intraseasonal-to-interannual time scales, as an integral part of the climate system.

TIME SCALES↗
DOE OSTI2025

Data-driven global ocean modeling for seasonal to decadal prediction

Accurate modeling of ocean dynamics is crucial for enhancing our understanding of complex ocean circulation processes, predicting climate variability, and tackling challenges posed by climate change. Although great efforts have been made to improve traditional numerical models, predicting global ocean variability over multiyear scales remains challenging. Here, we propose ORCA-DL (Oceanic Reliable foreCAst via Deep Learning), a data-driven three-dimensional ocean model for seasonal to decadal prediction of global ocean dynamics. ORCA-DL accurately simulates the three-dimensional structure of global ocean dynamics with high physical consistency and outperforms state-of-the-art numerical models in capturing extreme events, including El Niño–Southern Oscillation and upper ocean heat waves. Moreover, ORCA-DL stably emulates ocean dynamics at decadal timescales, demonstrating its potential even for skillful decadal predictions and climate projections. Our results demonstrate the high potential of data-driven models for providing efficient and accurate global ocean modeling and prediction.

Science & Technology - Other Topics↗
DOE OSTI2023

Assessing turbulence and mixing parameterizations in the gray-zone of multiscale simulations over mountainous terrain during the METEX21 field experiment

Multiscale numerical weather prediction models transition from mesoscale, where turbulence is fully parameterized, to microscale, where the majority of highly energetic scales of turbulence are resolved. The turbulence gray-zone is situated between these two regimes and multiscale models must downscale through these resolutions. Here, we compare three multiscale simulations which vary by the parameterization used for turbulence and mixing within the gray-zone. The three parameterizations analyzed are the Mellor-Yamada Nakanishi and Niino (MYNN) Level 2.5 planetary boundary layer scheme, the TKE-1.5 large eddy simulation (LES) closure scheme, and a recently developed three-dimensional planetary boundary layer scheme based on the Mellor-Yamada model. The simulation domain includes complex (i.e., mountainous) terrain in Nevada that was instrumented with meteorological towers, profiling and scanning lidars, a tethered balloon, and a surface flux tower. Simulations are compared to each other and to observations, with assessment of model skill at predicting wind speed, wind direction and TKE, and qualitative evaluations of transport and dispersion of smoke from controlled releases. This analysis demonstrates that microscale predictions of transport and dispersion can be significantly influenced by the choice of turbulence and mixing parameterization in the terra incognita , particularly over regions of complex terrain and with strong local forcing. This influence may not be apparent in the analysis of model skill, and motivates future field campaigns involving controlled tracer releases and corresponding modeling studies of the turbulence gray-zone.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

GMS-based"Future Time" Rainfall Data Assimilation for Mesoscale Weather Prediction over Korean Peninsula and Future Prospects with GPM Satellite Measurements

This study examines the use of satellite-derived nowcasted (short-term forecasted) rainfall over 3-hour time periods to gain an equivalent time increment in initializing a nonhydrostatic mesoscale model used for predicting convective rainfall events over the Korean peninsula. Infrared (IR) window measurements from the Japanese Geostationary Meteorological Satellite (GMS) are used to specify latent heating for a spinup period of the model - but in future time -- thus initializing in advance of actual time in the framework of a prediction scenario. The main scientific objective of the study is to investigate the strengths and weaknesses of this approach insofar as data assimilation, in which the nowcasted assimilation data are derived independently of the prognostic model itself. Although there have been various recent improvements in formulating the dynamics, thermodynamics, and microphysics of mesoscale models, as well as computer advances which allow the use of high resolution cloud-resolving grids and explicit latent heating over regional domains, spinup remains at the forefront of unresolved mesoscale modeling problems. In general, non-realistic spinup limits the skill in predicting the spatial-temporal distribution of convection and precipitation, primarily in the early hours of a. forecast, stemming from standard prognostic variables not representing the initial diabatic heating field produced by the ambient convection and cloud fields. The long-term goal of this research is to improve short-range (12-hour) quantitative precipitation forecasting (QPF) over the Korean peninsula through the use of innovative data assimilation methods based on geosynchronous satellite measurements. As a step in th~s direction, a non-standard data assimilation experiment in conjunction with GMS-retrieved nowcasted rainfall information introduced to the mesoscale model is conducted. The 3-hourly precipitation forecast information is assimilated through nudging the associated diabatic heating during the early stages of a forecast period. This procedure is expected to enhance details in the moisture field during model integration, and thus improve spinup performance, assuming the errors in the future time latent heating data ate less than intrinsic model background errors.

Smith, Eric A.↗
NASA NTRS1990

The relationship of marine stratus to synoptic conditions

The marine stratus which persistently covered most of the eastern Pacific Ocean, had large clear areas during the FIRE Intensive Field Operations (IFO) in 1987. Clear zones formed inside the large oceanic cloud mass on almost every day during the IFO. The location and size of the clear zones varied from day to day implying that they were related to dynamic weather conditions and not to oceanic conditions. Forecasting of cloud cover for aircraft operations during the IFO was directed towards predicting when and where the clear and broken zones would form inside the large marine stratus cloud mass. The clear zones often formed to the northwest of the operations area and moved towards it. However, on some days the clear zones appeared to form during the day in the operations area as part of the diurnal cloud burn off. The movement of the clear zones from day to day were hard to follow because of the large diurnal changes in cloud cover. Clear and broken cloud zones formed during the day only to distort in shape and fill during the following night. The field forecasters exhibited some skill in predicting when the clear and broken cloud patterns would form in the operations area. They based their predictions on the analysis and simulations of the models run by NOAA's Numeric Meteorological Center. How the atmospheric conditions analyzed by one NOAA/NMC model related to the cloud cover is discussed.

Wylie, Donald P.↗
NASA NTRS2005

A Global Rapid Integrated Monitoring System for Water Cycle and Water Resource Assessment (Global-RIMS)

The main focus of our work was to solidify underlying data sets, the data processing tools and the modeling environment needed to perform a series of long-term global and regional hydrological simulations leading eventually to routine hydrometeorological predictions. A water and energy budget synthesis was developed for the Mississippi River Basin (Roads et al. 2003), in order to understand better what kinds of errors exist in current hydrometeorological data sets. This study is now being extended globally with a larger number of observations and model based data sets under the new NASA NEWS program. A global comparison of a number of precipitation data sets was subsequently carried out (Fekete et al. 2004) in which it was further shown that reanalysis precipitation has substantial problems, which subsequently led us to the development of a precipitation assimilation effort (Nunes and Roads 2005). We believe that with current levels of model skill in predicting precipitation that precipitation assimilation is necessary to get the appropriate land surface forcing.

Roads, John↗
NASA NTRS2020

Designing an Optimal Ensemble Strategy for GMAO S2S Forecast System

GMAO Sub/Seasonal prediction system (S2S) is being readied for a major upgrade to GEOS-S2S Version 3. An important factor in successful extended range forecast is the definition of an ensemble For initialization of the ensemble we propose a combination of lagged and burst initial conditions. We plan to run a relatively large ensemble of 40 members for sub-seasonal forecast (up to 3 months), at which point we sub-sample the ensemble, and continue the forecast with 10 members (up to 12 months). Here we present the results of the extensive testing of various ways to generate the perturbations to the initial conditions and the validation of the stratified sampling strategy we chose.To generate perturbations for the burst ensemble members we used scaled differences of pairs of analysis states separated by 1-10 days, randomly chosen from a corresponding season. We considered perturbing separately only the atmospheric fields or only the ocean or both of the forecast initial conditions. Considering varying separation times between the analysis states, we were able to produce perturbations sampling various modes of variability. Focusing on the ENSO SST indices, we found that all types of perturbations are important for the ensemble spread.Our ensemble size for sub-seasonal forecasts was determined as to maximize the skill of predicting some of the leading modes of boreal winter atmospheric modes, NAO, PNA and AO. It is not feasible to run equally large ensemble for seasonal forecasts. Using a stratified sampling procedure we can identify the emerging directions of error growth. By comparing the stratified ensemble with randomly sampled ensemble of the same size, we were able to show that the former better estimates the mean of the original large ensemble.

Borovikov, Anna↗
NASA NTRS2020

Designing an Optimal Ensemble Strategy for GMAO S2S Forecast System

The NASA Global Modeling and Assimilation Office (GMAO) Sub-seasonal to Seasonal (S2S) prediction system is being readied for a major upgrade. An important factor in successful extended range forecasting is the definition of the ensemble. Our overall strategy is to run a relatively large ensemble of about 40 members up to 3 months (focusing on the sub-seasonal forecast problem), after which we sub-sample the ensemble, and continue the forecast with about 10 members (up to 12 months). Here we present the results of our testing of various ways to generate the initial perturbations and the validation of a stratified sampling approach for choosing the members of the smaller ensemble. For the initialization of the ensemble we propose a combination of lagged and burst initial conditions. To generate perturbations for the burst ensemble members we used scaled differences of pairs of analysis states (chosen randomly from the corresponding season) separated by 1-10 days. We consider perturbing separately the atmosphere and the ocean, or both. By varying the separation times between the analysis states, we are able to produce perturbations that resemble well-known modes of variability. Focusing on the ENSO SST indices, we found that all types of perturbations are important for the ensemble spread with, however, considerable differences in the timing of the impacts on spread for the atmospheric and oceanic perturbations.Our initial (larger) ensemble size was determined so as to maximize the skill of predicting some of the leading modes of boreal winter atmospheric modes (namely the NAO, PNA and AO). Since it is not feasible for us to run with the larger ensemble beyond about 3 months, we employ a stratified sampling procedure that identifies the emerging directions of error growth to subset the ensemble. By comparing the results from the stratified ensemble with that of the randomly sampled ensemble of the same size, we find that the former provides substantially better estimates the mean of the original large ensemble.

Borovikov, Anna↗
DOE OSTI2022

Hydrologic investigations of radar-rainfall error propagation to rainfall-runoff model hydrographs

Rainfall is arguably the most important yet most variable input for rainfall-runoff hydrologic models. In this study, the authors search for the characteristics of radar-rainfall estimates that are most important for skillful streamflow predictions. They perform comprehensive hydrologic investigations of radar-rainfall characteristics, including spatiotemporal resolution, radar range visibility, statistical characterization of rainfall variability, all vis-a-vis basin characteristics such as size and river network topology. Since the true rainfall fields are unknown, the authors exploit a paradigm of using two independently constructed radar-rainfall products i.e., Multi-Radar Multi-Sensor and IFC-ZR used operationally by the Iowa Flood Center (IFC). Using the distributed hydrologic model called the Hillslope-Link Model for the domain of the state of Iowa, they evaluate streamflow prediction at 140 USGS gauge stations that monitor rivers in Iowa. Through spatial and temporal rainfall aggregation experiments, the authors show that the impact of spatial and temporal resolution of rainfall is significant typically for smaller basins while starts reducing significantly for basins larger than 1,000 km 2 . Other rainfall characteristics they explored do not reveal a strong signature in the relationship of rainfall differences between the two products and hydrograph errors. However, exploring the product similarities rather than differences reveals that the basin-wide rainfall volume has the most significant effect on streamflow prediction. The results from this study are generalizable for all rainfall observing systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Using Multiple Signatures to Improve Accuracy of Substorm Identification

Abstract We have developed a new procedure for combining lists of substorm onset times from multiple sources. We apply this procedure to observational data and to magnetohydrodynamic (MHD) model output from 1–31 January 2005. We show that this procedure is capable of rejecting false positive identifications and filling data gaps that appear in individual lists. The resulting combined onset lists produce a waiting time distribution that is comparable to previously published results, and superposed epoch analyses of the solar wind driving conditions and magnetospheric response during the resulting onset times are also comparable to previous results. Comparison of the substorm onset list from the MHD model to that obtained from observational data reveals that the MHD model reproduces many of the characteristic features of the observed substorms, in terms of solar wind driving, magnetospheric response, and waiting time distribution. Heidke skill scores show that the MHD model has statistically significant skill in predicting substorm onset times.

Haiducek, John D.↗
DOE OSTI2024

Climate change-resilient snowpack estimation in the Western United States

Abstract In the 21st century, warmer temperatures and changing atmospheric circulation will likely produce unprecedented changes in Western United States snowfall 1–3 , with impacts on the timing, amount, and spatial patterns of snowpack 4–7 . The ~900 snow pillow stations are indispensable to water resource management by measuring snow-water equivalent (SWE) 8,9 in strategic but fixed locations 10,11 . However, this network may not be impacted by climate change in the same way as the surrounding area 12 and thus fail to accurately represent unmeasured locations; climate change thereby threatens our ability to measure the effects of climate change on snow. In this work, we show that maintaining the current peak SWE estimation skill is nonetheless possible. We find that explicitly including spatial correlations—either from gridded observations or learned by the model—improves skill at predicting distributed snowpack from sparse observations by 184%. Existing artificial intelligence methods can be useful tools to harness the many available sources of snowpack information to estimate snowpack in a nonstationary climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Underestimated marine stratocumulus cloud feedback associated with overly active deep convection in models

Cloud feedback remains the largest source of uncertainty in equilibrium climate sensitivity (ECS). Many studies have attempted to narrow uncertainties in cloud feedback and ECS by proposing observable metrics with high skill at predicting future climate, referred to as emergent constraints. These constraints are often associated with clouds, convection, and circulation, and are interrelated. However, physical explanations for these connections remain unclear. Here, we propose a new mechanism relating convection and clouds across multiple climate models. Some models show overly active deep convection on daily timescales in the subtropical low cloud regions, which contributes to weaker subsidence inversion and smaller amounts of low-level clouds. Such models predict smaller shortwave (SW) cloud feedback. Using precipitation frequency in these regions as an emergent constraint, encapsulating this mechanism, models with lower SW cloud feedback (<0.50 W m -2 °C - 1) are found to exhibit erroneously frequent convection. Our results suggest that further improvements in understanding and better modeling of cloud and convective systems are necessary for accurate climate predictions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1973

Variation of the low level winds during the passage of a thunderstorm gust front

Three time histories of wind profiles in thunderstorm gust fronts at Cape Kennedy and three at Oklahoma City are analyzed. Wind profiles at maximum wind strength below 100 m follow logarithmic laws, so that winds above the surface layer can be estimated from surface winds once the roughness length is known. A statistical analysis of 81 cases of surface winds during thunderstorms at Tampa revealed no predictor with skill to predict the time of maximum gust. Some 34% of the variance of the strength of the gust is accounted for by a stability index and surface wind prior to the gust; the regression equations for these variables are given. The coherence between microscale wind speed variations at the different levels has the same proportions as in non-thunderstorm cases.

Sinclair, R. W.↗
NASA NTRS1981

Integrated and spectral energetics of the GLAS general circulation model

Integrated and spectral error energetics of the Goddard Laboratory for Atmospheric Sciences (GLAS) general circulation model are compared with observations for periods in January 1975, 1976, and 1977. For two cases the model shows significant skill in predicting integrated energetics quantities out to two weeks, and for all three cases, the integrated monthly mean energetics show qualitative improvements over previous versions of the model in eddy kinetic energy and barotropic conversions. Fundamental difficulties remain with leakage of energy to the stratospheric level. General circulation model spectral energetics predictions are compared with the corresponding observational spectra on a day by day basis. Eddy kinetic energy can be correct while significant errors occur in the kinetic energy of wavenumber three. Single wavenumber dominance in eddy kinetic energy and the correlation of spectral kinetic and potential energy are demonstrated.

Tenenbaum, J.↗