Evaluating the Impact of Assimilating Aerosol Optical Depth Observations on Dust Forecasts Over North Africa and the East Atlantic Using Different Data Assimilation Methods
Explore the source record for details and available documents.
Yonghan Choi↗
SEARCH · Search NASA
Results for “forecast evaluation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Quantitative satellite applications - Tropical cyclone intensity monitoring and track forecasting
An assessment is made of the effectiveness of VISSR Atmospheric Sounder (VAS) data gathered over the North Atlantic Ocean area in the 1982 and 1983 hurricane seasons. By the end of the 1983 season, progress had been made in providing high quality analyses and displays of mass, motion and moisture patterns for evaluation. A comparison of mean forecast errors for several different operational models, official forecasts, and the VAS Trajectory model for selected cases in which VAS deep layer mean wind data were available show VAS accuracies that are comparable with those of the official forecasts.
Velden, C. S.↗
Between the Rock and a Hard Place: The CCMC as a Transit Station Between Modelers and Forecasters
The Community Coordinated Modeling Center (CCMC) is a US inter-agency activity aiming at research in support of the generation of advanced space weather models. As one of its main functions, the CCMC provides to researchers the use of space science models, even if they are not model owners themselves. The second CCMC activity is to support Space Weather forecasting at national Space Weather Forecasting Centers. This second activity involved model evaluations, model transitions to operations, and the development of draft Space Weather forecasting tools. This presentation will focus on the latter element. Specifically, we will discuss the process of transition research models, or information generated by research models, to Space Weather Forecasting organizations. We will analyze successes as well as obstacles to further progress, and we will suggest avenues for increased transitioning success.
Hesse, Michael↗
Tools and Products of Real-Time Modeling: Opportunities for Space Weather Forecasting
The Community Coordinated Modeling Center (CCMC) is a US inter-agency activity aiming at research in support of the generation of advanced space weather models. As one of its main functions, the CCMC provides to researchers the use of space science models, even if they are not model owners themselves. The second CCMC activity is to support Space Weather forecasting at national Space Weather Forecasting Centers. This second activity involves model evaluations, model transitions to operations, and the development of draft Space Weather forecasting tools. This presentation will focus on the last element. Specifically, we will discuss present capabilities, and the potential to derive further tools. These capabilities will be interpreted in the context of a broad-based, bootstrapping activity for modern Space Weather forecasting.
Hesse, Michael↗
The Impact of Assimilating Precipitation-affected Radiance on Cloud and Precipitation in Goddard WRF-EDAS Analyses
High-frequency TMI and AMSR-E radiances, which are sensitive to precipitation over land, are assimilated into the Goddard Weather Research and Forecasting Model- Ensemble Data Assimilation System (WRF-EDAS) for a few heavy rain events over the continental US. Independent observations from surface rainfall, satellite IR brightness temperatures, as well as ground-radar reflectivity profiles are used to evaluate the impact of assimilating rain-sensitive radiances on cloud and precipitation within WRF-EDAS. The evaluations go beyond comparisons of forecast skills and domain-mean statistics, and focus on studying the cloud and precipitation features in the jointed rainradiance and rain-cloud space, with particular attentions on vertical distributions of height-dependent cloud types and collective effect of cloud hydrometers. Such a methodology is very helpful to understand limitations and sources of errors in rainaffected radiance assimilations. It is found that the assimilation of rain-sensitive radiances can reduce the mismatch between model analyses and observations by reasonably enhancing/reducing convective intensity over areas where the observation indicates precipitation, and suppressing convection over areas where the model forecast indicates rain but the observation does not. It is also noted that instead of generating sufficient low-level warmrain clouds as in observations, the model analysis tends to produce many spurious upperlevel clouds containing small amount of ice water content. This discrepancy is associated with insufficient information in ice-water-sensitive radiances to address the vertical distribution of clouds with small amount of ice water content. Such a problem will likely be mitigated when multi-channel multi-frequency radiances/reflectivity are assimilated over land along with sufficiently accurate surface emissivity information to better constrain the vertical distribution of cloud hydrometers.
WRF-EDAS Analyses↗
Evaluation of Mesoscale Model Phenomenological Verification Techniques
Forecasters at the Spaceflight Meteorology Group, 45th Weather Squadron, and National Weather Service in Melbourne, FL use mesoscale numerical weather prediction model output in creating their operational forecasts. These models aid in forecasting weather phenomena that could compromise the safety of launch, landing, and daily ground operations and must produce reasonable weather forecasts in order for their output to be useful in operations. Considering the importance of model forecasts to operations, their accuracy in forecasting critical weather phenomena must be verified to determine their usefulness. The currently-used traditional verification techniques involve an objective point-by-point comparison of model output and observations valid at the same time and location. The resulting statistics can unfairly penalize high-resolution models that make realistic forecasts of a certain phenomena, but are offset from the observations in small time and/or space increments. Manual subjective verification can provide a more valid representation of model performance, but is time-consuming and prone to personal biases. An objective technique that verifies specific meteorological phenomena, much in the way a human would in a subjective evaluation, would likely produce a more realistic assessment of model performance. Such techniques are being developed in the research community. The Applied Meteorology Unit (AMU) was tasked to conduct a literature search to identify phenomenological verification techniques being developed, determine if any are ready to use operationally, and outline the steps needed to implement any operationally-ready techniques into the Advanced Weather Information Processing System (AWIPS). The AMU conducted a search of all literature on the topic of phenomenological-based mesoscale model verification techniques and found 10 different techniques in various stages of development. Six of the techniques were developed to verify precipitation forecasts, one to verify sea breeze forecasts, and three were capable of verifying several phenomena. The AMU also determined the feasibility of transitioning each technique into operations and rated the operational capability of each technique on a subjective 1-10 scale: (1) 1 indicates that the technique is only in the initial stages of development, (2) 2-5 indicates that the technique is still undergoing modifications and is not ready for operations, (3) 6-8 indicates a higher probability of integrating the technique into AWIPS with code modifications, and (4) 9-10 indicates that the technique was created for AWIPS and is ready for implementation. Eight of the techniques were assigned a rating of 5 or below. The other two received ratings of 6 and 7, and none of the techniques a rating of 9-10. At the current time, there are no phenomenological model verification techniques ready for operational use. However, several of the techniques described in this report may become viable techniques in the future and should be monitored for updates in the literature. The desire to use a phenomenological verification technique is widespread in the modeling community, and it is likely that other techniques besides those described herein are being developed, but the work has not yet been published. Therefore, the AMIU recommends that the literature continue to be monitored for updates to the techniques described in this report and for new techniques being developed whose results have not yet been published. 111
Lambert, Winifred↗
Forecast skill impact of drifting buoys in the Southern Hemisphere
Two analyses are performed to evaluate the effect of drift buoys and the FGGE's special observing system (SOS) on forecasting. The FGGE analysis utilizes all level II-b conventional and special data, and the Nosat analysis employs only surface and conventional upper air data. Twelve five-day forecasts are produced from these data. An additional experiment utilizing the FGGE data base minus buoys data, and the Nosat data base including buoys data is being conducted. The forecasts are compared and synoptic evaluation of the effect of buoys data is described. The results reveal that the FGGE data base with the SOS significantly improves forecasting in the Southern Hemisphere and the loss of buoys data does not have a great effect on forecasting. The Nosat data has less impact on forecasting; however, the addition of buoys data provides an improvement in forecast skills.
Kalnay, E.↗
User's appraisal of yield model evaluation criteria
The five major potential USDA users of AgRISTAR crop yield forecast models rated the Yield Model Development (YMD) project Test and Evaluation Criteria by the importance placed on them. These users were agreed that the "TIMELINES" and "RELIABILITY" of the forecast yields would be of major importance in determining if a proposed yield model was worthy of adoption. Although there was considerable difference of opinion as to the relative importance of the other criteria, "COST", "OBJECTIVITY", "ADEQUACY", AND "MEASURES OF ACCURACY" generally were felt to be more important that "SIMPLICITY" and "CONSISTENCY WITH SCIENTIFIC KNOWLEDGE". However, some of the comments which accompanied the ratings did indicate that several of the definitions and descriptions of the criteria were confusing.
Warren, F. B.↗
Winter Precipitation in North America and the Pacific-North America Pattern in GEOS-S2Sv2 Seasonal Hindcast
Reliable prediction of precipitation remains one of the most pivotal and complex challenges in seasonal forecasting. Previous studies show that various large-scale climate modes, such as ENSO, PNA and NAO play significant role in winter precipitation variability over the Northern America. The influences are most pronounced in years of strong indices of such climate modes. This study evaluates model bias, predictability and forecast skills of monthly winter precipitation in GEOS5-S2S 2.0 retrospective forecast from 1981 to 2016, with emphasis on the forecast skill of precipitation over North America during the extreme events of ENSO, PNA and NAO by applying EOF and composite analysis.
Li, Zhao↗
Global Positioning System (GPS) Precipitable Water in Forecasting Lightning at Spaceport Canaveral
This paper evaluates the use of precipitable water (PW) from Global Positioning System (GPS) in lightning prediction. Additional independent verification of an earlier model is performed. This earlier model used binary logistic regression with the following four predictor variables optimally selected from a candidate list of 23 candidate predictors: the current precipitable water value for a given time of the day, the change in GPS-PW over the past 9 hours, the KIndex, and the electric field mill value. This earlier model was not optimized for any specific forecast interval, but showed promise for 6 hour and 1.5 hour forecasts. Two new models were developed and verified. These new models were optimized for two operationally significant forecast intervals. The first model was optimized for the 0.5 hour lightning advisories issued by the 45th Weather Squadron. An additional 1.5 hours was allowed for sensor dwell, communication, calculation, analysis, and advisory decision by the forecaster. Therefore the 0.5 hour advisory model became a 2 hour forecast model for lightning within the 45th Weather Squadron advisory areas. The second model was optimized for major ground processing operations supported by the 45th Weather Squadron, which can require lightning forecasts with a lead-time of up to 7.5 hours. Using the same 1.5 lag as in the other new model, this became a 9 hour forecast model for lightning within 37 km (20 NM)) of the 45th Weather Squadron advisory areas. The two new models were built using binary logistic regression from a list of 26 candidate predictor variables: the current GPS-PW value, the change of GPS-PW over 0.5 hour increments from 0.5 to 12 hours, and the K-index. The new 2 hour model found the following for predictors to be statistically significant, listed in decreasing order of contribution to the forecast: the 0.5 hour change in GPS-PW, the 7.5 hour change in GPS-PW, the current GPS-PW value, and the KIndex. The new 9 hour forecast model found the following five independent variables to be statistically significant, listed in decreasing order of contribution to the forecast: the current GPSPW value, the 8.5 hour change in GPS-PW, the 3.5 hour change in GPS-PW, the 12 hour change in GPS-PW, and the K-Index. In both models, the GPS-PW parameters had better correlation to the lightning forecast than the K-Index, a widely used thunderstorm index. Possible future improvements to this study are discussed.
Kehrer, Kristen C.↗
Effect of Combined Spaceborne Microwave and Continuous Lightning Measurements on Precipitation Forecasts of the 1998 Ground-Hog Day Storm
We evaluated the impact of several newly available sources of meteorological data on mesoscale model forecasts of precipitation produced by the extra-tropical cyclone that struck Florida on February 2, 1998. Precipitation distributions of convective rainfall events were derived from Special Sensor Microwave Imager (SSM/I) and Multi-Channel Passive Microwave Sensor (TMI) microwave radiometric data by means of the Goddard PROFiling (GPROF) algorithm. Continuous lightning distributions were obtained from sferics measurements obtained from a network of VLF radio receivers. Histograms of coincident sferics frequency distributions were matched to those of precipitation to derive bogus convective rainfall rates from the continuously available sferics measurements. SSM/I and TMI microwave data were used to derive Integrated Precipitable Water (IPW) distributions. The TMI also provided sea surface temperatures (SSTS) of the Loop Current and Gulf Stream with improved structural detail. A series of experiments assimilated IPW and latent heating from the bogus convective rainfall for six-hours in the MM5 mesoscale forecast model to produce nine-hour forecasts of all rainfall as well as other weather parameters. Although continuously assimilating latent heating only slightly improved the surface pressure distribution forecast, it significantly improved the precipitation forecasts. Correctly locating convective rainfall was found critical for assimilating latent heating in the forecast model, but measurement of the rainfall intensity proved to be less important. The improved SSTs also had a positive impact on rainfall forecasts for this case. Assimilating bogus rainfall in the model produced nine-hour forecasts of radar reflectivity distributions that agreed well with coincident observations from the TRMM spaceborne precipitation radar, ground based radar and spaceborne microwave measurements.
Weinman, James A.↗
The Impact of TRMM Data on Numerical Forecast of Mesoscale Systems
The impact of surface rainfall data derived from the TRMM Microwave Image (TMI) on the numerical forecast of mesoscale systems is evaluated. A series of numerical experiments are performed that assimilate TMI rainfall data into the Penn State University/National Centers for Atmospheric Research (PSU/NCAR) Mesoscale Model version 5 (MM5) using a four-dimensional variational data assimilation (4DVAR) technique. Experiments are conducted incorporating TMI rainfall data into the mesoscale model to improve hurricane initialization. It is found that assimilation of rainfall data into the model is beneficial in producing a more realistic eye and rain bands and also helps to improve the intensity forecast for the hurricane. Further 4DVAR experiments are performed on mesoscale convective systems (MCSs). Detailed results and related issues will be presented during the conference.
Pu, Zhao-Xia↗
Forecast skill of a high-resolution real-time mesoscale model designed for weather support of operations at Kennedy Space Center and Cape Canaveral Air Station
NASA funded Mesoscale Environmental Simulations and Operations (MESO), Inc. to develop a version of the Mesoscale Atmospheric Simulation System (MASS). The model has been modified specifically for short-range forecasting in the vicinity of KSC/CCAS. To accomplish this, the model domain has been limited to increase the number of horizontal grid points (and therefore grid resolution) and the model' s treatment of precipitation, radiation, and surface hydrology physics has been enhanced to predict convection forced by local variations in surface heat, moisture fluxes, and cloud shading. The objective of this paper is to (1) provide an overview of MASS including the real-time initialization and configuration for running the data pre-processor and model, and (2) to summarize the preliminary evaluation of the model's forecasts of temperature, moisture, and wind at selected rawinsonde station locations during February 1994 and July 1994. MASS is a hydrostatic, three-dimensional modeling system which includes schemes to represent planetary boundary layer processes, surface energy and moisture budgets, free atmospheric long and short wave radiation, cloud microphysics, and sub-grid scale moist convection.
Taylor, Gregory E.↗
An assessment of VAS-derived retrievals and parameters used in thunderstorm forecasting
VAS satellite retrievals and derived parameters used in forecasting severe local storms were evaluated against corresponding radiosonde values. VAS products were also compared with the first-guess input to the retrieval algorithm. The evaluation methodology was to pair each radiosonde observation with the closest VAS retrieval within 50 km during a four-month period in 1986. VAS temperatures agreed closely with radiosonde values; dewpoints showed less agreement. Sounding differences were poorly correlated with the number of pixels from which the retrievals were prepared. VAS discrepancies usually were not well correlated with first-guess errors. Horizontal gradients of VAS products were stronger than those from radiosondes. VAS precipitable water agreed better with ground truth than did dewpoints at individual levels, but VAS thicknesses were not much improved. Results for severe storms forecasting parameters indicated that discrepancies increased with the amount of manipulation required during computation. The lifted index showed the best agreement; positive bouyant energy showed poor comparisons.
Fuelberg, Henry E.↗
Evaluating the Performance of Single and Double Moment Microphysics Schemes During a Synoptic-Scale Snowfall Event
Increases in computing resources have allowed for the utilization of high-resolution weather forecast models capable of resolving cloud microphysical and precipitation processes among varying numbers of hydrometeor categories. Several microphysics schemes are currently available within the Weather Research and Forecasting (WRF) model, ranging from single-moment predictions of precipitation content to double-moment predictions that include a prediction of particle number concentrations. Each scheme incorporates several assumptions related to the size distribution, shape, and fall speed relationships of ice crystals in order to simulate cold-cloud processes and resulting precipitation. Field campaign data offer a means of evaluating the assumptions present within each scheme. The Canadian CloudSat/CALIPSO Validation Project (C3VP) represented collaboration among the CloudSat, CALIPSO, and NASA Global Precipitation Measurement mission communities, to observe cold season precipitation processes relevant to forecast model evaluation and the eventual development of satellite retrievals of cloud properties and precipitation rates. During the C3VP campaign, widespread snowfall occurred on 22 January 2007, sampled by aircraft and surface instrumentation that provided particle size distributions, ice water content, and fall speed estimations along with traditional surface measurements of temperature and precipitation. In this study, four single-moment and two double-moment microphysics schemes were utilized to generate hypothetical WRF forecasts of the event, with C3VP data used in evaluation of their varying assumptions. Schemes that incorporate flexibility in size distribution parameters and density assumptions are shown to be preferable to fixed constants, and that a double-moment representation of the snow category may be beneficial when representing the effects of aggregation. These results may guide forecast centers in optimal configurations of their forecast models for winter weather and identify best practices present within these various schemes.
Molthan, Andrew L.↗
Using TRMM Field Campaign Data for Assessing GEOS Forecast and Assimilation Products
The wealth of in-situ measurements gathered during Tropical Rain Measuring Mission (TRMM) field campaigns over a wide range of tropical conditions constitute an important data source for evaluating the quality of global model forecasts and assimilated datasets. In this study we use selected observations of cloud microphysics and atmospheric sounding from TEFLUN-1998, SCEMEX-1998, and TRMMLBA-1999 to examine the assimilation and forecast fields produced by the operational GEOS-3 (Goddard Earth Observing System - version 3) global data assimilation system (DAS) and a new finite-volume DAS under development at the Data Assimilation Office. Additionally, TRMM field campaign measurements are used to verify the impact of assimilating rainfall and moisture data derived from TRMM Microwave Imager and Special Sensor Microwave/Imager instruments on the GEOS analysis. We will also explore issues concerning the 'error of representativeness' in using in-situ observations of quantities with large spatial and temporal variability such as precipitation for validating gridded global data products.
Hou, Arthur Y.↗
Regional Model Nesting Within GFS Daily Forecasts Over West Africa
The study uses the RM3, the regional climate model at the Center for Climate Systems Research of Columbia University and the NASA/Goddard Institute for Space Studies (CCSR/GISS). The paper evaluates 30 48-hour RM3 weather forecasts over West Africa during September 2006 made on a 0.5 grid nested within 1 Global Forecast System (GFS) global forecasts. September 2006 was the Special Observing Period #3 of the African Monsoon Multidisciplinary Analysis (AMMA). Archived GFS initial conditions and lateral boundary conditions for the simulations from the US National Weather Service, National Oceanographic and Atmospheric Administration were interpolated four times daily. Results for precipitation forecasts are validated against Tropical Rainfall Measurement Mission (TRMM) satellite estimates and data from the Famine Early Warning System (FEWS), which includes rain gauge measurements, and forecasts of circulation are compared to reanalysis 2. Performance statistics for the precipitation forecasts include bias, root-mean-square errors and spatial correlation coefficients. The nested regional model forecasts are compared to GFS forecasts to gauge whether nesting provides additional realistic information. They are also compared to RM3 simulations driven by reanalysis 2, representing high potential skill forecasts, to gauge the sensitivity of results to lateral boundary conditions. Nested RM3/GFS forecasts generate excessive moisture advection toward West Africa, which in turn causes prodigious amounts of model precipitation. This problem is corrected by empirical adjustments in the preparation of lateral boundary conditions and initial conditions. The resulting modified simulations improve on the GFS precipitation forecasts, achieving time-space correlations with TRMM of 0.77 on the first day and 0.63 on the second day. One realtime RM3/GFS precipitation forecast made at and posted by the African Centre of Meteorological Application for Development (ACMAD) in Niamey, Niger is shown.
Druyan, Leonard M.↗
Evaluation of the effect of VAS data on some NMC analyses and forecasts
The effect of visible/infrared atmospheric sounder (VAS) data on the limited area fine mesh model (LFM) analysis forecast system were examined. The VAS data obtained from the Pacific geostationary satellite are valuable for LFM analysis because temperatures from the polar orbiting satellite over the east Pacific are received too late for 1200 GMT LFM analysis. Because the VISSR has only infrared channels, retrievals are possible only in regions with little or no cloudiness.
Olenic, E. A.↗