Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Statistical Analysis of Model Data for Operational Space Launch Weather Support at Kennedy Space Center and Cape Canaveral Air Force Station

The 12-km resolution North American Mesoscale (NAM) model (MesoNAM) is used by the 45th Weather Squadron (45 WS) Launch Weather Officers at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) to support space launch weather operations. The 45 WS tasked the Applied Meteorology Unit to conduct an objective statistics-based analysis of MesoNAM output compared to wind tower mesonet observations and then develop a an operational tool to display the results. The National Centers for Environmental Prediction began running the current version of the MesoNAM in mid-August 2006. The period of record for the dataset was 1 September 2006 - 31 January 2010. The AMU evaluated MesoNAM hourly forecasts from 0 to 84 hours based on model initialization times of 00, 06, 12 and 18 UTC. The MesoNAM forecast winds, temperature and dew point were compared to the observed values of these parameters from the sensors in the KSC/CCAFS wind tower network. The data sets were stratified by model initialization time, month and onshore/offshore flow for each wind tower. Statistics computed included bias (mean difference), standard deviation of the bias, root mean square error (RMSE) and a hypothesis test for bias = O. Twelve wind towers located in close proximity to key launch complexes were used for the statistical analysis with the sensors on the towers positioned at varying heights to include 6 ft, 30 ft, 54 ft, 60 ft, 90 ft, 162 ft, 204 ft and 230 ft depending on the launch vehicle and associated weather launch commit criteria being evaluated. These twelve wind towers support activities for the Space Shuttle (launch and landing), Delta IV, Atlas V and Falcon 9 launch vehicles. For all twelve towers, the results indicate a diurnal signal in the bias of temperature (T) and weaker but discernable diurnal signal in the bias of dewpoint temperature (T(sub d)) in the MesoNAM forecasts. Also, the standard deviation of the bias and RMSE of T, T(sub d), wind speed and wind direction indicated the model error increased with the forecast period all four parameters. The hypothesis testing uses statistics to determine the probability that a given hypothesis is true. The goal of using the hypothesis test was to determine if the model bias of any of the parameters assessed throughout the model forecast period was statistically zero. For th is dataset, if this test produced a value >= -1 .96 or <= 1.96 for a data point, then the bias at that point was effectively zero and the model forecast for that point was considered to have no error. A graphical user interface (GUI) was developed so the 45 WS would have an operational tool at their disposal that would be easy to navigate among the multiple stratifications of information to include tower locations, month, model initialization times, sensor heights and onshore/offshore flow. The AMU developed the GUI using HyperText Markup Language (HTML) so the tool could be used in most popular web browsers with computers running different operating systems such as Microsoft Windows and Linux.

Bauman, William H., III↗
NASA NTRS1998

Evaluation of the 29-km Eta Model: Objective Verification at Three Selected Stations - Part 1

This paper describes an objective verification of the National Centers for Environmental Prediction (NCEP) 29-km eta model from May 1996 through January 1998. The evaluation was designed to assess the model's surface and upper-air point forecast accuracy at three selected locations during separate warm (May - August) and cool (October - January) season periods. In order to enhance sample sizes available for statistical calculations, the objective verification includes two consecutive warm and cool season periods. Systematic model deficiencies comprise the larger portion of the total error in most of the surface forecast variables that were evaluated. The error characteristics for both surface and upper-air forecasts vary widely by parameter, season, and station location. At upper levels, a few characteristic biases are identified. Overall however, the upper-level errors are more nonsystematic in nature and could be explained partly by observational measurement uncertainty. With a few exceptions, the upper-air results also indicate that 24-h model error growth is not statistically significant. In February and August 1997, NCEP implemented upgrades to the eta model's physical parameterizations that were designed to change some of the model's error characteristics near the surface. The results shown in this paper indicate that these upgrades led to identifiable and statistically significant changes in forecast accuracy for selected surface parameters. While some of the changes were expected, others were not consistent with the intent of the model updates and further emphasize the need for ongoing sensitivity studies and localized statistical verification efforts. Objective verification of point forecasts is a stringent measure of model performance, but when used alone, is not enough to quantify the overall value that model guidance may add to the forecast process. Therefore, results from a subjective verification of the meso-eta model over the Florida peninsula are discussed in the companion paper by Manobianco and Nutter. Overall verification results presented here and in part two should establish a reasonable benchmark from which model users and developers may pursue the ongoing eta model verification strategies in the future.

Nutter, Paul A.↗
NASA NTRS1979

Forecasts of geomagnetic activity by Ottawa Magnetic Observatory: Their reliabilty and application

A 27 day forecast of geomagnetic activity based on the forecasts from two locations is presented. To evaluate the reliability of the forecasts, the predicted activity was compared with the actual geomagnetic activity at five geomagnetic observatories located in different magnetic zones: Ottawa (57.0N, 351.5E); Meanook (61.8N, 301.0E); Fort Churchill (68.8N, 322.5E); Cambridge Bay (76.7N, 294.0E); and Resolute Bay (83.1N, 287.7E). Results indicate that the percentage of correct predictions varies with the geomagnetic latitude of the observatory used for comparison. The percentage is on the average highest for lower latitude stations and lowest for the northern stations. The number of incorrect predictions ranges from 4.7% for Ottawa to 8.4% for Churchill.

Hruska, J.↗
NASA NTRS1978

Post LANDSAT D advanced concept evaluation

Preliminary results of a past LANDSAT D advanced concept evaluation study to forecast and identify key technologies required for earth resources satellite systems in the 1985 to 2000 time period are presented. Mission categories discussed include agriculture, range management, forestry, geological resources, land use, water resources, environmental quality, and disaster assessment. Sensor and system concepts are described for a passive L-band radiometer (microsat), a texturometer to measure ground surface texture, and a ferris wheel radar configuration that relies on cable tension for support.

Flatow, F. S.↗
NASA NTRS1983

The impact of Seasat-A scatterometer data on GLAS model forecasts

The effect of SASS (Seasat-A Satellite Scatterometer) data on the GLAS analysis and forecast system is assessed. After discussing the objective analysis and assimilation of SASS winds, consideration is given to a scheme developed to objectively dealias the SASS data. Results are then presented from analysis and forecast experiments. The evaluation finds a negligible effect of the SASS data in the Northern Hemisphere. In the Southern Hemisphere, the impact is larger and for the most part beneficial when the VTPR (vertical temperature profile radiometer) is excluded. However, the inclusion of VTPR data effectively eliminates this positive impact, suggesting some redundancy between the two data sets.

Atlas, R.↗
NASA NTRS1985

Ability of a regional-scale model to predict the genesis of intense mesoscale convective systems

The mesoscale part of a two-part evaluation of 30 forecasts by a mesoscale numerical weather prediction model (MASS 2.0) is presented. Unfiltered fields are combined into convective predictor fields, the loci of which are then related at two-hour intervals to the loci of strong mesoscale convective systems identifiable in national radar summary plots and GOES satellite imagery. Examples of model 'forecasts' of intense convective storm clusters, a severe squall line triggered along a dryline, orographically induced hailstorms, and sea breeze thunderstorms are provided.

Koch, S. E.↗
NASA NTRS2004

The LATEST Project: Operational Assessment of Total Lightning Data in the U.S.

A government, university, and industry alliance has joined forces to transition total lightning observations from ground-based research networks and NASA satellites (LIS/TRMM) to improve the short range prediction of severe weather. This interest builds on the desire of the U.S Weather Research Program to foster a national Nowcasting Test Bed, with this specific transition activity initiated through the NASA short-term Prediction Research and Transition (SPoRT) Center in Huntsville, AL. A kick-off national workshop sponsored by the SPoRT Center was held in Huntsville April 1-2 to identify the common goals and objectives of the research and operational community, and to assign roles and responsibilities within the alliance. The workshop agenda, presentations, and summary are available at the SPoRT Center Web site ( h h under the "Meetings" tab. The next national workshop is planned for 2005 in Dallas, TX. The NASA North Alabama regional Lightning Mapping Array &MA) has been operational in the Huntsville area for 3 years, and has continuously sampled a variety of severe weather systems during that period. A gridded version of the LMA total lightning data is currently being supplied to National Weather Service offices in Huntsville, Nashville and Birmingham through the NWS AWES decision support system, for the purposes of assessing the utility of the data in the nowcasting of severe weather such as tornadoes, damaging straight line winds, flash flooding and other weather hazards (lightning induced forest fires, microbursts). While the raw LMA data have been useful to NWS forecasters, even greater utility would be realized if higher-order data products could be supplied through AWIPS along with the gridded data over a larger domain. In 2003-2004 additional LMA systems have been deployed across the southern US. from Florida to New Mexico, providing an opportunity for more than 20 NWS forecast offices to evaluate the incremental value of total lightning data in the warning decision making process.

Goodman, Steven↗
NASA NTRS2005

Contour Error Map Algorithm

The contour error map (CEM) algorithm and the software that implements the algorithm are means of quantifying correlations between sets of time-varying data that are binarized and registered on spatial grids. The present version of the software is intended for use in evaluating numerical weather forecasts against observational sea-breeze data. In cases in which observational data come from off-grid stations, it is necessary to preprocess the observational data to transform them into gridded data. First, the wind direction is gridded and binarized so that D(i,j;n) is the input to CEM based on forecast data and d(i,j;n) is the input to CEM based on gridded observational data. Here, i and j are spatial indices representing 1.25-km intervals along the west-to-east and south-to-north directions, respectively; and n is a time index representing 5-minute intervals. A binary value of D or d = 0 corresponds to an offshore wind, whereas a value of D or d = 1 corresponds to an onshore wind. CEM includes two notable subalgorithms: One identifies and verifies sea-breeze boundaries; the other, which can be invoked optionally, performs an image-erosion function for the purpose of attempting to eliminate river-breeze contributions in the wind fields.

Merceret, Francis↗
NASA NTRS2016

JPSS Preparations at the Satellite Proving Ground for Marine, Precipitation, and Satellite Analysis

The ocean prediction center at the national hurricane center's tropical analysis and forecast Branch, the Weather Prediction center and the Satellite analysis branch of NESDIS make up the Satellite Proving Ground for Marine, Precipitation and Satellite Analysis. These centers had early exposure to JPSS products using the S-NPP Satellite that was launched in 2011. Forecasters continue to evaluate new products in anticipation for the launch of JPSS-1 sometime in 2017.

Remote Sensing↗
NASA NTRS2022

NASA's NMME-Based S2S Hydrologic Forecast System for Food Insecurity Early Warning in Southern Africa

In situ hydrologic monitoring over regions most susceptible to food insecurity can be a challenge in current times due to various socio-economic and political issues in combination with environmental factors such as ongoing famine or drought. Hydrologic monitoring and initializing forecasts based on remotely sensed and analyzed data can contribute significantly to early warning in such regions. Routine hydrologic forecasts, as provided by NASA’s Hydrologic Forecasting and Analysis System (NHyFAS), are a recent addition to early warning systems. A custom instance of NHyFAS, termed FLDAS-Forecast, is used by FEWS NET’s Land Data Assimilation System (FLDAS). The FLDAS-Forecast’s dynamic forecasting component was originally set up with Goddard Earth Observing System (GEOS) forecast inputs and has been recently expanded with precipitation forecast forcing from the North American Multi-Model Ensemble (NMME). This paper describes the improvements in seasonal hydrologic forecasts produced with this updated system. Evaluations in this study focus on soil moisture across southern Africa’s growing season. Soil moisture forecasts are benchmarked and evaluated relative to climatology-based forecasts and historic runs, which are driven by observation-based meteorological forcing fields, and they are verified with remotely sensed observations of soil moisture and vegetation. Through multiple deterministic and probabilistic skill assessments, we show that using the larger ensemble of NMME precipitation inputs in the forecast system results in higher quality hydrologic forecasts than are allowed by climatology- or GEOS-only-based forecasts. Further, the near-real-time NMME-based rootzone soil moisture forecasts were able to correctly predict developing drought conditions over southern Africa through late 2019 and into early 2020.

Hydrologic forecasts↗
NASA NTRS2020

Evaluation of adjoint-based observation impacts as a function of forecast length using an Observing System Simulation Experiment

Adjoints of numerical weather prediction models may be employed for Forecast Sensitivity to Observation (FSO) in order to monitor the contribution of ingested observation data on short-term forecast skill. However, the calculation of short-term forecast error is difficult due to the lack of a truly independent dataset for verification. In an Observing System Simulation Experiment framework, the Nature Run is able to provide a true and complete verification dataset and allows accurate evaluation of short term forecast errors. In this work, an OSSE developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office is used to explore the impact of observational data on forecasts in the 6 to 48 hour range. An adjoint of the Global Earth Observing System model is employed to compare the observation impacts estimated using both self-analysis verification and the true Nature Run verification. Self-analysis verification is found to inflate the estimated forecast error growth during the early forecast period, resulting in overestimations of observation impacts, particularly in the 6-12 hour forecast range. By 48 hours, the self-analysis verification estimates of forecast error and observation impacts more closely match the true values. The fraction of beneficial observations is also overinflated at short forecast times when self-analysis verification is used. The progression of impacts of an individual observation or data type depends on the character of the growth of the initial condition error that each observation affects.

numerical weather prediction↗
NASA NTRS1993

Aviation Weather Program (AWP)

The Aviation Weather Program (AWP) combines additional weather observations, improved forecast technology, and more efficient distribution of information to pilots, controllers, and automated systems to improve the weather information provided to the air traffic control system, pilots, and other users of aviation weather information. Specific objectives include the needs to: improve airport and en-route capacity by accurate, high resolution, timely forecasts of changing weather conditions affecting airport and en-route operations; improve analyses and forecasts of upper-level winds for efficient flight planning and traffic management; and increase flight safety through improved aviation weather hazard forecasting (e.g. icing, turbulence, severe storms, microbursts, or strong winds). The AWP would benefit from participation in a cooperative multiscale experiment by obtaining data for: evaluation of aviation weather forecast products, analysis of four dimensional data assimilation schemes, and experimental techniques for retrieving aerosol and other visibility parameters. A multiscale experiment would also be helpful to AWP by making it possible to evaluate the added benefit of enhanced data sets collected during the experiment on those forecast and analysis products. The goals of the Coperative Multiscale Experiment (CME) are an essential step in attaining the long-term AWP objective of providing two-to-four hour location-specific forecasts of significant weather. Although the possibility of a funding role for the AWP in the CME is presently unclear, modest involvement of Federal Aviation Administration (FAA)/AWP personnel could be expected.

Foote, Brant↗
NASA NTRS2011

Evaluating the Impact of AIRS Observations on Regional Forecasts at the SPoRT Center

NASA Short-term Prediction Research and Transition (SPoRT) Center collaborates with operational partners of different sizes and operational goals to improve forecasts using targeted projects and data sets. Modeling and DA activities focus on demonstrating utility of NASA data sets and capabilities within operational systems. SPoRT has successfully assimilated the Atmospheric Infrared Sounder (AIRS) radiance and profile data. A collaborative project is underway with the Joint Center for Satellite Data Assimilation (JCSDA) to use AIRS profiles to better understand the impact of AIRS radiances assimilated within Gridpoint Statistical Interpolation (GSI) in hopes of engaging the operational DA community in a reassessment of assimilation methodologies to more effectively assimilate hyperspectral radiances.

Zavodsky, Bradley↗
NASA NTRS2016

IN31A-1734 Development and Evaluation of a Gridded CrIS/ATMS Visualization for Operational Forecasting

A collaborative effort between SPoRT, CIMSS, CIRA, GINA, and NOAA has produced a unique gridded visualization of real-time CrIS/ATMS sounding products. This product uses the NUCAPS retrieval algorithm and polar2grid software to generate plan-view and cross-section visualization for forecast challenges associated with cold air aloft and convective potential. Forecasters at select partner offices have been able to view the Gridded NUCAPS products in AWIPS alongside other operational data products with generally favorable feedback.

aviation↗
NASA NTRS2024

Northern Brazil Agriculture: Measuring Soybean Yields in Northern Brazil During El Niño-Southern Oscillation Conditions to Evaluate Trends in Agricultural Production and Support Crop Forecasting, 1984 – 2023

As one of the largest agricultural exporters in the world, Brazil’s crop productivity is highly influential to the world’s food supply. Crop productivity across Brazil is heavily influenced by climatic factors, such as the El Niño-Southern Oscillation (ENSO), which drives spatially heterogenous effects on growing conditions. To understand the relationship between ENSO conditions and staple crop productivity, the team used 1984 – 2023 climatic data and vegetation indices for four Brazilian states: Bahia, Mato Grosso, Pará, and Tocantins. The team focused on soybean growing areas in each state derived from annual land use/land cover classifications. Monthly mean Normalized Difference Vegetation Index (NDVI) per state were calculated using multispectral imagery from the Landsat 5 Thematic Mapper (TM), Landsat 7 Enhanced Thematic Mapper Plus (ETM+), and Landsat 8 Operational Land Imagery (OLI) sensors. In addition, the team used crop production indices, ENSO anomalies, temperature, and precipitation data in this study. The team found that although monthly ENSO anomaly did have a positive relationship between temperature and a slight negative relationship with precipitation, ENSO and monthly soy NDVI were not significantly correlated. Results find no association between ENSO conditions and NDVI in the study area at the state level spatial resolution during the study period. Furthermore, the team found that there was no correlation between cumulative growing season soy NDVI and detrended soy production yield for this study region at the spatial and temporal scale of the analysis. Findings from this project will be used by the United States Department of Agriculture’s Foreign Agriculture Service to inform crop productivity forecasting.

remote sensing↗
NASA NTRS1993

Session on validation of coupled models

The session on validation of coupled models is reviewed. The current use of a mesoscale model with a grid size of 20-km during STORM-FEST in 1992 has proven to be extremely valuable. The availability of forecast products at a much higher temporal and spatial resolution was very helpful for mesoscale forecasting, mission planning, and the guidance of research aircraft. Recent numerical simulation of ocean cyclones and mesoscsle convective systems using nonhydrostatic cloud/mesoscale models with a grid size as small as 2-km have demonstrated the potential of these models for predicting mesoscale convective systems, squall lines, hurricane rainbands, mesoscale gravity waves, and mesoscale frontal structures embedded within an extratropical cyclone. Although mesoscale/cloud scale models have demonstrated strong potential for use in operational forecasting, very limited quantitative evaluation (and verification) of these models were performed. As a result, the accuracy, the systematic biases, and the useful forecasts limits were not properly defined for these models. Also, no serious attempts were made to use these models for operational prediction of mesoscale convective systems.

Kuo, Bill↗
NASA NTRS1992

Low-frequency predictability of the Dynamical Extended-Range Forecast Experiment

The objective of the study was to analyze data from the Dynamical Extended-Range Forecast Experiment conducted from January 1986 to March 1987, and to evaluate differences between analysis and forecasts with emphasis on the tropical 30-50-day oscillation. The diagnostic toll used is the projection of analysis and forecast data onto the normal modes of a primitive equation model. Examination of zonal-wind anomalies in the tropics shows that the forecast model predicts propagation of intraseasonal variations more accurately for slow propagation rates. The forecast amplitude is generally weaker than the analyzed amplitude. Analyzed kinetic energy and error fields exhibit similar horizontal scales for internal and external modes. External Rossby-mode components maximize in the extratropics while Rossby internal modes exhibit patterns that extend over the entire globe.

Nogues-Peagle, Julia↗