Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Advances in Landslide Hazard Forecasting: Evaluation of Global and Regional Modeling Approach

A prototype global satellite-based landslide hazard algorithm has been developed to identify areas that exhibit a high potential for landslide activity by combining a calculation of landslide susceptibility with satellite-derived rainfall estimates. A recent evaluation of this algorithm framework found that while this tool represents an important first step in larger-scale landslide forecasting efforts, it requires several modifications before it can be fully realized as an operational tool. The evaluation finds that the landslide forecasting may be more feasible at a regional scale. This study draws upon a prior work's recommendations to develop a new approach for considering landslide susceptibility and forecasting at the regional scale. This case study uses a database of landslides triggered by Hurricane Mitch in 1998 over four countries in Central America: Guatemala, Honduras, EI Salvador and Nicaragua. A regional susceptibility map is calculated from satellite and surface datasets using a statistical methodology. The susceptibility map is tested with a regional rainfall intensity-duration triggering relationship and results are compared to global algorithm framework for the Hurricane Mitch event. The statistical results suggest that this regional investigation provides one plausible way to approach some of the data and resolution issues identified in the global assessment, providing more realistic landslide forecasts for this case study. Evaluation of landslide hazards for this extreme event helps to identify several potential improvements of the algorithm framework, but also highlights several remaining challenges for the algorithm assessment, transferability and performance accuracy. Evaluation challenges include representation errors from comparing susceptibility maps of different spatial resolutions, biases in event-based landslide inventory data, and limited nonlandslide event data for more comprehensive evaluation. Additional factors that may improve algorithm performance accuracy include incorporating additional triggering factors such as tectonic activity, anthropogenic impacts and soil moisture into the algorithm calculation. Despite these limitations, the methodology presented in this regional evaluation is both straightforward to calculate and easy to interpret, making results transferable between regions and allowing findings to be placed within an inter-comparison framework. The regional algorithm scenario represents an important step in advancing regional and global-scale landslide hazard assessment and forecasting.

Kirschbaum, Dalia B.↗
NASA NTRS2012

Forecasting Evaluation of WindSat in the Coastal Environment

WindSat has demonstrated that measurements from polarimetric space-based microwave radiometers can be used to retrieve global ocean surface vector winds. Since the date of launch in 2003, substantial incremental improvements have been made to WindSat data processing, calibration, and retrieval algorithms. The retrievals now have higher resolution, improved wind vector ambiguity removal, and enhanced capability to represent high winds. Utilization of WindSat retrievals (wind vectors, total precipitable water, rainrate and sea surface temperature) will be demonstrated in the context of operational weather forecasting applications, especially the monitoring of topographically-forced winds. Examples will be presented from various parts of the world, including inland seas, midlatitude oceans, the tropics, and the United States. We will illustrate retrievals in extreme high- and extreme low-wind regimes, both of which can be problematic. Rain contamination will be addressed. We will include a comparison of WindSat vector maps to corresponding maps from the QuikScat scatterometer. We will discuss how near-realtime data from WindSat is being transitioned to specific offices within the National Weather Service.

Lee, Thomas F.↗
NASA NTRSDate not supplied

Atmospheric Composition Forecast Model Evaluation Using Ozone Measurements Collected by the Langley Mobile Ozone Lidar

The Langley Mobile Ozone Lidar (LMOL) is a mobile ground based lidar system based at NASA Langley in Hampton, Virginia. Between 2022 and 2024, LMOL collected over 2500 hours of ozone measurements for a range of different atmospheric conditions, including calm days, stratospheric intrusions, surface frontal passages, and long-range transported wildfire smoke plumes. Here, the data is used to evaluate the forecast accuracy of NASA’s Global GEOS Composition Forecasting (GEOS-CF) model. GEOS-CF makes daily three-dimensional forecasts of trace gases and aerosol species. Overall, for calm periods, the forecast model predicts lower tropospheric ozone at NASA Langley with reasonable accuracy (within 20%). The model best predicts the timing and extent of stratospheric intrusions but often vary in the magnitude of the ozone mixing ratio. Among the other types of atmospheric conditions, there is more variability in the model forecasts. Based on this analysis, model forecasts are utilized to determine future data acquisition opportunities with the goal of providing feedback to the modeling teams, thereby enabling them to better understand the model biases and improve the model forecasts of ozone during these different atmospheric conditions.

Daniel B Phoenix↗
NASA NTRS2019

Evaluating Flood Forecasting System Performance in Cambodia During the 2019 Flood Season

Every year, Cambodia experiences both flash and prolonged riverine flooding as a result of monsoon rains and typhoons. Floods occur frequently in various parts of the region, and result in significant economic cost. Flood forecasting systems are designed to mitigate economic and social impacts, enabling people to prepare for extreme events. However, in order for forecasts to be used effectively, an assessment of the available forecasting systems is needed. In addition, following the onset of flooding, satellite imagery is used to generate flood maps to aid in response efforts. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times through a series of forecast verification metrics at gauge locations in Cambodia. We then compare the flood forecast performance to Sentinel 1 flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to generated flood maps helps provide context to forecasters and disaster managers as they make improvements to their models. Additionally, these results provide support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire M.↗
NASA NTRS2020

Evaluating Flood Forecasting System Performance in Cambodia

Every year, Cambodia experiences flooding as a result of monsoon rains and typhoons. Flood forecasting systems are designed to enable people to mitigate economic and social impacts from these events. However, in order for forecasts to be used effectively, an assessment of their accuracy is needed. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times and gauge locations in Cambodia. We then compare the flood forecast performance to satellite-based flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to flood extents helps (1) provide valuable information to forecasters and disaster managers as they make improvements to their models, and (2) provides support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire↗
NASA NTRS1984

Research in satellite-aided crop forecasting

Evaluations of remote sensing procedures developed specifically to estimate non-U.S. spring small grains area show accuracies of less than 10 percent relative difference to reference statistics for North Dakota in 1978 and good comparison with 9000 square miles of observations over four states and Saskatchewan, Canada during the years 1976-79. Processing a 5 x 6-nautical-mile sample site requires a few minutes manual time and a few minutes central processing unit time on an AS-3000 computer. Evaluations of summer crop, corn, and soybeans area estimates show unbiased summer crops estimates in the U.S. central corn belt but significant bias in one of two years for area estimates of corn and soybeans. Based on results to date, a highly automated corn/sorghum/soybean area estimation procedure should be achieved that is applicable to Argentina.

Erickson, J. D.↗
NASA NTRS2008

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗
NASA NTRS2015

Interactive Vegetation Phenology, Soil Moisture, and Monthly Temperature Forecasts

The time scales that characterize the variations of vegetation phenology are generally much longer than those that characterize atmospheric processes. The explicit modeling of phenological processes in an atmospheric forecast system thus has the potential to provide skill to subseasonal or seasonal forecasts. We examine this possibility here using a forecast system fitted with a dynamic vegetation phenology model. We perform three experiments, each consisting of 128 independent warm-season monthly forecasts: 1) an experiment in which both soil moisture states and carbon states (e.g., those determining leaf area index) are initialized realistically, 2) an experiment in which the carbon states are prescribed to climatology throughout the forecasts, and 3) an experiment in which both the carbon and soil moisture states are prescribed to climatology throughout the forecasts. Evaluating the monthly forecasts of air temperature in each ensemble against observations, as well as quantifying the inherent predictability of temperature within each ensemble, shows that dynamic phenology can indeed contribute positively to subseasonal forecasts, though only to a small extent, with an impact dwarfed by that of soil moisture.

Seasonal Forecasting↗
NASA NTRS2014

Bias Correction for Assimilation of Retrieved AIRS Profiles of Temperature and Humidity

Atmospheric Infrared Sounder (AIRS) is a hyperspectral radiometer aboard NASA's Aqua satellite designed to measure atmospheric profiles of temperature and humidity. AIRS retrievals are assimilated into the Weather Research and Forecasting (WRF) model over the North Pacific for some cases involving "atmospheric rivers". These events bring a large flux of water vapor to the west coast of North America and often lead to extreme precipitation in the coastal mountain ranges. An advantage of assimilating retrievals rather than radiances is that information in partly cloudy fields of view can be used. Two different Level 2 AIRS retrieval products are compared: the Version 6 AIRS Science Team standard retrievals and a neural net retrieval from MIT. Before assimilation, a bias correction is applied to adjust each layer of retrieved temperature and humidity so the layer mean values agree with a short-term model climatology. WRF runs assimilating each of the products are compared against each other and against a control run with no assimilation. This paper will describe the bias correction technique and results from forecasts evaluated by validation against a Total Precipitable Water (TPW) product from CIRA and against Global Forecast System (GFS) analyses.

Blankenship, Clay↗
NASA NTRSDate not supplied

Exploring Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

Terrestrial biosphere is an integral part of the climate system and plays a vital role in controlling the dynamics of the Earth’s carbon cycle. In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and seasonal carbon cycle predictability. First, by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations, we investigated the impact of a regional drought on land and atmospheric carbon. Through the drought-induced impact on remote meteorology, the capability of the land’s carbon uptake is altered in both the drought area and the adjacent areas. The induced anomalies of the atmospheric CO2 extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of the drought impact on carbon anomalies. Increase in column‐averaged monthly CO2 is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake in the Northern Hemisphere mid and high latitude land at multi-month leads. The prediction skill appears to be achieved by accurate forecasts of snow removal timing, which provides a latent predictability to the forecast system, and by proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire carbon, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗
NASA NTRSDate not supplied

Investigation of Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and carbon cycle predictability. First, the impact of a regional drought on land and atmospheric carbon was studied by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations. Through drought-induced impact on remote meteorology, the drought alters land’s productivity not only in the drought area but also in the adjacent areas. The atmospheric CO2 anomalies extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of drought‐induced carbon anomalies. Increase in column‐averaged monthly CO2 by the imposed drought is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and a terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake at multi-month leads in the Northern Hemisphere mid- and high latitude land. The skill appears to be achieved by accurate forecasts of snow removal timing as well as proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research activities to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗
NASA NTRS2010

Impact of High Resolution SST Data on Regional Weather Forecasts

Past studies have shown that the use of coarse resolution SST products such as from the real-time global (RTG) SST analysis[1] or other coarse resolution once-a-day products do not properly portray the diurnal variability of fluxes of heat and moisture from the ocean that drive the formation of low level clouds and precipitation over the ocean. For example, the use of high resolution MODIS SST composite [2] to initialize the Advanced Research Weather Research and Forecast (WRF) (ARW) [3] has been shown to improve the prediction of sensible weather parameters in coastal regions [4][5}. In an extend study, [6] compared the MODIS SST composite product to the RTG SST analysis and evaluated forecast differences for a 6 month period from March through August 2007 over the Florida coastal regions. In a comparison to buoy data, they found that that the MODIS SST composites reduced the bias and standard deviation over that of the RTG data. These improvements led to significant changes in the initial and forecasted heat fluxes and the resulting surface temperature fields, wind patterns, and cloud distributions. They also showed that the MODIS composite SST product, produced for the Terra and Aqua satellite overpass times, captured a component of the diurnal cycle in SSTs not represented in the RTG or other one-a-day SST analyses. Failure to properly incorporate these effects in the WRF initialization cycle led to temperature biases in the resulting short term forecasts. The forecast impact was limited in some situations however, due to composite product inaccuracies brought about by data latency during periods of long-term cloud cover. This paper focuses on the forecast impact of an enhanced MODIS/AMSR-E composite SST product designed to reduce inaccuracies due data latency in the MODIS only composite product.

Jedlovec, Gary J.↗
NASA NTRS2017

Air Quality Forecasts Using the NASA GEOS Model: A Unified Tool from Local to Global Scales

We provide an introduction to a new high-resolution (0.25 degree) global composition forecast produced by NASA's Global Modeling and Assimilation office. The NASA Goddard Earth Observing System version 5 (GEOS-5) model has been expanded to provide global near-real-time forecasts of atmospheric composition at a horizontal resolution of 0.25 degrees (approximately 25 km). Previously, this combination of detailed chemistry and resolution was only provided by regional models. This system combines the operational GEOS-5 weather forecasting model with the state-of-the-science GEOS-Chem chemistry module (version 11) to provide detailed chemical analysis of a wide range of air pollutants such as ozone, carbon monoxide, nitrogen oxides, and fine particulate matter (PM2.5). The resolution of the forecasts is the highest resolution compared to current, publically-available global composition forecasts. Evaluation and validation of modeled trace gases and aerosols compared to surface and satellite observations will be presented for constituents relative to health air quality standards. Comparisons of modeled trace gases and aerosols against satellite observations show that the model produces realistic concentrations of atmospheric constituents in the free troposphere. Model comparisons against surface observations highlight the model's capability to capture the diurnal variability of air pollutants under a variety of meteorological conditions. The GEOS-5 composition forecasting system offers a new tool for scientists and the public health community, and is being developed jointly with several government and non-profit partners. Potential applications include air quality warnings, flight campaign planning and exposure studies using the archived analysis fields.

Knowland, E. Emma↗
NASA NTRS2018

Air Quality Forecasts Using the NASA GEOS Model

We provide an introduction to a new high-resolution (0.25 degree) global composition forecast produced by NASA's Global Modeling and Assimilation office. The NASA Goddard Earth Observing System version 5 (GEOS-5) model has been expanded to provide global near-real-time forecasts of atmospheric composition at a horizontal resolution of 0.25 degrees (~25 km). Previously, this combination of detailed chemistry and resolution was only provided by regional models. This system combines the operational GEOS-5 weather forecasting model with the state-of-the-science GEOS-Chem chemistry module (version 11) to provide detailed chemical analysis of a wide range of air pollutants such as ozone, carbon monoxide, nitrogen oxides, and fine particulate matter (PM2.5). The resolution of the forecasts is the highest resolution compared to current, publically-available global composition forecasts. Evaluation and validation of modeled trace gases and aerosols compared to surface and satellite observations will be presented for constituents relative to health air quality standards. Comparisons of modeled trace gases and aerosols against satellite observations show that the model produces realistic concentrations of atmospheric constituents in the free troposphere. Model comparisons against surface observations highlight the model's capability to capture the diurnal variability of air pollutants under a variety of meteorological conditions. The GEOS-5 composition forecasting system offers a new tool for scientists and the public health community, and is being developed jointly with several government and non-profit partners. Potential applications include air quality warnings, flight campaign planning and exposure studies using the archived analysis fields.

Keller, Christoph A.↗
NASA NTRS2013

Evaluating NMME Seasonal Forecast Skill for use in NASA SERVIR Hub Regions

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The coupled forecasts have numerous potential applications, both national and international in scope. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in driving applications models in hub regions including East Africa, the Hindu Kush- Himalayan (HKH) region and Mesoamerica. A prerequisite for seasonal forecast use in application modeling (e.g. hydrology, agriculture) is bias correction and skill assessment. Efforts to address systematic biases and multi-model combination in support of NASA SERVIR impact modeling requirements will be highlighted. Specifically, quantilequantile mapping for bias correction has been implemented for all archived NMME hindcasts. Both deterministic and probabilistic skill estimates for raw, bias-corrected, and multi-model ensemble forecasts as a function of forecast lead will be presented for temperature and precipitation. Complementing this statistical assessment will be case studies of significant events, for example, the ability of the NMME forecasts suite to anticipate the 2010/2011 drought in the Horn of Africa and its relationship to evolving SST patterns.

Roberts, J. Brent↗