Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1976

Monthly mean forecast experiments with the GISS model

The GISS general circulation model was used to compute global monthly mean forecasts for January 1973, 1974, and 1975 from initial conditions on the first day of each month and constant sea surface temperatures. Forecasts were evaluated in terms of global and hemispheric energetics, zonally averaged meridional and vertical profiles, forecast error statistics, and monthly mean synoptic fields. Although it generated a realistic mean meridional structure, the model did not adequately reproduce the observed interannual variations in the large scale monthly mean energetics and zonally averaged circulation. The monthly mean sea level pressure field was not predicted satisfactorily, but annual changes in the Icelandic low were simulated. The impact of temporal sea surface temperature variations on the forecasts was investigated by comparing two parallel forecasts for January 1974, one using climatological ocean temperatures and the other observed daily ocean temperatures. The use of daily updated sea surface temperatures produced no discernible beneficial effect.

Spar, J.↗
NASA NTRS2022

Advances in the prediction of MJO-Teleconnections in the S2S forecast systems

This study evaluates the ability of state-of-the-art subseasonal to seasonal (S2S) forecasting systems to represent and predict the teleconnections of the Madden Julian Oscillations and their effects on weather in terms of midlatitude weather patterns and North Atlantic tropical cyclones. This evaluation of forecast systems applies novel diagnostics developed to track teleconnections along their preferred pathways in the troposphere and stratosphere, and to measure the global and regional responses induced by teleconnections across both the Northern and Southern Hemispheres. Results of this study will help the modeling community understand to what extent the potential to predict the weather on S2S time scales is achieved by the current generation of forecasting systems, while informing where to focus further development efforts. The findings of this study will also provide impact modelers and decision makers with a better understanding of the potential of S2S predictions related to MJO teleconnections.

Forecasting↗
NASA NTRS2014

Satellite Sounder Data Assimilation for Improving Alaska Region Weather Forecast

A case study and monthly statistical analysis using sounder data assimilation to improve the Alaska regional weather forecast model are presented. Weather forecast in Alaska faces challenges as well as opportunities. Alaska has a large land with multiple types of topography and coastal area. Weather forecast models must be finely tuned in order to accurately predict weather in Alaska. Being in the high-latitudes provides Alaska greater coverage of polar orbiting satellites for integration into forecasting models than the lower 48. Forecasting marine low stratus clouds is critical to the Alaska aviation and oil industry and is the current focus of the case study. NASA AIRS/CrIS sounder profiles data are used to do data assimilation for the Alaska regional weather forecast model to improve Arctic marine stratus clouds forecast. Choosing physical options for the WRF model is discussed. Preprocess of AIRS/CrIS sounder data for data assimilation is described. Local observation data, satellite data, and global data assimilation data are used to verify and/or evaluate the forecast results by the MET tools Model Evaluation Tools (MET).

Zhu, Jiang↗
NASA NTRS2023

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗
NASA NTRSDate not supplied

The Potential of GEO Sounders for Numerical Weather Prediction

The future of Earth observations from space is currently being decided upon in the United States. To better understand the impacts of various configurations, the Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework has been utilized to examine the impact of various hyperspectral infrared sounder constellations from the perspective of global numerical weather prediction (NWP). With an emphasis on the proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) Sounder (GXS), planned to launch in the mid-2030s, the NWP benefit of a global ring of geostationary sounders, consistent with the WMO’s 2040 vision is evaluated. In addition, considerations extend to the future of the Low Earth Orbit (LEO) sounder program with the loss of several existing instruments and plans for future missions ongoing. The GMAO OSSE framework has examined the potential complementarities of GEO and LEO sounders in weather prediction improvement. Overall, the inclusion of both GEO and LEO sounders produces the most beneficial impact on NWP for regional and global scales and the most accurate global weather forecasts as evaluated using several metrics, including hurricanes and the forecast sensitivity observation impact (FSOI).

Erica Mcgrath-Spangler↗
NASA NTRS1985

CSIS test and evaluation

This report covers the period from February 1982 when the Centralized Storm Information System CSIS was installed at NSSFC through June 1983. CSIS has had a dramatic and positive impact on the operations of the NSSFC. The value of CSIS in improving the level of severe storms forecasting is evaluated. The following CSIS components are examined: (1) hardware; (2) data acquisition; (3) data storage and retrieval; (4) forecaster-machine interface; (5) user training and requirement; (6) system relibility; and (7) software documentation.

Siebers, A. L.↗
NASA NTRS2005

Assimilation of ozone profiles from the Improved Limb Atmospheric Spectrometer: Study on Antarctic Ozone - 2

Ozone data from the Improved Limb Atmospheric Spectrometer-II (ILAS-II) were included in addition to other satellite observations in the ozone assimilation system at the Global Modeling and Assimilation Office (GMAO) of NASA/Goddard. The control run assimilated data from NOAA 16 Solar Backscatter Ultraviolet/2 (SBUV/2) and Polar Ozone and Aerosol Measurement III (POAM III) instruments. Persistent impacts over Antarctica and transient impacts over northern middle and high latitudes are seen from April to October 2003, when ILAS-II provided good coverage. The largest improvements with respect to independent ozone sonde data are seen over the South Pole station. Ozone analyses and forecasts from the assimilation of SBUV/2, POAM III and ILAS-II data b e used to investigate the transport of ozone to southern middle latitudes following the breakup of the Antarctic vortex. The quality of analyses and forecasts is evaluated by comparison with independent Stratospheric Aerosol and Gas Experiment III (SAGE III) ozone data near 46degs. Anomaly correlations between SAGE III data and forecasts'exceed 0.6 for up to five to seven days at 30,50, and 70 ma. The loss of skill with advancing forecast length is related to dynamical errors due to an excessively persistent vortex in longer forecasts, which hampers the transport of low ozone air into middle latitudes.

Stajner, Ivanka↗
NASA NTRSDate not supplied

Development and Application of NASA SPoRT’s DustTracker-AI Model for Real-Time Identification and Tracking of Dust in Geostationary Satellite Imagery

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed the DustTracker-AI model for identifying and tracking dust in NASA/NOAA Geostationary Operational Environmental Satellite (GOES) imagery in a real-time framework. A training dataset consisting of day and night dust cases was gathered over the southwestern consisting of 115 distinct images and over a million dust pixels and 256 million no dust pixels. The dataset was separated into training (60%), testing (20%), and validation (20%). A simple random forest machine learning model was developed originally to overcome the problem of night-time dust detection and has been expanded to a comprehensive day/night model for dust identification and tracking. This physically-based machine-learning approach uses NASA/NOAA GOES-16 Advanced Baseline Imager infrared imagery as inputs to the model. The model probability of dust output achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels for all dust images in the validation data set. In conjunction with developing the machine-learning model, the NASA Short-term Prediction Research and Transition Center (SPoRT) partnered with NOAA National Weather Service forecast offices to evaluate the model for utility in weather forecasting operations during the 2021 and 2023 late winter-spring seasons. Preliminary evaluation has indicated the majority of forecasters described the DustTracker-AI probabilities as having added confidence to interpreting the Dust RGB and other satellite products to objectively assess the dust extent and trends and increased the amount of time the dust plume could be tracked into the night as compared to use of the Dust RGB. More recently, SPoRT tested small scale events associated with thunderstorm outflow and burn scars to determine the model’s ability to capture local events. This presentation highlights design of the model, validation/evaluation of model performance, and example cases collected during end user product assessments.

Connor H Welch↗
NASA NTRSDate not supplied

Evaluation of Aerosol Data Assimilation and Forecasts in the NASA GEOS Model during the ASIA-AQ Campaign

Fine particulate matter (PM2.5) poses significant risks to human health and the environment by penetrating the lungs and causing respiratory and cardiovascular diseases, making it crucial to understand its sources and behavior for effective air quality management. The Goddard Earth Observing System (GEOS) Forward Processing (FP) system model, operated by the Global Modeling and Assimilation Office (GMAO) at NASA's Goddard Space Flight Center, provides real-time weather and aerosol analyses and forecasts. In addition to meteorological data assimilation, the GEOS-FP system also assimilates aerosol using Moderate Resolution Imaging Spectroradiometer (MODIS) Aerosol Optical Depth (AOD) and Aerosol Robotic Network (AERONET) AOD data. In this study, the aerosol data assimilation and forecasts performance of the GEOS-FP model were evaluated for predicting PM2.5 in Korea using observations from the Airborne and Satellite Investigation of Asian Air Quality (ASIA-AQ) campaign. The ASIA-AQ campaign, an international collaborative field study initiative, aims to enhance understanding of local air quality issues and address common challenges in interpreting satellite data and air quality modeling. Conducted in South Korea from February 15 to March 13, 2024, during the high PM2.5 concentration winter season, this campaign provided extensive airborne and ground observations for intensive analysis of PM2.5 model simulations. We demonstrate how the assimilation runs and the forecasting performance of PM2.5 at 24-hour and 48-hour intervals vary. Additionally, we analyzed the differences and characteristics of PM2.5 composition in cases of long-range transport and local emissions. Using ASIA-AQ airborne data, we also examined the vertical profile of fine particulate matter. Through the intensive observations of this campaign, the GEOS model was assessed over South Korea using both in situ and airborne measurements to establish a baseline and identify priorities for future development.

Seunghee Lee↗
NASA NTRS2013

Evaluating Downscaling Methods for Seasonal Climate Forecasts over East Africa

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in impact modeling within hub regions including East Africa, the Hindu Kush-Himalayan (HKH) region and Mesoamerica. One of the participating models in NMME is the NASA Goddard Earth Observing System (GEOS5). This work will present an intercomparison of downscaling methods using the GEOS5 seasonal forecasts of temperature and precipitation over East Africa. The current seasonal forecasting system provides monthly averaged forecast anomalies. These anomalies must be spatially downscaled and temporally disaggregated for use in application modeling (e.g. hydrology, agriculture). There are several available downscaling methodologies that can be implemented to accomplish this goal. Selected methods include both a non-homogenous hidden Markov model and an analogue based approach. A particular emphasis will be placed on quantifying the ability of different methods to capture the intermittency of precipitation within both the short and long rain seasons. Further, the ability to capture spatial covariances will be assessed. Both probabilistic and deterministic skill measures will be evaluated over the hindcast period.

Robertson, Franklin R.↗
NASA NTRS2013

Evaluating Downscaling Methods for Seasonal Climate Forecasts over East Africa

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in impact modeling within hub regions including East Africa, the Hindu Kush-Himalayan (HKH) region and Mesoamerica. One of the participating models in NMME is the NASA Goddard Earth Observing System (GEOS5). This work will present an intercomparison of downscaling methods using the GEOS5 seasonal forecasts of temperature and precipitation over East Africa. The current seasonal forecasting system provides monthly averaged forecast anomalies. These anomalies must be spatially downscaled and temporally disaggregated for use in application modeling (e.g. hydrology, agriculture). There are several available downscaling methodologies that can be implemented to accomplish this goal. Selected methods include both a non-homogenous hidden Markov model and an analogue based approach. A particular emphasis will be placed on quantifying the ability of different methods to capture the intermittency of precipitation within both the short and long rain seasons. Further, the ability to capture spatial covariances will be assessed. Both probabilistic and deterministic skill measures will be evaluated over the hindcast period

Roberts, J. Brent↗
NASA NTRS1981

Remote sensing techniques for conservation and management of natural vegetation ecosystems

The importance of using remote sensing techniques, in the visible and near-infrared ranges, for mapping, inventory, conservation and management of natural ecosystems is discussed. Some examples realized in Brazil or other countries are given to evaluate the products from orbital platform (MSS and RBV imagery of LANDSAT) and aerial level (photography) for ecosystems study. The maximum quantitative and qualitative information which can be obtained from each sensor, at different level, are discussed. Based on the developed experiments it is concluded that the remote sensing technique is a useful tool in mapping vegetation units, estimating biomass, forecasting and evaluation of fire damage, disease detection, deforestation mapping and change detection in land-use. In addition, remote sensing techniques can be used in controling implantation and planning natural/artificial regeneration.

Parada, N. D. J.↗
NASA NTRS1983

Lessons learned from the CSIS

A discussion is presented of the Centralized Storm Information System (CSIS), a joint effort by several organizations including NASA and the National Weather Service, which has been developed to aid the forecaster in evaluating weather data. The CSIS was developed to provide a handling, analyzing, intercomparison, and display system for real-time data from all available sources. The CSIS hardware and software, the impact of the CSIS, and the initial experience gained following the implementation of the CSIS are examined. Several general insights learned from this interactive processing system are examined in detail, including the benefits of an evolutionary bottom up rather than top down design approach, the crucial nature of scheduler function to any real time system, the recognition that meteorological interactive terminals requirements are different from image processing terminals requirements, and the knowledge that forecasters generate a large peak load on computer resources.

Mosher, F. R.↗
NASA NTRS2014

Applied Meteorology Unit (AMU) Quarterly Report First Quarter FY-14

NASA's LSP and other programs at Vandenberg Air Force Base (VAFB) use wind forecasts issued by the 30th Operational Support Squadron (30 OSS) to determine if they need to limit activities or protect property such as a launch vehicle due to the occurrence of warning level winds at VAFB in California. The 30 OSS tasked the AMU to provide a wind forecasting capability to improve wind warning forecasts and enhance the safety of their customers' operations. This would allow 30 OSS forecasters to evaluate pressure gradient thresholds between pairs of regional observing stations to help determine the onset and duration of warning category winds. Development of such a tool will require that solid relationships exist between wind speed and the pressure gradient of one or more station pairs. As part of this task, the AMU will also create a statistical climatology of meteorological observations from the VAFB wind towers.

Forecasting↗
NASA NTRSDate not supplied

Estimates of Future Numerical Weather Prediction Impacts from Hyperspectral Sounders

The United States’ satellite programs are currently in the process of evaluating the future of satellite observations of the Earth’s atmosphere, both as an individual nation and within the context of international partnerships. In an effort to better understand the impacts of various alternatives, the Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework has been utilized to evaluate several configurations of the international hyperspectral infrared sounder constellation from the perspective of global numerical weather prediction (NWP). This was done with an emphasis on the proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) Sounder (GXS), planned to launch in the mid-2030s, and similar planned missions from international partners. GXS, in addition to contributions from EUMETSAT and JMA, will form a global ring of geostationary sounders consistent with the WMO’s 2040 vision. In addition to a novel geostationary IR sounder program, considerations extend to the future of the Low Earth Orbit (LEO) sounder program with the upcoming demise of several existing instruments and plans for future missions ongoing. The GMAO OSSE framework has examined the potential roles of GEO and LEO sounders in weather prediction improvement. Overall, the inclusion of both GEO sounders in a global ring and LEO sounders produces the most beneficial observation impact and the most accurate global weather forecasts as evaluated using several metrics, including hurricanes and the FSOI.

Erica Mcgrath-Spangler↗
NASA NTRS1999

Data Assimilation Into a Coupled Ocean Atmosphere Model: Application to the 1997-1998 El Nino

As part of JPL's ocean data assimilation effort to study ocean circulation and seasonal-interannual climate variability, sea level anomaly observed by TOPEX altimeter, together with sea surface temperature and wind stress data, are assimilated into a simple coupled ocean atmosphere model of the tropical Pacific. Model-data consistency is examined. Impact of the assimilation (as initialization) on El Nino Southern Oscillation (ENSO) forecasts is evaluated. The coupled model consists of a shallow water component with two baroclinic modes, an Ekman shear layer, a simplified mixed-layer temperature equation, and a statistical atmosphere based on dominant correlations between historical surface temperature and wind stress anomaly data. The adjoins method is used to fit the coupled model to the data over various six-month periods from late 1996 to early 1998 by optimally adjusting the initial state, model parameters, and basis functions of the statistical atmosphere. On average, the coupled model can be fitted to the data to approximately within the data and representation errors (5 cm, 0.5 C, and 10 sq m/sq m for sea level, surface temperature, and pseudo wind stress anomalies, respectively). The estimated fields resemble observed spatio-temporal structure reasonably well. Hindcasts/forecasts of the 1997/1998 El Nino initialized from forced estimated ocean states and parameters are much more realistic than those simply initialized from ocean states (see figure below). In particular, the ability of the model to produce significant warming beyond the initial state is dramatically improved. Parameter estimation, which compensates for some model errors, is found to be important to obtaining better fits of the model to data and to improving forecasts.

Lee, Tong↗