Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Leveraging Observing System Simulation Experiments for Satellite Instrument Design: Advancements and Challenges

This abstract highlights NASA's OSSE framework, developed at the Global Modeling and Assimilation Office, which has become a widely adopted tool for evaluating the impact of new observations on weather forecasts. The framework involves simulating realistic observations by introducing errors to mimic real-world scenarios. By utilizing advanced radiative transfer modeling, the accuracy of simulated observations is significantly improved, enhancing the reliability of experimental outcomes. The talk focuses on recent progress and challenges in three key areas. Firstly, it explores the techniques used to simulate synthetic observations, a crucial aspect of OSSE experiments. Secondly, the presentation also discusses the challenges of examining the observation errors that need to be added to the perfect observations to generate realistic simulated observations. Lastly, the assimilation of synthetic observations and their impact on forecast skills is evaluated, providing valuable insights for optimizing current and future observing systems for improving the weather forecasts. By sharing recent advancements and acknowledging challenges, this presentation seeks to inspire researchers to leverage the OSSE framework in weather forecasting. NASA's OSSE techniques hold promise for a better understanding of the atmosphere and the development of more accurate and reliable weather predictions.

Isaac Moradi↗
NASA NTRS2007

Preliminary Evaluation of GEOS-5 Aerosol and CO Distributions Forecast During TC4

The NASA Tropical Composition, Cloud, and Climate Coupling (TC4) Mission was based out San Jose, Costa Rica during July and August 2007. During TC4 the NASA Global Modeling and Assimilation Office (GMAO) ran twice-daily 0.5 x 0.666 global 5-day forecasts of the Goddard Earth Observing System atmospheric general circulation model and data assimilation system (GEOS-5). This implementation of GEOS-5 contained an aerosol and carbon monoxide (CO) model to provide online forecast tropospheric distributions of dust, sea salt, sulfate, and carbonaceous aerosols and CO for both the planning of flights and for science. Here we provide a description of the aerosol and CO modeling system and give a preliminary evaluation of forecast tracer distributions. Our comparisons to satellite observations of aerosol and CO show qualitatively similar simulated distributions of tracers to those observed. During TC4 copious amounts of dust were observed in the Caribbean. The model generally reproduced the observations of the timing of dust events and the vertical structure in the lower atmosphere. However, the model simulations had too much aerosol at high altitudes relative to airborne Cloud Physics Lidar observations. The results were similar for biomass burning aerosol and CO tracers, where the model showed higher simulated concentrations of these tracers at aircraft flight altitude than observations.

Colarco, Peter R.↗
NASA NTRS2014

Demonstration of AIRS Total Ozone Products to Operations to Enhance User Readiness

Cyclogenesis is a key forecast challenge at operational forecasting centers such as WPC and OPC, so these centers have a particular interest in unique products that can identify key storm features. In some cases, explosively developing extratropical cyclones can produce hurricane force, non-convective winds along the East Coast and north Atlantic as well as the Pacific Ocean, with the potential to cause significant damage to life and property. Therefore, anticipating cyclogenesis for these types of storms is crucial for furthering the NOAA goal of a "Weather Ready Nation". Over the last few years, multispectral imagery (i.e. RGB) products have gained popularity among forecasters. The GOES-R satellite champion at WPC/OPC has regularly evaluated the Air Mass RGB products from GOES Sounder, MODIS, and SEVIRI to aid in forecasting cyclogenesis as part of ongoing collaborations with SPoRT within the framework of the GOES-R Proving Ground. WPC/OPC has used these products to identify regions of stratospheric air associated with tropopause folds that can lead to cyclogenesis and hurricane force winds. RGB products combine multiple channels or channel differences into multi-color imagery in which different colors represent a particular cloud or air mass type. Initial interaction and feedback from forecasters evaluating the legacy Air Mass RGBs revealed some uncertainty regarding what physical processes the qualitative RGB products represent and color interpretation. To enhance forecaster confidence and interpretation of the Air Mass RGB, NASA SPoRT has transitioned a total column ozone product from AIRS retrievals to the WPC/OPC. The use of legacy AIRS demonstrates future JPSS capabilities possible with CrIS or OMPS. Since stratospheric air can be identified by anomalous potential vorticity and warm, dry, ozone-rich air, hyperspectral infrared sounder ozone products can be used in conjunction with the Air Mass RGB for identifying the role of stratospheric air in explosive cyclogenesis and hurricane force wind events. Currently, forecasters at WPC/OPC are evaluating the Air Mass RGB imagery in conjunction with the AIRS total column ozone to aid forecasting cyclogenesis and high wind forecasts. One of the limitations of the total ozone product is that it is difficult for forecasters to determine whether elevated ozone concentrations are related to stratospheric air or climatologically high values of ozone in certain regions. To address this limitation, SPoRT created an AIRS ozone anomaly product which calculates the percent of normal ozone based on a global stratospheric ozone mean climatology. With the knowledge that ozone values 125 percent of normal and greater typically represent stratospheric air; the anomaly product can be used with the total column ozone product to confirm regions of stratospheric air on the Air Mass RGB. This presentation describes the generation of these products along with forecaster feedback concerning the use of the AIRS ozone products in conjunction with the Air Mass RGB product for the unique forecast challenges WPC/OPC face. Additionally examples of CrIS ozone and anomaly products will be shown to further demonstrate the utility and capability of JPSS in forecasting unique events.

Berndt, Emily↗
NASA NTRS2015

Development and Application of Hyperspectral Infrared Ozone Retrieval Products for Operational Meteorology

Cyclogenesis is a key forecast challenge at operational forecasting centers such as WPC and OPC, so these centers have a particular interest in unique products that can identify key storm features. In some cases, explosively developing extratropical cyclones can produce hurricane force, non-convective winds along the East Coast and north Atlantic as well as the Pacific Ocean, with the potential to cause significant damage to life and property. Therefore, anticipating cyclogenesis for these types of storms is crucial for furthering the NOAA goal of a "Weather Ready Nation". Over the last few years, multispectral imagery (i.e. RGB) products have gained popularity among forecasters. The GOES-R satellite champion at WPC/OPC has regularly evaluated the Air Mass RGB products from GOES Sounder, MODIS, and SEVIRI to aid in forecasting cyclogenesis as part of ongoing collaborations with SPoRT within the framework of the GOES-R Proving Ground. WPC/OPC has used these products to identify regions of stratospheric air associated with tropopause folds that can lead to cyclogenesis and hurricane force winds. RGB products combine multiple channels or channel differences into multi-color imagery in which different colors represent a particular cloud or air mass type. Initial interaction and feedback from forecasters evaluating the legacy Air Mass RGBs revealed some uncertainty regarding what physical processes the qualitative RGB products represent and color interpretation. To enhance forecaster confidence and interpretation of the Air Mass RGB, NASA SPoRT has transitioned a total column ozone product from AIRS retrievals to the WPC/OPC. The use of legacy AIRS demonstrates future JPSS capabilities possible with CrIS or OMPS. Since stratospheric air can be identified by anomalous potential vorticity and warm, dry, ozone-rich air, hyperspectral infrared sounder ozone products can be used in conjunction with the Air Mass RGB for identifying the role of stratospheric air in explosive cyclogenesis and hurricane force wind events. Currently, forecasters at WPC/OPC are evaluating the Air Mass RGB imagery in conjunction with the AIRS total column ozone to aid forecasting cyclogenesis and high wind forecasts. One of the limitations of the total ozone product is that it is difficult for forecasters to determine whether elevated ozone concentrations are related to stratospheric air or climatologically high values of ozone in certain regions. To address this limitation, SPoRT created an AIRS ozone anomaly product which calculates the percent of normal ozone based on a global stratospheric ozone mean climatology. With the knowledge that ozone values 125 percent of normal and greater typically represent stratospheric air; the anomaly product can be used with the total column ozone product to confirm regions of stratospheric air on the Air Mass RGB. This presentation describes the generation of these products along with forecaster feedback concerning the use of the AIRS ozone products in conjunction with the Air Mass RGB product for the unique forecast challenges WPC/OPC face. Additionally examples of CrIS ozone and anomaly products will be shown to further demonstrate the utility and capability of JPSS in forecasting unique events.

Berndt, Emily↗
NASA NTRS2018

Evaluation of Near-Surface Air Temperature from Reanalysis over the United States and Ukraine: Application to Winter Wheat Yield Forecasting

In this work we evaluate the near-surface air temperature datasets from the ERA-Interim, JRA55, MERRA2, NCEP1, and NCEP2 reanalysis projects. Reanalysis data were first compared to observations from weather stations located on wheat areas of the United States and Ukraine, and then evaluated in the context of a winter wheat yield forecast model. Results from the comparison with weather station data showed that all datasets performed well (r2>0.95) and that more modern reanalysis such as ERAI had lower errors (RMSD ~ 0.9) than the older, lower resolution datasets like NCEP1 (RMSD ~ 2.4). We also analyze the impact of using surface air temperature data from different reanalysis products on the estimations made by a winter wheat yield forecast model. The forecast model uses information of the accumulated Growing Degree Day (GDD) during the growing season to estimate the peak NDVI signal. When the temperature data from the different reanalysis projects were used in the yield model to compute the accumulated GDD and forecast the winter wheat yield, the results showed smaller variations between obtained values, with differences in yield forecast error of around 2% in the most extreme case. These results suggest that the impact of temperature discrepancies between datasets in the yield forecast model get diminished as the values are accumulated through the growing season.

GSOD↗
NASA NTRS2012

The SPoRT-WRF: Evaluating the Impact of NASA Datasets on Convective Forecasts

Short-term Prediction Research and Transition (SPoRT) seeks to improve short-term, regional weather forecasts using unique NASA products and capabilities SPoRT has developed a unique, real-time configuration of the NASA Unified Weather Research and Forecasting (WRF)WRF (ARW) that integrates all SPoRT modeling research data: (1) 2-km SPoRT Sea Surface Temperature (SST) Composite, (2) 3-km LIS with 1-km Greenness Vegetation Fraction (GVFs) (3) 45-km AIRS retrieved profiles. Transitioned this real-time forecast to NOAA's Hazardous Weather Testbed (HWT) as deterministic model at Experimental Forecast Program (EFP). Feedback from forecasters/participants and internal evaluation of SPoRT-WRF shows a cool, dry bias that appears to suppress convection likely related to methodology for assimilation of AIRS profiles Version 2 of the SPoRT-WRF will premier at the 2012 EFP and include NASA physics, cycling data assimilation methodology, better coverage of precipitation forcing, and new GVFs

Zavodsky, Bradley↗
NASA NTRSDate not supplied

Assimilation of TROPICS Radiance Data in Nasa Geos System and Impact Assessments Through Observing System Experiments

Since the first full-scale weather satellite Television Infrared Observation Satellite (TIROS)-1 was launched in 1960 to measure weather patterns from space, the number of satellites carrying various sensors to measure atmospheric properties has increased rapidly. Data from these meteorological satellites have been crucial to the advancement of the NWP forecasts. Especially, space-borne measurements of atmospheric temperature and moisture information provided by microwave sounders were reported to contribute most to positive impacts on global NWP forecasts. Developing and launching an operational weather satellite is a daunting and tremendously expensive mission that requires many years of planning, developments, and maintenance after the launch. Small satellites with low size, weight, and power requirements can reduce the cost associated with the construction and launch of large bus platforms and draw attention of several space agencies and weather technology companies that started investing their resources to develop small satellites and measure the potential benefits and weaknesses. The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Currently five TROPICS cubsats, including TROPICS-pathfinder, are in space and provide the temperature and humidity data from space to the meteorological community. This study seeks to assess the potential impact that the constellation of TROPICS satellites may bring to the global NWP analysis and forecasts by assimilating all-sky TROPICS data and implementing observing system experiments (OSE) using the NASA GEOS system. Various evaluations metrics including forecast skills, fit to other observations such as radiosondes and microwave and infrared sounder are used. Along with the NWP impact assessment, the quality of the TROPICS data is evaluated by looking at observation minus forecast statistics in comparisons with other conventional satellite temperature and humidity sounders.

Min-Jeong Kim↗
NASA NTRSDate not supplied

Assimilation of TROPICS Radiance Data in NASA GEOS System and Impact Assessments Through Observing System Experiments

Since the first full-scale weather satellite Television Infrared Observation Satellite (TIROS)-1 was launched in 1960 to measure weather patterns from space, the number of satellites carrying various sensors to measure atmospheric properties has increased rapidly. Data from these meteorological satellites have been crucial to the advancement of the NWP forecasts. Especially, space-borne measurements of atmospheric temperature and moisture information provided by microwave sounders were reported to contribute most to positive impacts on global NWP forecasts. Developing and launching an operational weather satellite is a daunting and tremendously expensive mission that requires many years of planning, developments, and maintenance after the launch. Small satellites with low size, weight, and power requirements can reduce the cost associated with the construction and launch of large bus platforms and draw attention of several space agencies and weather technology companies that started investing their resources to develop small satellites and measure the potential benefits and weaknesses. The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Currently five TROPICS cubsats, including TROPICS-pathfinder, are in space and provide the temperature and humidity data from space to the meteorological community. This study seeks to assess the potential impact that the constellation of TROPICS satellites may bring to the global NWP analysis and forecasts by assimilating all-sky TROPICS data and implementing observing system experiments (OSE) using the NASA GEOS system. Various evaluations metrics including forecast skills, fit to other observations such as radiosondes and microwave and infrared sounder are used. Along with the NWP impact assessment, the quality of the TROPICS data is evaluated by looking at observation minus forecast statistics in comparisons with other conventional satellite temperature and humidity sounders.

Min-Jeong Kim↗
NASA NTRS2017

Short-Term Forecasts Using NU-WRF for the Winter Olympics 2018

The NASA Unified-Weather Research and Forecasting model (NU-WRF) will be included for testing and evaluation in the forecast demonstration project (FDP) of the International Collaborative Experiment −PyeongChang 2018 Olympic and Paralympic (ICE-POP) Winter Games. An international array of radar and supporting ground based observations together with various forecast and now-cast models will be operational during ICE-POP. In conjunction with personnel from NASA's Goddard Space Flight Center, the NASA Short-term Prediction Research and Transition (SPoRT) Center is developing benchmark simulations for a real-time NU-WRF configuration to run during the FDP. ICE-POP observational datasets will be used to validate model simulations and investigate improved model physics and performance for prediction of snow events during the research phase (RDP) of the project The NU-WRF model simulations will also support NASA Global Precipitation Measurement (GPM) Mission ground-validation physical and direct validation activities in relation to verifying, testing and improving satellite-based snowfall retrieval algorithms over complex terrain.

forecasting↗
NASA NTRS1993

An evaluation of the real-time tropical cyclone forecast skill of the Navy Operational Global Atmospheric Prediction System in the western North Pacific

The paper evaluates the meteorological quality and operational utility of the Navy Operational Global Atmospheric Prediction System (NOGAPS) in forecasting tropical cyclones. It is shown that the model can provide useful predictions of motion and formation on a real-time basis in the western North Pacific. The meterological characteristics of the NOGAPS tropical cyclone predictions are evaluated by examining the formation of low-level cyclone systems in the tropics and vortex structure in the NOGAPS analysis and verifying 72-h forecasts. The adjusted NOGAPS track forecasts showed equitable skill to the baseline aid and the dynamical model. NOGAPS successfully predicted unusual equatorward turns for several straight-running cyclones.

Fiorino, Michael↗
NASA NTRS1983

An evaluation of soundings, analyses and model forecasts derived from TIROS-N and NOAA-6 satellite data

TIROS-N and NOAA-6 temperature soundings over North America during three days in January 1980, and synoptic analyses and numerical-model forecasts derived from them, are compared with conventional data and analyses from NMC's limited-area fine-mesh model (LFM). The collocated sounding comparison revealed significant errors, especially near the surface and the tropopause. Satellite-derived thermal gradients were found to be weak, and thickness-analysis difference fields to propagate eastward, suggesting that sounding errors are correlated with synoptic patterns. The same pattern of anomalies is seen in the model forecasts. More detailed determinations of the correlation detected here could be used to optimize the assimilation of satellite soundings to conventional data.

Koehler, T. L.↗
NASA NTRS1990

A preliminary evaluation of short-term thunderstorm forecasting using surface winds at Kennedy Space Center

In 1987 NASA expanded its surface wind network onto the mainland west of Kennedy Space Center, increasing the network area from nearly 800 sq km to over 1600 sq km. Here, the results of this expansion are reported using three years of wind and lightning information collected during June, July, August, and September of 1987, 1988, and 1989. The divergence-lightning relationships and the importance of wind direction are addressed, and the verification is summarized.

Watson, Andrew I.↗
NASA NTRS2007

Evaluation of Integrating the Invasive Species Forecasting System to Support National Park Service Decisions on Fire Management Activities and Invasive Plant Species Control

The USGS and NASA, in conjunction with Colorado State University, George Mason University and other partners, have developed the Invasive Species Forecasting System (ISFS), a flexible tool that capitalizes on NASA's remote sensing resource to produce dynamic habitat maps of invasive terrestrial plant species across the United States. In 2006 ISFS was adopted to generate predictive invasive habitat maps to benefit noxious plant and fire management teams in three major National Park systems: The Greater Yellowstone Area (Yellowstone / Grand Tetons National Parks), Sequoia and Kings Canyon National Park, and interior Alaskan (between Denali, Gates of The Arctic and Yukon-Charley). One of the objectives of this study is to explore how the ISFS enhances decision support apparatus in use by National Park management teams. The first step with each park system was to work closely with park managers to select top-priority invasive species. Specific species were chosen for each study area based on management priorities, availability of observational data, and their potential for invasion after fire disturbances. Once focal species were selected, sources of presence/absence data were collected from previous surveys for each species in and around the Parks. Using logistic regression to couple presence/absence points with environmental data layers, the first round of ISFS habitat suitability maps were generated for each National Park system and presented during park visits over the summer of 2006. This first engagement provided a demonstration of what the park service can expect from ISFS and initiated the ongoing dialog on how the parks can best utilized the system to enhance their decisions related to invasive species control. During the park visits it was discovered that separate "expert opinion" maps would provide a valuable baseline to compare against the ISFS model output. Opinion maps are a means of spatially representing qualitative knowledge into a quantitative two-dimensional map. Furthermore, our approach combines the qualitative expert opinion habitat maps -- with the quantitative ISFS habitat maps in a difference map that shows where the two maps agree and disagree. The objective of the difference map is to help focus future field sampling and improve model results. This paper presents a demonstration of the habitat, expert opinion, and difference map for Yellowstone National Park.

Ma, Peter↗
NASA NTRS2001

The Evaluation of the Regional Atmospheric Modeling System in the Eastern Range Dispersion Assessment System

The Applied Meteorology Unit (AMU) evaluated the Regional Atmospheric Modeling System (RAMS) contained within the Eastern Range Dispersion Assessment System (ERDAS). ERDAS provides emergency response guidance for Cape Canaveral Air Force Station and Kennedy Space Center operations in the event of an accidental hazardous material release or aborted vehicle launch. The RAMS prognostic data are available to ERDAS for display and are used to initialize the 45th Space Wing/Range Safety dispersion model. Thus, the accuracy of the dispersion predictions is dependent upon the accuracy of RAMS forecasts. The RAMS evaluation consisted of an objective and subjective component for the 1999 and 2000 Florida warm seasons, and the 1999-2000 cool season. In the objective evaluation, the AMU generated model error statistics at surface and upper-level observational sites, compared RAMS errors to a coarser RAMS grid configuration, and benchmarked RAMS against the nationally-used Eta model. In the subjective evaluation, the AMU compared forecast cold fronts, low-level temperature inversions, and precipitation to observations during the 1999-2000 cool season, verified the development of the RAMS forecast east coast sea breeze during both warm seasons, and examined the RAMS daily thunderstorm initiation and precipitation patterns during the 2000 warm season. This report summarizes the objective and subjective verification for all three seasons.

Case, Jonathan↗
NASA NTRS2008

Application of the NASA A-Train to Evaluate Clouds Simulated by the Weather Research and Forecast Model

The CloudSat Mission, part of the NASA A-Train, is providing the first global survey of cloud profiles and cloud physical properties, observing seasonal and geographical variations that are pertinent to evaluating the way clouds are parameterized in weather and climate forecast models. CloudSat measures the vertical structure of clouds and precipitation from space through the Cloud Profiling Radar (CPR), a 94 GHz nadir-looking radar measuring the power backscattered by clouds as a function of distance from the radar. One of the goals of the CloudSat mission is to evaluate the representation of clouds in forecast models, thereby contributing to improved predictions of weather, climate and the cloud-climate feedback problem. This paper highlights potential limitations in cloud microphysical schemes currently employed in the Weather Research and Forecast (WRF) modeling system. The horizontal and vertical structure of explicitly simulated cloud fields produced by the WRF model at 4-km resolution are being evaluated using CloudSat observations in concert with products derived from MODIS and AIRS. A radiative transfer model is used to produce simulated profiles of radar reflectivity given WRF input profiles of hydrometeor mixing ratios and ambient atmospheric conditions. The preliminary results presented in the paper will compare simulated and observed reflectivity fields corresponding to horizontal and vertical cloud structures associated with midlatitude cyclone events.

Molthan, Andrew L.↗
NASA NTRS2019

GMAO Seasonal Forecast Ensemble Exploration

GMAO Sub/Seasonal prediction system (S2S) has recently been upgraded. A complete set (1981-2016) of 9-months hindcasts for the previous and current versions (S2S-1.0 and S2S-2.1 respectively) allows for the evaluation of the forecast skill and a study of various characteristics of the ensemble forecasts in particular. We compared the intra-seasonal, interannual and intra-ensemble SST variability of the two systems against the observed. Focusing on the ENSO SST indices, we analyzed the consistency of the forecasts ensembles by studying rank histograms and comparing the ensemble spread with the standard error of the estimate.The S2S-2.1 ensemble appears to be more consistent with observations in Niño1+2 region compared to S2S-1.0, while in the central equatorial Pacific ocean this measure is comparably good for both systems. The S2S-1.0 system tends to be under dispersive, while the new system is under dispersive only at very short lead times, but tends to be over dispersive at long leads and for forecasts verifying in spring in Niño 3.4 region.Overall, the new system has greater skill in predicting ENSO. The evaluation techniques tested here will be applied for testing of the next generation sub/seasonal forecast system under development.

Borovikov, Anna↗