Evaluation of Global Forecast System Model Accuracy for NASA Spaceflight Operations
Explore the source record for details and available documents.
Frank Leahy↗
SEARCH · Search NASA
Results for “forecast accuracy”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The Accuracy of Precipitation Forecasts at Timescales of 1–15 Days in the Volta River Basin
Explore the source record for details and available documents.
Mekonnen Gebremichael↗
Evaluation of Mesoscale Model Phenomenological Verification Techniques
Forecasters at the Spaceflight Meteorology Group, 45th Weather Squadron, and National Weather Service in Melbourne, FL use mesoscale numerical weather prediction model output in creating their operational forecasts. These models aid in forecasting weather phenomena that could compromise the safety of launch, landing, and daily ground operations and must produce reasonable weather forecasts in order for their output to be useful in operations. Considering the importance of model forecasts to operations, their accuracy in forecasting critical weather phenomena must be verified to determine their usefulness. The currently-used traditional verification techniques involve an objective point-by-point comparison of model output and observations valid at the same time and location. The resulting statistics can unfairly penalize high-resolution models that make realistic forecasts of a certain phenomena, but are offset from the observations in small time and/or space increments. Manual subjective verification can provide a more valid representation of model performance, but is time-consuming and prone to personal biases. An objective technique that verifies specific meteorological phenomena, much in the way a human would in a subjective evaluation, would likely produce a more realistic assessment of model performance. Such techniques are being developed in the research community. The Applied Meteorology Unit (AMU) was tasked to conduct a literature search to identify phenomenological verification techniques being developed, determine if any are ready to use operationally, and outline the steps needed to implement any operationally-ready techniques into the Advanced Weather Information Processing System (AWIPS). The AMU conducted a search of all literature on the topic of phenomenological-based mesoscale model verification techniques and found 10 different techniques in various stages of development. Six of the techniques were developed to verify precipitation forecasts, one to verify sea breeze forecasts, and three were capable of verifying several phenomena. The AMU also determined the feasibility of transitioning each technique into operations and rated the operational capability of each technique on a subjective 1-10 scale: (1) 1 indicates that the technique is only in the initial stages of development, (2) 2-5 indicates that the technique is still undergoing modifications and is not ready for operations, (3) 6-8 indicates a higher probability of integrating the technique into AWIPS with code modifications, and (4) 9-10 indicates that the technique was created for AWIPS and is ready for implementation. Eight of the techniques were assigned a rating of 5 or below. The other two received ratings of 6 and 7, and none of the techniques a rating of 9-10. At the current time, there are no phenomenological model verification techniques ready for operational use. However, several of the techniques described in this report may become viable techniques in the future and should be monitored for updates in the literature. The desire to use a phenomenological verification technique is widespread in the modeling community, and it is likely that other techniques besides those described herein are being developed, but the work has not yet been published. Therefore, the AMIU recommends that the literature continue to be monitored for updates to the techniques described in this report and for new techniques being developed whose results have not yet been published. 111
Lambert, Winifred↗
The accuracy of present wave forecasting methods with reference to problems in beach erosion on the New Jersey and Long Island coasts
Explore the source record for details and available documents.
Pierson, W. J., Jr.↗
Objective tropical cyclone analysis and forecasting technique using conventional and Nimbus-5 electrically scanning microwave radiometer measurements
The ADAPT empirical analysis programs, based on finding an optimal representation of the data in the Karhunen-Loeve sense, were applied to 120 observations of twenty-nine 1973 and 1974 Pacific tropical cyclones. Each observation consists of NIMBUS-5 electrically scanning microwave radiometer (ESMR) radiation measurements at 267 grid points covering and surrounding the tropical cyclone plus nine other non-satellite derived descriptors. Analysis and forecast algorithms to estimate storm motion and intensity were developed for times ranging from the observation time up to 72 hours later. The 24 hr wind speed forecasts with an accuracy of 11.7 knots and position forecasts with accuracies 15% better than persistence were demonstrated using independent tests.
Hunter, H. E.↗
Accuracy of the Global Forecast System at Cape Canaveral Space Force Station
Explore the source record for details and available documents.
Frank Leahy↗
Aspects of clear air turbulence severity forecasting and detection
Factors influencing the accuracy of the forecasts of incidences of clear air turbulence (CAT) are discussed, along with techniques for improved verification. Descriptive ranking terms for the intensity of CAT events, ranging from light to extreme, are developed, and meteorological parameters used for predictions are reviewed, including jetstream core location, vertical and horizontal wind shears, stable layers, tropopause height, trough speed, 500-mb vorticity, surface fronts, pressure centers and cyclogenesis, and wind speeds near mountain ridges. Methods of remote detection of CAT, particularly by using radiometry sensitive to the IR water vapor band, are noted to have had some success in detecting actual CAT events and decreasing false alarms. Statistical aspects of CAT encounter severity are discussed, including the establishment of confidence intervals for thresholds of detection of CATs of varying intensities.
Ehernberger, L. J.↗
Flight Departure Delay and Rerouting Under Uncertainty in En Route Convective Weather
Delays caused by uncertainty in weather forecasts can be reduced by improving traffic flow management decisions. This paper presents a methodology for traffic flow management under uncertainty in convective weather forecasts. An algorithm for assigning departure delays and reroutes to aircraft is presented. Departure delay and route assignment are executed at multiple stages, during which, updated weather forecasts and flight schedules are used. At each stage, weather forecasts up to a certain look-ahead time are treated as deterministic and flight scheduling is done to mitigate the impact of weather on four-dimensional flight trajectories. Uncertainty in weather forecasts during departure scheduling results in tactical airborne holding of flights. The amount of airborne holding depends on the accuracy of forecasts as well as the look-ahead time included in the departure scheduling. The weather forecast look-ahead time is varied systematically within the experiments performed in this paper to analyze its effect on flight delays. Based on the results, longer look-ahead times cause higher departure delays and additional flying time due to reroutes. However, the amount of airborne holding necessary to prevent weather incursions reduces when the forecast look-ahead times are higher. For the chosen day of traffic and weather, setting the look-ahead time to 90 minutes yields the lowest total delay cost.
Mukherjee, Avijit↗
The MST radar technique: Requirements for operational weather forecasting
There is a feeling that the accuracy of mesoscale forecasts for spatial scales of less than 1000 km and time scales of less than 12 hours can be improved significantly if resources are applied to the problem in an intensive effort over the next decade. Since the most dangerous and damaging types of weather occur at these scales, there are major advantages to be gained if such a program is successful. The interest in improving short term forecasting is evident. The technology at the present time is sufficiently developed, both in terms of new observing systems and the computing power to handle the observations, to warrant an intensive effort to improve stormscale forecasting. An assessment of the extent to which the so-called MST radar technique fulfills the requirements for an operational mesoscale observing network is reviewed and the extent to which improvements in various types of forecasting could be expected if such a network is put into operation are delineated.
Larsen, M. F.↗
Time Relevance of Convective Weather Forecast for Air Traffic Automation
The Federal Aviation Administration (FAA) is handling nearly 120,000 flights a day through its Air Traffic Management (ATM) system and air traffic congestion is expected to increse substantially over the next 20 years. Weather-induced impacts to throughput and efficiency are the leading cause of flight delays accounting for 70% of all delays with convective weather accounting for 60% of all weather related delays. To support the Next Generation Air Traffic System goal of operating at 3X current capacity in the NAS, ATC decision support tools are being developed to create advisories to assist controllers in all weather constraints. Initial development of these decision support tools did not integrate information regarding weather constraints such as thunderstorms and relied on an additional system to provide that information. Future Decision Support Tools should move towards an integrated system where weather constraints are factored into the advisory of a Decision Support Tool (DST). Several groups such at NASA-Ames, Lincoln Laboratories, and MITRE are integrating convective weather data with DSTs. A survey of current convective weather forecast and observation data show they span a wide range of temporal and spatial resolutions. Short range convective observations can be obtained every 5 mins with longer range forecasts out to several days updated every 6 hrs. Today, the short range forecasts of less than 2 hours have a temporal resolution of 5 mins. Beyond 2 hours, forecasts have much lower temporal. resolution of typically 1 hour. Spatial resolutions vary from 1km for short range to 40km for longer range forecasts. Improving the accuracy of long range convective forecasts is a major challenge. A report published by the National Research Council states improvements for convective forecasts for the 2 to 6 hour time frame will only be achieved for a limited set of convective phenomena in the next 5 to 10 years. Improved longer range forecasts will be probabilistic as opposed to the deterministic shorter range forecasts. Despite the known low level of confidence with respect to long range convective forecasts, these data are still useful to a DST routing algorithm. It is better to develop an aircraft route using the best information available than no information. The temporally coarse long range forecast data needs to be interpolated to be useful to a DST. A DST uses aircraft trajectory predictions that need to be evaluated for impacts by convective storms. Each time-step of a trajectory prediction n&s to be checked against weather data. For the case of coarse temporal data, there needs to be a method fill in weather data where there is none. Simply using the coarse weather data without any interpolation can result in DST routes that are impacted by regions of strong convection. Increasing the temporal resolution of these data can be achieved but result in a large dataset that may prove to be an operational challenge in transmission and loading by a DST. Currently, it takes about 7mins retrieve a 7mb RUC2 forecast file from NOAA at NASA-Ames Research Center. A prototype NCWF6 1 hour forecast is about 3mb in size. A Six hour NCWFG forecast with a 1hr forecast time-step will be about l8mb (6 x 3mb). A 6 hour NCWF6 forecast with a l5min forecast time-step will be about 7mb (24 x 3mb). Based on the time it takes to retrieve a 7mb RUC2 forecast, it will take approximately 70mins to retrieve a 6 hour NCWF forecast with 15min time steps. Until those issues are addressed, there is a need to develop an algorithm that interpolates between these temporally coarse long range forecasts. This paper describes a method of how to use low temporal resolution probabilistic weather forecasts in a DST. The beginning of this paper is a description of some convective weather forecast and observation products followed by an example of how weather data are used by a DST. The subsequent sections will describe probabilistic forecasts followed by a descrtion of a method to use low temporal resolution probabilistic weather forecasts by providing a relevance value to these data outside of their valid times.
Chan, William N.↗
Forecasting the Solar Drivers of Solar Energetic Particle Events
Large flares and fast CMEs are the drivers of the most severe space weather including Solar Energetic Particle Events (SEP Events). Large flares and their co-produced CMEs are powered by the explosive release of free magnetic energy stored in non-potential magnetic fields of sunspot active regions. The free energy is stored in and released from the low-beta regime of the active region's magnetic field above the photosphere, in the chromosphere and low corona. From our work over the past decade and from similar work of several other groups, it is now well established that (1) a proxy of the free magnetic energy stored above the photosphere can be measured from photospheric magnetograms, maps of the measured field in the photosphere, and (2) an active region's rate of production of major CME/flare eruptions in the coming day or so is strongly correlated with its present measured value of the free-energy proxy. These results have led us to use the large database of SOHO/MDI full-disk magnetograms spanning Solar Cycle 23 to obtain empirical forecasting curves that from an active region's present measured value of the free-energy proxy give the active region's expected rates of production of major flares, CMEs, fast CMEs, and SEP Events in the coming day or so (Falconer et al 2011, Space Weather, 9, S04003). We will present these forecasting curves and demonstrate the accuracy of their forecasts. In addition, we will show that the forecasts for major flares and fast CMEs can be made significantly more accurate by taking into account not only the value of the free energy proxy but also the active region's recent productivity of major flares; specifically, whether the active region has produced a major flare (GOES class M or X) during the past 24 hours before the time of the measured magnetogram.
Falconer, David A.↗
Forecasting the Solar Drivers of Severe Space Weather from Active-Region Magnetograms
Large flares and fast CMEs are the drivers of the most severe space weather including Solar Energetic Particle Events (SEP Events). Large flares and their co-produced CMEs are powered by the explosive release of free magnetic energy stored in non-potential magnetic fields of sunspot active regions. The free energy is stored in and released from the low-beta regime of the active region s magnetic field above the photosphere, in the chromosphere and low corona. From our work over the past decade and from similar work of several other groups, it is now well established that (1) a proxy of the free magnetic energy stored above the photosphere can be measured from photospheric magnetograms, and (2) an active region s rate of production of major CME/flare eruptions in the coming day or so is strongly correlated with its present measured value of the free-energy proxy. These results have led us to use the large database of SOHO/MDI full-disk magnetograms spanning Solar Cycle 23 to obtain empirical forecasting curves that from an active region s present measured value of the free-energy proxy give the active region s expected rates of production of major flares, CMEs, fast CMEs, and SEP Events in the coming day or so (Falconer et al 2011, Space Weather, 9, S04003). We will present these forecasting curves and demonstrate the accuracy of their forecasts. In addition, we will show that the forecasts for major flares and fast CMEs can be made significantly more accurate by taking into account not only the value of the free energy proxy but also the active region s recent productivity of major flares; specifically, whether the active region has produced a major flare (GOES class M or X) during the past 24 hours before the time of the measured magnetogram. By empirically determining the conversion of the value of free-energy proxy measured from a GONG or HMI magnetogram to that which would be measured from an MDI magnetogram, we have made GONG and HMI magnetograms useable with our MDI-based forecasting curves to forecast event rates.
Falconer, David A.↗
Forecasting Space Weather from Magnetograms
Large flares and fast CMEs are the drivers of the most severe space weather including Solar Energetic Particle Events (SEP Events). Large flares and their co-produced CMEs are powered by the explosive release of free magnetic energy stored in non-potential magnetic fields of sunspot active regions. The free energy is stored in and released from the low-beta regime of the active region s magnetic field above the photosphere, in the chromosphere and low corona. From our work over the past decade and from similar work of several other groups, it is now well established that (1) a proxy of the free magnetic energy stored above the photosphere can be measured from photospheric magnetograms, maps of the measured field in the photosphere, and (2) an active region s rate of production of major CME/flare eruptions in the coming day or so is strongly correlated with its present measured value of the free-energy proxy. These results have led us to use the large database of SOHO/MDI full-disk magnetograms spanning Solar Cycle 23 to obtain empirical forecasting curves that from an active region s present measured value of the free-energy proxy give the active region s expected rates of production of major flares, CMEs, fast CMEs, and SEP Events in the coming day or so (Falconer et al 2011, Space Weather, 9, S04003). For each type of event, the expected rate is readily converted to the chance that the active region will produce such an event in any given forward time window of a day or so. If the chance is small enough (e.g. <5%), the forecast is All Clear for that type of event. We will present these forecasting curves and demonstrate the accuracy of their forecasts. In addition, we will show that the forecasts for major flares and fast CMEs can be made significantly more accurate by taking into account not only the value of the free energy proxy but also the active region s recent productivity of major flares; specifically, whether the active region has produced a major flare (GOES class M or X) during the past 24 hours before the time of the measured magnetogram.
Falconer, David A.↗
Forecasting the Solar Drivers of Severe Space Weather from Active-Region Magnetograms
Large flares and fast CMEs are the drivers of the most severe space weather including Solar Energetic Particle Events (SEP Events). Large flares and their co-produced CMEs are powered by the explosive release of free magnetic energy stored in non-potential magnetic fields of sunspot active regions. The free energy is stored in and released from the low-beta regime of the active region s magnetic field above the photosphere, in the chromosphere and low corona. From our work over the past decade and from similar work of several other groups, it is now well established that (1) a proxy of the free magnetic energy stored above the photosphere can be measured from photospheric magnetograms, and (2) an active region s rate of production of major CME/flare eruptions in the coming day or so is strongly correlated with its present measured value of the free-energy proxy. These results have led us to use the large database of SOHO/MDI full-disk magnetograms spanning Solar Cycle 23 to obtain empirical forecasting curves that from an active region s present measured value of the free-energy proxy give the active region s expected rates of production of major flares, CMEs, fast CMEs, and SEP Events in the coming day or so (Falconer et al 2011, Space Weather, 9, S04003). We will present these forecasting curves and demonstrate the accuracy of their forecasts. In addition, we will show that the forecasts for major flares and fast CMEs can be made significantly more accurate by taking into account not only the value of the free energy proxy but also the active region s recent productivity of major flares; specifically, whether the active region has produced a major flare (GOES class M or X) during the past 24 hours before the time of the measured magnetogram. By empirically determining the conversion of the value of free-energy proxy measured from a GONG or HMI magnetogram to that which would be measured from an MDI magnetogram, we have made GONG and HMI magnetograms useable with our MDI-based forecasting curves to forecast event rates.
Falconer, David A.↗
Evaluating Flood Forecasting System Performance in Cambodia
Every year, Cambodia experiences flooding as a result of monsoon rains and typhoons. Flood forecasting systems are designed to enable people to mitigate economic and social impacts from these events. However, in order for forecasts to be used effectively, an assessment of their accuracy is needed. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times and gauge locations in Cambodia. We then compare the flood forecast performance to satellite-based flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to flood extents helps (1) provide valuable information to forecasters and disaster managers as they make improvements to their models, and (2) provides support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.
Nauman, Claire↗
Improved Air Quality Forecasts using NASA’s Pandora and GEOS CF at International and Domestic Sites for SNWG Stakeholders
Air pollution prediction is complex due to the dynamic nature of atmospheric processes and the variability in data resolutions and availability. This project addresses these challenges by integrating and analyzing high-resolution ground-based measurements with global air quality models. Through this integration, we have gained a deeper understanding of how these processes interact under various conditions, which we then use to model and enhance the accuracy of forecasts.
Noussair Lazrak↗
On the remote sensing of directional wave spectra and surface winds
The potential benefits of remote SEASAT-A satellite sensing of wind directional wave spectra by active microwave systems are elaborated. It is shown that a combined effort which uses supplemental satellite information in numerical forecasting and hindcasting schemes upgrades the accuracy of existing forecasting methods of an order of magnitude.
Shemdin, O. H.↗
Simulation Experiments on the Relative Accuracy of Inferred Atmospheric States from Idealized Wind and Temperature Profiling Systems
The First GARP Global Experiment (FGGE) led to the planning, design and implementation of a global observing system. Technologies as coherent CO2 LIDAR systems and highly sensitive IR detectors offer the potential of more accurate global spaceborne observation systems. The advent of super computers allows general circulation modeling and more sophisticated data analysis schemes. The consideration of advanced spaceborne systems better suited to meet the new emerging requirements are suggested. The Global Weather Experiment provides us with a new baseline to assess data accuracy and forecasting capabilities which is used for study of the incremental performance.
Halem, M.↗