Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The measurement of winds over the ocean from Skylab with application to measuring and forecasting typhoons and hurricanes

On Skylab, a combination microwave radar-radiometer (S193) made measurements in a tropical hurricane (AVA), a tropical storm, and various extratropical wind systems. The winds at each cell scanned by the instrument were determined by objective numerical analysis techniques. The measured radar backscatter is compared to the analyzed winds and shown to provide an accurate method for measuring winds from space. An operational version of the instrument on an orbiting satellite will be able to provide the kind of measurements in tropical cyclones available today only by expensive and dangerous aircraft reconnaissance. Additionally, the specifications of the wind field in the tropical boundary layer should contribute to improved accuracy of tropical cyclone forecasts made with numerical weather predictions models currently being applied to the tropical atmosphere.

Cardone, V. J.↗

Verify MesoNAM Performance

The AMU conducted an objective analysis of the MesoNAM forecasts compared to observed values from sensors at specified KSC/CCAFS wind towers by calculating the following statistics to verify the performance of the model: 1) Bias (mean difference), 2) Standard deviation of Bias, 3) Root Mean Square Error (RMSE), and 4) Hypothesis test for Bias = O. The 45 WS LWOs use the MesoNAM to support launch weather operations. However, the actual performance of the model at KSC and CCAFS had not been measured objectively. The analysis compared the MesoNAM forecast winds, temperature and dew point to the observed values from the sensors on wind towers. The data were stratified by tower sensor, month and onshore/offshore wind direction based on the orientation of the coastline to each tower's location. The model's performance statistics were then calculated for each wind tower based on sensor height and model initialization time. The period of record for the data used in this task was based on the operational start of the current MesoNAM in mid-August 2006 and so the task began with the first full month of data, September 2006, through May 2010. The analysis of model performance indicated: a) The accuracy decreased as the forecast valid time from the model initialization increased, b) There was a diurnal signal in T with a cool bias during the late night and a warm bias during the afternoon, c) There was a diurnal signal in Td with a low bias during the afternoon and a high bias during the late night, and d) The model parameters at each vertical level most closely matched the observed parameters at heights closest to those vertical levels. The AMU developed a GUI that consists of a multi-level drop-down menu written in JavaScript embedded within the HTML code. This tool allows the LWO to easily and efficiently navigate among the charts and spreadsheet files containing the model performance statistics. The objective statistics give the LWOs knowledge of the model's strengths and weaknesses and the GUI allows quick access to the data which will result in improved forecasts for operations.

Bauman, William H., III↗

The Impact on EOP Predictions of AAM Forecasts from the ECMWF and NCEP

Predictions of UT1 are improved when dynamical model-based forecasts of the axial component of atmospheric angular momentum (AAM) are used as proxy length-of-day (LOD) forecasts (Freedman et al. 1994; Johnson et al. 2005). For example, the accuracy of JPL's predictions of UT1 are improved by nearly a factor of 2 when AAM forecast data from the National Centers for Environmental Prediction (NCEP) are used. Given the importance of AAM forecasts on the accuracy of UT1 predictions, other sources of AAM forecasts should be sought. Here, the angular momentum of the forecasted wind fields from the European Centre for Medium-Range Weather Forecasts (ECMWF) are computed and used to predict UT1. The results are compared to those obtained using NCEP forecasts.

atmospheric angular momentum (AAM)↗

Performance of a Local Mesoscale Model with Data Denial

Forecasters at the 45th Weather Squadron (45 WS) use observations from the Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) wind tower network and daily rawinsonde observations (RAOB) to issue and verify wind advisories, watches, and warnings for operations. They are also used by the Spaceflight Meteorology Group and Melbourne, Florida National Weather Service to initialize locally run mesoscale models. Due to impending budget cuts, some or all of the mainland wind towers and RAOBs may be eliminated, The loss of these data may significantly impact the forecast capability of the 45 WS and SMG. The Applied Meteorology Unit (AMU) was tasked to conduct an objective independent modeling study to determine how important these observations are to the accuracy of the model output used by the forecasters as input to their forecasts. To accomplish this, the AMU performed a sensitivity study using the Weather Research and Forecasting (WRF) model run with and without KSC/CCAFS wind tower and CCAFS RAOB observations and assessed the accuracy of model forecasts by comparing them to the observations.

Watson, Leela↗

Summary Report of the Severe Storms Committee

Smaller scale severe storms with the expectation that the larger storms associated weather-hazard-to-aircraft problems are discussed. Improvements in the detection capability for hail, turbulence, wind shear, and lightning are reported. Improvements in communications with limited surveillance capabilities are summarized. Education and training of pilots in severe storms are examined. Weather forecasts improvements by increasing accuracy in the short term are described. Aircraft operations, aircraft design, weather services, data acquisition and utilization are reviewed.

Lee, J. T.↗

Integration of Wind Turbine Generation (WTG) into utility generating systems

In order to obtain information required for the economical integration of wind turbine generation into utility systems, performance simulations of the MOD-2 turbine were conducted. The sensitivity of the utility-cost-of-generation to wind turbine performance models and the accuracy of wind velocity forecasts was analyzed. Four different simulation methods were used and the characteristics of each are discussed.

Mccabe, T. F.↗

Operational improvements of long-term predicted ephemerides of the Tracking and Data Relay Satellites (TDRSs)

Tracking and Data Relay Satellite (TDRS) orbit determination and prediction are supported by the Flight Dynamics Facility (FDF) of the Goddard Space Flight Center (GSFC) Flight Dynamics Division (FDD). TDRS System (TDRSS)-user satellites require predicted TDRS ephemerides that are up to 10 weeks in length. Previously, long-term ephemerides generated by the FDF included predictions from the White Sands Complex (WSC), which plans and executes TDRS maneuvers. TDRSs typically have monthly stationkeeping maneuvers, and predicted postmaneuver state vectors are received from WSC up to a month in advance. This paper presents the results of an analysis performed in the FDF to investigate more accurate and economical long-term ephemerides for the TDRSs. As a result of this analysis, two new methods for generating long-term TDRS ephemeris predictions have been implemented by the FDF. The Center-of-Box (COB) method models a TDRS as fixed at the center of its stationkeeping box. Using this method, long-term ephemeris updates are made semiannually instead of weekly. The impulse method is used to model more maneuvers. The impulse method yields better short-term accuracy than the COB method, especially for larger stationkeeping boxes. The accuracy of the impulse method depends primarily on the accuracy of maneuver date forecasting.

Kostoff, J. L.↗

Bias-Correcting Carbon Fluxes Derived From Land-Surface Satellite Data for Retrospective and Near Real-Time Assimilation Systems

The ability to monitor and understand natural and anthropogenic variability in atmospheric carbon dioxide(CO2) is a growing need of many stakeholders across the world. Systems that assimilate satellite observations, given their short latency and dense spatial coverage, into high resolution global models are valuable, if not essential, tools for addressing this need. A notable drawback of modern assimilation systems is the long latency of many vital in-put datasets, e.g., inventories, in situ measurements, and re-processed remote-sensing data can trail the current date by months to years. This paper describes techniques for bias-correcting surface fluxes derived from satellite observations of the Earth’s surface to be consistent with constraints from inventories and in situ CO2 datasets. The techniques are applicable in both short-term forecasts and retrospective simulations, thus taking advantage of the coverage and short latency of satellite data while reproducing the major features of long-term inventory and in situ records. Our approach begins with a standard collection of diagnostic fluxes which incorporate a variety of remote-sensing driver data, viz. vegetation indices, fire radiative power, and nighttime lights. We then apply an empirical sink so that global budgets of the diagnostic fluxes match given atmospheric and oceanic growth rates for each year. This step removes coherent, systematic flux errors that produce biases inCO2which mask the signals an assimilation system hopes to capture. Depending on the simulation mode, the empirical sink uses different choices of atmospheric growth rates: estimates based on observations in retrospective mode and projections based on seasonal fore-casts of sea surface temperature in forecasting mode. The retrospective fluxes, when used in simulations with NASA’s Goddard Earth Observing System (GEOS), reproduce marine boundary layer measurements with comparable skill to those using fluxes from a modern inversion system. The forecasted fluxes show promising accuracy in their application to the analysis of changes in the carbon cycle as they occur.

CO2↗

Identification of Flux Rope Orientation via Neural Networks

Geomagnetic disturbance forecasting is based on the identification of solar wind structures and accurate determination of their magnetic field orientation. For nowcasting activities, this is currently a tedious and manual process. Focusing on the main driver of geomagnetic disturbances, the twisted internal magnetic field of interplanetary coronal mass ejections (ICMEs), we explore a convolutional neural network’s (CNN) ability to predict the embedded magnetic flux rope’s orientation once it has been identified from in situ solar wind observations. Our work uses CNNs trained with magnetic field vectors from analytical flux rope data. The simulated flux ropes span many possible spacecraft trajectories and flux rope orientations. We train CNNs first with full duration flux ropes and then again with partial duration flux ropes. The former provides us with a baseline of how well CNNs can predict flux rope orientation while the latter provides insights into real-time forecasting by exploring how accuracy is affected by percentage of flux rope observed. The process of casting the physics problem as a machine learning problem is discussed as well as the impacts of different factors on prediction accuracy such as flux rope fluctuations and different neural network topologies. Finally, results from evaluating the trained network against observed ICMEs from Wind during 1995–2015 are presented.

Thomas Narock↗

Improving Air Quality Forecasts with AURA Observations

Past studies have identified model initial and boundary conditions as sources of reducible errors in air-quality simulations. In particular, improving the initial condition improves the accuracy of short-term forecasts as it allows for the impact of local emissions to be realized by the model and improving boundary conditions improves long range transport through the model domain, especially in recirculating anticyclones. During the August 2006 period, we use AURA/OMI ozone measurements along with MODIS and CALIPSO aerosol observations to improve the initial and boundary conditions of ozone and Particulate Matter. Assessment of the model by comparison of the control run and satellite assimilation run to the IONS06 network of ozonesonde observations, which comprise the densest ozone sounding campaign ever conducted in North America, to AURA/TES ozone profile measurements, and to the EPA ground network of ozone and PM measurements will show significant improvement in the CMAQ calculations that use AURA initial and boundary conditions. Further analyses of lightning occurrences from ground and satellite observations and AURA/OMI NO2 column abundances will identify the lightning NOx signal evident in OMI measurements and suggest pathways for incorporating the lightning and NO2 data into the CMAQ simulations.

Newchurch, M. J.↗

Near-Real Time Satellite-Retrieved Cloud and Surface Properties for Weather and Aviation Safety Applications

Cloud properties determined from satellite imager radiances provide a valuable source of information for nowcasting and weather forecasting. In recent years, it has been shown that assimilation of cloud top temperature, optical depth, and total water path can increase the accuracies of weather analyses and forecasts. Aircraft icing conditions can be accurately diagnosed in near-­‐real time (NRT) retrievals of cloud effective particle size, phase, and water path, providing valuable data for pilots. NRT retrievals of surface skin temperature can also be assimilated in numerical weather prediction models to provide more accurate representations of solar heating and longwave cooling at the surface, where convective initiation. These and other applications are being exploited more frequently as the value of NRT cloud data become recognized. At NASA Langley, cloud properties and surface skin temperature are being retrieved in near-­‐real time globally from both geostationary (GEO) and low-­‐earth orbiting (LEO) satellite imagers for weather model assimilation and nowcasting for hazards such as aircraft icing. Cloud data from GEO satellites over North America are disseminated through NCEP, while those data and global LEO and GEO retrievals are disseminated from a Langley website. This paper presents an overview of the various available datasets, provides examples of their application, and discusses the use of the various datasets downstream. Future challenges and areas of improvement are also presented.

Minnis, Patrick↗

Assessment of the 60 Km Rapid Update Cycle (RUC) with Near Real-Time Aircraft Reports

NASA is developing the Center-TBACON Advisory System (CTAS), a set of Air Traffic Management (ATM) Decision Support Tools (DST) to enable controllers to increase airspace capacity and flight efficiency. A crucial component of the CTAS, or any ATM DST, is the computation of the time-of-flight of aircraft along flight path segments which requires accurate knowledge of the wind through which the aircraft are flying. CTAS currently uses wind information from the Rapid Update Cycle (RUC), a numerical prediction model run operationally by the National Weather Service (NWS) National Center for Environmental Prediction (NCEP). There exists near real-time wind observations from commercial aircraft that can be used to increase the accuracy of the RUC wind forecasts via the FAA Integrated Terminal Weather System (ITWS) Terminal Winds (TW) algorithm. This report presents a study based on the application of the ITWS TW algorithm as an improvement to the baseline RUC product. Terminal Winds generally does not support the full Center airspace; the domain of the prototype MIT/LLITWS TW system was increased to cover the Denver Center airspace to support this study. This study has three goals: 1) determine the errors in the baseline 60-kilometer resolution RUC forecast wind fields relative to the needs of en route DSTs such as CTAS; 2) determine the benefit of using the TW algorithm to refine the RUC forecast wind fields with near real-tlme Meteorological Data Collection and Reporting System (MDCRS) aircraft reports, and 3) identify factors that influence wind field errors in order to improve accuracy and estimate errors in real time. The data for this study were collected over a one-year period for the Denver Center airspace and over one miIlion verification observations were used. This study is part of a larger effort funded by NASA which includes the NOAA/FSL.

Cole, R. E.↗

Improving Multiday Solar Wind Speed Forecasts

We analyze the residual errors for the Wang-Sheeley-Arge (WSA) solar wind speed forecasts as a function of the photospheric magnetic field expansion factor (fp) and the minimum separation angle (d) in the photosphere between the footpoints of open field lines and the nearest coronal hole boundary. We find the map of residual speed errors are systematic when examined as a function of fp and d. We use these residual error maps to apply corrections to the model speeds. We test this correction approach using 3-day lead time speed forecasts for an entire year of observations and model results. Our methods can readily be applied to develop corrections for the remaining WSA forecast lead times which range from 1 to 7 days in 1-day increments. Since the solar wind density, temperature, and the interplanetary magnetic field strength all correlate well with the solar wind speed, the improved accuracy of solar wind speed forecasts enables the production of multiday forecasts of the solar wind density, temperature, pressure, and interplanetary field strength, and geophysical indices. These additional parameters would expand the usefulness of Air Force Data Assimilative Photospheric Flux Transport-WSA forecasts for space weather clients.

H A Elliot↗

Interpretation of snowcover from satellite imagery for use in water supply forecasts in the Sierra Nevada

The California ASVT test area is composed of two study areas; one in Northern California covering the Upper Sacramento and Feather River Basins, and the other covering the Southern Sierra Basins of the San Joaquin, Kings, Kaweah, Tule, and Kern Rivers. Experiences of reducing snowcover from satellite imagery; the accuracy of present water supply forecast schemes; and the potential advantages of introducing snowcover into the forecast procedures are described.

Brown, A. J.↗

Uncertainty Optimization Applied to the Monte Carlo Analysis of Planetary Entry Trajectories

Recently, strong evidence of liquid water under the surface of Mars and a meteorite that might contain ancient microbes have renewed interest in Mars exploration. With this renewed interest, NASA plans to send spacecraft to Mars approx. every 26 months. These future spacecraft will return higher-resolution images, make precision landings, engage in longer-ranging surface maneuvers, and even return Martian soil and rock samples to Earth. Future robotic missions and any human missions to Mars will require precise entries to ensure safe landings near science objective and pre-employed assets. Potential sources of water and other interesting geographic features are often located near hazards, such as within craters or along canyon walls. In order for more accurate landings to be made, spacecraft entering the Martian atmosphere need to use lift to actively control the entry. This active guidance results in much smaller landing footprints. Planning for these missions will depend heavily on Monte Carlo analysis. Monte Carlo trajectory simulations have been used with a high degree of success in recent planetary exploration missions. These analyses ascertain the impact of off-nominal conditions during a flight and account for uncertainty. Uncertainties generally stem from limitations in manufacturing tolerances, measurement capabilities, analysis accuracies, and environmental unknowns. Thousands of off-nominal trajectories are simulated by randomly dispersing uncertainty variables and collecting statistics on forecast variables. The dependability of Monte Carlo forecasts, however, is limited by the accuracy and completeness of the assumed uncertainties. This is because Monte Carlo analysis is a forward driven problem; beginning with the input uncertainties and proceeding to the forecasts outputs. It lacks a mechanism to affect or alter the uncertainties based on the forecast results. If the results are unacceptable, the current practice is to use an iterative, trial-and-error approach to reconcile discrepancies. Therefore, an improvement to the Monte Carlo analysis is needed that will allow the problem to be worked in reverse. In this way, the largest allowable dispersions that achieve the required mission objectives can be determined quantitatively.

Olds, John↗

Improving Forecast Skill by Assimilation of AIRS Temperature Soundings

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The AIRS Version 5 retrieval algorithm, is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates delta T(p) for retrieved quantities and the use of these error estimates for Quality Control. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 deg. latitude X 0.67 deg longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates delta (p) were used as the uncertainty for each measurement in the data assimilation process. We compared forecasts analyses generated from the analyses done by assimilation of AIRS temperature profiles with three different sets of thresholds; Standard, Medium, and Tight. Assimilation of Quality Controlled AIRS temperature profiles significantly improve 5-7 day forecast skill compared to that obtained without the benefit of AIRS data in all of the cases studied. In addition, assimilation of Quality Controlled AIRS temperature soundings performs better than assimilation of AIRS observed radiances. Based on the experiments shown, Tight Quality Control of AIRS temperature profile performs best on the average from the perspective of improving Global 7 day forecast skill.

Susskind, Joel↗

Toward an Integrated Solution to Mitigate the Impact of Volcanic Ash to Aviation

The science community is making a concerted effort to improve the reliability of dispersion models for the forecasting of volcanic ash plumes. Toward this end, it has been observed that the assimilation of diverse, accurate and frequent surface, airborne and satellite observations of the source and distal ash plumes may hold the key. Various international research organizations and operational agencies make these observations using a variety of active and passive remote sensing systems and use them to initialize atmospheric trajectory and dispersion models. These observation systems range from surface LIDAR and ceilometers, to airborne radiometers and nephelometers, to satellite radiometers, multi-spectral imagers, LIDAR and UV-photometers. None of these systems alone is a panacea, however, their synergistic application holds great promise toward solving this complex problem. Additionally, the aeronautical and science communities are working to better understand the quantitative thresholds and tolerances of aviation systems to volcanic ash to better inform scientists of the accuracy requirements for dispersion model forecasts. A number of the most recent and promising efforts in all of these area are discussed in this presentation.

Murray, John J.↗

Session on validation of coupled models

The session on validation of coupled models is reviewed. The current use of a mesoscale model with a grid size of 20-km during STORM-FEST in 1992 has proven to be extremely valuable. The availability of forecast products at a much higher temporal and spatial resolution was very helpful for mesoscale forecasting, mission planning, and the guidance of research aircraft. Recent numerical simulation of ocean cyclones and mesoscsle convective systems using nonhydrostatic cloud/mesoscale models with a grid size as small as 2-km have demonstrated the potential of these models for predicting mesoscale convective systems, squall lines, hurricane rainbands, mesoscale gravity waves, and mesoscale frontal structures embedded within an extratropical cyclone. Although mesoscale/cloud scale models have demonstrated strong potential for use in operational forecasting, very limited quantitative evaluation (and verification) of these models were performed. As a result, the accuracy, the systematic biases, and the useful forecasts limits were not properly defined for these models. Also, no serious attempts were made to use these models for operational prediction of mesoscale convective systems.

Kuo, Bill↗