Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Low-frequency predictability of the Dynamical Extended-Range Forecast Experiment

The objective of the study was to analyze data from the Dynamical Extended-Range Forecast Experiment conducted from January 1986 to March 1987, and to evaluate differences between analysis and forecasts with emphasis on the tropical 30-50-day oscillation. The diagnostic toll used is the projection of analysis and forecast data onto the normal modes of a primitive equation model. Examination of zonal-wind anomalies in the tropics shows that the forecast model predicts propagation of intraseasonal variations more accurately for slow propagation rates. The forecast amplitude is generally weaker than the analyzed amplitude. Analyzed kinetic energy and error fields exhibit similar horizontal scales for internal and external modes. External Rossby-mode components maximize in the extratropics while Rossby internal modes exhibit patterns that extend over the entire globe.

Nogues-Peagle, Julia↗

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗

GMAO OSSE Framework in Support of PBL Mission Science

The planetary boundary layer is the bottom layer of the troposphere where most of human activities take place. Atmospheric pollutants are capped by the temperature inversion layer in PBL. The thickness of PBL, ranging from tens of meter to several kilometer, affects pollutant dispersion and air quality. The thickness of PBL typically shows a strong diurnal cycle but it is difficult to model and predict its change because complicated dynamic and thermodynamic processes involved with air-surface exchange of temperature and moisture, convective mixing, surface friction, topography, advection and radiation heating and cooling influence the PBL height. Various parameterization schemes for PBL were developed but the underlying processes of PBL are neither clearly understood nor represented in NWP models and adding large uncertainty into weather and climate predictions. There are no systematic global observations to provide information on thermodynamic structure of PBL and efforts to explore new spaceborne instruments and measurement techniques are growing. This study aims to develop a PBL OSSE framework leveraging existing GMAO’s OSSE system that utilizes GEOS data assimilation and global forecast model (1) to evaluate existing and potential new observation types for the PBL structure analysis and prediction and (2) to test sensitivity of PBL parameterization schemes to PBL forecasts.

Min-Jeong Kim↗

Satellite Sounder Data Assimilation for Improving Alaska Region Weather Forecast

Data assimilation has been demonstrated very useful in improving both global and regional numerical weather prediction. Alaska has very coarser surface observation sites. On the other hand, it gets much more satellite overpass than lower 48 states. How to utilize satellite data to improve numerical prediction is one of hot topics among weather forecast community in Alaska. The Geographic Information Network of Alaska (GINA) at University of Alaska is conducting study on satellite data assimilation for WRF model. AIRS/CRIS sounder profile data are used to assimilate the initial condition for the customized regional WRF model (GINA-WRF model). Normalized standard deviation, RMSE, and correlation statistic analysis methods are applied to analyze one case of 48 hours forecasts and one month of 24-hour forecasts in order to evaluate the improvement of regional numerical model from Data assimilation. The final goal of the research is to provide improved real-time short-time forecast for Alaska regions.

Zhu, Jiang↗

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗

Hurricane Intensity Forecasts with a Global Mesoscale Model on the NASA Columbia Supercomputer

It is known that General Circulation Models (GCMs) have insufficient resolution to accurately simulate hurricane near-eye structure and intensity. The increasing capabilities of high-end computers (e.g., the NASA Columbia Supercomputer) have changed this. In 2004, the finite-volume General Circulation Model at a 1/4 degree resolution, doubling the resolution used by most of operational NWP center at that time, was implemented and run to obtain promising landfall predictions for major hurricanes (e.g., Charley, Frances, Ivan, and Jeanne). In 2005, we have successfully implemented the 1/8 degree version, and demonstrated its performance on intensity forecasts with hurricane Katrina (2005). It is found that the 1/8 degree model is capable of simulating the radius of maximum wind and near-eye wind structure, and thereby promising intensity forecasts. In this study, we will further evaluate the model s performance on intensity forecasts of hurricanes Ivan, Jeanne, Karl in 2004. Suggestions for further model development will be made in the end.

Shen, Bo-Wen↗

Evaluating Implementations of the Immersed Boundary Method in the Weather Research and Forecasting Model

The terrain-following coordinate system used by many atmospheric models can cause numerical instabilities due to discretization errors as resolved terrain slopes increase and the grid becomes highly skewed. The immersed boundary (IB) method, which does not require the grid to conform to the terrain, has been shown to alleviate these errors, and has been used successfully for high-resolution atmospheric simulations over steep terrain, including vertical building surfaces. Since many previous applications of IB methods to atmospheric models have used very fine grid resolution (5 m or less), the present study seeks to evaluate IB method performance over a range of grid resolutions and aspect ratios. Two classes of IB algorithms, velocity reconstruction and shear stress reconstruction, are tested within the common framework of the Weather Research and Forecasting (WRF) Model. Performance is evaluated in two test cases, one with flat terrain and the other with the topography of Askervein Hill, both under neutrally stratified conditions. WRF-IB results are compared to similarity theory, observations, and native WRF results. Despite sensitivity to the location at which the IB intersects the model grid, the velocity reconstruction IB method shows consistent performance when used with a hybrid RANS/LES surface scheme. The shear stress reconstruction IB method is not sensitive to the grid intersection, but is less consistent and near-surface velocity errors can occur at coarse resolutions. This study represents an initial investigation of IB method variability across grid resolutions in WRF. Future work will focus on improving IB method performance at intermediate to coarse resolutions.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric Soundings from AIRS/AMSU/HSB

AIRS was launched on EOS Aqua on May 5, 2002, together with AMSU A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU/HSB are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an RMS error of 1K, and 1 km layer precipitable water with an rms error of 1K, and 1 km layer precipitable water with an rms error of 20 percent, in cases with up to 80 percent cloud cover. The AIRS data products are significant for studying climate variability and change, as well as for use in initialization of General Circulation Models with the objective of improving analysis fields and subsequent forecast skill. Data assimilation experiments to evaluate the impact of AIRS retrievals on analysis and forecast skill are being conducted. Sample fields of parameters retrieved from AIRS/AMSU/HSB data will be presented and validated as a function of retrieved fractional cloud cover. Select fields will also be compared to those contained in the ECMWF analysis, done without the benefit of AIRS data, on both an instantaneous and monthly mean basis, to demonstrate information that AIRS can add to that already contained in the ECMWF analysis.

Susskind, Joel↗

Sea Ice Outlook for September 2015 June Report - NASA Global Modeling and Assimilation Office

The recent decline in perennial sea ice cover in Arctic Ocean is a topic of enormous scientific interest and has relevance to a broad variety of scientific disciplines and human endeavors including biological and physical oceanography, atmospheric circulation, high latitude ecology, the sustainability of indigenous communities, commerce, and resource exploration. A credible seasonal prediction of sea ice extent would be of substantial use to many of the stakeholders in these fields and may also reveal details on the physical processes that result in the current trends in the ice cover. Forecasts are challenging due in part to limitations in the polar observing network, the large variability in the climate system, and an incomplete knowledge of the significant processes. Nevertheless it is a useful to understand the current capabilities of high latitude seasonal forecasting and identify areas where such forecasts may be improved. Since 2008 the Arctic Research Consortium of the United States (ARCUS) has conducted a seasonal forecasting contest in which the average Arctic sea ice extent for the month of September (the month of the annual extent minimum) is predicted from available forecasts in early June, July, and August. The competition is known as the Sea Ice Outlook (SIO) but recently came under the auspices of the Sea Ice Prediction Network (SIPN), and multi-agency funded project to evaluate the SIO. The forecasts are submitted based on modeling, statistical, and heuristic methods. Forecasts of Arctic sea ice extent from the GMAO are derived from seasonal prediction system of the NASA Goddard Earth Observing System model, version 5 (GEOS 5) coupled atmosphere and ocean general circulation model (AOGCM). The projections are made in order to understand the relative skill of the forecasting system and to determine the effects of future improvements to the system. This years prediction is for a September average Arctic ice extent of 5.030.41 million km2.

SIPN↗

Forced unsteady deceleration of a turbulent boundary layer from a temporal perspective

The behavior of a turbulent boundary layer which has been subjected to a local ramp-like deceleration in the external velocity field, which leads to forced separation, has been studied experimentally. The data of this study are re-interpreted in light of more recent findings concerning the temporal nature of boundary layer turbulence in the presence of forced unsteady shear. In particular, the robustness of the near-wall turbulent motions to organized deformation is recognized. Their resilence during unsteady shearing action promotes continued efficient turbulent mixing and rapid redistribution of turbulent kinetic energy during forced transients. In aerodynamic problems, the rapid nature of the adjustment of the turbulence field to a new temporal boundary condition necessitates equally rapid remedial measures to be taken if means of control/prevention of forced unsteady separation are to be deployed to maximum effect. This requirement suggests exploration of the use of simple, real-time statistical forecasting techniques, based upon time-series analysis of easily-measurable features of the flow, to help assure timely deployment of mechanisms of boundary-layer control. This paper focuses upon the nature of turbulence in boundary layers undergoing forced deceleration which would lead to separation. A preliminary form of a forecasting model is presented and evaluated. Using observations of the previous two large eddies passing a detector, it forecasts the behavior of the future large eddy rather well.

Brereton, G. J.↗

Evaluating wind profiles in a numerical weather prediction model with Doppler lidar

We use Doppler lidar wind profiles from six locations around the globe to evaluate the wind profile forecasts in the boundary layer generated by the operational global Integrated Forecast System (IFS) from the European Centre for Medium-range Weather Forecasts (ECMWF). The six locations selected cover a variety of surfaces with different characteristics (rural, marine, mountainous urban, and coastal urban). We first validated the Doppler lidar observations at four locations by comparison with co-located radiosonde profiles to ensure that the Doppler lidar observations were of sufficient quality. The two observation types agree well, with the mean absolute error (MAE) in wind speed almost always less than 1 m s –1 . Large deviations in the wind direction were usually only seen for low wind speeds and are due to the wind direction uncertainty increasing rapidly as the wind speed tends to zero. Time–height composites of the wind evaluation with 1 h resolution were generated, and evaluation of the model winds showed that the IFS model performs best over marine and coastal locations, where the mean absolute wind vector error was usually less than 3 m s –1 at all heights within the boundary layer. Larger errors were seen in locations where the surface was more complex, especially in the wind direction. For example, in Granada, which is near a high mountain range, the IFS model failed to capture a commonly occurring mountain breeze, which is highly dependent on the sub-grid-size terrain features that are not resolved by the model. The uncertainty in the wind forecasts increased with forecast lead time, but no increase in the bias was seen. At one location, we conditionally performed the wind evaluation based on the presence or absence of a low-level jet diagnosed from the Doppler lidar observations. The model was able to reproduce the presence of the low-level jet, but the wind speed maximum was about 2 m s –1 lower than observed. This is attributed to the effective vertical resolution of the model being too coarse to create the strong gradients in wind speed observed. Our results show that Doppler lidar is a suitable instrument for evaluating the boundary layer wind profiles in atmospheric models.

54 ENVIRONMENTAL SCIENCES↗

Forecasting influenza activity using machine-learned mobility map

Human mobility is a primary driver of infectious disease spread. However, existing data is limited in availability, coverage, granularity, and timeliness. Data-driven forecasts of disease dynamics are crucial for decision-making by health officials and private citizens alike. In this work, we focus on a machine-learned anonymized mobility map (hereon referred to as AMM) aggregated over hundreds of millions of smartphones and evaluate its utility in forecasting epidemics. We factor AMM into a metapopulation model to retrospectively forecast influenza in the USA and Australia. We show that the AMM model performs on-par with those based on commuter surveys, which are sparsely available and expensive. We also compare it with gravity and radiation based models of mobility, and find that the radiation model’s performance is quite similar to AMM and commuter flows. Additionally, we demonstrate our model’s ability to predict disease spread even across state boundaries. Our work contributes towards developing timely infectious disease forecasting at a global scale using human mobility datasets expanding their applications in the area of infectious disease epidemiology.

60 APPLIED LIFE SCIENCES↗

The GOES-R Geostationary Lightning Mapper (GLM) and the Global Observing System for Total Lightning

for the existing GOES system currently operating over the Western Hemisphere. New and improved instrument technology will support expanded detection of environmental phenomena, resulting in more timely and accurate forecasts and warnings. Advancements over current GOES include a new capability for total lightning detection (cloud and cloud-to-ground flashes) from the Geostationary Lightning Mapper (GLM), and improved temporal, spatial, and spectral resolution for the next generation Advanced Baseline Imager (ABI). The GLM will map total lightning continuously day and night with near-uniform spatial resolution of 8 km with a product latency of less than 20 sec over the Americas and adjacent oceanic regions. This will aid in forecasting severe storms and tornado activity, and convective weather impacts on aviation safety and efficiency among a number of potential applications. The GLM will help address the National Weather Service requirement for total lightning observations globally to support warning decision-making and forecast services. Science and application development along with pre-operational product demonstrations and evaluations at NWS national centers, forecast offices, and NOAA testbeds will prepare the forecasters to use GLM as soon as possible after the planned launch and check-out of GOES-R in 2016. New applications will use GLM alone, in combination with the ABI, or integrated (fused) with other available tools (weather radar and ground strike networks, nowcasting systems, mesoscale analysis, and numerical weather prediction models) in the hands of the forecaster responsible for issuing more timely and accurate forecasts and warnings.

Goodman, Steven J.↗

A numerical evaluation of TIROS-N and NOAA-6 analyses in a high resolution limited area model

Vertical temperature profiles derived from TIROS-N and NOAA-6 radiance measurements were used to create separate analyses for the period 0000 GMT 6 January to 0000 GMT 7 January 1980. The 0000 GMT 6 January satellite analyses and a conventional analysis were used to initialize and run the University of Wisconsin's version of the Australian Region Primitive Equations model. Forecasts based on conventional analyses were used to evaluate the forecasts based only on satellite upper air data. The forecasts based only on TIROS-N or NOAA-6 data did reasonably well in locating the main trough and ridge positions. The satellite initial analyses and forecasts revealed errors correlated to the synoptic situation. The trough in both TIROS-N and NOAA-6 forecasts which was initially too warm remained too warm as it propagated eastward during the forecast period. Thus, it is unlikely that the operational satellite data will improve forecasts in a data dense region. However, in regions of poor data coverage, the satellite data should have a beneficial effect on numerical forecasts.

Derber, J. C.↗

Operational Assimilation of GOES Data into a Mesoscale Model

A technique has been developed for assimilating GOES-derived skin temperature tendencies and insolation into the surface energy budget equation of a mesoscale model so that the simulated rate of temperature change closely agrees with the satellite observations. A critical assumption of the technique is that the availability of moisture (either from the soil or vegetation) is the least known term in the model's surface energy budget. Therefore, the simulated latent heat flux, which is a function of surface moisture availability, is adjusted based upon differences between the modeled and satellite- observed skin temperature tendencies. An advantage of this technique is that satellite temperature tendencies are assimilated in an energetically consistent manner that avoids energy imbalances and surface stability problems that arise from direct assimilation of surface shelter temperatures. The fact that the rate of change of the satellite skin temperature is used rather than the absolute temperature means that sensor calibration is not as critical. The technique has been employed on a semi-operational basis at the Global Hydrology and Climate Center (GHCC) within the Penn State/National Center for Atmospheric Research (PSU/NCAR) Mesoscale Model (MM5) since 1 November 1998. We performed the assimilation on a model grid centered over the Southeastern US. In addition, a control run without assimilation was performed to provide insight into the performance of the assimilation technique. Bulk verification statistics (BIAS and RMSE) of surface air temperature and relative humidity of more than 250 case days has been performed to date. Results show that assimilation of the satellite data results reduces both the bias and RMSE for simulations of surface air temperature and relative humidity. We are working with forecasters at the National Weather Service Forecast Office located in Birmingham, AL to evaluate the impact of the assimilation on precipitation forecasts. In addition, work is currently underway to determine the ability of both the assimilation technique and Early Eta to sense the significant changes that occur in both leaf expansion and soil moisture conditions during the Spring-Summer of 1999. This will be accomplished via examination of the simulated surface energy budgets from both modeling systems.

Lapenta, William↗

Effective Presentation of Metabolic Rate Information for Lunar Extravehicular Activity (EVA)

During human exploration of the lunar surface, a suited crewmember needs effective and accurate information about consumable levels remaining in their life support system. The information must be presented in a manner that supports real-time consumable monitoring and route planning. Since consumable usage is closely tied to metabolic rate, the lunar suit must estimate metabolic rate from life support sensors, such as oxygen tank pressures, carbon dioxide partial pressure, and cooling water inlet and outlet temperatures. To provide adequate warnings that account for traverse time for a crewmember to return to a safe haven, accurate forecasts of consumable depletion rates are required. The forecasts must be presented to the crewmember in a straightforward, effective manner. In order to evaluate methods for displaying consumable forecasts, a desktop-based simulation of a lunar Extravehicular Activity (EVA) has been developed for the Constellation lunar suite s life-support system. The program was used to compare the effectiveness of several different data presentation methods.

Mackin, Michael A.↗

Applied Meteorology Unit (AMU) Quarterly Report. First Quarter FY-05

This report summarizes the Applied Meteorology Unit (AMU) activities for the first quarter of Fiscal Year 2005 (October - December 2005). Tasks reviewed include: (1) Objective Lightning Probability Forecast: Phase I, (2) Severe Weather Forecast Decision Aid, (3) Hail Index, (4) Stable Low Cloud Evaluation, (5) Shuttle Ascent Camera Cloud Obstruction Forecast, (6) Range Standardization and Automation (RSA) and Legacy Wind Sensor Evaluation, (7) Advanced Regional Prediction System (ARPS) Optimization and Training Extension, and (8) User Control Interface for ARPS Data Analysis System (ADAS) Data Ingest

Bauman, William↗