Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

GMAO OSSE Framework in Support of PBL Mission Science

The planetary boundary layer is the bottom layer of the troposphere where most of human activities take place. Atmospheric pollutants are capped by the temperature inversion layer in PBL. The thickness of PBL, ranging from tens of meter to several kilometer, affects pollutant dispersion and air quality. The thickness of PBL typically shows a strong diurnal cycle but it is difficult to model and predict its change because complicated dynamic and thermodynamic processes involved with air-surface exchange of temperature and moisture, convective mixing, surface friction, topography, advection and radiation heating and cooling influence the PBL height. Various parameterization schemes for PBL were developed but the underlying processes of PBL are neither clearly understood nor represented in NWP models and adding large uncertainty into weather and climate predictions. There are no systematic global observations to provide information on thermodynamic structure of PBL and efforts to explore new spaceborne instruments and measurement techniques are growing. This study aims to develop a PBL OSSE framework leveraging existing GMAO’s OSSE system that utilizes GEOS data assimilation and global forecast model (1) to evaluate existing and potential new observation types for the PBL structure analysis and prediction and (2) to test sensitivity of PBL parameterization schemes to PBL forecasts.

Min-Jeong Kim↗
NASA NTRS2014

Satellite Sounder Data Assimilation for Improving Alaska Region Weather Forecast

Data assimilation has been demonstrated very useful in improving both global and regional numerical weather prediction. Alaska has very coarser surface observation sites. On the other hand, it gets much more satellite overpass than lower 48 states. How to utilize satellite data to improve numerical prediction is one of hot topics among weather forecast community in Alaska. The Geographic Information Network of Alaska (GINA) at University of Alaska is conducting study on satellite data assimilation for WRF model. AIRS/CRIS sounder profile data are used to assimilate the initial condition for the customized regional WRF model (GINA-WRF model). Normalized standard deviation, RMSE, and correlation statistic analysis methods are applied to analyze one case of 48 hours forecasts and one month of 24-hour forecasts in order to evaluate the improvement of regional numerical model from Data assimilation. The final goal of the research is to provide improved real-time short-time forecast for Alaska regions.

Zhu, Jiang↗
NASA NTRS2015

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗
NASA NTRS2006

Hurricane Intensity Forecasts with a Global Mesoscale Model on the NASA Columbia Supercomputer

It is known that General Circulation Models (GCMs) have insufficient resolution to accurately simulate hurricane near-eye structure and intensity. The increasing capabilities of high-end computers (e.g., the NASA Columbia Supercomputer) have changed this. In 2004, the finite-volume General Circulation Model at a 1/4 degree resolution, doubling the resolution used by most of operational NWP center at that time, was implemented and run to obtain promising landfall predictions for major hurricanes (e.g., Charley, Frances, Ivan, and Jeanne). In 2005, we have successfully implemented the 1/8 degree version, and demonstrated its performance on intensity forecasts with hurricane Katrina (2005). It is found that the 1/8 degree model is capable of simulating the radius of maximum wind and near-eye wind structure, and thereby promising intensity forecasts. In this study, we will further evaluate the model s performance on intensity forecasts of hurricanes Ivan, Jeanne, Karl in 2004. Suggestions for further model development will be made in the end.

Shen, Bo-Wen↗
NASA NTRS2003

Atmospheric Soundings from AIRS/AMSU/HSB

AIRS was launched on EOS Aqua on May 5, 2002, together with AMSU A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU/HSB are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an RMS error of 1K, and 1 km layer precipitable water with an rms error of 1K, and 1 km layer precipitable water with an rms error of 20 percent, in cases with up to 80 percent cloud cover. The AIRS data products are significant for studying climate variability and change, as well as for use in initialization of General Circulation Models with the objective of improving analysis fields and subsequent forecast skill. Data assimilation experiments to evaluate the impact of AIRS retrievals on analysis and forecast skill are being conducted. Sample fields of parameters retrieved from AIRS/AMSU/HSB data will be presented and validated as a function of retrieved fractional cloud cover. Select fields will also be compared to those contained in the ECMWF analysis, done without the benefit of AIRS data, on both an instantaneous and monthly mean basis, to demonstrate information that AIRS can add to that already contained in the ECMWF analysis.

Susskind, Joel↗
NASA NTRS2015

Sea Ice Outlook for September 2015 June Report - NASA Global Modeling and Assimilation Office

The recent decline in perennial sea ice cover in Arctic Ocean is a topic of enormous scientific interest and has relevance to a broad variety of scientific disciplines and human endeavors including biological and physical oceanography, atmospheric circulation, high latitude ecology, the sustainability of indigenous communities, commerce, and resource exploration. A credible seasonal prediction of sea ice extent would be of substantial use to many of the stakeholders in these fields and may also reveal details on the physical processes that result in the current trends in the ice cover. Forecasts are challenging due in part to limitations in the polar observing network, the large variability in the climate system, and an incomplete knowledge of the significant processes. Nevertheless it is a useful to understand the current capabilities of high latitude seasonal forecasting and identify areas where such forecasts may be improved. Since 2008 the Arctic Research Consortium of the United States (ARCUS) has conducted a seasonal forecasting contest in which the average Arctic sea ice extent for the month of September (the month of the annual extent minimum) is predicted from available forecasts in early June, July, and August. The competition is known as the Sea Ice Outlook (SIO) but recently came under the auspices of the Sea Ice Prediction Network (SIPN), and multi-agency funded project to evaluate the SIO. The forecasts are submitted based on modeling, statistical, and heuristic methods. Forecasts of Arctic sea ice extent from the GMAO are derived from seasonal prediction system of the NASA Goddard Earth Observing System model, version 5 (GEOS 5) coupled atmosphere and ocean general circulation model (AOGCM). The projections are made in order to understand the relative skill of the forecasting system and to determine the effects of future improvements to the system. This years prediction is for a September average Arctic ice extent of 5.030.41 million km2.

SIPN↗
NASA NTRS1992

Forced unsteady deceleration of a turbulent boundary layer from a temporal perspective

The behavior of a turbulent boundary layer which has been subjected to a local ramp-like deceleration in the external velocity field, which leads to forced separation, has been studied experimentally. The data of this study are re-interpreted in light of more recent findings concerning the temporal nature of boundary layer turbulence in the presence of forced unsteady shear. In particular, the robustness of the near-wall turbulent motions to organized deformation is recognized. Their resilence during unsteady shearing action promotes continued efficient turbulent mixing and rapid redistribution of turbulent kinetic energy during forced transients. In aerodynamic problems, the rapid nature of the adjustment of the turbulence field to a new temporal boundary condition necessitates equally rapid remedial measures to be taken if means of control/prevention of forced unsteady separation are to be deployed to maximum effect. This requirement suggests exploration of the use of simple, real-time statistical forecasting techniques, based upon time-series analysis of easily-measurable features of the flow, to help assure timely deployment of mechanisms of boundary-layer control. This paper focuses upon the nature of turbulence in boundary layers undergoing forced deceleration which would lead to separation. A preliminary form of a forecasting model is presented and evaluated. Using observations of the previous two large eddies passing a detector, it forecasts the behavior of the future large eddy rather well.

Brereton, G. J.↗
NASA NTRS2014

The GOES-R Geostationary Lightning Mapper (GLM) and the Global Observing System for Total Lightning

for the existing GOES system currently operating over the Western Hemisphere. New and improved instrument technology will support expanded detection of environmental phenomena, resulting in more timely and accurate forecasts and warnings. Advancements over current GOES include a new capability for total lightning detection (cloud and cloud-to-ground flashes) from the Geostationary Lightning Mapper (GLM), and improved temporal, spatial, and spectral resolution for the next generation Advanced Baseline Imager (ABI). The GLM will map total lightning continuously day and night with near-uniform spatial resolution of 8 km with a product latency of less than 20 sec over the Americas and adjacent oceanic regions. This will aid in forecasting severe storms and tornado activity, and convective weather impacts on aviation safety and efficiency among a number of potential applications. The GLM will help address the National Weather Service requirement for total lightning observations globally to support warning decision-making and forecast services. Science and application development along with pre-operational product demonstrations and evaluations at NWS national centers, forecast offices, and NOAA testbeds will prepare the forecasters to use GLM as soon as possible after the planned launch and check-out of GOES-R in 2016. New applications will use GLM alone, in combination with the ABI, or integrated (fused) with other available tools (weather radar and ground strike networks, nowcasting systems, mesoscale analysis, and numerical weather prediction models) in the hands of the forecaster responsible for issuing more timely and accurate forecasts and warnings.

Goodman, Steven J.↗
NASA NTRS1981

A numerical evaluation of TIROS-N and NOAA-6 analyses in a high resolution limited area model

Vertical temperature profiles derived from TIROS-N and NOAA-6 radiance measurements were used to create separate analyses for the period 0000 GMT 6 January to 0000 GMT 7 January 1980. The 0000 GMT 6 January satellite analyses and a conventional analysis were used to initialize and run the University of Wisconsin's version of the Australian Region Primitive Equations model. Forecasts based on conventional analyses were used to evaluate the forecasts based only on satellite upper air data. The forecasts based only on TIROS-N or NOAA-6 data did reasonably well in locating the main trough and ridge positions. The satellite initial analyses and forecasts revealed errors correlated to the synoptic situation. The trough in both TIROS-N and NOAA-6 forecasts which was initially too warm remained too warm as it propagated eastward during the forecast period. Thus, it is unlikely that the operational satellite data will improve forecasts in a data dense region. However, in regions of poor data coverage, the satellite data should have a beneficial effect on numerical forecasts.

Derber, J. C.↗
NASA NTRS2000

Operational Assimilation of GOES Data into a Mesoscale Model

A technique has been developed for assimilating GOES-derived skin temperature tendencies and insolation into the surface energy budget equation of a mesoscale model so that the simulated rate of temperature change closely agrees with the satellite observations. A critical assumption of the technique is that the availability of moisture (either from the soil or vegetation) is the least known term in the model's surface energy budget. Therefore, the simulated latent heat flux, which is a function of surface moisture availability, is adjusted based upon differences between the modeled and satellite- observed skin temperature tendencies. An advantage of this technique is that satellite temperature tendencies are assimilated in an energetically consistent manner that avoids energy imbalances and surface stability problems that arise from direct assimilation of surface shelter temperatures. The fact that the rate of change of the satellite skin temperature is used rather than the absolute temperature means that sensor calibration is not as critical. The technique has been employed on a semi-operational basis at the Global Hydrology and Climate Center (GHCC) within the Penn State/National Center for Atmospheric Research (PSU/NCAR) Mesoscale Model (MM5) since 1 November 1998. We performed the assimilation on a model grid centered over the Southeastern US. In addition, a control run without assimilation was performed to provide insight into the performance of the assimilation technique. Bulk verification statistics (BIAS and RMSE) of surface air temperature and relative humidity of more than 250 case days has been performed to date. Results show that assimilation of the satellite data results reduces both the bias and RMSE for simulations of surface air temperature and relative humidity. We are working with forecasters at the National Weather Service Forecast Office located in Birmingham, AL to evaluate the impact of the assimilation on precipitation forecasts. In addition, work is currently underway to determine the ability of both the assimilation technique and Early Eta to sense the significant changes that occur in both leaf expansion and soil moisture conditions during the Spring-Summer of 1999. This will be accomplished via examination of the simulated surface energy budgets from both modeling systems.

Lapenta, William↗
NASA NTRS2010

Effective Presentation of Metabolic Rate Information for Lunar Extravehicular Activity (EVA)

During human exploration of the lunar surface, a suited crewmember needs effective and accurate information about consumable levels remaining in their life support system. The information must be presented in a manner that supports real-time consumable monitoring and route planning. Since consumable usage is closely tied to metabolic rate, the lunar suit must estimate metabolic rate from life support sensors, such as oxygen tank pressures, carbon dioxide partial pressure, and cooling water inlet and outlet temperatures. To provide adequate warnings that account for traverse time for a crewmember to return to a safe haven, accurate forecasts of consumable depletion rates are required. The forecasts must be presented to the crewmember in a straightforward, effective manner. In order to evaluate methods for displaying consumable forecasts, a desktop-based simulation of a lunar Extravehicular Activity (EVA) has been developed for the Constellation lunar suite s life-support system. The program was used to compare the effectiveness of several different data presentation methods.

Mackin, Michael A.↗
NASA NTRS2005

Applied Meteorology Unit (AMU) Quarterly Report. First Quarter FY-05

This report summarizes the Applied Meteorology Unit (AMU) activities for the first quarter of Fiscal Year 2005 (October - December 2005). Tasks reviewed include: (1) Objective Lightning Probability Forecast: Phase I, (2) Severe Weather Forecast Decision Aid, (3) Hail Index, (4) Stable Low Cloud Evaluation, (5) Shuttle Ascent Camera Cloud Obstruction Forecast, (6) Range Standardization and Automation (RSA) and Legacy Wind Sensor Evaluation, (7) Advanced Regional Prediction System (ARPS) Optimization and Training Extension, and (8) User Control Interface for ARPS Data Analysis System (ADAS) Data Ingest

Bauman, William↗
NASA NTRS2014

Sport Transition of JPSS VIIRS Imagery for Night-time Applications

The NASA/Short‐term Prediction, Research, and Transition (SPoRT) Program and NOAA/Cooperative Institute for Research in the Atmosphere (CIRA) work within the NOAA/Joint Polar Satellite System (JPSS) Proving Ground to demonstrate the unique capabilities of the VIIRS instrument. Very similar to MODIS, the VIIRS instrument provides many high‐resolution visible and infrared channels in a broad spectrum. In addition, VIIRS is equipped with a low‐light sensor that is able to detect light emissions from the land and atmosphere as well as reflected sunlight by the lunar surface. This band is referred to as the Day‐Night Band due to the sunlight being used at night to see cloud and topographic features just as one would typically see in day‐time visible imagery. NWS forecast offices that collaborate with SPoRT and CIRA have utilized MODIS imagery in operations, but have longed for more frequent passes of polar‐orbiting data. The VIIRS instrument enhances SPoRT collaborations with WFOs by providing another day and night‐time pass, and at times two additional passes due to its large swath width. This means that multi‐spectral, RGB imagery composites are more readily available to prepare users for their use in GOES‐R era and high‐resolution imagery for use in high‐latitudes is more frequently able to supplement standard GOES imagery within the SPoRT Hybrid GEO‐LEO product. The transition of VIIRS also introduces the new Day‐Night Band capability to forecast operations. An Intensive Evaluation Period (IEP) was conducted in Summer 2013 with a group of "Front Range" NWS offices related to VIIRS night‐time imagery. VIIRS single‐channel imagery is able to better analyze the specific location of fire hotspots and other land features, as well as provide a more true measurement of various cloud and aerosol properties than geostationary measurements, especially at night. Viewed within the SPoRT Hybrid imagery, the VIIRS data allows forecasters to better interpret the more frequent, but coarse GOES Imagery. Night‐time Microphysics and Dust RGB Imagery provides cloud analysis of cloud height, thickness, and composition in order for operational applications such as separating fog from low clouds, dust plume detection, and determining precipitating clouds in radar-void/ blocked regions. The Day‐Night Band has a particular benefit to seeing light from cities, fires, or other emissions as well as the reflection of moonlight off of clouds and smoke plumes, given the right lunar phase and angle. Examples from the VIIRS transition and IEP will be presented.

Fuell, Kevin↗
NASA NTRS1990

Atmospheric energetics and earth radiation budget

Processed ERBE data are used in several studies in which NMC global analyses and forecasts are examined and evaluated. In the first study, ERBE net radiation values for four months are averaged and integrated to provide global net energy transport. Energy transport by atmospheric circulations is obtained using NMC analyses and results provide a measure of reasonableness of the analyses. In the second and third experiments, ERBE values of outgoing longwave radiation are used as 'top-side truth' to examine both the spin-up problem and the radiation algorithms of the global forecasts.

Kann, Deirdre M.↗
NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis (MERRA-2)

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity-based Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observations that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45\% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario, though their fractional contribution reduces slightly from the early 2000's onward after the increased availability of wind observation from aircraft and atmospheric motion vectors, and the introduction of GPSRO; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Todling, Ricardo↗
NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observing system that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to Reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Fabio L R Diniz↗
NASA NTRS2012

Estimation of Eddy Dissipation Rates from Mesoscale Model Simulations

The Eddy Dissipation Rate is an important metric for representing the intensity of atmospheric turbulence and is used as an input parameter for predicting the decay of aircraft wake vortices. In this study, the forecasts of eddy dissipation rates obtained from the current state-of-the-art mesoscale model are evaluated for terminal area applications. The Weather Research and Forecast mesoscale model is used to simulate the planetary boundary layer at high horizontal and vertical mesh resolutions. The Bougeault-Lacarrer and the Mellor-Yamada-Janji schemes implemented in the Weather Research and Forecast model are evaluated against data collected during the National Aeronautics and Space Administration s Memphis Wake Vortex Field Experiment. Comparisons with other observations are included as well.

Ahmad, Nashat N.↗