Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

The NASA GEOS-5 Aerosol Forecasting System

The NASA Goddard Earth Observing System modeling and data assimilation environment (GEOS-5) is maintained by the Global Modeling and Assimilation Office (GMAO) at the NASA Goddard Space Flight Center. Near-realtime meteorological forecasts are produced to support NASA satellite and field missions. We have implemented in this environment an aerosol module based on the Goddard Chemistry, Aerosol, Radiation, and Transport (GOCART) model. This modeling system has previously been evaluated in the context of hindcasts based on assimilated meteorology. Here we focus on the development and evaluation of the near-realtime forecasting system. We present a description of recent efforts to implement near-realtime biomass burning emissions derived from the Moderate Resolution Imaging Spectroradiometer (MODIS) fire radiative power products. We as well present a developing capability for improvement of aerosol forecasts by assimilation of aerosol information from MODIS.

Colarco, Peter↗
NASA NTRS2010

Evaluation of Enhanced High Resolution MODIS/AMSR-E SSTs and the Impact on Regional Weather Forecast

Over the last few years, the NASA Short-term Prediction Research and Transition (SPoRT) Center has been generating a 1-km sea surface temperature (SST) composite derived from retrievals of the Moderate Resolution Imaging Spectroradiometer (MODIS) for use in operational diagnostics and regional model initialization. With the assumption that the day-to-day variation in the SST is nominal, individual MODIS passes aboard the Earth Observing System (EOS) Aqua and Terra satellites are used to create and update four composite SST products each day at 0400, 0700, 1600, and 1900 UTC, valid over the western Atlantic and Caribbean waters. A six month study from February to August 2007 over the marine areas surrounding southern Florida was conducted to compare the use of the MODIS SST composite versus the Real-Time Global SST analysis to initialize the Weather Research and Forecasting (WRF) model. Substantial changes in the forecast heat fluxes were seen at times in the marine boundary layer, but relatively little overall improvement was measured in the sensible weather elements. The limited improvement in the WRF model forecasts could be attributed to the diurnal changes in SST seen in the MODIS SST composites but not accounted for by the model. Furthermore, cloud contamination caused extended periods when individual passes of MODIS were unable to update the SSTs, leading to substantial SST latency and a cool bias during the early summer months. In order to alleviate the latency problems, the SPoRT Center recently enhanced its MODIS SST composite by incorporating information from the Advanced Microwave Scanning Radiometer-EOS (AMSR-E) instruments as well as the Operational Sea Surface Temperature and Sea Ice Analysis. These enhancements substantially decreased the latency due to cloud cover and improved the bias and correlation of the composites at available marine point observations. While these enhancements improved upon the modeled cold bias using the original MODIS SSTs, the discernable impacts on the WRF model were still somewhat limited. This paper explores several factors that may have contributed to this result. First, the original methodology to initialize the model used the most recent SST composite available in a hypothetical real ]time configuration, often matching the forecast initial time with an SST field that was 5-8 hours offset. To minimize the differences that result from the diurnal variations in SST, the previous day fs SST composite is incorporated at a time closest to the model initialization hour (e.g. 1600 UTC composite at 1500 UTC model initialization). Second, the diurnal change seen in the MODIS SST composites was not represented by the WRF model in previous simulations, since the SSTs were held constant throughout the model integration. To address this issue, we explore the use of a water skin-temperature diurnal cycle prediction capability within v3.1 of the WRF model to better represent fluctuations in marine surface forcing. Finally, the verification of the WRF model is limited to very few over-water sites, many of which are located near the coastlines. In order to measure the open ocean improvements from the AMSR-E, we could use an independent 2-dimensional, satellite-derived data set to validate the forecast model by applying an object-based verification method. Such a validation technique could aid in better understanding the benefits of the mesoscale SST spatial structure to regional models applications.

Schiferl, Luke D.↗
NASA NTRS1984

FGGE data impact studies in the Southern Hemisphere

The purpose of this paper is to quantify the impact of the FGGE SOS on the GLAS analyses and forecasts in the Southern Hemisphere, and to evaluate the relative importance of its components, and in particular, the impact of the loss of surface buoys. This discussion is limited to the forecast impact of the FGGE system upon a region between 28 deg S and 56 deg S, 50 deg W-80 W which includes essentially the southern cone of South America. Although forecast skill is verified against the NMC analysis, which used only VTPR but no TIROS-N data in the Southern Hemisphere, enough conventional data exists over this region to avoid biased verifications.

Kalnay, E.↗
NASA NTRS1983

FGGE forecast impact studies in the Southern Hemisphere

The purpose of this paper is to quantify the impact of the FGGE SOS on the GLAS analyses and forecasts in the Southern Hemisphere, and to evaluate the relative importance of its components, and in particular, the impact of the loss of surface buoys. This discussion is limited to the forecast impact of the FGGE system upon a region between 28 deg S and 56 deg S, 50 deg W-80 W which includes essentially the southern cone of South America. Although forecast skill is verified against the NMC analysis, which used only VTPR but no TIROS-N data in the Southern Hemisphere, enough conventional data exists over this region to avoid biased verifications.

Kalnay, E.↗
NASA NTRS1998

The Impact of NASA Scatterometer Data on GEOS-2 Analyses and Forecasts

Experiments with the evolving GEOS-2 data assimilation system (DAS) delineate the impact of NASA scatterometer (NSCAT) data on ocean surface analysis and numerical weather prediction (NWP). Extensions and refinements of the DAS to account for the characteristics of NSCAT data produced better results than were obtained with the GEOS-1 DAS. The two key extensions are to increase the vertical influence of the surface wind data and to take proper account of the time difference between the observation and the analysis. The results of these experiments show that surface wind analyses are improved by NSCAT data. This is seen in subjective evaluation of synoptic cases and in forecast impacts. NSCAT data have a very significant positive impact on the GEOS-2 forecasts in the southern hemisphere (SH). In the northern hemisphere (NH) the overall statistics show a modest positive impact. However, on a case by case basis, in the NH, the impact is generally neutral or significantly positive. The GEOS-2 results are compared to results obtained using the GEOS-1 DAS and using the 1995 National Center for Environmental Prediction (NCEP95) DAS. The GEOS-2 control forecasts are more accurate than those of GEOS-1. All three impact experiments show a large positive impact in the SH. In the NH, both the GEOS-2 and the NCEP95 NSCAT impacts are positive while the GEOS-1 impact is neutral.

Atlas, R.↗
NASA NTRS2019

Evaluation of the Impacts of Biomass Burning Aerosols on the NASA GEOS Sub-Seasonal Climate Forecasts

Emission sources of trace gases and aerosol particles in the South American (SA)and African (Af) continents have a strong seasonal and space variability associated with the extensive vegetation fires activities. In both continents, during the austral winter, the fires affect mainly tropical forest and savannah-type biomes and are mostly associated with deforestation and agricultural/pasture land management. Smoke aerosol particles, on average, contribute to at least 90% of the total aerosol optical depth (AOD) in the visible spectrum in the case of the South America regional smoke. Smoke aerosols also act as cloud condensation nuclei affecting cloud microphysics properties and therefore, changing the radiation budget, hydrological cycle and global circulation patterns over disturbed areas (Kaufman, 1995; Rosenfeld, 1999; Andreae,et al., 2004; Koren et al., 2004, Zhang, 2008; Ott et al., 2010; Randles et al., 2013). This study aims to evaluate and quantify the impact of including a comprehensive emission field of biomass burning aerosol on the performance of a seasonal climate forecast system, not only regarding the AOD itself but mainly on the meteorological state variable (e.g., precipitation and temperature). To address the questions put above, we designed two numerical experiments: 1- named"AERO_CTL" which applies the Quick Fire Emissions Dataset (QFED) emissions estimated with intra-diurnal variation (hereafter, BBE), and 2- named "AERO_CLM" where the sourcee mission is based on a climatology of the QFED emissions, with only monthly variation(hereafter, BBCLIM). Hindcast simulations were produced using the Goddard Earth ObservingSystem global circulation model, version 5, sub-seasonal to seasonal (GEOS5-S2S) system with a nominal spatial resolution of 56km (Rienecker et al., 2008). In both experiments, the aerosol feedbacks from cloud developments and radiation interactions were accounted. The two experiments consisted of 4 members each and ran from June to November spanning over the years 2000 to 2015. Model performance was evaluated by calculating statistical metrics on the mean area of SA and Af. Our results demonstrated that the skill model in predicting AOD is significantly improve when BBE source emission is applied over SA, but not over the Afcontinent. Over SA, the correlation between the AERO_CTL model configuration and MERRA-2 is 0.93 (R2= 0.86, RMS=0.02, BIAS=0.01), while the AERO_CLM model presents a value of0.81 (R2= 0.65, RMS=0.04, BIAS=0.06). However, the AERO_CTL experiment better represents the inter-annual variability of the AOS in both regions. The gain of the skill in predicting the AOD by the AERO_CTL experiment is also seen in some meteorological variables. We observed an increase in the model skill in predicting the 2-meter temperature and precipitation of up to 0.3 for the AERO_CTL experiment in comparison to the AERO_CLM. AERO_CLM. According to the analyzed hindcast, we inferred that representing the BBE more realistically implies in a significant gain of skills in the seasonal climate forecasting over SA and Af continents.

Aerosol↗
NASA NTRS2012

Evaluating the Contribution of NASA Remotely-Sensed Data Sets on a Convection-Allowing Forecast Model

The Short-term Prediction Research and Transition (SPoRT) Center is a collaborative partnership between NASA and operational forecasting partners, including a number of National Weather Service forecast offices. SPoRT provides real-time NASA products and capabilities to help its partners address specific operational forecast challenges. One challenge that forecasters face is using guidance from local and regional deterministic numerical models configured at convection-allowing resolution to help assess a variety of mesoscale/convective-scale phenomena such as sea-breezes, local wind circulations, and mesoscale convective weather potential on a given day. While guidance from convection-allowing models has proven valuable in many circumstances, the potential exists for model improvements by incorporating more representative land-water surface datasets, and by assimilating retrieved temperature and moisture profiles from hyper-spectral sounders. In order to help increase the accuracy of deterministic convection-allowing models, SPoRT produces real-time, 4-km CONUS forecasts using a configuration of the Weather Research and Forecasting (WRF) model (hereafter SPoRT-WRF) that includes unique NASA products and capabilities including 4-km resolution soil initialization data from the Land Information System (LIS), 2-km resolution SPoRT SST composites over oceans and large water bodies, high-resolution real-time Green Vegetation Fraction (GVF) composites derived from the Moderate-resolution Imaging Spectroradiometer (MODIS) instrument, and retrieved temperature and moisture profiles from the Atmospheric Infrared Sounder (AIRS) and Infrared Atmospheric Sounding Interferometer (IASI). NCAR's Model Evaluation Tools (MET) verification package is used to generate statistics of model performance compared to in situ observations and rainfall analyses for three months during the summer of 2012 (June-August). Detailed analyses of specific severe weather outbreaks during the summer will be presented to assess the potential added-value of the SPoRT datasets and data assimilation methodology compared to a WRF configuration without the unique datasets and data assimilation.

Zavodsky, Bradley T.↗
NASA NTRS1979

Application of parametric weight and cost estimating relationships to future transport aircraft

A model comprised of system level weight and cost estimating relationships for transport aircraft is presented. In order to determine the production cost of future aircraft its weight is first estimated based on performance parameters, and then the cost is estimated as a function of weight. For initial evaluation CERs were applied to actual system weights of six aircraft (3 military and 3 commercial) with mean empty weights ranging from 30,000 to 300,000 lb. The resulting cost estimates were compared with actual costs. The average absolute error was only 4.3%. Then the model was applied to five aircraft still in the design phase (Boeing 757, 767 and 777, and BAC HS146-100 and HS146-200). While the estimates for the 757 and 767 are within 2 to 3 percent of their assumed break-even costs, it is recognized that these are very sensitive to the validity of the estimated weights, inflation factor, the amount assumed for nonrecurring costs, etc., and it is suggested that the model may be used in conjunction with other information such as RDT&E cost estimates and market forecasts. The model will help NASA evaluate new technologies and production costs of future aircraft.

Beltramo, M. N.↗
NASA NTRS2013

An Assessment of the Skill of GEOS-5 Seasonal Forecasts

The seasonal forecast skill of the NASA Global Modeling and Assimilation Office coupled global climate model (CGCM) is evaluated based on an ensemble of 9-month lead forecasts for the period 1993 to 2010. The results from the current version (V2) of the CGCM consisting of the GEOS-5 AGM coupled to the MOM4 ocean model are compared with those from an earlier version (V1) in which the AGCM (the NSIPP model) was coupled to the Poseidon Ocean Model. It was found that the correlation skill of the Sea Surface Temperature (SST) forecasts is generally better in V2, especially over the sub-tropical and tropical central and eastern Pacific, Atlantic, and Indian Ocean. Furthermore, the improvement in skill in V2 mainly comes from better forecasts of the developing phase of ENSO from boreal spring to summer. The skill of ENSO forecasts initiated during the boreal winter season, however, shows no improvement in terms of correlation skill, and is in fact slightly worse in terms of root mean square error (RMSE). The degradation of skill is found to be due to an excessive ENSO amplitude. For V1, the ENSO amplitude is too strong in forecasts starting in boreal spring and summer, which causes large RMSE in the forecast. For V2, the ENSO amplitude is slightly stronger than that in observations and V1 for forecasts starting in boreal winter season. An analysis of the terms in the SST tendency equation, shows that this is mainly due to an excessive zonal advective feedback. In addition, V2 forecasts that are initiated during boreal winter season, exhibit a slower phase transition of El Nino, which is consistent with larger amplitude of ENSO after the ENSO peak season. It is found that this is due to weak discharge of equatorial Warm Water Volume (WWV). In both observations and V1, the discharge of equatorial WWV leads the equatorial geostrophic easterly current so as to damp the El Nino starting in January. This process is delayed by about 2 months in V2 due to the slower phase transition of the equatorial zonal current from westerly to easterly.

GMAO↗
NASA NTRS2017

The OSSE Framework at the NASA Global Modeling and Assimilation Office (GMAO)

This abstract summarizes the OSSE framework developed at the Global Modeling and Assimilation Office at the National Aeronautics and Space Administration (NASA/GMAO). Some of the OSSE techniques developed at GMAO including simulation of realistic observations, e.g., adding errors to simulated observations, are now widely used by the community to evaluate the impact of new observations on the weather forecasts. This talk presents some of the recent progresses and challenges in simulating realistic observations, radiative transfer modeling support for the GMAO OSSE activities, assimilation of OSSE observations into data assimilation systems, and evaluating the impact of simulated observations on the forecast skills.

Moradi, Isaac↗
NASA NTRSDate not supplied

The GMAO Observing System Simulation Experiment (OSSE) Framework

We present the current status of the OSSE system at the Global Modeling and Assimilation Office at the National Aeronautics and Space Administration (NASA/GMAO). Some of the OSSE techniques developed at GMAO including simulation of realistic observations, e.g., adding errors to simulated observations, are now widely used by the community to evaluate the impact of new observations on the weather forecasts. This talk presents some of the recent progresses and challenges in simulating realistic observations, radiative transfer modeling support for the GMAO OSSE activities, assimilation of OSSE observations into data assimilation systems, and evaluating the impact of simulated observations on the forecast skills.

Isaac Moradi↗
NASA NTRS2021

Perspectives on flood forecast-based early action and opportunities for Earth observations

This paper seeks to identify opportunities to integrate Earth observations (EO) into flood forecast-based early action and propose future directions for research and collaboration between EO and humanitarian communities. Forecast-based early action (FbA) is an approach to shift disaster response toward anticipation to mitigate impacts to at-risk communities; however, timely and accurate information is needed in the development of data-based triggers and thresholds for action. Therefore, this paper considers the readiness of a wide range of EO for flood monitoring and forecasting in the design, operations, and evaluation phases of FbA. The most significant opportunities for EO to inform FbA efforts lie in the design and evaluation phases, as EO can aid in the development of impact-based triggers. The EO products most readily applicable include precipitation, streamflow estimates, and exposure mapping, and those requiring the greatest amount of further research include vulnerability and impact assessments. This paper identifies collaboration opportunities for the EO and humanitarian communities to create tailored products, such as overlays combining flood extents with exposure maps. Such collaboration opportunities can be fostered by open data sharing, data verification efforts, and incentives for supporting boundary organizations capable of enabling the use of EO for FbA.

disasters↗
NASA NTRSDate not supplied

Assessing the Viability of Using GEOS-Forecast Product for Landslides Forecasting: A Step Toward Early Warning System

Landslides across the globe are mostly triggered by extreme rainfall events affecting infrastructure, transportation and livelihoods. The risks are rarely quantified due to lack of data, analytical skills and limited modeling techniques. Knowledge of local to global scale landslide risks provides communities and national agencies the ability to adapt disaster management practices to mitigate and recover from these hazards. In order to minimize the risks and improve characterization of community resilience to landslides, it is vital to have reliable information about the factors triggering landslides such as rainfall, well ahead in time. Forecasting potential landslide activity and impacts can be achieved through reliable precipitation forecast models. However, it is challenging because of the temporal and spatial variability of precipitation, an important factor in triggering landslides. Evaluation of the precipitation field, associated errors, and sampling uncertainties is integral for development of efficient and reliable landslide forecasting and early warning system. This study develops a methodology to assess the viability of using a precipitation field provided by a global model and its potential integration in the landslide forecasting system. The study focuses on the comparison between the IMERG (Integrated Multi-satellitE Retrievals for Global Precipitation Mission) and GEOS (NASA Goddard Earth Observing System)-Forecast product over contiguous United States (CONUS). GEOS model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The framework is tested on the GEOS-Forecast Model initialized at 00 UTC using daily IMERG early product as reference using both categorical and continuous statistics. The categorical statistics includes the probability of detection (POD), success ratio (SR), critical success index (CSI), and the hit bias. Continuous statistics such as correlation, normalized standard deviation, and root-mean-square error are also evaluated. Overall, GEOS-Forecast precipitation field over the analysis period (~1 year) show underestimation with respect to IMERG early for the daily accumulated rainfall. However, the probability distribution function and cumulative distribution function of both show similar patterns. In terms of correlations, POD, SR, CSI, hit bias, the performance varies with respect to the rainfall threshold used.

Sana Khan↗
NASA NTRS1981

Yield Model Development (YMD) implementation plan for fiscal years 1981 and 1982

A plan is described for supporting USDA crop production forecasting and estimation by (1) testing, evaluating, and selecting crop yield models for application testing; (2) identifying areas of feasible research for improvement of models; and (3) conducting research to modify existing models and to develop new crop yield assessment methods. Tasks to be performed for each of these efforts are described as well as for project management and support. The responsibilities of USDA, USDC, USDI, and NASA are delineated as well as problem areas to be addressed.

Ambroziak, R. A.↗
NASA NTRS1981

Risk analysis of computer system designs

Adverse events during implementation can affect final capabilities, schedule and cost of a computer system even though the system was accurately designed and evaluated. Risk analysis enables the manager to forecast the impact of those events and to timely ask for design revisions or contingency plans before making any decision. This paper presents a structured procedure for an effective risk analysis. The procedure identifies the required activities, separates subjective assessments from objective evaluations, and defines a risk measure to determine the analysis results. The procedure is consistent with the system design evaluation and enables a meaningful comparison among alternative designs.

Vallone, A.↗
NASA NTRS2013

GPS Estimates of Integrated Precipitable Water Aid Weather Forecasters

Global Positioning System (GPS) meteorology provides enhanced density, low-latency (30-min resolution), integrated precipitable water (IPW) estimates to NOAA NWS (National Oceanic and Atmospheric Adminis tration Nat ional Weather Service) Weather Forecast Offices (WFOs) to provide improved model and satellite data verification capability and more accurate forecasts of extreme weather such as flooding. An early activity of this project was to increase the number of stations contributing to the NOAA Earth System Research Laboratory (ESRL) GPS meteorology observing network in Southern California by about 27 stations. Following this, the Los Angeles/Oxnard and San Diego WFOs began using the enhanced GPS-based IPW measurements provided by ESRL in the 2012 and 2013 monsoon seasons. Forecasters found GPS IPW to be an effective tool in evaluating model performance, and in monitoring monsoon development between weather model runs for improved flood forecasting. GPS stations are multi-purpose, and routine processing for position solutions also yields estimates of tropospheric zenith delays, which can be converted into mm-accuracy PWV (precipitable water vapor) using in situ pressure and temperature measurements, the basis for GPS meteorology. NOAA ESRL has implemented this concept with a nationwide distribution of more than 300 "GPSMet" stations providing IPW estimates at sub-hourly resolution currently used in operational weather models in the U.S.

Moore, Angelyn W.↗
NASA NTRS2014

Comparison of Climatological Planetary Boundary Layer Depth Estimates Using the GEOS-5 AGCM

Planetary boundary layer (PBL) processes, including those influencing the PBL depth, control many aspects of weather and climate and accurate models of these processes are important for forecasting changes in the future. However, evaluation of model estimates of PBL depth are difficult because no consensus on PBL depth definition currently exists and various methods for estimating this parameter can give results that differ by hundreds of meters or more. In order to facilitate comparisons between the Goddard Earth Observation System (GEOS-5) and other modeling and observational systems, seven PBL depth estimation methods are used to produce PBL depth climatologies and are evaluated and compared here. All seven methods evaluate the same atmosphere so all differences are related solely to the definition chosen. These methods depend on the scalar diffusivity, bulk and local Richardson numbers, and the diagnosed horizontal turbulent kinetic energy (TKE). Results are aggregated by climate class in order to allow broad generalizations. The various PBL depth estimations give similar midday results with some exceptions. One method based on horizontal turbulent kinetic energy produces deeper PBL depths in the winter associated with winter storms. In warm, moist conditions, the method based on a bulk Richardson number gives results that are shallower than those given by the methods based on the scalar diffusivity. The impact of turbulence driven by radiative cooling at cloud top is most significant during the evening transition and along several regions across the oceans and methods sensitive to this cooling produce deeper PBL depths where it is most active. Additionally, Richardson number-based methods collapse better at night than methods that depend on the scalar diffusivity. This feature potentially affects tracer transport.

Planetary Boundary Layer Depth↗
NASA NTRS2018

A Markov Decision Process Framework for Optimal Airport Reconfiguration

The airport runway configuration is defined as a combination set of runways for arrivals and departures used at a point during operation of the airport. An optimal configuration of these runways depends on a number of factors, including traffic demand, wind magnitude and direction, other adverse weather conditions, and noise restrictions, among others. Based on the current state of these factors and predictions of traffic demand and weather conditions, runway configuration changes are made and coordinated between tower controller, other air traffic control facilities, pilots, and ground personnel. Reconfigurations can be quite disruptive to airport operations; minimizing their frequency and scheduling them well in advance is essential for mitigating some of the added workload for controllers and pilots. Unfortunately, deciding on an appropriate time to change is challenging for human decision makers. Not only do multiple factors need to be evaluated, but the uncertainty in their forecasts must also be considered. Previous optimization methods, such as mixed linear integer programming, have been proposed. Although these methods can reason over a large set of variables, they do not systematically handle the uncertainty associated with weather movement, traffic demands, and other variables. In this work, we introduce a Markov Decision Process (MDP)-based decision making framework which can reason effectively over the inherent uncertainties and make optimal decisions on if/when to change the airport configuration. In a prototype implementation, we present a single runway with three aircraft and utilize knowledge of the forecasted wind speed and direction to determine whether to keep or change the current runway configuration. Our aim through this work is to present a framework for airport reconfiguration which can be scalable to additional aircraft, multiple runways, and various input parameters. This technique will optimize the airport reconfiguration procedure by providing a proactive approach, optimizing not just at the next optimal opportunity for a reconfiguration based on varying atmospheric and traffic conditions in the terminal airspace, but also anticipating future necessary reconfigurations. This will eliminate the inefficiencies of frequent changes currently associated with runway reconfiguration procedures.

runway reconfiguration↗