Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Hurricane Wind Field Measurements with Scanning Airborne Doppler Lidar During CAMEX-3

During the 1998 Convection and Moisture Experiment (CAMEX-3), the first hurricane wind field measurements with Doppler lidar were achieved. Wind fields were mapped within the eye, along the eyewall, in the central dense overcast, and in the marine boundary layer encompassing the inflow region. Spatial coverage was determined primarily by cloud distribution and opacity. Within optically-thin cirrus slant range of 20- 25 km was achieved, whereas no propagation was obtained during penetration of dense cloud. Measurements were obtained with the Multi-center Airborne Coherent Atmospheric Wind Sensor (MACAWS) on the NASA DC-8 research aircraft. MACAWS was developed and operated cooperatively by the atmospheric lidar remote sensing groups of NOAA Environmental Technology Laboratory, NASA Marshall Space Flight Center, and Jet Propulsion Laboratory. A pseudo-dual Doppler technique ("co-planar scanning") is used to map the horizontal component of the wind at several vertical levels. Pulses from the laser are directed out the left side of the aircraft in the desired directions using computer-controlled rotating prisms. Upon exiting the aircraft, the beam is completely eyesafe. Aircraft attitude and speed are taken into account during real-time signal processing, resulting in determination of the ground-relative wind to an accuracy of about 1 m/s magnitude and about 10 deg direction. Beam pointing angle errors are about 0.1 deg, equivalent to about 17 m at 10 km. Horizontal resolution is about 1 km (along-track) for typical signal processor and scanner settings; vertical resolution varies with range. Results from CAMEX-3 suggest that scanning Doppler wind lidar can complement airborne Doppler radar by providing wind field measurements in regions that are devoid of hydrometeors. At present MACAWS observations are being assimilated into experimental forecast models and satellite Doppler wind lidar simulations to evaluate the relative impact.

Rothermel, Jeffry↗

The Impact of TRMM Data on Mesoscale Numerical Simulation of Super Typhoon Paka

Accurate measurement of the spatial and temporal variations of tropical rainfall around the globe had remained as a critical problem in meteorology until the recent launch of the Tropical Rainfall Measuring Mission (TRMM). TRMM offers a unique opportunity to improve understanding of tropical meteorology and also offers a great opportunity to evaluate the impact of rainfall data on tropical weather forecasts. This study assesses the impact of TRMM Microwave Imager (TMI) derived surface rainfall data on the numerical simulation of Super Typhoon Paka (1997).

Pu, Zhao-Xia↗

Developing a Customizable Composite Drought Index for Pakistan

Pakistan has experienced intense agricultural droughts in recent years, with the southern provinces experiencing the most severe drought conditions. These prolonged dry conditions often result in failed crop production, impacting families and communities. To reduce the impacts a drought may have on a community by identifying dry conditions, drought indices are used. A customizable composite drought index (CDI) is developed to improve the spatial and temporal understanding of historical agricultural droughts that have affected Pakistan. An in depth analysis using 9 input variables will provide information regarding the most important variables for differing locations. This framework can enhance drought monitoring and forecasting systems. The performance of the CDI will be evaluated by using production data from different crops that have significant economic value in Pakistan. These crops include wheat, rice, maize, cotton and barley. The expected relationship between the CDI and crop production would be to see production decrease when the CDI decreases, an indication that crops failed due to drought. The CDI is made more precise by evaluating only agricultural areas using the months of the growing season for each specific crop. This will allow for a custom drought index to be developed based on crop type and geographic location that only uses the most important variables, while still capturing the full extent of historical drought.

Caily Schwartz↗

Enabling Exchange and Adequate Use of Data for Observation Based Atmospheric Research

Systematic long-term field observations have played a vital role in advancing atmospheric research over the past several decades. The use of these observations has expanded from primarily characterizing atmospheric processes and trends to evaluating satellite measurements, assessing models, and improving air quality forecasts. Consequently, the demand for atmospheric chemistry observational data have dramatically increased in terms of scope and coverage of measurements (i.e., parameters/species, spatiotemporal extent). In addition to high quality measurements, certain data reporting standards need to be agreed to ensure the data can be readily exchanged and are sufficiently documented to enable adequate use in different research activities. To this end, WMO has developed and implemented measurement guidelines and community practices for meteorology, climatology, atmospheric and hydrological sciences. In addition, the WMO Expert Team on Metadata Standards manages and evolves the existing metadata standards for the WMO Information System WIS and WMO Integrated Global Observing System WIGOS to support consistent and interoperable data descriptions, ensure relevance to research, and to apply data science principles. This team draws on a wide range of expertise from the research community, including atmospheric measurements, modeling, data management, and data science. The current activities include development of key performance indicators, vocabularies for metadata and the evolution of metadata standards to lower the barrier of application to weather/climate/water/environment data for all communities and the weather enterprise. This presentation intends to promote awareness of ongoing progress and actively solicit community feedback.

Field Observations↗

Implementation of a Discrete Dipole Approximation Scattering Database into Community Radiative Transfer Model

The Community Radiative Transfer Model (CRTM) is a fast model that requires bulk optical properties of hydrometeors in the form of lookup tables to simulate all-sky satellite radiances. Current cloud scattering lookup tables of CRTM were generated using the Mie-Lorenz theory thus assuming spherical shapes for all frozen habits, while actual clouds contain frozen hydrometeors with different shapes. The Discrete Dipole Approximation (DDA) technique is an effective technique for simulating the optical properties of non-spherical hydrometeors in the microwave region. This paper discusses the implementation and validation of a comprehensive DDA cloud scattering database into CRTM for the microwave frequencies. The original DDA database assumes total random orientation in the calculation of single scattering properties. The mass scattering parameters required by CRTM were then computed from single scattering properties and water content dependent particle size distributions. The new lookup tables eliminate the requirement for providing the effective radius as input to CRTM by using the cloud water content for the mass dimension. A collocated dataset of short-term forecasts from Integrated Forecast System of the European Centre for Medium-Range Weather Forecasts and satellite microwave data was used for the evaluation of results. The results overall showed that the DDA lookup tables, in comparison with the Mie tables, greatly reduce the differences among simulated and observed values. The Mie lookup tables especially introduce excessive scattering for the channels operating below 90 GHz and low scattering for the channels above 90 GHz.

Discrete dipole↗

Evaluation of the Impact of AIRS Radiance and Profile Data Assimilation in Partly Cloudy Regions

Improvements to global and regional numerical weather prediction have been demonstrated through assimilation of data from NASA s Atmospheric Infrared Sounder (AIRS). Current operational data assimilation systems use AIRS radiances, but impact on regional forecasts has been much smaller than for global forecasts. Retrieved profiles from AIRS contain much of the information that is contained in the radiances and may be able to reveal reasons for this reduced impact. Assimilating AIRS retrieved profiles in an identical analysis configuration to the radiances, tracking the quantity and quality of the assimilated data in each technique, and examining analysis increments and forecast impact from each data type can yield clues as to the reasons for the reduced impact. By doing this with regional scale models individual synoptic features (and the impact of AIRS on these features) can be more easily tracked. This project examines the assimilation of hyperspectral sounder data used in operational numerical weather prediction by comparing operational techniques used for AIRS radiances and research techniques used for AIRS retrieved profiles. Parallel versions of a configuration of the Weather Research and Forecasting (WRF) model with Gridpoint Statistical Interpolation (GSI) are run to examine the impact AIRS radiances and retrieved profiles. Statistical evaluation of a long-term series of forecast runs will be compared along with preliminary results of in-depth investigations for select case comparing the analysis increments in partly cloudy regions and short-term forecast impacts.

Zavodsky, Bradley↗

Technology requirements for communication satellites in the 1980's

The key technology requirements are defined for meeting the forecasted demands for communication satellite services in the 1985 to 1995 time frame. Evaluation is made of needs for services and technical and functional requirements for providing services. The future growth capabilities of the terrestrial telephone network, cable television, and satellite networks are forecasted. The impact of spacecraft technology and booster performance and costs upon communication satellite costs are analyzed. Systems analysis techniques are used to determine functional requirements and the sensitivities of technology improvements for reducing the costs of meeting requirements. Recommended development plans and funding levels are presented, as well as the possible cost saving for communications satellites in the post 1985 era.

Burtt, J. E.↗

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Assessment Report for the Beta-Release L4_SM Data Product - Volume 40

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public beta release scheduled for 30 October 2015. The primary objective of the beta release is to allow users to familiarize themselves with the data product before the validated product becomes available. The beta release also allows users to conduct their own assessment of the data and to provide feedback to the L4_SM science data product team. The assessment of the L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 1 validation and supports the beta release of the data. The validation against sparse network measurements and the evaluation of the assimilation diagnostics address Stage 2 validation criteria by expanding the assessment to regional and global scales.

ubRMSE↗

Survey of air cargo forecasting techniques

Forecasting techniques currently in use in estimating or predicting the demand for air cargo in various markets are discussed with emphasis on the fundamentals of the different forecasting approaches. References to specific studies are cited when appropriate. The effectiveness of current methods is evaluated and several prospects for future activities or approaches are suggested. Appendices contain summary type analyses of about 50 specific publications on forecasting, and selected bibliographies on air cargo forecasting, air passenger demand forecasting, and general demand and modalsplit modeling.

Kuhlthan, A. R.↗

Financial options methodology for analyzing investments in new technology

The evaluation of investments in longer term research and development in emerging technologies, because of the nature of such subjects, must address inherent uncertainties. Most notably, future cash flow forecasts include substantial uncertainties. Conventional present value methodology, when applied to emerging technologies severely penalizes cash flow forecasts, and strategic investment opportunities are at risk of being neglected. Use of options evaluation methodology adapted from the financial arena has been introduced as having applicability in such technology evaluations. Indeed, characteristics of superconducting magnetic energy storage technology suggest that it is a candidate for the use of options methodology when investment decisions are being contemplated.

Wenning, B. D.↗

Evaluation of the CEAS trend and monthly weather data models for soybean yields in Iowa, Illinois, and Indiana

The CEAS models evaluated use historic trend and meteorological and agroclimatic variables to forecast soybean yields in Iowa, Illinois, and Indiana. Indicators of yield reliability and current measures of modeled yield reliability were obtained from bootstrap tests on the end of season models. Indicators of yield reliability show that the state models are consistently better than the crop reporting district (CRD) models. One CRD model is especially poor. At the state level, the bias of each model is less than one half quintal/hectare. The standard deviation is between one and two quintals/hectare. The models are adequate in terms of coverage and are to a certain extent consistent with scientific knowledge. Timely yield estimates can be made during the growing season using truncated models. The models are easy to understand and use and are not costly to operate. Other than the specification of values used to determine evapotranspiration, the models are objective. Because the method of variable selection used in the model development is adequately documented, no evaluation can be made of the objectivity and cost of redevelopment of the model.

French, V.↗

Review of Hydrologic Models for Evaluating Use of Remote Sensing Capabilities

Hydrologic models most commonly used by federal agencies for hydrologic forecasting are reviewed. Six catchment models and one snow accumulation and ablation model are reviewed. Information on the structure, parameters, states, and required inputs is presented in schematic diagrams and in tables. The primary and secondary roles of parameters and state variables with respect to their function in the models are identified. The information will be used to evaluate the usefulness of remote sensing capabilities in the operational use of hydrologic models.

Peck, E. L.↗

Impact of Land Surface Initialization Approach on Subseasonal Forecast Skill: a Regional Analysis in the Southern Hemisphere

The authors use a sophisticated coupled land-atmosphere modeling system for a Southern Hemisphere subdomain centered over southeastern Australia to evaluate differences in simulation skill from two different land surface initialization approaches. The first approach uses equilibrated land surface states obtained from offline simulations of the land surface model, and the second uses land surface states obtained from reanalyses. The authors find that land surface initialization using prior offline simulations contribute to relative gains in subseasonal forecast skill. In particular, relative gains in forecast skill for temperature of 10%-20% within the first 30 days of the forecast can be attributed to the land surface initialization method using offline states. For precipitation there is no distinct preference for the land surface initialization method, with limited gains in forecast skill irrespective of the lead time. The authors evaluated the asymmetry between maximum and minimum temperatures and found that maximum temperatures had the largest gains in relative forecast skill, exceeding 20% in some regions. These results were statistically significant at the 98% confidence level at up to 60 days into the forecast period. For minimum temperature, using reanalyses to initialize the land surface contributed to relative gains in forecast skill, reaching 40% in parts of the domain that were statistically significant at the 98% confidence level. The contrasting impact of the land surface initialization method between maximum and minimum temperature was associated with different soil moisture coupling mechanisms. Therefore, land surface initialization from prior offline simulations does improve predictability for temperature, particularly maximum temperature, but with less obvious improvements for precipitation and minimum temperature over southeastern Australia.

Precipitation↗

Investigating the Strength and Variability of El Niño Southern Oscillation Teleconnections to Hydroclimate and Maize Yields in Southern and East Africa

The state of the El Niño Southern Oscillation (ENSO) is critical for seasonal climate forecasts, but recent events diverged substantially from expectations in many regions, including Sub-Saharan Africa where seasonal forecasts are critical tools for addressing food security. Here, we evaluate 39 years (1982–2020) of data on hydroclimate, leaf area index, and maize yields to investigate the strength of ENSO teleconnections in southern and East Africa. Teleconnections to precipitation, soil moisture, and leaf area index are generally stronger during ENSO phases that cause drought conditions (El Niño in southern Africa and La Niña in East Africa), with seasonality that aligns well with the maize growing seasons. Within maize growing areas, however, ENSO teleconnections to hydroclimate and vegetation are generally weaker compared to the broader geographic regions, especially in East Africa. There is also little evidence that the magnitude of the ENSO event affects the hydroclimate or vegetation response in these maize regions. Maize yields in Kenya, Malawi, South Africa, and Zimbabwe all correlate significantly with hydroclimate and leaf area index, with South Africa and Zimbabwe showing the strongest and most consistent yield responses to ENSO events. Our results highlight the chain of causality from El Niño and La Niña forcing of regional anomalies in hydroclimate to vegetation health and maize yields in southern and East Africa. The large spread across individual ENSO events, however, underscores the limitations of this climate mode for seasonal climate prediction in the region, and the importance of finding additional sources of skill for improving climate and yield forecasts.

El Niño Southern Oscillation↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavordsky, Bradley↗

Development and Implementation of Dynamic Scripts to Support Local Model Verification at National Weather Service Weather Forecast Offices

Local modeling with a customized configuration is conducted at National Weather Service (NWS) Weather Forecast Offices (WFOs) to produce high-resolution numerical forecasts that can better simulate local weather phenomena and complement larger scale global and regional models. The advent of the Environmental Modeling System (EMS), which provides a pre-compiled version of the Weather Research and Forecasting (WRF) model and wrapper Perl scripts, has enabled forecasters to easily configure and execute the WRF model on local workstations. NWS WFOs often use EMS output to help in forecasting highly localized, mesoscale features such as convective initiation, the timing and inland extent of lake effect snow bands, lake and sea breezes, and topographically-modified winds. However, quantitatively evaluating model performance to determine errors and biases still proves to be one of the challenges in running a local model. Developed at the National Center for Atmospheric Research (NCAR), the Model Evaluation Tools (MET) verification software makes performing these types of quantitative analyses easier, but operational forecasters do not generally have time to familiarize themselves with navigating the sometimes complex configurations associated with the MET tools. To assist forecasters in running a subset of MET programs and capabilities, the Short-term Prediction Research and Transition (SPoRT) Center has developed and transitioned a set of dynamic, easily configurable Perl scripts to collaborating NWS WFOs. The objective of these scripts is to provide SPoRT collaborating partners in the NWS with the ability to evaluate the skill of their local EMS model runs in near real time with little prior knowledge of the MET package. The ultimate goal is to make these verification scripts available to the broader NWS community in a future version of the EMS software. This paper provides an overview of the SPoRT MET scripts, instructions for how the scripts are run, and example use cases.

Zavodsky, Bradley↗

Stratospheric Analysis and Forecasting in the Northern Winter of 1999/2000: The NASA DAO's GEOS-3 System

An evaluation is presented of the performance in the northern winter 1999/2000 of the GEOS-3 troposphere-stratosphere data assimilation system (DAS). The impacts of the two main input data types are assessed: upper-air soundings (sondes) provide wind and temperature information and satellite-based (Tiros Operational Vertical Sounders: TOVS) give estimates of the thermal structure. It is shown that in the low stratosphere (300-70hPa) the analyses are generally slightly warmer than the sonde data, but colder than the TOVS data; this relationship reverses between 70 and 10 hPa. There are geographical biases, related to the spatial and temporal coverage of the observation types and to the statistical weights assigned to them in the DAS. Forecasts show a tendency to reduce zonal asymmetries in the atmospheric flow and to suppress stratospheric temperature minima. In the DAS, the analysis increments compensate for this, but it leads to important biases in the multi-day forecasts. The analysis increments are as large as the diabatic forcing in the lower polar stratosphere, indicating a substantial model bias. The results provide important insights into the roles of different data types and the circulation model in producing accurate analyses for studies of polar chemistry and physical processes.

Pawson, Steven↗