Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

An Extended Objective Evaluation of the 29-km Eta Model for Weather Support to the United States Space Program

This report describes the Applied Meteorology Unit's objective verification of the National Centers for Environmental Prediction 29-km eta model during separate warm and cool season periods from May 1996 through January 1998. The verification of surface and upper-air point forecasts was performed at three selected stations important for 45th Weather Squadron, Spaceflight Meteorology Group, and National Weather Service, Melbourne operational weather concerns. The statistical evaluation identified model biases that may result from inadequate parameterization of physical processes. Since model biases are relatively small compared to the random error component, most of the total model error results from day-to-day variability in the forecasts and/or observations. To some extent, these nonsystematic errors reflect the variability in point observations that sample spatial and temporal scales of atmospheric phenomena that cannot be resolved by the model. On average, Meso-Eta point forecasts provide useful guidance for predicting the evolution of the larger scale environment. A more substantial challenge facing model users in real time is the discrimination of nonsystematic errors that tend to inflate the total forecast error. It is important that model users maintain awareness of ongoing model changes. Such changes are likely to modify the basic error characteristics, particularly near the surface.

Nutter, Paul↗

A Systematic Review of Local to Regional Yield Forecasting Approaches and Frequently Used Data Resources

Forecasting crop yields, or providing an expectation of ex-ante harvest amounts, is highly relevant to the whole agricultural production chain. Farmers can adapt their management, traders or insurers their pricing schemes, suppliers their stocks, logistic companies their routes, national authorities their food balance sheets to guide import or export and, finally, international aid organizations can mobilize reliefs. Evidence has grown in the literature that such forecasts with a meaningful lead time are possible on various geographic scales and for a broad range of crops. Here, we present a systematic review of the methods applied in end-of-season yield forecasting and three frequently used data sources: weather data, satellite data and crop masks. Our literature database comprises 362 studies (2004–2019) which were evaluated regarding methods, crops, regions, data sources, lead time and performance. Moreover, we present 24 sources of real-time and predictive weather data, 21 sources of remote sensing data and 16 crop masks. Yield forecasting in our literature sample has been performed for 44 crops in 71 countries, also including many non-staple crops, but with an apparent bias in regions and crops. Forecasting performance depends on various factors, including crop, region, method, lead time to harvest and input diversity. Our systematic review supports a broader application of locally successful approaches at larger scales by providing a comprehensive, accessible compendium of necessary information for yield forecasting. We discuss improvement potentials with respect to methodological approaches and available data sources. We additionally suggest standardization procedures for future forecasting studies and encourage studying additional crops and geographic regions. Implications of forecasts for different target groups on different scales and the adaptation towards climate change are also discussed.

Seasonal crop yield forecasting↗

Evaluation of the Emergency Response Dose Assessment System(ERDAS)

The emergency response dose assessment system (ERDAS) is a protype software and hardware system configured to produce routine mesoscale meteorological forecasts and enhanced dispersion estimates on an operational basis for the Kennedy Space Center (KSC)/Cape Canaveral Air Station (CCAS) region. ERDAS provides emergency response guidance to operations at KSC/CCAS in the case of an accidental hazardous material release or an aborted vehicle launch. This report describes the evaluation of ERDAS including: evaluation of sea breeze predictions, comparison of launch plume location and concentration predictions, case study of a toxic release, evaluation of model sensitivity to varying input parameters, evaluation of the user interface, assessment of ERDA's operational capabilities, and a comparison of ERDAS models to the ocean breeze dry gultch diffusion model.

Evans, Randolph J.↗

Global Landslide Forecasting System for Hazard Assessment and Situational Awareness

Landslides triggered by extreme rainfall can be devastating, resulting in loss of life, property, and infrastructure. Landslide forecasting systems provide an opportunity to build awareness of potential hazards and ultimately take preemptive measures. There is currently a dearth of forecasting systems that provide regional or global coverage, but these systems can offer important situational awareness in data-sparse, ungauged, or large-scale catchments. A near global, primarily satellite-based system calledthe Landslide Hazard Assessment for Situational Awareness (LHASA) provides near real-time estimates of potential landslide hazard and exposure around the world. In this work, a precipitation forecast module is introduced into LHASA to complement the existing LHASA framework and provide an estimate of landslide hazard up to three days in advanceat 1km resolution. The model-based Goddard Earth Observing System-Forward Processing (GEOS-FP) precipitation forecast product is used as the forcing input for the model in place of the satellite-based Integrated Multi-satellitE Retrievals for Global Precipitation Mission product. Soil moisture and snow depth from the GEOS-FP assimilated product are also incorporated. The study period January 2020–January 2021 is usedto test the model performance against the LHASA near real-time estimates at multiple spatiotemporal scales. Validation of the model is carried out using a collection of rainfall-triggered landslide inventories from around the world as case studies to demonstrate the potential utility and limitations of this system.The rescaling of the GEOS-FP precipitation product is a critical step in incorporating the forecasted precipitation data within LHASA-Forecast (LHASA-F). Combining different streams of forecasted data within the LHASA-F framework shows promise, particularly for larger events at the 1-and 2-day lead time for events. Results indicate that for the case studies evaluated, the LHASA-F is generally able to resolve major landslide events triggered by extreme rainfall, such as from tropical cyclones. The analysis shows that landslide forecast outputs may be represented differently depending on the user’s needs. This framework serves as a first milestone in providing a global predictive view of landslide hazard.

Landslide forecasting system↗

Evaluation of Landsat image registration accuracy

The Large Area Crop Inventory Experiment (LACIE) is an attempt to demonstrate the capability to forecast the annual production of major crops such as wheat and corn. Good image registration of data acquired on different dates is one of the key assumptions made in LACIE. This paper describes an algorithm to measure the accuracy of the current registration procedure. This algorithm employs a modified version of sequential similarity detection algorithm (SSDA). Based on over 264 registration checks, it was found that the root-mean-square of registration errors was 1.0 pixel. The failure rate of our registration checking algorithm was less than 10 per cent and the standard deviation of the accuracy of this algorithm was less than 0.2 picture element.

Kaneko, T.↗

Diagnostic classification of flash drought events reveals distinct classes of forcings and impacts

Recent years have seen growing appreciation that rapidly intensifying flash droughts are significant climate hazards with major economic and ecological impacts. This has motivated efforts to inventory, monitor, and forecast flash drought events. Here we consider the question of whether the term “flash drought” comprises multiple distinct classes of event, which would imply that understanding and forecasting flash droughts might require more than one framework. To do this, we first extend and evaluate a soil moisture volatility–based flash drought definition that we introduced in previous work and use it to inventory the onset dates and severity of flash droughts across the contiguous United States (CONUS) for the period 1979–2018. Using this inventory, we examine meteorological and land surface conditions associated with flash drought onset and recovery. These same meteorological and land surface conditions are then used to classify the flash droughts based on precursor conditions that may represent predictable drivers of the event. We find that distinct classes of flash drought can be diagnosed in the event inventory. Specifically, we describe three classes of flash drought: “dry and demanding” events for which antecedent evaporative demand is high and soil moisture is low, “evaporative” events with more modest antecedent evaporative demand and soil moisture anomalies, but positive antecedent evaporative anomalies, and “stealth” flash droughts, which are different from the other two classes in that precursor meteorological anomalies are modest relative to the other classes. The three classes exhibit somewhat different geographic and seasonal distributions. We conclude that soil moisture flash droughts are indeed a composite of distinct types of rapidly intensifying droughts, and that flash drought analyses and forecasts would benefit from approaches that recognize the existence of multiple phenomenological pathways.

Mahmoud Osman↗

Early Transition and Use of VIIRS and GOES-R Products by NWS Forecast Offices

The Visible Infrared Imaging Radiometer Suite (VIIRS) on the NPOESS Preparatory Project (NPP) satellite, part of the Joint Polar Satellite System (JPSS), and the ABI and GLM sensors scheduled for the GOES-R geostationary satellite will bring advanced observing capabilities to the operational weather community. The NASA Short-term Prediction Research and Transition (SPoRT) project at Marshall Space Flight Center has been facilitating the use of real-time experimental and research satellite data by NWS Weather Forecast Offices (WFOs) for a number of years to demonstrate the planned capabilities of future sensors to address particular forecast challenges through improve situational awareness and short-term weather forecasts. For the NOAA GOES-R Proving Ground (PG) activity, SPoRT is developing and disseminating selected GOES-R proxy products to collaborating WFOs and National Centers. SPoRT developed the a pseudo-Geostationary Lightning Mapper product and helped in the transition of the Algorithm Working Group (AWG) Convective Initiation (CI) proxy product for the Hazardous Weather Testbed (HWT) Spring Experiment,. Along with its partner WFOs, SPoRT is evaluating MODIS/GOES Hybrid products, which brings ABI-like data sets from existing NASA instrumentation in front of the forecaster for everyday use. The Hybrid uses near real-time MODIS imagery to demonstrate future ABI capabilities, while utilizing standard GOES imagery to provide the temporal frequency of geostationary imagery expected by operational forecasters. In addition, SPoRT is collaborating with the GOES-R hydrology AWG to transition a baseline proxy product for rainfall rate / quantitative precipitation estimate (QPE) to the OCONUS regions. For VIIRS, SPoRT is demonstrating multispectral observing capabilities and the utility of low-light channels not previously available on operational weather satellites to address a variety of weather forecast challenges. This presentation will discuss the results of transitioning these products to collaborating WFOs throughout the country.

Fuell, Kevin K.↗

Cost reductions through earth resource satellites in developed countries

Data from detailed studies on the possible economic impact of the use of remote sensing technology in industry and agriculture are presented and analyzed. The utility of satellite surveillance in reduction of crop production forecast error, recognition and monitoring of crop diseases and insect infestations, and range management is evaluated. Application of satellite maps to facilitate land resource decisions, mineral exploration, geological studies, and water resource inventories is considered, as is the usefulness of early storm warning in the reduction of property damage. The cost of remote sensing is compared to that of conventional methods whenever possible.

Schweickart, R. L.↗

LDEF: Dosimetric measurement results (AO 138-7 experiment)

One of the objectives of the AO 138-7 experiment on board the LDEF was a total dose measurement with Thermo Luminescent Detectors (TLD 100). Two identical cases, both including 5 TLDs inside various aluminum shields, are exposed to the space environment in order to obtain the absorbed dose profile induced. Radiation fluence received during the total mission length was computed, taking into account the trapped particles (solar maximum and solar minimum periods) and the cosmic rays; due to the magnetospheric shielding, the solar proton fluences are negligible on the LDEF orbit. The total dose induced by these radiations inside a semi-infinite plane shield of Al are computed with radiation transport codes. TLD reading are performed after flight; due to the mission duration increase, a post-flight calibration was necessary in order to cover the range of the flight induced dose. The results obtained, similar (+ or - 30 pct.) in both cases, are compared with the dose profile computation. In practice, these LDEF results, with less than a factor 1.4 between measurements and forecasts, reinforce the validity of the computation methods and models used for the long term evaluation of space radiation intensity on low inclination Earth orbits.

Bourrieau, J.↗

Seasonal Atmospheric and Oceanic Predictions

Several projects associated with dynamical, statistical, single column, and ocean models are presented. The projects include: 1) Regional Climate Modeling; 2) Statistical Downscaling; 3) Evaluation of SCM and NSIPP AGCM Results at the ARM Program Sites; and 4) Ocean Forecasts.

Roads, John↗

Satellite Data of Atmospheric Pollution for U.S. Air Quality Applications: Examples of Applications, Summary of Data End-user Resources, Answers to Faqs, and Common Mistakes to Avoid

Satellite data of atmospheric pollutants are becoming more widely used in the decision-making and environmental management activities of public, private sector and non-profit organizations. They are employed for estimating emissions, tracking pollutant plumes, supporting air quality forecasting activities, providing evidence for "exceptional event" declarations, monitoring regional long-term trends, and evaluating air quality model output. However, many air quality managers are not taking full advantage of the data for these applications nor has the full potential of satellite data for air quality applications been realized. A key barrier is the inherent difficulties associated with accessing, processing, and properly interpreting observational data. A degree of technical skill is required on the part of the data end-user, which is often problematic for air quality agencies with limited resources. Therefore, we 1) review the primary uses of satellite data for air quality applications, 2) provide some background information on satellite capabilities for measuring pollutants, 3) discuss the many resources available to the end-user for accessing, processing, and visualizing the data, and 4) provide answers to common questions in plain language.

remote sensing↗

Analysis and Prediction of Weather Impacted Ground Stop Operations

When the air traffic demand is expected to exceed the available airport's capacity for a short period of time, Ground Stop (GS) operations are implemented by Federal Aviation Administration (FAA) Traffic Flow Management (TFM). The GS requires departing aircraft meeting specific criteria to remain on the ground to achieve reduced demands at the constrained destination airport until the end of the GS. This paper provides a high-level overview of the statistical distributions as well as causal factors for the GSs at the major airports in the United States. The GS's character, the weather impact on GSs, GS variations with delays, and the interaction between GSs and Ground Delay Programs (GDPs) at Newark Liberty International Airport (EWR) are investigated. The machine learning methods are used to generate classification models that map the historical airport weather forecast, schedule traffic, and other airport conditions to implemented GS/GDP operations and the models are evaluated using the cross-validations. This modeling approach produced promising results as it yielded an 85% overall classification accuracy to distinguish the implemented GS days from the normal days without GS and GDP operations and a 71% accuracy to differentiate the GS and GDP implemented days from the GDP only days.

Analysis↗

Improved Rainfall Estimates and Predictions for 21st Century Drought Early Warning

As temperatures increase, the onset and severity of droughts is likely to become more intense. Improved tools for understanding, monitoring and predicting droughts will be a key component of 21st century climate adaption. The best drought monitoring systems will bring together accurate precipitation estimates with skillful climate and weather forecasts. Such systems combine the predictive power inherent in the current land surface state with the predictive power inherent in low frequency ocean-atmosphere dynamics. To this end, researchers at the Climate Hazards Group (CHG), in collaboration with partners at the USGS and NASA, have developed i) a long (1981-present) quasi-global (50degS-50degN, 180degW-180degE) high resolution (0.05deg) homogenous precipitation data set designed specifically for drought monitoring, ii) tools for understanding and predicting East African boreal spring droughts, and iii) an integrated land surface modeling (LSM) system that combines rainfall observations and predictions to provide effective drought early warning. This talk briefly describes these three components. Component 1: CHIRPS The Climate Hazards group InfraRed Precipitation with Stations (CHIRPS), blends station data with geostationary satellite observations to provide global near real time daily, pentadal and monthly precipitation estimates. We describe the CHIRPS algorithm and compare CHIRPS and other estimates to validation data. The CHIRPS is shown to have high correlation, low systematic errors (bias) and low mean absolute errors. Component 2: Hybrid statistical-dynamic forecast strategies East African droughts have increased in frequency, but become more predictable as Indo- Pacific SST gradients and Walker circulation disruptions intensify. We describe hybrid statistical-dynamic forecast strategies that are far superior to the raw output of coupled forecast models. These forecasts can be translated into probabilities that can be used to generate bootstrapped ensembles describing future climate conditions. Component 3: Assimilation using LSMs CHIRPS rainfall observations (component 1) and bootstrapped forecast ensembles (component 2) can be combined using LSMs to predict soil moisture deficits. We evaluate the skill such a system in East Africa, and demonstrate results for 2013.

Funk, Chris↗

Satellite Data of Atmospheric Pollution for U.S. Air Quality Applications: Examples of Applications, Summary of Data End-User Resources, Answers to FAQs, and Common Mistakes to Avoid

Satellite data of atmospheric pollutants are becoming more widely used in the decision-making and environmental management activities of public, private sector and non-profit organizations. They are employed for estimating emissions, tracking pollutant plumes, supporting air quality forecasting activities, providing evidence for "exceptional event" declarations, monitoring regional long-term trends, and evaluating air quality model output. However, many air quality managers are not taking full advantage of the data for these applications nor has the full potential of satellite data for air quality applications been realized. A key barrier is the inherent difficulties associated with accessing, processing, and properly interpreting observational data. A degree of technical skill is required on the part of the data end-user, which is often problematic for air quality agencies with limited resources. Therefore, we 1) review the primary uses of satellite data for air quality applications, 2) provide some background information on satellite capabilities for measuring pollutants, 3) discuss the many resources available to the end-user for accessing, processing, and visualizing the data, and 4) provide answers to common questions in plain language.

Duncan, Bryan↗

Improved Rainfall Estimates and Predictions for 21st Century Drought Early Warning

As temperatures increase, the onset and severity of droughts is likely to become more intense. Improved tools for understanding, monitoring and predicting droughts will be a key component of 21st century climate adaption. The best drought monitoring systems will bring together accurate precipitation estimates with skillful climate and weather forecasts. Such systems combine the predictive power inherent in the current land surface state with the predictive power inherent in low frequency ocean-atmosphere dynamics. To this end, researchers at the Climate Hazards Group (CHG), in collaboration with partners at the USGS and NASA, have developed i) a long (1981-present) quasi-global (50degS-50degN, 180degW-180degE) high resolution (0.05deg) homogenous precipitation data set designed specifically for drought monitoring, ii) tools for understanding and predicting East African boreal spring droughts, and iii) an integrated land surface modeling (LSM) system that combines rainfall observations and predictions to provide effective drought early warning. This talk briefly describes these three components. Component 1: CHIRPS The Climate Hazards group InfraRed Precipitation with Stations (CHIRPS), blends station data with geostationary satellite observations to provide global near real time daily, pentadal and monthly precipitation estimates. We describe the CHIRPS algorithm and compare CHIRPS and other estimates to validation data. The CHIRPS is shown to have high correlation, low systematic errors (bias) and low mean absolute errors. Component 2: Hybrid statistical-dynamic forecast strategies East African droughts have increased in frequency, but become more predictable as Indo- Pacific SST gradients and Walker circulation disruptions intensify. We describe hybrid statistical-dynamic forecast strategies that are far superior to the raw output of coupled forecast models. These forecasts can be translated into probabilities that can be used to generate bootstrapped ensembles describing future climate conditions. Component 3: Assimilation using LSMs CHIRPS rainfall observations (component 1) and bootstrapped forecast ensembles (component 2) can be combined using LSMs to predict soil moisture deficits. We evaluate the skill such a system in East Africa, and demonstrate results for 2013.

Funk, Chris↗

Microphysics and Radiation Effect of Dust on Saharan Air Layer: An HS3 Case Study

A Saharan air layer (SAL) event associated with a nondeveloping African easterly wave (AEW) over the main development region of the eastern Atlantic was sampled by the NASA Global Hawk aircraft on 24-25 August 2013 during the NASA Hurricane and Severe Storm Sentinel (HS3) campaign and was simulated with the NASA Unified Weather Research and Forecasting (NU-WRF) Model. Airborne, ground-based, and spaceborne measurements were used to evaluate the model performance. The microphysical and radiative effects of dust and other aerosols on the SAL structure and environment were investigated with the factor-separation method. The results indicate that relative to a simulation without dust-radiative and microphysical impacts, Saharan dust and other aerosols heated the SAL air mainly through shortwave heating by the direct aerosol-radiation (AR) effect, resulting in a warmer (up to 0.6 K) and drier (up to 5% RH reduction) SAL and maintaining the strong temperature inversion at the base of the SAL in the presence of predominant longwave cooling. Radiative heating of the dust accentuated a vertical circulation within the dust layer, in which air rose (sank) in the northern (southern) portions of the dust layer. Furthermore, above and to the south of the dust layer, both the microphysical and radiative impacts of dust tended to counter the vertical motions associated with the Hadley circulation, causing a small weakening and southward shift of convection in the intertropical convergence zone (ITCZ) and reduced anvil cloud to the north. Changes in moisture and cloud/precipitation hydrometeors were largely driven by the dust induced changes in vertical motion. Dust strengthened the African easterly jet by up to ~1ms(exp -1) at the southern edge of the jet, primarily through the AR effect, and produced modest increases in vertical wind shear within and in the vicinity of the dust layer. These modulations of the SAL and AEW environment clearly contributed to the nondevelopment of this AEW.

Tao, Zhining↗

Flight Awareness Collaboration Tool Development

NASA is developing the Flight Awareness Collaboration Tool (FACT) to support airline and airport operations during winter storms. The goal is to reduce flight delays and cancellations due to winter weather. FACT concentrates relevant information from the Internet and FAA databases on one screen for easy access. It provides collaboration tools for those managing the winter weather event including the airline operations center, airport authority (runway treatment), the Federal Aviation Administration air traffic control tower, and de-icing operators. Prediction tools are being added to improve FACT capabilities including one that anticipates changes in airport departure rates from weather forecasts. We have formed two user teams from affected airports to guide the design and evaluate the web-based prototype. Future work includes adding more automated capabilities and conducting a simulation to evaluate FACT in a realistic environment.

Mogford, Richard↗

Flight Awareness Collaboration Tool Development

NASA is developing the Flight Awareness Collaboration Tool (FACT) to support airline and airport operations during winter storms. The goal is to reduce flight delays and cancellations due to winter weather. FACT concentrates relevant information from the Internet and FAA databases on one screen for easy access. It provides collaboration tools for those managing the winter weather event including the airline operations center, airport authority (runway treatment), the Federal Aviation Administration air traffic control tower, and de-icing operators. Prediction tools are being added to improve FACT capabilities including one that anticipates changes in airport departure rates from weather forecasts. We have formed two user teams from affected airports to guide the design and evaluate the web-based prototype. Future work includes adding more automated capabilities and conducting a simulation to evaluate FACT in a realistic environment.

Mogford, Richard↗