Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Quantifying the Turbulent Entrainment‐Mixing Processes Based on Z ‐LWC Relationships of Cloud Droplets

Abstract Turbulent entrainment‐mixing processes profoundly influence the relationship between radar reflectivity factor and liquid water content ( Z ‐LWC) of cloud droplets. However, quantification of the entrainment‐mixing mechanisms based on the Z ‐LWC relationship is still lacking. To address this gap, 12,218 entrainment‐mixing cases are simulated using the Explicit Mixing Parcel Model. We examine the variations of the parameters in the power‐law relationship Z = a LWC b , and the relationship between parameter b and homogeneous mixing degree ( ψ ), a measure quantifying entrainment‐mixing processes. The results indicate that parameter b distributes within the range of 1–2, with a positive correlation between parameter b and ψ . The b ‐ ψ relationship is fitted, which connects the Z ‐LWC relationship for various entrainment‐mixing types. The results suggest the potential for employing a remote sensing approach to investigate the entrainment‐mixing mechanisms of non‐precipitating small cumulus/stratocumulus clouds, thereby overcoming the limitations of traditional observational studies that rely solely on aircraft observations.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1998

Total Lightning and Radar Storm Characteristics Associated with Severe Storms in Central Florida

This paper examines the three dimensional characteristics of lightning flashes and severe storms observed in Central Florida during 1997-1998. The lightning time history of severe and tornadic storms were captured during the on-going ground validation campaign supporting the Lightning Imaging Sensor (LIS) experiment on the Tropical Rainfall Measuring Mission (TRMM). The ground validation campaign is a collaborative experiment that began in 1997 and involves scientists at the Global Hydrology and Climate Center, MIT/Lincoln Laboratories, and the NWS Forecast Office at Melbourne, FL. Lightning signatures that may provide potential early warning of severe storms are being evaluated by the forecasters at the NWS/MLB office. Severe storms with extreme flash rates sometimes exceeding 300 per minute and accompanying rapid increases in flash rate prior to the onset of the severe weather (hall, damaging winds, tornadoes) have been reported by Hodanish et al. and Williams et al. (1998-this conference). We examine the co-evolving changes in storm structure (mass, echo top, shear, latent heat release) and kinematics associated with these extreme and rapid flash rate changes over time. The flash frequency and density are compared with the three dimensional radar reflectivity structure of the storm to help interpret the possible mechanisms producing the extreme and rapidly increasing flash rates. For two tornadic storms examined thus far, we find the burst of lightning is associated with the development of upper level rotation in the storm. In one case, the lightning burst follows the formation of a bounded weak echo region (BWER). The flash rates diminish with time as the rotation develops to the ground in conjunction with the decent of the reflectivity core. Our initial findings suggest the dramatic increase of flash rates is associated with a sudden and dramatic increase in storm updraft intensity which we hypothesize is stretching vertical vorticity as well as enhancing the development of the mixed phase region of the storm. We discuss the importance of these factors in producing both the observed extreme flash rates and the severe weather that follows in these storms and others to be presented.

Goodman, Steven J↗
DOE OSTI2025

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Surface Energy Balance Responses to Radiative Forcing in the Central Arctic From MOSAiC and Models

The Arctic surface energy budget (SEB) couples the atmosphere with the sea ice, making it useful for both studying surface processes as well as evaluating models. Improved understanding of atmosphere-ice interactions is required to improve models, requiring year-round observations to address seasonally dependent biases. This work uses novel observations from the MOSAiC expedition to quantify the responses of surface fluxes to radiative forcing over sea ice throughout a complete annual cycle. We identify two primary regimes of flux response: an ice growth regime in winter and an ice melt regime in summer. In the growth regime, changes in radiative forcing impact upwelling longwave, sensible heat, and subsurface heat fluxes, whereas in the melt regime changes in radiative forcing primarily alter the amount of melt and subsurface transmission because the surface temperature is fixed. These observed responses of surface fluxes to radiative forcing are used to evaluate seven weather forecast models during the ice growth regime. In most models, the responses of surface fluxes to radiative forcing do not match observations. Many models also have biased downwelling longwave. One model (the Coupled Arctic Forecast System; CAFS) adequately captures both the mean radiative forcing and the flux responses in winter. CAFS is further evaluated against observations spanning the full MOSAiC year, demonstrating sufficient agreement to provide a more generalized understanding of these SEB process relationships across the Arctic.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-solar ensemble prediction system and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Database observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by considering the uncertainty of each ensemble member. The analog ensemble calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes, such as reliability and statistical consistency.

14 SOLAR ENERGY↗
NASA NTRS2012

Preliminary Results of a U.S. Deep South Warm Season Deep Convective Initiation Modeling Experiment using NASA SPoRT Initialization Datasets for Operational National Weather Service Local Model Runs

The initiation of deep convection during the warm season is a forecast challenge in the relative high instability and low wind shear environment of the U.S. Deep South. Despite improved knowledge of the character of well known mesoscale features such as local sea-, bay- and land-breezes, observations show the evolution of these features fall well short in fully describing the location of first initiates. A joint collaborative modeling effort among the NWS offices in Mobile, AL, and Houston, TX, and NASA s Short-term Prediction Research and Transition (SPoRT) Center was undertaken during the 2012 warm season to examine the impact of certain NASA produced products on the Weather Research and Forecasting Environmental Modeling System. The NASA products were: a 4-km Land Information System data, a 1-km sea surface temperature analysis, and a 4-km greenness vegetation fraction analysis. Similar domains were established over the southeast Texas and Alabama coastlines, each with a 9 km outer grid spacing and a 3 km inner nest spacing. The model was run at each NWS office once per day out to 24 hours from 0600 UTC, using the NCEP Global Forecast System for initial and boundary conditions. Control runs without the NASA products were made at the NASA SPoRT Center. The NCAR Model Evaluation Tools verification package was used to evaluate both the forecast timing and location of the first initiates, with a focus on the impacts of the NASA products on the model forecasts. Select case studies will be presented to highlight the influence of the products.

Medlin, Jeffrey M.↗
NASA NTRS2000

Evaluation of the Regional Atmospheric Modeling System in the Eastern Range Dispersion Assessment System

The Applied Meteorology Unit is conducting an evaluation of the Regional Atmospheric Modeling System (RAMS) contained within the Eastern Range Dispersion Assessment System (ERDAS). ERDAS provides emergency response guidance for operations at the Cape Canaveral Air Force Station and the Kennedy Space Center in the event of an accidental hazardous material release or aborted vehicle launch. The prognostic data from RAMS is available to ERDAS for display and is used to initialize the 45th Range Safety (45 SW/SE) dispersion model. Thus, the accuracy of the 45 SW/SE dispersion model is dependent upon the accuracy of RAMS forecasts. The RAMS evaluation task consists of an objective and subjective component for the Florida warm and cool seasons of 1999-2000. The objective evaluation includes gridded and point error statistics at surface and upper-level observational sites, a comparison of the model errors to a coarser grid configuration of RAMS, and a benchmark of RAMS against the widely accepted Eta model. The warm-season subjective evaluation involves a verification of the onset and movement of the Florida east coast sea breeze and RAMS forecast precipitation. This interim report provides a summary of the RAMS objective and subjective evaluation for the 1999 Florida warm season only.

Case, Jonathan↗
NASA NTRS2012

The SPoRT-WRF: Evaluating the Impact of NASA Datasets on Convective Forecasts

The Short-term Prediction Research and Transition Center (SPoRT) is a collaborative partnership between NASA and operational forecasting entities, including a number of National Weather Service offices. SPoRT transitions real-time NASA products and capabilities to its partners to address specific operational forecast challenges. One challenge that forecasters face is applying convection-allowing numerical models to predict mesoscale convective weather. In order to address this specific forecast challenge, SPoRT produces real-time mesoscale model forecasts using the Weather Research and Forecasting (WRF) model that includes unique NASA products and capabilities. Currently, the SPoRT configuration of the WRF model (SPoRT-WRF) incorporates the 4-km Land Information System (LIS) land surface data, 1-km SPoRT sea surface temperature analysis and 1-km Moderate resolution Imaging Spectroradiometer (MODIS) greenness vegetation fraction (GVF) analysis, and retrieved thermodynamic profiles from the Atmospheric Infrared Sounder (AIRS). The LIS, SST, and GVF data are all integrated into the SPoRT-WRF through adjustments to the initial and boundary conditions, and the AIRS data are assimilated into a 9-hour SPoRT WRF forecast each day at 0900 UTC. This study dissects the overall impact of the NASA datasets and the individual surface and atmospheric component datasets on daily mesoscale forecasts. A case study covering the super tornado outbreak across the Ce ntral and Southeastern United States during 25-27 April 2011 is examined. Three different forecasts are analyzed including the SPoRT-WRF (NASA surface and atmospheric data), the SPoRT WRF without AIRS (NASA surface data only), and the operational National Severe Storms Laboratory (NSSL) WRF (control with no NASA data). The forecasts are compared qualitatively by examining simulated versus observed radar reflectivity. Differences between the simulated reflectivity are further investigated using convective parameters along with model soundings to determine the impacts of the various NASA datasets. Additionally, quantitative evaluation of select meteorological parameters is performed using the Meteorological Evaluation Tools model verification package to compare forecasts to in situ surface and upper air observations.

Zavodsky, Bradley↗
DOE OSTI2021

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-Solar Ensemble System (WRF-Solar EPS) and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Data Base (NSRDB) observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by taking into account the uncertainty of each ensemble member. The Analog Ensemble (AnEn) calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes such as reliability and statistical consistency.

analog ensemble↗
DOE OSTI2025

Lidar-Based Evaluation of HRRR Performance in California’s Diablo Range

The performance of the NOAA High-Resolution Rapid Refresh (HRRR) model for capturing low-level winds near a wind energy production site during summer 2019 is evaluated. This study catalogs the ability of HRRR to predict boundary layer dynamics relevant to wind energy interests over complex terrain, which has presented challenges for weather and energy forecasting. Performance is evaluated by comparing HRRR output to wind-profiling Doppler lidars at Lawrence Livermore National Laboratory Site 300. HRRR captured the diurnal profile of horizontal winds in the observed 150-m layer, despite strong underpredictions (∼4 m s −1 ) during evening and nighttime hours. These underpredictions may be a result of local speedup flows observed by the lidars, which were unresolved in HRRR due to their small spatial extent. HRRR bias magnitude relative to observations was found to be minimal during days with synoptic-scale troughs and strong 850-hPa geopotential gradients, while bias magnitude was maximal during days with synoptic ridging and weak 850-hPa geopotential gradients. To translate wind speed predictions to energy forecasting, generic turbine models were used to estimate power generation for turbines characteristic of the nearby Altamont Pass Wind Resource Area. Results show that HRRR-based energy estimates predicted daytime power generation adequately relative to lidar-based estimates with an 18-h lead time (bias magnitude < 0.4 MW from 0900 to 1400 LT) but overpredicted power during the rest of the diurnal cycle (bias > 1 MW). These results demonstrate conditions under which HRRR performs well for wind energy applications in complex terrain, while highlighting biases that require further investigation to support usage of a high-resolution model for wind energy forecasts.

Boundary layer↗
NASA NTRS1991

Surface wind convergence as a short-term predictor of cloud-to-ground lightning at Kennedy Space Center: A four-year summary and evaluation

Since 1986, USAF forecasters at NASA-Kennedy have had available a surface wind convergence technique for use during periods of convective development. In Florida during the summer, most of the thunderstorm development is forced by boundary layer processes. The basic premise is that the life cycle of convection is reflected in the surface wind field beneath these storms. Therefore the monitoring of the local surface divergence and/or convergence fields can be used to determine timing, location, longevity, and the lightning hazards which accompany these thunderstorms. This study evaluates four years of monitoring thunderstorm development using surface wind convergence, particularly the average over the area. Cloud-to-ground (CG) lightning is related in time and space with surface convergence for 346 days during the summers of 1987 through 1990 over the expanded wind network at KSC. The relationships are subdivided according to low level wind flow and midlevel moisture patterns. Results show a one in three chance of CG lightning when a convergence event is identified. However, when there is no convergence, the chance of CG lightning is negligible.

Watson, Andrew I.↗
NASA NTRS1985

Evaluation of the satellite derived snow cover area - Runoff forecasting models for the inaccessible basins of western Himalayas

In this study, the existing seasonal snow cover area runoff forecasting models of the Indus, Kabul, Sutlej and Chenab basins were evaluated with the concurrent flow correlation model for the period 1975-79. In all the basins under study, correlation of concurrent flow model explained the variability in flow better than by the snow cover area runoff models. Actually, the concurrent flow correlation model explained more than 90 percent of the variability in the flow of these rivers. Compared to this model, the snow cover area runoff models explained less of the variability in flow. In the Himalayan river basins under study and at least for the period under observation, the concurrent flow correlation model provided a set of results with which to compare the estimates from the snow cover area runoff models.

Dey, B.↗
NASA NTRS1977

The effect of increased horizontal resolution on synoptic forecasts with the GISS model of the global atmosphere

The improved horizontal resolution global circulation model in question has a horizontal spacing of 2.5 deg latitude by 3 deg longitude for a resolution of about 250 km in midlatitude. This paper reports on experiments to determine the improvements in forecasting skill and in initial conditions that were made possible by the ultrafine resolution and ultrafine assimilation. The size of the improvement in skill score when the ultrafine model is used for forecasting and assimilation was so large that 60-hour forecasts with the ultrafine model had as good a skill score as the 48-hour forecasts with the fine model. Synoptic evaluations confirmed that ultrafine model forecasts are better than the fine model forecasts.

Quirk, W. J.↗
NASA NTRS2006

Performance of Two Cloud-Radiation Parameterization Schemes in the Finite Volume General Circulation Model for Anomalously Wet May and June 2003 Over the Continental United States and Amazonia

An objective assessment of the impact of a new cloud scheme, called Microphysics of Clouds with Relaxed Arakawa-Schubert Scheme (McRAS) (together with its radiation modules), on the finite volume general circulation model (fvGCM) was made with a set of ensemble forecasts that invoke performance evaluation over both weather and climate timescales. The performance of McRAS (and its radiation modules) was compared with that of the National Center for Atmospheric Research Community Climate Model (NCAR CCM3) cloud scheme (with its NCAR physics radiation). We specifically chose the boreal summer months of May and June 2003, which were characterized by an anomalously wet eastern half of the continental United States as well as northern regions of Amazonia. The evaluation employed an ensemble of 70 daily 10-day forecasts covering the 61 days of the study period. Each forecast was started from the analyzed initial state of the atmosphere and spun-up soil moisture from the first-day forecasts with the model. Monthly statistics of these forecasts with up to 10-day lead time provided a robust estimate of the behavior of the simulated monthly rainfall anomalies. Patterns of simulated versus observed rainfall, 500-hPa heights, and top-of-the-atmosphere net radiation were recast into regional anomaly correlations. The correlations were compared among the simulations with each of the schemes. The results show that fvGCM with McRAS and its radiation package performed discernibly better than the original fvGCM with CCM3 cloud physics plus its radiation package. The McRAS cloud scheme also showed a reasonably positive response to the observed sea surface temperature on mean monthly rainfall fields at different time leads. This analysis represents a method for helpful systematic evaluation prior to selection of a new scheme in a global model.

Sud, Y. C.↗
NASA NTRS1982

Investigation of geomagnetic field forecasting and fluid dynamics of the core

Progress in the development, testing, and evaluation of kinematic geomagnetic forecast models and their utility in magnetic prediction of the core-mantle boundary of the Earth and in determination of the core radius is reported. The GFSC 9/80 model, which uses MAGSAT data, was determined to be of high quality.

Benton, E. R.↗
NASA NTRS2004

An Evaluation of the Accuracy of Meteor Shower Forecasts

Brought into being by the recent Leonid meteor storms, meteor shower forecasts are now regarded by many spacecraft projects as necessary inputs into the planning of spacecraft operations. We compare the shower forecasts made by various researchers over the past six years to actual shower observations in an attempt to create an overall picture of forecast accuracy, specifically focusing on the three aspects most important to space vehicles: 1) the time of shower maximum, 2) the half-width (duration), and 3) the maximum Zenith Hourly Rate (ZHR). It will be noted that, while the times of maxima are generally predicted to within several minutes, the peak ZHRs are often overestimated and shower half-widths are frequently not even calculated. The difficulties involved in converting shower ZHRs into the meteoroid fluxes needed to assess spacecraft risk are also discussed.

Cooke, W.↗