SEARCH · Search NASA
Results for “numerical weather forecasting”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
PyDDA: A Pythonic Direct Data Assimilation Framework for Wind Retrievals
This software assimilates data from an arbitrary number of weather radars together with other spatial wind fields (eg numerical weather forecasting model data) in order to retrieve high resolution three dimensional wind fields. PyDDA uses NumPy and SciPy’s optimization techniques combined with the Python Atmospheric Radiation Measurement (ARM) Radar Toolkit (Py-ART) in order to create wind fields using the 3D variational technique (3DVAR). PyDDA is hosted and distributed on GitHub at https://github.com/openradar/PyDDA. PyDDA has the potential to be used by the atmospheric science community to develop high resolution wind retrievals from radar networks. These retrievals can be used for the evaluation of numerical weather forecasting models and plume modelling. This paper shows how wind fields from 2 NEXt generation RADar (NEXRAD) WSR-88D radars and the High Resolution Rapid Refresh can be assimilated together using PyDDA to create a high resolution wind field inside Hurricane Florence.
Confronting the Challenge of Modeling Cloud and Precipitation Microphysics
In the atmosphere, microphysics refers to the microscale processes that affect cloud and precipitation particles and is a key linkage among the various components of Earth’s atmospheric water and energy cycles. The representation of microphysical processes in models continues to pose a major challenge leading to uncertainty in numerical weather forecasts and climate simulations. In this paper, the problem of treating microphysics in models is divided into two parts: i) how to represent the population of cloud and precipitation particles, given the impossibility of simulating all particles individually within a cloud, and ii) uncertainties in the microphysical process rates owing to fundamental gaps in knowledge of cloud physics. The recently-developed Lagrangian particle-based method is advocated as a way to address several conceptual and practical challenges of representing particle populations using traditional bulk and bin microphysics parameterization schemes. For addressing critical gaps in cloud physics knowledge, sustained investment for observational advances from laboratory experiments, new probe development, and next-generation instruments in space is needed. Greater emphasis on laboratory work, which has apparently declined over the past several decades relative to other areas of cloud physics research, is argued to be an essential ingredient for improving process-level understanding. More systematic use of natural cloud and precipitation observations to constrain microphysics schemes is also advocated. Because it is generally difficult to quantify individual microphysical process rates from these observations directly, this presents an inverse problem that can be viewed from the standpoint of Bayesian statistics. Following this idea, a probabilistic framework is proposed that combines elements from statistical and physical modeling. Besides providing rigorous constraint of schemes, there is an added benefit of quantifying uncertainty systematically. Finally, a broader hierarchical approach is proposed to accelerate improvements in microphysics schemes, leveraging the advances described in this paper related to process modeling (using Lagrangian particle-based schemes), laboratory experimentation, cloud and precipitation observations, and statistical methods.
Optimizing Prediction Error for Time-dependent Solar Radiation Modeling
Numerical weather forecasting models and statistical methods have found wide use to help power companies estimate renewable output, but better methods are needed, particularly for extended forecasts. Machine learning approaches have been used here as well, but so far a major limitation is the ability to also predict the corresponding uncertainty in a forecast. Here we show that both can be done and demonstrate this using a long-term-short memory neural network where the difference between predicted and ground truth data are used to train a model for the corresponding forecast uncertainties.
Frost prediction using machine learning and deep neural network models
This study describes accurate, computationally efficient models that can be implemented for practical use in predicting frost events for point-scale agricultural applications. Frost damage in agriculture is a costly burden to farmers and global food security alike. Timely prediction of frost events is important to reduce the cost of agricultural frost damage and traditional numerical weather forecasts are often inaccurate at the field-scale in complex terrain. In this paper, we developed machine learning (ML) algorithms for the prediction of such frost events near Alcalde, NM at the point-scale. ML algorithms investigated include deep neural network, convolution neural networks, and random forest models at lead-times of 6–48 h. Our results show promising accuracy (6-h prediction RMSE = 1.53–1.72°C) for use in frost and minimum temperature prediction applications. Seasonal differences in model predictions resulted in a slight negative bias during Spring and Summer months and a positive bias in Fall and Winter months. Additionally, we tested the model transferability by continuing training and testing using data from sensors at a nearby farm. We calculated the feature importance of the random forest models and were able to determine which parameters provided the models with the most useful information for predictions. We determined that soil temperature is a key parameter in longer term predictions (>24 h), while other temperature related parameters provide the majority of information for shorter term predictions. The model error compared favorable to previous ML based frost studies and outperformed the physically based High Resolution Rapid Refresh forecasting system making our ML-models attractive for deployment toward real-time monitoring of frost events and damage at commercial farming operations.
The ICON-A model for direct QBO simulations on GPUs (version icon-cscs:baf28a514)
Abstract. Classical numerical models for the global atmosphere, as used for numerical weather forecasting or climate research, have been developed for conventional central processing unit (CPU) architectures. This hinders the employment of such models on current top-performing supercomputers, which achieve their computing power with hybrid architectures, mostly using graphics processing units (GPUs). Thus also scientific applications of such models are restricted to the lesser computer power of CPUs. Here we present the development of a GPU-enabled version of the ICON atmosphere model (ICON-A), motivated by a research project on the quasi-biennial oscillation (QBO), a global-scale wind oscillation in the equatorial stratosphere that depends on a broad spectrum of atmospheric waves, which originates from tropical deep convection. Resolving the relevant scales, from a few kilometers to the size of the globe, is a formidable computational problem, which can only be realized now on top-performing supercomputers. This motivated porting ICON-A, in the specific configuration needed for the research project, in a first step to the GPU architecture of the Piz Daint computer at the Swiss National Supercomputing Centre and in a second step to the JUWELS Booster computer at the Forschungszentrum Jülich. On Piz Daint, the ported code achieves a single-node GPU vs. CPU speedup factor of 6.4 and allows for global experiments at a horizontal resolution of 5 km on 1024 computing nodes with 1 GPU per node with a turnover of 48 simulated days per day. On JUWELS Booster, the more modern hardware in combination with an upgraded code base allows for simulations at the same resolution on 128 computing nodes with 4 GPUs per node and a turnover of 133 simulated days per day. Additionally, the code still remains functional on CPUs, as is demonstrated by additional experiments on the Levante compute system at the German Climate Computing Center. While the application shows good weak scaling over the tested 16-fold increase in grid size and node count, making also higher resolved global simulations possible, the strong scaling on GPUs is relatively poor, which limits the options to increase turnover with more nodes. Initial experiments demonstrate that the ICON-A model can simulate downward-propagating QBO jets, which are driven by wave–mean flow interaction.
Microwave Radiometer: Meteorological Temperature Profiler (raw)
The microwave radiometer profiler (MWRP) provides vertical profiles of temperature, humidity, and cloud liquid water content as a function of height or pressure at approximately 5-minute intervals for nearly all weather conditions. The profiles are derived from measurements of absolute microwave radiances (expressed as "brightness temperatures") obtained at 12 frequencies in the range of 22-30 GHz and 51-59 GHz. The data are useful for input to numerical weather forecast models and others that require continuous, high-temporal-resolution profiles. The microwave radiance measurements are useful for testing models of microwave radiation transfer used to derive the profiles.
GEFSv12 High- and Low-Skill Day-10 Tornado Forecasts
Abstract On average, modern numerical weather prediction forecasts for daily tornado frequency exhibit no skill beyond day 10. However, in this extended-range lead window, there are particular model cycles that have exceptionally high forecast skill for tornadoes because of their ability to correctly simulate the future synoptic pattern. Here, model initial conditions that produced a more skillful forecast for tornadoes over the United States were exploited while also highlighting potential causes for low-skill cycles within the Global Ensemble Forecasting System, version 12 (GEFSv12). There were 88 high-skill and 91 low-skill forecasts in which the verifying day-10 synoptic pattern for tornado conditions revealed a western U.S. thermal trough and an eastern U.S. thermal ridge, a favorable configuration for tornadic storm occurrence. Initial conditions for high skill forecasts tended to exhibit warmer sea surface temperatures throughout the tropical Pacific Ocean and Gulf of Mexico, an active Madden–Julian oscillation, and significant modulation of Earth-relative atmospheric angular momentum. Low-skill forecasts were often initialized during La Niña and negative Pacific decadal oscillation conditions. Significant atmospheric blocking over eastern Russia—in which the GEFSv12 overforecast the duration and characteristics of the downstream flow—was a common physical process associated with low-skill forecasts. This work helps to increase our understanding of the common causes of high- or low-skill extended-range tornado forecasts and could serve as a helpful tool for operational forecasters. Significance Statement This research provides a framework for the anticipation of a more (or less) skillful 10-day tornado forecast in an operational numerical weather prediction system. High-skill forecasts were associated with substantial tropical convection and warm sea surface temperature throughout the Pacific Ocean and Gulf of Mexico, whereas the underlying cause of low-skill forecasts were typically associated with a blocking anticyclone over eastern Russia. These findings are important because they permit increased or decreased confidence in a long-range forecast of tornado occurrence based on a dynamical prediction system.
Simulated wind farm wake sensitivity to configuration choices in the Weather Research and Forecasting model version 3.8.1
Wakes from wind farms can extend over 50 km downwind in stably stratified conditions. These wakes can undermine power production at downwind turbines, adversely impacting revenue. As such, wind farm wake impacts must be considered in wind resource assessments, especially in regions of dense wind farm development. The open-source Weather Research and Forecasting (WRF) numerical weather prediction model includes a wind farm parameterization to estimate wind farm wake effects, but model configuration choices can influence the resulting predictions of wind farm wakes. These choices include vertical resolution, horizontal resolution, and whether or not to include the addition of turbulent kinetic energy generated by the rotating wind turbines. Despite the sensitivity to model configuration, no clear guidance currently exists for these options. Here we compare simulated wind farm wakes produced by varying model configurations with meteorological observations near a land-based wind farm in flat terrain over several diurnal cycles. A WRF configuration comprised of horizontal resolutions of 3 km or 1 km paired with a vertical resolution of 10 m provides the most accurate representation of wind farm wake effects, such as the correct surface warming and elevated wind speed deficit. The inclusion of turbine-generated turbulence is also critical to produce accurate surface warming and should not be omitted.
Evaluating WRF-Solar EPS cloud mask forecast using the NSRDB
Improving the accuracy of day-ahead solar forecasts using numerical weather prediction models requires improving the forecasting of cloud occurrence and properties. Validating cloud forecasts is challenging because this requires evaluating different types of clouds over a wide variety of regions. This study analyzes the cloud occurrence (or cloud mask) over the contiguous United States (CONUS), predicted by the Weather Research and Forecasting-Solar Ensemble Prediction System (WRF-Solar EPS), to identify the strengths and limitations of the model in reproducing cloud fields. To enable the in-depth analysis of cloud mask forecasts covering CONUS, we use satellite observations from the National Solar Radiation Database (NSRDB). Two evaluation methods are implemented to consider all clouds and partially removed clouds from the 2-km NSRDB in evaluating the 9-km WRF-Solar EPS cloud mask. Cloud detection metrics as well as the frequency of cloud occurrence are used to quantify the monthly performance of WRF-Solar EPS. Mismatched cloud frequency (MCF) is used to assess the model's capability to predict different types of clouds, which are classified using three levels of cloud optical depth (COD) and cloud top height (CTH). The day-ahead forecasts covering the full year of 2018 demonstrate that WRF-Solar EPS produces MCFs ranging from 27%-46%, 13%-34%, and 8%-19% for thin, mid-thickness, and thick clouds, respectively. For three CTH levels, the model shows MCFs ranging from 19%-46%, 16%-33%, and 8%-27% for low-level, middle-level, and high-level clouds, respectively. This comprehensive characterization of model performance helps identify model weakness and will eventually lead to improvements in cloud and solar radiation forecasting.
Improving the prediction of DNI with physics-based representation of all-sky circumsolar radiation
Direct normal irradiance (DNI) is often interpreted differently in ground measurements and forecasts using numerical weather prediction (NWP) models, leading to substantial bias in DNI forecasting especially under cloudy-sky conditions. To mitigate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to conduct physics-based simulations of solar radiation in the circumsolar region. The DNI is quantified using the sum of the radiation along the sun direction and the scattered radiation within the circumsolar region. FARMS-DNI is coupled with the Weather Research and Forecasting model with solar extensions (WRF-Solar) to predict day-ahead DNI in 9-km pixels over an extended domain covering the contiguous United States. The DNI forecasts for the entire year of 2018 are validated using surface-based observations at the Atmospheric Radiation Measurement (ARM) and Surface Radiation Budget Network (SURFRAD) sites and a satellite-based solar radiation product developed by the procedure of the National Solar Radiation Data Base (NSRDB). The results show that the WRF-Solar coupled with the conventional Beer-Bouguer-Lambert law underestimes the overall DNI forecasts by 30%-60%, which is a joint effect of the uncertainties in computing the circumsolar radiation and forecasting cloud properties. This bias is significantly reduced by using FARMS-DNI.
Variational data augmentation for a learning-based granular predictive model of power outages
As the trend in climate change continues, extreme weather events are expected to occur with increasing frequency and severity and pose a significant threat to the electric power infrastructure. Regardless of the efforts a utility puts towards hardening the grid, storm-induced damage to the utility assets such as cables and distributed energy resources (DERs) that are particularly vulnerable to such events is unavoidable. Access to a highly granular, in space and time, outage forecasting tool with long lead times (i.e., days ahead) will enhance the efficiency of service restoration efforts. Here, in this study, we propose to develop and implement a multi-model framework as an operational tool based on a granular and multi-day outage forecasting model using operational numerical weather prediction model forecasts and detailed component outage information. An innovative two-layered recurrent neural network, i.e., a long-short-term-memory (LSTM)-based variational autoencoder (VAE) framework and a sliding window are used to address the uneven distribution of different types of weather events and make better use of the time-series data. Case studies are performed to demonstrate the performance of the new framework.
High-Frequency Forecasting of Solar Radiation Using a Hybrid Numerical Weather Prediction and Stochastic Downscaling Model
This poster presents an overview of high-frequency forecasting of solar radiation using a hybrid numerical weather prediction and stochastic downscaling model.
A Physics-Based DNI Model for Advancing Solar Resource Assessment and Forecasting: Preprint
Direct Normal Irradiance (DNI) is one of the most used quantities to quantify the magnitude of solar energy resource. The concept of DNI is often interpreted differently for ground measurements and solar forecasting by numerical weather prediction (NWP) models, leading to substantial bias during evaluation of DNI forecasts especially under cloudy-sky conditions. To eliminate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to provide a physics-based solution of solar radiation in the circumsolar region. The FARMS-DNI is implemented in the Weather Research and Forecasting model with solar extensions (WRF-Solar) to forecast day-ahead DNI in the north America. By comparing with conventional predictions from WRF-Solar and satellite observations from the National Solar Radiation Data Base (NSRDB), we found significant improvements in our prediction of DNI.
Moving beyond the Aerosol Climatology of WRF-Solar: A Case Study over the North China Plain
Numerical weather prediction (NWP), when accessible, is a crucial input to short-term solar power forecasting. WRF-Solar, the first NWP model specifically designed for solar energy applications, has shown promising predictive capability. Nevertheless, few attempts have been made to investigate its performance under high aerosol loading, which attenuates incoming radiation significantly. The North China Plain is a polluted region due to industrialization, which constitutes a proper testbed for such investigation. Here, in this paper, aerosol direct radiative effect (DRE) on three surface shortwave radiation components (i.e., global, beam, and diffuse) during five heavy pollution episodes is studied within the WRF-Solar framework. Results show that WRF-Solar overestimates instantaneous beam radiation up to 795.3 W m -2 when the aerosol DRE is not considered. Although such overestimation can be partially offset by an underestimation of the diffuse radiation of about 194.5 W m -2 , the overestimation of the global radiation still reaches 160.2 W m -2 . This undesirable bias can be reduced when WRF-Solar is powered by Copernicus Atmosphere Monitoring Service (CAMS) aerosol forecasts, which then translates to accuracy improvements in photovoltaic (PV) power forecasts. This work also compares the forecast performance of the CAMS-powered WRF-Solar with that of the European Centre for Medium-Range Weather Forecasts model. Under high aerosol loading conditions, the irradiance forecast accuracy generated by WRF-Solar increased by 53.2% and the PV power forecast accuracy increased by 6.8%.
Improving High Resolution Offshore Wind Resource Assessments and Forecasts using Observations in the MA/RI Lease Areas
The third Wind Forecast Improvement Project (WFIP3) sought to improve understanding of the physical phenomena in the atmosphere and ocean that dictate the structure and variability of wind and thermodynamic fields within the Marine Atmospheric Boundary Layer (MABL). WFIP3 conducted a comprehensive 18-month observational study over the Northeast U.S. outer continental shelf, a high use coastal zone, using a 3-D multiscale sensor array to highly resolve the temporal, vertical, and horizontal structure of the coupled atmospheric and oceanic boundary layers. Multiple land-based study sites adjacent to the coastal ocean observed surface meteorology and vertical profiles of atmospheric properties via passive infrared and microwave radiometers, active lidars and radars, and radiosondes. At sea, an array of surface flux buoys and two vertical profiling lidar buoys observed both atmospheric and oceanic properties, augmented by land-based oceanographic radar systems and routine ship-based surveys. Intensive observations of the MABL over the ocean was done from an air-sea interaction flux tower and extended deployments of a large barge platform. WFIP3 focused on mesoscale and sub-mesoscale flows -- including sea breezes, low-level jets, low-level clouds, and coastal storms -- and the ability of advanced numerical model parameterizations to represent them within fully coupled oceanic and atmospheric modeling systems and foundational weather forecast models. Numerous critical forecasting phenomena were observed, however the project was terminated prior to the completion of the field observational period and the analysis period.
Evaluating Ensemble Predictions of South Asian Monsoon Low Pressure System Genesis
Abstract Synoptic-scale vortices known as monsoon low pressure systems (LPSs) frequently produce intense precipitation and hydrological disasters in South Asia, so accurately forecasting LPS genesis is crucial for improving disaster preparedness and response. However, the accuracy of LPS genesis forecasts by numerical weather prediction models has remained unknown. Here, we evaluate the performance of two global ensemble models—the U.S. Global Ensemble Forecast System (GEFS) and the Ensemble Prediction System of the European Centre for Medium-Range Weather Forecasts (ECMWF)—in predicting LPS genesis during the years 2021–22. The GEFS successfully predicted about half the observed LPS genesis events 1–2 days in advance; the ECMWF model captured an additional 10% of observed genesis events. Both models had a false alarm ratio (FAR) of around 50% for 1–2-day lead times. In both ensembles, the control run typically exhibited a higher probability of detection (POD) of observed events and a lower FAR compared to the perturbed ensemble members. However, a consensus forecast, in which genesis is predicted when at least 20% of ensemble members forecast LPS formation, had POD values surpassing those of the control run for all lead times. Moreover, probabilistic predictions of genesis over the Bay of Bengal, where most LPSs form, were skillful, with the fraction of ensemble members predicting LPS formation over a 5-day lead time approximating the observed frequency of genesis, without any adjustment or bias correction.
Comparison of Observations and Predictions of Daytime Planetary-Boundary-Layer Heights and Surface Meteorological Variables in the Columbia River Gorge and Basin During the Second Wind Forecast Improvement Project
The second Wind Forecast Improvement Project (WFIP2) is an 18-month field campaign in the Pacific Northwest U.S.A., whose goal is to improve the accuracy of numerical-weather-prediction forecasts in complex terrain. The WFIP2 campaign involved the deployment of a large suite of in situ and remote sensing instrumentation, including eight 915-MHz wind-profiling radars, and surface meteorological stations. The evolution and annual variability of the daytime convective planetary-boundary-layer (PBL) height is investigated using the wind-profiling radars. Three models with different horizontal grid spacing are evaluated: the Rapid Refresh, the High-Resolution Rapid Refresh, and its nested version. The results are used to assess errors in the prediction of PBL height within the experimental and control versions of the models, with the experimental versions including changes and additions to the model parametrizations developed during the field campaign, and the control version using the parametrizations present in the National Oceanic and Atmospheric Administration/National Centers for Environmental Prediction operational version of the models at the start of the project. Results show that the high-resolution models outperform the low-resolution versions, the experimental versions perform better compared with the control versions, model PBL height estimations are more accurate on cloud-free days, and model estimates of the PBL height growth rate are more accurate than model estimates of the rate of decay. Finally, using surface sensors, we assess surface meteorological variables, finding improved surface irradiance and, to a lesser extent, improved 2-m temperature in the experimental version of the model.