Search NASA⌕ Search

Engineering topics

Sharp, Justin

Publications and source records attributed to Sharp, Justin.

Measurements and Model Improvement: Insight into NWP Model Error Using Doppler Lidar and Other WFIP2 Measurement Systems

Abstract Doppler-lidar wind-profile measurements at three sites were used to evaluate NWP model errors from two versions of NOAA’s 3-km-grid HRRR model, to see whether updates in the latest version 4 reduced errors when compared against the original version 1. Nested (750-m grid) versions of each were also tested to see how grid spacing affected forecast skill. The measurements were part of the field phase of the Second Wind Forecasting Improvement Project (WFIP2), an 18-month deployment into central Oregon–Washington, a major wind-energy-producing region. This study focuses on errors in simulating marine intrusions, a summertime, 600–800-m-deep, regional sea-breeze flow found to generate large errors. HRRR errors proved to be complex and site dependent. The most prominent error resulted from a premature drop in modeled marine-intrusion wind speeds after local midnight, when lidar-measured winds of greater than 8 m s −1 persisted through the next morning. These large negative errors were offset at low levels by positive errors due to excessive mixing, complicating the interpretation of model “improvement,” such that the updates to the full-scale versions produced mixed results, sometimes enhancing but sometimes degrading model skill. Nesting consistently improved model performance, with version 1’s nest producing the smallest errors overall. HRRR’s ability to represent the stages of sea-breeze forcing was evaluated using radiation budget, surface-energy balance, and near-surface temperature measurements available during WFIP2. The significant site-to-site differences in model error and the complex nature of these errors mean that field-measurement campaigns having dense arrays of profiling sensors are necessary to properly diagnose and characterize model errors, as part of a systematic approach to NWP model improvement. Significance Statement Dramatic increases in NWP model skill will be required over the coming decades. This paper describes the role of major deployments of accurate profiling sensors in achieving that goal and presents an example from the Second Wind Forecast Improvement Program (WFIP2). Wind-profile data from scanning Doppler lidars were used to evaluate two versions of HRRR, the original and an updated version, and nested versions of each. This study focuses on the ability of updated HRRR versions to improve upon predicting a regional sea-breeze flow, which was found to generate large errors by the original HRRR. Updates to the full-scale HRRR versions produced mixed results, but the finer-mesh versions consistently reduced model errors.

Meteorology & Atmospheric Sciences↗

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗

The Evolving Role of Extreme Weather Events in the U.S. Power System with High Levels of Variable Renewable Energy

As weather-dependent renewable generation grows, it is important for power system planning to understand the broad trends and correlations between weather, renewable resources, and load. The traditional planning, performed by utilities and system operators, includes the study of system resource adequacy during peak load periods in the summer and winter to ensure the generation and transmission system is appropriate to meet load. But in a power grid with a high penetration of variable renewable energy (i.e., wind and solar), periods of high risk to system resource adequacy may no longer correspond only to hours of peak load. In particular, high shares of variable renewable energy, even when well-forecasted to inform system operations, can further complicate the stress extreme weather events already place on the grid. They also may lead to changes to the types of weather conditions that are most problematic to system operations and resource adequacy due to widespread and extended deficits of wind and solar generation. Accordingly, the focus of reliability assessments in long-term planning studies may need to evolve in the coming years to more fully incorporate weather events that lead to these deficits. This report seeks to identify these new weather events and understand the characteristics of the events that lead to system risk of future systems with higher penetrations variable renewable energy.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Mountain waves can impact wind power generation

Abstract. Mountains can modify the weather downstream of the terrain. In particular, when stably stratified air ascends a mountain barrier, buoyancy perturbations develop. These perturbations can trigger mountain waves downstream of the mountains that can reach deep into the atmospheric boundary layer where wind turbines operate. Several such cases of mountain waves occurred during the Second Wind Forecast Improvement Project (WFIP2) in the Columbia River basin in the lee of the Cascade Range bounding the states of Washington and Oregon in the Pacific Northwest of the United States. Signals from the mountain waves appear in boundary layer sodar and lidar observations as well as in nacelle wind speeds and power observations from wind plants. Weather Research and Forecasting (WRF) model simulations also produce mountain waves and are compared to satellite, lidar, and sodar observations. Simulated mountain wave wavelengths and wave propagation speeds (group velocities) are analyzed using the fast Fourier transform. We found that not all mountain waves exhibit the same speed and conclude that the speed of propagation, magnitudes of wind speeds, or wavelengths are important parameters for forecasters to recognize the risk for mountain waves and associated large drops or surges in power. When analyzing wind farm power output and nacelle wind speeds, we found that even small oscillations in wind speed caused by mountain waves can induce oscillations between full-rated power of a wind farm and half of the power output, depending on the position of the mountain wave's crests and troughs. For the wind plant analyzed in this paper, mountain-wave-induced fluctuations translate to approximately 11 % of the total wind farm output being influenced by mountain waves. Oscillations in measured wind speeds agree well with WRF simulations in timing and magnitude. We conclude that mountain waves can impact wind turbine and wind farm power output and, therefore, should be considered in complex terrain when designing, building, and forecasting for wind farms.

17 WIND ENERGY↗

Evaluating the WFIP2 updates to the HRRR model using scanning Doppler lidar measurements in the complex terrain of the Columbia River Basin

The wind-energy (WE) industry relies on numerical weather prediction (NWP) forecast models as foundational or base models for many purposes, including wind-resource assessment and wind-power forecasting. During the Second Wind Forecast Improvement Project (WFIP2) in the Columbia River Basin of Oregon and Washington, a significant effort was made to improve NWP forecasts through focused model development, to include experimental refinements to the High Resolution Rapid Refresh (HRRR) model physics and horizontal grid spacing. In this study, the performance of an experimental version of HRRR that includes these refinements is tested against a control version, which corresponds to that of the operational HRRR run by National Oceanic and Atmospheric Administration/National Centers for Environmental Protection at the outset of WFIP2. Furthermore, the effects of horizontal grid resolution were also tested by comparing wind forecasts from the HRRR (with 3-km grid spacing) with those from a finer-resolution HRRR nest with 750-m grid spacing. Model forecasts are validated against accurate wind-profile measurements by three scanning, pulsed Doppler lidars at sites separated by a total distance of 71 km. Model skill and improvements in model skill, attributable to physics refinements and improved horizontal grid resolution, varied by season, by site, and during periods of atmospheric phenomena relevant to WE. In general, model errors were the largest below 150 m above ground level (AGL). Experimental HRRR refinements tended to reduce the mean absolute error (MAE) and other error metrics for many conditions, but degradation in skill (increased MAE) was noted below 150 m AGL at the two lowest-elevation sites at night. Finer resolution was found to produce the most significant reductions in the error metrics.

17 WIND ENERGY↗

Characterizing NWP Model Errors Using Doppler-Lidar Measurements of Recurrent Regional Diurnal Flows: Marine-Air Intrusions into the Columbia-River Basin

Ground-based Doppler-lidar instrumentation provides atmospheric wind data at dramatically improved accuracies and spatial/temporal resolutions. These capabilities have provided new insights into atmospheric flow phenomena, but they also should have a strong role in NWP model improvement. Insight into the nature of model errors can be gained by studying recurrent atmospheric flows, here a regional summertime diurnal sea breeze and subsequent marine-air intrusion into the arid interior of Oregon-Washington, where these winds are an important windenergy resource. These marine intrusions were sampled by three scanning Doppler lidars in the Columbia-River Basin as part of the Second Wind Forecast Improvement Project (WFIP2), using data from summer 2016. Lidar time-height cross sections of wind speed identified eight days when the diurnal-flow cycle, (peak wind speeds at midnight, afternoon minima) was obvious and strong. Eight-day composite time-height cross sections of lidar wind speeds are used to validate those generated by the operational NCEP-HRRR model. HRRR simulated the diurnal wind cycle, but produced errors in the timing of onset and significant errors due to a premature nighttime demise of the intrusion flow, producing low-bias errors of 6 m s-1 . Day-to-day and in the composite, whenever a marine intrusion occurred, HRRR made these same errors. The errors occurred under a range of gradient wind conditions indicating that they resulted from the misrepresentation of physical processes within a limited region around the measurement locations. Because of their generation within a limited geographical area, field-measurement programs can be designed to find and address the sources of these NWP errors.

Banta, Robert M.↗

Identification and Characterization of Persistent Cold Pool Events from Temperature and Wind Profilers in the Columbia River Basin

Cold pool events occur when deep layers of stable, cold air remain trapped in a valley or basin for multiple days, without mixing out from daytime heating. With large impacts on air quality, freezing events, and es-pecially on wind energy production, they are often poorly forecast by modern mesoscale numerical weather prediction (NWP) models. Understanding the characteristics of cold pools is, therefore, important to provide more accurate forecasts. This study analyzes cold pool characteristics with data collected during the Second Wind Forecast Improvement Project (WFIP2), which took place in the Columbia River basin and Gorge of Oregon and Washington from fall 2015 until spring 2017. A subset of the instrumentation included three microwave radiometer pro?lers, six radar wind pro?lers with radio acoustic sounding systems, and seven sodars, which together provided seven sites with collocated vertical pro?les of temperature, humidity, wind speed, and wind direction. Using these collocated observations, we developed a set of criteria to determine if a cold pool was present based on stability, wind speed, direction, and temporal continuity, and then developed an automated algorithm based on these criteria to identify all cold pool events over the 18 months of the ?eld project. Characteristics of these events are described, including statistics of the wind speed distributions and pro?les, stability conditions, cold pool depths, and descent rates of the cold pool top. The goal of this study is a better understanding of these characteristics and their processes to ultimately lead to improved physical parameterizations in NWP models, and consequently improve forecasts of cold pool events in the study region as well at other locations that experiences similar events.

McCaffrey, Katherine L.↗

The Second Wind Forecast Improvement Project (WFIP 2): General Overview

In 2015 the U.S. Department of Energy initiated a four-year study, the second Wind Forecast Improvement Project (WFIP 2), to improve the representation of boundary-layer physics and related processes in mesoscale models for better wind and wind power forecasts. This goal challenges numerical weather prediction models in complex terrain due to inherent assumptions underlying their boundary-layer parameterizations. The WFIP 2 effort involved the wind industry, universities, NOAA, and DOE's national laboratories in an integrated observational and modeling study. Observations spanned 18-months to assure a full annual cycle of continuously recorded observations from remote-sensing and in situ measurement systems. The study area comprised the Columbia Basin of eastern Washington and Oregon, containing more than 4 GW of installed wind capacity; nests of observational systems captured important atmospheric scales from mesoscale to NWP sub-grid scale. Model improvements targeted NOAA's High-Resolution Rapid Refresh (HRRR) model to facilitate transfer of improvements to NWS operational forecast models. This paper describes the general WFIP 2 scope and objectives, the particular scientific challenges of improving wind forecasts in complex terrain, early successes of the project, and an integrated approach to archiving observations and model output. It provides an introduction for a set of more detailed BAMS papers addressing WFIP 2 observational science, modeling challenges and solutions, practical transfer of boundary layer advances to industry use, and advances in coupling improved mesoscale models to microscale models that can represent interactions between wind plants and the atmosphere.

WFIP2, boundary layer, complex terrain, forecastin↗

The Second Wind Forecast Improvement Project (WFIP2): Observational Field Campaign

The science of wind energy forecasting has taken a leap forward with the unique meteorological observations gathered in complex terrain during the Second Wind Forecast Improvement Project (WFIP2). The Second Wind Forecast Improvement Project (WFIP2) is a U.S. Department of Energy (DOE) and National Oceanic and Atmospheric Administration (NOAA) funded program, with private-sector and university partners, which aims to improve the accuracy of numerical weather prediction (NWP) model forecasts of wind speed in complex terrain for wind energy applications. A core component of WFIP2 was an 18-month field campaign which took place in the U.S. Pacific Northwest between October 2015 and March 2017. A large suite of instrumentation was deployed in a series of telescoping arrays, ranging from 500 km across to a densely instrumented 2 x 2 km area similar in size to a high-resolution NWP model grid cell. Observations from these instruments are being used to improve our understanding of the meteorological phenomena that affect wind energy production in complex terrain, and to evaluate and improve model physical parameterization schemes. We present several brief case studies using these observations to describe phenomena that are routinely difficult to forecast, including wintertime cold pools, diurnally driven gap flows, and mountain waves/wakes. Observing system and data product improvements developed during WFIP2 are also described.

17 WIND ENERGY↗

Wind Forecasting Improvement Project In Complex Terrain Near the Columbia River Gorge

In 2014 a multi-institution team led by Vaisala, Inc. was selected by the Department of Energy (DOE) to partner with multiple DOE and National Oceanic and Atmospheric Administration (NOAA) laboratories on a project designed to improve the quality of wind power forecasts in areas of complex terrain. This was the second Wind Forecast Improvement Project (WFIP2) funded by DOE and it extended from late 2014 through the middle of 2018. It encompassed an 18-month observational field campaign, numerical weather prediction (NWP) model development, extensive analysis of data and NWP output, and the creation of decision support tool algorithms to convey forecast information to end users in the wind industry. WFIP2 focused on improvements to the representation of near-surface and boundary-layer physics in NOAA’s High-Resolution Rapid Refresh (HRRR) model. Improvements to HRRR, which is run operationally over the continental United States, benefit the wind industry in multiple ways. Forecasts from the operational HRRR are used directly by wind power forecast vendors and the operators of wind plants. In addition, because HRRR is built using the widely-used Weather Research and Forecasting (WRF) model, improvements to its parameterizations become available to commercial and research institutions using WRF for a myriad of purposes. The geographic area studied by WFIP2 was a region of the Columbia River basin located to the east of the Cascade Mountains between Oregon and Washington. Home to over 6 GW of installed capacity for wind energy production, this area also hosts a variety of atmospheric phenomena either unique to or augmented by complex topography. This makes it an attractive test-bed for the analysis of wind forecast in complex terrain, though results found are should be applicable in any area of topographic complexity. WFIP2 succeeded as a collaborative effort, and while this report focuses on the activities of the team led by Vaisala, the work described here is part of a larger whole. The Vaisala team accomplished a number of specific tasks as described in this report, while also contributing to this larger effort.

17 WIND ENERGY↗

Recent Trends in Variable Generation Forecasting and Its Value to the Power System

We report that the rapid deployment of wind and solar energy generation systems has resulted in a need to better understand, predict, and manage variable generation. The uncertainty around wind and solar power forecasts is still viewed by the power industry as being quite high, and many barriers to forecast adoption by power system operators still remain. In response, the U.S. Department of Energy has sponsored, in partnership with the National Oceanic and Atmospheric Administration, public, private, and academic organizations, two projects to advance wind and solar power forecasts. Additionally, several utilities and grid operators have recognized the value of adopting variable generation forecasting and have taken great strides to enhance their usage of forecasting. In parallel, power system markets and operations are evolving to integrate greater amounts of variable generation. This paper will discuss the recent trends in wind and solar power forecasting technologies in the U.S., the role of forecasting in an evolving power system framework, and the benefits to intended forecast users.

24 POWER TRANSMISSION AND DISTRIBUTION↗