Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Discrete Graph Structure Learning for Forecasting Multiple Time Series

Time series forecasting is an extensively studied subject in statistics, economics, and computer science. Exploration of the correlation and causation among the variables in a multivariate time series shows promise in enhancing the performance of a time series model. When using deep neural networks as forecasting models, we hypothesize that exploiting the pairwise information among multiple (multivariate) time series also improves their forecast. If an explicit graph structure is known, graph neural networks (GNNs) have been demonstrated as powerful tools to exploit the structure. In this work, we propose learning the structure simultaneously with the GNN if the graph is unknown. We cast the problem as learning a probabilistic graph model through optimizing the mean performance over the graph distribution. The distribution is parameterized by a neural network so that discrete graphs can be sampled differentiably through reparameterization. Empirical evaluations show that our method is simpler, more efficient, and better performing than a recently proposed bilevel learning approach for graph structure learning, as well as a broad array of forecasting models, either deep or non-deep learning based, and graph or non-graph based.

Shang, Chao↗

Day-ahead continuous double auction-based peer-to-peer energy trading platform incorporating trading losses and network utilisation fee

Integration of distributed energy resources, such as photovoltaic solar (PV), introduces new opportunities to establish local energy market frameworks to improve renewable energy utilisation in residential sectors. Such peer-to-peer (P2P) energy trading refers to a local market structure where customers (and prosumers) interact to share excess PV generation to enhance the individual and community social welfare. In this work, a day-ahead continuous double auction (CDA)-based P2P market structure considering network losses and network utilisation fees was designed. Day-ahead PV energy is modelled using fractional integral polynomials and the output is forecasted using an autoregressive integrated moving average model for each market interval. Based on the customer load and excess PV energy, the CDA market is cleared using a bid/ask matching mechanism. The performance of the P2P market was evaluated by computing different welfare metrics while analysing the effect of network constraints. The results show that the designed CDA-based P2P market structure increases the social welfare of all participants by an average of 17.75% compared to the baseline for the presented cases. Moreover, the impact of the forecasting error between the day-ahead and real-time market was also quantified.

24 POWER TRANSMISSION AND DISTRIBUTION↗

California wildfire spread derived using VIIRS satellite observations and an object-based tracking system

Changing wildfire regimes in the western US and other fire-prone regions pose considerable risks to human health and ecosystem function. However, our understanding of wildfire behavior is still limited by a lack of data products that systematically quantify fire spread, behavior and impacts. Here we develop a novel object-based system for tracking the progression of individual fires using 375 m Visible Infrared Imaging Radiometer Suite active fire detections. At each half-daily time step, fire pixels are clustered according to their spatial proximity, and are either appended to an existing active fire object or are assigned to a new object. This automatic system allows us to update the attributes of each fire event, delineate the fire perimeter, and identify the active fire front shortly after satellite data acquisition. Using this system, we mapped the history of California fires during 2012–2020. Our approach and data stream may be useful for calibration and evaluation of fire spread models, estimation of near-real-time wildfire emissions, and as means for prescribing initial conditions in fire forecast models.

54 ENVIRONMENTAL SCIENCES↗

Hurricane-Induced Rainfall is a Stronger Predictor of Tropical Forest Damage in Puerto Rico Than Maximum Wind Speeds

Projected increases in cyclonic storm intensity under a warming climate will have profound effects on forests, potentially changing these ecosystems from carbon sinks to sources. Forecasting storm impacts on these ecosystems requires consideration of risk factors associated with storm meteorology, landscape structure, and forest attributes. Here we evaluate risk factors associated with damage severity caused by Hurricanes María and Irma across Puerto Rican forests. Using field and remote sensing data, total forest aboveground biomass (AGB) lost to the storms was estimated at 10.44 (±2.33) Tg, ca. 23% of island-wide pre-hurricane forest AGB. Storm-related rainfall was a stronger predictor of forest damage than maximum wind speeds. Soil water storage capacity was also an important risk factor, corroborating the influence of rainfall on forest damage. Expected increases of 20% in hurricane-associated rainfall in the North Atlantic highlight the need to consider how such shifts, together with high speed winds, will affect terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

HPC Analytics of Fused Thermal Plants Data to Optimize Operating Envelope

In this project, ORNL extensively reviewed the ORAP RAM data, and it guided us to develop machine learning models that can predict time to next failures and forecast failure trends, which will be useful for optimizing power plant operation strategies. More specifically, we trained multiple random forest models and evaluated the model accuracy to validate with 10+ years of historical data. In addition, we implemented a web-based graphical user interface system for the models to show how our models can be used in more intuitive ways. This proof of concept allowed exploration of model use with power plant operators in mind. Developed machine learning models will be helpful for managing risks, planning maintenance and operation, ultimately reducing the down time and increasing the service hours. For future work, there are several interesting research topics including but not limited to model enhancement, creating synergy with traditional failure modeling approaches, and data-driven actionable recommendation and suggestions.

20 FOSSIL-FUELED POWER PLANTS↗

Measurements and Model Improvement: Insight into NWP Model Error Using Doppler Lidar and Other WFIP2 Measurement Systems

Abstract Doppler-lidar wind-profile measurements at three sites were used to evaluate NWP model errors from two versions of NOAA’s 3-km-grid HRRR model, to see whether updates in the latest version 4 reduced errors when compared against the original version 1. Nested (750-m grid) versions of each were also tested to see how grid spacing affected forecast skill. The measurements were part of the field phase of the Second Wind Forecasting Improvement Project (WFIP2), an 18-month deployment into central Oregon–Washington, a major wind-energy-producing region. This study focuses on errors in simulating marine intrusions, a summertime, 600–800-m-deep, regional sea-breeze flow found to generate large errors. HRRR errors proved to be complex and site dependent. The most prominent error resulted from a premature drop in modeled marine-intrusion wind speeds after local midnight, when lidar-measured winds of greater than 8 m s −1 persisted through the next morning. These large negative errors were offset at low levels by positive errors due to excessive mixing, complicating the interpretation of model “improvement,” such that the updates to the full-scale versions produced mixed results, sometimes enhancing but sometimes degrading model skill. Nesting consistently improved model performance, with version 1’s nest producing the smallest errors overall. HRRR’s ability to represent the stages of sea-breeze forcing was evaluated using radiation budget, surface-energy balance, and near-surface temperature measurements available during WFIP2. The significant site-to-site differences in model error and the complex nature of these errors mean that field-measurement campaigns having dense arrays of profiling sensors are necessary to properly diagnose and characterize model errors, as part of a systematic approach to NWP model improvement. Significance Statement Dramatic increases in NWP model skill will be required over the coming decades. This paper describes the role of major deployments of accurate profiling sensors in achieving that goal and presents an example from the Second Wind Forecast Improvement Program (WFIP2). Wind-profile data from scanning Doppler lidars were used to evaluate two versions of HRRR, the original and an updated version, and nested versions of each. This study focuses on the ability of updated HRRR versions to improve upon predicting a regional sea-breeze flow, which was found to generate large errors by the original HRRR. Updates to the full-scale HRRR versions produced mixed results, but the finer-mesh versions consistently reduced model errors.

Meteorology & Atmospheric Sciences↗

Disruption event characterization and forecasting in tokamaks

Disruption prediction and avoidance is a critical need for next-step tokamaks, such as ITER. Disruption Event Characterization and Forecasting (DECAF) research fully automates analysis of tokamak data to determine chains of events that lead to disruptions and to forecast their evolution allowing sufficient time for mitigation or complete avoidance of the disruption. Disruption event chains related to local rotating or global magnetohydrodynamic (MHD) modes and vertical instability are examined with warnings issued for many off-normal physics events, including density limits, plasma dynamics, confinement transitions, and profile variations. Along with Greenwald density limit evaluation, a local radiative island power balance theory is evaluated and compared to the observation of island growth. Automated decomposition and analysis of rotating tearing modes produce physical event chains leading to disruptions. A total MHD state warning model comprised of 15 separate criteria produces a disruption forecast about 180 ms before a standard locked mode detector warning. Single DECAF event analyses have begun on KSTAR, MAST, and NSTX/-U databases with thousands of shot seconds of device operation using from 0.5 to 1 × 10 6 tested sample times per device. An initial multi-device database comparison illustrates a highly important result that plasma disruptivity does not need to increase as βN increases. Global MHD instabilities, such as resistive wall modes (RWMs), can give the briefest time period of warning before disruption compared to other physics events. In an NSTX database with unstable RWMs, the mode onset, loss of boundary and current control, and disruption event warnings are found in all cases and vertical displacement events are found in 91% of cases. An initial time-dependent reduced physics model of kinetic RWM stabilization created to forecast the disruption chain predicts instability 84% of the time for experimentally unstable cases with a relatively low false positive rate. Instances of the disruption event chain analysis illustrate dynamics including H–L back transitions for rotating MHD and global RWM triggering events. Furthermore, disruption warnings are issued with sufficient time before the disruption (on transport timescales) to potentially allow active profile control for disruption avoidance, active mode control, or mitigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Grid Spacing Sensitivities of Simulated Mid-Latitude and Tropical Mesoscale Convective Systems in the Convective Gray Zone

The main objective of this study is to observationally constrain processes in tropical and midlatitude mesoscale convective systems (MCSs), and to use these constraints for model evaluation. To accomplish this, we leverage MCS observations collected at the U.S. DOE Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site in Oklahoma and ARM's mobile GoAmazon2014/15 site in Manaus, Brazil (MAO). We simulate 13 and 11 of these observed MCSs at the SGP and MAO site, respectively, using the Weather Research and Forecasting model at 12-, 4-, 2-, and 1-km horizontal grid spacing. Observations from radiosondes, surface meteorology, and radar wind profilers are used to characterize MCS properties, such as MCS timing and location, cold pools, and convective drafts, and evaluate these simulations. SGP cases are found in better agreement with observations than MAO cases, and when simulated at 2 km, outperform simulations at 1 km regarding the timing of MCS overpass and the accuracy of surface variable trends. MAO simulations suggest a consistent improvement in model accuracy with increasing model resolution in depicting the downdraft structure, the timing of MCSs, and the surface variables changes, except for the latter two metrics at 2 km. Deficiencies are still evident at km-scales, suggesting the need for higher resolution to simulate tropical MCSs. Overall, location-dependent improvements in MCS representation are obtained with the increasing model resolution, prompting the evaluation of sub-km scale simulations.

54 ENVIRONMENTAL SCIENCES↗

WRF Modelling of Deep Convection and Hail for Wind Power Applications

Deep convection and the related occurrence of hail, intense precipitation and wind gusts represent a hazard to a range of energy infrastructure including wind turbine blades. Wind turbine blade leading edge erosion (LEE) is caused by the impact of falling hydrometeors onto rotating wind turbine blades. It is a major source of wind turbine maintenance costs and energy losses from wind farms. In the United States Southern Great Plains (SGP), where there is widespread wind energy development, deep convection and hail events are common, increasing the potential for precipitation-driven LEE. A 25-day Weather Research and Forecasting (WRF) model simulation conducted at convection-permitting resolution and using a detailed microphysics scheme is carried out for the SGP to evaluate the effectiveness in modelling the wind and precipitation conditions relevant to LEE potential. WRF output for these properties is evaluated using radar observations of precipitation (including hail) and reflectivity, in situ wind speed measurements and wind power generation. This research demonstrates some skill for the primary drivers of LEE. Wind speeds, rainfall rates and precipitation totals show good agreement with observations. Here, the occurrence of precipitation during power producing wind speeds is also shown to exhibit fidelity. Hail events frequently occur during periods when wind turbines are rotating and are especially important to LEE in the SGP. The presence of hail is modelled with a mean proportion correct of 0.77 and an odds ratio 4.55. Further research is needed to demonstrate sufficient model performance to be actionable for the wind energy industry and there is evidence for positive model bias in cloud reflectivity.

17 WIND ENERGY↗

Cross-Scale Land-Atmosphere Experiment (CSLAEX) (Final Report)

It is now well recognized that land-atmosphere interactions play an important role in both weather and climate. These interactions take place over a wide range of spatial and temporal scales. Most of the current formulations of the momentum, heat and moisture transport laws are informed by observations with a limited temporal or spatial scale, and hence may have limited applicability. The objective of this work is to improve the multi-scale representation of the near-surface heat transfer in the ground and in the atmosphere using a combination of modeling and field observations. Our knowledge and predictive capacity in land-atmosphere coupling is limited by our capacity to observe the full-scale spectrum at play. In order to bridge this fundamental gap in our observation capacity I will work to: create the first long-term Integrated Cross-Scale land-Atmosphere Experiment (CSLAEX) since I will work to: measure the components of the surface energy balance at a spatial scale relevant to remote sensing and meteorological applications (5km), along with observations of the nested subscale processes with Distributed Temperature Sensors (DTS). This proposal aims to fill the gaps in modeling and observing land-atmosphere interactions across scales via a novel Cross-Scale Land-Atmosphere Experiment (CSLAEX) to be implemented as part of the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site near Lamont, Oklahoma. The proposed research effort aims at exploring land-atmosphere processes across multiple spatial scales and to investigate the effect of landscape heterogeneity using Distributed Temperature Sensor measurements. The novel instrumentation of the Surface Energy Balance and simultaneous observations of the atmospheric state (boundary layer, cloud, convection) available at the DOE ARM SGP site will be used to create CSLAEX. This dataset will be used to frame and evaluate new transport laws and parameterizations for the boundary layer and the land surface, which can be implemented into the Weather and Research Forecasting (WRF) model and Community Atmospheric Model (CAM). The result of this study should impact multiple fields: meteorology, climate, and hydrology.

54 ENVIRONMENTAL SCIENCES↗

Methods and systems for evaluating data transportability in distribution grids

This document describes systems and techniques for evaluating and improving distribution-grid data transportability. These systems and techniques allow engineers to quantify the data transportability of a communication system within or connected to a distribution grid, which represents an ability to transport in real-time telemetry from source locations (e.g., sensors in the distribution grid) to control mechanisms. Distribution engineers can use the sensor readings to perform grid analytics, control operating parameters, and operate protection systems. Distribution engineers can also use the transportability of the communication system to evaluate the observability of the distribution grid, which represents an ability to combine actual measurements and various types of computations (e.g., analytics, estimators, forecasters) from a system model. Distribution engineers can then generate a sensor allocation plan that indicates the number and location of sensors to maximize observability for a fixed sensor cost and/or minimize sensor cost for predetermined observability.

Taft, Jeffrey D.↗

A Machine Learning Approach for Hourly Traffic Prediction Used in EV-Charging Sites

Reliable forecasting of hourly traffic volumes on highways is critical for planning and operating electric-vehicle charging infrastructure without overloading the grid. In this work, we develop and evaluate a station-specific machine-learning approach based on NeuralProphet, enhanced with conditional seasonality to better distinguish weekday, weekend, and holiday patterns. For each station, the model automatically retrieves the same calendar day from the prior years as an AR-Net initialization, fits trend and Fourier-based seasonality components, and then applies short-term auto-regressive corrections. We train and test on 2021 and 2022 TMAS data, respectively, and validate performance over the whole year. We chose to demonstrate how the model performs on a typical weekday (3/15/2022), weekend (3/27/2022), and a special holiday (12/25/2022). Our results yield MAPE of 7.4%, 23.6%, and 32.0%, respectively. Over the entire year 2022, the overall MAPE was 17%. This demonstrates that station-specific models with conditional seasonality can achieve accurate, scalable hourly forecasts for EV-charging load planning.

99 - GENERAL AND MISCELLANEOUS↗

Impact of Mineral Reactive Surface Area on Forecasting Geological Carbon Sequestration in a CO2-EOR Field

Mineral reactive surface area (RSA) is one of the key factors that control mineral reactions, as it describes how much mineral is accessible and can participate in reactions. This work aims to evaluate the impact of mineral RSA on numerical simulations for CO2 storage at depleted oil fields. The Farnsworth Unit (FWU) in northern Texas was chosen as a case study. A simplified model was used to screen representative cases from 87 RSA combinations to reduce the computational cost. Three selected cases with low, mid, and high RSA values were used for the FWU model. Results suggest that the impact of RSA values on CO2 mineral trapping is more complex than it is on individual reactions. While the low RSA case predicted negligible porosity change and an insignificant amount of CO2 mineral trapping for the FWU model, the mid and high RSA cases forecasted up to 1.19% and 5.04% of porosity reduction due to mineral reactions, and 2.46% and 9.44% of total CO2 trapped in minerals by the end of the 600-year simulation, respectively. The presence of hydrocarbons affects geochemical reactions and can lead to net CO2 mineral trapping, whereas mineral dissolution is forecasted when hydrocarbons are removed from the system.

58 GEOSCIENCES↗

Evaluating the WFIP2 updates to the HRRR model using scanning Doppler lidar measurements in the complex terrain of the Columbia River Basin

The wind-energy (WE) industry relies on numerical weather prediction (NWP) forecast models as foundational or base models for many purposes, including wind-resource assessment and wind-power forecasting. During the Second Wind Forecast Improvement Project (WFIP2) in the Columbia River Basin of Oregon and Washington, a significant effort was made to improve NWP forecasts through focused model development, to include experimental refinements to the High Resolution Rapid Refresh (HRRR) model physics and horizontal grid spacing. In this study, the performance of an experimental version of HRRR that includes these refinements is tested against a control version, which corresponds to that of the operational HRRR run by National Oceanic and Atmospheric Administration/National Centers for Environmental Protection at the outset of WFIP2. Furthermore, the effects of horizontal grid resolution were also tested by comparing wind forecasts from the HRRR (with 3-km grid spacing) with those from a finer-resolution HRRR nest with 750-m grid spacing. Model forecasts are validated against accurate wind-profile measurements by three scanning, pulsed Doppler lidars at sites separated by a total distance of 71 km. Model skill and improvements in model skill, attributable to physics refinements and improved horizontal grid resolution, varied by season, by site, and during periods of atmospheric phenomena relevant to WE. In general, model errors were the largest below 150 m above ground level (AGL). Experimental HRRR refinements tended to reduce the mean absolute error (MAE) and other error metrics for many conditions, but degradation in skill (increased MAE) was noted below 150 m AGL at the two lowest-elevation sites at night. Finer resolution was found to produce the most significant reductions in the error metrics.

17 WIND ENERGY↗

Forecast of Wildfire Potential Across California USA Using a Transformer

Wildfires are a major issue facing the United States, a matter further exacerbated by an ever-changing climate. In California alone, wildfires are responsible for billions of dollars in damages and take lives each year. Accurately predicting fire danger conditions allows preparation awareness before wildfires start. Transformers are a class of deep learning models designed to identify patterns in sequential datasets. In recent years, transformers have gained popularity through their impressive performance in natural language processing and other applications of signal recognition. This analysis demonstrates the ability of a transformer with a residual connection to forecast fire danger potential over the state of California. Wildland fire potential index (WFPI) maps collected from the US Geological Survey database from January 1st 2020 to December 31st 2023 were used to tune, train and evaluate the transformer. Meteorological inputs (provided by Daymet daily weather and climatological summaries), the normalized difference vegetation index (NDVI) (calculated from the Moderate Resolution Imaging Spectroradiometer (MODIS)), and outputs from the Scott and Burgman fire behavior fuel models (to characterize maps of fuel types), were used as inputs. Our results show that a transformer can effectively emulate the US Forest Service modeled WFPI maps of California USA for four week long forecasts over the month of July, 2023, with correlations ranging from 0.85 – 0.98.

Limber, Russell [ORNL]↗

Recreating the California New Year's Flood Event of 1997 in a Regionally Refined Earth System Model

Abstract The 1997 New Year's flood event was the most costly in California's history. This compound extreme event was driven by a category 5 atmospheric river that led to widespread snowmelt. Extreme precipitation, snowmelt, and saturated soils produced heavy runoff causing widespread inundation in the Sacramento Valley. This study recreates the 1997 flood using the Regionally Refined Mesh capabilities of the Energy Exascale Earth System Model (RRM‐E3SM) under prescribed ocean conditions. Understanding the processes causing extreme events informs practical efforts to anticipate and prepare for such events in the future, and also provides a rich context to evaluate model skill in representing extremes. Three California‐focused RRM grids, with horizontal resolution refinement of 14 km down to 3.5 km, and six forecast lead times, 28 December 1996 at 00Z through 30 December 1996 at 12Z, are assessed for their ability to recreate the 1997 flood. Planetary to synoptic scale atmospheric circulations and integrated vapor transport are weakly influenced by horizontal resolution refinement over California. Topography and mesoscale circulations, such as the Sierra barrier jet, are better represented at finer horizontal resolutions resulting in better estimates of storm total precipitation and storm duration snowpack changes. Traditional time‐series and causal analysis frameworks are used to examine runoff sensitivities state‐wide and above major reservoirs. These frameworks show that horizontal resolution plays a more prominent role in shaping reservoir inflows, namely the magnitude and time‐series shape, than forecast lead time, 2‐to‐4 days prior to the 1997 flood onset.

54 ENVIRONMENTAL SCIENCES↗

Security Enhancement of Network Constraint Grid-Edge Energy Management System

Network constrained grid edge energy management system (EMS) provides economic solution for active and reactive power dispatch of distributed energy resources (DERs) at the grid edge level. Grid edge EMS ensures secure interconnection of a circuit segment to the distribution system by maintaining grid code requirements (e.g. IEEE 1547–2018). Grid edge EMS is dependent on communication to receive load measurement, which brings a risk of unobservable false data injection attacks (FDIAs). To mitigate the risk, this paper proposes a framework to enhance resilient operation of grid edge EMS by detecting the unobservable FDIAs on loads and replacing them with forecasted values. In this work, a two-step detection algorithm is proposed. In first step, conventional residual based algorithm is deployed. Autoencoder (AE) based data driven mechanism is included in second step to detect the presence of unobservable FDIAs. After ensuring the presence of FDIA, its specific location is detected by checking the maximum residue values till the predefined threshold value is reached. Detected false data injected loads are then replaced with forecasted load values following long-short term memory (LSTM) based forecast to ensure resilient performance of grid edge EMS in the presence of attacks. This proposed security enhancement framework for grid edge EMS is evaluated in IEEE 13 bus system with three integrated DERs. Numerical simulation shows the validation of the proposed framework by reducing voltage violation in real operation of grid edge EMS.

cyber attack detection↗