Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

Evaluation of the synoptic and mesoscale predictive capabilities of a mesoscale atmospheric simulation system

The overall performance characteristics of a limited area, hydrostatic, fine (52 km) mesh, primitive equation, numerical weather prediction model are determined in anticipation of satellite data assimilations with the model. The synoptic and mesoscale predictive capabilities of version 2.0 of this model, the Mesoscale Atmospheric Simulation System (MASS 2.0), were evaluated. The two part study is based on a sample of approximately thirty 12h and 24h forecasts of atmospheric flow patterns during spring and early summer. The synoptic scale evaluation results benchmark the performance of MASS 2.0 against that of an operational, synoptic scale weather prediction model, the Limited area Fine Mesh (LFM). The large sample allows for the calculation of statistically significant measures of forecast accuracy and the determination of systematic model errors. The synoptic scale benchmark is required before unsmoothed mesoscale forecast fields can be seriously considered.

Koch, S. E.↗
NASA NTRSDate not supplied

Anticipating Hazard Impacts through Capacity Building and Co-development

Improving forecast accuracy, extending lead time, understanding hazard susceptibility, and integrating exposure and vulnerability data to generate impact-based forecasts are critical in mitigating disaster impacts. These efforts enable anticipatory action through enhancing the efficacy of early warning systems to assess potential multi-dimensional hazard impacts. In response to this need, SERVIR has co-developed a series of hazard services providing vital information from national to regional scales. This poster showcases examples of geospatial services co-developed with partners through a capacity building approach, supporting the establishment of hazard early warning / early action systems. These services integrate multidimensional vulnerability and exposure data to comprehensively assess impacts. Furthermore, these services demonstrate how co-development and capacity building can advance the development of impact-based forecasts and multi-hazards services. By prioritizing collaboration, human insights, local knowledge, capacity building, and employing applied science approaches in geospatial service development, this work has helped create inclusive and customized solutions. These solutions are tailored to meet the needs of local communities and are readily adaptable into decision-making processes.

weather↗
DOE OSTI2021

A meta-learning based distribution system load forecasting model selection framework

This paper presents a meta-learning based, automatic distribution system load forecasting model selection framework. Furthermore, the framework includes the following processes: feature extraction, candidate model preparation and labeling, offline training, and online model recommendation. Using load forecasting needs and data characteristics as input features, multiple metalearners are used to rank the candidate load forecast models based on their forecasting accuracy. Then, a scoring-voting mechanism is proposed to weights recommendations from each meta-leaner and make the final recommendations. Heterogeneous load forecasting tasks with different temporal and technical requirements at different load aggregation levels are set up to train, validate, and test the performance of the proposed framework. Simulation results demonstrate that the performance of the meta-learning based approach is satisfactory in both seen and unseen forecasting tasks.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2022

Exploring the Relationship Between Temperature Forecast Errors and Earth System Variables

Accurate subseasonal weather forecasts, from two weeks up to a season, can help reduce costs and impacts related to weather and corresponding extremes. The quality of weather forecasts has improved considerably in recent decades as models represent more details of physical processes, and they benefit from assimilating comprehensive Earth observation data as well as increasing computing power. However, with ever–growing model complexity, it becomes increasingly difficult to pinpoint weaknesses in the forecast models’ process representations which is key to improving forecast accuracy. In this study, we use a comprehensive set of observation–based ecological, hydrological and meteorological variables to study their potential for explaining temperature forecast errors at the weekly time scale. For this purpose, we compute Spearman correlations between each considered variable and the forecast error obtained from the ECMWF subseasonal–to–seasonal (S2S) reforecasts at lead times of 1–6 weeks. This is done across the globe for the time period 2001–2017. The results show that temperature forecast errors globally are most strongly related with climate–related variables such as surface solar radiation and precipitation, which highlights the model’s difficulties in accurately capturing the evolution of the climate–related variables during the forecasting period. At the same time, we find particular regions in which other variables are more strongly related to forecast errors. For instance, in central Europe, eastern North America and southeastern Asia, vegetation greenness and soil moisture are relevant, while in western South America and central North America, circulation–related variables such as surface pressure relate more strongly with forecast errors. Overall, the identified relationships between forecast errors and independent Earth observations reveal promising variables on which future forecasting system development could focus by specifically considering related process representations and data assimilation.

Temperature↗
DOE OSTI2024

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗
NASA NTRS1974

Short-range forecasts with the GISS model of the global atmosphere

Results of tests carried out during the period from December 1972 through January 1973 to determine the short-term forecasting accuracy of a multilevel numerical primitive-equation (PE) model of the global atmosphere developed at the Goddard Institute for Space Studies (GISS). Six 48-hr forecasts were carried out with the aid of this model, using nine vertical levels and a horizontal grid spacing of 4 deg in latitude and 5 deg in longitude for an effective grid point separation averaging slightly more than 400 km. Verification of forecast sea-level pressures, 1000-mb heights, and 500-mb heights, as well as 1000-mb and 500-mb vector geostrophic winds, shows that the model has forecast skill comparable to that of operational PE models. Based on the 36-hr evolution of 18 extratropical cyclones, the model forecasts exhibit a tendency toward underestimating their propagation speeds and overestimating their central pressures. Both deficiencies are attributed to inadequate horizontal grid resolution. Quantitative verification of forecast surface temperatures over the eastern United States shows a forecast skill equal to that achieved by combined dynamical-statistical procedures.

Druyan, L. M.↗
NASA NTRSDate not supplied

Complementary Roles of LEO and GEO IR Sounders in NWP Evaluated using an OSSE Framework

The United States is currently preparing for the next-generation weather satellite program. Building off the multi-decadal successes of the Low-Earth Orbit (LEO) infrared (IR) sounder program, NOAA and NASA are planning for the Geostationary eXtended Observations (GeoXO) Sounder (GXS) that will join international counterparts to form a global ring from geosynchronous orbit (GEO). To address questions about the complementarities and roles of these two platform types in the context of numerical weather prediction (NWP) and forecast accuracy, NASA’s Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework was used to test their impact individually and in concert. Analyses, forecasts, and forecast sensitivity-based observations impact (FSOI) are examined. Overall, each has a role in forecast error reduction with the most beneficial impacts occurring when both LEO and GEO sounders are used together to address the needs of global skill and targeted regional weather phenomena.

Erica Mcgrath-Spangler↗
DOE OSTI2022

Integrating Deep Learning and Hydrodynamic Modeling to Improve the Great Lakes Forecast

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, trained with the limited data from hypothetical monitoring networks, can provide consistent and robust performance. The LSTM prediction captured the LST spatiotemporal variabilities across the five Great Lakes well, suggesting an effective and efficient way for monitoring network design in assisting the ML-based forecast. Furthermore, we employed an explainable artificial intelligence (XAI) technique named SHapley Additive exPlanations (SHAP) to uncover how the features impact the LSTM prediction. Our XAI analysis shows air temperature is the most influential feature for predicting LST in the trained LSTM. The relatively large bias in the LSTM prediction during the spring and fall was associated with substantial heterogeneity of air temperature during the two seasons. In contrast, the physics-based hydrodynamic model performed better in spring and fall yet exhibited relatively large biases during the summer stratification period. Finally, we developed a statistical integration of the hydrodynamic modeling and deep learning results based on the Best Linear Unbiased Estimator (BLUE). The integration further enhanced prediction accuracy, suggesting its potential for next-generation Great Lakes forecast systems.

Xue, Pengfei (ORCID:000000025702421X)↗
DOE OSTI2020

Chapter 7: Predictive Analytics in Future Power Systems: A Panorama and State-of-the-Art of Deep Learning Applications

The challenges surrounding the optimal operation of power systems are growing in various dimensions, due in part to increasingly distributed energy resources and a progression towards large-scale transportation electrification. Currently, the increasing uncertainties associated with both renewable energy generation and demand are largely being managed by increasing operational reserves - potentially at the cost of suboptimal economic conditions - in order to maintain the reliability of the system. This chapter looks at the big picture role of forecasting in power systems from generation to consumption and provides a comprehensive review of traditional approaches for forecasting generation and load in various contexts. This chapter then takes a deep dive into the state-of-the-art machine learning and deep learning approaches for power systems forecasting. Furthermore, a case study of multi-time-horizon solar irradiance forecasting using deep learning is discussed in detail. Smart grids form the backbone of the future interdependent networks. For addressing the challenges associated with the operations of smart grid, development and wide adoption of machine learning and deep learning algorithms capable of producing better forecasting accuracies is urgently needed. Along with exploring the implementation and benefits of these approaches, this chapter also considers the strengths and limitations of deep learning algorithms for power systems forecasting applications. This chapter, thus, provides a panoramic view of state-of-the-art of predictive analytics in power systems in the context of future smart grid operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Deep-Learning-Based Multi-Timescale Load Forecasting in Buildings: Opportunities and Challenges from Research to Deployment

Electricity load forecasting for buildings and campuses is becoming increasingly important as the penetration of distributed energy resources (DERs) grows. Efficient operation and dispatch of DERs require reasonably accurate predictions of future energy consumption in order to conduct near-real-time optimized dispatch of on-site generation and storage assets. Electric utilities have traditionally performed load forecasting for load pockets spanning large geographic areas, and therefore, forecasting has not been a common practice by buildings and campus operators. Given the growing trends of research and prototyping in the grid-interactive efficient buildings domain, characteristics beyond simple algorithm forecast accuracy are important in determining the algorithm's true utility for smart buildings. Other characteristics include the overall design of the deployed architecture and the operational efficiency of the forecasting system. In this work, we present a deep-learning-based load forecasting system that predicts the building load at 1-hour intervals for 18 hours in the future. We also discuss challenges associated with the real-time deployment of such systems as well as the research opportunities presented by a fully functional forecasting system that has been developed within the National Renewable Energy Laboratory's Intelligent Campus program.

building load forecasting↗
DOE OSTI2024

Empowering Machine Learning Forecasting of Labquake Using Event‐Based Features and Clustering Characteristics

Abstract Following recent advances of machine learning (ML), we present a novel approach to extract spatiotemporal seismo‐mechanical features from Acoustic Emission (AE) catalogs to empower ML‐based forecasting. The AE data were recorded during laboratory stick‐slip experiments on granite samples cut by rough faults. Based on the features computed for a past time window, a random forest (RF) classifier is used to forecast the occurrence of a large magnitude event ( M AE > 3.5) in the next time window. Event‐based features allow us to associate informative time‐space characteristics to each feature and nearest‐neighbor clustering analysis enables us to separate background and clustered seismicity and train individual models. The results show that the separation of AEs enhances the forecasting accuracy from 73.2% for the entire catalog up to 82.1% and 89.0% if background and clustered events are used separately. The presented new approach may be upscaled for applications to forecast tectonic earthquakes.

Karimpouli, Sadegh↗
NASA NTRS1993

(abstract) The Atmospheric Infrared Sounder on EOS

The Atmospheric Infrared Sounder (AIRS) is a facility instrument on the Earth Observing System (EOS) P.M. platform. It will be launched into a 705 km high polar orbit in the year 2000. On the platform with AIRS are the Advanced Microwave Sounding Unit (AMSU) and the Microwave Humidity Sounder (MHS). The three instruments are designed to meet NASA's global change research objectives and NOAA's operational sounding requirements for global weather predictions. AIRS, AMSU, and MHS will provide global tempeature profiles with 1 k rms accuracy in 1 km thick layers in the troposphere and water burden with 10 % accuracy. This is more than a factor of two better than the current operational sounding system, TOVS, and is expected to result in a significant improvement in the medium range forecast accuracy.

remote sensing satellite temperature sounding mois↗
DOE OSTI2021

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗
DOE OSTI2023

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗
DOE OSTI2026

The relative influences of hydrologic information and dams’ hydropower scheduling decisions on electricity price forecasts

Price dynamics in wholesale electricity markets are driven by supply and demand. In markets with hydroelectric dams, the timing and amount of hydropower offered can influence prices in similar ways to wind and solar power. Unlike variable renewable energy, however, the supply of hydropower in wholesale markets is a function of both water availability and operational decisions at dams. Dam operators maximize revenues in wholesale markets by aligning generation with the periods of highest expected prices, and these scheduling decisions may in turn influence prices. Here, we examine the relative importance of two types of information in predicting forward electricity prices: a) water availability at dams, in the form of short-to-medium-range hydrological forecasts; and b) hourly scheduling decisions at dams. Using softly coupled hydrologic, hydropower scheduling, and power systems models spanning the U.S. Western Interconnection, we quantify the importance of hydrologic forecast accuracy in correctly predicting wholesale electricity prices and compare this with the influence of dam operators’ own hourly scheduling decisions on realized market prices. We find that aligning hydropower generation schedules with the periods of high forecasted prices causes larger, inadvertent price forecast errors than imperfect hydrologic forecasts. This suggests that knowledge of how water is managed by dam operators within the week is more important than weekly inflow forecast errors when predicting forward electricity prices. Our findings have implications for optimal hydropower scheduling by region. Specifically, accounting for price effects is critical in markets dominated by hydropower capacity.

Electricity markets↗
DOE OSTI2024

Use of physics to improve solar forecast: Part III, impacts of different cloud types

Cloud-type impacts present a great challenge to solar forecasting due to diverse and complex cloud-radiation interactions. This third part of our paper sequence seeks to address this challenge by quantifying the forecast accuracies under eight cloud types: cumulus (Cu), stratified clouds (St), altocumulus (Ac), altostratus (As), cirrostratus/anvil (Cr), cirrus (Ci), congestus (Co), deep convective clouds (Dc) across four physics-informed persistence models reported in Part I. To generalize the cloud impacts, the eight cloud types are further grouped into three cloud categories based on their common features: weak convective clouds, stratiform clouds, and strong convective clouds. Here, the decade-long (2001 ~ 2014) collocated measurements of irradiances and cloud types at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Program South Great Plain (SGP) Central Facility site are used for model evaluation. Results reveal a clear performance hierarchy for global horizontal irradiance (GHI) and direct normal irradiance (DNI): best for weak convective clouds and cirrus, intermediate for stratiform clouds, and worst for strong convective clouds. Performance for diffuse horizontal irradiance (DHI) is less influenced by cloud types. Cloud albedo dominates all three irradiances for Dc, while both cloud albedo and cloud fraction are influential for other cloud types. A 12 %~33 % improvement in accuracy at 6-hour lead time compared to the benchmark smart model confirms the effectiveness of incorporating physics into the models for various cloud types; further improvements are expected by directly integrating cloud type information into forecasting models by modifying the physical formulation of cloud-radiation interaction, and/or using more advanced machine learning models.

14 SOLAR ENERGY↗
NASA NTRS2022

Assessment of Geo-Kompsat-2A Atmospheric Motion Vector Data and Its Assimilation Impact in the GEOS Atmospheric Data Assimilation System

Korea’s second geostationary meteorological satellite, Geo-Kompsat-2A (Geostationary-Korean Multi-Purpose Satellite-2A, GK2A), was successfully launched on 4 December 2018. GK2Agenerates Atmospheric Motion Vectors (AMVs) every 10 min in the full disk area. This data hasbeen disseminated via Global Telecommunication System (GTS) since 25 October 2019. This articleevaluates the quality of GK2A AMVs in the Goddard Earth Observing System (GEOS) atmosphericdata assimilation system (ADAS). The data show slow wind speed biases at 200–300 hPa and 600–800hPa in the northern and southern hemispheres. These biases are caused by observation heightassignment errors near jet streams. The Equivalent Blackbody Temperature (EBBT) method of GK2Atends to assign clouds at higher altitude, which mainly causes slow wind speed biases, especially inthe lower atmosphere. The IR/WV intercept method of GK2A assigns clouds slightly lower in theatmospheric layers below the altitude of 400 hPa, which causes positive biases. Quality control (QC)criteria to select the most suitable GK2A AMV data for assimilation are presented based on thesequality assessments. A new QC criterion utilizing height errors within the GEOS ADAS is introducedto exclude data with slow wind speed biases and large errors. GEOS forecast accuracy is slightlyimproved after assimilating GK2A AMVs along with other conventional, radiance, and satellitewinds which include AMVs made by the Himawari-8 satellite in nearly the same observational areaof GK2A. Additionally, the present work shows that GEOS forecasts can be significantly improved,especially in the tropics and southern hemisphere after assimilating GK2A data in the absence ofHimawari-8 AMVs. This study demonstrates that GK2A AMV data is a valuable data source toenhance the robustness of GEOS ADAS.

Atmospheric Motion Vectors↗