Results for “Energy forecasting” — Page 3

DOE OSTI2025

Hydroboost

HydroBoost is the most realistic revenue optimization tool for the hybridization of hydropower and battery energy storage systems to date. The innovative representation of how operators actually schedule hydropower in practice results in more realistic predictions of revenue and operations. Unlike other optimization tools, HydroBoost generates forecast energy prices with uncertainty to use in the optimization. This allows HydroBoost to give users a range of potential revenue with an upper bound using the perfect foresight pricing and a lower bound using a naive persistence forecast model. Additional forecast can be generated and used in the optimization, such as additive models, random forest, and neural networks to give further insight into potential revenue. HydroBoost has been designed to be applicable for both run-of-river and reservoir storage sites. The primary focus is on the day-ahead market and requires year-long data with an hour time-step. All time-series input and constraints are contained in an Excel worksheet for convince. The user will run the forecasting generation first with a Python script to give the optimization model the necessary requirements. Next the optimization is ran using Julia and results are generated and stored into a directory as csv files. HydroBoost includes an additional module to generate figures based on the results of the optimization simulation. The results help analyze the results and users to draw insights into how the hydro and battery systems are operated and the revenue each is producing. Additionally, the difference between the perfect foresight model and models that include forecast can easily be inspected.

Phillips, TylerB. [Idaho National Laboratory (INL)↗

DOE OSTI2022

End-Use Load Profiles for the U.S. Building Stock: Practical Guidance on Accessing and Using the Data

End-use load profiles (EULP), which quantify how and when energy is used, are critically important to utilities, public utility commissions, state energy offices, and other stakeholders. Applications of EULPs focus on understanding how efficiency, demand response, and other distributed energy resources are valued and used in R&D prioritization, utility resource and distribution system planning, and state and local energy planning and regulations. Consequently, high-quality EULPs are critical for widespread adoption of electrification, demand flexibility, and grid-interactive efficient buildings. For example, EULPs can be used to forecast energy savings in buildings or to identify energy using activities that can be shifted to different times of the day.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2020

Data-driven occupant-behavior analytics for residential buildings

Many advances have been made in building technology to help save energy, but influencing the behavior of the occupants is still necessary to achieve low-energy use targets. One of the most practical ways to influence and change occupant behaviors is through incentives. Developing incentives for energy-saving and quantifying the impact of occupant behaviors are both active areas of research. Here, we propose a data analytics framework for detecting changes in occupant behaviors, which will help build an analytics feedback loop from behavior impact to incentive design. The framework has two major parts. The first forecasts energy consumption for each occupant, while the second determines a probability distribution for changes in energy consumption. The parts are interchangeable with other existing machine learning and statistical methods. A specific instantiation of the framework, using kernel ridge-regression for forecasting and k-means to find an empirical behavior distribution, is described in detail. An HVAC use-case with 5 different incentivized behaviors is used as an example to show that the framework can detect behavior changes induced by incentives. Furthermore, we show that some simpler behavior-change detection methods do not work, further justifying the use of advanced analytics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Energy and Emission Prediction for Mixed-Vehicle Transit Fleets Using Multi-task and Inductive Transfer Learning

Public transit agencies are focused on making their fixed-line bus systems more energy efficient by introducing electric (EV) and hybrid (HV) vehicles to their fleets. However, because of the high upfront cost of these vehicles, most agencies are tasked with managing a mixed-fleet of internal combustion vehicles (ICEVs), EVs, and HVs. In managing mixed-fleets, agencies require accurate predictions of energy use for optimizing the assignment of vehicles to transit routes, scheduling charging, and ensuring that emission standards are met. The current state-of-the-art is to develop separate neural network models to predict energy consumption for each vehicle class. Although different vehicle classes’ energy consumption depends on a varied set of covariates, we hypothesize that there are broader generalizable patterns that govern energy consumption and emissions. In this paper, we seek to extract these patterns to aid learning to address two problems faced by transit agencies. First, in the case of a transit agency which operates many ICEVs, HVs, and EVs, we use multi-task learning (MTL) to improve accuracy of forecasting energy consumption. Second, in the case where there is a significant variation in vehicles in each category, we use inductive transfer learning (ITL) to improve predictive accuracy for vehicle class models with insufficient data. As this work is to be deployed by our partner agency, we also provide an online pipeline for joining the various sensor streams for fixed-line transit energy prediction. Here, we find that our approach outperforms vehicle-specific baselines in both the MTL and ITL settings.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2003

Transferring Knowledge from Observations and Models to Decision Makers: An Overview and Challenges

Over the last 25 years, a tremendous progress has been made in the Earth science space-based remote sensing observations, technologies and algorithms. Such advancements have improved the predictability by providing lead-time and accuracy of forecast in weather, climate, natural hazards, and natural resources. It has further reduced or bounded the overall uncertainties by partially improving our understanding of planet Earth as an integrated system that is governed by non-linear and chaotic behavior. Many countries such US, European Community, Japan, China and others have invested billions of dollars in developing and launching space-based assets in the low earth (LEO) and geostationary (GEO) orbits. However, the wealth of this scientific knowledge that has potential of extracting monumental socio-economic benefits from such large investments have been slow in reaching to public and decision makers. For instance, there are a number of areas such as energy forecasting, aviation safety, agricultural competitiveness, disaster management, security, air quality and public health can directly take advantage. Nevertheless, we all live in a global economy that depends on access to the best available Earth Science information for all inhabitants of this planet. This paper surveys and examines a number such applications in terms of their architecture, maturity and economic applicability as they apply to the societal needs. A detailed analysis is also presented of various challenges and issues that pertain to a number of areas such as: (1) difficulties in making a speedy transition of data and information from observations and models to relevant Decision Support Systems (DSS) or tools, (2) data and models inter-operability issues, (3) limitations of spatial, spectral and temporal resolution, (4) communication limitations as dictated by the availability of image processing and data compression techniques. Additionally, the most critical element amongst all is the organizational and management boundaries that must be resolved at local, state, national and international levels to implement and realize free flow of such vital information. This paper also makes attempts to address this topic and discuss possible approaches to deal with this quandary.

Habib, Shahid↗

NASA NTRS2010

Utilizing Earth Observations for Societal Issues

Over the last four decades a tremendous progress has been made in the Earth science space-based remote sensing observations, technologies and algorithms. Such advancements have improved the predictability by providing lead-time and accuracy of forecast in weather, climate, natural hazards, and natural resources. It has further reduced or bounded the overall uncertainties by partially improving our understanding of planet Earth as an integrated system that is governed by non-linear and chaotic behavior. Many countries such as the US, European Community, Japan, China, Russia, India has and others have invested billions of dollars in developing and launching space-based assets in the low earth (LEO) and geostationary (GEO) orbits. However, the wealth of this scientific knowledge that has potential of extracting monumental socio-economic benefits from such large investments have been slow in reaching the public and decision makers. For instance, there are a number of areas such as water resources and availability, energy forecasting, aviation safety, agricultural competitiveness, disaster management, air quality and public health, which can directly take advantage. Nevertheless, we all live in a global economy that depends on access to the best available Earth Science information for all inhabitants of this planet. This presentation discusses a process to transition Earth science data and products for societal needs including NASA's experience in achieving such objectives. It is important to mention that there are many challenges and issues that pertain to a number of areas such as: (1) difficulties in making a speedy transition of data and information from observations and models to relevant Decision Support Systems (DSS) or tools, (2) data and models inter-operability issues, (3) limitations of spatial, spectral and temporal resolution, (4) communication limitations as dictated by the availability of image processing and data compression techniques. Additionally, the most critical element amongst all is the organizational and management boundaries that must be resolved at local, state, national and international levels to implement and realize free flow of such vital information.

Habib, Shahid↗

DOE OSTI2021

Data-driven building energy modeling with feature selection and active learning for data predictive control

Three gaps impede the development of cost-effective and accurate data-driven building energy modeling/models (DBEM) for energy forecasting and predictive control strategies. Gap 1: data bias is common in building operation data, but this topic is hardly studied in DBEM; Gap 2: high data dimensionality is common in DBEM, but a systematic and scalable methodology is lacking to solve the problem; Gap 3: the interactions between data bias and high dimensionality have not been systematically studied for DBEM and predictive control in buildings. In this work, to address the three gaps mentioned above, we develop a framework that integrates active learning and feature selection for DBEM used for whole building data predictive control (or DPC, which is a branch of model predictive control). The framework provides a systematic methodology and automatic workflow that starts with raw data from building automation systems to the establishment of data-driven energy models for DPC controllers. The developed strategies and framework are evaluated in a virtual testbed based on EnergyPlus and BCVTB. Improved performance and reduced computational complexity are observed from the DBEM built with the developed framework, as well as the DPC controller based on that DBEM, indicating the effectiveness of the developed framework.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Indoor and Outdoor Test Results for 'DUSST', a Low-Cost, Low-Maintenance PV Soiling Sensor

Soiling can cause significant losses to photovoltaic systems, and therefore it is often measured for the purposes of predicting long-term energy forecasts or for monitoring real time performance and triggering maintenance events as needed. Currently, the most common soiling monitoring technologies are soiling stations that use the electrical outputs of a regularly cleaned PV device and of a naturally soiled PV device to quantify soiling. As part of a new class of low-cost and low-maintenance soiling stations NREL has previously presented 'DUSST'. DUSST projects a collimated monochromatic light source through a glass surface (exposed similarly to the PV modules that need to be monitored) and on to a light detector to measure the intensity of the transmitted light. As the glass surface naturally soils, the losses are quantified by comparing this soiled reading with a calibrated reading under baseline clean condition. This work presents the ongoing improvement of DUSST and the ongoing indoor and outdoor validation of this new soiling sensor.

14 SOLAR ENERGY↗

DOE OSTI2023

Regime-specific Cloud Vertical Overlap Characteristics from Radar and Lidar Observations at the ARM sites

Climate and numerical weather prediction models require assumptions to represent the vertical distribution of subgrid-scale clouds, which have radiative transfer implications. In this study, nearly 25 years of ground-based radar and lidar observations of vertical cloud profiles at the Atmospheric Radiation Measurement Program (ARM) Southern Great Plains (SGP) site are utilized to derive cloud vertical overlap characteristics from the Cloud Type (CLDTYPE) data product. Here, the cloud vertical overlap characteristics are further separated by cloud regime by considering seven cloud types (i.e., low cloud, congestus, deep convection, altocumulus, altostratus, cirrostratus, and cirrus) as well as periods of shallow cumulus. The decorrelation length scale (i.e., exponential transition from maximum to random overlap with layer separation) is found to vary by cloud regime, ranging between 0.04 km for cirrostratus paired with cirrus to 4.58 km for low cloud paired with cirrus at SGP. Cloud vertical overlap characteristics are also considered for other ARM sites including the Tropical Western Pacific (TWP), North Slope of Alaska (NSA), and Eastern North Atlantic (ENA) sites amongst other shorter term ARM deployments globally. The decorrelation length scale ranged globally from 1.03 km in the Arctic Ocean to 3.06 km in Manacapuru, Brazil. Globally, the decorrelation length scale by cloud regime exhibited similarities (e.g., for cirrus paired with cirrus) and differences (e.g., congestus paired with cirrus). The results could help inform development of cloud vertical overlap assumptions within operational numerical weather prediction models and potentially improve prediction of radiative fluxes for weather, climate, and renewable energy forecasting.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

A Clustering-Based Scenario Generation Framework for Power Market Simulation with Wind Integration

A critical step in stochastic optimization models of power system analysis is to select a set of appropriate scenarios and significant numbers of scenario generation methods exist in the literature. This paper develops a clustering based scenario generation method, which aims to improve the performance of existing scenario generation techniques by grouping a set of correlated wind sites into clusters according to their cross-correlations. Copula based models are utilized to model spatiotemporal correlations and the Gibbs sampling is then used to generate scenarios for day-ahead markets. Our results show that the generated scenarios based on clustered wind sites outperform existing approaches in terms of reliability and sharpness and can reduce the total computational time for scenario generation and reduction significantly. The clustering-based framework can therefore provide a better support for real-world market simulations with high wind penetration.

data visualization↗

DOE OSTI2020

Model-Free State Estimation Using Low-Rank Canonical Polyadic Decomposition

As electric grids experience high penetration levels of renewable generation, fundamental changes are required to address real-time situational awareness. Here, we utilize unique traits of tensors to devise a model-free situational awareness and energy forecasting framework for distribution networks. This work formulates the state of the network at multiple time instants as a three-way tensor; hence, recovering full state information of the network is tantamount to estimating all the values of the tensor. Given measurements received from µphasor measurement units and/or smart meters, the recovery of unobserved quantities is carried out using the low-rank canonical polyadic decomposition of the state tensor—that is, the state estimation task is posed as a tensor imputation problem utilizing observed patterns in measured (sampled) quantities. Two structured sampling schemes are considered, namely, asynchronous slab and fiber sampling. For both schemes, we present sufficient conditions on the number of sampled slabs and fibers that guarantee identifiability of the factors of the state tensor. Numerical results demonstrate the ability of the proposed framework to achieve high estimation accuracy in multiple sampling scenarios.

42 ENGINEERING↗

DOE OSTI2023

Department of Energy’s Atmospheric System Research (ASR) Program’s Workshop on the Future of Atmospheric Large Eddy Simulation (LES): Workshop Report

Large-eddy simulation (LES) is used as a tool to understand physical processes such as turbulence, aerosols, clouds, precipitation, radiation, the interactions among all these, and their interactions with the underlying surface. Over the next 10 years, LES will drive fundamental progress in open scientific questions in these areas as LES is increasingly used to gain understanding of complex interacting physical processes involving atmospheric turbulence. This growth will be driven both by scientific demand and the expansion of computational resources needed to conduct LES, and the form that the growth takes will largely be determined by how computational resources are leveraged for scientific gain. In particular, we suggest that computational resources are likely to be leveraged in two separate but not necessarily distinct ways. On one hand, growth in computational resources will allow LES to be made more routine, that is, performed more frequently, while on the other hand, the computational expense (measured in total floating point operations) afforded to individual LES will expand dramatically, allowing simulations to increase in both domain size and resolution as well as physical detail. Current U.S. Department of Energy (DOE) projects such as LES ARM Symbiotic Simulation and Observation Activity (LASSO) are leading the way in conducting routine LES, building large, public databases that are accessible for data science, sensitivity studies, and training for machine learning. LES will also become more routine as it becomes more accessible for individual researchers to address their scientific questions of interest. Scientific questions addressed by LES over the next 10 years are likely to include cloud organization and aggregation; aerosol cloud interactions and atmospheric chemistry (including geo-engineering); urban-scale LES; atmospheric extreme events, ranging from small-scale severe weather to wildfires; and ocean-wave-atmosphere interactions. Further LES-related research will likely grow significantly in areas related to societal impact studies of air quality and extreme weather events, applications to renewable energy forecasting and resource assessment, and aid in decision-making processes. The growth in the use of LES in atmospheric science research will drive the need for better physical process representations (e.g., cloud aerosol microphysics, radiation, and atmospheric chemistry) at the scales resolved by LES. To date, many of the process representations used by LES have been taken directly from coarser-resolution models. Promising methods for LES process representations include superdroplet and quadrature methods for microphysics, 3D approaches for radiation, and better representation of chemistry and aerosol processes. At LES resolution, land-atmosphere interactions for complex terrains, land cover/types, biogeochemistry, and plant canopy models are needed as an improvement beyond traditional and widely used Monin-Obuhkov similarity theory.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Co-Simulation Meets AI: MCP-Driven Power System Analysis

GridGPT, a fine-tuned Generative AI model is designed for on-premise use in grid control rooms. This presentation will demonstrate how eGridGPT can seamlessly integrate with control room solutions to offer operators, engineers, and corporate users enhanced guidance and decision support. It is to show how this innovative AI solution can improve state estimation, boost variable energy forecasting, and optimize grid operations. By leveraging eGridGPT's unique features, audience will learn to unlock new levels of automation, predictive analytics, and reliability within their power systems, ultimately leading to reduced downtime and improved operational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Department of Energy’s Atmospheric System Research (ASR) Program’s Workshop on the Future of Atmospheric Large Eddy Simulation (LES) (Workshop Report)

Large-eddy simulation (LES) is used as a tool to understand physical processes such as turbulence, aerosols, clouds, precipitation, radiation, the interactions among all these, and their interactions with the underlying surface. Over the next 10 years, LES will drive fundamental progress in open scientific questions in these areas as LES is increasingly used to gain understanding of complex interacting physical processes involving atmospheric turbulence. This growth will be driven both by scientific demand and the expansion of computational resources needed to conduct LES, and the form that the growth takes will largely be determined by how computational resources are leveraged for scientific gain. In particular, we suggest that computational resources are likely to be leveraged in two separate but not necessarily distinct ways. On one hand, growth in computational resources will allow LES to be made more routine, that is, performed more frequently, while on the other hand, the computational expense (measured in total floating point operations) afforded to individual LES will expand dramatically, allowing simulations to increase in both domain size and resolution as well as physical detail. Current U.S. Department of Energy (DOE) projects such as LES ARM Symbiotic Simulation and Observation Activity (LASSO) are leading the way in conducting routine LES, building large, public databases that are accessible for data science, sensitivity studies, and training for machine learning. LES will also become more routine as it becomes more accessible for individual researchers to address their scientific questions of interest. Scientific questions addressed by LES over the next 10 years are likely to include cloud organization and aggregation; aerosol cloud interactions and atmospheric chemistry (including geo-engineering); urban-scale LES; atmospheric extreme events, ranging from small-scale severe weather to wildfires; and ocean-wave-atmosphere interactions. Further LES-related research will likely grow significantly in areas related to societal impact studies of air quality and extreme weather events, applications to renewable energy forecasting and resource assessment, and aid in decision-making processes.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

Web-Based Satellite Products Database for Meteorological and Climate Applications

The need for ready access to satellite data and associated physical parameters such as cloud properties has been steadily growing. Air traffic management, weather forecasters, energy producers, and weather and climate researchers among others can utilize more satellite information than in the past. Thus, it is essential that such data are made available in near real-time and as archival products in an easy-access and user friendly environment. A host of Internet web sites currently provide a variety of satellite products for various applications. Each site has a unique contribution with appeal to a particular segment of the public and scientific community. This is no less true for the NASA Langley's Clouds and Radiation (NLCR) website (http://www-pm.larc.nasa.gov) that has been evolving over the past 10 years to support a variety of research projects This website was originally developed to display cloud products derived from the Geostationary Operational Environmental Satellite (GOES) over the Southern Great Plains for the Atmospheric Radiation Measurement (ARM) Program. It has evolved into a site providing a comprehensive database of near real-time and historical satellite products used for meteorological, aviation, and climate studies. To encourage the user community to take advantage of the site, this paper summarizes the various products and projects supported by the website and discusses future options for new datasets.

Phan, Dung↗

NASA NTRS2004

Harnessing Systems Engineering Methodology in Using Earth Science Research Data for Real Applications

For the last three decades, Earth science remote sensing technologies have been providing an enormous amount of useful data and information serving to broaden our understanding of the home planet as a system. NASA's Earth science program has deployed about 18 complex satellites and is in the process of defining and launching multiple observing systems in this decade. At the same time, the European Community and many other countries such as Russia, France, India, Japan, and China have also significantly contributed to Earth science research. To date, the majority of such efforts have concentrated on expanding our scientific understanding of the multiple nonlinear and chaotic processes of Earth's behavior. In recent years, legislators and stakeholders have put serious pressure on the science community to devote more attention to making use of scientific results for societal benefit. For instance, there are a number of areas such as energy forecasting, aviation safety, agricultural efficiency, disaster management, air quality and public health that can directly take advantage of Earth science results to analyze and predict large scale problems and conditions. This is becoming even more important now that we live in a global economy interconnected via the internet and transportation systems; regional environmental conditions can have far reaching impact across continental boundaries. These factors dictate requirements for global data that can help us assess and control the devastating problems of famine, water resources, wildfires, human health and more. To do this requires a serious, organized, and systematic approach that transfers fundamental research products to the applied sciences domain. This paper presents a systems engineering and management process that can effectively make such transfer of data to the user community. Examples are presented on how the above decision making framework can help in solving critical problems such as the spread of vector borne diseases, forecasts of harmful algal blooms as well as forest fires and wildfires, and the intercontinental transport of dust storms and pollution.

Habib, Shahid↗

NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗

NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗