Search NASA⌕ Search

SEARCH · Search NASA

Results for “Forecasting accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development of Whole System Digital Twins for Advanced Reactors: Leveraging Graph Neural Networks and SAM Simulations

Here, in this work, we introduce a novel method to develop whole system digital twins (DTs) for advanced nuclear reactors. This method treats a complex reactor system as a heterogeneous graph: with the system components as different types of graph nodes and their physical interconnections as edges. Based on the heterogeneous graph, a graph neural network combining graph convolution and temporal node attention is developed as the DT, facilitating a comprehensive understanding of the system's dynamic behavior. By utilizing the System Analysis Module (SAM) code for simulating various operational transients, we develop a graph-based database that trains the DT. This DT is characterized by two primary functions: It can infer the entire system's status using sparse node information, and it can predict the progress of transients based on current and historical system information. Our approach is validated through case studies on the Experimental Breeder Reactor II (EBR-II) system and a generic Fluoride-salt-cooled High-temperature Reactor (gFHR), demonstrating the DT's accuracy in forecasting operational transients. The DT's rapid computation capabilities enhance its potential for supporting advanced reactor operations, offering benefits in intelligent simulation, autonomous control, and anomaly detection, paving the way for improved safety analysis and intelligent component health management for advanced reactor systems and reducing their operations and maintenance cost.

EBR-II↗
DOE OSTI2025

PQML: Enabling the Predictive Reproducibility on NISQ Machines for Quantum ML Applications

Quantum computing represents a groundbreaking approach to high-performance computing. In recent years, quantum computers have progressed from single-qubit processors to systems boasting over 400 qubits. The presence of such a large number of qubits offers significant advantages, including enhanced computational speed—a capability beyond classical computing methods. However, the current stage of quantum computing is referred to as the noisy intermediate-scale quantum (NISQ) era. The existence of noise in this era presents challenges in testing quantum computing applications, leading to considerable variance in application results. Furthermore, the diverse noise characteristics observed across different machines exacerbate this issue, complicating the selection of the appropriate machine for application execution. In response to these challenges, we introduce our Predictive Quantum Machine Learning (PQML) tool. This tool is designed to predict outcomes when executing identical quantum machine learning applications—specifically, a critical suite of variational quantum algorithms—across various quantum computers during the NISQ era. This effort relies on data collected over a 12-month period. To the best of our knowledge, this study represents the first attempt to ensure reproducibility across quantum computers for complex circuits. Additionally, we have developed a model capable of forecasting the accuracy of quantum computers for variational quantum algorithms, with a particular emphasis on quantum machine learning as a case study.

Senapati, Priyabrata [Kent State University]↗
DOE OSTI2024

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1974

On the remote sensing of directional wave spectra and surface winds

The potential benefits of remote SEASAT-A satellite sensing of wind directional wave spectra by active microwave systems are elaborated. It is shown that a combined effort which uses supplemental satellite information in numerical forecasting and hindcasting schemes upgrades the accuracy of existing forecasting methods of an order of magnitude.

Shemdin, O. H.↗
NASA NTRS1984

Simulation Experiments on the Relative Accuracy of Inferred Atmospheric States from Idealized Wind and Temperature Profiling Systems

The First GARP Global Experiment (FGGE) led to the planning, design and implementation of a global observing system. Technologies as coherent CO2 LIDAR systems and highly sensitive IR detectors offer the potential of more accurate global spaceborne observation systems. The advent of super computers allows general circulation modeling and more sophisticated data analysis schemes. The consideration of advanced spaceborne systems better suited to meet the new emerging requirements are suggested. The Global Weather Experiment provides us with a new baseline to assess data accuracy and forecasting capabilities which is used for study of the incremental performance.

Halem, M.↗
NASA NTRS1994

Accuracy analysis of TDRSS demand forecasts

This paper reviews Space Network (SN) demand forecasting experience over the past 16 years and describes methods used in the forecasts. The paper focuses on the Single Access (SA) service, the most sought-after resource in the Space Network. Of the ten years of actual demand data available, only the last five years (1989 to 1993) were considered predictive due to the extensive impact of the Challenger accident of 1986. NASA's Space Network provides tracking and communications services to user spacecraft such as the Shuttle and the Hubble Space Telescope. Forecasting the customer requirements is essential to planning network resources and to establishing service commitments to future customers. The lead time to procure Tracking and Data Relay Satellites (TDRS's) requires demand forecasts ten years in the future a planning horizon beyond the funding commitments for missions to be supported. The long range forecasts are shown to have had a bias toward underestimation in the 1991 -1992 period. The trend of underestimation can be expected to be replaced by overestimation for a number of years starting with 1998. At that time demand from new missions slated for launch will be larger than the demand from ongoing missions, making the potential for delay the dominant factor. If the new missions appear as scheduled, the forecasts are likely to be moderately underestimated. The SN commitment to meet the negotiated customer's requirements calls for conservatism in the forecasting. Modification of the forecasting procedure to account for a delay bias is, therefore, not advised. Fine tuning the mission model to more accurately reflect the current actual demand is recommended as it may marginally improve the first year forecasting.

Stern, Daniel C.↗
NASA NTRS2003

Transferring Knowledge from Observations and Models to Decision Makers: An Overview and Challenges

Over the last 25 years, a tremendous progress has been made in the Earth science space-based remote sensing observations, technologies and algorithms. Such advancements have improved the predictability by providing lead-time and accuracy of forecast in weather, climate, natural hazards, and natural resources. It has further reduced or bounded the overall uncertainties by partially improving our understanding of planet Earth as an integrated system that is governed by non-linear and chaotic behavior. Many countries such US, European Community, Japan, China and others have invested billions of dollars in developing and launching space-based assets in the low earth (LEO) and geostationary (GEO) orbits. However, the wealth of this scientific knowledge that has potential of extracting monumental socio-economic benefits from such large investments have been slow in reaching to public and decision makers. For instance, there are a number of areas such as energy forecasting, aviation safety, agricultural competitiveness, disaster management, security, air quality and public health can directly take advantage. Nevertheless, we all live in a global economy that depends on access to the best available Earth Science information for all inhabitants of this planet. This paper surveys and examines a number such applications in terms of their architecture, maturity and economic applicability as they apply to the societal needs. A detailed analysis is also presented of various challenges and issues that pertain to a number of areas such as: (1) difficulties in making a speedy transition of data and information from observations and models to relevant Decision Support Systems (DSS) or tools, (2) data and models inter-operability issues, (3) limitations of spatial, spectral and temporal resolution, (4) communication limitations as dictated by the availability of image processing and data compression techniques. Additionally, the most critical element amongst all is the organizational and management boundaries that must be resolved at local, state, national and international levels to implement and realize free flow of such vital information. This paper also makes attempts to address this topic and discuss possible approaches to deal with this quandary.

Habib, Shahid↗
NASA NTRS2010

Utilizing Earth Observations for Societal Issues

Over the last four decades a tremendous progress has been made in the Earth science space-based remote sensing observations, technologies and algorithms. Such advancements have improved the predictability by providing lead-time and accuracy of forecast in weather, climate, natural hazards, and natural resources. It has further reduced or bounded the overall uncertainties by partially improving our understanding of planet Earth as an integrated system that is governed by non-linear and chaotic behavior. Many countries such as the US, European Community, Japan, China, Russia, India has and others have invested billions of dollars in developing and launching space-based assets in the low earth (LEO) and geostationary (GEO) orbits. However, the wealth of this scientific knowledge that has potential of extracting monumental socio-economic benefits from such large investments have been slow in reaching the public and decision makers. For instance, there are a number of areas such as water resources and availability, energy forecasting, aviation safety, agricultural competitiveness, disaster management, air quality and public health, which can directly take advantage. Nevertheless, we all live in a global economy that depends on access to the best available Earth Science information for all inhabitants of this planet. This presentation discusses a process to transition Earth science data and products for societal needs including NASA's experience in achieving such objectives. It is important to mention that there are many challenges and issues that pertain to a number of areas such as: (1) difficulties in making a speedy transition of data and information from observations and models to relevant Decision Support Systems (DSS) or tools, (2) data and models inter-operability issues, (3) limitations of spatial, spectral and temporal resolution, (4) communication limitations as dictated by the availability of image processing and data compression techniques. Additionally, the most critical element amongst all is the organizational and management boundaries that must be resolved at local, state, national and international levels to implement and realize free flow of such vital information.

Habib, Shahid↗
NASA NTRS1985

The impact of data density and data error on the evolution of mesoscale forecast error

The effects of data density and data errors on the accuracy of mesoscale weather forecasts were assessed by simulations of a period in February 1979 when a snowstorm occurred along the U.S. eastern seaboard. The simulations were initiated every 12 hr and the growth of the rms error was tracked as a function of time and varying data densities. A uniform grid of instrumentation separation and perfect boundary conditions were assumed for all the simulations. A bias error representation was defined to account for systematic measurement errors. A brief summary of features of the somewhat complex storm is provided, together with the parameters of the 11 different simulations with high, medium and low data densities. The accuracy of the forecasts were proportional to the data density, although the error decreased for all the simulations over a 24 hr period. The density of the vertical data had a significant impact on the accuracy of the forecast, whereas the horizontal data density did not. Finally, pathways by which errors were transferred among variables were identified.

Warner, T. T.↗
DOE OSTI2020

Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing

A main challenge towards ensuring large-scale and seamless integration of photovoltaic systems is to improve the accuracy of energy yield forecasts, especially in grid areas of high photovoltaic shares. The scope of this paper is to address this issue by presenting a unified methodology for hourly-averaged day-ahead photovoltaic power forecasts with improved accuracy, based on data-driven machine learning techniques and statistical post-processing. More specifically, the proposed forecasting methodology framework comprised of a data quality stage, data-driven power output machine learning model development (artificial neural networks), weather clustering assessment (K-means clustering), post-processing output optimisation (linear regressive correction method) and the final performance accuracy evaluation. The results showed that the application of linear regression coefficients to the forecasted outputs of the developed day-ahead photovoltaic power production neural network improved the performance accuracy by further correcting solar irradiance forecasting biases. The resulting optimised model provided a mean absolute percentage error of 4.7% when applied to historical system datasets. Finally, the model was validated both, at a hot as well as a cold semi-arid climatic location, and the obtained results demonstrated close agreement by yielding forecasting accuracies of mean absolute percentage error of 4.7% and 6.3%, respectively. Finally, the validation analysis provides evidence that the proposed model exhibits high performance in both forecasting accuracy and stability.

42 ENGINEERING↗
DOE OSTI2022

Forecasted Dynamic Line Ratings for Regional Transmission Lines

This report was prepared for the Wind Energy Technology Office for the FY 2022, quarter 3 deliverable. This details the use of forecasted dynamic line rating as an improvement over static rating for three transmission lines in three regions of interest. A selection of wind plants across Idaho, the Columbia River Gorge and offshore wind in the NYSERDA territory were modeled for their concurrent cooling effects for dynamic line rating. Regional transmission lines for the wind plant interconnections were determined and a CFD domain was created to determine local wind flows over the lines. A dynamic line rating for each of the lines was calculated for both weather observation data and HRRR model forecast data. The comparison of peaks in the wind power production were compared to the DLR peaks. It was determined that for shorter regional transmission lines, the effect of concurrent cooling that commonly occur with gen-tie lines were still valid. Concurrent cooling effects drop as the length of the regional transmission lines increase in distance from the wind plants. In addition, the accuracy of the forecasted ampacity to the weather observation data for ampacity was assessed. In general, the accuracy was best for the INL region with the NOAA-maintained sites. The Columbia River Gorge and Long Island sites showed similar levels of accuracy for the forecasted DLR. The accuracy levels were around 11% for the INL region, 15% for Columbia River Gorge and 7% for New York Long Island. The higher error for the Columbia Gorge region is likely due to the sparse availability of weather stations available, whereas both the INL site and Long Island are well instrumented.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2004

Tropospheric Airborne Meteorological Data Reporting (TAMDAR) Sensor Development

One of the recommendations of the National Aviation Weather Program Council was to expand and institutionalize the generation, dissemination, and use of automated pilot reports (PIREPS) to the full spectrum of the aviation community, including general aviation. In response to this and other similar recommendations, NASA initiated cooperative research into the development of an electronic pilot reporting capability (Daniels 2002). The ultimate goal is to develop a small low-cost sensor, collect useful meteorological observations below 25,000 ft., downlink the data in near real time, and use the data to improve weather forecasts. Primary users of the data include pilots, who are one targeted audience for the improved weather information that will result from the TAMDAR data. The weather data will be disseminated and used to improve aviation safety by providing pilots with enhanced weather situational awareness. In addition, the data will be used to improve the accuracy and timeliness of weather forecasts. Other users include air traffic controllers, flight service stations, and airline weather centers. Additionally, the meteorological data collected by TAMDAR is expected to have a significant positive impact on forecast accuracy for ground based applications.

Daniels, Taumi S.↗
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2021

Machine learning based algorithms for uncertainty quantification in numerical weather prediction models

Complex numerical weather prediction models incorporate a variety of physical processes, each described by multiple alternative physical schemes with specific parameters. The selection of the physical schemes and the choice of the corresponding physical parameters during model configuration can significantly impact the accuracy of model forecasts. There is no combination of physical schemes that works best for all times, at all locations, and under all conditions. It is therefore of considerable interest to understand the interplay between the choice of physics and the accuracy of the resulting forecasts under different conditions. This paper demonstrates the use of machine learning techniques to study the uncertainty in numerical weather prediction models due to the interaction of multiple physical processes. The first problem addressed herein is the estimation of systematic model errors in output quantities of interest at future times, and the use of this information to improve the model forecasts. The second problem considered is the identification of those specific physical processes that contribute most to the forecast uncertainty in the quantity of interest under specified meteorological conditions. In order to address these questions we employ two machine learning approaches, random forests and artificial neural networks. The discrepancies between model results and observations at past times are used to learn the relationships between the choice of physical processes and the resulting forecast errors. Numerical experiments are carried out with the Weather Research and Forecasting (WRF) model. The output quantity of interest is the model precipitation, a variable that is both extremely important and very challenging to forecast. The physical processes under consideration include various micro-physics schemes, cumulus parameterizations, short wave, and long wave radiation schemes. The experiments demonstrate the strong potential of machine learning approaches to aid the study of model errors.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Error-Level-Controlled Synthetic Forecasts for Renewable Generation

Renewable energy resources, including solar and wind energy, play a significant role in sustainable energy systems. However, the inherent uncertainty and intermittency of renewable generation pose challenges to the safe and efficient operation of power systems. Recognizing the importance of short-term (hours ahead) renewable generation forecasting in power systems operation, it becomes crucial to address the potential inaccuracies in these forecasts. To systematically evaluate the performance of controllers in the presence of imperfect forecasts, we generate synthetic forecasts using actual renewable generation profiles (one from solar and one from wind). These synthetic forecasts incorporate different levels of statistical error, allowing us to control and manipulate the accuracy of the predictions. The primary objective is to employ synthetic forecasts with controlled yet realistic error levels to systematically investigate how controllers adapt to variations in forecast accuracy, providing valuable insights into their robustness and effectiveness under real-world conditions.

Array↗
DOE OSTI2022

Evaluating WRF-Solar EPS cloud mask forecast using the NSRDB

Improving the accuracy of day-ahead solar forecasts using numerical weather prediction models requires improving the forecasting of cloud occurrence and properties. Validating cloud forecasts is challenging because this requires evaluating different types of clouds over a wide variety of regions. This study analyzes the cloud occurrence (or cloud mask) over the contiguous United States (CONUS), predicted by the Weather Research and Forecasting-Solar Ensemble Prediction System (WRF-Solar EPS), to identify the strengths and limitations of the model in reproducing cloud fields. To enable the in-depth analysis of cloud mask forecasts covering CONUS, we use satellite observations from the National Solar Radiation Database (NSRDB). Two evaluation methods are implemented to consider all clouds and partially removed clouds from the 2-km NSRDB in evaluating the 9-km WRF-Solar EPS cloud mask. Cloud detection metrics as well as the frequency of cloud occurrence are used to quantify the monthly performance of WRF-Solar EPS. Mismatched cloud frequency (MCF) is used to assess the model's capability to predict different types of clouds, which are classified using three levels of cloud optical depth (COD) and cloud top height (CTH). The day-ahead forecasts covering the full year of 2018 demonstrate that WRF-Solar EPS produces MCFs ranging from 27%-46%, 13%-34%, and 8%-19% for thin, mid-thickness, and thick clouds, respectively. For three CTH levels, the model shows MCFs ranging from 19%-46%, 16%-33%, and 8%-27% for low-level, middle-level, and high-level clouds, respectively. This comprehensive characterization of model performance helps identify model weakness and will eventually lead to improvements in cloud and solar radiation forecasting.

14 SOLAR ENERGY↗
NASA NTRSDate not supplied

Importance of Radiative Transfer Models in Atmospheric Remote Sensing

Radiative transfer models (RTMs) play a significant role in the development of satellite instruments for remote sensing applications. These models simulate electromagnetic radiation's propagation through the atmosphere, providing valuable insights into atmosphere-radiation interactions. RTMs facilitate the optimization of satellite instrument designs, ensuring their ability to measure targeted atmospheric and surface properties accurately. Moreover, they aid in simulating instrument’s measurements under various atmospheric conditions, enabling calibration and validation processes to enhance data quality and reliability. RTMs are extensively used in the Observing System Simulation Experiments (OSSE), to generate synthetic observations. By incorporating RTMs into OSSE, we can assess the potential impact of future satellite missions, sensor configurations, and data assimilation techniques. This approach allows for the optimization of satellite instruments and constellations and the evaluation of their influence on weather forecasting, climate monitoring, and other Earth science applications. Another crucial application area of RT models is data assimilation, where they play a fundamental role in combining satellite observations with numerical models to improve atmospheric and environmental predictions. RTMs provide the link between observed radiances and atmospheric parameters, enhancing the accuracy of numerical models and generating more reliable forecasts for weather events, air quality assessments, and climate projections. Moreover, adapting RT models to capture the intricate radiation interactions within the Planetary Boundary Layer will significantly contribute to improving weather forecasting and climate change projections. Current community radiative transfer (RT) models are primarily developed and optimized for operational data assimilation of satellite observations. These models excel at assimilating satellite data into numerical weather prediction models to improve forecast accuracy. However, their focus on data assimilation limits their suitability for other important applications, such as satellite instrument development, OSSE, and Planetary Boundary Layer (PBL) studies. Moreover, for PBL studies, RT models need to be adapted to capture the intricate radiation interactions within this crucial atmospheric layer. Developing RT models that can represent the PBL's unique characteristics, such as surface interactions, will contribute significantly to understanding and predicting weather phenomena, air quality, and climate dynamics. This abstract provides a comprehensive overview of the current status of RT models and highlights their limitations concerning satellite instrument development, OSSE, and PBL studies. Addressing these shortcomings requires concerted efforts to enhance RT models' capabilities and expand their applications beyond data assimilation. By investing in research and development to improve these

Isaac Moradi↗