Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

The large scale polarization explorer (LSPE) for CMB measurements: performance forecast

The measurement of the polarization of the Cosmic Microwave Background (CMB) radiation is one of the current frontiers in cosmology. In particular, the detection of the divergence-free component of the polarization field, the B-mode component, reveals the presence of gravitational waves in the early Universe. The detection of such component is at the moment the most promising technique to probe the inflationary theory describing the very early evolution of the Universe. The measurement of the polarization of the Cosmic Microwave Background (CMB) radiation is one of the current frontiers in cosmology. In particular, the detection of the primordial divergence-free component of the polarization field, the B-mode, could reveal the presence of gravitational waves in the early Universe. The detection of such a component is at the moment the most promising technique to probe the inflationary theory describing the very early evolution of the Universe. We present the updated performance forecast of the Large Scale Polarization Explorer (LSPE), a program dedicated to the measurement of the CMB polarization. LSPE is composed of two instruments: LSPE-Strip, a radiometer-based telescope on the ground in Tenerife-Teide observatory, and LSPE-SWIPE (Short-Wavelength Instrument for the Polarization Explorer) a bolometer-based instrument designed to fly on a winter arctic stratospheric long-duration balloon. The program is among the few dedicated to observation of the Northern Hemisphere, while most of the international effort is focused into ground-based observation in the Southern Hemisphere. Measurements are currently scheduled in Winter 2022/23 for LSPE-SWIPE, with a flight duration up to 15 days, and in Summer 2022 with two years observations for LSPE-Strip. In this work, we describe the main features of the two instruments, identifying the most critical aspects of the design, in terms of impact on the performance forecast. We estimate the expected sensitivity of each instrument and propagate their combined observing power to the sensitivity to cosmological parameters, including the effect of scanning strategy, component separation, residual foregrounds and partial sky coverage. We also set requirements on the control of the most critical systematic effects and describe techniques to mitigate their impact. LSPE will reach a sensitivity in tensor-to-scalar ratio of σr < 0.01, set an upper limit r < 0.015 at 95% confidence level, and improve constraints on other cosmological parameters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Considering the Variability of Soiling in Long-Term PV Performance Forecasting

This study presents the development of a methodology for evaluating the variability associated with soiling on long-term photovoltaic (PV) forecasting. Independent engineering firms typically build forecasts for large PV plants through the use of the PVsyst software, where monthly soiling losses are one of many inputs to the P50 model. Subsequently, long-term performance distributions are constructed through a Monte Carlo analysis that includes various factors, such as satellite irradiance modeling uncertainty, uncertainty in the PVsyst model, and long-term irradiance variability. Often the PVsyst model uncertainty is increased to account for sites with significant soiling concerns but no systematic method has been presented in the literature to specifically include soiling variability within long-term performance uncertainty. In this work soiling information from 16 sites in the U.S. Southwest are combined with 24 years of rainfall data to generate 24 years of energy production with soiling losses and then subsequently generate probability of exceedance values (e.g., P50, P90, P95…). The results show that the size of the 90% confidence interval (P5–P95) can increase from –0.7% to 10.1% when interannual soiling variability and soiling rate uncertainty is included.

14 SOLAR ENERGY↗
DOE OSTI2023

Considering the Variability of Soiling in Long-Term PV Performance Forecasting: Preprint

This study presents the development of a methodology for evaluating the variability associated with soiling on long-term PV forecasting. Independent engineering firms typically build P50 forecasts for large PV plants through the use of the PVsyst software, where monthly soiling losses are one of many inputs to the P50 model. Subsequently, long-term performance distributions, or Pvalues, are constructed through a Monte Carlo analysis that includes various factors such as: satellite irradiance modeling uncertainty, uncertainty in the PVsyst model, and long-term irradiance variability. Often the PVsyst model uncertainty is increased to account for sites with significant soiling concerns but no systematic method has been presented in the literature to specifically include soiling variability within Pvalues. In this work soiling information from 16 sites in the U.S. Southwest are combined with 20 years of rainfall data to generate 20 years of energy production with soiling losses and then subsequently generate Pvalues. The results show that the spread of Pvalues (P1-P99) can increase from 0-13% when interannual soiling variability is included.

interannual variability↗
DOE OSTI2026

An Uncertainty-Informed and High-Fidelity Performance Forecasting Framework for Heliostat Fields

Concentrating Solar Thermal (CST) tower systems employ heliostat fields to direct solar energy to a central receiver, which then transfers the heat either directly to a thermal process (e.g., steam production) or to a thermal energy storage system for future use. Heliostat fields compose a significant proportion of the project costs of a CST tower system and the performance of the heliostats determines a plant's productivity at a given location. While CST characterization tools such as SolarPILOT and System Advisor Model (SAM) include a large collection of inputs that influence the performance of a CST tower system, many are uncertain prior to the development of the project and may have a significant impact on the overall energy delivery and profitability of a project; moreover, the fidelity of these models under default conditions may be insufficient to determine the value of component improvements such as those under development in the Heliostat Consortium. This work introduces a Monte Carlo simulation framework that incorporates uncertainty in key performance parameters to generate confidence intervals and percentile estimates for a CST solar field's energy delivery.

14 SOLAR ENERGY↗
DOE OSTI2023

A Performance Forecasting Framework for Concentrating Solar Power Systems

This presentation will summarize a methodology used to characterize the uncertainty in performance of a contrived CSP project. As well as develop a case study in which we backcast the projected and actual annual performance of an existing plant. Finally will highlight the importance of several assumptions and the use of time series inputs in obtaining realistic estimates.

concentrating solar power↗
NASA NTRS2020

Evaluating Flood Forecasting System Performance in Cambodia

Every year, Cambodia experiences flooding as a result of monsoon rains and typhoons. Flood forecasting systems are designed to enable people to mitigate economic and social impacts from these events. However, in order for forecasts to be used effectively, an assessment of their accuracy is needed. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times and gauge locations in Cambodia. We then compare the flood forecast performance to satellite-based flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to flood extents helps (1) provide valuable information to forecasters and disaster managers as they make improvements to their models, and (2) provides support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire↗
NASA NTRS2019

Evaluating Flood Forecasting System Performance in Cambodia During the 2019 Flood Season

Every year, Cambodia experiences both flash and prolonged riverine flooding as a result of monsoon rains and typhoons. Floods occur frequently in various parts of the region, and result in significant economic cost. Flood forecasting systems are designed to mitigate economic and social impacts, enabling people to prepare for extreme events. However, in order for forecasts to be used effectively, an assessment of the available forecasting systems is needed. In addition, following the onset of flooding, satellite imagery is used to generate flood maps to aid in response efforts. This study demonstrates the performance of regional and global flood forecasting systems over the 2019 flood season. To do this, we assess the flood forecast accuracy at different forecast lead times through a series of forecast verification metrics at gauge locations in Cambodia. We then compare the flood forecast performance to Sentinel 1 flood maps produced by the Hydrological Remote Sensing Analysis of Floods (HYDRAFloods) tool currently being co-developed by SERVIR-Mekong in collaboration with the Myanmar Department of Disaster Management. This assessment of the flood forecasting systems’ performance and comparison to generated flood maps helps provide context to forecasters and disaster managers as they make improvements to their models. Additionally, these results provide support to forecast users as they evaluate the strengths and weaknesses of different systems for taking action.

Nauman, Claire M.↗
NASA NTRS2017

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗
DOE OSTI2023

A general spatial-temporal framework for short-term building temperature forecasting at arbitrary locations with crowdsourcing weather data

Weather forecasting has been a critical component to predict and control building energy consumption for better building energy management. Without accessibility to other data sources, the onsite observed temperatures or the airport temperatures are used in forecast models. In this paper, we present a novel approach by utilizing the crowdsourcing weather data from neighboring personal weather stations (PWS) to improve the weather forecast accuracy around buildings using a general spatial-temporal modeling framework. The final forecast is based on the ensemble of local forecasts for the target location using neighboring PWSs. Our approach is distinguished from existing literature in various aspects. First, we leverage the crowdsourcing weather data from PWS in addition to public data sources. In this way, the data is at much finer time resolution (e.g., at 5-minute frequency) and spatial resolution (e.g., arbitrary location vs grid). Second, our proposed model incorporates spatial-temporal correlation information of weather variables between the target building and a set of neighboring PWSs so that underlying correlations can be effectively captured to improve forecasting performance. Here, we demonstrate the performance of the proposed framework by comparing to the benchmark models on temperature forecasting for a building located at an arbitrary location at San Antonio, Texas, USA. In general, the proposed model framework equipped with machine learning technique such as Random Forest can improve forecasting by 50% compares with persistent model and has 90% chance to outperform airport forecast in short-term forecasting. In a real-time setting, the proposed model framework can provide more accurate temperature forecasting results compared with using airport temperature forecast for most forecast horizon. Moreover, we analyze the sensitivity of model parameters to gain insights on how crowdsourcing data from the neighboring personal weather stations impacts forecasting performance. Finally, we implement our model in other cities such as Syracuse and Chicago to test the model's performance in different landforms and climate types.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2019

Forecasting the Ambient Solar Wind with Numerical Models. I. On the Implementation of an Operational Framework

The ambient solar wind conditions in interplanetary space and in the near-Earth environment are determined by activity on the Sun. Steady solar wind streams modulate the propagation behavior of interplanetary coronal mass ejections and are themselves an important driver of recurrent geomagnetic storm activity. The knowledge of the ambient solar wind flows and fields is thus an essential component of successful space weather forecasting. Here, we present an implementation of an operational framework for operating, validating, and optimizing models of the ambient solar wind flow on the example of Carrington Rotation 2077. We reconstruct the global topology of the coronal magnetic field using the potential field source surface model (PFSS) and the Schatten current sheet model (SCS) and discuss three empirical relationships for specifying the solar wind conditions near the Sun, namely the Wang–Sheeley (WS) model, the distance from the coronal hole boundary model (DCHB), and the Wang-Sheeley–Arge (WSA) model. By adding uncertainty in the latitude about the sub-Earth point, we select an ensemble of initial conditions and map the solutions to Earth by the Heliospheric Upwind eXtrapolation (HUX) model. We assess the forecasting performance from a continuous variable validation and find that the WSA model most accurately predicts the solar wind speed time series (RMSE≈83 km/s). We note that the process of ensemble forecasting slightly improves the forecasting performance of all solar wind models investigated. We conclude that the implemented framework is well suited for studying the relationship between coronal magnetic fields and the properties of the ambient solar wind flow in the near-Earth environment.

Reiss, Martin A.↗
DOE OSTI2026

VRN3P: Variational Recurrent Neural Network Based Net-Load Prediction under High Solar Penetration

This is the final technical report for the SETO-funded VRN3P project (PNNL# 76914). The goal of this project, led by Pacific Northwest National Laboratory (PNNL), in collaboration with Lawrence Livermore National Laboratory (LLNL) and Portland General Electric (PGE), was to develop and validate a deep variational recurrent neural network-based net-load prediction (VRN3P) framework for probabilistic time-series forecasting of day-ahead net-load under high solar penetration scenarios. The project team reports successful design of a novel probabilistic net-load forecasting architecture, comprising of a variational autoencoder and a recurrent neural network, which demonstrates 30% improvement in forecast performance, 60% improvement in training time, and consumes 44% less memory, when compared with conventional baseline models. The team tested the VRN3P model performance on GridLAB-D test-cases representing varying BTM solar penetration levels of 20%, 30%, and 50%, with integrated time-series net-load profiles provided by the utility partner (PGE). The VRN3P model demonstrate <2% hourly MAPE (averaged over the year) for day- ahead net-load forecast on the test scenario with 20% BTM solar. Transfer learning extension of the VRN3P model has demonstrated 8.33× speed-up in training, while still achieving acceptable forecast performance of 2.24% hourly MAPE on the 30% BTM solar penetration test-scenario. A preliminary version of the VRN3P GridAPPS-D™has been developed, along with a web-based interactive user-interface (named ‘Forte’) which has made available on GitHub for public use.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Evaluation of Aerosol Data Assimilation and Forecasts in the NASA GEOS Model during the ASIA-AQ Campaign

Fine particulate matter (PM2.5) poses significant risks to human health and the environment by penetrating the lungs and causing respiratory and cardiovascular diseases, making it crucial to understand its sources and behavior for effective air quality management. The Goddard Earth Observing System (GEOS) Forward Processing (FP) system model, operated by the Global Modeling and Assimilation Office (GMAO) at NASA's Goddard Space Flight Center, provides real-time weather and aerosol analyses and forecasts. In addition to meteorological data assimilation, the GEOS-FP system also assimilates aerosol using Moderate Resolution Imaging Spectroradiometer (MODIS) Aerosol Optical Depth (AOD) and Aerosol Robotic Network (AERONET) AOD data. In this study, the aerosol data assimilation and forecasts performance of the GEOS-FP model were evaluated for predicting PM2.5 in Korea using observations from the Airborne and Satellite Investigation of Asian Air Quality (ASIA-AQ) campaign. The ASIA-AQ campaign, an international collaborative field study initiative, aims to enhance understanding of local air quality issues and address common challenges in interpreting satellite data and air quality modeling. Conducted in South Korea from February 15 to March 13, 2024, during the high PM2.5 concentration winter season, this campaign provided extensive airborne and ground observations for intensive analysis of PM2.5 model simulations. We demonstrate how the assimilation runs and the forecasting performance of PM2.5 at 24-hour and 48-hour intervals vary. Additionally, we analyzed the differences and characteristics of PM2.5 composition in cases of long-range transport and local emissions. Using ASIA-AQ airborne data, we also examined the vertical profile of fine particulate matter. Through the intensive observations of this campaign, the GEOS model was assessed over South Korea using both in situ and airborne measurements to establish a baseline and identify priorities for future development.

Seunghee Lee↗
NASA NTRS2024

Multi-Agency Ensemble Forecast of Wildfire Air Quality in the United States: Toward Community Consensus of Early Warning

Wildfires pose increasing risks to human health and properties in North America. Due to large uncertainties in fire emission, transport, and chemical transformation, it remains challenging to accurately predict air quality during wildfire events, hindering our collective capability to issue effective early warnings to protect public health and welfare. Here we present a new real-time Hazardous Air Quality Ensemble System (HAQES) by leveraging various wildfire smoke forecasts from three U.S. federal agencies (NOAA, NASA, and Navy). Compared to individual models, the HAQES ensemble forecast significantly enhances forecast accuracy. To further enhance forecasting performance, a weighted ensemble forecast approach was introduced and tested. Compared to the unweighted ensemble mean, the multilinear regression weighted ensemble reduced fractional bias by 34% in the major fire regions, false alarm rate by 72%, and increased hit rate by 17%. Finally, we improved the weighted ensemble using quantile regression and weighted regression methods to enhance the forecast of extreme air quality events. The advanced weighted ensemble increased the PM2.5 exceedance hit rate by 55% compared to the ensemble mean. Our findings provide insights into the development of advanced ensemble forecast methods for wildfire air quality, offering a practical way to enhance decision-making support to protect public health.

Yunyao Li↗
DOE OSTI2024

PV Generation and Load Forecasting for Adjuntas PR Community Microgrids

Existing frameworks to forecast time-series photovoltaic (PV) output power and consumer load for microgrid operations and controls assume a near-continuous availability of real-time input features from the field assets such as PV inverters, energy meters, and weather station. These incoming data points are used to periodically retrain models and update forecast snapshots over a moving horizon window, be it one hour-ahead, one-day ahead, or one-week ahead. However, such frameworks are not resilient to disruptions in data availability caused by losses in communications between the field sensors and data loggers. Hence, there is a need for programs that assume no availability of real-time microgrid asset data and still make reliable forecasts that can be used for decision-making. Such programs would be apt to function in extreme weather events such as hurricanes and would use lightweight recursive time-series models to independently forecast solar irradiance and ambient temperature, then compute PV power from those forecasts, as well as independently forecast consumer load. The codebase performs forecasting for the scenario of when the microgrid does not have a reliable access to forecasts or real-time observations of solar irradiance (I) and ambient temperature (AT) and load (Load) to be able to adequately forecast, in real-time, the PV power production or a business' load. In this case, using historical values of PV power and load, a univariate forecasting of generation and consumption are respectively made. The use-case in particular has two sub-scenarios: one, a normal 7-day ahead forecast where the unavailability of real-time data is assumed due to infrastructure issues such as loss of communication or sensor maintenance or service downtimes. Whereas a hurricane-caused unavailability of real-time data requires a second model trained specifically on historical hurricane days to be able to capture the extreme day behavior of generation in particular, and load if applicable. A gradient boosted regression tree comprises an ensemble of additive models that map between the input of historical values (be it irradiance, temperature, or load) and their corresponding output forecasts of a given horizon such that the individual learner predictions are summed up over the total number of such learners in the ensemble to produce an aggregate forecast. A weighting mechanism is applied to the training data in each iteration, where actual and forecast values are compared to penalize incorrect forecasts by increasing the weight and reducing it to reward correct forecasts. The code's benefits are that it: (a) accounts for a contingency where communication loss renders newly measured real-time data unavailable for model tuning and snapshot updates; (b) presents blind forecasting that recursively determines the next time-step value in a horizon using the forecast of the same attribute from a prior step; and (c) employs lightweight models that, once trained, can reliably generalize for different horizons, which make them suitable for enhancing the resilience of field microgrids prone to extreme events that encounter disruptions to data availability.

Sundararajan, Aditya [Oak Ridge National Laborator↗
NASA NTRS2019

A Validation Study of the Performance Prediction Methodology of the Early Warning Metrics

Complex projects frequently experience delays and develop backlogs of their project control milestones during the acquisition and development lifecycles. In response, the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) formed an independent group of Subject Matter Experts (SMEs) to monitor the execution performance of GSFC Flight projects and instruments that are under development. The SME team’s objective is to generate data driven performance-based indicators that quantify the degree to which projects are meeting their respective schedule and budget commitments. One of these performance-based indicators, the Early Warning Metrics, provides performance forecasts and insight to project performance relative to historical successful projects. Herein this paper describes the purpose and utility of the Early Warning Metrics. Additionally, the initial prediction method used in the creation of the metrics is described along with its validity and the validity of comparable prediction methods.

Holloman, Sherrica↗