Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Jet stream velocity errors in general circulation models

The longitude and time dependence of excessive wind speed errors above subtropical jets in current GCM forecasts is studied for 14 five-day winter forecasts using the NASA Goddard Laboratory for Atmospheres fourth-order GCM. Several distinct phenomena, which may be divided into four categories, are found to contribute to the excess winds. These categories are: (1) error growth above the jet near the Himalayas; (2) error growth above the jet initiated elsewhere followed by advection; (3) tropical moisture bursts appearing in equatorial regions and migrating northeastward to merge with and distort the jet; and (4) undulatory growth of waves in the meridional component of the jet stream velocity. The results of additional sensitivity studies of the Himalayan region error are also reported.

Tenenbaum, J.↗

Status of the NASA GMAO Observing System Simulation Experiment

An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.

OSSE↗

Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing

A main challenge towards ensuring large-scale and seamless integration of photovoltaic systems is to improve the accuracy of energy yield forecasts, especially in grid areas of high photovoltaic shares. The scope of this paper is to address this issue by presenting a unified methodology for hourly-averaged day-ahead photovoltaic power forecasts with improved accuracy, based on data-driven machine learning techniques and statistical post-processing. More specifically, the proposed forecasting methodology framework comprised of a data quality stage, data-driven power output machine learning model development (artificial neural networks), weather clustering assessment (K-means clustering), post-processing output optimisation (linear regressive correction method) and the final performance accuracy evaluation. The results showed that the application of linear regression coefficients to the forecasted outputs of the developed day-ahead photovoltaic power production neural network improved the performance accuracy by further correcting solar irradiance forecasting biases. The resulting optimised model provided a mean absolute percentage error of 4.7% when applied to historical system datasets. Finally, the model was validated both, at a hot as well as a cold semi-arid climatic location, and the obtained results demonstrated close agreement by yielding forecasting accuracies of mean absolute percentage error of 4.7% and 6.3%, respectively. Finally, the validation analysis provides evidence that the proposed model exhibits high performance in both forecasting accuracy and stability.

42 ENGINEERING↗

System for NIS Forecasting Based on Ensembles Analysis

BMA-NIS is a package/library designed to be called by a script (e.g. Perl or Python). The software itself is written in the language of R. The software assists electric power delivery systems in planning resource availability and demand, based on historical data and current data variables. Net Interchange Schedule (NIS) is the algebraic sum of all energy scheduled to flow into or out of a balancing area during any interval. Accurate forecasts for NIS are important so that the Area Control Error (ACE) stays within an acceptable limit. To date, there are many approaches for forecasting NIS but all none of these are based on single models that can be sensitive to time of day and day of week effects.

Gosink, Luke↗

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Impact of prescribed diabatic heating on short range weather forecasts

Using the 9 layer general circulation model developed at the Goddard Laboratory for Atmospheric Sciences (GLAS), several 4 to 5 day integrations were made to assess the impact that latent heating processes (supersaturation and moist convective) have on the model forecasts. In an earlier study by Shukla (1981) it was hypothesized that because of strong interaction between dynamics and moist convection, small initial errors grow very fast and make short range forecasting difficult. The purpose of this study was to examine if prescribed heating rates can improve the forecasts for a few days.

Marx, L.↗

Cloud Influence on ERA5 and AMPS Surface Downwelling Longwave Radiation Biases in West Antarctica

The surface downwelling longwave radiation component (LW?) is crucial for the determination of the surface energy budget and has significant implications for the resilience of ice surfaces in the polar regions. Accurate model evaluation of this radiation component requires knowledge about the phase, vertical distribution, and associated temperature of water in the atmosphere, all of which control the LW? signal measured at the surface. In this study, we examine the LW? model errors found in the Antarctic Mesoscale Prediction System (AMPS) operational forecast model and the ERA5 reanalysis model relative to observations from the AWARE campaign at McMurdo Station and the West Antarctic Ice Sheet (WAIS) Divide. The errors are calculated separately for observed clear sky conditions, ice cloud occurrences, and liquid-bearing cloud layer (LBCL) occurrences. The analysis results show a tendency (in both models at each site) to underestimate the LW? during clear sky conditions, high error variability (standard deviations > 20 W/m2) during any type of cloud occurrence, and negative LW? biases when LBCLs are observed (bias magnitudes > 15 W/m2 in tenuous LBCL cases; > 43 W/m2 in optically thick/opaque LBCLs instances). We suggest that a generally dry and liquid water-deficient atmosphere responsible for the identified LW? biases in both models is the result of excessive ice formation and growth, which could stem from model initial and lateral boundary conditions, microphysics scheme, aerosol representation, and/or limited vertical resolution.

Silber, Israel↗

MOM: A meteorological data checking expert system in CLIPS

Meteorologists have long faced the problem of verifying the data they use. Experience shows that there is a sizable number of errors in the data reported by meteorological observers. This is unacceptable for computer forecast models, which depend on accurate data for accurate results. Most errors that occur in meteorological data are obvious to the meteorologist, but time constraints prevent hand-checking. For this reason, it is necessary to have a 'front end' to the computer model to ensure the accuracy of input. Various approaches to automatic data quality control have been developed by several groups. MOM is a rule-based system implemented in CLIPS and utilizing 'consistency checks' and 'range checks'. The system is generic in the sense that it knows some meteorological principles, regardless of specific station characteristics. Specific constraints kept as CLIPS facts in a separate file provide for system flexibility. Preliminary results show that the expert system has detected some inconsistencies not noticed by a local expert.

Odonnell, Richard↗

Addressing delayed case reporting in infectious disease forecast modeling

Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always be available. Provided alternatives include excluding recently-reported data and performing sensitivity analysis. This work provides intuition and guidance for handling delay in disease case reporting and may serve as a useful resource to inform practical infectious disease forecasting efforts.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling Plan-Related Clinical Complications Using Machine Learning Tools in a Multiplan IMRT Framework

Purpose: To predict organ-at-risk (OAR) complications as a function of dose-volume (DV) constraint settings without explicit plan computation in a multiplan intensity-modulated radiotherapy (IMRT) framework. Methods and Materials: Several plans were generated by varying the DV constraints (input features) on the OARs (multiplan framework), and the DV levels achieved by the OARs in the plans (plan properties) were modeled as a function of the imposed DV constraint settings. OAR complications were then predicted for each of the plans by using the imposed DV constraints alone (features) or in combination with modeled DV levels (plan properties) as input to machine learning (ML) algorithms. These ML approaches were used to model two OAR complications after head-and-neck and prostate IMRT: xerostomia, and Grade 2 rectal bleeding. Two-fold cross-validation was used for model verification and mean errors are reported. Results: Errors for modeling the achieved DV values as a function of constraint settings were 0-6%. In the head-and-neck case, the mean absolute prediction error of the saliva flow rate normalized to the pretreatment saliva flow rate was 0.42% with a 95% confidence interval of (0.41-0.43%). In the prostate case, an average prediction accuracy of 97.04% with a 95% confidence interval of (96.67-97.41%) was achieved for Grade 2 rectal bleeding complications. Conclusions: ML can be used for predicting OAR complications during treatment planning allowing for alternative DV constraint settings to be assessed within the planning framework.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Improving the MJO Forecast of S2S Operation Models by Correcting Their Biases in Linear Dynamics

The operational dynamic subseasonal to seasonal (S2S) models for Madden-Julian oscillation (MJO) forecasting mostly still suffer from systematic errors in capturing the MJO's key dynamic features, such as its growth rate and propagation speed. By deriving the linear dynamic operators using the linear inverse modeling (LIM) approach, we propose a method to partly correct the errors in MJO linear dynamic operators to improve the MJO predictions of three operational dynamic S2S models. Correcting the deficiencies of the too-fast decay rates and the unrealistic propagating phase speeds lead to MJO prediction skills being extended by approximately 2–4 days. The improvements are more significant for the models with larger biases in MJO amplitude and propagation. This approach in principle may be extendable to predictions of other types of climate variability such as ENSO on one hand, and possible inclusions of nonlinear dynamics effects on the other hand.

58 GEOSCIENCES↗

Constraints on gravity and dark energy from the pairwise kinematic Sunyaev–Zel’Dovich effect

We calculate the constraints on dark energy and cosmic modifications to gravity achievable with upcoming cosmic microwave background (CMB) surveys sensitive to the Sunyaev–Zel’dovich (SZ) effects. The analysis focuses on using the mean pairwise velocity of clusters as observed through the kinematic SZ effect (kSZ), an approach based on the same methods used for the first detection of the kSZ effect, and includes a detailed derivation and discussion of this statistic’s covariance under a variety of different survey assumptions. The potential of current, Stage II, and upcoming, Stages III and IV, CMB observations are considered, in combination with contemporaneous spectroscopic and photometric galaxy observations. A detailed assessment is made of the sensitivity to the assumed statistical and systematic uncertainties in the optical depth determination, the magnitude and uncertainty in the minimum detectable mass, and the importance of pairwise velocity correlations at small separations, where nonlinear effects can start to arise. In combination with Stage III constraints on the expansion history, such as those projected by the Dark Energy Task Force, we forecast 5% and 3% for fractional errors on the growth factor, γ, for Stage III and IV surveys, respectively, and 2% constraints on the growth rate, f{sub g}, for a Stage IV survey for 0.2<z<0.6. The results suggest that kSZ measurements of cluster peculiar velocities, obtained from cross-correlation with upcoming spectroscopic galaxy surveys, could provide robust tests of dark energy and theories of gravity on cosmic scales.

79 ASTRONOMY AND ASTROPHYSICS↗

Lifting primordial non-Gaussianity above the noise

Primordial non-Gaussianity (PNG) in Large Scale Structures is obfuscated by the many additional sources of non-linearity. Within the Effective Field Theory approach to Standard Perturbation Theory, we show that matter non-linearities in the bispectrum can be modeled sufficiently well to strengthen current bounds with near future surveys, such as Euclid. We find that the EFT corrections are crucial to this improvement in sensitivity. Yet, our understanding of non-linearities is still insufficient to reach important theoretical benchmarks for equilateral PNG, while, for local PNG, our forecast is more optimistic. We consistently account for the theoretical error intrinsic to the perturbative approach and discuss the details of its implementation in Fisher forecasts.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Isospin breaking and chiral symmetry restoration

We analyze quark condensates and chiral (scalar) susceptibilities including isospin-breaking effects at finite temperature T. These include m{sub u{ne}}m{sub d} contributions as well as electromagnetic (e{ne}0) corrections, both treated in a consistent chiral Lagrangian framework to leading order in SU(2) and SU(3) chiral perturbation theory, so that our predictions are model-independent. The chiral restoration temperature extracted from <qq>=<uu+dd> is almost unaffected, while the isospin-breaking order parameter <uu-dd> grows with T for the three-flavor case SU(3). We derive a sum rule relating the condensate ratio <qq>(e{ne}0)/<qq>(e=0) with the scalar susceptibility difference {chi}(T)-{chi}(0), directly measurable on the lattice. This sum rule is useful also for estimating condensate errors in staggered lattice analysis. Keeping m{sub u{ne}}m{sub d} allows one to obtain the connected and disconnected contributions to the susceptibility, even in the isospin limit, whose temperature, mass, and isospin-breaking dependence we analyze in detail. The disconnected part grows linearly, diverging in the chiral (infrared) limit as T/M{sub {pi}}, while the connected part shows a quadratic behavior, infrared regular as T{sup 2}/M{sub {eta}}{sup 2}, and coming from {pi}{sup 0{eta}} mixing terms. This smooth connected behavior suggests that isospin-breaking correlations are weaker than critical chiral ones near the transition temperature. We explore some consequences in connection with lattice data and their scaling properties, for which our present analysis for physical masses, i.e. beyond the chiral limit, provides a useful model-independent description for low and moderate temperatures.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Studying the Impact of Distributed Solar PV on Power Systems Using Integrated Transmission and Distribution Models

Rapid growth of distributed energy resources has prompted increasing interest in integrated Transmission (T) and Distribution (D) modeling. This paper presents the results of a distributed generation from solar photovoltaics (DGPV) impact assessment study that was performed using a synthetic T &D model. The primary objective of the study was to present a new approach for DGPV impact assessment, where along with detailed models of transmission and distribution networks, consumer loads were modeled using the physics of end-use equipment, and DGPV was geographically dispersed and connected to the secondary distribution networks. The study highlights (i) how a lack of DGPV forecasting can increase the Area Control Error (ACE) at the transmission level for high penetration levels; and (ii) how capturing transmission voltage changes using integrated T &D can change simulated distribution voltage profiles and voltage regulator operations between integrated T &D and distribution-only simulations.

14 SOLAR ENERGY↗

Determination of damage severity on rotor shaft due to crack using damage index derived from experimental modal data

After long duration of an operation, a shaft under high spin speeds and heavy loadings may develop fatigue cracks. This could lead to catastrophic failure and could be difficult to detect. An accurate prediction of dynamic characteristics of rotor system is fundamentally important. Hence, a practical method to nondestructively locate and estimate the severity of a crack in terms of its damage index by measuring the changes in natural frequencies of the rotor shaft is presented. In this study, experimental modal analysis (EMA) data were utilized. A crack detection algorithm to locate and identify cracks in the rotor system using the first and second natural frequencies was outlined. Subsequently, a crack-locating model was formulated by relating the fractional changes in modal energy to the changes in natural frequencies as a result of cracks based on the experimentally obtained natural frequencies and mode shapes’ functions. The feasibility and practicality of the crack detection scheme were evaluated for several damage scenarios by locating and sizing cracks in test rotor shafts for which the first two natural frequencies were available. It was observed that crack could be confidently located with a relatively small localization error. It was also observed that crack severity could be estimated in terms of its damage index.

42 ENGINEERING↗