Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Dynamic Bayesian Networks for Fault Prognosis

A dynamic Bayesian Network (DBN)-based fault prognosis framework is proposed in this study to predict the future fault probabilities of gradual faults. The proposed framework utilizes the trend in prediction error generated from data driven forecasting models to estimate the future fault beliefs. The accuracy and scalability of the proposed method is evaluated using the data from a Modelica-based virtual testbed. Overall, the developed framework demonstrates good potential in estimating future fault probabilities of gradual faults.

Pradhan, Ojas↗

Measuring software development characteristics in the local environment

In a brief evaluation of software-related considerations, it is found that suitable approaches for software development depend to a large degree on the characteristics of the particular project involved. An analysis is conducted of development problems in an environment in which ground support software is produced for spacecraft control. The amount of work involved is in the range from 6 to 10 man-years. Attention is given to a general project summary, a programmer/analyst survey, a component summary, a component status report, a resource summary, a change report, a computer program run analysis, aspects of data collection on a smaller scale, progress forecasting, problems of overhead, and error analysis.

Basili, V. R.↗

The influence of the tropics on the prediction of ultralong waves. I - Tropical wind field

The effects of tropical wind data from the FGGE and tropical latent heating on numerical modeling of ultralong waves are considered in a two-part study. The model studied is the global fourth-order GLAS general circulation model, an energy-conserving format with horizontal differences calculated with fourth-order accuracy. Data assimilation experiments were performed with and without the wind data, with account taken of eastward and northward wind components, the geopotential height, and the relative humidity, all over pressure surfaces. The initial conditions were used to generate six pairs of forecasts, and the tropical wind error decreased after two days of prediction when the initial conditions contained the wind data. The deviations from the measured planetary wave data were attributed to differences in the initial rotational wind field, which varied on a three-day basis. The latent heat initial data had a five-day period and extended its influence beyond the tropical zone. The tropical heat sources sustained the tropical westerlies in the GLAS model, and removal of the tropical heat sources reversed the wind to easterlies.

Baker, W. E.↗

Analysis of rapidly developing fog at the Kennedy Space Center

Space Shuttle landings at Kennedy Space Center (KSC) are of special concern to NASA's landing community because of Florida's rapidly changing weather conditions. Since a large number of Shuttle landing attempts occur in the morning hours (just after sunrise) fog and stratus development are a problem. The deorbit burn decision for a landing at KSC is typically made 90 minutes before Shuttle touchdown. In that 90 minutes weather conditions can change very rapidly. Fog to the west of KSC an advect in and reduce visibility to less than 7 miles. The most important difference between Shuttle and normal aircraft landings is that the Shuttle has no go-around capability requiring a forecast with little room for error. To help guard against rapidly changing weather conditions, flight rules have been developed as guidelines for all landings. This paper concerns fog development that would affect less than 7-statue mile visibility rule which is in effect for End-Of-Mission (EOM) Shuttle landings at KSC (Rule 4-64(A)). Data used for this analysis included hourly surface observations at the X68 Shuttle Landing Facility (SLF) and upper-air observations form the CCAFS (Cape Canaveral Air Force Station-72794) rawinsonde site for the five year period, 1986 to 1990. This investigation focused on rapidly developing fog or stratus that developed between decision time and landing.

Wheeler, Mark M.↗

The Madden-Julian Oscillation and its Impact on Northern Hemisphere Weather Predictability during Wintertime

The Madden-Julian Oscillation (MJO) is known as the dominant mode of tropical intraseasonal variability and has an important role in the coupled-atmosphere system. This study used twin numerical model experiments to investigate the influence of the MJO activity on weather predictability in the midlatitudes of the Northern Hemisphere during boreal winter. The National Aeronautics and Space Administration (NASA) Goddard laboratory for the Atmospheres (GLA) general circulation model was first used in a 10-yr simulation with fixed climatological SSTs to generate a validation data set as well as to select initial conditions for active MJO periods and Null cases. Two perturbation numerical experiments were performed for the 75 cases selected [(4 MJO phases + Null phase) _ 15 initial conditions in each]. For each alternative initial condition, the model was integrated for 90 days. Mean anomaly correlations in the midlatitudes of the Northern Hemisphere (2O deg N_60 deg.N) and standardized root-mean-square errors were computed to validate forecasts and control run. The analyses of 500-hPa geopotential height, 200-hPa Streamfunction and 850-hPa zonal wind component systematically show larger predictability during periods of active MJO as opposed to quiescent episodes of the oscillation.

Jones, Charles↗

Hurricane Forecasts with a Global Mesoscale-resolving Model on the NASA Columbia Supercomputer Preliminary Simulations of Hurricane Katrina (2005)

It is known that the General Circulation Models (GCMs) have sufficient resolution to accurately simulate hurricane near-eye structure and intensity. To overcome this limitation, the mesoscale-resolving finite-element GCM (fvGCM) has been experimentally deployed on the NASA Columbia supercomputer, and its performance is evaluated choosing hurricane Katrina as an example in this study. On late August 2005 Katrina underwent two stages of rapid intensification and became the sixth most intense hurricane in the Atlantic. Six 5-day simulations of Katrina at both 0.25 deg and 0.125 deg show comparable track forecasts, but the 0,125 deg runs provide much better intensity forecasts, producing center pressure with errors of only +/- 12 hPa. The 0.125 deg simulates better near-eye wind distributions and a more realistic average intensification rate. A convection parameterization (CP) is one of the major limitations in a GCM, the 0.125 deg run with CP disabled produces very encouraging results.

Shen, B.-W.↗

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗

The Contributions of Gauge-Based Precipitation and SMAP Brightness Temperature Observations to the Skill of the SMAP Level-4 Soil Moisture Product

Soil Moisture Active Passive (SMAP) mission L-band brightness temperature (Tb) observations are routinely assimilated into the Catchment land surface model to generate Level-4 Soil Moisture (L4_SM) estimates of global surface and root-zone soil moisture at 9-km, 3-hourly resolution with ~2.5-day latency. The Catchment model in the L4_SM algorithm is driven with ¼-degree, hourly surface meteorological forcing data from the Goddard Earth Observing System (GEOS). Outside of Africa and the high latitudes, GEOS precipitation is corrected using Climate Prediction Center Unified (CPCU) gauge-based, ½-degree, daily precipitation. L4_SM soil moisture was previously shown to improve over land model-only estimates that use CPCU precipitation but no Tb assimilation (CPCU_SIM). Here, we additionally examine the skill of model-only (CTRL) and Tb assimilation-only (SMAP_DA) estimates derived without CPCU precipitation. Soil moisture is assessed versus in situ measurements in well-instrumented regions and globally through the Instrumental Variable (IV) method using independent soil moisture retrievals from the Advanced Scatterometer. At the in situ locations, SMAP_DA and CPCU_SIM have comparable soil moisture skill improvements relative to CTRL for the unbiased root-mean-square error (surface and root-zone) and correlation metrics (root-zone only). In the global average, SMAP Tb assimilation increases the surface soil moisture anomaly correlation by 0.10-0.11 compared to an increase of 0.02-0.03 from the CPCU-based precipitation corrections. The contrast is particularly strong in central Australia, where CPCU is known to have errors and observation-minus-forecast Tb residuals are larger when CPCU precipitation is used. Validation versus streamflow measurements in the contiguous U.S. reveals that CPCU precipitation provides most of the skill gained in L4_SM runoff estimates over CTRL.

SMAP↗

Leveraging Pre-storm Soil Moisture Estimates for Enhanced Land Surface Model Calibration in Ungauged Hydrologic Basins

Despite long-standing efforts, hydrologists still lack robust tools for calibrating land surface model (LSM) streamflow estimates within ungauged basins. Using surface soil moisture estimates from the Soil Moisture Active Passive Level 4 Soil Moisture (L4_SM) product, precipitation observations, and streamflow gauge measurements for 617 medium-scale (200-10,000 km2) basins in the contiguous United States, we measure the temporal (Spearman) rank correlation between antecedent (i.e., pre-storm) surface soil moisture (ASM) and the storm-scale runoff coefficient (RC; the fraction of storm-scale precipitation accumulation converted into streamflow). In humid and semi-humid basins, this rank correlation is shown to be sufficiently strong to allow for the substitution of storm-scale RC observations (available only in basins that are both lightly regulated and gauged) with high-quality ASM values (available quasi-globally from L4_SM) in streamflow calibration procedures. Using this principle, we define a new, basin-wise LSM streamflow calibration approach based on L4_SM alone and successfully apply it to identify LSM configurations that produce a high rank correlation with observed RC. However, since the approach cannot detect RC bias, it is less successful in identifying LSM configurations with low mean-absolute error. Plain Text Summary Accurately forecasting the fraction of rainfall that runs off into streams, as opposed to infiltrates into the soil, is critical for flash-flood prediction, water-resource monitoring, and tracking the transport of nutrients from agricultural fields into local waterways. Such forecasting is typically performed by hydrologic models that attempt to represent the physical processes responsible for surface runoff generation. However, to provide accurate streamflow forecasts, these models typically need to be calibrated against actual streamflow observations. This is problematic given the relatively poor, and declining, global availability of stream gauges. This paper presents a novel model calibration strategy that uses soil moisture from remote sensing and numerical modeling in place of streamflow observations during calibration. This transition has significant practical advantages because, unlike streamflow observations, the soil moisture data are continuously available across space. Our results demonstrate that this new approach can significantly improve hydrologic models within humid and semi-humid basins lacking sufficient ground-based instrumentation for traditional streamflow calibration.

hydrologic models↗

Impact of Bias in the Marine Air Temperature Observation Set on Atmospheric Reanalyses

Marine air temperature observations are collected by volunteer observing ships carrying automatic meteorological sensor packages. Close proximity of the package mount to a dark colored ship's deck is known to introduce a warm bias on sunny afternoons in summer under low wind conditions. This observation set is used as an influential constraint in the MERRA-2 reanalysis, as well as several other reanalyses, in the poorly sampled surface marine boundary layer. Here we explore the consequences of bias in the marine air temperature observation set during the 36 year period 1980-2015. Marine air temperature observations have mainly been collected along major shipping routes, with the densest coverage in the North Atlantic and North Pacific. In the first part of this presentation we review the historical observation coverage and compare air temperature and contemporaneous SST measurements to identify systematic differences. The comparison suggests the presence of diurnal bias in the air temperature observations peaking in subtropics and midlatitudes latitudes in mid-afternoon local time. In the second part we explore the impact of the marine air temperature observations on MERRA-2 through analysis of the terms in the temperature forecast tendency equation, the equation which describes the contributions to changes in temperature during each analysis cycle. Examination of the temperature forecast tendency equation allows us to separate systematic errors due to such processes and radiation, mixing, and advection and allows us to identify the major source of systematic forecast tendencies. The results show that the marine air temperature measurements introduce an error that can reach 0.4K/dy which also peaks in local afternoon at subtropical latitudes. This bias varies with season and has gradually reduced from the beginning of the MERRA-2 reanalysis in 1980. In the final part we conduct numerical experiments with a version of the MERRA-2 analysis system, comparing experiments when the marine air temperature observations are included or withheld from the analysis system.

Akella, Santharam↗

CAUSES: On the Role of Surface Energy Budget Errors to the Warm Surface Air Temperature Error Over the Central United States

Many weather forecasting and climate models simulate a warm surface air temperature (T2m) bias over mid-latitude continents during the summertime, especially over the Great Plains. We present here one of a series of papers from a multi-model intercomparison project (CAUSES: Cloud Above the United States and Errors at the Surface), which aims to evaluate the role of cloud, radiation, and precipitation biases in contributing to T2m bias using a short-term hindcast approach with observations mainly from the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site during the period of April to August 2011. The present study examines the contribution of surface energy budget errors to the bias. All participating models simulate higher net shortwave and longwave radiative fluxes at the surface but there is no consistency on signs of biases in latent and sensible heat fluxes over the Central U.S. and ARM SGP. Nevertheless, biases in net shortwave and downward longwave fluxes, as well as surface evaporative fraction (EF) are the main contributors to T2m bias. Radiation biases are largely affected by cloud simulations, while EF is affected by soil moisture modulated by seasonal accumulated precipitation and evaporation. An approximate equation is derived to further quantify the magnitudes of radiation and EF contributions to T2m bias. Our analysis suggests that radiation errors are always an important source of T2m error for long-term climate runs with EF errors either of equal or lesser importance. However, for the short-term hindcasts, EF errors are more important provided a model has a substantial EF bias.

Ma, H. -Y.↗

A New Ensemble Canonical Correlation Prediction Scheme for Seasonal Precipitation

Department of Mathematical Sciences, University of Alberta, Edmonton, Canada This paper describes the fundamental theory of the ensemble canonical correlation (ECC) algorithm for the seasonal climate forecasting. The algorithm is a statistical regression sch eme based on maximal correlation between the predictor and predictand. The prediction error is estimated by a spectral method using the basis of empirical orthogonal functions. The ECC algorithm treats the predictors and predictands as continuous fields and is an improvement from the traditional canonical correlation prediction. The improvements include the use of area-factor, estimation of prediction error, and the optimal ensemble of multiple forecasts. The ECC is applied to the seasonal forecasting over various parts of the world. The example presented here is for the North America precipitation. The predictor is the sea surface temperature (SST) from different ocean basins. The Climate Prediction Center's reconstructed SST (1951-1999) is used as the predictor's historical data. The optimally interpolated global monthly precipitation is used as the predictand?s historical data. Our forecast experiments show that the ECC algorithm renders very high skill and the optimal ensemble is very important to the high value.

Kim, Kyu-Myong↗

TRMM Data Assimilation at NASA

We give an overview of the research at NASA in assimilating tropical rainfall and total precipitable water (TPW) retrievals derived from the TRMM Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments. Global analyses currently contain order-one errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. We show that an effective strategy to assimilate tropical rainfall data is to use observations to compensate for errors in moisture tendencies produced by the assimilation model. Results show that assimilating TMI and SSM/I surface rainrates and TPW estimates improves shortrange forecasts and reduces state-dependent systematic errors in the hydrological cycle and related climate parameters such as cloud, radiation, and the large-scale circulation in the tropics. The study provides a demonstration of the potential of using rainfall and moisture observations derived from passive microwave instruments to improve the quality of 4-dimensional global datasets for climate analysis and weather forecasting applications.

Hou, Arthur Y.↗

An OSSE on Mesoscale Model Assimilation of Simulated HIRAD-Observed Hurricane Surface Winds

The hazards of landfalling hurricanes are well known, but progress on improving the intensity forecasts of these deadly storms at landfall has been slow. Many cite a lack of high-resolution data sets taken inside the core of a hurricane, and the lack of reliable measurements in extreme conditions near the surface of hurricanes, as possible reasons why even the most state-of-the-art forecasting models cannot seem to forecast intensity changes better. The Hurricane Imaging Radiometer (HIRAD) is a new airborne microwave remote sensor for observing hurricanes, and is operated and researched by NASA Marshall Space Flight Center in partnership with the NOAA Atlantic Oceanographic and Meteorological Laboratory/Hurricane Research Division, the University of Central Florida, the University of Michigan, and the University of Alabama in Huntsville. This instrument?s purpose is to study the wind field of a hurricane, specifically observing surface wind speeds and rain rates, in what has traditionally been the most difficult areas for other instruments to study; the high wind and heavy rain regions. Dr. T. N. Krishnamurti has studied various data assimilation techniques for hurricane and monsoon rain rates, and this study builds off of results obtained from utilizing his style of physical initializations of rainfall observations, but obtaining reliable observations in heavy rain regions has always presented trouble to our research of high-resolution rainfall forecasting. Reliable data from these regions at such a high resolution and wide swath as HIRAD provides is potentially very valuable to mesoscale forecasting of hurricane intensity. This study shows how the data assimilation technique of Ensemble Kalman Filtering (EnKF) in the Weather Research and Forecasting (WRF) model can be used to incorporate wind, and later rain rate, data into a mesoscale model forecast of hurricane intensity. The study makes use of an Observing System Simulation Experiment (OSSE) with a simulated HIRAD dataset sampled during a hurricane and uses EnKF to forecast the track and intensity prediction of the hurricane. Comparisons to truth and error metrics are used to assess the model?s forecast performance.

Albers, Cerese↗

An alternate approach to ensemble ENSO forecast spread: Application to the 2014 forecast

Abstract Evaluating the 2014 El Niño forecast as a “bust” may be tapping into a bigger issue, namely that forecast “overconfidence” from single‐model ensembles could affect the retrospective assessment of El Niño–Southern Oscillation (ENSO) predictions. The present study proposes a new approach to quantifying an “expected” spread and uncertainty from noise‐driven processes and supplementing these measures with actual ENSO forecasts. Expanding on a previously developed coupled model framework that isolates noise‐driven ENSO‐like errors, an experimental design is implemented to generate an expected December Niño‐3.4 spread from March initial condition sea surface temperature errors that have similar structure to the 2014 and 2015 observed. Results reveal that the 2014 ENSO forecast falls within the expected uncertainty generated by ENSO‐independent, forecast‐independent, noise‐driven errors.

Larson, Sarah M.↗

Forecasting distributed energy resources adoption for power systems

Failing to incorporate accurate distributed energy resource penetration forecasts into long-term resource and transmission planning can lead to cost inefficiencies at best and system failures at worst. We have developed an open-source tool that employs an advanced Bass specification to calibrate and forecast technology adoption. The advanced specification includes geographic clustering, exogenously estimated market size, and dynamic time steps. Training on historical adoption of rooftop photovoltaics at the U.S. county-level and using detailed techno-economic estimates, our model achieves a two-year average mean-absolute-percentage-error of 19% in predicting system counts at the county-level, weighted by population. Model error was negatively correlated with market maturity - the error was 12% for counties in states with at least 28 W-per-capita of installed capacity. The advanced specification significantly reduces unweighted forecasting percent error compared to a conventional Bass specification: from 196% to 25% for capacity and from 226% to 22% for system count.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Improved Prediction of Cold-Air Pools in the Weather Research and Forecasting Model Using a Truly Horizontal Diffusion Scheme for Potential Temperature

The terrain-following vertical coordinate system used by many atmospheric models, including the Weather Research and Forecasting (WRF) Model, is prone to errors in regions of complex terrain. These errors stem, in part, from the calculation of horizontal gradients within the diffusion term of the momentum or scalar evolution equations. In WRF, such gradients can be calculated along coordinate surfaces, or using metric terms that help account for grid skewness. However, neither of these options ensures a truly horizontal gradient calculation, especially if a grid cell is skewed enough that the heights of the neighboring grid points used in the calculation fall outside the vertical range of the cell. In this work, an improved scheme that uses Taylor series approximations to vertically interpolate variables to the level necessary for a truly horizontal gradient calculation is implemented in WRF for the diffusion of potential temperature. The scheme is validated using an atmosphere-at-rest configuration, in which spurious flows develop only as a result of numerical errors and can thus be used as a proxy for model performance. Following validation, the method is applied to the simulation of cold-air pools (CAPs), which occur in regions of complex terrain and are characterized by strong near-surface temperature gradients. Using the truly horizontal scheme, idealized simulations demonstrate reduced numerical mixing in a quiescent CAP, and a realistic case study in the Columbia River basin shows a reduction in positive wind speed bias by up to roughly 20% compared to observations from the Second Wind Forecast Improvement Project.

54 ENVIRONMENTAL SCIENCES↗

Day-Ahead Probabilistic Forecasting of Net-Load and Demand Response Potentials with High Penetration of Behind-the-Meter Solar-plus-Storage

The goal of this project is to develop advanced methods for day-ahead net-load forecasting, by leveraging the state-of-the-art machine learning techniques. The developed models produce both point and probabilistic forecasts for a variety of use cases, and are versatile to work with different types of data sets. The innovation lies in the novel design of the architectures, leveraging the most recent advances in machine learning that have not been explored in power systems, accompanied by techniques in the broader artificial intelligence fields such as fuzzy systems. This project has achieved the following accomplishments: (1) preprocessing of over 10 data sets covering varying geographical regions, time horizons, and system levels, which form a robust foundation for training and evaluating forecasting models across a wide range of realistic grid scenarios; (2) development of an interactive web app that enables exploratory analysis of load and generation data, and supports better understanding of data trends, anomalies, and correlations, facilitating model development and stakeholder engagement; (3) implementation of over 10 benchmark models for point and probabilistic forecasting, which include a mix of conventional machine learning methods and state-of-the-art deep learning approaches, providing a comprehensive baseline for performance comparison and validation of the proposed models; (4) development of a fuzzy system based gradient boosting model, tailored for small (less than 3 years) data sets, which achieves a mean absolute percentage error (MAPE) of 4% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (5) development of a Transformer (a state-of-the-art deep learning architecture) based neural network model, tailored for large (3 years or more) data sets, which achieves a MAPE of 2% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (6) development of a methodology for quantifying DR potential, and extensions of the previous models for multi-target forecasting of net load and DR potential, which achieve a MAPE of 10% for DR potential.

24 POWER TRANSMISSION AND DISTRIBUTION↗