Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

The Impact of Trajectory Prediction Uncertainty on Air Traffic Controller Performance and Acceptability

A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

trajectory prediction uncertainty↗

Using Remotely Sensed Information for Near Real-Time Landslide Hazard Assessment

The increasing availability of remotely sensed precipitation and surface products provides a unique opportunity to explore how landslide susceptibility and hazard assessment may be approached at larger spatial scales with higher resolution remote sensing products. A prototype global landslide hazard assessment framework has been developed to evaluate how landslide susceptibility and satellite-derived precipitation estimates can be used to identify potential landslide conditions in near-real time. Preliminary analysis of this algorithm suggests that forecasting errors are geographically variable due to the resolution and accuracy of the current susceptibility map and the application of satellite-based rainfall estimates. This research is currently working to improve the algorithm through considering higher spatial and temporal resolution landslide susceptibility information and testing different rainfall triggering thresholds, antecedent rainfall scenarios, and various surface products at regional and global scales.

remote sensing↗

Introducing Multisensor Satellite Radiance-Based Evaluation for Regional Earth System Modeling

Earth System modeling has become more complex, and its evaluation using satellite data has also become more difficult due to model and data diversity. Therefore, the fundamental methodology of using satellite direct measurements with instrumental simulators should be addressed especially for modeling community members lacking a solid background of radiative transfer and scattering theory. This manuscript introduces principles of multisatellite, multisensor radiance-based evaluation methods for a fully coupled regional Earth System model: NASA-Unified Weather Research and Forecasting (NU-WRF) model. We use a NU-WRF case study simulation over West Africa as an example of evaluating aerosol-cloud-precipitation-land processes with various satellite observations. NU-WRF-simulated geophysical parameters are converted to the satellite-observable raw radiance and backscatter under nearly consistent physics assumptions via the multisensor satellite simulator, the Goddard Satellite Data Simulator Unit. We present varied examples of simple yet robust methods that characterize forecast errors and model physics biases through the spatial and statistical interpretation of various satellite raw signals: infrared brightness temperature (Tb) for surface skin temperature and cloud top temperature, microwave Tb for precipitation ice and surface flooding, and radar and lidar backscatter for aerosol-cloud profiling simultaneously. Because raw satellite signals integrate many sources of geophysical information, we demonstrate user-defined thresholds and a simple statistical process to facilitate evaluations, including the infrared-microwave-based cloud types and lidar/radar-based profile classifications.

Planetary Boundary Layer↗

A Realization of Bias Correction Method in the GMAO Coupled System

Over the past several decades, a tremendous effort has been made to improve model performance in the simulation of the climate system. The cold or warm sea surface temperature (SST) bias in the tropics is still a problem common to most coupled ocean atmosphere general circulation models (CGCMs). The precipitation biases in CGCMs are also accompanied by SST and surface wind biases. The deficiencies and biases over the equatorial oceans through their influence on the Walker circulation likely contribute the precipitation biases over land surfaces. In this study, we introduce an approach in the CGCM modeling to correct model biases. This approach utilizes the history of the model's short-term forecasting errors and their seasonal dependence to modify model's tendency term and to minimize its climate drift. The study shows that such an approach removes most of model climate biases. A number of other aspects of the model simulation (e.g. extratropical transient activities) are also improved considerably due to the imposed pre-processed initial 3-hour model drift corrections. Because many regional biases in the GEOS-5 CGCM are common amongst other current models, our approaches and findings are applicable to these other models as well.

Chang, Yehui↗

Evaluation of Integrated Demand Management Looking into Strategic & Tactical Flow Management

The motivation behind Integrated Demand Management (IDM) research is to explore possible improvements to United States National Airspace System (NAS) performance that could be realized through procedural integration of strategic traffic flow management capabilities, such as the Collaborative Trajectory Options Program (CTOP), and tactical capabilities, such as Time Based Flow Management (TBFM). An initial IDM concept for clear weather operations was developed and evaluated for potential benefits, including efficiency, delay reduction, predictability and throughput, and to identify any major issues that might represent a showstopper for a fielded application. Newark Liberty International Airport (EWR) arrival operations provided a use case for concept development. EWR uses miles-in-trail (MIT) metering to regulate demand into TBFM during high volume operations, and short-haul flights are often penalized with excessive, last-minute ground delays when the overhead stream is saturated. IDM addresses this problem by replacing MIT conditioning with CTOP to better manage the demand delivery to the TBFM entry points. A quasi-real time high-fidelity simulation that would normally involve participants was conducted using heuristic-based procedures that mimicked operators behaviors instead. Five total conditions were compared: two baseline conditions with MIT delivery to TBFM entry points using two different TBFM settings; and three IDM conditions: one with airborne speed control using an Required Time of Arrival (RTA) capability, a second without RTA, and a third with no wind forecast errors. Results suggest that the IDM concept can deliver traffic more efficiently by shifting the delays from airborne to ground for both RTA and non-RTA conditions, while maintaining a target throughput rate. The results also suggest that with good predictability of airport capacity, excessive TBFM ground delay can be minimized by applying more strategic CTOP delay, increasing predictability for the airline operators. Overall, the results indicate that the implementation of an IDM concept under clear weather conditions can improve NAS system performance. Future IDM research aims to expand the concept to address demandcapacity imbalance d severe weather.

Time-Based Flow Management (TBFM)↗

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally-distributed single-catchment locations for a 10-year experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF systematically increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results also demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Soil moisture↗

A High-Performance Computing Predictive GNSS Performance Monitor for Autonomous Air Vehicles in Urban Environments

This report offers analysis and design insights for leveraging High-Performance Computing (HPC) to predict line-of-sight (LOS) Global Navigation Satellite System (GNSS) availability in a city. This work is motivated by the emerging fields of Advanced and Urban Air Mobility (AAM/UAM), where regulatory authorities are seeking city-scale, meter-resolution risk forecasting in order to safely integrate new flight missions with existing urban life and infrastructure. This work addresses the technical challenge of efficiently computing urban GNSS satellite visibility to predict GNSS performance metrics under these requirements. We present a new HPC-optimized shadow casting algorithm variant as a ray-based approach to forecasting satellite visibility. We apply this algorithm variant in a software-defined prognostic service which generates a GNSS navigation risk-correlated map as a path planning-style potential field. We detail dominant computational burdens, viable simplifying assumptions, and different algorithmic implementations, intending to demonstrate a baseline of computation time needed by each stage in such a service. We conclude by analyzing the prototype service’s prediction accuracy compared to receiver data from Corpus Christi, Texas. This informs design trade-offs along the dimensions of hardware, computation time, and tolerable forecasting error (including proportions of false positives and false negatives).

GNSS↗

Complementary Roles of LEO and GEO IR Sounders in NWP Evaluated using an OSSE Framework

The United States is currently preparing for the next-generation weather satellite program. Building off the multi-decadal successes of the Low-Earth Orbit (LEO) infrared (IR) sounder program, NOAA and NASA are planning for the Geostationary eXtended Observations (GeoXO) Sounder (GXS) that will join international counterparts to form a global ring from geosynchronous orbit (GEO). To address questions about the complementarities and roles of these two platform types in the context of numerical weather prediction (NWP) and forecast accuracy, NASA’s Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework was used to test their impact individually and in concert. Analyses, forecasts, and forecast sensitivity-based observations impact (FSOI) are examined. Overall, each has a role in forecast error reduction with the most beneficial impacts occurring when both LEO and GEO sounders are used together to address the needs of global skill and targeted regional weather phenomena.

Erica Mcgrath-Spangler↗

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally distributed single-catchment locations for a 10-yr experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF consistently increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone, and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results additionally demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Rolf Reichle↗

Analyzing the Deployment of Large Amounts of Offshore Wind to Design an Offshore Transmission Grid in the United States: Preprint

This paper revisits the results from the U.S. Department of Energy's '20% Wind Energy By 2030' study, which envisioned that 54 GW of offshore wind would be installed by said year. The analysis is conducted using the Regional Energy Deployment System (ReEDS), a capacity expansion model developed by the National Renewable Energy Laboratory. The model is used to optimize the deployment of the 54 GW of wind capacity along the coasts and lakes of the United States. The graphical representation of the results through maps will be used to provide a qualitative description for planning and designing an offshore grid. ReEDS takes into account many factors in the process of siting offshore wind capacity, such as the quality of the resource, capital and O&M costs, interconnection costs, or variability metrics (wind capacity value, forecast error, expected curtailment). The effect of these metrics in the deployment of offshore wind will be analyzed through examples in the results.

17 WIND ENERGY↗

Probabilistic Look-ahead Contingency Analysis Integration with Commercial Tool and Practical Data

This paper presents an initial effort of integrating a smart sampling-based probabilistic look-ahead contingency analysis algorithm with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool as a proof-of-concept for a seamless research tool integration using real world large-scale grid data. With the increasing impact of random forces such as variable generation and load, their stochastic behaviors cannot be ignored. However, the current practices are still dominated by deterministic tools. They are becoming increasingly inadequate for the future grid. The developed look-ahead contingency analysis algorithm incorporates forecast errors of variable energy and load to address the challenges brought by the increasing uncertainty of power system. The algorithm can reveal the potential violations caused by the variance of variable energy and load that are not normally detected by traditional deterministic approaches. To test its performance under practical environments ( real data with real commercial tool), significant efforts have been made to prepare test cases, modify GE EMS tool, and adapt an extreme value distribution algorithm to analyze the GE EMS’s violation-only outputs. The test results clearly demonstrate the effectiveness of the developed algorithm as new transformer violations that were not previously detected have been identified. This performance provides better situational awareness to engineers for their decision-making process under uncertainty. Moreover, with the discussion of computational performance and future work, this paper has shown a clear path for integrating the probabilistic algorithm with commercial tools to make us better equipped for the changing power system.

Modeling and simulation of power systems, constrai↗

A BI-LEVEL APPROACH TO FUTURE POWER SYSTEM CO-OPTIMIZATION WITH HIGH PENETRATION OF RENEWABLE ENERGY AND RESPONSIVE DEMAND

Electricity generation accounts for nearly half of the total CO2 emissions in the United States. For this reason, the development and integration of renewable resources will play an essential role in achieving the societal objective of mitigating climate change through reduction of greenhouse gas emissions. In conjunction with the environmental benefits of renewable energy, the most common renewable sources, such as wind and solar, also increase the uncertainties surrounding generation in power systems, which adds significant challenges to the system operation and planning. The uncertainties and forecasting errors surrounding renewable generation are normally addressed through the use of reserves from traditional generators. At greater levels of renewable penetration, sufficient generator reserves may not be available or economically viable. In contrast, the promise of demand-side resources in this arena lies in the spatially widespread availability, rapid response potential, and lower cost of features that already exist in the system. However, the challenge of responsive demand arises from the need to understand, manage, and incentivize a very large number of resources to participate effectively in efficient operation of the complex power system. Since demand response comes from the distribution system, microgrids as the basic building blocks of future distribution systems will be a critical environment for the study of demand response. To support integration of microgrids with flexible loads in future power systems, the operational mode of power systems will need to evolve. Therefore, it is going to be critical to have new and efficient co-optimization methods for coordination of the various power market participants and the scheduling of resources in the power systems of the future. Motivated by the rapid increase in renewable penetration, the need for effective demand response programs, and a changing system structure, this dissertation seeks to define a new strategy that supports co-optimization of various participants in power systems with emphasis on high renewable penetration and demand response. This strategy has three components; 1) an exploration of the capabilities of different types of demand response programs in a microgrid, 2) development and implementation of a bi-level framework for co-optimization of the main grid with high renewable penetration and a microgrid with demand response capabilities, and 3) expansion of the bi-level framework from a microgrid to a general distribution system to explore the advantages of the bi-level co-optimization approach over the traditional optimization approach. Conclusions of this work illustrate that the stochastic rolling horizon approach could effectively manage the operation of a microgrid with various demand response programs. In addition, the bi-level approach is a promising co-optimization framework for the transmission and distribution levels that could increase system renewable penetration and reduce operation costs. Compared to the traditional framework, the bi-level framework yields more equitable cost sharing patterns among the market participants as well as better support for the power system evolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Model Error Estimation for the CPTEC Eta Model

Statistical data assimilation systems require the specification of forecast and observation error statistics. Forecast error is due to model imperfections and differences between the initial condition and the actual state of the atmosphere. Practical four-dimensional variational (4D-Var) methods try to fit the forecast state to the observations and assume that the model error is negligible. Here with a number of simplifying assumption, a framework is developed for isolating the model error given the forecast error at two lead-times. Two definitions are proposed for the Talagrand ratio tau, the fraction of the forecast error due to model error rather than initial condition error. Data from the CPTEC Eta Model running operationally over South America are used to calculate forecast error statistics and lower bounds for tau.

Tippett, Michael K.↗

Forecasting longitudinal changes in oropharyngeal tumor morphology throughout the course of head and neck radiation therapy

Purpose: To create models that forecast longitudinal trends in changing tumor morphology and to evaluate and compare their predictive potential throughout the course of radiation therapy. Methods: Two morphology feature vectors were used to describe 35 gross tumor volumes (GTVs) throughout the course of intensity-modulated radiation therapy for oropharyngeal tumors. The feature vectors comprised the coordinates of the GTV centroids and a description of GTV shape using either interlandmark distances or a spherical harmonic decomposition of these distances. The change in the morphology feature vector observed at 33 time points throughout the course of treatment was described using static, linear, and mean models. Models were adjusted at 0, 1, 2, 3, or 5 different time points (adjustment points) to improve prediction accuracy. The potential of these models to forecast GTV morphology was evaluated using leave-one-out cross-validation, and the accuracy of the models was compared using Wilcoxon signed-rank tests. Results: Adding a single adjustment point to the static model without any adjustment points decreased the median error in forecasting the position of GTV surface landmarks by the largest amount (1.2 mm). Additional adjustment points further decreased the forecast error by about 0.4 mm each. Selection of the linear model decreased the forecast error for both the distance-based and spherical harmonic morphology descriptors (0.2 mm), while the mean model decreased the forecast error for the distance-based descriptor only (0.2 mm). The magnitude and statistical significance of these improvements decreased with each additional adjustment point, and the effect from model selection was not as large as that from adding the initial points. Conclusions: The authors present models that anticipate longitudinal changes in tumor morphology using various models and model adjustment schemes. The accuracy of these models depended on their form, and the utility of these models includes the characterization of patient-specific response with implications for treatment management and research study design.

60 APPLIED LIFE SCIENCES↗

Error-Level-Controlled Synthetic Forecasts for Renewable Generation

Renewable energy resources, including solar and wind energy, play a significant role in sustainable energy systems. However, the inherent uncertainty and intermittency of renewable generation pose challenges to the safe and efficient operation of power systems. Recognizing the importance of short-term (hours ahead) renewable generation forecasting in power systems operation, it becomes crucial to address the potential inaccuracies in these forecasts. To systematically evaluate the performance of controllers in the presence of imperfect forecasts, we generate synthetic forecasts using actual renewable generation profiles (one from solar and one from wind). These synthetic forecasts incorporate different levels of statistical error, allowing us to control and manipulate the accuracy of the predictions. The primary objective is to employ synthetic forecasts with controlled yet realistic error levels to systematically investigate how controllers adapt to variations in forecast accuracy, providing valuable insights into their robustness and effectiveness under real-world conditions.

Array↗

Characterization of Transport Errors in Chemical Forecasts from a Global Tropospheric Chemical Transport Model

We propose a new methodology to characterize errors in the representation of transport processes in chemical transport models. We constrain the evaluation of a global three-dimensional chemical transport model (GEOS-CHEM) with an extended dataset of carbon monoxide (CO) concentrations obtained during the Transport and Chemical Evolution over the Pacific (TRACE-P) aircraft campaign. The TRACEP mission took place over the western Pacific, a region frequently impacted by continental outflow associated with different synoptic-scale weather systems (such as cold fronts) and deep convection, and thus provides a valuable dataset. for our analysis. Model simulations using both forecast and assimilated meteorology are examined. Background CO concentrations are computed as a function of latitude and altitude and subsequently subtracted from both the observed and the model datasets to focus on the ability of the model to simulate variability on a synoptic scale. Different sampling strategies (i.e., spatial displacement and smoothing) are applied along the flight tracks to search for systematic model biases. Statistical quantities such as correlation coefficient and centered root-mean-square difference are computed between the simulated and the observed fields and are further inter-compared using Taylor diagrams. We find no systematic bias in the model for the TRACE-P region when we consider the entire dataset (i.e., from the surface to 12 km ). This result indicates that the transport error in our model is globally unbiased, which has important implications for using the model to conduct inverse modeling studies. Using the First-Look assimilated meteorology only provides little improvement of the correlation, in comparison with the forecast meteorology. These general statements can be refined when the entire dataset is divided into different vertical domains, i.e., the lower troposphere (less than 2 km), the middle troposphere (2-6 km), and the upper troposphere (greater than 6 km). The best agreement between the observations and the model is found in the lower and middle troposphere. Downward displacements in the lower troposphere provide a better fit with the observed value, which could indicate a problem in the representation of boundary layer height in the model. Significant improvement is also found for downward and southward displacements in the upper troposphere. There are several potential sources of errors in our simulation of the continental outflow in the upper troposphere which could lead to such biases, including the location and/or the strength of deep convective cells as well as that of wildfires in Southeast Asia.

Bey, I.↗

Error growth in operational ECMWF forecasts

A parameterization scheme used at the European Centre for Medium Range Forecasting to model the average growth of the difference between forecasts on consecutive days was extended by including the effect of error growth on forecast model deficiencies. Error was defined as the difference between the forecast and analysis fields during the verification time. Systematic and random errors were considered separately in calculating the error variance for a 10 day operational forecast. A good fit was obtained with measured forecast errors and a satisfactory trend was achieved in the difference between forecasts. Fitting six parameters to forecast errors and differences that were performed separately for each wavenumber revealed that the error growth rate grew with wavenumber. The saturation error decreased with the total wavenumber and the limit of predictability, i.e., when error variance reaches 95 percent of saturation, decreased monotonically with the total wavenumber.

Kalnay, E.↗

Assimilation of Soil Moisture Observations Over Land Improves Analysis and Prediction of Tropical Cyclone Idai

Soil moisture conditions can impact the circulation and structure of a tropical cyclone (TC) when part or all of the circulation is over land. Dry land surface conditions may lead to faster dissipation of a TC over land, whereas very wet conditions may lead to a prolonged maintenance of its intensity. While this relationship is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tbs significantly improves modeled land surface states. Here we evaluate: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP Tb observations. We find that in the analysis with SMAP assimilation, the TC has a better-defined, more aligned vertical structure over land relative to the control run; moreover, the analyzed TC size, as measured by the wind speed radius, better matches the observed TC size. We further find significant reductions in the forecast intensity error and the forecast along-track error, measured against observations. The largest error reductions occur at lead times of 36 to 72 hours, suggesting that the land with its longer memory gains in importance as a source of predictability at this timescale. An investigation of the underlying mechanisms leading to the skill improvements from SMAP data assimilation revealed that the assimilation of SMAP leads to wetter soil moisture conditions and an increased latent heat flux in the SMAP analysis, which results in a TC with higher column-integrated total moisture content and total energy compared to the control analysis.

Jana Kolassa↗