Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗

Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles

Dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extends from the interior to the corona and from fast turbulent motions to the global-Sun magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across the different layers, which contribute to the corona heating and eruptive dynamics, as well as interlinks between different layers of the solar interior and atmosphere. For modeling the global-scale activity we use the data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitation on the prediction accuracy. We present the EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields, and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting the solar activity.

Kitiashvili, I. N.↗

Solar Activity Modeling: From Subgranular Dynamical Scales to the Solar Cycles

The dynamical effects of solar magnetoconvection span a wide range spatial and temporal scales that extend from the interior to the corona and from fast turbulent motions to global magnetic activity. To study the solar activity on short temporal scales (from minutes to hours), we use 3D radiative MHD simulations that allow us to investigate complex turbulent interactions that drive various phenomena, such as plasma eruptions, spontaneous formation of magnetic structures, funnel-like structures and magnetic loops in the corona, and others. In particular, we focus on multi-scale processes of energy exchange across layers of the solar interior and atmosphere, which contribute to coronal heating and eruptive dynamics. For modeling global-scale activity, we use a data assimilation approach that has demonstrated great potential for building reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to the Parker-Kleeorin-Ruzmakin dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of observational limitations on prediction accuracy, and we present the EnKF predictions of the upcoming Solar Cycle (25) based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach for modeling and forecasting solar activity.

Kitiashvili, I. N.↗

A Community Convention for Ecological Forecasting: Output Files and Metadata Version 1.0

This paper summarizes the open community conventions developed by the Ecological Forecasting Initiative (EFI) for the common formatting and archiving of ecological forecasts and the metadata associated with these forecasts. Such open standards are intended to promote interoperability and facilitate forecast communication, distribution, validation, and synthesis. For output files, we first describe the convention conceptually in terms of global attributes, forecast dimensions, forecasted variables, and ancillary indicator variables. We then illustrate the application of this convention to the two file formats that are currently preferred by the EFI, netCDF (network common data form), and comma-separated values (CSV), but note that the convention is extensible to future formats. For metadata, EFI's convention identifies a subset of conventional metadata variables that are required (e.g., temporal resolution and output variables) but focuses on developing a framework for storing information about forecast uncertainty propagation, data assimilation, and model complexity, which aims to facilitate cross-forecast synthesis. The initial application of this convention expands upon the Ecological Metadata Language (EML), a commonly used metadata standard in ecology. To facilitate community adoption, we also provide a Github repository containing a metadata validator tool and several vignettes in R and Python on how to both write and read in the EFI standard. Lastly, we provide guidance on forecast archiving, making an important distinction between short-term dissemination and long-term forecast archiving, while also touching on the archiving of code and workflows. Overall, the EFI convention is a living document that can continue to evolve over time through an open community process.

Michael C. Dietze↗

Satellite Sea Surface Salinity Observations Impact on El Niño/Southern Oscillation Predictions: Case Studies from the NASA GEOS Seasonal Forecast System

El Niño/Southern Oscillation (ENSO) has far reaching global climatic impacts and so extending useful ENSO forecasts would have great societal benefit. However, one key variable that has yet to be fully exploited within coupled forecast systems is accurate estimation of near-surface ocean salinity. Satellite sea surface salinity (SSS), combined with temperature, help to improve the estimates of ocean density changes and associated near-surface mixing. For the first time, we assess the impact of satellite SSS observations for improving near-surface dynamics within ocean reanalyses and how these initializations impact dynamical ENSO forecasts using NASA’s coupled forecast system (GEOS-S2S-2). For all initialization experiments, all available sea level and in situ temperature and salinity observations are assimilated. Separate observing system experiments (OSE) additionally assimilate Aquarius, and SMAP, SMOS, and these datasets combined. We highlight the impact of satellite SSS on ocean reanalyses by comparing experiments with and without the application of SSS assimilation. Next, we compare case studies of coupled forecasts for the big 2015 El Niño, the 2017 La Niña, and the weak El Niño in 2018 that are initialized from GEOS-S2S-2 spring reanalyses that assimilate and withhold along-track SSS. For each of these ENSO-event case studies, assimilation of satellite SSS improves the forecast validation with respect to observed NINO3.4 anomalies (or at least reduces the forecast uncertainty). Satellite SSS assimilation improved characterization of the mixed layer depth leading to more accurate coupled air/sea interaction and better forecasts. These results further underline the value of satellite SSS assimilation into operational forecast systems.

Eric Hackert↗

Model Forecast Skill and Sensitivity to Initial Conditions in the Seasonal Sea Ice Outlook

We explore the skill of predictions of September Arctic sea ice extent from dynamical models participating in the Sea Ice Outlook (SIO). Forecasts submitted in August, at roughly 2 month lead times, are skillful. However, skill is lower in forecasts submitted to SIO, which began in 2008, than in hindcasts (retrospective forecasts) of the last few decades. The multimodel mean SIO predictions offer slightly higher skill than the single-model SIO predictions, but neither beats a damped persistence forecast at longer than 2 month lead times. The models are largely unsuccessful at predicting each other, indicating a large difference in model physics and/or initial conditions. Motivated by this, we perform an initial condition sensitivity experiment with four SIO models, applying a fixed −1 m perturbation to the initial sea ice thickness. The significant range of the response among the models suggests that different model physics make a significant contribution to forecast uncertainty.

Arctic Sea↗

The Arya Crop Yield Forecasting Algorithm: Application to the Main Wheat Exporting Countries

Wheat is the most important commodity traded in the international food market. Thus, accurate and timely information on wheat production can help mitigate food price fluctuations. Within the existing operational regional and global scale agricultural monitoring systems that provide information on global crop yield and area forecasts, there are still fundamental gaps: #1. Lack of quantitative Earth Observation (EO) derived crop information, #2. Lack of global but detailed (national or subnational level) and timely crop production forecasts and #3. Lack of information on forecast uncertainties. In this study we present the Agriculture Remotely-sensed Yield Algorithm (ARYA) an EO-based method, advancing the state of EO data application and usage (addressing gap #1) to forecast wheat yield. The algorithm is based on the evolution of the Difference Vegetation Index (DVI) using MODIS data at 1km resolution and the Growing Degree Days (GDD) from reanalysis data. Additionally, we explore how Land Surface Temperature (LST) can be included into the model and whether this parameter adds any value to the model performance when combined with the optical information. ARYA is implemented at the national and subnational level to forecast winter wheat yield in the main wheat exporting countries of US, Russia, Ukraine, France, Germany, Australia and Argentina from 2001 to 2019 (covering over 70% of wheat exports globally) in a timely manner by providing daily forecasts (addressing gap #2). The results show that ARYA provides yield estimations with RMSE’s within 0.3 ± 0.1 t/ha at national level and 0.6 ± 0,1 t/ha at subnational level after Day Of the Year (DOY) 140 (mid May) in the Northern Hemisphere and DOY 280 (beginning of October) in the Southern Hemisphere. This means that ARYA can provide crop yield estimates of wheat yield with 5-15 % error at national and 7-20 % error at subnational level starting from 2 to 2.5 months prior to harvest.

Agriculture↗

Conflict Resolution for Wind-Optimal Aircraft Trajectories in North Atlantic Oceanic Airspace with Wind Uncertainties

Air traffic in the North Atlantic oceanic airspace (NAT) experiences very strong winds caused by jet streams. Flying wind-optimal trajectories increases individual flight efficiency, which is advantageous when operating in the NAT. However, as the NAT is highly congested during peak hours, a large number of potential conflicts between flights are detected for the sets of wind-optimal trajectories. Conflict resolution performed at the strategic level of flight planning can significantly reduce the airspace congestion. However, being completed far in advance, strategic planning can only use predicted environmental conditions that may significantly differ from the real conditions experienced further by aircraft. The forecast uncertainties result in uncertainties in conflict prediction, and thus, conflict resolution becomes less efficient. This work considers wind uncertainties in order to improve the robustness of conflict resolution in the NAT. First, the influence of wind uncertainties on conflict prediction is investigated. Then, conflict resolution methods accounting for wind uncertainties are proposed.

wind uncertainties↗

Impact of Tactical and Strategic Weather Avoidance on Separation Assurance

The ability to keep flights away from weather hazards while maintaining aircraft-to-aircraft separation is critically important. The Advanced Airspace Concept is an automation concept that implements a ground-based strategic conflict resolution algorithm for management of aircraft separation. The impact of dynamic and uncertain weather avoidance on this concept is investigated. A strategic weather rerouting system is integrated with the Advanced Airspace Concept, which also provides a tactical weather avoidance algorithm, in a fast time simulation of the Air Transportation System. Strategic weather rerouting is used to plan routes around weather in the 20 minute to two-hour time horizon. To address forecast uncertainty, flight routes are revised at 15 minute intervals. Tactical weather avoidance is used for short term trajectory adjustments (30 minute planning horizon) that are updated every minute to address any weather conflicts (instances where aircraft are predicted to pass through weather cells) that are left unresolved by strategic weather rerouting. The fast time simulation is used to assess the impact of tactical weather avoidance on the performance of automated conflict resolution as well as the impact of strategic weather rerouting on both conflict resolution and tactical weather avoidance. The results demonstrate that both tactical weather avoidance and strategic weather rerouting increase the algorithm complexity required to find aircraft conflict resolutions. Results also demonstrate that tactical weather avoidance is prone to higher airborne delay than strategic weather rerouting. Adding strategic weather rerouting to tactical weather avoidance reduces total airborne delays for the reported scenario by 18% and reduces the number of remaining weather violations by 13%. Finally, two features are identified that have proven important for strategic weather rerouting to realize these benefits; namely, the ability to revise reroutes and the use of maneuvers that start far ahead of encountering a weather cell when rerouting around weather.

Refai, Mohamad S.↗

Using Field and Satellite Measurements to Improve Snow and Riming Processes in Cloud Resolving Models

The representation of clouds in climate and weather models is a driver in forecast uncertainty. Cloud microphysics parameterizations are challenged by having to represent a diverse range of ice species. Key characteristics of predicted ice species include habit and fall speed, and complex interactions that result from mixed-phased processes like riming. Our proposed activity leverages Global Precipitation Measurement (GPM) Mission ground validation studies to improve parameterizations

Colle, Brian A.↗

Air Traffic Management Technology Demonstration - 3 (ATD-3) Dynamic Weather Routes Domestic En Route Concept of Operations Synopsis Version 1.0

NASA conducted a survey in 2015 of stakeholders in industry, flight operators, and others to collect data on the most pressing air traffic management (ATM) issues impacting en route operations. Weather related delays and interruptions were identified as the most significant and costly problem impacting en route operations in today's system. Additionally, future traffic demands will place greater demands on the FAA's air traffic control system, necessitate a more efficient and integrated traffic management system and provide controller tools to leverage human productivity. Consequently, NASA is assembling a suite of integrated ground and aircraft-based technologies and decision-making aids under the Airspace Technology Demonstrations 3 (ATD-3) project to continuously search for more efficient weather-avoidance routes and to rapidly respond to weather changes and associated traffic management initiatives. These route efficiency enhancements are targeted at en route airspace and will enable continued use of en route and arrival metering in the presence of weather. NASA's Dynamic Weather Routes (DWR) concept represents a subset of those technologies and focuses primarily on the cruise phase of flight. It leverages existing air traffic weather, airspace, and traffic data, as well as improvements in navigation, surveillance, communication and digital network technologies, and builds upon existing ATM automation to address the shortcomings associated with strategic traffic flow management initiatives and weather forecasting uncertainties. The potential benefits in the form of time, fuel, and cost savings are significant. This concept of operations synopsis provides a detailed description of DWR, its potential benefits and notional implementation paths.

DWR↗

Air Traffic Management Technology Demonstration - 3 (ATD-3) Multi-Flight Common Route (MFCR) Concept of Operations Version 1.0

NASA's Multi Flight Common Route (MFCR) automation represents one element of those technologies focusing primarily on delay recovery in the en route phase of flight. Delay recovery is an attenuation of flight-time delay, accomplished by periodically revising weather-avoidance routing as the convective weather system evolves. MFCR is intended for use by Traffic Management Coordinators (TMCs) in Air Route Traffic Control Centers (ARTCCs, or Centers) and traffic management specialists (TMSs) in the Air Traffic Control System Command Center (ATCSCC). MFCR leverages existing weather, airspace, and traffic data, as well as improvements in navigation, surveillance, communication, and digital information technologies, to build on existing ATM automation and address some of the shortcomings associated with strategic traffic flow management initiatives and weather forecasting uncertainties. These capabilities provide significant potential benefits in the form of time, fuel, and cost savings. The concept of operations described in this document describes MFCR functionality as delivered by NASA to the FAA in December 2017, including a list of potential enhancements that may be realized when the system is fielded.

conops↗

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗

Integrated Precision Landing Performance and Technology Assessments of a Human-Scale Mars Lander Using a Generalized Simulation Framework

Human-scale missions to Mars will likely require multiple landers delivered precisely to designated locations. The current NASA human Mars reference architecture assumes delivery of three 25 t payloads from a 1- or 5-Sol orbit to the surface with a landing precision of 50 m to ensure logistics are located near the habitat. While initial navigation estimates improve with on-orbit ground tracking, errors increase during post-deorbit coast. Likewise, Mars atmospheric variability and forecasting uncertainty means that the entry vehicle guidance, navigation, and control systems must be robust to accommodate landing during any time of day or Mars year, including during dust storms. Precision landing technologies are currently being assessed to determine if onboard navigation sensors are sufficient to enable the landing accuracy required or if additional navigation aids such as surface or orbiting beacons will be needed. This study evaluates the system performance requirements to meet the desired landing accuracy for the reference vehicle design and entry, descent, and landing concept of operations. A detailed six degree-of-freedom integrated performance simulation framework is used to perform the assessment and demonstrate that under current assumptions, onboard navigation sensors are sufficient to support precision landing.

spacecraft navigation↗

Integrated Precision Landing Performance and Technology Assessments of a Human- Scale Mars Lander Using a Generalized Simulation Framework

Human-scale missions to Mars will likely require multiple landers delivered precisely to designated locations. The current NASA human Mars reference architecture assumes delivery of three 25 t payloads from a 1- or 5-Sol orbit to the surface with a landing precision of 50 m to ensure logistics are located near the habitat. While initial navigation estimates improve with on-orbit ground tracking, errors increase during post-deorbit coast. Likewise, Mars atmospheric variability and forecasting uncertainty means that the entry vehicle guidance, navigation, and control systems must be robust to accommodate landing during any time of day or Mars year, including during dust storms. Precision landing technologies are currently being assessed to determine if onboard navigation sensors are sufficient to enable the landing accuracy required or if additional navigation aids such as surface or orbiting beacons will be needed. This study evaluates the system performance requirements to meet the desired landing accuracy for the reference vehicle design and entry, descent, and landing concept of operations. A detailed six degree-of-freedom integrated performance simulation framework is used to perform the assessment and demonstrate that under current assumptions, onboard navigation sensors are sufficient to support precision landing.

Chen, Po-Ting↗