Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Building a standardized Observing System Simulation Experiment (OSSE) framework for Mars

We advocate that the Decadal Survey recommends the NASA Science Mission Directorate to develop a rigorous Observing System Simulation Experiment (OSSE) framework for Mars, to optimize future atmospheric observations. Atmospheric conditions on Mars are a potential hazard source for landing missions. Errors in the estimates of atmospheric density profiles, inadequate knowledge of wind vertical structure and dust concentration as a function of height are likely causes of uncertainty at the landing site on the order of kilometers. An operational real-time weather forecasting capability for Mars would reduce such uncertainties, carrying enormous benefits to future robotic missions, and would be an invaluable prerequisite for human missions.A real-time forecasting capability relies upon three fundamental components: a critical mass of observing systems, a data assimilation system (DAS), and a global forecast model. The DAS allows the model to ingest the data effectively, optimizing the observational information content,and transforming them into a gridded representation of the atmosphere at a given time, called an ‘analysis’. The analysis is the best estimate of the atmospheric state for that time, and also represents a set of ‘initial conditions’ from which a global model can be initialized, to predict a future state of the atmosphere. The connection between analysis and forecast represents the foundation of modern weather forecasting. However, from the point of view of a forecast system,not all observations are equally impactful, partially because of the problem of “observational error correlation”, one important research topic in data assimilation development. For the Earth, partly due to the spontaneous and deregulated development of observations and forecast capabilities worldwide for more than half a century,the use of observations in contemporary operational forecast systems is suboptimal, with many potentially useful data being underutilized. On the contrary, Mars atmospheric scientists are in the unique situation of designing the next-generation observing systems by learning from the experience gathered on the Earth, so as to assure that the future instruments are specifically optimized to give the maximum benefit to a future weather forecast capability.An immensely powerful tool that has been firmly established by atmospheric scientists on the Earth is represented by a properly designed OSSE framework. A realistic OSSE framework cannot only quantify the benefit of future data types, be them surface based or space borne, but can also help design and optimize an entire observational network. Furthermore, OSSEs can provide deep insights into an atmosphere’s behavior, by addressing conceptual problems of its intrinsic predictability and delineating the regions or features of the atmosphere which are more sensitive to additional data and would benefit from a denser sampling. The difficulties posed by OSSEs are fundamentally different for Earth and Mars. For Earth, the enormous data volume imposes a tremendous constraint on any innovation in the observing systems: it is very hard for a single sensor to impact the skill. For Mars, the problem is the opposite: almost any additional instrument will exert some impact. However, OSSEs can help to evaluate the cost/benefit for every sensor and suggest optimal data configuration and density.The purpose of this white paper is to provide an introduction to a rigorously designed OSSE framework, explain the underlying problems and challenges, and engage the Mars community to collaborate with Earth Atmospheric scientists in order to develop a joint-OSSE framework for Mars with the largest consensual basis possible. An OSSE infrastructure would increase the understanding of the Martian atmosphere, would help NASA to optimize instrument specifications and orbit choice, providing the maximium benefit for a given expenditure of resources, and could even help establishing a roadmap for a future real-time weather forecasting capability.

Oreste Reale↗

Solar power satellite system definition study. Volume 1, phase 1: Executive summary

A systems definition study of the solar satellite system (SPS) is presented. The technical feasibility of solar power satellites based on forecasts of technical capability in the various applicable technologies is assessed. The performance, cost, operational characteristics, reliability, and the suitability of SPS's as power generators for typical commercial electricity grids are discussed. The uncertainties inherent in the system characteristics forecasts are assessed.

Source record↗

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗

Demonstration of AIRS Total Ozone Products to Operations to Enhance User Readiness

Cyclogenesis is a key forecast challenge at operational forecasting centers such as WPC and OPC, so these centers have a particular interest in unique products that can identify key storm features. In some cases, explosively developing extratropical cyclones can produce hurricane force, non-convective winds along the East Coast and north Atlantic as well as the Pacific Ocean, with the potential to cause significant damage to life and property. Therefore, anticipating cyclogenesis for these types of storms is crucial for furthering the NOAA goal of a "Weather Ready Nation". Over the last few years, multispectral imagery (i.e. RGB) products have gained popularity among forecasters. The GOES-R satellite champion at WPC/OPC has regularly evaluated the Air Mass RGB products from GOES Sounder, MODIS, and SEVIRI to aid in forecasting cyclogenesis as part of ongoing collaborations with SPoRT within the framework of the GOES-R Proving Ground. WPC/OPC has used these products to identify regions of stratospheric air associated with tropopause folds that can lead to cyclogenesis and hurricane force winds. RGB products combine multiple channels or channel differences into multi-color imagery in which different colors represent a particular cloud or air mass type. Initial interaction and feedback from forecasters evaluating the legacy Air Mass RGBs revealed some uncertainty regarding what physical processes the qualitative RGB products represent and color interpretation. To enhance forecaster confidence and interpretation of the Air Mass RGB, NASA SPoRT has transitioned a total column ozone product from AIRS retrievals to the WPC/OPC. The use of legacy AIRS demonstrates future JPSS capabilities possible with CrIS or OMPS. Since stratospheric air can be identified by anomalous potential vorticity and warm, dry, ozone-rich air, hyperspectral infrared sounder ozone products can be used in conjunction with the Air Mass RGB for identifying the role of stratospheric air in explosive cyclogenesis and hurricane force wind events. Currently, forecasters at WPC/OPC are evaluating the Air Mass RGB imagery in conjunction with the AIRS total column ozone to aid forecasting cyclogenesis and high wind forecasts. One of the limitations of the total ozone product is that it is difficult for forecasters to determine whether elevated ozone concentrations are related to stratospheric air or climatologically high values of ozone in certain regions. To address this limitation, SPoRT created an AIRS ozone anomaly product which calculates the percent of normal ozone based on a global stratospheric ozone mean climatology. With the knowledge that ozone values 125 percent of normal and greater typically represent stratospheric air; the anomaly product can be used with the total column ozone product to confirm regions of stratospheric air on the Air Mass RGB. This presentation describes the generation of these products along with forecaster feedback concerning the use of the AIRS ozone products in conjunction with the Air Mass RGB product for the unique forecast challenges WPC/OPC face. Additionally examples of CrIS ozone and anomaly products will be shown to further demonstrate the utility and capability of JPSS in forecasting unique events.

Berndt, Emily↗

Development and Application of Hyperspectral Infrared Ozone Retrieval Products for Operational Meteorology

Cyclogenesis is a key forecast challenge at operational forecasting centers such as WPC and OPC, so these centers have a particular interest in unique products that can identify key storm features. In some cases, explosively developing extratropical cyclones can produce hurricane force, non-convective winds along the East Coast and north Atlantic as well as the Pacific Ocean, with the potential to cause significant damage to life and property. Therefore, anticipating cyclogenesis for these types of storms is crucial for furthering the NOAA goal of a "Weather Ready Nation". Over the last few years, multispectral imagery (i.e. RGB) products have gained popularity among forecasters. The GOES-R satellite champion at WPC/OPC has regularly evaluated the Air Mass RGB products from GOES Sounder, MODIS, and SEVIRI to aid in forecasting cyclogenesis as part of ongoing collaborations with SPoRT within the framework of the GOES-R Proving Ground. WPC/OPC has used these products to identify regions of stratospheric air associated with tropopause folds that can lead to cyclogenesis and hurricane force winds. RGB products combine multiple channels or channel differences into multi-color imagery in which different colors represent a particular cloud or air mass type. Initial interaction and feedback from forecasters evaluating the legacy Air Mass RGBs revealed some uncertainty regarding what physical processes the qualitative RGB products represent and color interpretation. To enhance forecaster confidence and interpretation of the Air Mass RGB, NASA SPoRT has transitioned a total column ozone product from AIRS retrievals to the WPC/OPC. The use of legacy AIRS demonstrates future JPSS capabilities possible with CrIS or OMPS. Since stratospheric air can be identified by anomalous potential vorticity and warm, dry, ozone-rich air, hyperspectral infrared sounder ozone products can be used in conjunction with the Air Mass RGB for identifying the role of stratospheric air in explosive cyclogenesis and hurricane force wind events. Currently, forecasters at WPC/OPC are evaluating the Air Mass RGB imagery in conjunction with the AIRS total column ozone to aid forecasting cyclogenesis and high wind forecasts. One of the limitations of the total ozone product is that it is difficult for forecasters to determine whether elevated ozone concentrations are related to stratospheric air or climatologically high values of ozone in certain regions. To address this limitation, SPoRT created an AIRS ozone anomaly product which calculates the percent of normal ozone based on a global stratospheric ozone mean climatology. With the knowledge that ozone values 125 percent of normal and greater typically represent stratospheric air; the anomaly product can be used with the total column ozone product to confirm regions of stratospheric air on the Air Mass RGB. This presentation describes the generation of these products along with forecaster feedback concerning the use of the AIRS ozone products in conjunction with the Air Mass RGB product for the unique forecast challenges WPC/OPC face. Additionally examples of CrIS ozone and anomaly products will be shown to further demonstrate the utility and capability of JPSS in forecasting unique events.

Berndt, Emily↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers, and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Carl Malings↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Nathan R. Pavlovic↗

Impact of Archeomagnetic Field Model Data on Modern Era Geomagnetic Forecasts

A series of geomagnetic data assimilation experiments have been carried out to demonstrate the impact of assimilating archeomagnetic data via the CALS3k.4 geomagnetic field model from the period between 10 and 1590 CE. The assimilation continues with the gufm1 model from 1590 to 1990 and CM4 model from 1990 to 2000 as observations, and comparisons between these models and the geomagnetic forecasts are used to determine an optimal maximum degree for the archeomagnetic observations, and to independently estimate errors for these observations. These are compared with an assimilation experiment that uses the uncertainties provided with CALS3k.4. Optimal 20 year forecasts in 1990 are found when the Gauss coefficients up to degree 3 are assimilated. In addition we demonstrate how a forecast and observation bias correction scheme could be used to reduce bias in modern era forecasts. Initial experiments show that this approach can reduce modern era forecast biases by as much as 50 percent.

Tangborn, Andrew↗

Statistical Approaches for the Definition of Landslide Rainfall Thresholds and their Uncertainty Using Rain Gauge and Satellite Data

Models for forecasting rainfall-induced landslides are mostly based on the identification of empirical rainfall thresholds obtained exploiting rain gauge data. Despite their increased availability, satellite rainfall estimates are scarcely used for this purpose. Satellite data should be useful in ungauged and remote areas, or should provide a significant spatial and temporal reference in gauged areas. In this paper, the analysis of the reliability of rainfall thresholds based on rainfall remote sensed and rain gauge data for the prediction of landslide occurrence is carried out. To date, the estimation of the uncertainty associated with the empirical rainfall thresholds is mostly based on a bootstrap resampling of the rainfall duration and the cumulated event rainfall pairs (D,E) characterizing rainfall events responsible for past failures. This estimation does not consider the measurement uncertainty associated with D and E. In the paper, we propose (i) a new automated procedure to reconstruct ED conditions responsible for the landslide triggering and their uncertainties, and (ii) three new methods to identify rainfall threshold for the possible landslide occurrence, exploiting rain gauge and satellite data. In particular, the proposed methods are based on Least Square (LS), Quantile Regression (QR) and Nonlinear Least Square (NLS) statistical approaches. We applied the new procedure and methods to define empirical rainfall thresholds and their associated uncertainties in the Umbria region (central Italy) using both rain-gauge measurements and satellite estimates. We finally validated the thresholds and tested the effectiveness of the different threshold definition methods with independent landslide information. The NLS method among the others performed better in calculating thresholds in the full range of rainfall durations. We found that the thresholds obtained from satellite data are lower than those obtained from rain gauge measurements. This is in agreement with the literature, where satellite rainfall data underestimate the 'ground' rainfall registered by rain gauges.

landslide prediction↗

Power law time dependence of river flood decay and its relationship to long term discharge frequency distribution

Investigations have continued into the possibility that significant information on stream flow rates can be obtained from aerial and satellite imagery of river meander patterns by seeking a correlation between the meander and discharge spectra of rivers. Such a correlation could provide the basis for a simple and inexpensive technique for remote sensing of the water resources of large geographical areas, eliminating the need for much hydrologic recording. The investigation of the nature of the meander and discharge spectra and their interrelationship can also contribute to a more fundamental understanding of the processes of both river meander formation and drainage of large basins. It has been found that floods decay with an inverse power law dependence on time. The exponent of this dependence varies from river to river and even from station to station along the same river. This power law time dependence makes possible the forecasting of river discharge with an uncertainty of about 5% for as long as a month following the flood peak.

Schubert, G.↗

Visualizing 2D Probability Distributions from Satellite Image-Derived Data

Creating maps of biophysical and geophysical variables using Earth Observing System (EOS) satellite image data is an important component of Earth science. These 2D maps have a single value at every location and standard techniques are used to visualize them. Current tools fall short, however, when it is necessary to describe a distribution of values at each location. Distributions may represent a frequency of occurrence over time, frequency of occurrence from multiple runs of an ensemble forecast or possible values from an uncertainty model. 'Distribution data sets' are described, then a case study is presented to visualize such 2D distributions. Distribution data sets are different from multivariate data sets in the sense that the values are for a single variable instead of multiple variables. Our case study data consists of multiple realizations of percent forest cover, generated using a geostatistical technique that combines ground measurements and satellite imagery to model uncertainty about forest cover. We present several approaches for analyzing and visualizing such data sets. The first is a pixel-wise analysis of the probability density functions for the 2D image while the second is an analysis of features identified within the image. Such pixel-wise and feature-wise views will give Earth scientists a more complete understanding of distribution data sets.

Kao, David↗

Accurate Radiometry from Space: An Essential Tool for Climate Studies

The Earth s climate is undoubtedly changing; however, the time scale, consequences and causal attribution remain the subject of significant debate and uncertainty. Detection of subtle indicators from a background of natural variability requires measurements over a time base of decades. This places severe demands on the instrumentation used, requiring measurements of sufficient accuracy and sensitivity that can allow reliable judgements to be made decades apart. The International System of Units (SI) and the network of National Metrology Institutes were developed to address such requirements. However, ensuring and maintaining SI traceability of sufficient accuracy in instruments orbiting the Earth presents a significant new challenge to the metrology community. This paper highlights some key measurands and applications driving the uncertainty demand of the climate community in the solar reflective domain, e.g. solar irradiances and reflectances/radiances of the Earth. It discusses how meeting these uncertainties facilitate significant improvement in the forecasting abilities of climate models. After discussing the current state of the art, it describes a new satellite mission, called TRUTHS, which enables, for the first time, high-accuracy SI traceability to be established in orbit. The direct use of a primary standard and replication of the terrestrial traceability chain extends the SI into space, in effect realizing a metrology laboratory in space . Keywords: climate change; Earth observation; satellites; radiometry; solar irradiance

Fox, Nigel↗

Three CA-Related Covariance Issues and Their Solutions

This presentation addresses three issues that arise in the use of DoD-produced satellite state estimate covariances in the conjunction assessment process: the realism of the provided covariances, how to address correlated error between two satellites' covariance matrices, and how to proceed when a furnished covariance is non-positive-definite. To address the first, DoD has implemented a set of two "consider parameters" with which to alter/expand the covariance to account for atmospheric density forecast error and satellite frontal area uncertainty, the two largest sources of unmodeled position prediction error for LEO orbits; these values are governed by a satellite's orbital parameters and ballistic coefficient histories, as well as the current and predicted space weather situation. This approach substantially improves the realism of the covariance by accounting for expected prediction errors that are not part of the fit process that generates the covariance. The second issue of covariance correlation is a complicated one, but the main shared error source—global atmospheric density error that is common to both satellites can be characterized and, through sensitivity vectors, quantified at the conjunction's time of closest approach and removed from the joint covariance, which is used in the CA probability of collision (Pc) calculation. Finally, while according to the orbit determination theory a non-positive-definite (NPD) covariance is not possible, numerical truncation and covariance interpolation can conspire to produce NPD results, which render the covariance unusable for certain CA risk assessment calculations, such as Monte Carlo Pc determination. Three similar techniques are profiled and the simplest of them recommended as a reasonable remediation technique when NPD covariances are encountered by CA practitioners.

Dynamic Consider Parameter↗

A model-independent data assimilation (MIDA) module and its applications in ecology

Models are an important tool to predict Earth system dynamics. An accurate prediction of future states of ecosystems depends on not only model structures but also parameterizations. Model parameters can be constrained by data assimilation. However, applications of data assimilation to ecology are restricted by highly technical requirements such as model-dependent coding. To alleviate this technical burden, we developed a model-independent data assimilation (MIDA) module. MIDA works in three steps including data preparation, execution of data assimilation, and visualization. The first step prepares prior ranges of parameter values, a defined number of iterations, and directory paths to access files of observations and models. The execution step calibrates parameter values to best fit the observations and estimates the parameter posterior distributions. The final step automatically visualizes the calibration performance and posterior distributions. MIDA is model independent, and modelers can use MIDA for an accurate and efficient data assimilation in a simple and interactive way without modification of their original models. We applied MIDA to four types of ecological models: the data assimilation linked ecosystem carbon (DALEC) model, a surrogate-based energy exascale earth system model: the land component (ELM), nine phenological models and a stand-alone biome ecological strategy simulator (BiomeE). The applications indicate that MIDA can effectively solve data assimilation problems for different ecological models. Additionally, the easy implementation and model-independent feature of MIDA breaks the technical barrier of applications of data–model fusion in ecology. MIDA facilitates the assimilation of various observations into models for uncertainty reduction in ecological modeling and forecasting.

Earth system dynamics↗

Evaluation of Temporal Spacing Errors Associated with Interval Management Algorithms

This paper seeks to characterize the temporal spacing errors resulting from the use of Interval Management (IM) algorithms. The focus of the current paper is IM concepts and algorithms that realize a specified temporal spacing between a Target aircraft and an Ownship aircraft at the runway threshold. The paper presents an IM algorithm consisting of the following four modules: (i) Target-Landing-Time Estimation Module, (ii) Ownship-Landing-Time Estimation Module, (iii) Ownship Speed Command Computation Module, and (iv) Ownship Thrust Command Computation Module. The overall guidance module is evaluated on a simulation that models aircraft point-mass dynamics, bank-angle auto-pilot dynamics, pitch-axis auto-pilot dynamics, and engine lag dynamics. The simulation environment also consists of actual atmospheric forecasts and realistic spatio-temporally correlated wind uncertainty models. Results obtained from single case simulation as well as Monte-Carlo simulations are presented in the paper. The modeled scenario consisted of an A320 Target equipped with “Lateral Navigation”/“Vertical Navigation” (LNAV/VNAV) capabilities followed by an A320 Ownship equipped with the IM algorithm. Both aircraft fly the BIGSUR route to SFO airport using a RAP-13 1-hr wind forecast. 500 Monte-Carlo simulations were conducted with realistic wind uncertainty models. The IM algorithm for this case is seen to have a 90% probability landing time error range of 5.9 seconds, compared to the no-IM solution, which has a 90% probability landing time error range of 33.4 seconds.

Bai, Xiaoli↗

A Comparison of Perturbed Initial Conditions and Multiphysics Ensembles in a Severe Weather Episode in Spain

Ensembles of numerical model forecasts are of interest to operational early warning forecasters as the spread of the ensemble provides an indication of the uncertainty of the alerts, and the mean value is deemed to outperform the forecasts of the individual models. This paper explores two ensembles on a severe weather episode in Spain, aiming to ascertain the relative usefulness of each one. One ensemble uses sensible choices of physical parameterizations (precipitation microphysics, land surface physics, and cumulus physics) while the other follows a perturbed initial conditions approach. The results show that, depending on the parameterizations, large differences can be expected in terms of storm location, spatial structure of the precipitation field, and rain intensity. It is also found that the spread of the perturbed initial conditions ensemble is smaller than the dispersion due to physical parameterizations. This confirms that in severe weather situations operational forecasts should address moist physics deficiencies to realize the full benefits of the ensemble approach, in addition to optimizing initial conditions. The results also provide insights into differences in simulations arising from ensembles of weather models using several combinations of different physical parameterizations.

severe weather↗