SEARCH · Search NASA

Results for “Observing System Simulation Experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS2023

Robustness of Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to investigate the potential performance of proposed new instruments on numerical weather prediction (NWP). As OSSEs involve a framework in which the atmosphere and observations are all completely simulated, it is necessary to perform validation of the OSSE to ensure that it is sufficiently realistic to provide useful experimental results. A common issue that affects the forecast skill and observation impacts is the tendency of OSSEs to have insufficient model error compared to NWP in the real world. In this work, two versions of the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) NWP OSSE framework are compared, with the newer framework having more simulated forecast model error than the older framework due to changes to the NWP system. The performance of the updated OSSE is validated against corresponding behavior of the same NWP system in the real world in terms of the simulated observations, the analysis increments, forecast error, and observation impacts. OSSE results of analysis and forecast impacts for three proposed new observation systems are also compared between the older and newer frameworks to evaluate the robustness of the OSSE experiments and the role of model error in observation impacts. These three new instruments are the Geostationary eXtended Observations (GeoXO) hyperspectral infrared sounder (GXS), the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds) atmospheric motion vectors, and additional Global Navigation Satellite System Radio Occultations (GNSS-RO).

Observing System Simulation Experiments↗

NASA NTRS2018

Observing System Simulation Experiments

Observing System Simulation Experiments can be powerful tools for evaluating and exploring both the behavior of data assimilation systems and the potential impacts of future observing systems. With great power comes great responsibility - given a pure modeling framework, how can we be sure our results are meaningful? The challenges and pitfalls of OSSE calibration and validation will be addressed, as well as issues of incestuousness, selection of appropriate metrics, and experiment design. The use of idealized observational networks to investigate theoretical ideas in a fully complex modeling framework will also be discussed.

Prive, Nikki↗

NASA NTRS1984

Accuracy of diagnostic heat and moisture budgets using SESAME-79 field data as revealed by observing system simulation experiments

Observing system simulation experiments are used to investigate the accuracy of diagnostic heat and moisture budgets which employ the AVE-SESAME 1979 data. The time-including, four-dimensional data set of a mesoscale model is used to simulate rawinsonde observations from AVE-SESAME 1979. The 5 C/day (heat budget) and 2 g/kg per day (moisture budget) magnitudes of error obtained indicate difficulties in the diagnosis of the heating rate in weak convective systems. The influences exerted by observational frequency, objective analysis, observational density, vertical interpolation, and observational errors on the budget are also studied, and it is found that the temporal and spatial resolution of the SESAME regional network is marginal for diagnosing convective effects on a horizontal time scale of 550 x 550 km.

Kuo, Y.-H.↗

NASA NTRS1992

NWP Impact of Cloud Top and Boundary Layer Winds from a Satellite Borne Lidar: an Observing System Simulation Experiment

Observing systems simulation experiments (OSSE's) provide a powerful tool to assess the impact of proposed satellite borne observing systems on meteorological applications models. We describe the results of an OSSE conducted to assess the impact of data from a low power lidar wind sensor on the forecast accuracy of a global spectral numerical weather prediction (NWP) model, the Air Force Geophysics Laboratory Global Data Assimilation System. The instrument would be operating at near-infrared wavelengths thereby increasing the backscatter signal relative to comparable infrared lidar.

Isaacs, R. G.↗

NASA NTRS2012

Assimilating Remote Sensing Observations of Leaf Area Index and Soil Moisture for Wheat Yield Estimates: An Observing System Simulation Experiment

Observing system simulation experiments were used to investigate ensemble Bayesian state updating data assimilation of observations of leaf area index (LAI) and soil moisture (theta) for the purpose of improving single-season wheat yield estimates with the Decision Support System for Agrotechnology Transfer (DSSAT) CropSim-Ceres model. Assimilation was conducted in an energy-limited environment and a water-limited environment. Modeling uncertainty was prescribed to weather inputs, soil parameters and initial conditions, and cultivar parameters and through perturbations to model state transition equations. The ensemble Kalman filter and the sequential importance resampling filter were tested for the ability to attenuate effects of these types of uncertainty on yield estimates. LAI and theta observations were synthesized according to characteristics of existing remote sensing data, and effects of observation error were tested. Results indicate that the potential for assimilation to improve end-of-season yield estimates is low. Limitations are due to a lack of root zone soil moisture information, error in LAI observations, and a lack of correlation between leaf and grain growth.

Nearing, Grey S.↗

NASA NTRS2017

An Introduction to Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to estimate the potential impact of proposed new instruments and data on numerical weather prediction. OSSEs can also be used to help design new observing platforms and to investigate the behavior of data assimilation systems. A basic overview of how to design and perform an OSSE will be given, as well as best practices and pitfalls. Some examples using the OSSE framework developed at the NASA Global Modeling and Assimilation Office will be shown.

OSSE↗

NASA NTRS2014

Status of the NASA GMAO Observing System Simulation Experiment

An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.

OSSE↗

NASA NTRS2018

Adjoint Estimation of Observation Impact Explored with an Observing System Simulation Experiment

In an Observing System Simulation Experiment, the full, true state of the simulated atmosphere is known. This knowledge allows the direct calculation of analysis and forecast errors, and also may be used in conjunction with an adjoint tool to calculate metrics that are unachievable in the real world. For example, the errors that result from the use of the analysis state as verification when running adjoint calculations of observation impact on a forecast can be quantified. The adjoint itself can also be used to operate on the analysis state rather than on the forecast state. Results from these and other adjoint experiments using the NASA/GMAO OSSE framework will be presented.

Prive, Nikki↗

NASA NTRS2015

Observing System Simulation Experiments for Fun and Profit

Observational Networks↗

NASA NTRS2012

A Regional CO2 Observing System Simulation Experiment Using ASCENDS Observations and WRF-STILT Footprints

Knowledge of the spatiotemporal variations in emissions and uptake of CO2 is hampered by sparse measurements. The recent advent of satellite measurements of CO2 concentrations is increasing the density of measurements, and the future mission ASCENDS (Active Sensing of CO2 Emissions over Nights, Days and Seasons) will provide even greater coverage and precision. Lagrangian atmospheric transport models run backward in time can quantify surface influences ("footprints") of diverse measurement platforms and are particularly well suited for inverse estimation of regional surface CO2 fluxes at high resolution based on satellite observations. We utilize the STILT Lagrangian particle dispersion model, driven by WRF meteorological fields at 40-km resolution, in a Bayesian synthesis inversion approach to quantify the ability of ASCENDS column CO2 observations to constrain fluxes at high resolution. This study focuses on land-based biospheric fluxes, whose uncertainties are especially large, in a domain encompassing North America. We present results based on realistic input fields for 2007. Pseudo-observation random errors are estimated from backscatter and optical depth measured by the CALIPSO satellite. We estimate a priori flux uncertainties based on output from the CASA-GFED (v.3) biosphere model and make simple assumptions about spatial and temporal error correlations. WRF-STILT footprints are convolved with candidate vertical weighting functions for ASCENDS. We find that at a horizontal flux resolution of 1 degree x 1 degree, ASCENDS observations are potentially able to reduce average weekly flux uncertainties by 0-8% in July, and 0-0.5% in January (assuming an error of 0.5 ppm at the Railroad Valley reference site). Aggregated to coarser resolutions, e.g. 5 degrees x 5 degrees, the uncertainty reductions are larger and more similar to those estimated in previous satellite data observing system simulation experiments.

Wang, James S.↗

NASA NTRS2018

Observing System Simulation Experiments

A very brief overview of Observing System Simulation Experiments for numerical weather prediction, including the Nature Run, synthetic observations, and calibration/validation of the OSSE framework will be given.

Prive, Nikki↗

NASA NTRS2016

Observing System Simulation Experiments: An Overview

An overview of Observing System Simulation Experiments (OSSEs) will be given, with focus on calibration and validation of OSSE frameworks. Pitfalls and practice will be discussed, including observation error characteristics, incestuousness, and experimental design. The potential use of OSSEs for investigation of the behaviour of data assimilation systems will be explored, including some results from experiments using the NASAGMAO OSSE.

OSSE↗

NASA NTRS2016

Observing System Simulation Experiments: An Overview

OSSE↗

NASA NTRS2013

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗

NASA NTRS2019

Observing System Simulation Experiments and their Requirements

A brief overview of Observing System Simulation Experiments is given, including the methodology used at NASA/GMAO for generating simulated observations. Some technical and computing requirements for current and expected future generation and use of simulated observations are discussed.

Prive, Nikki↗

NASA NTRS2015

Observing System Simulation Experiments

This presentation gives an overview of Observing System Simulation Experiments (OSSEs). The components of an OSSE are described, along with discussion of the process for validating, calibrating, and performing experiments. a.

OSSE↗

NASA NTRS1984

Observing system simulation experiments related to space-borne Lidar wind profiling. Part 1: Forecast impacts of highly idealized observing systems

Simulation experiments comparing the relative importance of an idealized LIDAR wind profiling system with idealized temperature and pressure sounding systems on 12 h forecasts are studied for three "nature' fields representing the true evolving atmospheric states. The three fields are obtained respectively from: (1) a long integration of the GLAS 4th Order Model (4 deg lat x 5 deg lon x 9 levels), (2) a continuous sequence of NMC operational analysis and, (3) a long integration of the ECMWF high resolution (1.875 deg 1 lat x 1.875 deg lon x 15 layers) operational forecast model. These fields are interpolated to the grid of the GLAS model and used for simulating the observed global analysed fields of winds, temperature, moisture and surface pressure. The same interpolated fields are also used for verification of forecast impact. The effects of clouds, aerosol concentrations, and instrument accuracies on the simulated observation will be discussed.

Halem, M.↗

NASA NTRS1985

Results of an observing system simulation experiment based on the proposed Windsat instrument

Two fraternal twin experiments were conducted as part of this study. A data impact experiment using real data (runs 1 and 2) was conducted to assess the impact that rawin wind observations have on both a 5-day assimilation and a single 5-day forecast generated at the end of each assimilation. An observing system simulation experiment (OSSE) using simulated observations (runs 3, 4, and 5) was conducted in order to first calibrate the OSSE results and second to use this calibration to estimate the 'real world' impact from the contribution of global 3-dimensional wind profiles generated from a space-based lidar system known as Windsat. Each of the three runs in the seond experiment were also 5-day assimilation runs with a 5-day forecast initialized from the last 6-hour update cycle of the assimilation. The data impact study revealed a consistent positive impact when rawin winds were added back into an otherwise complete FGGE data set. Both the 6-hour and 5-day forecasts were improved at all levels, in both hemispheres, and for both the wind and the geopotential height fields. Similar results were obtained from the two parallel simulation runs, 3 and 4. Together with the results from runs 1 and 2, calibration coefficients were generated so as to 'correct' the results determined from the addition of Windsat winds (run 5). The Windsat simulation showed a positive improvement in all cases studied. Even though only the tropics were enhanced with these wind observations, hemispheric rms errors were decreased in both the assimilation and 5-day forecast. The 6-hour forecasts of zonal wind from the assimilation run were improved by as much as 50 pct. on the average, and the single forecast showed an average improvement of near 30 pct. Even though these calibrated values are considered too optimistic, the skill of the forecast generated from this run extended the useful forecast period by 18-24 hours.

Arnold, Charles P., Jr.↗