Search NASA⌕ Search

SEARCH · Search NASA

Results for “Observing System Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Robustness of Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to investigate the potential performance of proposed new instruments on numerical weather prediction (NWP). As OSSEs involve a framework in which the atmosphere and observations are all completely simulated, it is necessary to perform validation of the OSSE to ensure that it is sufficiently realistic to provide useful experimental results. A common issue that affects the forecast skill and observation impacts is the tendency of OSSEs to have insufficient model error compared to NWP in the real world. In this work, two versions of the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) NWP OSSE framework are compared, with the newer framework having more simulated forecast model error than the older framework due to changes to the NWP system. The performance of the updated OSSE is validated against corresponding behavior of the same NWP system in the real world in terms of the simulated observations, the analysis increments, forecast error, and observation impacts. OSSE results of analysis and forecast impacts for three proposed new observation systems are also compared between the older and newer frameworks to evaluate the robustness of the OSSE experiments and the role of model error in observation impacts. These three new instruments are the Geostationary eXtended Observations (GeoXO) hyperspectral infrared sounder (GXS), the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds) atmospheric motion vectors, and additional Global Navigation Satellite System Radio Occultations (GNSS-RO).

Observing System Simulation Experiments↗

Observing System Simulation Experiments

Observing System Simulation Experiments can be powerful tools for evaluating and exploring both the behavior of data assimilation systems and the potential impacts of future observing systems. With great power comes great responsibility - given a pure modeling framework, how can we be sure our results are meaningful? The challenges and pitfalls of OSSE calibration and validation will be addressed, as well as issues of incestuousness, selection of appropriate metrics, and experiment design. The use of idealized observational networks to investigate theoretical ideas in a fully complex modeling framework will also be discussed.

Prive, Nikki↗

Accuracy of diagnostic heat and moisture budgets using SESAME-79 field data as revealed by observing system simulation experiments

Observing system simulation experiments are used to investigate the accuracy of diagnostic heat and moisture budgets which employ the AVE-SESAME 1979 data. The time-including, four-dimensional data set of a mesoscale model is used to simulate rawinsonde observations from AVE-SESAME 1979. The 5 C/day (heat budget) and 2 g/kg per day (moisture budget) magnitudes of error obtained indicate difficulties in the diagnosis of the heating rate in weak convective systems. The influences exerted by observational frequency, objective analysis, observational density, vertical interpolation, and observational errors on the budget are also studied, and it is found that the temporal and spatial resolution of the SESAME regional network is marginal for diagnosing convective effects on a horizontal time scale of 550 x 550 km.

Kuo, Y.-H.↗

NWP Impact of Cloud Top and Boundary Layer Winds from a Satellite Borne Lidar: an Observing System Simulation Experiment

Observing systems simulation experiments (OSSE's) provide a powerful tool to assess the impact of proposed satellite borne observing systems on meteorological applications models. We describe the results of an OSSE conducted to assess the impact of data from a low power lidar wind sensor on the forecast accuracy of a global spectral numerical weather prediction (NWP) model, the Air Force Geophysics Laboratory Global Data Assimilation System. The instrument would be operating at near-infrared wavelengths thereby increasing the backscatter signal relative to comparable infrared lidar.

Isaacs, R. G.↗

Assimilating Remote Sensing Observations of Leaf Area Index and Soil Moisture for Wheat Yield Estimates: An Observing System Simulation Experiment

Observing system simulation experiments were used to investigate ensemble Bayesian state updating data assimilation of observations of leaf area index (LAI) and soil moisture (theta) for the purpose of improving single-season wheat yield estimates with the Decision Support System for Agrotechnology Transfer (DSSAT) CropSim-Ceres model. Assimilation was conducted in an energy-limited environment and a water-limited environment. Modeling uncertainty was prescribed to weather inputs, soil parameters and initial conditions, and cultivar parameters and through perturbations to model state transition equations. The ensemble Kalman filter and the sequential importance resampling filter were tested for the ability to attenuate effects of these types of uncertainty on yield estimates. LAI and theta observations were synthesized according to characteristics of existing remote sensing data, and effects of observation error were tested. Results indicate that the potential for assimilation to improve end-of-season yield estimates is low. Limitations are due to a lack of root zone soil moisture information, error in LAI observations, and a lack of correlation between leaf and grain growth.

Nearing, Grey S.↗

An Introduction to Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to estimate the potential impact of proposed new instruments and data on numerical weather prediction. OSSEs can also be used to help design new observing platforms and to investigate the behavior of data assimilation systems. A basic overview of how to design and perform an OSSE will be given, as well as best practices and pitfalls. Some examples using the OSSE framework developed at the NASA Global Modeling and Assimilation Office will be shown.

OSSE↗

Status of the NASA GMAO Observing System Simulation Experiment

An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.

OSSE↗

A Geostationary Instrument Simulator for Aerosol Observing System Simulation Experiments

In the near future, there will be several new instruments measuring atmospheric composition from geostationary orbit over North America, East Asia, and Europe. This constellation of satellites will provide high resolution, time resolved measurements of trace gases and aerosols for monitoring air quality and tracking pollution sources. This paper describes a detailed, fast, and accurate (less than 1.0% uncertainty) method for calculating synthetic top of the atmosphere (TOA) radiances from a global simulation with a mesoscale free running model, the GEOS-5 Nature Run, for remote sensing instruments in geostationary orbit that measure in the ultraviolet-visible spectral range (UV-Vis). Generating these synthetic observations is the first step of an Observing System Simulation Experiment (OSSE), a framework for evaluating the impact of a new observation or algorithm. This paper provides details of the model sampling, aerosol and cloud optical properties, surface reflectance modeling, Rayleigh scattering calculations, and a discussion of the uncertainties of the simulated TOA radiance. An application for the simulated TOA radiance observations is demonstrated in the manuscript. Simulated TEMPO (Tropospheric Emissions: Monitoring of Pollution) and GOES-R (Geostationary Operational Environmental Satellites) observations were used to show how observations from the two instruments could be combined to facilitate aerosol type discrimination. The results demonstrate the viability of a detailed instrument simulator for radiance measurements in the UV-Vis that is capable of accurately simulating high resolution, time-resolved measurements with reasonable computational efficiency.

Castellanos, Patricia↗

Adjoint Estimation of Observation Impact Explored with an Observing System Simulation Experiment

In an Observing System Simulation Experiment, the full, true state of the simulated atmosphere is known. This knowledge allows the direct calculation of analysis and forecast errors, and also may be used in conjunction with an adjoint tool to calculate metrics that are unachievable in the real world. For example, the errors that result from the use of the analysis state as verification when running adjoint calculations of observation impact on a forecast can be quantified. The adjoint itself can also be used to operate on the analysis state rather than on the forecast state. Results from these and other adjoint experiments using the NASA/GMAO OSSE framework will be presented.

Prive, Nikki↗

A Regional CO2 Observing System Simulation Experiment Using ASCENDS Observations and WRF-STILT Footprints

Knowledge of the spatiotemporal variations in emissions and uptake of CO2 is hampered by sparse measurements. The recent advent of satellite measurements of CO2 concentrations is increasing the density of measurements, and the future mission ASCENDS (Active Sensing of CO2 Emissions over Nights, Days and Seasons) will provide even greater coverage and precision. Lagrangian atmospheric transport models run backward in time can quantify surface influences ("footprints") of diverse measurement platforms and are particularly well suited for inverse estimation of regional surface CO2 fluxes at high resolution based on satellite observations. We utilize the STILT Lagrangian particle dispersion model, driven by WRF meteorological fields at 40-km resolution, in a Bayesian synthesis inversion approach to quantify the ability of ASCENDS column CO2 observations to constrain fluxes at high resolution. This study focuses on land-based biospheric fluxes, whose uncertainties are especially large, in a domain encompassing North America. We present results based on realistic input fields for 2007. Pseudo-observation random errors are estimated from backscatter and optical depth measured by the CALIPSO satellite. We estimate a priori flux uncertainties based on output from the CASA-GFED (v.3) biosphere model and make simple assumptions about spatial and temporal error correlations. WRF-STILT footprints are convolved with candidate vertical weighting functions for ASCENDS. We find that at a horizontal flux resolution of 1 degree x 1 degree, ASCENDS observations are potentially able to reduce average weekly flux uncertainties by 0-8% in July, and 0-0.5% in January (assuming an error of 0.5 ppm at the Railroad Valley reference site). Aggregated to coarser resolutions, e.g. 5 degrees x 5 degrees, the uncertainty reductions are larger and more similar to those estimated in previous satellite data observing system simulation experiments.

Wang, James S.↗

Simulating thin cirrus clouds in Observing System Simulation Experiments (OSSE) for LAWS

It was previously shown (Wood and Emmitt, 1990, 1991) that, by omitting the contribution of thin cirrus by the Observing System Simulation Experiments, will result in severe misrepresentation of both the frequency and the accuracy of wind observations in the upper troposphere. This paper estimates the presence of optically thin (tau less than 1.0) cirrus clouds by using model soundings in a cirrus cloud model. An example is presented showing the location of cirrus cloud profiles over North America for November 10, 1979, which were generated by the LAWS Simulation Model.

Emmitt, G. D.↗

Observing System Simulation Experiments for Fun and Profit

Observing System Simulation Experiments can be powerful tools for evaluating and exploring both the behavior of data assimilation systems and the potential impacts of future observing systems. With great power comes great responsibility - given a pure modeling framework, how can we be sure our results are meaningful? The challenges and pitfalls of OSSE calibration and validation will be addressed, as well as issues of incestuousness, selection of appropriate metrics, and experiment design. The use of idealized observational networks to investigate theoretical ideas in a fully complex modeling framework will also be discussed

Observational Networks↗

Observing system simulation experiments related to space-borne Lidar wind profiling. Part 1: Forecast impacts of highly idealized observing systems

Simulation experiments comparing the relative importance of an idealized LIDAR wind profiling system with idealized temperature and pressure sounding systems on 12 h forecasts are studied for three "nature' fields representing the true evolving atmospheric states. The three fields are obtained respectively from: (1) a long integration of the GLAS 4th Order Model (4 deg lat x 5 deg lon x 9 levels), (2) a continuous sequence of NMC operational analysis and, (3) a long integration of the ECMWF high resolution (1.875 deg 1 lat x 1.875 deg lon x 15 layers) operational forecast model. These fields are interpolated to the grid of the GLAS model and used for simulating the observed global analysed fields of winds, temperature, moisture and surface pressure. The same interpolated fields are also used for verification of forecast impact. The effects of clouds, aerosol concentrations, and instrument accuracies on the simulated observation will be discussed.

Halem, M.↗

Observing System Simulation Experiments

A very brief overview of Observing System Simulation Experiments for numerical weather prediction, including the Nature Run, synthetic observations, and calibration/validation of the OSSE framework will be given.

Prive, Nikki↗

Observing System Simulation Experiments: An Overview

An overview of Observing System Simulation Experiments (OSSEs) will be given, with focus on calibration and validation of OSSE frameworks. Pitfalls and practice will be discussed, including observation error characteristics, incestuousness, and experimental design. The potential use of OSSEs for investigation of the behaviour of data assimilation systems will be explored, including some results from experiments using the NASAGMAO OSSE.

OSSE↗

Observing System Simulation Experiments: An Overview

An overview of Observing System Simulation Experiments (OSSEs) will be given, with focus on calibration and validation of OSSE frameworks. Pitfalls and practice will be discussed, including observation error characteristics, incestuousness, and experimental design. The potential use of OSSEs for investigation of the behaviour of data assimilation systems will be explored, including some results from experiments using the NASAGMAO OSSE.

OSSE↗

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗