SEARCH · Search NASA

Results for “O-F residuals”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

12 records

All sources NASA NTRS DOE OSTI

NASA NTRS2003

Monitoring and Assimilation of MIPAS and SCIAMACHY Ozone Data

Preliminary results are presented from experiments that integrate ozone observations from two ENVISAT-borne instruments with the ozone data assimilation system developed at NASA's Data Assimilation Office (DAO). The data used are ozone total column provided by the Scanning Imaging Absorption Spectrometer for Atmospheric Chartography (SCIAMACHY) and stratospheric profiles from the Michelson Interferometer for Passive Atmospheric Sounding (MIPAS) instrument. The DAO's existing system sequentially assimilates the Solar Backscatter Ultraviolet/2 total and partial ozone column data. Incorporation of SCIAMACHY and MIPAS data is done in two stages. First, the observations are monitored. The monitoring consists of computing the differences between Envisat observations and the ozone system forecast, i.e. observed-minus-forecast (O-F) residuals. The O-F residuals are then analyzed using simple statistical methods to examine the spatial distribution of differences, which are large for SCIAMACHY near the terminator. In the second stage, the MIPAS data will be actively assimilated along with the SBW/2 observations; any preliminary results of note will be discussed.

Wargan, K.↗

NASA NTRSDate not supplied

Examination of L-Band Brightness Temperature Forecasts in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission [4] has been providing L-band (1.4 GHz) passive microwave brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model [5] using a spatially distributed ensemble Kalman filter, the NASA Global Modeling and Assimilation Office generates the SMAP Level-4 Soil Moisture (L4_SM) product, which provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications [6]. The L4_SM product also includes estimates of soil temperature, land surface fluxes, and assimilation diagnostics such as the model forecast and observed Tb values [7]. The output from the L4_SM system is routinely monitored by the L4_SM team. Such monitoring provides valuable information; instances of unusually large Tb observation-minus-forecast (O-F) residuals can indicate events during which soil moisture conditions are poorly described in the land modeling system [7,8]. For example, repeated occurrences of very large Tb O-F values in central Australia were traced back to deficiencies in the gauge-based precipitation product used in the land modeling system through L4_SM Version 5; this discovery prompted the use, beginning in Version 6, of satellite- and gauge-based precipitation observations outside of North America [9]. Recently, a statistical analysis of the Tb O-F residuals revealed systematic errors in the “tau-omega” L-band radiative transfer model that converts the land-model simulated soil moisture and temperature into the forecast Tb prior to the L4_SM analysis. The L4_SM analysis is built on the ensemble Kalman filter and assumes unbiased forecast errors. The presence of systematic Tb forecast errors could thus adversely impact the quality of the analyzed soil moisture. In this paper, we examine the Tb O-F residuals of the latest Version 7 L4_SM data (Science Version ID Vv7030 and Vv7032) [10,11,12]. In the L4_SM Version 7 algorithm, key parameters of the L-band radiative transfer model, including soil roughness, scattering albedo, and a (seasonally varying) climatology of vegetation opacity, are obtained from the SMAP Level-2 Radiometer retrieval product (Version 5) [1]. Additionally, we also use ground measurements of surface soil moisture and soil temperature from the SMAP core validation sites as in situ reference of soil conditions [2,3]. As part of the L4_SM system calibration, the seasonally-varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations [7]. That is, the L4_SM system is designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (potentially erroneous) climatology. The Tb O-F residuals examined here are thus computed using SMAP Tb observations after they are rescaled to the mean seasonal cycle of Tb from the modeling system without SMAP data assimilation. Consequently, the long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. Despite the small time-average values of the Tb O-F residuals, the model forecast Tb was nevertheless found to exhibit undesirable systematic errors. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to further improve the L4_SM algorithm.

Rolf Reichle↗

NASA NTRS2016

Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the “Version 2” validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities.

SMAP L4_SM↗

NASA NTRS2006

Detection of Ice Polar Stratospheric Clouds from Assimilation of Atmospheric Infrared Sounder Data

A novel technique is presented for detection of ice polar stratospheric clouds (PSCs) that form at extremely low temperatures in the lower polar stratosphere during winter. Temperature is a major factor in determining abundance of PSCs, which in turn provide surfaces for heterogeneous chemical reactions leading to ozone loss and radiative cooling. The technique infers the presence of ice PSCs using radiances from the Atmospheric Infrared Sounder (AIRS) in the Goddard Earth Observing System version 5 (GEOS-5) data assimilation system. Brightness temperatures are computed from short-term GEOS-5 forecasts for several hundred AIRS channels, using a radiation transfer module. The differences between collocated AIRS observations and these computed values are the observed-minus-forecast (O-F) residuals in the assimilation system. Because the radiation model assumes clear-sky conditions, we hypothesize that these O-F residuals contain quantitative information about PSCs. This is confirmed using sparse data from the Polar Ozone and Aerosol Measurement (POAM) III occultation instrument. The analysis focuses on 0-F residuals for the 6.79pm AIRS moisture channel. At coincident locations, when POAM III detects ice clouds, the AIRS O-F residuals for this channel are lower than -2K. When no ice PSCs are evident in POAM III data, the AIRS 0-F residuals are larger. Given this relationship, the high spatial density of AIRS data is used to construct maps of regions where 0-F residuals are lower than -2K, as a proxy for ice PSCs. The spatial scales and spatio-temporal variations of these PSCs in the Antarctic and Arctic are discussed on the basis of these maps.

Stajner, Ivanka↗

NASA NTRSDate not supplied

Systematic Errors in Simulated L-Band Brightness Temperature in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission has been providing L-band (1.4 GHz) brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF), the SMAP Level-4 Soil Moisture (L4_SM) product provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications. The EnKF-based L4_SM analysis assumes unbiased forecast errors. Consequently, the seasonally varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations. The L4_SM system is thus designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (possibly wrong) climatology. In this paper, we examine the Tb observation-minus-forecast (O-F) residuals from the L4_SM Version 7 product (computed after rescaling the Tb observations to the mean seasonal cycle of the simulated Tb). The long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. The model forecast Tb, however, still exhibits undesirable systematic errors relative to the (rescaled) Tb observations. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to improve the L4_SM algorithm.

Rolf Reichle↗

NASA NTRS2002

Monitoring of Observation Errors from Satellite Ozone Instruments in Assimilation

Ozone distributions derived from the Solar Backscatter UltraViolet/2 (SBUV/2) instruments and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) have been assimilated in near-real time at the NASA/Goddard Data Assimilation Office since January 2000. Observed-minus-forecast (O-F) residuals are the differences between the incoming ozone data and the co-located short-term model forecast. They are routinely produced and monitored in the assimilation process. Using examples from the NOAA-14 and NOAA-16 SBUV/2 and the EP-TOMS instruments, it is demonstrated that the monitoring of time series of O-F residual statistics is an effective method of identifying time-dependent changes in the observation-error characteristics of ozone. In addition, the data assimilation system was used to assist the validation of updated calibration coefficients for the NOAA-14 SBUV/2 instrument. This assimilation-based monitoring work will be extended to ozone data from instruments on new satellites: Envisat EOS, Aqua, and EOS Aura.

Stajner, Ivanka↗

NASA NTRS2001

Monitoring of MLS Measurements for Ozone Data Assimilation

The ozone data assimilation system at the NASA Goddard Space Flight Center Data Assimilation Office (DAO) has operationally provided near real time global three dimensional analyzed ozone fields since December 1999. Presently, 4 system assimilates both total column ozone and profile measurements from the NOAA - 16 SBUV/2 instrument into an off-line transport model using a physical space statistical analysis scheme (PS AS). Recently, this system was modified to investigate a possible impact from including MLS profile observations. Over a period from December 13, 1991 to March 1, 1992 the system assimilated both NOAA 11 SBUV/2 profile measurements and TOMS total column measurements. Short term ozone forecasts were produced and compared to MLS observations. The resulting observed -minus -forecast (O-F) residuals were studied regionally (by both latitude bands and pressure levels) in order to explore the potential impact of MLS observations on the assimilation and sensitivity to the UARS yaw maneuver and other instrument and algorithm characteristics. In addition, MLS profiles were compared to nearest neighbor SBUV and analysis profiles. In the tropics, analyzed ozone values tend to be too high from 1-3 hPa and too low from 10-20 hPa. MLS measurements in these regions tend be lower and higher (respectively) than forecast ozone values. This indicates that assimilating MLS measurements may improve, analysis results in these areas. Further, nearest neighbor profile comparisons in the southern high latitudes indicate that laminar features present in the analysis but not present in SBUV measurements, are also present in MLS measurements. This, together with the availability of MLS measurements in polar night regions indicates that assimilating MLS measurements in polar night regions indicates that assimilating MLS measurements may improve analyzed ozone values in high latitudes.

Winslow, Nathan↗

NASA NTRS2005

A Posteriori Correction of Forecast and Observation Error Variances

Proposed method of total observation and forecast error variance correction is based on the assumption about normal distribution of "observed-minus-forecast" residuals (O-F), where O is an observed value and F is usually a short-term model forecast. This assumption can be accepted for several types of observations (except humidity) which are not grossly in error. Degree of nearness to normal distribution can be estimated by the symmetry or skewness (luck of symmetry) a(sub 3) = mu(sub 3)/sigma(sup 3) and kurtosis a(sub 4) = mu(sub 4)/sigma(sup 4) - 3 Here mu(sub i) = i-order moment, sigma is a standard deviation. It is well known that for normal distribution a(sub 3) = a(sub 4) = 0.

Rukhovets, Leonid↗

NASA NTRS2015

Technical Report Series on Global Modeling and Data Assimilation: Soil Moisture Active Passive (SMAP) Project Assessment Report for the Beta-Release L4_SM Data Product - Volume 40

ubRMSE↗

NASA NTRS2018

Global Assessment of the SMAP Level-4 Soil Moisture Product Using Assimilation Diagnostics

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx. 2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

Reichle, Rolf↗

NASA NTRS2018

Using Data Assimilation Diagnostics to Assess the SMAP Level-4 Soil Moisture Product

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with approx.2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of approx. 0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under approx. 3 K), the soil moisture increments (under approx. 0.01 cu m/cu m), and the surface soil temperature increments (under approx. 1 K). Typical instantaneous values are approx. 6 K for O-F residuals, approx. 0.01 (approx. 0.003) cu m/cu m for surface (root-zone) soil moisture increments, and approx. 0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing.

SMAP↗

NASA NTRS2018

Soil Moisture Active Passive (SMAP) Project Assessment Report for Version 4 of the L4_SM Data Product

This report provides an assessment of Version 4 of the SMAP Level 4 Surface and Root Zone Soil Moisture (L4_SM) product, released on 14 June 2018. The assessment includes comparisons of L4_SM soil moisture and temperature estimates with in situ measurements from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product, including observation-minus-forecast (O-F) brightness temperature residuals and soil moisture analysis increments.Together, the core validation site comparisons and the statistics of the assimilation diagnostics areconsidered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid-cell scale of the data product.The Version 4 L4_SM product benefits from an improved land surface modeling system and from retrospective surface meteorological forcing data that are as consistent as possible with the present-day datain terms of their climatology. Specifically, the model changes include revised parameters and parameterizations for (i) the surface energy balance, (ii) recharge from below of the model's surface excess reservoir, and (iii) the snow depletion curve. Updated ancillary inputs include improved datasets for landcover, topography, and vegetation height. The Version 4 algorithm further includes a revised approach to precipitation corrections that improves the precipitation climatology in Africa and the high-latitudes. Moreover, for system calibration the model is forced retrospectively with MERRA-2 reanalysis data, which are more consistent with the near-real time GEOS forward processing (FP) data used during the SMAP period than the retrospective GEOS data that were available for previous L4_SM versions. An analysis of the time-average surface and root zone soil moisture shows that the global pattern ofarid and humid regions is captured by the Version 4 L4_SM estimates. Owing to the changes in the landsurface modeling system, surface soil moisture is typically drier by several volumetric percent in Version 4 compared to Version 3, whereas root zone soil moisture is wetter in Version 4 in some regions and drierin others. Because of these climatological differences, the Version 3 and Version 4 products should not be combined into a single dataset for use in applications.Results from the core validation site comparisons indicate that Version 4 of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the RMSE after removal of the long-term mean difference (ubRMSE). The overall ubRMSE of the 3-hourly L4_SM dataat the 9 km scale is 0.039 m3 m-3 for surface soil moisture and 0.029 m3 m-3 for root zone soil moisture,below the 0.04 m3 m-3 requirement. The L4_SM estimates are an improvement over estimates from a model-only Nature Run version 7.2 (NRv7.2), which demonstrates the beneficial impact of the SMAP brightness temperature data. Overall, L4_SM surface and root zone soil moisture estimates are more skillful than NRv7.2 estimates, with statistically significant improvements at the 5% level for surface soil moisture R and anomaly R values. Results from comparisons of the L4_SM product to i

Reichle, Rolf H.↗