Search NASA⌕ Search

SEARCH · Search NASA

Results for “Error Covariance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Insight and Evidence Motivating the Simplification of Dual-Analysis Hybrid Systems into Single-Analysis Hybrid Systems

Many hybrid data assimilation systems currently used for NWP employ some form of dual-analysis system approach. Typically a hybrid variational analysis is responsible for creating initial conditions for high-resolution forecasts, and an ensemble analysis system is responsible for creating sample perturbations used to form the flow-dependent part of the background error covariance required in the hybrid analysis component. In many of these, the two analysis components employ different methodologies, e.g., variational and ensemble Kalman filter. In such cases, it is not uncommon to have observations treated rather differently between the two analyses components; recentering of the ensemble analysis around the hybrid analysis is used to compensated for such differences. Furthermore, in many cases, the hybrid variational high-resolution system implements some type of four-dimensional approach, whereas the underlying ensemble system relies on a three-dimensional approach, which again introduces discrepancies in the overall system. Connected to these is the expectation that one can reliably estimate observation impact on forecasts issued from hybrid analyses by using an ensemble approach based on the underlying ensemble strategy of dual-analysis systems. Just the realization that the ensemble analysis makes substantially different use of observations as compared to their hybrid counterpart should serve as enough evidence of the implausibility of such expectation. This presentation assembles numerous anecdotal evidence to illustrate the fact that hybrid dual-analysis systems must, at the very minimum, strive for consistent use of the observations in both analysis sub-components. Simpler than that, this work suggests that hybrid systems can reliably be constructed without the need to employ a dual-analysis approach. In practice, the idea of relying on a single analysis system is appealing from a cost-maintenance perspective. More generally, single-analysis systems avoid contradictions such as having to choose one sub-component to generate performance diagnostics to another, possibly not fully consistent, component.

Todling, Ricardo↗
NASA NTRS2019

Toward Improving Short-Term Predictions of Fine Particulate Matter Over the United States Via Assimilation of Satellite Aerosol Optical Depth Retrievals

This study develops a new approach to improve simulations of the particulate matter of aerodynamic diameter smaller than 2.5μm (PM2.5) in the Community Multiscale Air Quality (CMAQ) model via assimilation of Moderate Resolution Imaging Spectroradiometer (MODIS) aerosol optical depth(AOD) retrievals using the Grid point Statistical Interpolation (GSI) system. In contrast to previous studies that only consider errors due to transport, our computation of the background error covariance matrix incorporates uncertainties in anthropogenic emissions. To understand the impact of this approach, three experiments (one background and two assimilations) are performed over the contiguous United States(CONUS) from 15 July to 14 August 2014. The background CMAQ experiment significantly underestimates both the MODIS AOD and surface PM2.5levels. MODIS AOD assimilation pushes both the CMAQ AOD and surface PM2.5distributions toward the observed distributions, but CMAQ still underestimates the observations. Averaged over CONUS, the two assimilation experiments with and without including the anthropogenic emission uncertainties improve the correlation coefficient between the model and independent observations of PM2.5 by ~67% and ~48%, respectively, and reduces the mean bias by ~38% and~10%, respectively. The assimilation improves the model performance everywhere over CONUS, except the New York and Wisconsin, where CMAQ overestimates the observed PM2.5during nighttime after assimilation likely because of overcorrection of aerosol mass concentrations by the AOD assimilation. Future work should incorporate uncertainties in other processes (biomass burning and biogenic emissions, deposition, chemistry, transport, and boundary conditions) to further enhance the value of assimilating spaceborne AOD retrievals.

Assimilation↗
NASA NTRS2022

Observation Impact and Information Retention in the Lower Troposphere of the GMAO GEOS Data Assimilation System

In this study, we have assessed the effectiveness of the use of existing observing systems in the lower troposphere in the GEOS hybrid–4DEnVar data assimilation system through a set of observing system experiments. The results show that microwave radiances have a large impact in the Southern Hemisphere and Tropical ocean, but the large influence is mostly observed above 925 hPa and dissipates relatively quickly with longer forecast lead times. Conventional data information holds better in the forecast ranging from the surface to 100 hPa, depending on the field evaluated, in the Northern Hemisphere and lowest model levels in the Tropics. Infrared radiances collectively have much less impact in the lower troposphere. Removing surface observations has small but persistent impact on specific humidity in the upper atmosphere, but small or negligible impact on planetary boundary layer (PBL) height and temperature. The model responses to the incremental analysis update (IAU) forcing are also analyzed. In the IAU assimilation window, the physics responds strongly to the IAU forcing in the lower troposphere, and the changes of physics tendency in the lower troposphere and hydrodynamics tendency in the mid- and upper troposphere are viewed as beneficial to the reduction of state error covariance. In the subsequent forecast, the model tendencies continue to deviate further from the original free forecast with forecast lead times around 300–400 hPa, but physics tendency has showed signs of returning to its original free forecast mechanisms at 1-day forecast in the lower troposphere.

GEOS↗
NASA NTRS2012

A review of reduced Kalman filters for clock ensembles

This paper reviews the author’s previous work on free-running timescales based on Kalman filters that act upon clock comparisons. The natural Kalman clock ensemble algorithm tends to optimize long-term timescale stability at the expense of short-term stability. By subjecting each postmeasurement error covariance matrix to a non-transparent reduction operation, one obtains corrected clocks with improved short-term stability and little sacrifice of long-term stability. A new result on covariance matrix reduction is also stated.

Greenhall, Charles A.↗
NASA NTRS2021

Satellite Constraints on the Latitudinal Distribution and Temperature Sensitivity of Wetland Methane Emissions

Wetland methane (CH4) emissions comprise about one-third of the global CH4 source. The latitudinal distribution and climate sensitivity of wetland CH4 fluxes are the key determinants of the global CH4-climate feedback. However, large differences exist between bottom-up estimates, informed by ground-based flux measurements, and top-down estimates derived from spaceborne total column CH4. Despite the extensive coverage of satellite CH4 concentration observations, challenges remain with using top-down estimates to test bottom-up models, mainly because of the uncertainties in the satellite retrievals, the model representation errors, the variable prior emissions, and the confounding role of the posterior error covariance structures. Here, we use satellite-based top-down CH4 flux estimates (2010–2012) to test and refine 42 bottom-up estimates of wetland emissions that use a range of hypothesized wetland extents and process controls. Our comparison between bottom-up models and satellite-based fluxes innovatively accounts for cross-correlations and spatial uncertainties typically found in top-down inverse estimates, such that only the information from satellite observations and the atmospheric transport model is kept as a constraint. We present a satellite-constrained wetland CH4 ensemble product derived from assembling the highest-performance bottom-up models, which estimates global wetland CH4 emissions of 148 (117–189, 5th–95th percentile) Tg CH4 yr−1. We find that tropical wetland emissions contribute 72% (63%–85%) to the global wetland total. We also find that a lower-than-expected temperature sensitivity agrees better with atmospheric CH4 measurements. Overall, our approach demonstrates the potential for using satellites to quantitatively refine bottom-up wetland CH4 emission estimates, their latitudinal distributions, and their sensitivity to climate.

wetland ch4↗
NASA NTRSDate not supplied

Status and Progress of Observation Usages in the GMAO GEOS Atmospheric Data Assimilation System

The Global Modeling and Assimilation Office (GMAO) continuously works to enhance the use of observations in the Goddard Earth Observing System – Forward Processing (GEOS-FP) model and analysis system. Updates to GEOS-FP in March 2022 and February 2023 focused on the analysis component, adding new capabilities to ingest radiances and other new observing systems, such as SPIRE GNSS-RO data. Concurrent activities enhance aspects of the radiance assimilation, such as the use of hyperspectral radiances in the stratosphere and lower troposphere, the introduction of microwave radiances over land, and a revised treatment of GMI observations. Furthermore, GMAO has been contributing to the Joint Effort for Data assimilation Integration (JEDI), including development and testing of various components of the observing system and GEOS-specific background error covariances that will allow migration of GEOS-FP from a GSI- to a JEDI-based analysis system. A number of examples are shown.

Y Zhu↗
NASA NTRSDate not supplied

Understanding and Utilizing PBL Height Data from Multiple Observing Systems in the GEOS System

The accuracy of PBL height simulation is a key issue in many applications including forecasting near surface meteorology and air quality, however, it is a very challenging problem due to the lack of not only comprehensive, global Planetary Boundary Layer (PBL) observations but also a strategy and infrastructure to utilize PBL height data from a variety of sensors. Following the designation of PBL as an incubation class observable in the 2017 Decadal Survey, the PBL Incubation Study Team Report [14] made clear that “a future global PBL observing system requires modeling and data assimilation as essential components.” There is an urgent need for global modeling development in order to utilize Program of Record (POR) observations, assess their impacts, and identify gaps to be filled by future PBL missions. Our overall objective is to develop PBL data assimilation capabilities in the NASA Global Earth Observing System (GEOS), focusing on PBL height from multiple observing systems, to support the assessment and use of future PBL observations. The NASA GEOS system is composed of the GEOS global atmospheric general circulation model (AGCM) and the atmospheric data assimilation system (ADAS). The PBL parameterizations include the “Lock” K-profile scheme driven by surface and cloud-top buoyancy fluxes ([4]), and the “Louis” local scheme for stable conditions based on the Richardson number ([5]). Above the mixed layer defined by the Lock surface plume, shallow cumulus convection is represented by the mass flux scheme of [9]. Additional parameterizations are summarized in [1]. The ADAS employs the hybrid 4D Ensemble- Variational (EnVar) configuration ([15]), with the ensemble providing flow-dependent background error covariance information. The resultant analysis increments are fed back to the forecast model through the 4D incremental analysis update (IAU) approach ([11]). In this study, PBL height data are being or have been generated from radiosondes, GNSS RO, satellite (CATS, CALIPSO and ICESat-2) and ground-based (MPLNET) lidars, and wind profiler. Investigations have been conducted to specify quality marks for PBL height retrievals for the data assimilation purpose. These PBL height data have different strengths and weaknesses ([2], [3], [6], [7], [8], [10]), and the satellite PBL height data provide better global coverage and complement in-situ PBL height data. Radiosondes offer high accuracy and in situ measurement of temperature and humidity profiles, but with poor spatio-temporal sampling. The in-situ observing systems like MPLNET and wind profiler provide long history of PBL height records at each station. The GNSS RO based PBL height is retrieved based on the sharp gradients in refractivity profile that represent the fine vertical structure of temperature and moisture changes above the PBL. However, not all RO refractivity profiles reach the surface depending on location and regime, and RO refractivity retrievals can be negatively biased below 2km. The PBL height data from satellite lidars provide high resolution along track PBL height retrievals, but over land they are affected by previous day convective PBL aerosol and strongly associated with mixing layer and retrievals cannot be made below thick, attenuating clouds. A successful assimilation of PBL height data requires a thorough understanding of the observing method and the retrieval algorithm for each observing system in order to use the PBL height data from multiple observing systems properly. Due to the sensitivity of PBL height data to the observing method and choice of algorithm, it is important to use a model definition appropriate for each observation type to compute differences between PBL height data and model PBL height (OmFs). The GEOS model currently includes two PBL height definitions suitable for direct comparison with observed PBL height, and additional definitions are being added in this study. Evaluation of different model PBL height definitions is underway. Meanwhile, efforts have been made in the GEOS data assimilation system to develop PBL height data assimilation capability. PBL height data can be assimilated using two different approaches. The traditional approach is to construct an observation operator and its tangent linear and adjoint, which link control variables to PBL height data from each observing system. This observation operator can be very complicated, e.g., the lidar-based PBL height observation operator includes the backscatter lidar forward observation operator, the algorithm to derive PBL height from attenuated total backscatter, interpolation, and calculations handling the mismatch between observed and model scales. The other approach is to augment PBL height to the control variable vector, and it is adopted in this study. The latter approach was also used in previous studies, e.g., the assimilation of PBL height data from radiosonde and aircraft in the Real Time Mesoscale Analysis (RTMA) system for a dispersion modelling study ([13]); the PBL height assimilation study using lidar PBL height data at Greensburg, Kansas for a field campaign ([12]). The PBL height assimilation from multiple observing systems in this study allows us to take advantage of the diverse PBL height data that provide much better global coverage collectively under different meteorological conditions and with different temporal and spatial scales. As all the PBL heights are tightly coupled with the PBL thermodynamic variables, the strong correlations, which are provided by the 4D ensemble forecast, enable PBL height data from various sources to interact and combine coherently and provide additional information for PBL temperature and moisture fields. The results of comparisons among PBL height data from different sources and the evaluation of the model PBL height definitions with the PBL height data will be presented, and the PBL height data synergy strategies and preliminary results will also be discussed at the conference.

Y. Zhu↗
NASA NTRSDate not supplied

Improving Boundary Layer Data Assimilation in the NASA GEOS System

The Goddard Earth Observing System (GEOS) developed by the NASA Global Modeling and Assimilation Office assimilates a wide range of observations to support various NASA Earth Science missions. As Measurement of planetary boundary layer (PBL) was designated as an incubation program by the 2018 Decadal Survey, we have aimed to improve PBL thermodynamic structure using data from multiple observing systems. In particular, we have developed strategies and infrastructure to assimilate PBL height (PBLH) data derived from radiosondes, GNSS radio occultation, space-based lidar (CALIPSO, CATS, IceSat-2), ground-based lidar (MPLNET) and radar wind profilers to produce global PBL height analyses. We have also explored methods to better represent capping inversions by using PBLH data together with other observations in the GEOS to adjust background error covariance and enhance model PBL parameterization performance.

Y. Zhu↗
NASA NTRSDate not supplied

Towards an Optimal Estimation Retrieval of Cirrus Cloud Optical and Microphysical Properties Using Hyperspectral Shortwave Instruments and A Fast Radiative Transfer Algorithm

Cirrus cloud retrieval products (here, cloud optical depth, effective particle size, and cloud top height) are important inputs into numerical weather and climate models. Uncertainties in such retrieval products, as a matter of course, propagate downstream, impacting model calculations. Improvements in high-quality global cirrus cloud optical and microphysical data products from satellite observations are needed to understand and reduce retrieval uncertainties. Hyperspectral shortwave instruments produce high-resolution and information-dense spectra, thus offering the opportunity to reduce uncertainties in retrieval products. We are in the process of developing a retrieval that uses the very fast Principal Component Radiative Transfer Model in the solar spectral region (PCRTM-Solar) in the forward model calculations. This retrieval will use measured reflectances from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) and the forthcoming Climate Absolute Radiance and Refractivity Observatory Pathfinder (CLARREO-Pathfinder) instruments. In this manuscript we present progress towards a reference retrieval employing a widely used, verified, accurate, yet computationally slower radiative transfer modeling technique. The reference retrieval, while too slow for using the complete hyperspectral measurement, will allow us to study the behavior of retrieval products and help us verify results from our in-development fast retrieval. Both retrievals will use the optimal estimation retrieval framework. In this manuscript we present results from an uncertainty analysis considering three uncertainty sources for a cirrus cloud retrieval in the form of error covariance matrices: reflectance uncertainty due to water vapor, the reflectance uncertainty due to ice crystal scattering assumptions, and the instrument measurement uncertainty. Results show that the uncertainty due to habit selection is the largest, while that due to water vapor is at most 0.6% relative to channel reflectance. As a first step, the retrieval is being designed for single layer ice clouds over open ocean water.

Cirrus cloud↗
NASA NTRSDate not supplied

Improving Boundary Layer Data Assimilation Using Observation Data from Multiple Observing Systems in the NASA GEOS System

The Planetary Boundary Layer (PBL) is a complex interface that mediates energy and moisture exchanges between the Earth’s surface and atmosphere. Accurate simulation and observation of PBL characteristics, such as PBL height and thermodynamic structure, have proven to be a challenge. In our latest efforts, we have focused on improving PBL thermodynamic structure using data from multiple observing systems in the Goddard Earth Observing System (GEOS), developed by the NASA Global Modeling and Assimilation Office (GMAO). We present strategies and results from assimilating PBL height data derived from radiosondes, GNSS radio occultation, space-based lidar (CALIPSO, CATS, IceSat-2), ground-based lidar (MPLNET), and radar wind profilers, including a novel global PBL height analysis dataset. We also discuss the impacts of better representing capping inversions by using PBL height data together with other observations in GEOS through adjustments to the background error covariance. Long-term statistics of the impact of assimilating and utilizing PBL height data in GEOS are presented. In addition, we explore an innovative approach to assimilate GNSS-RO refractivity data in the lower troposphere.

Eun-Gyeong Yang↗
NASA NTRS1978

Filtering and error analysis via the UDU super T covariance factorization

Kalman filter algorithms based on the UDU super T covariance factorization are discussed, with special attention given to algorithm implementation efficiency. A U-D-factored covariance error-analysis algorithm is formulated, and its efficiency and numerical stability are demonstrated in a representative orbit determination problem. The numerical results are compared with those obtained using covariance error-analysis formulas, and the comparison highlights the numerical superiority of the present algorithm. A byproduct of the U-D analysis is a highly efficient algorithm mechanization of the arbitrary gain covariance update formula.

Thornton, C. L.↗
NASA NTRS2000

Adjoints and Low-rank Covariance Representation

Quantitative measures of the uncertainty of Earth System estimates can be as important as the estimates themselves. Second moments of estimation errors are described by the covariance matrix, whose direct calculation is impractical when the number of degrees of freedom of the system state is large. Ensemble and reduced-state approaches to prediction and data assimilation replace full estimation error covariance matrices by low-rank approximations. The appropriateness of such approximations depends on the spectrum of the full error covariance matrix, whose calculation is also often impractical. Here we examine the situation where the error covariance is a linear transformation of a forcing error covariance. We use operator norms and adjoints to relate the appropriateness of low-rank representations to the conditioning of this transformation. The analysis is used to investigate low-rank representations of the steady-state response to random forcing of an idealized discrete-time dynamical system.

Tippett, Michael K.↗
NASA NTRS1987

Errors in plate rotations as described by covariance matrices and their combination in reconstructions

The use of covariance matrices to describe the errors in plate rotations and to combine the contributions of individual plate pairs for plate reconstructions is discussed. Particular attention is given to finite rotations and the combination of covariance matrices for a circuit of successive plate pair rotations. Examples of errors in plate reconstructions in which the position of the Pacific plate relative to North America is reconstructed are presented.

Jurdy, Donna M.↗
NASA NTRS1989

Analysis of Modified SMI Method for Adaptive Array Weight Control

An adaptive array is used to receive a desired signal in the presence of weak interference signals which need to be suppressed. A modified sample matrix inversion (SMI) algorithm controls the array weights. The modification leads to increased interference suppression by subtracting a fraction of the noise power from the diagonal elements of the covariance matrix. The modified algorithm maximizes an intuitive power ratio criterion. The expected values and variances of the array weights, output powers, and power ratios as functions of the fraction and the number of snapshots are found and compared to computer simulation and real experimental array performance. Reduced-rank covariance approximations and errors in the estimated covariance are also described.

Dilsavor, Ronald Louis↗
NASA NTRS1986

System identification for modeling for control of flexible structures

The major components of a design and operational flight strategy for flexible structure control systems are presented. In this strategy an initial distributed parameter control design is developed and implemented from available ground test data and on-orbit identification using sophisticated modeling and synthesis techniques. The reliability of this high performance controller is directly linked to the accuracy of the parameters on which the design is based. Because uncertainties inevitably grow without system monitoring, maintaining the control system requires an active on-line system identification function to supply parameter updates and covariance information. Control laws can then be modified to improve performance when the error envelopes are decreased. In terms of system safety and stability the covariance information is of equal importance as the parameter values themselves. If the on-line system ID function detects an increase in parameter error covariances, then corresponding adjustments must be made in the control laws to increase robustness. If the error covariances exceed some threshold, an autonomous calibration sequence could be initiated to restore the error enveloped to an acceptable level.

Mettler, Edward↗
NASA NTRS2019

Three CA-Related Covariance Issues and Their Solutions

This presentation addresses three issues that arise in the use of DoD-produced satellite state estimate covariances in the conjunction assessment process: the realism of the provided covariances, how to address correlated error between two satellites' covariance matrices, and how to proceed when a furnished covariance is non-positive-definite. To address the first, DoD has implemented a set of two "consider parameters" with which to alter/expand the covariance to account for atmospheric density forecast error and satellite frontal area uncertainty, the two largest sources of unmodeled position prediction error for LEO orbits; these values are governed by a satellite's orbital parameters and ballistic coefficient histories, as well as the current and predicted space weather situation. This approach substantially improves the realism of the covariance by accounting for expected prediction errors that are not part of the fit process that generates the covariance. The second issue of covariance correlation is a complicated one, but the main shared error source—global atmospheric density error that is common to both satellites can be characterized and, through sensitivity vectors, quantified at the conjunction's time of closest approach and removed from the joint covariance, which is used in the CA probability of collision (Pc) calculation. Finally, while according to the orbit determination theory a non-positive-definite (NPD) covariance is not possible, numerical truncation and covariance interpolation can conspire to produce NPD results, which render the covariance unusable for certain CA risk assessment calculations, such as Monte Carlo Pc determination. Three similar techniques are profiled and the simplest of them recommended as a reasonable remediation technique when NPD covariances are encountered by CA practitioners.

Dynamic Consider Parameter↗
NASA NTRS1983

On the error in crop acreage estimation using satellite (LANDSAT) data

The problem of crop acreage estimation using satellite data is discussed. Bias and variance of a crop proportion estimate in an area segment obtained from the classification of its multispectral sensor data are derived as functions of the means, variances, and covariance of error rates. The linear discriminant analysis and the class proportion estimation for the two class case are extended to include a third class of measurement units, where these units are mixed on ground. Special attention is given to the investigation of mislabeling in training samples and its effect on crop proportion estimation. It is shown that the bias and variance of the estimate of a specific crop acreage proportion increase as the disparity in mislabeling rates between two classes increases. Some interaction is shown to take place, causing the bias and the variance to decrease at first and then to increase, as the mixed unit class varies in size from 0 to 50 percent of the total area segment.

Chhikara, R.↗
NASA NTRS1989

Biases and nonsystematic errors in NMC MRF predictions of momentum and zonal winds

The period of study considered by Rosen et al. (1987) for M forecasts is extended and the source of errors in these forecasts is examined. Time series of daily values of MRF forecasted minus the observed M are presented for forecast lead times of 2, 5, and 10 days from December 1985 through November 1988. A graph is presented of the covariance between errors in the angular momentum per unit mass forecasted at a 10-day lag, and those in the forecasted global angular momentum for the same period.

Rosen, Richard D.↗