Search NASA⌕ Search

SEARCH · Search NASA

Results for “covariance realism”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Earth Observing System Covariance Realism

The purpose of covariance realism is to properly size a primary object's covariance in order to add validity to the calculation of the probability of collision. The covariance realism technique in this paper consists of three parts: collection/calculation of definitive state estimates through orbit determination, calculation of covariance realism test statistics at each covariance propagation point, and proper assessment of those test statistics. An empirical cumulative distribution function (ECDF) Goodness-of-Fit (GOF) method is employed to determine if a covariance is properly sized by comparing the empirical distribution of Mahalanobis distance calculations to the hypothesized parent 3-DoF chi-squared distribution. To realistically size a covariance for collision probability calculations, this study uses a state noise compensation algorithm that adds process noise to the definitive epoch covariance to account for uncertainty in the force model. Process noise is added until the GOF tests pass a group significance level threshold. The results of this study indicate that when outliers attributed to persistently high or extreme levels of solar activity are removed, the aforementioned covariance realism compensation method produces a tuned covariance with up to 80 to 90% of the covariance propagation timespan passing (against a 60% minimum passing threshold) the GOF tests-a quite satisfactory and useful result.

Realism↗
NASA NTRS2016

Earth Observation System Flight Dynamics System Covariance Realism

This presentation applies a covariance realism technique to the National Aeronautics and Space Administration (NASA) Earth Observation System (EOS) Aqua and Aura spacecraft based on inferential statistics. The technique consists of three parts: collection calculation of definitive state estimates through orbit determination, calculation of covariance realism test statistics at each covariance propagation point, and proper assessment of those test statistics.

A-Train↗
NASA NTRS2017

Earth Observing System Covariance Realism Updates

This presentation will be given at the International Earth Science Constellation Mission Operations Working Group meetings June 13-15, 2017 to discuss the Earth Observing System Covariance Realism updates.

realism↗
NASA NTRS2019

Covariance Realism Is Not Enough

A great deal of effort has been put into improving the practice of space situational awareness such that covariance data associated with predicted close approaches is more “realistic.” However, “realistic” usually has meant “larger” and this presents a problem. In many cases, there exist multiple sources for predictive ephemerides, which may be fused to produce predictive states with smaller associated covariances. Ancillary to the fusion computation is the capability to assess consistency of the estimates. If actionable covariance information becomes available, interval estimates for the miss distance provide a more informative alternative to collision probability for risk assessment.

Carpenter, J. Russell↗
NASA NTRS2017

Filter Tuning Using the Chi-Squared Statistic

This paper examines the use of the Chi-square statistic as a means of evaluating filter performance. The goal of the process is to characterize the filter performance in the metric of covariance realism. The Chi-squared statistic is the value calculated to determine the realism of a covariance based on the prediction accuracy and the covariance values at a given point in time. Once calculated, it is the distribution of this statistic that provides insight on the accuracy of the covariance. The process of tuning an Extended Kalman Filter (EKF) for Aqua and Aura support is described, including examination of the measurement errors of available observation types, and methods of dealing with potentially volatile atmospheric drag modeling. Predictive accuracy and the distribution of the Chi-squared statistic, calculated from EKF solutions, are assessed.

Filter Tuning↗
NASA NTRS2018

Realistic Covariance Generation for the GPM Spacecraft

A covariance realism process for NASA's Global Precipitation Measurement (GPM) spacecraft is detailed. The GPM spacecraft is in a low earth orbit, and performs collision avoidance maneuvers few times a year. Currently GPM is below the International Space Station (ISS). So, in addition to cataloged debris objects, GPM must contend with smallsat/cubesat objects that are deployed from the ISS. Both operational scenarios require complete knowledge of the expected GPM prediction errors as a function of time. In this study, we present a method for generating realistic predicted covariance that uses linear propagation of the covariance with the addition of process noise. Further analyses are presented for the process noise ''tuning'' that generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Different tuning strategies are considered and compared via a Goodness-of-Fit testing for the Gaussian properties of the scaled covariance. SpaceNav's realistic covariance generation approach takes into account the contribution of predicted maneuver errors in the increased propagation uncertainty. Corresponding maneuver uncertainty is injected into the state uncertainty, and is used within the collision avoidance process to determine the collision risk for close approach events that follow a maneuver. This is a critical step in the maneuver planning process that provides the satellite operator with an accurate quantification of the collision probability for planned maneuvers. Using this information, an informed decision can be made to proceed with a maneuver if the collision risk is acceptable. This approach is validated by Monte-Carlo simulations and results are presented.

spacecraft uncertainty propagation↗
NASA NTRSDate not supplied

NASA CARA Tools

The NASA Conjunction Assessment Risk Analysis (CARA) team has created and posted to GitHub a set of MATLAB software tools for collision assessment (CA) analysis. The software is provided to the public under a NASA Open-Source Software Agreement and is maintained/updated by the CARA Analysis team. Capabilities provided within the toolset include algorithms in assessing probability of collision (Pc), collision consequence, covariance realism, Orbit Determination (OD) quality assessment, and single covariance max Pc. Additionally, a set of utilities are provided for astrodynamics topics closely related to CA, such as: Conjunction Data Message (CDM) parsing, covariance transformations, coordinate system transformations, etc. The repository is regularly updated on a monthly basis and new functionality will be added as algorithms are approved for public release. This presentation will provide a brief introduction to the toolset, highlight some of the key components which can be used in operations, and will present information on algorithms that are in the release pipeline and can be expected soon. This software will enable operators to independently perform CA calculations using the same core algorithms that CARA uses in operations.

L. Baars↗
NASA NTRSDate not supplied

NASA CARA Tools

The NASA Conjunction Assessment Risk Analysis (CARA) team has created and posted to GitHub a set of MATLAB software tools for collision assessment (CA) analysis. The software is provided to the public under a NASA Open-Source Software Agreement and is maintained/updated by the CARA Analysis team. Capabilities provided within the toolset include algorithms in assessing probability of collision (Pc), collision consequence, covariance realism, Orbit Determination (OD) quality assessment, and single covariance max Pc. Additionally, a set of utilities are provided for astrodynamics topics closely related to CA, such as: Conjunction Data Message (CDM) parsing, covariance transformations, coordinate system transformations, etc. The repository is regularly updated on a monthly basis and new functionality will be added as algorithms are approved for public release. This presentation will provide a brief introduction to the toolset, highlight some of the key components which can be used in operations, and will present information on algorithms that are in the release pipeline and can be expected soon. This software will enable operators to independently perform CA calculations using the same core algorithms that CARA uses in operations.

Luis Baars↗
NASA NTRS2019

Three CA-Related Covariance Issues and Their Solutions

This presentation addresses three issues that arise in the use of DoD-produced satellite state estimate covariances in the conjunction assessment process: the realism of the provided covariances, how to address correlated error between two satellites' covariance matrices, and how to proceed when a furnished covariance is non-positive-definite. To address the first, DoD has implemented a set of two "consider parameters" with which to alter/expand the covariance to account for atmospheric density forecast error and satellite frontal area uncertainty, the two largest sources of unmodeled position prediction error for LEO orbits; these values are governed by a satellite's orbital parameters and ballistic coefficient histories, as well as the current and predicted space weather situation. This approach substantially improves the realism of the covariance by accounting for expected prediction errors that are not part of the fit process that generates the covariance. The second issue of covariance correlation is a complicated one, but the main shared error source—global atmospheric density error that is common to both satellites can be characterized and, through sensitivity vectors, quantified at the conjunction's time of closest approach and removed from the joint covariance, which is used in the CA probability of collision (Pc) calculation. Finally, while according to the orbit determination theory a non-positive-definite (NPD) covariance is not possible, numerical truncation and covariance interpolation can conspire to produce NPD results, which render the covariance unusable for certain CA risk assessment calculations, such as Monte Carlo Pc determination. Three similar techniques are profiled and the simplest of them recommended as a reasonable remediation technique when NPD covariances are encountered by CA practitioners.

Dynamic Consider Parameter↗
NASA NTRS2018

Realistic Covariance Generation for the GPM Spacecraft

We present several different methods for generating realistic predictive covariance, including Monte-Carlo simulations and more direct linear methods which require the addition of process noise. The Monte-Carlo simulation starts with an epoch uncertainty sample basis and propagates each trial to a time of interest in the future. The variance-covariance of the state elements as well as other higher order sample statistics can be readily computed from the propagated sample. While this method preserves the nonlinear effects on the propagated uncertainty, it is computationally intensive as a statistically significant sample size must be considered in the propagation process. Moreover, if the epoch covariance is optimistic, this can result in an underestimation of the prediction error. Another method is to propagate a state sensitivity matrix simultaneously with the satellite state, which allows the epoch covariances to be propagated forward in a linear fashion. This method does not preserve the non-linearity of the satellite state uncertainty but is much less computationally intensive. The propagated state covariance is the scaled to represent the realistic level of GPM state uncertainty via a "e-tuning process." The tuning process generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Difference tuning strategies are considered and compared via Goodness-of-Fit method testing for the Gaussian properties of the scaled covariance.

prediction error↗
NASA NTRS2017

Filter Tuning Using the Chi-Squared Statistic

The Goddard Space Flight Center (GSFC) Flight Dynamics Facility (FDF) performs orbit determination (OD) for the Aqua and Aura satellites. Both satellites are located in low Earth orbit (LEO), and are part of what is considered the A-Train satellite constellation. Both spacecraft are currently in the science phase of their respective missions. The FDF has recently been tasked with delivering definitive covariance for each satellite.The main source of orbit determination used for these missions is the Orbit Determination Toolkit developed by Analytical Graphics Inc. (AGI). This software uses an Extended Kalman Filter (EKF) to estimate the states of both spacecraft. The filter incorporates force modelling, ground station and space network measurements to determine spacecraft states. It also generates a covariance at each measurement. This covariance can be useful for evaluating the overall performance of the tracking data measurements and the filter itself. An accurate covariance is also useful for covariance propagation which is utilized in collision avoidance operations. It is also valuable when attempting to determine if the current orbital solution will meet mission requirements in the future.This paper examines the use of the Chi-square statistic as a means of evaluating filter performance. The Chi-square statistic is calculated to determine the realism of a covariance based on the prediction accuracy and the covariance values at a given point in time. Once calculated, it is the distribution of this statistic that provides insight on the accuracy of the covariance.For the EKF to correctly calculate the covariance, error models associated with tracking data measurements must be accurately tuned. Over estimating or under estimating these error values can have detrimental effects on the overall filter performance. The filter incorporates ground station measurements, which can be tuned based on the accuracy of the individual ground stations. It also includes measurements from the NASA space network (SN), which can be affected by the assumed accuracy of the TDRS satellite state at the time of the measurement.The force modelling in the EKF is also an important factor that affects the propagation accuracy and covariance sizing. The dominant force in the LEO orbit regime is the drag force caused by atmospheric drag. Accurate accounting of the drag force is especially important for the accuracy of the propagated state. The implementation of a box and wing model to improve drag estimation accuracy, and its overall effect on the covariance state is explored.The process of tuning the EKF for Aqua and Aura support is described, including examination of the measurement errors of available observation types (Doppler and range), and methods of dealing with potentially volatile atmospheric drag modeling. Predictive accuracy and the distribution of the Chi-square statistic, calculated based of the ODTK EKF solutions, are assessed versus accepted norms for the orbit regime.

Covariance Analysis↗
NASA NTRS2016

Covariance Manipulation for Conjunction Assessment

The manipulation of space object covariances to try to provide additional or improved information to conjunction risk assessment is not an uncommon practice. Types of manipulation include fabricating a covariance when it is missing or unreliable to force the probability of collision (Pc) to a maximum value ('PcMax'), scaling a covariance to try to improve its realism or see the effect of covariance volatility on the calculated Pc, and constructing the equivalent of an epoch covariance at a convenient future point in the event ('covariance forecasting'). In bringing these methods to bear for Conjunction Assessment (CA) operations, however, some do not remain fully consistent with best practices for conducting risk management, some seem to be of relatively low utility, and some require additional information before they can contribute fully to risk analysis. This study describes some basic principles of modern risk management (following the Kaplan construct) and then examines the PcMax and covariance forecasting paradigms for alignment with these principles; it then further examines the expected utility of these methods in the modern CA framework. Both paradigms are found to be not without utility, but only in situations that are somewhat carefully circumscribed.

Conjunction↗
NASA NTRSDate not supplied

From Formal Errors Towards Realistic Uncertainties

Evaluation of uncertainties of geodetic parameter estimates is the problem that is not yet solved in a satisfactory way. A direct evaluation of the uncertainties derived from a least square solution is labeled "formal" and is usually biased, sometimes up to an order of magnitude. Customary, the use of formal errors for scientific analysis is discouraged. We claim that the root of the problem is neglecting off-diagonal elements in the variance-covariance matrix of the noise in the data. A careful reconstruction of the full variance-covariance matrix, including the off-diagonal terms greatly improves realism of uncertainty estimates derived from least squares. We processed the dataset of VLBI group delays and built a prior variance-covariance of the atmosphere-driven noise based on analysis of the output of NASA high-resolution numerical weather models. We found that the uncertainties of parameter estimates derived from this least square solution that uses such variance-covariance matrices become much closer to realistic errors. We consider approaches for implementation of this method in routine data analysis of space geodesy data.

Leonid Petrov↗
DOE OSTI2025

High-frequency Data Integration for Landscape Model Calibration of Carbon Fluxes Across Diverse Tidal Marshes

Terrestrial Aquatic Interfaces (TAIs), and tidal wetlands in particular, store large amounts of carbon yet are not well represented in Earth System Models (ESMs). Predictions of carbon cycling and greenhouse gas (GHG) emissions in tidal wetlands are highly uncertain. Eddy covariance (EC) towers provide ecosystem-scale GHG flux data at a temporal resolution (every 30min) that is helpful for parameterizing and improving mechanistic realism in ESMs. We propose to use a network of eddy covariance towers and standardized ancillary data streams, along with mesocosm experiments and statistical analyses, across diverse tidal wetlands of North America to develop and improve biogeochemical modeling at the TAI. Our overarching objective is to improve understanding and process-based modeling of gross primary productivity (GPP) and CH4 emission responses, both non-linear and asynchronous, to stressors including plant inundation, disturbance, salinity and nitrogen loading.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2009

Quantifying Parameter Sensitivity, Interaction and Transferability in Hydrologically Enhanced Versions of Noah-LSM over Transition Zones

We use sensitivity analysis to identify the parameters that are most responsible for shaping land surface model (LSM) simulations and to understand the complex interactions in three versions of the Noah LSM: the standard version (STD), a version enhanced with a simple groundwater module (GW), and version augmented by a dynamic phenology module (DV). We use warm season, high-frequency, near-surface states and turbulent fluxes collected over nine sites in the US Southern Great Plains. We quantify changes in the pattern of sensitive parameters, the amount and nature of the interaction between parameters, and the covariance structure of the distribution of behavioral parameter sets. Using Sobol s total and first-order sensitivity indexes, we show that very few parameters directly control the variance of the model output. Significant parameter interaction occurs so that not only the optimal parameter values differ between models, but the relationships between parameters change. GW decreases parameter interaction and appears to improve model realism, especially at wetter sites. DV increases parameter interaction and decreases identifiability, implying it is overparameterized and/or underconstrained. A case study at a wet site shows GW has two functional modes: one that mimics STD and a second in which GW improves model function by decoupling direct evaporation and baseflow. Unsupervised classification of the posterior distributions of behavioral parameter sets cannot group similar sites based solely on soil or vegetation type, helping to explain why transferability between sites and models is not straightforward. This evidence suggests a priori assignment of parameters should also consider climatic differences.

Rosero, Enrique↗
DOE OSTI2025

ELM–Wet: Inclusion of a Wet–Landunit With Sub–Grid Representation of Eco–Hydrological Patches and Hydrological Forcing Improves Methane Emission Estimations in the E3SM Land Model (ELM)

Wetlands are the largest emitters of biogenic methane (CH 4 ) and represent the highest source of uncertainty in global CH 4 budgets. Here, we aim to improve the realism of wetland representation in the U.S. Department of Energy's Exascale Earth System Model land surface model, ELM, thereby reducing uncertainty of CH 4 flux predictions. We develop an updated version, ELM-Wet, where we activate a separate landunit for wetlands that handles multiple wetland-specific eco-hydrological patch functional types. We introduce more realistic hydrological forcing through prescribing site-level constraints on surface water elevation, which allows resolving different sustained inundation depth for different patches, and if data exists, prescribing inundation depth. We modified the calculation of aerenchyma transport diffusivity based on observed conductance per leaf area for different vegetation types. We use Bayesian Optimization to parameterize CO 2 and CH 4 fluxes in the developed wet-landunit. Site-level simulations of a coastal non-tidal freshwater wetland in Louisiana were performed with the updated model. Eddy covariance observations of CO 2 and CH 4 fluxes from 2012 to 2013 were used to train the model and data from 2021 were used for validation. Patch-specific chamber flux observations and observations of CH 4 concentration profiles in the soil porewater from 2021 were used for evaluation of the model performance. Our results show that ELM-Wet reduces the model's CH 4 emission root mean squared error by up to 33% and is able to represent inter-daily CO 2 and CH 4 flux variability across the wetland's eco-hydrological patches, including during periods of extreme dry or wet conditions.

54 ENVIRONMENTAL SCIENCES↗