Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

From Formal Errors Towards Realistic Uncertainties

Evaluation of uncertainties of geodetic parameter estimates is the problem that is not yet solved in a satisfactory way. A direct evaluation of the uncertainties derived from a least square solution is labeled "formal" and is usually biased, sometimes up to an order of magnitude. Customary, the use of formal errors for scientific analysis is discouraged. We claim that the root of the problem is neglecting off-diagonal elements in the variance-covariance matrix of the noise in the data. A careful reconstruction of the full variance-covariance matrix, including the off-diagonal terms greatly improves realism of uncertainty estimates derived from least squares. We processed the dataset of VLBI group delays and built a prior variance-covariance of the atmosphere-driven noise based on analysis of the output of NASA high-resolution numerical weather models. We found that the uncertainties of parameter estimates derived from this least square solution that uses such variance-covariance matrices become much closer to realistic errors. We consider approaches for implementation of this method in routine data analysis of space geodesy data.

Leonid Petrov↗

The Crucial Role of Error Correlation for Uncertainty Modeling of CFD-Based Aerodynamics Increments

The Ares I ascent aerodynamics database for Design Cycle 3 (DAC-3) was built from wind-tunnel test results and CFD solutions. The wind tunnel results were used to build the baseline response surfaces for wind-tunnel Reynolds numbers at power-off conditions. The CFD solutions were used to build increments to account for Reynolds number effects. We calculate the validation errors for the primary CFD code results at wind tunnel Reynolds number power-off conditions and would like to be able to use those errors to predict the validation errors for the CFD increments. However, the validation errors are large compared to the increments. We suggest a way forward that is consistent with common practice in wind tunnel testing which is to assume that systematic errors in the measurement process and/or the environment will subtract out when increments are calculated, thus making increments more reliable with smaller uncertainty than absolute values of the aerodynamic coefficients. A similar practice has arisen for the use of CFD to generate aerodynamic database increments. The basis of this practice is the assumption of strong correlation of the systematic errors inherent in each of the results used to generate an increment. The assumption of strong correlation is the inferential link between the observed validation uncertainties at wind-tunnel Reynolds numbers and the uncertainties to be predicted for flight. In this paper, we suggest a way to estimate the correlation coefficient and demonstrate the approach using code-to-code differences that were obtained for quality control purposes during the Ares I CFD campaign. Finally, since we can expect the increments to be relatively small compared to the baseline response surface and to be typically of the order of the baseline uncertainty, we find that it is necessary to be able to show that the correlation coefficients are close to unity to avoid overinflating the overall database uncertainty with the addition of the increments.

Hemsch, Michael J.↗

Neural correspondence to spectrum of environmental uncertainty in multiple-cue probability judgment system with time delay

Despite state-of-the-art technologies like artificial intelligence, human judgment is critically essential in cooperative systems, such as the multi-agent system (MAS), which collect information among agents based on multiple-cue judgment. Human agents can prevent impaired situational awareness of automated agents by confirming situations under environmental uncertainty. System error caused by uncertainty can result in an unreliable system environment, and this environment affects the human agent, resulting in non-optimal decision-making in MAS. Thus, it is necessary to know how human behavior is changed to capture system reliability under uncertainty. Another issue affecting MAS is time delay, which can delay agent information transfer, resulting in low performance and instability. However, it is difficult to find studies on the influence of time delay on human agents. This study is about understanding the human decision-making process under a specific system reliability environment by uncertainty with time delay. We used concepts of expected and unexpected uncertainty to implement reliability of the system usage environment with three types of time delay conditions: no time delay, regular time delay, and irregular time delay conditions. We used electroencephalogram (EEG) for human cognitive neural mechanisms in multiple-cue judgment systems to understand human decision-making. In the reliability of system usage environment, the unreliable system environment significantly creates less memory load by less utilization of system rules for decision-making. In terms of time delay, delayed information delivery does not significantly affect memory load for decision-making.

cognitive process↗

Trajectory Dispersion Control for the Cassini Grand Finale Mission

The Cassini Grand Finale Mission, which consists of 22 ballistic orbits, will begin on April 22, 2017 after the last targeted Titan flyby. It will end on September 15, 2017 when the spacecraft dives into Saturn's atmosphere and be permanently captured. High volumes of unique science data from various onboard instruments are expected from the mission. To ensure its success and facilitate science planning, the trajectory dispersion needs to be controlled below 250 km (root-mean-square spatial deviation at the 68th percentile level) for a few segments of trajectory in the mission. This paper reports the formulation and solution of this dispersion control problem. We consider various sources of uncertainties including flyby error, orbit determination error, maneuver execution error, thruster firing control error, and uncertainty in Saturn's atmospheric model. A non-linear Monte Carlo Trajectory Dispersion tool is developed and employed for the analysis. It is found that a total of three Orbit Trim Maneuvers with a 99% (Delta)V usage of less than 2 m/s will adequately control the trajectory.

orbit determination↗

Optimized Trajectory Correction Burn Placement for the NASA Artemis II Mission

The NASA Artemis II mission represents the first time humans plan to return to the lunar vicinity in over 50 years with a crew traveling to the Moon in the Orion spacecraft on a free return trajectory. This first crewed mission of the Artemis program will evaluate human-rated elements of Orion in preparation to sending astronauts to the lunar surface. The selected free-return cislunar trajectory profile that is reminiscent of the Apollo 8 mission that nominally requires no additional translational burns following the trans-lunar injection (TLI) burn. Due to crew activity, maneuver execution errors, navigation uncertainty, orbit insertion errors, disturbance accelerations, and other system limitations; periodic trajectory corrections burns are necessary to ensure proper entry interface (EI) conditions are satisfied for a safe return to Earth. Robust trajectory optimization techniques are utilized to determine the optimized placements for the Artemis II trajectory correction burns that accounts for the crew schedule, both the primary and backup navigation systems, targeting strategies and burn plan configurations, spacecraft venting, thruster selection, and the integrated GN&C performance.

Linear Covariance Analysis↗

Performance Impacts to the NASA Artemis II Trajectory Correction Burn Placement

As NASA embarks to return humans to the lunar vicinity with the upcoming Artemis II mission, the selected free return trajectory taking the crew to the Moon in the Orion spacecraft is impacted by the execution of small trajectory correction burns to ensure the spacecraft stays on course for a successful return to Earth. The placement of these nominally zero translational maneuvers must account for the crew schedule, navigation tracking constraints, spacecraft venting, thermal and communication requirements, and a host of other programmatic factors. Understanding the influence the placement of these periodic burn corrections have on the integrated GN\&C performance can provide valuable insight to mission controllers and trajectory planning processes to untangle the complex trade space considered for both baseline and contingency scenarios. This sensitivity information can also be utilized to facilitate the optimized placement of these burns. This paper utilizes several techniques to systematically generate the performance impacts to the NASA Artemis II trajectory correction burn placement and demonstrate how to derive optimized locations that make the system robust to crew activity, maneuver execution errors, navigation uncertainty, orbit insertion errors, disturbance accelerations, and other system limitations.

GN&C↗

Analysis of Strategic Conflict Management Approaches as Applied to Simulated UAM Operations

This report presents the results of a comparison analysis of candidate Strategic Conflict Management (SCM) strategies as applied to Urban Air Mobility (UAM) operations. The SCM strategies investigated included: no SCM, resource scheduling (RS), resource flow rates (FR), area-based flow rates (AR), and conflict detection and resolution (CR). The study evaluated each strategy against the same 3 levels of flight demand in a representative airspace construct for the Dallas/Fort Worth region. The study also accounted for different levels of uncertainty in operational planning and equivalent levels of trajectory following error. In the analysis, we compared the SCM strategies’ effectiveness in reducing the need for the tactical conflict management layer to act and looked at the metrics of unmitigated losses-of-separation (LOS), flight delays imposed by strategic planning, and throughput of the overall airspace. The study results indicated that the CR strategy was the most effective at reducing LOS and percentage of flights with LOS, even in the presence of trajectory error when uncertainty is accounted for in planning. Thus, if the objective is to reduce the number of actions that the tactical conflict management layer will have to take, in terms of conflicts that may need to be resolved, CR is the strategy to use. The FR strategy was found to be the worst at reducing LOS and percentage of flights with LOS. Thus, it is not very effective at reducing the actions required by a tactical conflict management layer. In the airspace tested, the demand was high enough to produce unacceptable levels of flight delay and reductions of throughput when the SCM strategies were implemented. This was especially evident at the higher levels of trajectory uncertainty and error. The need to account for expected levels of uncertainty becomes more and more important as the demand level increases and as the level of trajectory error increases. This is because the likelihood of flights with LOS increases as the density of operations increases and as the level of trajectory error increases. Accounting for uncertainty in the SCM strategies improves the strategy effectiveness with respect to LOS but increases delays and reduces throughput. Thus, there is a tradeoff between scalability and allowable levels of uncertainty. That is, we can implement an air traffic management construct that allows high levels of uncertainty, but we can expect that same system to have limits on scalability that may be evident even at small demand levels, such as those used in this study. Therefore, the results in this study indicate that an air traffic system should attempt to implement mechanisms appropriate for reducing uncertainty where possible in order to increase the chances for scalability. And this increased level of predictability of operations needs to be balanced with mechanisms for ensuring flexibility when operational conditions and plans need to change, even though those types of changes should be the exception rather than the rule under normal conditions. The study also introduced a trade space that could serve as a mechanism for selecting the appropriate SCM strategy in a trade-off between uncertainty and error, mean flight delay, and the LOS metrics (which this study equates to the potential for tactical conflict management actions). The optimal solution for a given airspace, demand level, and other factors, could likely be a combination of SCM strategies, although this study only compared the use of a single SCM strategy at a time. The CR strategy appeared to have the best opportunity for scalability by limiting the number of potential tactical actions to nearly zero.

Strategic Conflict Management↗

Error dynamics and relative orbital uncertainty of the Magellan spacecraft

Relative error is discussed in light of a proposed orbiter mission to Venus. It is hypothesized that the relative (position) error of the orbiting spacecraft between disjoint data sets will be large because of residual uncertainties of the absolute estimates and their decorrelation caused by succeeding estimates. A method is proposed to limit relative error by inducing correlations between the estimates on successive data arcs. These correlations are induced by overlapping the data arcs. Covariance analyses of the data sets are undertaken at two distinct mapping times, yielding the relative error between those mapping times. The technique is applied to a mosaicking problem on a specific day in the mission.

Haw, R. J.↗

Quantifying Uncertainties in Nighttime Light Retrievals From Suomi-NPP and NOAA-20 VIIRS Day/Night Band Data

Satellite observations of nighttime lights (NTL) from Suomi-NPP and NOAA-20 VIIRS Day/Night Band data have been widely used to estimate human activities. Long-term changes such as urban development and abrupt short-term changes such as power outages have been monitored from temporal NTL acquired by satellites. While high temporal NTL variation has been found across NTL data of varying temporal scale (e.g., daily, monthly, and annual composites), the sources of measurement error and uncertainty are poorly understood. This paper quantifies the sources of VIIRS-derived NTL uncertainty due to view-illumination geometry, surface Bidirectional Reflectance Distribution Function (BRDF)/albedo, and the effects of snow cover, lunar irradiance, aerosol loading, cloud mask, vegetation, geometry, and ephemeral artifacts (e.g., the Aurora Borealis). Based on this current assessment of NASA Black Marble retrievals (VNP46, Collection V001), we found that angular and atmospheric effects dominate retrieval uncertainty. Errors introduced by upstream data inputs (e.g., a coarser nighttime snow cover flag and misclassification errors in the existing VIIRS nighttime cloud mask) were also found to impact retrieval quality. Despite these challenges, a consistent daily NTL time series record can be routinely generated from top-of-atmosphere VNP46 radiances. Key recommendations include: (1) the use of lunar-BRDF adjusted and atmospherically corrected NTL (i.e., as identified as high-quality retrievals in the VNP46 QA fields), (2) development and improvement to the VIIRS snow cover and cloud masks algorithms to accurately reflect NTL retrieval conditions, (3) characterizing seasonal variations in NTL due to vegetation and snow, (4) reducing geometric effects due to the spatial mismatch of gridded pixel and observation footprint, (5) employing angularly-consistent NTL observations from multiple VIIRS instruments (i.e., Suomi-NPP and NOAA-20) to reduce pixel-based uncertainties and address persistent data gaps, and (6) being mindful of surface-reflected radiance from aurora events at mid-to-high latitudes.

Zhuosen Wang↗

Uncertainty methodology for in-flight thrust determination

A methodology is proposed for the evaluation of uncertainty in the in-flight determination of aircraft thrust, which provides error traceability to a national standards laboratory, and is independent of the procedure used to calculate or measure thrust in flight, thereby yielding a consistent means for the evaluation of measurement capabilities. Attention is given to the factors of measurement error, precision, bias, uncertainty, error estimation and classification, error propagation, ground testing, and the related problems of model bias error, model precision error, and the uncertainty limit.

Adams, G. R.↗

Mission Design Considerations for a Low-Thrust Spacecraft

Developing an executable low-thrust trajectory for use in a spaceflight mission requires the design and optimization of a deterministic trajectory as well as the validation that the selected architecture is robust to some set of uncertainties, execution errors, and potential contingencies. Uncertainty in the ability of the spacecraft and its launch vehicle to execute a trajectory as well as potential deviations such as in-flight anomalies combine with design-to constraints and requirements to complicate the optimization problem. The approach by which robust mission design was accomplished for the initial capability of NASA’s Gateway is presented as well as associated results.

NRHO↗

Mission Design Considerations for a Low-Thrust Spacecraft

Developing an executable low-thrust trajectory for use in a spaceflight mission requires the design and optimization of a deterministic trajectory as well as the validation that the selected architecture is robust to some set of uncertainties, execution errors, and potential contingencies. Uncertainty in the ability of the spacecraft and its launch vehicle to execute a trajectory as well as potential deviations such as in-flight anomalies combine with design-to constraints and requirements to complicate the optimization problem. The approach by which robust mission design was accomplished for the initial capability of NASA’s Gateway is presented as well as associated results.

mission design↗

Spaceborne Doppler Radar Measurements of Rainfall: Correction of Errors Induced by Pointing Uncertainties

In this paper a sea surface radar echo spectral analysis technique to correct for the rainfall velocity error caused by radar-pointing uncertainty is presented. The correction procedure is quite straightforward when the radar is observing a homogeneous rainfall field. When nonuniform beam filling (NUBF) occurs and attenuating frequencies are used, however, additional steps are necessary in order to correctly estimate the antenna-pointing direction. This new technique relies on the application of the combined frequency-time (CFT) algorithm to correct for uneven attenuation effects on the observed sea surface Doppler spectrum. The performance of this correction technique was evaluated by a Monte Carlo simulation of the Doppler precipitation radar backscatter from high-resolution 3D rain fields (either generated by a cloud resolving numerical model or retrieved from airborne radar measurements). The results show that the antenna-pointing-induced error can, indeed, be reduced by the proposed technique in order to achieve 1 m s(exp -1) accuracy on rainfall vertical velocity estimates.

remote sensing↗

The Impact of Model and Rainfall Forcing Errors on Characterizing Soil Moisture Uncertainty in Land Surface Modeling

The contribution of rainfall forcing errors relative to model (structural and parameter) uncertainty in the prediction of soil moisture is investigated by integrating the NASA Catchment Land Surface Model (CLSM), forced with hydro-meteorological data, in the Oklahoma region. Rainfall-forcing uncertainty is introduced using a stochastic error model that generates ensemble rainfall fields from satellite rainfall products. The ensemble satellite rain fields are propagated through CLSM to produce soil moisture ensembles. Errors in CLSM are modeled with two different approaches: either by perturbing model parameters (representing model parameter uncertainty) or by adding randomly generated noise (representing model structure and parameter uncertainty) to the model prognostic variables. Our findings highlight that the method currently used in the NASA GEOS-5 Land Data Assimilation System to perturb CLSM variables poorly describes the uncertainty in the predicted soil moisture, even when combined with rainfall model perturbations. On the other hand, by adding model parameter perturbations to rainfall forcing perturbations, a better characterization of uncertainty in soil moisture simulations is observed. Specifically, an analysis of the rank histograms shows that the most consistent ensemble of soil moisture is obtained by combining rainfall and model parameter perturbations. When rainfall forcing and model prognostic perturbations are added, the rank histogram shows a U-shape at the domain average scale, which corresponds to a lack of variability in the forecast ensemble. The more accurate estimation of the soil moisture prediction uncertainty obtained by combining rainfall and parameter perturbations is encouraging for the application of this approach in ensemble data assimilation systems.

Maggioni, V.↗