Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Validation of Linear Covariance Techniques for Mars Entry, Descent, and Landing Guidance and Navigation Performance Analysis

Current Monte Carlo-based uncertainty analysis methods may require significant computational resources to evaluate the performance of a closed-loop guidance, navigation, and control system. An attractive alternative, particularly during the preliminary and conceptual design phase, is to use linear covariance analysis, which can provide the same statistical information as Monte Carlo methods at a fraction of the computational load. Linear covariance has already been demonstrated in various spaceflight regimes, but only recently has it been applied to atmospheric flight. In this study, a 6-degree-of-freedom formulation of both a linear covariance and Monte Carlo analysis tools are utilized for a Mars entry, descent, and landing scenario which capture both atmospheric and powered flight phases to support precision landing. Comparison of the performance results shows close agreement between the linear covariance and traditional Monte Carlo methods when incorporating an assortment of guidance algorithms and processing a variety of inertial and relative sensor measurements onboard the lander's navigation filter.

James W. Williams↗

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗

Uncertainty of Five-Hole Probe Measurements

A new algorithm for five-hole probe calibration and data reduction using a non-nulling technique was developed, verified, and reported earlier (Wendt and Reichert, 1993). The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify the uncertainty of five-hole probe results (e.g., total pressure, static pressure, and flow direction) and to determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance for improving the measurement technique.

Reichert, Bruce A.↗

Uncertainty estimates in geomagnetic field modeling

This paper presents an extension of the conventional uncertainty analysis which characterizes the sources of uncertainty in the coefficients of the geomagnetic field models. The new formalism accounts for the systematic errors introduced by the omission of such sources as the presence of crustal fields, the external fields, and the field from the truncated terms. The usefulness of this formalism depends on two critical conditions. The first of these is the knowledge of the statistical properties of the fields whose parameters are not solved in the analysis, i.e., the crustal field and the external field. The second critical point in the practical use of the method is the approximation used for the weight matrix.

Langel, R. A.↗

Verification and Validation in NASA-CUIP LOX/methane Injector Research Efforts

The NASA-CUIP program is supporting experimental and modeling/computational research efforts investigating wall heat flux characteristics of LOX/methane single-element injectors. A Verification and Validation (V&V) task has begun with the objective of quantifying the degree of accuracy of the models for wall heat flux distributions at specific sets of conditions. The V&V approach used is that being drafted as a standard by the ASME Performance Test Codes Committee, PTC 61: Verification and Validation in Computational Fluid Dynamics and Heat Transfer. The approach is based on well-established concepts from experimental uncertainty analysis. Initially the V&V and uncertainty estimation efforts will use data obtained previously in the same facility using oxygen/hydrogen in single-element injector testing. In this paper the V&V process, experimental facility, and computer code are described, and approaches to estimating the associated uncertainties are discussed.

Coleman, Hugh W.↗

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit(CPU)on the order of ~30 s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗

Estimation of 3D Woven Design Sensitivities Using a Rapid Multiscale Analysis Technique

Highly-refined finite element models of three-dimension (3D) woven composite systems currently require excessive computational demands that limit their use in sensitivity analysis, uncertainty quantification, and optimization. An alternative analysis methodology was developed using the NASA Multiscale Analysis Tool (NASMAT) where multiscale models of a 3D woven composite (including inter-tow matrix voids and constituent failure) can be completed on a single central processing unit (CPU) on the order of ~30s. To develop inputs and validation data for the NASMAT model, coupon and acid-digesting testing and x-ray computed tomography were performed. The NASMAT inputs were parameterized using a set of 25 input variables and distributions. These inputs were randomly sampled to generate a total of 100,000 NASMAT analyses that could be used to understand the influence of different material and geometric properties on the warp and weft-direction stiffness and strength. These analyses (including pre/post-processing) were performed in less than eight hours on a 120 CPU cluster. The computational efficiency of the NASMAT model enabled a sensitivity analysis to be performed, and dominant input variables were able to be identified. Key results were consistent with theoretical and experimental observations for the specific 3D woven system studied in this work.

NASMAT↗

Aerothermal Analysis of the Rocket Lab Venus Probe Heatshield

This document provides an overview of the aerothermodynamic analyses performed by the Aerothermodynamics Branch at NASA Langley Research Center for the Rocket Lab Venus Probe (RLVP). In addition to defining the baseline heating environment to the heatshield, this document pursues the experimental validation of key physical models at RLVP-relevant conditions. This experimental validation analysis, which captures the model form uncertainty, is used as one of two primary components of the margin assessment, where the other component is the parametric uncertainty. These model form (experimental) and parametric uncertainty components are used to construct a spatial and time varying margin for the heating to the RLVP heatshield. The margin is evaluated as the sum of the parametric and model form uncertainty components. The model form uncertainty is defined as the difference between the RLVP-relevant measurements and their simulations, using the upper limit uncertainty bounds for both the measurements and simulations in the comparisons. The differences in the dominant physics in the stagnation region and flank lead to the separate RLVP-relevant measurements for assessing the model form uncertainty in these two regions. These regions are addressed as follows: Stagnation Region Heating Environment: For the high-temperature stagnation-region, both the radiative heating and impact of blowing on convective heating are significant, while the impacts of turbulence and roughness are negligible. Coupled radiation and ablation LAURA/HARA solutions with ray-tracing provide the radiative heating over the entire vehicle, including the contributions from the Venus atmosphere and ablation species. Non-ablating LAURA simulations provide the convective heating. During the material-response computation typically used for TPS sizing, this non-ablating convective heating is corrected for the impact of ablation using the blowing correction. Coupled ablation LAURA simulations that capture finite-rate sur-face processes show that this blowing correction may be non-conservative over most of the heatshield. This non-conservatism is due to hydrogen recombination in the finite-rate surface model, which tends to increase the coupled ablation convective heating to near the non-ablating values, therefore making any reduction in the non-ablating value through the blowing correction non-conservative. This non-conservatism due to H catalysis is captured in the parametric component of the margin. The best available ground-test measurements that capture the impact of blowing on stagnation region convective heating, at RLVP-relevant conditions, indicate that the current blowing reduction model is non-conservative by up to 20% at RLVP-relevant blowing rates (the coupled blowing simulations were also non-conservative). Because of the relatively low velocity of the ground tests and the non-Venus atmospheric chemistry, these measurements do not capture the chemistry and therefore do not inform the uncertainty due to H catalysis. However, they do capture the fluid mechanics of blowing. The non-conservatism of the blowing correction implied by these measurements is covered by the model form component of the margin, which leads to total margin values over 50%. For the radiative heating, the shock-tube informed bias approach suggests a model form uncertainty of roughly 20%, while the parametric uncertainty analysis suggests values over 100%. The combined stagnation-point radiation margin of over 100% leads to peak margined radiative heating values of over300 W/cm2, which remains small relative to the peak margined convective heating of nearly 2000 W/cm2. Based on this analysis, at the stagnation point, the peak margined heat rate is 2203 W/cm2 and the margined total heat load is 31.5 kJ/cm2 for the current nominal trajectory. Flank Heating Environment: The forebody flank (and near-shoulder) heating environment is dominated by the impact of turbulence, roughness augmentation, and ablation on the convective heating. An extensive collection of ground test measurements with RLVP-relevant turbulence and roughness is studied to show that the maximum difference between the simulated and measured convective heating is 5%. However, with the exception of the Holden measurements from the 1980s, these measurements do not include roughness elements extending into the supersonic region of the boundary layer, which is likely to occur for RLVP (due to the 45 degree sphere-cone geometry). The interaction between the supersonic flow and roughness could cause convective heating augmentation fundamentally different than for locally subsonic flow. Although these Holden measurements are consistent with the other measurements considered, another path was pursued to assure that the rough-ness height extending into supersonic flow does not fundamentally change the roughness augmentation. This additional path was a computational effort to resolve the roughness elements in the CFD grid, so that the interaction be-tween the roughness elements and locally supersonic flow may be simulated in detail. This roughness-resolved CFD simulation is feasible because of the RLVP forebody TPS’s patterned roughness, which may be approximated analytically, and because of the axisymmetric nominal flow field, which allows a narrow surface region to be simulated and therefore make the computational expense feasible. These grid-resolved roughness simulations, which are performed at actual RLVP flight conditions, result in heating augmentation values that are below the design approach for roughness augmentation. This provides evidence that the design approach for RLVP roughness augmentation is sufficient. Based on this analysis, at this flank or near-shoulder location, the peak margined total heat rate is 2088 W/cm2and the margined total heat load is 26.0 kJ/cm2for the current nominal trajectory. Heat flux, shear, pressure and heat transfer coefficient at the RLVP stagnation point and near shoulder location are evaluated for the entire trajectory, and curved fit to a functional form of F=AρB∞UC∞. These simplified relationships for the nominal and margined aerothermal environments are referred to as aerothermal indicators, and presented at the end of this document.

Christopher O Johnston↗

Conducting the NASP ground test program

The National Aero-Space Plane (NASP) program has recently entered a new phase of the program known as Phase 2D. During this period, five aerospace companies and the Government have formed a National Team. This team has focused on developing a single experimental (X-30) vehicle design and are pursuing a technology validation and demonstration program to prove out the design concepts and design tools. This paper presents an overview of the Phase 2D round testing being conducted to validate the X-30 design and to demonstrate the critical technologies needed to build and fly a research vehicle during Phase 3 of the program. The Phase 2D exit criteria are discussed to identify how they provide top-level guidance for developing the ground test program. An overview of major test facility modifications being performed in support of the test program is also presented. Emphasis is placed on propulsion and structures testing since these are felt to be the primary areas requiring technologies beyond the current state-of-the-art. Also discussed is the use of uncertainty analysis as a method to account for uncertainties in test data. In addition, this paper addresses the use of these uncertainties to develop qualitative indicators of how well the design and technology developed during Phase 2 have matured.

Airframes↗

Using Importance Sampling Monte Carlo to Analyze Aircraft Takeoff and Landing

Aircraft have achieved high levels of reliability, so the probability of undesirable dynamics is very low. The low probability of a bad takeoff or landing challenges nondeterministic methods to quantify the uncertainty of these improbable events. In the present work, a Monte Carlo method is defined to more effectively quantify these unlikely events that is suitable for uncertainty analysis of a mature design with many uncertainty parameters. The proposed Monte Carlo method has been applied to the takeoff and landing of the X-59 Quiet SuperSonic Technology (QueSST). Takeoff and landing simulation profiles were defined using a combination of industry standards and piloted simulation experience. The proposed method is shown to be able to quantify events with significantly fewer samples than would be required with conventional Monte Carlo. These results improve understanding of the sensitivity of the takeoff and landing dynamics to inform further studies and test planning.

Jeffrey Ouellette↗

Using Importance Sampling Monte Carlo to Analyze Aircraft Takeoff and Landing

Aircraft have achieved high levels of reliability, so the probability of undesirable dynamics is very low. The low probability of a bad takeoff or landing challenges nondeterministic methods to quantify the uncertainty of these improbable events. In the present work, a Monte Carlo method is defined to more effectively quantify these unlikely events that is suitable for uncertainty analysis of a mature design with many uncertainty parameters. The proposed Monte Carlo method has been applied to the takeoff and landing of the X-59 Quiet SuperSonic Technology (QueSST). Takeoff and landing simulation profiles were defined using a combination of industry standards and piloted simulation experience. The proposed method is shown to be able to quantify events with significantly fewer samples than would be required with conventional Monte Carlo. These results improve understanding of the sensitivity of the takeoff and landing dynamics to inform further studies and test planning.

Jeffrey Ouellette↗

Calibration of the NASA Glenn Research Center 16 in. Mass-Flow Plug

The results of an experimental calibration of the NASA Glenn Research Center 16 in. Mass-Flow Plug (MFP) are presented and compared to a previously obtained calibration of a 15 in. Mass-Flow Plug. An ASME low-beta, long-radius nozzle was used as the calibration reference. The discharge coefficient for the ASME nozzle was obtained by numerically simulating the flow through the nozzle from the WIND-US code. The results showed agreement between the 15 and 16 in. MFPs for area ratios (MFP to pipe area ratio) greater than 0.6 but deviate at area ratios below this value for reasons that are not fully understood. A general uncertainty analysis was also performed and indicates that large uncertainties in the calibration are present for low MFP area ratios.

Davis, David O.↗

Calibration of the NASA GRC 16 In. Mass-Flow Plug

The results of an experimental calibration of the NASA Glenn Research Center 16 in. Mass-Flow Plug (MFP) are presented and compared to a previously obtained calibration of a 15 in. Mass-Flow Plug. An ASME low-beta, long-radius nozzle was used as the calibration reference. The discharge coefficient for the ASME nozzle was obtained by numerically simulating the flow through the nozzle from the WIND-US code. The results showed agreement between the 15 in. and 16 in. MFPs for area ratios (MFP to pipe area ratio) greater than 0.6 but deviate at area ratios below this value for reasons that are not fully understood. A general uncertainty analysis was also performed and indicates that large uncertainties in the calibration are present for low MFP area ratios.

Davis, David O.↗

Performance and Reliability Optimization for Aerospace Systems subject to Uncertainty and Degradation

This report summarizes work performed by the Space Systems Laboratory (SSL) for NASA Langley Research Center in the field of performance optimization for systems subject to uncertainty. The objective of the research is to develop design methods and tools to the aerospace vehicle design process which take into account lifecycle uncertainties. It recognizes that uncertainty between the predictions of integrated models and data collected from the system in its operational environment is unavoidable. Given the presence of uncertainty, the goal of this work is to develop means of identifying critical sources of uncertainty, and to combine these with the analytical tools used with integrated modeling. In this manner, system uncertainty analysis becomes part of the design process, and can motivate redesign. The specific program objectives were: 1. To incorporate uncertainty modeling, propagation and analysis into the integrated (controls, structures, payloads, disturbances, etc.) design process to derive the error bars associated with performance predictions. 2. To apply modern optimization tools to guide in the expenditure of funds in a way that most cost-effectively improves the lifecycle productivity of the system by enhancing the subsystem reliability and redundancy. The results from the second program objective are described. This report describes the work and results for the first objective: uncertainty modeling, propagation, and synthesis with integrated modeling.

Miller, David W.↗

Primary reference cell calibrations at SERI - History and methods

The tabular calibration method used at the Solar Energy Research Institute (SERI) for primary reference cells is derived and described in detail. An uncertainty analysis shows that the tabular method should have a total uncertainty of + or - 1.0 percent; data from five years of calibrations are then shown to support this analysis. Results from SERI's tabular method are compared with terrestrial calibrations performed by the NASA Lewis Research Center in the late 1970s.

Osterwald, C. R.↗

Validity of trace element cosmothermometer

A reply is made to previous criticisms of the claim that the range of accretion of ordinary chondrites can be narrowed to 500-420 K (from 560-405 K) using volatile metals as cosmothermometers. Questions concerning uncertainties in vapor pressure data, entropy of mixing, methods of analysis, uncertainties in condensation curves, metamorphic transport, alloy formation, condensation of Tl, condensation of In, and concordance with other thermometers (FeO contents of silicates) are addressed. It is concluded that the original claim is valid.

Anders, E.↗

Probabilistic Design and Analysis Framework

PRODAF is a software package designed to aid analysts and designers in conducting probabilistic analysis of components and systems. PRODAF can integrate multiple analysis programs to ease the tedious process of conducting a complex analysis process that requires the use of multiple software packages. The work uses a commercial finite element analysis (FEA) program with modules from NESSUS to conduct a probabilistic analysis of a hypothetical turbine blade, disk, and shaft model. PRODAF applies the response surface method, at the component level, and extrapolates the component-level responses to the system level. Hypothetical components of a gas turbine engine are first deterministically modeled using FEA. Variations in selected geometrical dimensions and loading conditions are analyzed to determine the effects of the stress state within each component. Geometric variations include the cord length and height for the blade, inner radius, outer radius, and thickness, which are varied for the disk. Probabilistic analysis is carried out using developing software packages like System Uncertainty Analysis (SUA) and PRODAF. PRODAF was used with a commercial deterministic FEA program in conjunction with modules from the probabilistic analysis program, NESTEM, to perturb loads and geometries to provide a reliability and sensitivity analysis. PRODAF simplified the handling of data among the various programs involved, and will work with many commercial and opensource deterministic programs, probabilistic programs, or modules.

Strack, William C.↗

Quantitative Evaluation of MODIS Fire Radiative Power Measurement for Global Smoke Emissions Assessment

Satellite remote sensing is providing us tremendous opportunities to measure the fire radiative energy (FRE) release rate or power (FRP) from open biomass burning, which affects many vegetated regions of the world on a seasonal basis. Knowledge of the biomass burning characteristics and emission source strengths of different (particulate and gaseous) smoke constituents is one of the principal ingredients upon which the assessment, modeling, and forecasting of their distribution and impacts depend. This knowledge can be gained through accurate measurement of FRP, which has been shown to have a direct relationship with the rates of biomass consumption and emissions of major smoke constituents. Over the last decade or so, FRP has been routinely measured from space by both the MODIS sensors aboard the polar orbiting Terra and Aqua satellites, and the SEVIRI sensor aboard the Meteosat Second Generation (MSG) geostationary satellite. During the last few years, FRP has steadily gained increasing recognition as an important parameter for facilitating the development of various scientific studies and applications relating to the quantitative characterization of biomass burning and their emissions. To establish the scientific integrity of the FRP as a stable quantity that can be measured consistently across a variety of sensors and platforms, with the potential of being utilized to develop a unified long-term climate data record of fire activity and impacts, it needs to be thoroughly evaluated, calibrated, and validated. Therefore, we are conducting a detailed analysis of the FRP products from MODIS to evaluate the uncertainties associated with them, such as those due to the effects of satellite variable observation geometry and other factors, in order to establish their error budget for use in diverse scientific research and applications. In this presentation, we will show recent results of the MODIS FRP uncertainty analysis and error mitigation solutions, and demonstrate their implications for biomass burning emissions assessment.

Ichoku, Charles↗