Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data and model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

In-flight thrust determination on a real-time basis

A real time computer program was implemented on a F-15 jet fighter to monitor in-flight engine performance of a Digital Electronic Engine Controlled (DEES) F-100 engine. The application of two gas generator methods to calculate in-flight thrust real time is described. A comparison was made between the actual results and those predicted by an engine model simulation. The percent difference between the two methods was compared to the predicted uncertainty based on instrumentation and model uncertainty and agreed closely with the results found during altitude facility testing. Data was obtained from acceleration runs of various altitudes at maximum power settings with and without afterburner. Real time in-flight thrust measurement was a major advancement to flight test productivity and was accomplished with no loss in accuracy over previous post flight methods.

Ray, R. J.↗

Synthesis of Contributed Simulations for OREX Test Cases

A synthesis is presented of the computer simulations of the flow over the Orbital Reentry Vehicle (ORV) at the 92.8 km and 63.6 km Earth altitude trajectory points that were discussed at the First Europe-U.S. High Speed Flow Field Database Workshop Part 2, Napoli, Italy, November 1997. For the materials used on the surface of ORV, the non-catalytic wall condition is appropriate at 92.8 km and the finite-rate catalytic wall condition at 63.6 km. Additional simulations are required for establishing the independency of the discussed results from numerics. The proper modeling of natural phenomena needs further sensitivity studies. The uncertainties of inferred flight data are lacking for a proper evaluation of the presented results.

Mehta, Unmeel B.↗

Five-Hole Flow Angle Probe Calibration for the NASA Glenn Icing Research Tunnel

A spring 1997 test section calibration program is scheduled for the NASA Glenn Research Center Icing Research Tunnel following the installation of new water injecting spray bars. A set of new five-hole flow angle pressure probes was fabricated to properly calibrate the test section for total pressure, static pressure, and flow angle. The probes have nine pressure ports: five total pressure ports on a hemispherical head and four static pressure ports located 14.7 diameters downstream of the head. The probes were calibrated in the NASA Glenn 3.5-in.-diameter free-jet calibration facility. After completing calibration data acquisition for two probes, two data prediction models were evaluated. Prediction errors from a linear discrete model proved to be no worse than those from a full third-order multiple regression model. The linear discrete model only required calibration data acquisition according to an abridged test matrix, thus saving considerable time and financial resources over the multiple regression model that required calibration data acquisition according to a more extensive test matrix. Uncertainties in calibration coefficients and predicted values of flow angle, total pressure, static pressure. Mach number. and velocity were examined. These uncertainties consider the instrumentation that will be available in the Icing Research Tunnel for future test section calibration testing.

Gonsalez, Jose C.↗

The Wardle Instability in Interstellar Shocks: Gas Temperture and Line Emission - 2

We have modeled the gas temperature structure in unstable C-type shocks and obtained predictions for the resultant CO and H2 rotational line emissions, using numerical simulations of the Wardle instability. Our model for the thermal balance of the gas includes ion-neutral frictional heating; compressional heating; radiative cooling due to rotational and ro-vibrational transitions of the molecules CO, H2O, and H2; and gas-grain collisional cooling. We obtained results for the gas temperature distribution in-and H2 and CO line emission from-shocks of neutral Alfvenic Mach number 10 and velocity 20 or 40 km/ s in which the Wardle instability has saturated. Both two- and three-dimensional simulations were carried out for shocks in which the preshock magnetic field is perpendicular to the shock propagation direction, and a two-dimensional simulation was carried out for the case in which the magnetic field is obliquely oriented with respect to the shock propagation direction. Although the Wardle instability profoundly affects the density structure behind C-type shocks, most of the shock-excited molecular line emission is generated upstream of the region where the strongest effects of the instability are felt. Thus the Wardle instability has a relatively small effect on the overall gas temperature distribution in-and the emission-line spectrum from-C-type shocks, at least for the cases that we have considered. In none of the cases that we have considered thus far did any of the predicted emission-line luminosities change by more than a factor of 2.5, and in most cases the effects of instability were significantly smaller than that. Slightly larger changes in the line luminosities seem likely for three-dimensional simulations of oblique shocks, although such simulations have yet to be carried out and lie beyond the scope of this study. Given the typical uncertainties that are always present when model predictions are compared with real astronomical data, we conclude that Wardle instability does not imprint any clear observational signature on the shock-excited CO and H2 line strengths. This result justifies the use of one-dimensional steady shock models in the interpretation of observations of shock-excited line emission in regions of star formation. Our three-dimensional simulations of perpendicular shocks revealed the presence of warm filamentary structures that are aligned along the magnetic field, a result that is of possible relevance to models of water maser emission from C-type shocks.

Neufeld, David A.↗

Space Radiation Cancer Risks and Uncertainties for Mars Missions

Projecting cancer risks from exposure to space radiation is highly uncertain because of the absence of data for humans and because of the limited radiobiology data available for estimating late effects from the high-energy and charge (HZE) ions present in the galactic cosmic rays (GCR). Cancer risk projections involve many biological and physical factors, each of which has a differential range of uncertainty due to the lack of data and knowledge. We discuss an uncertainty assessment within the linear-additivity model using the approach of Monte Carlo sampling from subjective error distributions that represent the lack of knowledge in each factor to quantify the overall uncertainty in risk projections. Calculations are performed using the space radiation environment and transport codes for several Mars mission scenarios. This approach leads to estimates of the uncertainties in cancer risk projections of 400-600% for a Mars mission. The uncertainties in the quality factors are dominant. Using safety standards developed for low-Earth orbit, long-term space missions (>90 days) outside the Earth's magnetic field are currently unacceptable if the confidence levels in risk projections are considered. Because GCR exposures involve multiple particle or delta-ray tracks per cellular array, our results suggest that the shape of the dose response at low dose rates may be an additional uncertainty for estimating space radiation risks.

NASA Discipline Radiation Health↗

Large-Scale Features of Pliocene Climate: Results from the Pliocene Model Intercomparison Project

Climate and environments of the mid-Pliocene warm period (3.264 to 3.025 Ma) have been extensively studied.Whilst numerical models have shed light on the nature of climate at the time, uncertainties in their predictions have not been systematically examined. The Pliocene Model Intercomparison Project quantifies uncertainties in model outputs through a coordinated multi-model and multi-mode data intercomparison. Whilst commonalities in model outputs for the Pliocene are clearly evident, we show substantial variation in the sensitivity of models to the implementation of Pliocene boundary conditions. Models appear able to reproduce many regional changes in temperature reconstructed from geological proxies. However, data model comparison highlights that models potentially underestimate polar amplification. To assert this conclusion with greater confidence, limitations in the time-averaged proxy data currently available must be addressed. Furthermore, sensitivity tests exploring the known unknowns in modelling Pliocene climate specifically relevant to the high latitudes are essential (e.g. palaeogeography, gateways, orbital forcing and trace gasses). Estimates of longer-term sensitivity to CO2 (also known as Earth System Sensitivity; ESS), support previous work suggesting that ESS is greater than Climate Sensitivity (CS), and suggest that the ratio of ESS to CS is between 1 and 2, with a "best" estimate of 1.5.

mathematical models↗

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

Error Sources and Mitigation Strategies for Thermocouples Integrated in Flexible Thermal Protection System Materials

• The flexible thermal protection system (FTPS) on NASA’s Low-Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) vehicle will be instrumented with thermocouples (TCs) to measure the in-depth thermal response during entry into Earth’s atmosphere. Accurate flight temperature measurements are critical for verifying vehicle performance and reducing thermal model uncertainties. • The TC leads are routed from the measurement location to the data acquisition system within the same FTPS layer that they are monitoring the temperature. This approach eliminates the need to put holes in the FTPS layers. However, the insulated TC leads are exposed to high temperatures and large thermal gradients. • The baseline TCs were commercially available 30 AWG Type K TCs with a binder impregnated glass braid insulation. The glass braid is rated to a maximum continuous use temperature of 482°C. LOFTID’s heat pulse will be on the order of minutes and the maximum predicted temperature beneath the outermost FTPS layers is 1350°C.

R. A. Miller↗

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗

Dose Error Impacts on A Collection of Realistic Dose-Response Curves Based on A NASA Sonic Boom Community Noise Survey

The National Aeronautics and Space Administration (NASA) plans to conduct surveys of community response to quiet supersonic flight to collect dose-response data for international regulators. Previous models of noise dose versus annoyance response ignored uncertainty in the noise dose experienced by survey respondents. This dose error causes attenuation bias and results in inaccurate dose-response relationships. The impacts of dose errors can be explored by introducing error into the dose estimates of a simulated community noise survey. The simulated population annoyance response is determined by specific noise response characteristics, including the onset of annoyance intercept, rate of increasing annoyance, participant intercept variability, and response rates. This paper explores the effects of dose errors on notional populations created by perturbing the noise response characteristics observed in participants in a recent NASA flight test, QSF18. The QSF18-based population parameters were shifted up to ±20% to create the study populations. For the anticipated dose range of the X-59, changes to the onset of annoyance intercept have the greatest impact on erroneous model results. Quantifying point estimate errors illustrates the impact of dose error, with errors up to 14 dB observed for a fixed high annoyance percentage.

dose-response modeling↗

Dose Error Impacts on A Collection of Realistic Dose-Response Curves Based on A NASA Sonic Boom Community Noise Survey

The National Aeronautics and Space Administration (NASA) plans to conduct surveys of community response to quiet supersonic flight to collect dose-response data for international regulators. Previous models of noise dose versus annoyance response ignored uncertainty in the noise dose experienced by survey respondents. This dose error causes attenuation bias and results in inaccurate dose-response relationships. The impacts of dose errors can be explored by introducing error into the dose estimates of a simulated community noise survey. The simulated population annoyance response is determined by specific noise response characteristics, including the onset of annoyance intercept, rate of increasing annoyance, participant intercept variability, and response rates. This paper explores the effects of dose errors on notional populations created by perturbing the noise response characteristics observed in participants in a recent NASA flight test, QSF18. The QSF18-based population parameters were shifted up to ±20% to create the study populations. For the anticipated dose range of the X-59, changes to the onset of annoyance intercept have the greatest impact on erroneous model results. Quantifying point estimate errors illustrates the impact of dose error, with errors up to 14 dB observed for a fixed high annoyance percentage.

dose-response modeling↗

Challenges in Qualification of Thermal Protection Systems in Extreme Entry Environments

Planetary entry vehicles employ ablative TPS materials to shield the aeroshell from entry aeroheating environments. To ensure mission success, it must be demonstrated that the heat shield system, including local features such as seams, does not fail at conditions that are suitably margined beyond those expected in flight. Furthermore, its thermal response must be predictable, with acceptable fidelity, by computational tools used in heat shield design. Mission assurance is accomplished through a combination of ground testing and material response modelling. A material's robustness to failure is verified through arcjet testing while its thermal response is predicted by analytical tools that are verified against experimental data. Due to limitations in flight-like ground testing capability and lack of validated high-fidelity computational models, qualification of heat shield materials is often achieved by piecing together evidence from multiple ground tests and analytical simulations, none of which fully bound the flight conditions and vehicle configuration. Extreme heating environments (>2000 W/sq. cm heat flux and >2 atm pressure), experienced during entries at Venus, Saturn and Ice Giants, further stretch the current testing and modelling capabilities for applicable TPS materials. Fully-dense Carbon Phenolic was the material of choice for these applications; however, since heritage raw materials are no longer available, future uses of re-created Carbon Phenolic will require re-qualification. To address this sustainability challenge, NASA is developing a new dual-layer material based on 3D weaving technology called Heat shield for Extreme Entry Environments (HEEET). Regardless of TPS material, extreme environments pose additional certification challenges beyond what has been typical in recent NASA missions. Scope of this presentation: This presentation will give an overview of challenges faced in verifying TPS performance at extreme heating conditions. Examples include: (1) Bounding aeroheating parameters (heat flux, pressure, shear and enthalpy) in ground facilities. How to certify TPS if environments can't be bounded or aeroheating parameters can't be simultaneously achieved. (2) Higher uncertainties in ground test environments (facility calibration and analytical predictions) at extreme conditions. (3) Testing in flows similar to planetary atmosphere composition (H2/He for Gas and Ice Giants). (4) Test sample size limitations for qualifying seam designs. (5) Lack of computational tools capable of simulating all significant aspects of TPS performance (including initiation and propagation of failures). This presentation will provide recommendations on how the EDL community can address these challenges and mitigate some of the risks involved in flying TPS materials at extreme conditions. Examples include: (1) Dedicated activity to understanding TPS failure modes. Develop computational tools capable of modelling fluid interaction with material's thermostructural response. Validate these tools through failure testing. A better understanding of failure mechanisms may eliminate the need to fully bound all aeroheating parameters in ground testing. (2) Enhancements to current testing facilities to simulate flight-like ablation mechanism (ex. testing in Nitrogen at Ames Interaction Heating Facility to limit oxidation in favor of more sublimation). (3) Improved characterization of test conditions with new diagnostic methods and determination of environment uncertainty through rigorous statistical analysis of available data. (4) Design margin policies that are directly tied to uncertainties in ground test environments and modelling fidelity

Mahzari, Milad↗

Model Evaluation of Methods for Estimating Surface Emissions and Chemical Lifetimes from Satellite Data

Column densities from satellite retrievals can provide valuable information for estimating emissions and chemical lifetimes objectively across the globe. To better understand the uncertainties associated with these estimates, we test four methods using simulated column densities from a point source: a box model approach, a 2D Gaussian fit, an Inverse Radius fit and an Exponentially-Modified Gaussian fit. The model results were simulated using the WRF and CAMx models for the year 2005, for a single point source outside Atlanta in Georgia, USA with specified emissions and three chemical scenarios: no chemical reactions, 12 h chemical lifetime and 1 h chemical lifetime. No other sources were included in the simulations. We find that the box model provides reliable estimates irrespective of plume speed and plume direction, if the plume speed and the chemical lifetime are known accurately. The 2D Gaussian fit was found to be sensitive to plume speed and direction, and requires omnidirectional dispersion in order to have a decent fit. However, the 2D Gaussian fit is only an approximate fit to the data, and the discrepancies mean that the results are dependent on the geographical domain used for the optimization. An Inverse Radius fit is introduced to correct this issue, which is found to provide improved emissions and lifetime estimates. The Exponentially-Modified Gaussian fit also gave improved estimates. It is however dependent on accurate plume rotation such that reported chemical lifetimes with this method could be significantly underestimated.

Emission inventory↗

Automated Probabilistic Finite Element Model Calibration Tool Based on Uncertainty Quantification and Machine Learning

Qualification and certification of safety critical parts is a hurdle to the adoption of metallic additively manufactured components for aerospace vehicle applications. Challenges include variability in part properties due to inconsistent defect distribution and microstructure. Understanding of the process through finite element modeling (FEM), and process control through in-situ monitoring, may result in significant improvements; however, solutions useful to manufacturers will require large volumes of data and automated data utilization. Toward this end, a generalizable automated FEM calibration paradigm is developed. This paradigm leverages existing and novel tools from machine learning and uncertainty quantification to enable the automatic calibration of FEMs without requiring prior knowledge of the model performance across input parameter space, including meshing and solver settings, which can require time consuming manual model probing or cause noisy and inconsistent predictions. The result is a probabilistic distribution of calibrated and validated FEM input parameters targeting measured data.

Additive manufacturing model calibration finite el↗

Five-Year Wilkinson Microwave Anisotropy Probe (WMAP1) Observations: Galactic Foreground Emission

We present a new estimate of foreground emission in the WMAP data, using a Markov chain Monte Carlo (MCMC) method. The new technique delivers maps of each foreground component for a variety of foreground models, error estimates of the uncertainty of each foreground component, and provides an overall goodness-of-fit measurement. The resulting foreground maps are in broad agreement with those from previous techniques used both within the collaboration and by other authors. We find that for WMAP data, a simple model with power-law synchrotron, free-free, and thermal dust components fits 90% of the sky with a reduced X(sup 2) (sub v) of 1.14. However, the model does not work well inside the Galactic plane. The addition of either synchrotron steepening or a modified spinning dust model improves the fit. This component may account for up to 14% of the total flux at Ka-band (33 GHz). We find no evidence for foreground contamination of the CMB temperature map in the 85% of the sky used for cosmological analysis.

Gold, B.↗

Numerical modelling of instantaneous plate tectonics

Assuming lithospheric plates to be rigid, 68 spreading rates, 62 fracture zones trends, and 106 earthquake slip vectors are systematically inverted to obtain a self-consistent model of instantaneous relative motions for eleven major plates. The inverse problem is linearized and solved iteratively by a maximum-likelihood procedure. Because the uncertainties in the data are small, Gaussian statistics are shown to be adequate. The use of a linear theory permits (1) the calculation of the uncertainties in the various angular velocity vectors caused by uncertainties in the data, and (2) quantitative examination of the distribution of information within the data set. The existence of a self-consistent model satisfying all the data is strong justification of the rigid plate assumption. Slow movement between North and South America is shown to be resolvable.

Minster, J. B.↗

A Probabilistic Approach to Model Update

Finite element models are often developed for load validation, structural certification, response predictions, and to study alternate design concepts. In rare occasions, models developed with a nominal set of parameters agree with experimental data without the need to update parameter values. Today, model updating is generally heuristic and often performed by a skilled analyst with in-depth understanding of the model assumptions. Parameter uncertainties play a key role in understanding the model update problem and therefore probabilistic analysis tools, developed for reliability and risk analysis, may be used to incorporate uncertainty in the analysis. In this work, probability analysis (PA) tools are used to aid the parameter update task using experimental data and some basic knowledge of potential error sources. Discussed here is the first application of PA tools to update parameters of a finite element model for a composite wing structure. Static deflection data at six locations are used to update five parameters. It is shown that while prediction of individual response values may not be matched identically, the system response is significantly improved with moderate changes in parameter values.

Horta, Lucas G.↗

Tensor-to-scalar ratio forecasts for extended LiteBIRD frequency configurations

LiteBIRD is a planned JAXA-led cosmic microwave background (CMB) B -mode satellite experiment aiming for launch in the late 2020s, with a primary goal of detecting the imprint of primordial inflationary gravitational waves. Its current baseline focal-plane configuration includes 15 frequency bands between 40 and 402 GHz, fulfilling the mission requirements to detect the amplitude of gravitational waves with the total uncertainty on the tensor-to-scalar ratio, δr , down to δr < 0.001. A key aspect of this performance is accurate astrophysical component separation, and the ability to remove polarized thermal dust emission is particularly important. In this paper we note that the CMB frequency spectrum falls off nearly exponentially above 300 GHz relative to the thermal dust spectral energy distribution, and a relatively minor high frequency extension can therefore result in even lower uncertainties and better model reconstructions. Specifically, we compared the baseline design with five extended configurations, while varying the underlying dust modeling, in each of which the High-Frequency Telescope (HFT) frequency range was shifted logarithmically toward higher frequencies, with an upper cutoff ranging between 400 and 600 GHz. In each case, we measured the tensor-to-scalar ratio r uncertainty and bias using both parametric and minimum-variance component-separation algorithms. When the thermal dust sky model includes a spatially varying spectral index and temperature, we find that the statistical uncertainty on r after foreground cleaning may be reduced by as much as 30–50% by extending the upper limit of the frequency range from 400 to 600 GHz, with most of the improvement already gained at 500 GHz. We also note that a broader frequency range leads to higher residuals when fitting an incorrect dust model, but also it is easier to discriminate between models through higher χ 2 sensitivity. Even in the case in which the fitting procedure does not correspond to the underlying dust model in the sky, and when the highest frequency data cannot be modeled with sufficient fidelity and must be excluded from the analysis, the uncertainty on r increases by only about 5% for a 500 GHz configuration compared to the baseline.

U. Fuskeland↗