Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data and model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS1988

Two-temperature interpretation of dissociation rate data for N2 and O2

The existing experimental data on dissociation of nitrogen and oxygen obtained using shock-tubes during the 1960's and 1970's are reinterpreted using the two-temperature thermo-chemical model developed recently in order to determine the rate coefficients consistent with the model. In this model, the vibrational-electronic temperature is calculated by integrating a separate conservation equation accounting for the suppression of vibrational energy during dissociation due to preferential removal of high vibrational states. The rate coefficient is assumed to be a function of the geometrically-averaged temperature between the translational-rotational temperature and the vibrational-electronic temperature. By comparing the computed overall and species densities with the experimental data, the rate coefficient values most consistent with the model, and their ranges of uncertainty, are deduced for dissociation of N2 through collisions with N2 or N, and for O2 through collisions with O2, O or N2. It is seen that a single set of such rate coefficients fit all existing experimental data closely. According to the two-temperature model, density and species density are insensitive to the rate coefficients, and so the rate coefficients so determined are uncertain to within a factor of at least 1.5.

Park, Chul↗
NASA NTRS1973

Preliminary lift and drag characteristics of the F-8 supercritical wing airplane

A flight research program is being conducted using a supercritical wing attached to a modified F-8 fuselage to demonstrate the potential benefits of the supercritical wing concept in a realistic cruise flight environment. One of the primary goals of the flight program is to determine the drag-divergence Mach number, that is, the Mach number at which the total vehicle drag increases significantly. Another objective of the program is to show how well wind-tunnel data can be used to predict the performance of a supercritical wing configuration in the transonic Mach number region from 0. 9 to 1. 0. Comparisons of this nature are important in view of the uncertainties in the present methods for extrapolating wind-tunnel-model data to flight Reynolds numbers, determining the effect of wall interference on the model results, and simulating the flow separation characteristics on the model wing to correspond to the large-scale wing. However, in comparing these wind-tunnel and flight results, it must be taken into account that this supercritical wing test configuration is of only intermediate scale und that a full-scale transport would have Reynolds numbers three to five times larger.

Jon S. Pyle↗
NASA NTRSDate not supplied

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗
NASA NTRS1992

Comparison of Echo 7 field line length measurements to magnetospheric model predictions

The Echo 7 sounding rocket experiment injected electron beams on central tail field lines near L = 6.5. Numerous injections returned to the payload as 'conjugate echoes' after mirroring in the southern hemisphere. Field line lengths calculated from measured conjugate echo bounce times and energies are compared to predictions made by integrating electron trajectories through various magnetospheric models. Although Kp at launch was 3-, quiet time magnetic models best fit the echo measurements. Geosynchronous satellite magnetometer measurements near the Echo 7 field lines during the flight were best modeled by the Olson-Pfitzer Dynamic Model and the Tsyganenko-Usmanov model for Kp = 3. The discrepancy between the models that best fit the Echo 7 data and those that fit the satellite data was most likely due to uncertainties in the small-scale configuration of the magnetospheric models. The field line length measured by the conjugate echoes showed some temporal variation in the magnetic field, also indicated by the satellite magnetometers. This demonstrates the utility an Echo-style experiment could have in substorm studies.

Nemzek, R. J.↗
NASA NTRS2020

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗
NASA NTRSDate not supplied

Ensemble Cancer Risk Model for Astronaut Risk Assessment

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

Lisa C Simonsen↗
NASA NTRS1973

Statistical error model for a solar electric propulsion thrust subsystem

The solar electric propulsion thrust subsystem statistical error model was developed as a tool for investigating the effects of thrust subsystem parameter uncertainties on navigation accuracy. The model is currently being used to evaluate the impact of electric engine parameter uncertainties on navigation system performance for a baseline mission to Encke's Comet in the 1980s. The data given represent the next generation in statistical error modeling for low-thrust applications. Principal improvements include the representation of thrust uncertainties and random process modeling in terms of random parametric variations in the thrust vector process for a multi-engine configuration.

Bantell, M. H.↗
NASA NTRS2011

Uncertainty Assessments of 2D and Axisymmetric Hypersonic Shock Wave - Turbulent Boundary Layer Interaction Simulations at Compression Corners

This paper is one of a series of five papers in a special session organized by the NASA Fundamental Aeronautics Program that addresses uncertainty assessments for CFD simulations in hypersonic flow. Simulations of a shock emanating from a compression corner and interacting with a fully developed turbulent boundary layer are evaluated herein. Mission relevant conditions at Mach 7 and Mach 14 are defined for a pre-compression ramp of a scramjet powered vehicle. Three compression angles are defined, the smallest to avoid separation losses and the largest to force a separated flow engaging more complicated flow physics. The Baldwin-Lomax and the Cebeci-Smith algebraic models, the one-equation Spalart-Allmaras model with the Catrix-Aupoix compressibility modification and two-equation models including Menter SST, Wilcox k-omega 98, and Wilcox k-omega 06 turbulence models are evaluated. Each model is fully defined herein to preclude any ambiguity regarding model implementation. Comparisons are made to existing experimental data and Van Driest theory to provide preliminary assessment of model form uncertainty. A set of coarse grained uncertainty metrics are defined to capture essential differences among turbulence models. Except for the inability of algebraic models to converge for some separated flows there is no clearly superior model as judged by these metrics. A preliminary metric for the numerical component of uncertainty in shock-turbulent-boundary-layer interactions at compression corners sufficiently steep to cause separation is defined as 55%. This value is a median of differences with experimental data averaged for peak pressure and heating and for extent of separation captured in new, grid-converged solutions presented here. This value is consistent with existing results in a literature review of hypersonic shock-turbulent-boundary-layer interactions by Roy and Blottner and with more recent computations of MacLean.

Gnoffo, Peter A.↗
NASA NTRS1991

Methods for evaluating the predictive accuracy of structural dynamic models

Modeling uncertainty is defined in terms of the difference between predicted and measured eigenvalues and eigenvectors. Data compiled from 22 sets of analysis/test results was used to create statistical databases for large truss-type space structures and both pretest and posttest models of conventional satellite-type space structures. Modeling uncertainty is propagated through the model to produce intervals of uncertainty on frequency response functions, both amplitude and phase. This methodology was used successfully to evaluate the predictive accuracy of several structures, including the NASA CSI Evolutionary Structure tested at Langley Research Center. Test measurements for this structure were within + one-sigma intervals of predicted accuracy for the most part, demonstrating the validity of the methodology and computer code.

Hasselman, Timothy K.↗
NASA NTRS2016

Spatial and Temporal Uncertainty of Crop Yield Aggregations

The aggregation of simulated gridded crop yields to national or regional scale requires information on temporal and spatial patterns of crop-specific harvested areas. This analysis estimates the uncertainty of simulated gridded yield time series related to the aggregation with four different harvested area data sets. We compare aggregated yield time series from the Global Gridded Crop Model Inter-comparison project for four crop types from 14 models at global, national, and regional scale to determine aggregation-driven differences in mean yields and temporal patterns as measures of uncertainty. The quantity and spatial patterns of harvested areas differ for individual crops among the four datasets applied for the aggregation. Also simulated spatial yield patterns differ among the 14 models. These differences in harvested areas and simulated yield patterns lead to differences in aggregated productivity estimates, both in mean yield and in the temporal dynamics. Among the four investigated crops, wheat yield (17% relative difference) is most affected by the uncertainty introduced by the aggregation at the global scale. The correlation of temporal patterns of global aggregated yield time series can be as low as for soybean (r = 0.28).For the majority of countries, mean relative differences of nationally aggregated yields account for10% or less. The spatial and temporal difference can be substantial higher for individual countries. Of the top-10 crop producers, aggregated national multi-annual mean relative difference of yields can be up to 67% (maize, South Africa), 43% (wheat, Pakistan), 51% (rice, Japan), and 427% (soybean, Bolivia).Correlations of differently aggregated yield time series can be as low as r = 0.56 (maize, India), r = 0.05∗Corresponding (wheat, Russia), r = 0.13 (rice, Vietnam), and r = −0.01 (soybean, Uruguay). The aggregation to sub-national scale in comparison to country scale shows that spatial uncertainties can cancel out in countries with large harvested areas per crop type. We conclude that the aggregation uncertainty can be substantial for crop productivity and production estimations in the context of food security, impact assessment, and model evaluation exercises.

Aggregation uncertainty↗
NASA NTRS2010

Development of a Climate-Data Record (CDR) of the Surface Temperature of the Greenland Ice Sheet

Regional "clear sky" surface temperature increases since the early 1980s in the Arctic, measured using Advanced Very High Resolution Radiometer (AVHRR) infrared data, range from 0.57+/-0.02 deg C to 72+/-0.10 deg C per decade. Arctic warming has important implications for ice-sheet mass balance because much of the periphery of the Greenland Ice Sheet is already near 0 deg C during the melt season, and is thus vulnerable to rapid melting if temperatures continue to increase. An increase in melting of the ice sheet would accelerate sea-level rise, an issue affecting potentially billions of people worldwide. To quantify the ice-surface temperature (IST) of the Greenland Ice Sheet, and to provide an IST dataset of Greenland for modelers that provides uncertainties, we are developing a climate-data record (CDR) of daily "clear-sky" IST of the Greenland Ice Sheet, from 1982 to the present using AVHRR (1982 - present) and Moderate-Resolution Imaging Spectroradiometer (MODIS) data (2000 - present) at a resolution of approximately 5 km. Known issues being addressed in the production of the CDR are: time-series bias caused by cloud cover (surface temperatures can be different under clouds vs. clear areas) and cross-calibration in the overlap period between AVHRR instruments, and between AVHRR and MODIS instruments. Because of uncertainties, mainly due to clouds, time-series of satellite IST do not necessarily correspond with actual surface temperatures. The CDR will be validated by comparing results with automatic-weather station data and with satellite-derived surface-temperature products and biases will be calculated.

Hall, Dorthy K.↗
NASA NTRS1988

Current models of the intensely ionizing particle environment in space

The Cosmic Ray Effects on MicroElectronics (CREME) model that is currently in use to estimate single event effect rates in spacecraft is described. The CREME model provides a description of the radiation environment in interplanetary space near the orbit of the earth that contains no major deficiencies. The accuracy of the galactic cosmic ray model is limited by the uncertainties in solar modulation. The model for solar energetic particles could be improved by making use of all the data that has been collected on solar energetic particle events. There remain major uncertainties about the environment within the earth's magnetosphere, because of the uncertainties over the charge states of the heavy ions in the anomalous component and solar flares, and because of trapped heavy ions. The present CREME model is valid only at 1 AU, but it could be extended to other parts of the heliosphere. There is considerable data on the radiation environment from 0.2 to 35 AU in the ecliptic plane. This data could be used to extend the CREME model.

Adams, James H., Jr.↗
NASA NTRS1987

An intercomparison of nitrogen-containing species in Nimbus 7 LIMS and SAMS data

Odd-nitrogen chemistry and transport are analyzed using a two-dimensional model and Nimbus 7 data. The Nimbus 7 data include: measurements of O3, NO2, HNO3, H2O, and temperature by the LIMS instrument; N2O, CH4, and temperature measurements by the SAMS instrument; and O3 data from the SBUV instrument. The characteristics of the two-dimensional model used in the study, a modified Guthrie et al. (1984) model, are described. NO2 and HNO3 are calculated using the two-dimensional model, and the computed data are compared with the LIMS NO2 and HNO3 measurements. The model uncertainties are computed based on the photochemical equilibrium assumption, and the role of stratospheric dynamics in determining NO2 and HNO3 is discussed. It is observed that there is good correlation between the LIMS and model data in the upper stratosphere; however, the data do not correspond in the lower stratosphere. The effect of nitrogen sources, such as lightning, on the stratospheric odd nitrogen distribution is examined.

Jackman, Charles H.↗
NASA NTRS1993

Quantification of model error via an interval model with nonparametric error bound

The quantification of model uncertainty is becoming increasingly important as robust control is an important tool for control system design and analysis. This paper presents an algorithm that effectively characterizes the model uncertainty in terms of parametric and nonparametric uncertainties. The algorithm utilizes the frequency domain model error which is estimated from the spectra of output error and input data. The parametric uncertainty is represented as an interval transfer function while the nonparametric uncertainty is bounded by a designed error bound transfer function. Both discrete and continuous systems are discussed in this paper. The algorithm is applied to the Mini-Mast example, and the detail analysis is given.

Lew, Jiann-Shiun↗
NASA NTRS2003

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗
NASA NTRS1978

The thermal structure of Saturn: Inferences from ground-based and airborne infrared observations

Spectroscopic and photometric infrared observations of Saturn are reviewed and compared to the expected flux from thermal structure models. Large uncertainties exist in the far-infrared measurements, but the available data indicate that the effective temperature of the disk of Saturn is 90 + or - 5 K. The thermal structure models proposed by Tokunaga and Cess and by Gautier et al. (model 'N') agree best with the observations. North-South limb scans of Saturn at 10 and 20 micrometers show that the temperature inversion is much stronger at the South polar region than at the equator.

Tokunaga, A.↗
NASA NTRS2013

The Ocean Colour Climate Change Initiative: III. A Round-Robin Comparison on In-Water Bio-Optical Algorithms

Satellite-derived remote-sensing reflectance (Rrs) can be used for mapping biogeochemically relevant variables, such as the chlorophyll concentration and the Inherent Optical Properties (IOPs) of the water, at global scale for use in climate-change studies. Prior to generating such products, suitable algorithms have to be selected that are appropriate for the purpose. Algorithm selection needs to account for both qualitative and quantitative requirements. In this paper we develop an objective methodology designed to rank the quantitative performance of a suite of bio-optical models. The objective classification is applied using the NASA bio-Optical Marine Algorithm Dataset (NOMAD). Using in situ Rrs as input to the models, the performance of eleven semianalytical models, as well as five empirical chlorophyll algorithms and an empirical diffuse attenuation coefficient algorithm, is ranked for spectrally-resolved IOPs, chlorophyll concentration and the diffuse attenuation coefficient at 489 nm. The sensitivity of the objective classification and the uncertainty in the ranking are tested using a Monte-Carlo approach (bootstrapping). Results indicate that the performance of the semi-analytical models varies depending on the product and wavelength of interest. For chlorophyll retrieval, empirical algorithms perform better than semi-analytical models, in general. The performance of these empirical models reflects either their immunity to scale errors or instrument noise in Rrs data, or simply that the data used for model parameterisation were not independent of NOMAD. Nonetheless, uncertainty in the classification suggests that the performance of some semi-analytical algorithms at retrieving chlorophyll is comparable with the empirical algorithms. For phytoplankton absorption at 443 nm, some semi-analytical models also perform with similar accuracy to an empirical model. We discuss the potential biases, limitations and uncertainty in the approach, as well as additional qualitative considerations for algorithm selection for climate-change studies. Our classification has the potential to be routinely implemented, such that the performance of emerging algorithms can be compared with existing algorithms as they become available. In the long-term, such an approach will further aid algorithm development for ocean-colour studies.

Phytoplankton↗
NASA NTRS2018

Reliability Analysis in the Presence of Aleatory Uncertainty

This paper proposes a method for modeling a system’s response using data. In contrast to approaches that identify a limit state function, we focus on the case in which not all uncertain parameters affecting the response are observable and the measured response is corrupted by noise. To this end, the system response is not characterized by a limit state function but instead by a Random Predictor Model (RPM) having a nonparametric structure. Consequently, the resulting failure probability is not a scalar but a random variable. This variable accounts for the aleatory contributions of the model-form uncertainty and the measurement noise into the response. Furthermore, we propose a framework that enables trading off the predicted range of failure probabilities resulting from such an analysis with a measure of risk. In this context, risk is the percentage of all predicted outcomes the analyst is willing to ignore. The reliability analysis of an aeroelastic structure subject to flutter is used to illustrate the ideas proposed.

Crespo, L. G.↗