Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data and model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗

Atmospheric Composition Change: Climate-Chemistry Interactions

Chemically active climate compounds are either primary compounds such as methane (CH4), removed by oxidation in the atmosphere, or secondary compounds such as ozone (O3), sulfate and organic aerosols, formed and removed in the atmosphere. Man-induced climate-chemistry interaction is a two-way process: Emissions of pollutants change the atmospheric composition contributing to climate change through the aforementioned climate components, and climate change, through changes in temperature, dynamics, the hydrological cycle, atmospheric stability, and biosphere-atmosphere interactions, affects the atmospheric composition and oxidation processes in the troposphere. Here we present progress in our understanding of processes of importance for climate-chemistry interactions, and their contributions to changes in atmospheric composition and climate forcing. A key factor is the oxidation potential involving compounds such as O3 and the hydroxyl radical (OH). Reported studies represent both current and future changes. Reported results include new estimates of radiative forcing based on extensive model studies of chemically active climate compounds such as O3, and of particles inducing both direct and indirect effects. Through EU projects such as ACCENT, QUANTIFY, and the AEROCOM project, extensive studies on regional and sector-wise differences in the impact on atmospheric distribution are performed. Studies have shown that land-based emissions have a different effect on climate than ship and aircraft emissions, and different measures are needed to reduce the climate impact. Several areas where climate change can affect the tropospheric oxidation process and the chemical composition are identified. This can take place through enhanced stratospheric-tropospheric exchange of ozone, more frequent periods with stable conditions favouring pollution build up over industrial areas, enhanced temperature-induced biogenic emissions, methane releases from permafrost thawing, and enhanced concentration through reduced biospheric uptake. During the last 510 years, new observational data have been made available and used for model validation and the study of atmospheric processes. Although there are significant uncertainties in the modelling of composition changes, access to new observational data has improved modelling capability. Emission scenarios for the coming decades have a large uncertainty range, in particular with respect to regional trends, leading to a significant uncertainty range in estimated regional composition changes and climate impact.

Atmosphere climate chemistry↗

Sources of Uncertainty in the Prediction of LAI / fPAR from MODIS

To explicate the sources of uncertainty in the prediction of biophysical variables over space, consider the general equation: where z is a variable with values on some nominal, ordinal, interval or ratio scale; y is a vector of input variables; u is the spatial support of y and z ; x and u are the spatial locations of y and z , respectively; f is a model and B is the vector of the parameters of this model. Any y or z has a value and a spatial extent which is called its support. Viewed in this way, categories of uncertainty are from variable (e.g. measurement), parameter, positional. support and model (e.g. structural) sources. The prediction of Leaf Area Index (LAI) and the fraction of absorbed photosynthetically active radiation (fPAR) are examples of z variables predicted using model(s) as a function of y variables and spatially constant parameters. The MOD15 algorithm is an example of f, called f(sub 1), with parameters including those defined by one of six biome types and solar and view angles. The Leaf Canopy Model (LCM)2, a nested model that combines leaf radiative transfer with a full canopy reflectance model through the phase function, is a simpler though similar radiative transfer approach to f(sub 1). In a previous study, MOD15 and LCM2 gave similar results for the broadleaf forest biome. Differences between these two models can be used to consider the structural uncertainty in prediction results. In an effort to quantify each of the five sources of uncertainty and rank their relative importance for the LAI/fPAR prediction problem, we used recent data for an EOS Core Validation Site in the broadleaf biome with coincident surface reflectance, vegetation index, fPAR and LAI products from the Moderate Resolution Imaging Spectrometer (MODIS). Uncertainty due to support on the input reflectance variable was characterized using Landsat ETM+ data. Input uncertainties were propagated through the LCM2 model and compared with published uncertainties from the MOD15 algorithm.

Dungan, Jennifer L.↗

Simulation and Application of Bayesian Dose Uncertainty Modeling for Low-Boom Community Noise Surveys

In dose-response modeling, failing to account for dose uncertainty can cause artificial flattening of the estimated slope of the dose-response curve. Previous analyses of NASA sonic boom community noise survey data utilized a Bayesian multilevel logistic regression model, which did not account for dose uncertainty. The current work extends the model to account for either classical or Berkson dose uncertainty. The extended model is applied to two simulated dose-response datasets to illustrate conditions under which the dose uncertainty term does and does not correct for the artificial flattening introduced by dose uncertainty. Finally, the extended model is applied to two previous NASA sonic boom community noise surveys. The resulting dose-response curve slope for the average participant is 5 to 10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). The difference remains insignificant when producing population summary dose-response curves. Commentary is included on applicability to future X-59 low-boom community noise survey data modeling and analysis.

X-59↗

A GSFC alternative to the SLR MERIT constants

The use of the Lageos satellite to monitor the earth's orientation is examined. The derivations of long wavelength ocean tidal parameters, a geocentric gravitational constant of 398,600.436 cu km/ sq sec + or - 0.0001 cu km/sq sec, and Love numbers using Lageos laser ranging data are described. The uncertainties of the geopotential model, GEM-L2 of Lerch et al. (1982), are discussed. The calculation of polar motion using the Lageos constants is considered. The Lageos constants are tested by applying them to independent laser ranging data. It is determined that the new constants improve the rms of fit to independent Lageos data and improve the earth orientation parameters compared to VLBI data obtained during the IRIS project.

Christodoulidis, Demosthenes C.↗

Uncertainty-Based Approach for Dynamic Aerodynamic Data Acquisition and Analysis

Development of improved modeling methods to provide increased fidelity of flight predictions for aircraft motions during flight in flow regimes with large nonlinearities requires improvements in test techniques for measuring and characterizing wind tunnel data. This paper presents a method for providing a measure of data integrity for static and forced oscillation test techniques. Data integrity is particularly important when attempting to accurately model and predict flight of today s high performance aircraft which are operating in expanded flight envelopes, often maneuvering at high angular rates at high angles-of-attack, even above maximum lift. Current aerodynamic models are inadequate in predicting flight characteristics in the expanded envelope, such as rapid aircraft departures and other unusual motions. Present wind tunnel test methods do not factor changes of flow physics into data acquisition schemes, so in many cases data are obtained over more iterations than required, or insufficient data may be obtained to determine a valid estimate with statistical significance. Additionally, forced oscillation test techniques, one of the primary tools used to develop dynamic models, do not currently provide estimates of the uncertainty of the results during an oscillation cycle. A method to optimize the required number of forced oscillation cycles based on decay of uncertainty gradients and balance tolerances is also presented.

Heim, Eugene H. D.↗

Updated global and regional trends of stratospheric ozone profiles

We present updated evaluation of stratospheric ozone profile trends in the 60° S–60°N latitude range using long-term ground-based and satellite climate data records, as well as simulations by chemistry-climate models. The trends are evaluated using the LOTUS (Long-term Ozone Trends and Uncertainties in the Stratosphere) regression model. Analyses of satellite data confirm the statistically significant positive ozone trends in the period 2000–2024 in the upper stratosphere of ~1–3% per decade, with larger trends at mid-latitudes compared to the tropics. The trends are slightly positive or close to zero in the middle stratosphere, and mostly negative, -1 to -2% per decade, in the lower stratosphere, but they are not statistically significant. The morphology and magnitude of ozone trends are similar to previous analyses (2000–2020 trends). Ozone trends in 2000–2024 predicted by chemistry-climate model simulations are in good agreement with combined satellite trends. In the upper stratosphere, models predict a slightly stronger ozone recovery than observations. In the lower stratosphere, both models and satellite observations report negative trends in the tropics, while modelled ozone trends are slightly positive at mid-latitudes. Ozone profile trends over several stations estimated from ground-based records capture the same overall vertical pattern of ozone trends as merged gridded satellite datasets. Analyses of regional ozone profile trends in 2003–2024 using merged satellite datasets confirmed the previous observations of a longitudinal structure in ozone trends in the NH mid-latitude stratosphere, with positive trends over Scandinavia and negative trends over Siberia. However, the magnitude of this dipole-like structure is reduced compared to previous analyses.

trends↗

Combining Data with Physical Knowledge for Uncertainty Quantification in Certification and Reliability Analysis

Unifying empirical data with predictive models can enable engineering cost-savings through certification by analysis and reliability-based design. Both concepts require rigorous uncertainty quantification (UQ) and robust understanding and treatment of relevant physics. Combining sampling-based UQ algorithms with high-fidelity simulations creates a computational bottleneck that is often alleviated through the use of machine learning (ML). ML can be used to create computationally efficient surrogates for simulations of complex or high-dimensional physical interactions (e.g., multi-phase interactions associated with melt pools in laser powder bed fusion or spatially-dependent material properties in functionally graded materials). However, negative side effects of ML may include a lack of interpretability and negative correlation between event rarity and simulation accuracy due to a lack of training data. As such, it is important to infuse ML algorithms with physics-based guardrails to provide confidence in their predictions. This talk will provide a brief review of recent NASA research at this intersection of physics-based simulation, ML, and UQ with a focus on certification and reliability analysis.

uncertainty quantification↗

SOME GEOLOGIC PROBLEMS OF MARS

Geological and geophysical knowledge and uncertainties concerning the surface and body of Mars are briefly discussed and evaluated. The large number of uncertainties in present data precludes an adequate model of Mars; reliable data are needed. Accurate values for the figure of the planet and the radii, seismic evidence of internal structure, and measurements of the outward heat flux across the surface are important and necessary for a satisfactory description of the body of Mars. Two types of television coverage from an orbiter are required to describe surface features. One type is needed to delineate gross topographic features, such as extensive highlands or basins, with resolution of about one kilometer. The second type is needed to search for evidence of orogenic and volcanic activity, areas of groundwater accumulation, sand dune patterns, etc., with resolution of about 10 meters. Some geological inferences which can be drawn from available photographic and photometric data concerning topography, areas of water accumulation, and biological activity are discussed. The priority of scientific geologic experiments is presented and some present instrumentation capabilities and deficiencies are listed.

Mars surface↗

Autonomous Frequency-Domain Indentification

Test and data-processing system determines plant models and uncertainties. Integrated system of methods, digital signal-processing, and algorithms identifies parametric model of large, flexible structures. Experiments in development of system conducted on laboratory model intended to represent large space antenna or flexible spacecraft. Also applicable to many terrestrial systems, robust control of dynamic plants and processes, robust control of systems about which knowledge uncertain or incomplete, decentralized control, and knowledge-based control systems.

Mettler, Edward↗

Reactive Nitrogen Distribution and Partitioning in the North American Troposphere and Lowermost Stratosphere

A comprehensive group of reactive nitrogen species (NO, NO2, HNO3, HO2NO2, PANs, alkyl nitrates, and aerosol-NO3) were measured in the troposphere and lowermost stratosphere over North America and the Atlantic during July/August 2004 (INTEX-A) from the NASA DC-8 platform (0.1-12 km). Less reactive nitrogen species (HCN and CH3CN), that are also unique tracers of biomass combustion, were also measured along with a host of other gaseous (CO, VOC, OVOC, halocarbon) and aerosol tracers. Clean background air as well as air with influences from biogenic emissions, anthropogenic pollution, biomass combustion, and stratosphere was sampled both over continental U. S., Atlantic and Pacific. The North American upper troposphere was found to be greatly influenced by both lightning NO(x) and surface pollution lofted via convection and contained elevated concentrations of PAN, ozone, hydrocarbons, and NO(x). Under polluted conditions PAN was a dominant carrier of reactive nitrogen in the upper troposphere while nitric acid dominated in the lower troposphere. Peroxynitric acid (HO2NO2) was present in sizable concentrations always peaking at around 8 km. Aerosol nitrate appeared to be mostly contained in large soil based particles in the lower troposphere. Plumes from Alaskan fires contained large amounts of PAN and very little enhancement in ozone. Observational data suggest that lightning was a far greater contributor to NO(x) in the upper troposphere than previously believed. NO(x) and NO(y) reservoir appeared to be in steady state only in the middle troposphere where NO(x)/NO(y) was independent of air mass age. A first comparison of observed data with simulations from four 3-D models shows significant differences between observations and models as well as among models. These uncertainties likely propagate themselves in satellites derived NOx data. Observed data are interpreted to suggest that soil sinks of HCN/CH3CN are at best very small. We investigate the partitioning and interplay of the reactive nitrogen species within characteristic air masses and further examine their role in ozone formation.

Singh, H. B.↗

Using Reliability to Meet Z540.3's 2 percent Rule

NASA's Kennedy Space Center (KSC) undertook implementation of ANSI/NCSL Z540.3-2006 in October 2008. Early in the implementation, KSC identified that the largest cost driver of Z540.3 implementation is measurement uncertainty analyses for legacy calibration processes. NASA, like other organizations, has a significant inventory of measuring and test equipment (MTE) that have documented calibration procedures without documented measurement uncertainties. This paper provides background information to support the rationale for using high in-tolerance reliability as evidence of compliance to the 2% probability of false acceptance (PFA) quality metric of ANSI/NCSL Z540.3-2006 allowing use of qualifying legacy processes. NASA is adopting this as policy and is recommending NCSL International consider this as a method of compliance to Z540.3. Topics covered include compliance issues, using end-of-period reliability (EOPR) to estimate test point uncertainty, reliability data influences within the PFA model, the validity of EOPR data, and an appendix covering "observed" versus "true" EOPR.

Mimbs, Scott M.↗

Uncertainty Quantification Methodology for Sonic Boom Loudness of a Low-Boom Supersonic Concept

This paper presents a comprehensive analysis of uncertainty quantification for sonic boom loudness metrics associated with the X-59 aircraft during its acoustic validation phase. The study focuses on employing advanced methodologies to characterize uncertainties in key sonic boom parameters predicted from a database derived from a computational fluid dynamics (CFD) solver. These methodologies include creating a polynomial chaos expansion (PCE) surrogate model, which is then used to run a Monte Carlo analysis to obtain 95% uncertainty intervals for sonic boom loudness parameters across the full carpet. Atmospheric uncertainties are rigorously considered, leveraging weather models based on historical data near Edwards Air Force Base to simulate potential flight conditions. The findings include preliminary uncertainty results for the full carpet during the validation phase of the Quesst mission. Additionally, a sensitivity study reveals that the primary sources of uncertainty are humidity and cruise weight.

Laura M. White↗

Recent Advancements in Modeling and Simulation of Entry Systems at NASA

This paper describes recent development of modeling and simulation technologies for entry systems in support of NASA’s exploration missions. Mission-tailored research and development in modeling of entry systems occurs across the Agency (e.g., within the Orion and Mars 2020 Programs), however the aim of this paper is to discuss the broad, cross-mission research conducted by NASA’s Entry Systems Modeling (ESM) Project, which serves as the Agency’s only concerted effort toward advancing entry systems across a range of technical disciplines. Technology development in ESM is organized and prioritized from a system-level perspective, resulting in four broad technical areas of investment: (1) Predictive material modeling, (2) Shock layer kinetics and radiation, (3) Computational and experimental aerosciences, and (4) Guidance, navigation, and control. Investments in thermal protection material modeling are geared toward high-fidelity, predictive models capable of handling complex structures, with an eye toward optimizing design performance and quantifying thermal protection system reliability. New computational tools have been developed to characterize material properties and behavior at the microstructural level, and experimental techniques (molecular beam scattering, micro-computed tomography, among others) have been developed to measure material kinetics, morphology, and other parameters needed to inform and validate detailed simulations. Advancements have also been made in macrostructural simulation capability to enable 3-D system-scale calculations of material response with complex topological features, including differential recession of tile gaps. Research and development in the area of shock layer kinetics has focused on air and CO2-based atmospheres. Capacity and capability of the NASA Ames Electric Arc Shock Tube (EAST) have been expanded in recent years and analysis of resulting data has led to several improvements in kinetic models, while simultaneously reducing uncertainties associated with radiative heat transfer predictions. First-principles calculations of fundamental kinetic, thermodynamic, and transport data, along with state-specificmodels for non-equilibrium flow regimes, have also yielded new insights and have the potential to vastly improve model fidelity. Aerosciences is a very broad area of interest in entry systems, yet a number of important challenges are being addressed: Coupled fluid-structure simulations of parachute inflation and dynamics; Experimental and computational studies of vehicle dynamics; Multi-phase flow with dust particles to simulate entry environments at Mars during dust storms; Studies of roughness-induced heating augmentation relevant to tiled and woven thermal protection systems; and Advanced numerical methods to optimize computational analyses for desired accuracy versus cost. Guidance and control in the context of entry systems has focused on development of methods for multi-axis control (i.e. pitch and yaw, rather than bank angle alone) of spacecraft during entry and descent. With precision landing requirements driven by Mars human exploration goals, recent efforts have yielded 6-DOF models of multi-axis control with propulsive descent of both inflatable and rigid ellipsled-like architectures. Results for both configurations have demonstrated the ability to land within the 50-meter precision requirement demanded by Mars human exploration missions, while also reducing propellant requirements by enabling more efficient control through entry and descent. Ongoing research in GN&C is developing mechanical specifications for the systems and establishing engineering feasibility.

aerothermodynamics↗

Scoping estimates of the LDEF satellite induced radioactivity

The Long Duration Exposure Facility (LDEF) satellite was recovered after almost six years in space. It was well-instrumented with ionizing radiation dosimeters, including thermoluminescent dosimeters, plastic nuclear track detectors, and a variety of metal foil samples for measuring nuclear activation products. The extensive LDEF radiation measurements provide the type of radiation environments and effects data needed to evaluate and help resolve uncertainties in present radiation models and calculational methods. A calculational program was established to aid in LDEF data interpretation and to utilize LDEF data for assessing the accuracy of current models. A summary of the calculational approach is presented. The purpose of the reported calculations is to obtain a general indication of: (1) the importance of different space radiation sources (trapped, galactic, and albedo protons, and albedo neutrons); (2) the importance of secondary particles; and (3) the spatial dependence of the radiation environments and effects expected within the spacecraft. The calculational method uses the High Energy Transport Code (HETC) to estimate the importance of different sources and secondary particles in terms of fluence, absorbed dose in tissue and silicon, and induced radioactivity as a function of depth in aluminum.

Armstrong, Tony W.↗

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness - however, increases in the cost of flight testing and the accuracy of inexpensive CFD promote certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight test or high fidelity data of the original aircraft as well as lower fidelity data of the original and modified configurations. Two methods are presented which estimate the model form uncertainty of the modified configuration, which is then used to conduct non-deterministic simulations. The framework is applied to an example aircraft system with simulated flight test data to demonstrate the ability to predict the performance and associated uncertainty of modified aircraft configurations. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. The factors and limitations of the framework are explored to determine the range of applicability of the framework. The effects of these factors on the performance and uncertainty results are demonstrated using the example aircraft system. The framework is then applied to NASA’s X-57 Maxwell and each of its modifications. The estimated performance and associated uncertainties are then compared to the airworthiness criteria to evaluate the potential of the framework as a component to the certification by analysis process.

Uncertainty Quantification↗

North American Extreme Precipitation Events and Related Large-Scale Meteorological Patterns: a Review of Statistical Methods, Dynamics, Modeling, and Trends

This paper surveys the current state of knowledge regarding Large-Scale Meteorological Patterns (LSMPs) associated with short-duration (less than one week) extreme precipitation events over North America. In contrast to teleconnections, which are typically defined based on the characteristic spatial variations of a meteorological field or on the remote circulation response to a known forcing, LSMPs are defined relative to the occurrence of a specific phenomenon—here, extreme precipitation—and with an emphasis on the synoptic scales that have a primary influence in individual events, have medium-range weather predictability, and are well-resolved in both weather and climate models. For the LSMP relationship with extreme precipitation, we consider the previous literature with respect to definitions and data, dynamical mechanisms, model representation, and climate change trends. There is considerable uncertainty in identifying extremes based on existing observational precipitation data and some limitations in analyzing the associated LSMPs in reanalysis data. Many different definitions of “extreme” are in use, making it difficult to directly compare different studies. Dynamically, several types of meteorological systems—extratropical cyclones, tropical cyclones, mesoscale convective systems, and mesohighs—and several mechanisms—fronts, atmospheric rivers, and orographic ascent—have been shown to be important aspects of extreme precipitation LSMPs. The extreme precipitation is often realized through mesoscale processes organized, enhanced, or triggered by the LSMP. Understanding of model representation, trends, and projections for LSMPs is at an early stage, although some 4 promising analysis techniques have been identified and the LSMP perspective is useful for evaluating model dynamics.

Mathew Barlow↗

The Observed State of the Water Cycle in the Early Twenty-First Century

This study quantifies mean annual and monthly fluxes of Earth's water cycle over continents and ocean basins during the first decade of the millennium. To the extent possible, the flux estimates are based on satellite measurements first and data-integrating models second. A careful accounting of uncertainty in the estimates is included. It is applied within a routine that enforces multiple water and energy budget constraints simultaneously in a variational framework in order to produce objectively determined optimized flux estimates. In the majority of cases, the observed annual surface and atmospheric water budgets over the continents and oceans close with much less than 10% residual. Observed residuals and optimized uncertainty estimates are considerably larger for monthly surface and atmospheric water budget closure, often nearing or exceeding 20% in North America, Eurasia, Australia and neighboring islands, and the Arctic and South Atlantic Oceans. The residuals in South America and Africa tend to be smaller, possibly because cold land processes are negligible. Fluxes were poorly observed over the Arctic Ocean, certain seas, Antarctica, and the Australasian and Indonesian islands, leading to reliance on atmospheric analysis estimates. Many of the satellite systems that contributed data have been or will soon be lost or replaced. Models that integrate ground-based and remote observations will be critical for ameliorating gaps and discontinuities in the data records caused by these transitions. Continued development of such models is essential for maximizing the value of the observations. Next-generation observing systems are the best hope for significantly improving global water budget accounting.

Numerical analysis/modeling↗