Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6-Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗
NASA NTRSDate not supplied

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at the NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6- Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗
NASA NTRS2016

Uncertainties in Coastal Ocean Color Products: Impacts of Spatial Sampling

With increasing demands for ocean color (OC) products with improved accuracy and well characterized, per-retrieval uncertainty budgets, it is vital to decompose overall estimated errors into their primary components. Amongst various contributing elements (e.g., instrument calibration, atmospheric correction, inversion algorithms) in the uncertainty of an OC observation, less attention has been paid to uncertainties associated with spatial sampling. In this paper, we simulate MODIS (aboard both Aqua and Terra) and VIIRS OC products using 30 m resolution OC products derived from the Operational Land Imager (OLI) aboard Landsat-8, to examine impacts of spatial sampling on both cross-sensor product intercomparisons and in-situ validations of R(sub rs) products in coastal waters. Various OLI OC products representing different productivity levels and in-water spatial features were scanned for one full orbital-repeat cycle of each ocean color satellite. While some view-angle dependent differences in simulated Aqua-MODIS and VIIRS were observed, the average uncertainties (absolute) in product intercomparisons (due to differences in spatial sampling) at regional scales are found to be 1.8%, 1.9%, 2.4%, 4.3%, 2.7%, 1.8%, and 4% for the R(sub rs)(443), R(sub rs)(482), R(sub rs)(561), R(sub rs)(655), Chla, K(sub d)(482), and b(sub bp)(655) products, respectively. It is also found that, depending on in-water spatial variability and the sensor's footprint size, the errors for an in-situ validation station in coastal areas can reach as high as +/- 18%. We conclude that a) expected biases induced by the spatial sampling in product intercomparisons are mitigated when products are averaged over at least 7 km × 7 km areas, b) VIIRS observations, with improved consistency in cross-track spatial sampling, yield more precise calibration/validation statistics than that of MODIS, and c) use of a single pixel centered on in-situ coastal stations provides an optimal sampling size for validation efforts. These findings will have implications for enhancing our understanding of uncertainties in ocean color retrievals and for planning of future ocean color missions and the associated calibration/validation exercises.

Coastal ocean color↗
NASA NTRS2005

Improvement of Raman lidar algorithm for quantifying aerosol extinction

Aerosols are particles of different composition and origin and influence the formation of clouds which are important in atmospheric radiative balance. At the present there is high uncertainty on the effect of aerosols on climate and this is mainly due to the fact that aerosol presence in the atmosphere can be highly variable in space and time. Monitoring of the aerosols in the atmosphere is necessary to better understanding many of these uncertainties. A lidar (an instrument that uses light to detect the extent of atmospheric aerosol loading) can be particularly useful to monitor aerosols in the atmosphere since it is capable to record the scattered intensity as a function of altitude from molecules and aerosols. One lidar method (the Raman lidar) makes use of the different wavelength changes that occur when light interacts with the varying chemistry and structure of atmospheric aerosols. One quantity that is indicative of aerosol presence is the aerosol extinction which quantifies the amount of attenuation (removal of photons), due to scattering, that light undergoes when propagating in the atmosphere. It can be directly measured with a Raman lidar using the wavelength dependence of the received signal. In order to calculate aerosol extinction from Raman scattering data it is necessary to evaluate the rate of change (derivative) of a Raman signal with respect to altitude. Since derivatives are defined for continuous functions, they cannot be performed directly on the experimental data which are not continuous. The most popular technique to find the functional behavior of experimental data is the least-square fit. This procedure allows finding a polynomial function which better approximate the experimental data. The typical approach in the lidar community is to make an a priori assumption about the functional behavior of the data in order to calculate the derivative. It has been shown in previous work that the use of the chi-square technique to determine the most likely functional behavior of the data prior to actually calculating the derivative eliminates the need for making a priori assumptions. We note that the a priori choice of a model itself can lead to larger uncertainties as compared to the method that is validated here. In this manuscript, the chi-square technique that determines the most likely functional behavior is validated through numerical simulation and by application to a large body of Raman lidar measurements. In general, we show that the chi-square approach to evaluate aerosol extinction yields lower extinction uncertainty than the traditional technique. We also use the technique to study the feasibility of developing a general characterization of the extinction uncertainty that could permit the uncertainty in Raman lidar aerosol extinction measurements to be estimated accurately without the use of the chi-square technique.

Russo, Felicita↗
NASA NTRSDate not supplied

Atmospheric Variability and Measurement Uncertainty: Pitfalls in Averaging in situ Data

Satellite measurements and atmospheric models, two essential components of the integrated global observing system, provide crucial tools for monitoring and predicting regional and global foci, spanning numerous Earth Science fields. Unfortunately, models can lack the spatial and temporal resolution needed to resolve finer scale structure. Satellite measurements also have similar tempo-spatial restriction issues, but additionally can only measure certain species and can have biases that must be evaluated. Ground measurement networks are critical components of this system, by providing both independent inputs of species needed by models (including those that satellites do not provide) and assisting with investigation of biases in satellite products. Similarly, aircraft measurements play a vital role in closing the gaps between satellite measurements, model products, and ground monitoring networks by providing high accuracy, high-resolution data on local to regional spatial scales. Therefore, both ground-based and airborne observations are widely used to assess model predictions and satellite observations. One of the great challenges in using both ground and aircraft data in this fashion is matching the data temporally and spatially to the model/satellite data. A meaningful comparison with model or satellite requires a solid assessment of the variability of the in-situ measurements, which include both the instrument uncertainty and the statistical uncertainty due to atmospheric variability. While instrument uncertainty is generally more straightforwardly characterized, it can be challenging to accurately capture this variability uncertainty as it often presents in a non-Gaussian manner (e.g. emission plumes, frontal passages). We will present results examining spatial and temporal variability over a selection of scales relevant to satellite measurements and models of several in situ measurement species spanning both airborne and ground measurements. The extent of non-Gaussian variability will be quantified, and we will discuss additional statistical parameters that help assess the fitness of gaussian variability assumption when temporally or spatially averaging.

satellite validation↗
NASA NTRS2023

Uncertainty Analysis of the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel 2019 Characterization Test 14-Foot, 5.8 Percent Test Section Porosity

This paper presents methods and results of a measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The uncertainty analysis is based on data collected during a characterization test following major structural modifications to the facility and upgrades to the facility’s data and control systems. The statistical methods and engineering judgments used to estimate elemental uncertainties are described in this report. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A description of the Monte Carlo method as applied for this analysis is provided. The primary variable of interest (VOI) for this facility is free stream Mach number. In addition to determining the uncertainty in Mach number, the uncertainty in free stream values of static pressure, total pressure, dynamic pressure, total temperature, static temperature, Reynolds number, and air speed were also calculated. Uncertainty results are presented as random (unpredictable variation in repeated measurements), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty for Mach number. Systematic uncertainty results are presented for the other VOIs. Individual uncertainty sources are presented both dimensionally and as percent contributions to uncertainty in all VOIs, to aid in the identification of primary uncertainty sources.

Uncertainty Analysis↗
NASA NTRS2013

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗
NASA NTRS1987

Modal survey of the space shuttle solid rocket motor using multiple input methods

The ability to accurately characterize propellant in a finite element model is a concern of engineers tasked with studying the dynamic response of the Space Shuttle Solid Rocket Motor (SRM). THe uncertainties arising from propellant characterization through specimem testing led to the decision to perform a model survey and model correlation of a single segment of the Shuttle SRM. Multiple input methods were used to excite and define case/propellant modes of both an inert segment and, later, a live propellant segment. These tests were successful at defining highly damped, flexible modes, several pairs of which occured with frequency spacing of less than two percent.

Brillhart, Ralph↗
NASA NTRS2010

Application of Ensemble Detection and Analysis to Modeling Uncertainty in Non Stationary Process

Characterization of non stationary and nonlinear processes is a challenge in many engineering and scientific disciplines. Climate change modeling and projection, retrieving information from Doppler measurements of hydrometeors, and modeling calibration architectures and algorithms in microwave radiometers are example applications that can benefit from improvements in the modeling and analysis of non stationary processes. Analyses of measured signals have traditionally been limited to a single measurement series. Ensemble Detection is a technique whereby mixing calibrated noise produces an ensemble measurement set. The collection of ensemble data sets enables new methods for analyzing random signals and offers powerful new approaches to studying and analyzing non stationary processes. Derived information contained in the dynamic stochastic moments of a process will enable many novel applications.

Racette, Paul↗
NASA NTRS2017

A Model-Based, Bayesian Solution for Characterization of Complex Damage Scenarios in Aerospace Composite Structures

Ultrasonic damage detection and characterization is commonly used in nondestructive evaluation (NDE) of aerospace composite components. In recent years there has been an increased development of guided wave based methods. In real materials and structures, these dispersive waves result in complicated behavior in the presence of complex damage scenarios. Model-based characterization methods utilize accurate three dimensional finite element models (FEMs) of guided wave interaction with realistic damage scenarios to aid in defect identification and classification. This work describes an inverse solution for realistic composite damage characterization by comparing the wavenumber-frequency spectra of experimental and simulated ultrasonic inspections. The composite laminate material properties are first verified through a Bayesian solution (Markov chain Monte Carlo), enabling uncertainty quantification surrounding the characterization. A study is undertaken to assess the efficacy of the proposed damage model and comparative metrics between the experimental and simulated output. The FEM is then parameterized with a damage model capable of describing the typical complex damage created by impact events in composites. The damage is characterized through a transdimensional Markov chain Monte Carlo solution, enabling a flexible damage model capable of adapting to the complex damage geometry investigated here. The posterior probability distributions of the individual delamination petals as well as the overall envelope of the damage site are determined.

H. Reed↗
NASA NTRS1994

Hypersonic vehicle model and control law development using H(infinity) and micron synthesis

The control system design for a Single Stage To Orbit (SSTO) air breathing vehicle will be central to a successful mission because a precise ascent trajectory will preserve narrow payload margins. The air breathing propulsion system requires the vehicle to fly roughly halfway around the Earth through atmospheric turbulence. The turbulence, the high sensitivity of the propulsion system to inlet flow conditions, the relatively large uncertainty of the parameters characterizing the vehicle, and continuous acceleration make the problem especially challenging. Adequate stability margins must be provided without sacrificing payload mass since payload margins are critical. Therefore, a multivariable control theory capable of explicitly including both uncertainty and performance is needed. The H(infinity) controller in general provides good robustness but can result in conservative solutions for practical problems involving structured uncertainty. Structured singular value mu framework for analysis and synthesis is potentially much less conservative and hence more appropriate for problems with tight margins. An SSTO control system requires: highly accurate tracking of velocity and altitude commands while limiting angle-of-attack oscillations, minimized control power usage, and a stabilized vehicle when atmospheric turbulence and system uncertainty are present. The controller designs using H(infinity) and mu-synthesis procedures were compared. An integrated flight/propulsion dynamic mathematical model of a conical accelerator vehicle was linearized as the vehicle accelerated through Mach 8. Vehicle acceleration through the selected flight condition gives rise to parametric variation that was modeled as a structured uncertainty. The mu-analysis approach was used in the frequency domain to conduct controller analysis and was confirmed by time history plots. Results demonstrate the inherent advantages of the mu framework for this class of problems.

Gregory, Irene M.↗
NASA NTRS1994

SeaWiFS technical report series. Volume 16: The second SeaWiFS Intercalibration Round-Robin Experiment, SIRREX-2, June 1993

The results of the second Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Intercalibration Round-Robin Experiment (SIRREX-2), which was held at the Center for Hydro-Optics and Remote Sensing (CHORS) at San Diego State University on 14-25 Jun. 1993 are presented. SeaWiFS is an ocean color radiometer that is scheduled for launch in 1994. The SIRREXs are part of the SeaWiFS Calibration and Validation Program that includes the GSFC, CHORS, NIST, and several other laboratories. GSFC maintains the radiometric scales (spectral radiance and irradiance) for the SeaWiFS program using spectral irradiance standards lamps, which are calibrated by NIST. The purpose of each SIRREX is to assure that the radiometric scales which are realized by the laboratories who participate in the SeaWiFS Calibration and Validation Program are correct; that is, the uncertainties of the radiometric scales are such that measurements of normalized water-leaving radiance using oceanographic radiometers have uncertainties of 5%. SIRREX-1 demonstrated, from the internal consistency of the results, that the program goals would not be met without improvements to the instrumentation. The results of SIRREX-2 demonstrate that spectral irradiance scales realized using the GSFC standard irradiance lamp (F269) are consistent with the program goals, as the uncertainty of these measurements is assessed to be about 1%. However, this is not true for the spectral radiance scales, where again the internal consistency of the results is used to assess the uncertainty. This is attributed to inadequate performance and characterization of the instrumentation. For example, spatial nonuniformities, spectral features, and sensitivity to illumination configuration were observed in some of the integrating sphere sources. The results of SIRREX-2 clearly indicate the direction for future work, with the main emphasis on instrument characterization and the assessment of the measurement uncertainties so that the results may be stated in a more definitive manner.

Hooker, Stanford B.↗
NASA NTRS2017

Picosecond Pulsed Laser Ablation for the Surface Preparation of Epoxy Composites

As part of a technical challenge under the Advanced Composites Program, methods for improving pre-bond process control for aerospace composite surface treatments and inspections, in conjunction with Federal Aviation Administration guidelines, are under investigation. The overall goal is to demonstrate high fidelity, rapid and reproducible surface treatment and surface characterization methods to reduce uncertainty associated with the bonding process. The desired outcomes are reliable bonded airframe structure, and reduced timeline to certification. In this work, laser ablation was conducted using a q-switched Nd:YVO4 laser capable of nominal pulse durations of 8 picoseconds (ps). Aerospace structural carbon fiber reinforced composites with an epoxy resin matrix were laser treated, characterized, processed into bonded assemblies and mechanically tested. The characterization of ablated surfaces were conducted using scanning electron microscopy (SEM), water contact angle (WCA) goniometry, micro laser induced breakdown spectroscopy (uLIBS), and electron spin resonance (ESR). The bond performance was assessed using a double cantilever beam (DCB) test with an epoxy adhesive. The surface characteristics and bond performance obtained from picosecond ablated carbon fiber reinforced plastics (CFRPs) are presented herein.

Palmieri, Frank↗
NASA NTRS2002

Sources of Uncertainty in the Prediction of LAI / fPAR from MODIS

To explicate the sources of uncertainty in the prediction of biophysical variables over space, consider the general equation: where z is a variable with values on some nominal, ordinal, interval or ratio scale; y is a vector of input variables; u is the spatial support of y and z ; x and u are the spatial locations of y and z , respectively; f is a model and B is the vector of the parameters of this model. Any y or z has a value and a spatial extent which is called its support. Viewed in this way, categories of uncertainty are from variable (e.g. measurement), parameter, positional. support and model (e.g. structural) sources. The prediction of Leaf Area Index (LAI) and the fraction of absorbed photosynthetically active radiation (fPAR) are examples of z variables predicted using model(s) as a function of y variables and spatially constant parameters. The MOD15 algorithm is an example of f, called f(sub 1), with parameters including those defined by one of six biome types and solar and view angles. The Leaf Canopy Model (LCM)2, a nested model that combines leaf radiative transfer with a full canopy reflectance model through the phase function, is a simpler though similar radiative transfer approach to f(sub 1). In a previous study, MOD15 and LCM2 gave similar results for the broadleaf forest biome. Differences between these two models can be used to consider the structural uncertainty in prediction results. In an effort to quantify each of the five sources of uncertainty and rank their relative importance for the LAI/fPAR prediction problem, we used recent data for an EOS Core Validation Site in the broadleaf biome with coincident surface reflectance, vegetation index, fPAR and LAI products from the Moderate Resolution Imaging Spectrometer (MODIS). Uncertainty due to support on the input reflectance variable was characterized using Landsat ETM+ data. Input uncertainties were propagated through the LCM2 model and compared with published uncertainties from the MOD15 algorithm.

Dungan, Jennifer L.↗
NASA NTRS1988

Robustness analysis based on passivity

A technique of robust stability analysis for multivariable control systems is introduced. Existing tools in the literature are mostly based on small gain type of conditions such as the H(infinity)-norm or mu measure. In contrast, the approach presented is motivated by passivity theory. The natural energy Lyapunov function associated with a passive system allows robustness to be analyzed with Lyapunov stability theory. Consequently, nonlinear and time-varying perturbations can be considered within the same framework. For unstructured uncertainties, the robustness margin is characterized in terms of an index related to the Hermitian part of a transfer function. If the uncertainties contain additional diagonal structure, stability margins are obtained for variations of each uncertain block in both positive and negative directions. Applications of this robustness analysis technique are illustrated.

Wen, John T.↗
NASA NTRS2011

Flow Property Measurement Using Laser-Induced Fluorescence in the NASA Ames Interaction Heating Facility

The spectroscopic diagnostic technique of two photon absorption laser-induced fluorescence (TALIF) of atomic species has been applied to single-point measurements of velocity and static temperature in the NASA Ames Interaction Heating Facility (IHF) arc jet. Excitation spectra of atomic oxygen and nitrogen were recorded while scanning a tunable dye laser over the absorption feature. Thirty excitation spectra were acquired during 8 arc jet runs at two facility operating conditions; the number of scans per run varied between 2 and 6. Curve fits to the spectra were analyzed to recover their Doppler shifts and widths, from which the flow velocities and static temperatures, respectively, were determined. An increase in the number of independent flow property pairs from each as-measured scan was obtained by extracting multiple lower-resolution scans. The larger population sample size enabled the mean property values and their uncertainties for each run to be characterized with greater confidence. The average plus or minus 2 sigma uncertainties in the mean velocities and temperatures for all 8 runs were plus or minus 1.4% and plus or minus 11%, respectively.

Grinstead, Jay Henderson↗
NASA NTRS2019

Ephemeris refinement of 21 hot Jupiter exoplanets with high timing uncertainties

Transit events of extrasolar planets offer a wealth of information for planetary characterization. However, for many known targets, the uncertainty of their predicted transit windows prohibits an accurate scheduling of follow-up observations. In this work, we refine the ephemerides of 21 hot Jupiter exoplanets with the largest timing uncertainties. We collected 120 professional and amateur transit light curves of the targets of interest, observed with a range of telescopes of 0.3 m–2.2 m, and analyzed them along with the timing information of the planets discovery papers. In the case of WASP-117b, we measured a timing deviation compared to the known ephemeris of about 3.5 h, and for HAT-P-29b and HAT-P-31bthe deviation amounted to about 2 h and more. For all targets, the new ephemeris predicts transit timings with uncertainties of less than 6 min in the year 2018 and less than 13 min until 2025. Thus, our results allow for an accurate scheduling of follow-up observations in the next decade.

photometric↗