Search NASA⌕ Search

SEARCH · Search NASA

Results for “expanded uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

Autonomous RPOD for Arbitrarily Configured Spacecraft with Anomaly Detection

Autonomous GN&C is a necessary component for a sustainable deep-space logistics architecture. The challenges for establishing robust autonomy are numerous, from state uncertainty, to anomaly detection and recovery. In this work, previous work investigating autonomous GN&C for arbitrary thruster configurations and mass properties is expanded to include state uncertainty and anomaly detection. Logistics vehicles with off-center-of-mass thruster configurations and in the presence of large but realistic state uncertainties are simulated in a Rendezvous, Proximity Operations and Docking scenario. Furthermore, stuck and non-functional thrusters are simulated, demonstrating the vehicle's ability to identify and overcome thruster anomalies. The simulations demonstrate that even with these realistic ambiguities, the vehicle is able to converge to the desired pose.

GN&C↗

Measuring planetary neutron albedo fluxes by remote gamma-ray sensing

In order to measure the planetary neutron albedo fluxes, a neutron-absorbing shield which emits gamma rays of characteristic energy and serves as a neutron detector, is added to a gamma-ray spectrometer (GRS). The gamma rays representing the neutron flux are observed against interference consisting of cosmic gamma rays, planetary continuum and line emission, and gamma rays arising from the interaction of cosmic rays with the GRS and the spacecraft. The uncertainty and minimum detection limits in neutron albedo fluxes are calculated for two missions, a lunar orbiter and a comet nucleus rendezvous. A GRS on a lunar orbiter at 100 km altitude detects a thermal neutron albedo flux as low as 0.002/sq cm/s and an expected flux of about 0.6/sq cm/s is measured with an uncertainty of 0.001/sq cm/s, for a 100 h observation period. For the comet nucleus, again in a 100 h observing period, a thermal neutron albedo flux is detected at a level of 0.006/sq cm/s and an expected flux of about 0.4/sq cm/s is measured with an uncertainty of 0.004/sq cm/s. The expanded geological capabilities made possible by this technique include improvements in H sensitivity, spatial resolution, and measurement depth; and an improved model of induced gamma-ray emission.

Haines, E. L.↗

A Practical Approach to Uncertainty Quantification Using Probability Boxes

To date, while the use of CFD for aerospace vehicle design and development is prevalent, the documentation of uncertainties associated with the simulations are rare. Instead, the current state-of-the-art relies heavily on the experience of the CFD practitioner to estimate the uncertainty associated with their simulations through simple sensitivity studies or subject matter expertise. This practice will have to be replaced with a formal uncertainty quantification (UQ) process if CFD is to play an expanded role in the research and engineering design community, test and evaluation community, and ultimately certification for flight. Accounting for uncertainties in a formal manner is a tedious process. Moreover, the typical CFD practitioner is not likely to be familiar with formal UQ methods. These factors have prevented the adoption of UQ methods in the engineering design and development cycle. This presentation will outline a credible approach to UQ using Probability Boxes that is straightforward to apply, and can readily be automated using existing UQ tool sets such as the DAKOTA packaged developed at Sandia. The added expense incurred when moving away from a deterministic CFD process to a stochastic one that captures uncertainties to enable risk-informed decision making will be discussed, as well as effective ways to reduce the computational costs.

Uncertainty Quantification↗

Dynamic control of robotic welding - On-going research

Two major challenges exist for the development of dynamic control systems: first, the control system must be resourceful enough to provide problem-solving capabilities in unforeseen circumstances; second, it must be rapid enough to respond to dynamic environments. Most conventional control systems do not have the ability to 'step back' and problem-solve, especially in environments with incomplete and uncertain models and data. Orthogonally, commercially available AI systems usually do not respond at the rates required to support 'real-time' control. Hence, control systems are not available that respond to complex dynamic environments within appropriate time constraints. This paper describes work on an AI-based control system designed to address these challenges. A prototype system has been used, in a simulated environment, to control the robotic welding of aerospace components. This AI-based control system has demonstrated the ability to flexibly control a complex process within required time constraints by incorporating higher level reasoning and the ability to deal with uncertainty. Further work is in progress to expand the system's problem-solving capabilities.

Ruokangas, Corinne C.↗

Development of a Data Fusion Methodology for Lineload Aerodynamic Databases for a Launch Vehicle during Liftoff and Transition

The need for databases for the distributed loading on launch vehicles during the early portion of flight necessitates the use of expensive computational flows in regimes where wake effects dominate. While also being expensive, this is a regime that computational tools tend to historically have problems simulating accurately. To help tackle this problem, a method of data fusion to combine computational results to wind tunnel derived force and moment data is developed. Using this method, significant reduction in computational costs and increases in confidence of the final product is possible and has been used to generate several databases for the Space Launch System (SLS) at NASA. While the full details of database generation are not part of this work, the crucial method at its core is developed here. Two SLS geometries are used throughout the work to demonstrate the techniques. These are two of the larger geometries and represent both planned crewed missions to the Moon as well as potential cargo missions to deep space. The method uses principal component analysis (PCA) to generate a reduced ordered model (ROM) to help fill in the full parameter space. Other similar techniques are explored, but were not found to have a significant result on the predictions of the ROM. Because the full number of components are kept to generate the model, this lack of difference is expected. This method is then extended to ensure that predicted surfaces match trusted force and moment data derived from wind tunnel testing. This extension is done by setting up a constrained optimization problem in order to minimize the deviation from the surface resolved computational data while still integrating to the desired values. When generating the constrained optimization problem, a weighting factor to balance these competing needs is introduced. The work compares previously introduced weighting terms from similar work to the proposed terms and shows that the previously used terms do not have as desirable behavior in this flow regime. This method is then expanded by developing a technique to incorporate uncertainty quantification into the developed data fusion methodology. This expansion takes a two pronged approach. One examines transferring the uncertainties in the force and moment database and characterizes how those adjustments change the predicted lineloads. The second looks at model form error and looks how rebuilding the model using slightly different data changes the predictions. These two terms are then combined in order to create an uncertainty model that takes both effects into account. The limitations of the proposed methods is then discussed as well as possible techniques to address these shortcomings.

Launch Vehicles↗

Arctic Sea Ice in Transformation: A Review of Recent Observed Changes and Impacts on Biology and Human Activity

Sea ice in the Arctic is one of the most rapidly changing components of the global climate system. Over the past few decades, summer areal extent has declined over 30, and all months show statistically significant declining trends. New satellite missions and techniques have greatly expanded information on sea ice thickness, but many uncertainties remain in the satellite data and long-term records are sparse. However, thickness observations and other satellite-derived data indicate a 40 decline in thickness, due in large part to the loss of thicker, older ice cover. The changes in sea ice are happening faster than models have projected. With continued increasing temperatures, summer ice-free conditions are likely sometime in the coming decades, though there are substantial uncertainties in the exact timing and high interannual variability will remain as sea ice decreases. The changes in Arctic sea ice are already having an impact on flora and fauna in the Arctic. Some species will face increasing challenges in the future, while new habitat will open up for other species. The changes are also affecting peoples living and working in the Arctic. Native communities are facing challenges to their traditional ways of life, while new opportunities open for shipping, fishing, and natural resource extraction.

Sea Ice↗

Uncertainty Quantification of CFD Data Generated for a Model Scramjet Isolator Flowfield

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty. The nonintrusive nature of the approach allows the computational fluid dynamicist to perform the uncertainty quantification with the flow solver treated as a "black box". Moreover, a large fraction of the process can be automated, allowing the uncertainty assessment to be readily adapted into the engineering design and development workflow. In the present work, the approach is applied to a model scramjet isolator problem where the desire is to validate turbulence closure models in the presence of uncertainty. In this context, the relevant uncertainty sources are determined and accounted for to allow the analyst to delineate turbulence model-form errors from other sources of uncertainty associated with the simulation of the facility flow.

Baurle, R. A.↗

TPSAS-NF1676L-32640-DND

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty.

Robert A Baurle↗

Automation of the Uncertainty Quantification Process Based on Probability Boxes with DAKOTA

To date, while the use of CFD is prevalent, very few efforts have been undertaken that truly attempt to document all (or even most) of the sources of uncertainty in the simulations. Instead, the current state-of-the-art relies heavily on the experience of the CFD practitioner to estimate the uncertainty associated with their simulations through simple sensitivity studies or subject matter expertise. This practice will have to be replaced with a formal uncertainty quantification (UQ) process if CFD is to play an expanded role in the design research and engineering community, test and evaluation community, and ultimately certification for flight. This is especially true for hypersonic air-breathing propulsion systems due to the environment, scale, and duration limitations of ground test facilities. Accounting for uncertainties in a formal manner is a tedious process. Moreover, the typical CFD practitioner is not likely to be familiar with formal UQ methods. Hence, a major obstacle that has prevented the adoption of UQ methods for engineering design and development work is the lack of a tool set to automate most (if not all) of the UQ workflow. Towards this end, the SANDIA package DAKOTA (which has been developed to drive both UQ and optimization processes) will be tightly wrapped around the VULCAN-CFD code to automate the uncertainty quantification process. The automated process will be applied to an isolator turbulence model validation exercise that has previously been documented using a manual approach to the UQ process. Hence, the focus of this paper will be documenting the level to which automation can hide the UQ process details from the CFD practitioner rather than the UQ method itself.

CFD↗

Quantifying Uncertainty in Particle Size Distribution Parameters Inferred from SAGE III/ISS Extinction Spectra

Stratospheric aerosols play key roles in the chemistry and radiation balance of the atmosphere and are a key input parameter for global chemistry and climate models. The degree to which aerosols impact chemistry and radiation balance depends primarily on their microphysical properties such as particle size distribution (PSD). The PSD is a mathematical description of the relative abundance of different sized particles within a sampling volume. If the PSD is accurately known then other key modeling parameters (e.g., surface area density) can be derived. Occultation observations from orbital instruments such as SAGE III/ISS have been used to infer these PSD parameters by inverting the extinction coefficient spectra. However, past efforts failed to address two key issues with this methodology: 1. The measurement uncertainty was not accounted for; 2. They assumed the PSDs to be single-mode only, while “real-world” PSDs are predominantly bi-modal. Accounting for both issues in the retrieval will yield an expanded solution space to the inferred PSD parameters; the question is “by how much?” To address this knowledge gap, we propose to carry out a series of simulations and, for every valid SAGE III/ISS data point, determine the range of PSD parameters that yield extinction spectra that are indistinguishable from the SAGE III/ISS data, within the limits of the reported uncertainty. Further, we will expand the solution space, for the first time, to include bimodal distributions. The results of this work will advance Earth system modeling/prediction capability through identifying the uncertainty of PSD parameter estimates using SAGE III/ISS data. The key benefits of this study over previous studies are twofold: 1. we will provide PSD estimates that include bimodal distributions in the solution space, 2. we will provide an uncertainty estimate for these parameters. The results of this study may be used directly in current and future climate and chemistry models.

SAGE III/ISS↗

On-Line Mu Method for Robust Flutter Prediction in Expanding a Safe Flight Envelope for an Aircraft Model Under Flight Test

A structured singular value (mu) analysis method of computing flutter margins has robust stability of a linear aeroelastic model with uncertainty operators (Delta). Flight data is used to update the uncertainty operators to accurately account for errors in the computed model and the observed range of aircraft dynamics of the aircraft under test caused by time-varying aircraft parameters, nonlinearities, and flight anomalies, such as test nonrepeatability. This mu-based approach computes predict flutter margins that are worst case with respect to the modeling uncertainty for use in determining when the aircraft is approaching a flutter condition and defining an expanded safe flight envelope for the aircraft that is accepted with more confidence than traditional methods that do not update the analysis algorithm with flight data by introducing mu as a flutter margin parameter that presents several advantages over tracking damping trends as a measure of a tendency to instability from available flight data.

Lind, Richard C.↗

Reynolds-Averaged Turbulence Model Assessment for a Highly Back-Pressured Isolator Flowfield

The use of computational fluid dynamics in scramjet engine component development is widespread in the existing literature. Unfortunately, the quantification of model-form uncertainties is rarely addressed with anything other than sensitivity studies, requiring that the computational results be intimately tied to and calibrated against existing test data. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Due to ground test facility limitations, this expanded role is believed to be a requirement by some in the test and evaluation community if scramjet engines are to be given serious consideration as a viable propulsion device. An effort has been initiated at the NASA Langley Research Center to validate several turbulence closure models used for Reynolds-averaged simulations of scramjet isolator flows. The turbulence models considered were the Menter BSL, Menter SST, Wilcox 1998, Wilcox 2006, and the Gatski-Speziale explicit algebraic Reynolds stress models. The simulations were carried out using the VULCAN computational fluid dynamics package developed at the NASA Langley Research Center. A procedure to quantify the numerical errors was developed to account for discretization errors in the validation process. This procedure utilized the grid convergence index defined by Roache as a bounding estimate for the numerical error. The validation data was collected from a mechanically back-pressured constant area (1 2 inch) isolator model with an isolator entrance Mach number of 2.5. As expected, the model-form uncertainty was substantial for the shock-dominated, massively separated flowfield within the isolator as evidenced by a 6 duct height variation in shock train length depending on the turbulence model employed. Generally speaking, the turbulence models that did not include an explicit stress limiter more closely matched the measured surface pressures. This observation is somewhat surprising, given that stress-limiting models have generally been developed to better predict shock-separated flows. All of the models considered also failed to properly predict the shape and extent of the separated flow region caused by the shock boundary layer interactions. However, the best performing models were able to predict the isolator shock train length (an important metric for isolator operability margin) to within 1 isolator duct height.

Baurle, Robert A.↗

Bayesian retrieval of optically relevant properties from hyperspectral water-leaving reflectances

Current methods to retrieve optically relevant properties from ocean color observations do not explicitly make use of prior knowledge about property distributions. Here we implement a simplified Bayesian approach that takes into account prior probability distributions on two sets of five optically relevant parameters, and conduct a retrieval of these parameters using hyperspectral simulated water-leaving reflectances. We focus specifically on the ability of the model to distinguish between two optically similar phytoplankton taxa, diatoms and Noctiluca scintillans. The inversion retrieval gives most-likely concentrations and uncertainty estimates, and we find that the model is able to probabilistically predict the occurrence of Noctiluca scintillans blooms using these metrics. We discuss how this method can be expanded to include a priori covariances between different parameters, and show the effect of varying measurement uncertainty and spectral resolution on Noctiluca scintillans bloom predictions.

Zachary K Erickson↗

NASA Ames Thermophysics Ground Test Facilities Supporting Future Planetary Atmospheric Entry

A review of the current facility capabilities for testing Thermal Protection Systems and quantifying their entry environments at NASA Ames Research Center is presented based on the expected targets of interest to the Planetary Science and Astrobiology communities. While the operational capabilities of these facilities are generally considered sufficient for supporting future missions to targets of interest, expanded ground test capabilities such as larger sample sizes, flight-relevant gas mixtures, dusty environments, and flight-relevant shear/pressure combinations would reduce future entry vehicle design uncertainties and applied margins. These reduced uncertainties may translate into reduced entry vehicle masses, increased robustness, and decreased operational risks during entry phases for science missions. Expanded ground test capabilities would also offer the ability to study material failure modes in environments even more representative of flight than are currently achievable. A list of desired future test capabilities is presented along with suggestions of possible methods of achieving each. The main recommendation of this paper is the undertaking of a detailed study of the benefits and associated costs of each of these expanded capabilities to determine the best future path.

arc jet↗

Climate Reanalysis: Progress and Future Prospects

Reanalysis is the process whereby an unchanging data assimilation system is used to provide a consistent reprocessing of observations, typically spanning an extended segment of the historical data record. The process relies on an underlying model to combine often-disparate observations in a physically consistent manner, enabling production of gridded data sets for a broad range of applications including the study of historical weather events, preparation of climatologies, business sector development and, more recently, climate monitoring. Over the last few decades, several generations of reanalyses of the global atmosphere have been produced by various operational and research centers, focusing more or less on the period of regular conventional and satellite observations beginning in the mid to late twentieth century. There have also been successful efforts to extend atmospheric reanalyses back to the late nineteenth and early twentieth centuries, using mostly surface observations. Much progress has resulted from (and contributed to) advancements in numerical weather prediction, especially improved models and data assimilation techniques, increased computing capacity, the availability of new observation types and efforts to recover and improve the quality of historical ones. The recent extension of forecast systems that allow integrated modeling of meteorological, oceanic, land surface, and chemical variables provide the basic elements for coupled data assimilation. This has opened the door to the development of a new generation of coupled reanalyses of the Earth system, or integrated Earth system analyses (IESA). Evidence so far suggests that this approach can improve the analysis of currently uncoupled components of the Earth system, especially at their interface, and lead to increased predictability. However, extensive analysis coupling as envisioned for IESA, while progressing, still presents significant challenges. These include model biases that can be exacerbated when coupled, component systems with different physical characteristics and different spatial and temporal scales, and component observations in different media with different spatial and temporal frequencies and different latencies. Quantification of uncertainty in reanalyses is also a critical challenge and is important for expanding their utility as a tool for climate change assessment. This talk provides a brief overview of the progress of reanalysis development during recent decades, and describes remaining challenges in the progression toward coupled Earth system reanalyses.

IES↗

Application of snowcovered area to runoff forecasting in selected basins of the Sierra Nevada, California

The author has identified the following significant results. Direct overlay onto 1:1,000,000 prints takes about one third the time of 1:500,000 zone transfer scope analysis using transparencies, but the consistency of the transparencies reduce the time for data analysis. LANDSAT data received on transparencies is better and more easily interpreted than the near real-time data from Quick Look, or imagery from other sources such as NOAA. The greatest potential for water supply forecasting is probably in improving forecast accuracy and in expanding forecast services during the period of snowmelt. Problems of transient snow line and uncertainties in future weather are the main reasons that snow cover area appears to offer little in water supply forecast accuracy improvement during the peroid snowpack accumulation.

Brown, A. J.↗

Ocean Carbon From Space: Current Status and Priorities for the Next Decade

The ocean plays a central role in modulating the Earth’s carbon cycle. Monitoring how the ocean carbon cycle is changing is fundamental to managing climate change. Satellite remote sensing is currently our best tool for viewing the ocean surface globally and systematically, at high spatial and temporal resolutions, and the past few decades have seen an exponential growth in studies utilising satellite data for ocean carbon research. Satellite-based observations must be combined with in-situ observations and models, to obtain a comprehensive view of ocean carbon pools and fluxes. To help prioritise future research in this area, a workshop was organised that assembled leading experts working on the topic, from around the world, including remote-sensing scientists, field scientists and modellers, with the goal to articulate a collective view of the current status of ocean carbon research, identify gaps in knowledge, and formulate a scientific roadmap for the next decade, with an emphasis on evaluating where satellite remote sensing may contribute. A total of 449 scientists and stakeholders participated (with balanced gender representation), from North and South America, Europe, Asia, Africa, and Oceania. Sessions targeted both inorganic and organic pools of carbon in the ocean, in both dissolved and particulate form, as well as major fluxes of carbon between reservoirs (e.g., primary production) and at interfaces (e.g., air-sea and land–ocean). Extreme events, blue carbon and carbon budgeting were also key topics discussed. Emerging priorities identified include: expanding the networks and quality of in-situ observations; improved satellite retrievals; improved uncertainty quantification; improved understanding of vertical distributions; integration with models; improved techniques to bridge spatial and temporal scales of the different data sources; and improved fundamental understanding of the ocean carbon cycle, and of the interactions among pools of carbon and light. We also report on priorities for the specific pools and fluxes studied, and highlight issues and concerns that arose during discussions, such as the need to consider the environmental impact of satellites or space activities; the role satellites can play in monitoring ocean carbon dioxide removal approaches; economic valuation of the satellite based information; to consider how satellites can contribute to monitoring cycles of other important climatically-relevant compounds and elements; to promote diversity and inclusivity in ocean carbon research; to bring together communities working on different aspects of planetary carbon; maximising use of international bodies; to follow an open science approach; to explore new and innovative ways to remotely monitor ocean carbon; and to harness quantum computing. Overall, this paper provides a comprehensive scientific roadmap for the next decade on how satellite remote sensing could help monitor the ocean carbon cycle, and its links to the other domains, such as terrestrial and atmosphere.

oceanography↗