Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Composite Bond Line Measurements Based on A Bayesian Analysis of Flash Thermography Data

For bonded composite materials, an accurate characterization of the adhesive bond line is needed to predict failure modes and fracture toughness. In this paper, bond line thickness was estimated from data obtained using through transmission flash thermography. The forward model that predicts back surface temperature is based on a three layer heat diffusion equation with varying diffusivity and flux boundary conditions. The corresponding inverse problem of estimating bond line thickness from measurement data was solved using a Bayesian approach that assumed Gaussian priors for the bond line thickness and thermal diffusivity of the adherends. Finally, the outputs of the thermography based method were compared to measurements that were collected using a micrometer and ultrasound testing.

Flash thermography↗

Application of Machine Learning to Rotorcraft Health Monitoring

Machine learning is a powerful tool for data exploration and model building with large data sets. This project aimed to use machine learning techniques to explore the inherent structure of data from rotorcraft gear tests, relationships between features and damage states, and to build a system for predicting gear health for future rotorcraft transmission applications. Classical machine learning techniques are difficult, if not irresponsible to apply to time series data because many make the assumption of independence between samples. To overcome this, Hidden Markov Models were used to create a binary classifier for identifying scuffing transitions and Recurrent Neural Networks were used to leverage long distance relationships in predicting discrete damage states. When combined in a workflow, where the binary classifier acted as a filter for the fatigue monitor, the system was able to demonstrate accuracy in damage state prediction and scuffing identification. The time dependent nature of the data restricted data exploration to collecting and analyzing data from the model selection process. The limited amount of available data was unable to give useful information, and the division of training and testing sets tended to heavily influence the scores of the models across combinations of features and hyper-parameters. This work built a framework for tracking scuffing and fatigue on streaming data and demonstrates that machine learning has much to offer rotorcraft health monitoring by using Bayesian learning and deep learning methods to capture the time dependent nature of the data. Suggested future work is to implement the framework developed in this project using a larger variety of data sets to test the generalization capabilities of the models and allow for data exploration.

machine learning↗

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

A generalized concept for cost-effective structural design

A generalized concept for cost-effective structural design is introduced. It is assumed that decisions affecting the cost effectiveness of aerospace structures fall into three basic categories: design, verification, and operation. Within these basic categories, certain decisions concerning items such as design configuration, safety factors, testing methods, and operational constraints are to be made. All or some of the variables affecting these decisions may be treated probabilistically. Bayesian statistical decision theory is used as the tool for determining the cost optimum decisions. A special case of the general problem is derived herein, and some very useful parametric curves are developed and applied to several sample structures.

Thomas, J. M.↗

The multicategory case of the sequential Bayesian pixel selection and estimation procedure

A Bayesian technique for stratified proportion estimation and a sampling based on minimizing the mean squared error of this estimator were developed and tested on LANDSAT multispectral scanner data using the beta density function to model the prior distribution in the two-class case. An extention of this procedure to the k-class case is considered. A generalization of the beta function is shown to be a density function for the general case which allows the procedure to be extended.

Pore, M. D.↗

Bayesian Approach for Reliability Assessment of Sunshield Deployment on JWST

Deployable subsystems are essential to mission success of most spacecraft. These subsystems enable critical functions including power, communications and thermal control. The loss of any of these functions will generally result in loss of the mission. These subsystems and their components often consist of unique designs and applications, for which various standardized data sources are not applicable for estimating reliability and for assessing risks. In this study, a Bayesian approach for reliability estimation of spacecraft deployment was developed for this purpose. This approach was then applied to the James Webb Space Telescope (JWST) Sunshield subsystem, a unique design intended for thermal control of the observatory's telescope and science instruments. In order to collect the prior information on deployable systems, detailed studies of "heritage information", were conducted extending over 45 years of spacecraft launches. The NASA Goddard Space Flight Center (GSFC) Spacecraft Operational Anomaly and Reporting System (SOARS) data were then used to estimate the parameters of the conjugative beta prior distribution for anomaly and failure occurrence, as the most consistent set of available data and that could be matched to launch histories. This allows for an emperical Bayesian prediction for the risk of an anomaly occurrence of the complex Sunshield deployment, with credibility limits, using prior deployment data and test information.

Kaminskiy, Mark P.↗

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to three combined HZE-irradiated mouse datasets

Radiation health risks are predominantly derived from low linear energy transfer (LET) terrestrial exposures; however, space radiation includes exposure to high-LET and high-charge, high-energy (HZE) particles. Accurately quantifying the differences in radiation quality between the space and terrestrial radiation environments is important for assessing and predicting health risks for astronauts. Weil et al. 2009 and 2014 used two different inbred mouse strains to study differences in hepatocellular carcinoma (HCC) tumorigenesis after exposures to low- and high- LET radiation. More recently, Edmundson et al. 2020 provided valuable new tumor data in outbred mice that were exposed to low- and high-LET radiation. The present study aims to rigorously investigate a relative biological effectiveness (RBE) factor by leveraging the HCC tumor data from Weil et al. 2009, Weil et al. 2014, and Edmundson et al. 2020. The three experiments were similarly designed, allowing the raw data to be combined into a pooled dataset to estimate excess relative risk (ERR) and excess absolute risk (EAR) models using Bayesian Poisson regression. These effect estimates from the pooled data provide greater power to calculate a data driven RBE. Extensive sensitivity analyses test the robustness of RBE estimates to various model assumptions. The following questions will be explored through the sensitivity analyses: • Is the shape of the dose response different for low-LET radiation and HZE radiation, indicating that RBE is a function of dose? • Does attained age modify the effect estimates differently for low-LET radiation and HZE radiation, indicating RBE is a function of attained age? • Are the effect estimates and RBE estimates different for inbred mouse strains and outbred mouse strains? • Do assumptions about differences in ERR models and EAR models change the estimated RBE? Additional studies would be needed to validate the findings from these exploratory analyses.

Lori J. Chappell↗

Methods Studies on System Identification from Transient Rotor Tests

Some of the more important methods are discussed that have been used or proposed for aircraft parameter identification. The methods are classified into two groups: Equation error or regression estimates and Bayesian estimates and their derivatives that are based on probabilistic concepts. In both of these two groups the cost function can be optimized either globally over the entire time span of the transient, or sequentially, leading to the formulation of optimum filters. Identifiability problems and the validation of the estimates are briefly outlined, and applications to lifting rotors are discussed.

Hohenemser, K. H.↗

Sequential Probability Ratio Test for Collision Avoidance Maneuver Decisions

When facing a conjunction between space objects, decision makers must chose whether to maneuver for collision avoidance or not. We apply a well-known decision procedure, the sequential probability ratio test, to this problem. We propose two approaches to the problem solution, one based on a frequentist method, and the other on a Bayesian method. The frequentist method does not require any prior knowledge concerning the conjunction, while the Bayesian method assumes knowledge of prior probability densities. Our results show that both methods achieve desired missed detection rates, but the frequentist method's false alarm performance is inferior to the Bayesian method's

Carpenter, J. Russell↗

OGLE-2014-BLG-0962 and a Comparison of Galactic Model Priors to Microlensing Data

OGLE-2014-BLG-0962 (OB140962) is a stellar binary microlensing event that was well covered by observations from the Spitzer satellite as well as ground-based surveys. Modeling yields a unique physical solution: a mid-M+M-dwarf binary with M(prim) = 0.20 ± 0.01 M(☉) and M(sec) = 0.16 ± 0.01 M(☉), with projected separation of 2.0 ± 0.3 au. The lens is only D(LS) = 0.41 ± 0.06 kpc in front of the source, making OB140962 a bulge lens and the most distant Spitzer binary lens to date. In contrast, because the Einstein radius (θ(E) = 0.143 ± 0.007 mas) is unusually small, a standard Bayesian analysis, conducted in the absence of parallax information, would predict a brown dwarf binary. We compare the results of Bayesian analysis using two commonly used Galactic model priors to the measured values for a set of Spitzer lenses. We find all models tested predict lens properties consistent with the Spitzer data. Furthermore, we illustrate the methodology for probing the Galactic distribution of planets by comparing the cumulative distance distribution of the Spitzer two-body lenses to that of the Spitzer single lenses.

Yutong Shan↗

Low-Earth Orbit Trajectory Optimization in the Presence of Atmospheric Uncertainty

The previous 20 to 25 years have seen a tremendous increase in space exploration, and with that an increase in the level of logistics planning needed to ensure mission success. For spacecraft that are designed to be periodically re-supplied, a key logistics consumable is propellant, as it constitutes the greatest up-mass on re-supply vehicles. A trajectory design strategy is therefore desired that minimizes propellant usage in order to ease the demand for propellant re-supply missions. This thesis develops such a strategy in three stages, and uses the International Space Station (ISS) as its testbed, as no other LEO spacecraft is more challenging from a space logistics standpoint. First, the ISS trajectory planning problem is formulated as a constrained burn optimization problem assuming a deterministic atmosphere. The cost function is total ∆v, with constraints imposed on longitude of ascending viii node (LAN) and semi-major axis (SMA) altitude. Analytic derivatives are constructed for both the cost and constraints, which are necessary given the 6-week to 2-year time frames being considered. A gradient-based optimizer is then utilized to find locally-optimal solutions to real-world ISS trajectory planning problems. Second, atmospheric uncertainty is addressed by constructing a probabilistic model of space weather data using Gaussian Processes (GPs). Bayesian inference is performed using the GP model to generate mean and covariance estimates for space weather predictions, whose pedigree is assessed against test data. The predictions are then mapped into atmospheric density via the analytic Jacchia-Roberts density model, and the effect of space weather uncertainty on orbital lifetime is examined. Third, an ISS burn execution uncertainty model is developed. This model, along with the space weather uncertainty model, are deployed in a linear covariance analysis to ascertain their combined effect on LAN and SMA altitude dispersions. The deterministic constraints from the original problem are re-formulated as stochastic constraints, where now the constraint uncertainty interval is required to fall within specified bounds. An updated optimization framework is constructed using the original ∆v cost function along with the stochastic constraints to solve the trajectory optimization problem under atmospheric uncertainty. Finally, the complete architecture is summarized for deployment in an operational setting.

Trajectory Optimization↗

A Bayesian Framework for Reliability Analysis of Spacecraft Deployments

Deployable subsystems are essential to mission success of most spacecraft. These subsystems enable critical functions including power, communications and thermal control. The loss of any of these functions will generally result in loss of the mission. These subsystems and their components often consist of unique designs and applications for which various standardized data sources are not applicable for estimating reliability and for assessing risks. In this study, a two stage sequential Bayesian framework for reliability estimation of spacecraft deployment was developed for this purpose. This process was then applied to the James Webb Space Telescope (JWST) Sunshield subsystem, a unique design intended for thermal control of the Optical Telescope Element. Initially, detailed studies of NASA deployment history, "heritage information", were conducted, extending over 45 years of spacecraft launches. This information was then coupled to a non-informative prior and a binomial likelihood function to create a posterior distribution for deployments of various subsystems uSing Monte Carlo Markov Chain sampling. Select distributions were then coupled to a subsequent analysis, using test data and anomaly occurrences on successive ground test deployments of scale model test articles of JWST hardware, to update the NASA heritage data. This allowed for a realistic prediction for the reliability of the complex Sunshield deployment, with credibility limits, within this two stage Bayesian framework.

Evans, John W.↗

Comparison of two weighted integration models for the cueing task: linear and likelihood

In a task in which the observer must detect a signal at two locations, presenting a precue that predicts the location of a signal leads to improved performance with a valid cue (signal location matches the cue), compared to an invalid cue (signal location does not match the cue). The cue validity effect has often been explained with a limited capacity attentional mechanism improving the perceptual quality at the cued location. Alternatively, the cueing effect can also be explained by unlimited capacity models that assume a weighted combination of noisy responses across the two locations. We compare two weighted integration models, a linear model and a sum of weighted likelihoods model based on a Bayesian observer. While qualitatively these models are similar, quantitatively they predict different cue validity effects as the signal-to-noise ratios (SNR) increase. To test these models, 3 observers performed in a cued discrimination task of Gaussian targets with an 80% valid precue across a broad range of SNR's. Analysis of a limited capacity attentional switching model was also included and rejected. The sum of weighted likelihoods model best described the psychophysical results, suggesting that human observers approximate a weighted combination of likelihoods, and not a weighted linear combination.

NASA Program Biomedical Research and Countermeasur↗

Diagnosing Intermittent and Persistent Faults using Static Bayesian Networks

Both intermittent and persistent faults may occur in a wide range of systems. We present in this paper the introduction of intermittent fault handling techniques into ProDiagnose, an algorithm that previously only handled persistent faults. We discuss novel algorithmic techniques as well as how our static Bayesian networks help diagnose, in an integrated manner, a range of intermittent and persistent faults. Through experiments with data from the ADAPT electrical power system test bed, generated as part of the Second International Diagnostic Competition (DXC-10), we show that this novel variant of ProDiagnose diagnoses intermittent faults accurately and quickly, while maintaining strong performance on persistent faults.

Megshoel, Ole Jakob↗

Sensor Selection and Data Validation for Reliable Integrated System Health Management

For new access to space systems with challenging mission requirements, effective implementation of integrated system health management (ISHM) must be available early in the program to support the design of systems that are safe, reliable, highly autonomous. Early ISHM availability is also needed to promote design for affordable operations; increased knowledge of functional health provided by ISHM supports construction of more efficient operations infrastructure. Lack of early ISHM inclusion in the system design process could result in retrofitting health management systems to augment and expand operational and safety requirements; thereby increasing program cost and risk due to increased instrumentation and computational complexity. Having the right sensors generating the required data to perform condition assessment, such as fault detection and isolation, with a high degree of confidence is critical to reliable operation of ISHM. Also, the data being generated by the sensors needs to be qualified to ensure that the assessments made by the ISHM is not based on faulty data. NASA Glenn Research Center has been developing technologies for sensor selection and data validation as part of the FDDR (Fault Detection, Diagnosis, and Response) element of the Upper Stage project of the Ares 1 launch vehicle development. This presentation will provide an overview of the GRC approach to sensor selection and data quality validation and will present recent results from applications that are representative of the complexity of propulsion systems for access to space vehicles. A brief overview of the sensor selection and data quality validation approaches is provided below. The NASA GRC developed Systematic Sensor Selection Strategy (S4) is a model-based procedure for systematically and quantitatively selecting an optimal sensor suite to provide overall health assessment of a host system. S4 can be logically partitioned into three major subdivisions: the knowledge base, the down-select iteration, and the final selection analysis. The knowledge base required for productive use of S4 consists of system design information and heritage experience together with a focus on components with health implications. The sensor suite down-selection is an iterative process for identifying a group of sensors that provide good fault detection and isolation for targeted fault scenarios. In the final selection analysis, a statistical evaluation algorithm provides the final robustness test for each down-selected sensor suite. NASA GRC has developed an approach to sensor data qualification that applies empirical relationships, threshold detection techniques, and Bayesian belief theory to a network of sensors related by physics (i.e., analytical redundancy) in order to identify the failure of a given sensor within the network. This data quality validation approach extends the state-of-the-art, from red-lines and reasonableness checks that flag a sensor after it fails, to include analytical redundancy-based methods that can identify a sensor in the process of failing. The focus of this effort is on understanding the proper application of analytical redundancy-based data qualification methods for onboard use in monitoring Upper Stage sensors.

Garg, Sanjay↗

Tool Support for Parametric Analysis of Large Software Simulation Systems

The analysis of large and complex parameterized software systems, e.g., systems simulation in aerospace, is very complicated and time-consuming due to the large parameter space, and the complex, highly coupled nonlinear nature of the different system components. Thus, such systems are generally validated only in regions local to anticipated operating points rather than through characterization of the entire feasible operational envelope of the system. We have addressed the factors deterring such an analysis with a tool to support envelope assessment: we utilize a combination of advanced Monte Carlo generation with n-factor combinatorial parameter variations to limit the number of cases, but still explore important interactions in the parameter space in a systematic fashion. Additional test-cases, automatically generated from models (e.g., UML, Simulink, Stateflow) improve the coverage. The distributed test runs of the software system produce vast amounts of data, making manual analysis impossible. Our tool automatically analyzes the generated data through a combination of unsupervised Bayesian clustering techniques (AutoBayes) and supervised learning of critical parameter ranges using the treatment learner TAR3. The tool has been developed around the Trick simulation environment, which is widely used within NASA. We will present this tool with a GN&C (Guidance, Navigation and Control) simulation of a small satellite system.

Schumann, Johann↗

An overview of the essential differences and similarities of system identification techniques

Information is given in the form of outlines, graphs, tables and charts. Topics include system identification, Bayesian statistical decision theory, Maximum Likelihood Estimation, identification methods, structural mode identification using a stochastic realization algorithm, and identification results regarding membrane simulations and X-29 flutter flight test data.

Mehra, Raman K.↗