Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

Optimizing the Performance of Radionuclide Identification Software in the Hunt for Nuclear Security Threats

The Radionuclide Analysis Kit (RNAK), my team’s most recent nuclide identification software, is entering the testing phase. A question arises: will removing rare nuclides from the software’s library improve its overall performance? An affirmative response indicates fundamental errors in the software’s framework, while a negative response confirms the effectiveness of the software’s key machine learning algorithms. After thorough testing, I found that the performance of RNAK cannot be improved with the library choice effect, thus verifying the effectiveness of RNAK’s algorithms—multiple linear regression, Bayesian network using the Viterbi algorithm, and branch and bound search.

97 MATHEMATICS AND COMPUTING↗

Physics based Reliability Models for Supercritical CO 2 Turbomachinery Components

CSP plants using sCO 2 power cycle can potentially achieve high thermal conversion efficiency at low capital cost due to compact turbo-machinery and other components. An sCO 2 expander and improved heat exchanger is expected to provide a major stepping stone for achieving CSP power at $0.06/kW-hr LCOE, energy conversion efficiency > 50%, and total power block cost < $1,200/kW installed. Hybrid gas bearings (HGB) and Dry gas seals (DGS) are two key components that are critical for robust and efficient operation of future sCO 2 power cycles. From a system perspective, HGBs can provide substantial benefits (~3 to 5%) to the modular CSP operation, while use of DGSs limits the leakage losses as well as the windage losses in the generator and can increase overall generator efficiency by ~ 8%. The life limiting mechanisms of HGBs and DGSs in high pressure, high temperature sCO2 environment were not well understood and hence this program aims at developing physics-based performance prediction and life prediction models for these two components. The output of the performance models serves as input to the life models. The performance models were validated using experimental data and using data from literature. DGS and HGB models have shed light on some risks associated with its operation in sCO2 expander and will guide more robust designs tailored towards sCO 2 cycle applications. A DGS was tested in 1MWe sCO2 turbo expander to study its performance and validate the performance models. To understand the effect of high pressures, high temperatures and sCO 2 environment on crack initiation, crack propagation and LCF/HCF life of these components, a novel experimental setup was developed. The LCF test data was used to calibrate and validate the life prediction models. The effect of sCO 2 corrosion on the life of Ni-based super-alloys is quantified using long duration experiments. Advanced microstructure and spectroscopic analyses conducted shed light on some key differences between IN718 and IN617 in terms of oxidation morphology, chemical species diffusion and trapping, the formation of protective corrosion resistant layers and changes in surface properties. A novel crack initiation model was developed which takes into account strain distribution, temperature, hold times and activation energy at the gas-metal interface and predicts the number of cycles to initiate the crack in the Inconel alloy. An advanced 3D fracture mechanics-based crack propagation model was also developed which takes into account the transient loading mission of the component and predict how fast the crack will grow and what will be its final shape and size. High energy X-Ray tomography measurements were conducted to study and validate 3D morphology of crack growth inside the specimen. These two models along with chemical kinetics models obtained from corrosion tests can be combined to predict the total life of the component under given long term operating conditions. A Bayesian Hybrid Modeling (BHM) probabilistic framework was developed to quantify uncertainty in physics-based performance models and in crack initiation and crack propagation models, to calibrate the models and to validate the models with statistical confidence. Advanced coupled physics multi-phase flow models were developed to study condensation, boiling and phase change behavior of CO 2 under various sCO 2 turbomachinery and heat exchanger conditions. A novel experimental setup was also designed to observe phase change of CO 2 during its transition across liquid-gas-supercritical state lines.

14 SOLAR ENERGY↗

Physics based Reliability Models for Supercritical CO 2 Turbomachinery Components

CSP plants using sCO 2 power cycle can potentially achieve high thermal conversion efficiency at low capital cost due to compact turbo-machinery and other components. An sCO 2 expander and improved heat exchanger is expected to provide a major stepping stone for achieving CSP power at 0.06/kW-hr LCOE, energy conversion efficiency > 50 % ,and total power block cost< $1,200/kW installed. Hybrid gas bearings (HGB) and Dry gas seals (DGS) are two key components that are critical for robust and efficient operation of future sCO 2 power cycles. From a system perspective, HGBs can provide substantial benefits (~3 to 5%) to the modular CSP operation, while use of DGSs limits the leakage losses as well as the windage losses in the generator and can increase overall generator efficiency by ~ 8%. The life limiting mechanisms of HGBs and DGSs in high pressure, high temperature sCO 2 environment were not well understood and hence this program aims at developing physics-based performance prediction and life prediction models for these two components. The output of the performance models serves as input to the life models. The performance models were validated using experimental data and using data from literature. DGS and HGB models have shed light on some risks associated with its operation in sCO 2 expander and will guide more robust designs tailored towards sCO 2 cycle applications. A DGS was tested in 1MWe sCO 2 turbo expander to study its performance and validate the performance models. To understand the effect of high pressures, high temperatures and sCO 2 environment on crack initiation, crack propagation and LCF/HCF life of these components, a novel experimental setup was developed. The LCF test data was used to calibrate and validate the life prediction models. The effect of sCO 2 corrosion on the life of Ni-based super-alloys is quantified using long duration experiments. Advanced microstructure and spectroscopic analyses conducted shed light on some key differences between IN718 and IN617 in terms of oxidation morphology, chemical species diffusion and trapping, the formation of protective corrosion resistant layers and changes in surface properties. A novel crack initiation model was developed which takes into account strain distribution, temperature, hold times and activation energy at the gas-metal interface and predicts the number of cycles to initiate the crack in the Inconel alloy. An advanced 3D fracture mechanics-based crack propagation model was also developed which takes into account the transient loading mission of the component and predict how fast the crack will grow and what will be its final shape and size. High energy X-Ray tomography measurements were conducted to study and validate 3D morphology of crack growth inside the specimen. These two models along with chemical kinetics models obtained from corrosion tests can be combined to predict the total life of the component under given long term operating conditions. A Bayesian Hybrid Modeling (BHM) probabilistic framework was developed to quantify uncertainty in physics-based performance models and in crack initiation and crack propagation models, to calibrate the models and to validate the models with statistical confidence. Advanced coupled physics multi-phase flow models were developed to study condensation, boiling and phase change behavior of CO 2 under various sCO 2 turbomachinery and heat exchanger conditions. A novel experimental setup was also designed to observe phase change of CO 2 during its transition across liquid-gas-supercritical state lines.

14 SOLAR ENERGY↗

Do large and small earthquakes start alike? Rupture determinism and earthquake early warning

Do earthquakes large and small begin alike, or are there systematic differences in the nucleation or early rupture process that determine the final earthquake size? This question of rupture determinism is one of the outstanding challenges in earthquake physics, and has significant implications for earthquake early warning systems, which rely on the ability to rapidly estimate earthquake magnitudes based on small snapshots of waveform data. Here I examine the question of rupture determinism using a massive dataset of strong-motion acceleration waveforms from M4-9 earthquakes occurring near Japan over the past 20 years. We analyze the time-evolution of peak displacement from more than 130,000 strong-motion waveforms, finding no significant evidence for deterministic rupture in our dataset. We then use these observations to develop a rigorous Bayesian framework for calculating time-dependent uncertainties in earthquake early warning systems like ShakeAlert, which is currently undergoing testing for the western United States. This work forms the basis for future data-driven studies designed to improve methodology used real-time geophysical hazard assessments.

58 GEOSCIENCES↗

A Novel Statistical Method for Measuring the Temperature–Density Relation in the IGM Using the b – N Hi Distribution of Absorbers in the Ly α Forest

We propose a new method for determining the thermal state of the intergalactic medium based on Voigt profile decomposition of the Lyα forest. The distribution of Doppler parameter and column density (b–N H i distribution) is sensitive to the temperature–density relation T = T 0 (ρ/ρ 0 ) γ-1 , and previous work has inferred T 0 and γ by fitting its low-b cutoff. This approach discards the majority of available data and is susceptible to systematics related to cutoff determination. We introduce an approach that exploits all information encoded in the b – N H i distribution by modeling its entire shape. We apply kernel density estimation to discrete absorption lines to generate model probability density functions, and then we use principal component decomposition to create an emulator that can be evaluated anywhere in thermal parameter space. We introduce a Bayesian likelihood based on these models enabling parameter inference via Markov Chain Monte Carlo. The method's robustness is tested by applying it to a large grid of thermal history simulations. By conducting 160 mock measurements, we establish that our approach delivers unbiased estimates and valid uncertainties for a 2D ( T 0 , γ) measurement. Furthermore, we conduct a pilot study applying this methodology to real observational data at z = 2. Using 200 absorbers, equivalent in path length to a single Lya forest spectrum, we measure $\mathrm{log}{T}_{0}={4.092}_{-0.055}^{+0.050}$ and $\gamma ={1.49}_{-0.074}^{+0.073}$ in excellent agreement with cutoff fitting determinations using the same data. Our method is far more sensitive than cutoff fitting, enabling measurements of log T 0 and γ with precision on $\mathrm{log}{T}_{0}$ (γ) nearly two (three) times higher for current data set sizes.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of errors in prior mean and variance in the estimation of integrated circuit failure rates using Bayesian methods

The critical point of any Bayesian analysis concerns the choice and quantification of the prior information. The effects of prior data on a Bayesian analysis are studied. Comparisons of the maximum likelihood estimator, the Bayesian estimator, and the known failure rate are presented. The results of the many simulated trails are then analyzed to show the region of criticality for prior information being supplied to the Bayesian estimator. In particular, effects of prior mean and variance are determined as a function of the amount of test data available.

Fletcher, B. C.↗

Signal processing for airborne doppler radar detection of hazardous wind shear as applied to NASA 1991 radar flight experiment data

Radar data collected during the 1991 NASA flight tests have been selectively analyzed to support research directed at developing both improved as well as new algorithms for detecting hazardous low-altitude windshear. Analysis of aircraft attitude data from several flights indicated that platform stability bandwidths were small compared to the data rate bandwidths which should support an assumption that radar returns can be treated as short time stationary. Various approaches at detection of weather returns in the presence of ground clutter are being investigated. Non-coventional clutter rejection through spectrum mode tracking and classification algorithms is a subject of continuing research. Based upon autoregressive modeling of the radar return time sequence, this approach may offer an alternative to overcome errors in conventional pulse-pair estimates. Adaptive filtering is being evaluated as a means of rejecting clutter with emphasis on low signal-to-clutter ratio situations, particularly in the presence of discrete clutter interference. An analysis of out-of-range clutter returns is included to illustrate effects of ground clutter interference due to range aliasing for aircraft on final approach. Data are presented to indicate how aircraft groundspeed might be corrected from the radar data as well as point to an observed problem of groundspeed estimate bias variation with radar antenna scan angle. A description of how recorded clutter return data are mixed with simulated weather returns is included. This enables the researcher to run controlled experiments to test signal processing algorithms. In the summary research efforts involving improved modelling of radar ground clutter returns and a Bayesian approach at hazard factor estimation are mentioned.

Baxa, Ernest G., Jr.↗

Efficient uncertainty quantification methodologies for high-dimensional climate land models

In this report, we proposed, examined and implemented approaches for performing efficient uncertainty quantification (UQ) in climate land models. Specifically, we applied Bayesian compressive sensing framework to a polynomial chaos spectral expansions, enhanced it with an iterative algorithm of basis reduction, and investigated the results on test models as well as on the community land model (CLM). Furthermore, we discussed construction of efficient quadrature rules for forward propagation of uncertainties from high-dimensional, constrained input space to output quantities of interest. The work lays grounds for efficient forward UQ for high-dimensional, strongly non-linear and computationally costly climate models. Moreover, to investigate parameter inference approaches, we have applied two variants of the Markov chain Monte Carlo (MCMC) method to a soil moisture dynamics submodel of the CLM. The evaluation of these algorithms gave us a good foundation for further building out the Bayesian calibration framework towards the goal of robust component-wise calibration.

54 ENVIRONMENTAL SCIENCES↗

A Multi-Armed Bayesian Ordinal Outcome Utility-Based Sequential Trial with a Pairwise Null Clustering Prior

A multi-armed trial based on ordinal outcomes is proposed that leverages a flexible non-proportional odds cumulative logit model and numerical utility scores for each outcome to determine treatment optimality. This trial design uses a Bayesian clustering prior on the treatment effects that encourages the pairwise null hypothesis of no differences between treatments. A group sequential design is proposed to determine which treatments are clinically different with an adaptive decision boundary that becomes more aggressive as the sample size or clinical significance grows, or the number of active treatments decreases. A simulation study is conducted for 3 and 5 treatment arms, which shows that the design has superior operating characteristics (family wise error rate, generalized power, average sample size) compared to utility designs that do not allow clustering, a frequentist proportional odds model, or a permutation test based on empirical mean utilities.

97 MATHEMATICS AND COMPUTING↗

THE DEMOGRAPHICS OF BROAD-LINE QUASARS IN THE MASS-LUMINOSITY PLANE. I. TESTING FWHM-BASED VIRIAL BLACK HOLE MASSES

We jointly constrain the luminosity function (LF) and black hole mass function (BHMF) of broad-line quasars with forward Bayesian modeling in the quasar mass-luminosity plane, based on a homogeneous sample of {approx}58, 000 Sloan Digital Sky Survey (SDSS) Data Release 7 quasars at z {approx} 0.3-5. We take into account the selection effect of the sample flux limit; more importantly, we deal with the statistical scatter between true BH masses and FWHM-based single-epoch virial mass estimates, as well as potential luminosity-dependent biases of these mass estimates. The LF is tightly constrained in the regime sampled by SDSS and makes reasonable predictions when extrapolated to {approx}3 mag fainter. Downsizing is seen in the model LF. On the other hand, we find it difficult to constrain the BHMF to within a factor of a few at z {approx}> 0.7 (with Mg II and C IV-based virial BH masses). This is mainly driven by the unknown luminosity-dependent bias of these mass estimators and its degeneracy with other model parameters, and secondly driven by the fact that SDSS quasars only sample the tip of the active BH population at high redshift. Nevertheless, the most likely models favor a positive luminosity-dependent bias for Mg II and possibly for C IV, such that at fixed true BH mass, objects with higher-than-average luminosities have overestimated FWHM-based virial masses. There is tentative evidence that downsizing also manifests itself in the active BHMF, and the BH mass density in broad-line quasars contributes an insignificant amount to the total BH mass density at all times. Within our model uncertainties, we do not find a strong BH mass dependence of the mean Eddington ratio, but there is evidence that the mean Eddington ratio (at fixed BH mass) increases with redshift.

79 ASTRONOMY AND ASTROPHYSICS↗

Composite Bond Line Measurements Based on A Bayesian Analysis of Flash Thermography Data

For bonded composite materials, an accurate characterization of the adhesive bond line is needed to predict failure modes and fracture toughness. In this paper, bond line thickness was estimated from data obtained using through transmission flash thermography. The forward model that predicts back surface temperature is based on a three layer heat diffusion equation with varying diffusivity and flux boundary conditions. The corresponding inverse problem of estimating bond line thickness from measurement data was solved using a Bayesian approach that assumed Gaussian priors for the bond line thickness and thermal diffusivity of the adherends. Finally, the outputs of the thermography based method were compared to measurements that were collected using a micrometer and ultrasound testing.

Flash thermography↗

Application of Machine Learning to Rotorcraft Health Monitoring

Machine learning is a powerful tool for data exploration and model building with large data sets. This project aimed to use machine learning techniques to explore the inherent structure of data from rotorcraft gear tests, relationships between features and damage states, and to build a system for predicting gear health for future rotorcraft transmission applications. Classical machine learning techniques are difficult, if not irresponsible to apply to time series data because many make the assumption of independence between samples. To overcome this, Hidden Markov Models were used to create a binary classifier for identifying scuffing transitions and Recurrent Neural Networks were used to leverage long distance relationships in predicting discrete damage states. When combined in a workflow, where the binary classifier acted as a filter for the fatigue monitor, the system was able to demonstrate accuracy in damage state prediction and scuffing identification. The time dependent nature of the data restricted data exploration to collecting and analyzing data from the model selection process. The limited amount of available data was unable to give useful information, and the division of training and testing sets tended to heavily influence the scores of the models across combinations of features and hyper-parameters. This work built a framework for tracking scuffing and fatigue on streaming data and demonstrates that machine learning has much to offer rotorcraft health monitoring by using Bayesian learning and deep learning methods to capture the time dependent nature of the data. Suggested future work is to implement the framework developed in this project using a larger variety of data sets to test the generalization capabilities of the models and allow for data exploration.

machine learning↗

Conservative Estimation of Tail Probabilities from Limited Sample Data

Several sparse-sample uncertainty quantification (UQ) methods are compared for conservative but not overly conservative estimation of small tail probabilities involving responses that lay beyond specified thresholds in the tails of probability distributions. Sixteen very differently shaped distributions (or probability density functions, PDFs) and tail probability magnitudes ranging from 10 -5 to 10 -1 are considered in order for the study to be relevant to a wide range of risk analysis and quantification of margins and uncertainty (QMU) problems. The emphasis of the study is on limited data regimes ranging from N = 2 to 20 samples, reflective of most experimental and some expensive computational situations. Relatively simple sparse-sample UQ methods tested for this regime involve statistical tolerance interval "Equivalent Normal and related "Ensemble of Normals" and "Superdistribution (SD) approaches. (The independently derived SD is effectively equivalent to the Bayesian posterior predictive distribution given the assumptions of the derivation.) The performance of the methods was generally improved for N ≥ 5 samples with a generalized Jackknife resampling technique, which determines a tail probability estimate by averaging estimates from smaller sub-samples. Several quantitative metrics for method conservatism and accuracy of tail probability estimation are used to assess and rank the methods' performance over many random trials for each test PDF and probability magnitude. A variant of Bootstrap resampling was also tried, but did not significantly improve tail probability estimates in most cases. Detailed results are presented from over 100-million tests over the above factors that provide useful granular information on which methods or combination of methods perform best in various areas of the factor space.

97 MATHEMATICS AND COMPUTING↗

Optimizing Carbon Cycle Parameters Drastically Improves Terrestrial Biosphere Model Underestimates of Dryland Mean Net CO 2 Flux and its Inter-Annual Variability

Drylands occupy ~40% of the land surface and are thought to dominate global carbon (C) cycle inter-annual variability (IAV). Therefore, it is imperative that global terrestrial biosphere models (TBMs), which form the land component of IPCC earth system models, are able to accurately simulate dryland vegetation and biogeochemical processes. However, compared to more mesic ecosystems, TBMs have not been widely tested or optimized using in situ dryland CO 2 fluxes. Here, for this work, we address this gap using a Bayesian data assimilation system and 89 site-years of daily net ecosystem exchange (NEE) data from 12 southwest US Ameriflux sites to optimize the C cycle parameters of the ORCHIDEE TBM. The sites span high elevation forest ecosystems, which are a mean sink of C, and low elevation shrub and grass ecosystems that are either a mean C sink or “pivot” between an annual C sink and source. We find that using the default (prior) model parameters drastically underestimates both the mean annual NEE at the forested mean C sink sites and the NEE IAV across all sites. Our analysis demonstrated that optimizing phenology parameters are particularly useful in improving the model's ability to capture both the magnitude and sign of the NEE IAV. At the forest sites, optimizing C allocation, respiration, and biomass and soil C turnover parameters reduces the underestimate in simulated mean annual NEE. Our study demonstrates that all TBMs need to be calibrated for dryland ecosystems before they are used to determine dryland contributions to global C cycle variability and long-term carbon-climate feedbacks.

59 BASIC BIOLOGICAL SCIENCES↗

Deep-learning-enabled Bayesian inference of fuel magnetization in magnetized liner inertial fusion

Fuel magnetization in magneto-inertial fusion (MIF) experiments improves charged burn product confinement, reducing requirements on fuel areal density and pressure to achieve self-heating. By elongating the path length of 1.01 MeV tritons produced in a pure deuterium fusion plasma, magnetization enhances the probability for deuterium–tritium reactions producing 11.8-17.1 MeV neutrons. Nuclear diagnostics thus enable a sensitive probe of magnetization. Characterization of magnetization, including uncertainty quantification, is crucial for understanding the physics governing target performance in MIF platforms, such as magnetized liner inertial fusion (MagLIF) experiments conducted at Sandia National Laboratories, Z-facility. We demonstrate a deep-learned surrogate of a physics-based model of nuclear measurements. A single model evaluation is reduced from O ( 10 – 100 ) (10–100) CPU hours on a high-performance computing cluster down to O ( 10 – 100 ) (10) ms on a laptop. This enables a Bayesian inference of magnetization, rigorously accounting for uncertainties from surrogate modeling and noisy nuclear measurements. The approach is validated by testing on synthetic data and comparing with a previous study. We analyze a series of MagLIF experiments systematically varying preheat, resulting in the first ever systematic experimental study of magnetic confinement properties of the fuel plasma as a function of fundamental inputs on any neutron-producing MIF platform. We demonstrate that magnetization decreases from B R &#x223C; 0.2 ~0.5 to B R &#x223C; 0.2 ~0.2 MG cm as laser preheat energy deposited increases from E preheat &#x223C; 460 ~460 J to E preheat &#x223C; 460 ~1.4 kJ. This trend is consistent with 2D LASNEX simulations showing Nernst advection of the magnetic field out of the hot fuel and diffusion into the target liner.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Star-galaxy classification in the Dark Energy Survey Y1 dataset

Here, we perform a comparison of different approaches to star-galaxy classification using the broad-band photometric data from Year 1 of the Dark Energy Survey. We explore and compare different techniques to address this problem: morphological versus using additional flux information, differences between machine-learning, cut based and template fitting including Hierarchical Bayesian methods and catalogue-based versus image-based analyses. This is done by performing a wide range of tests with and without external ‘truth’ information, which can be ported to other similar datasets. We make a broad evaluation of the performance of the classifiers in two science cases with DES data that are most affected by this systematic effect: large-scale structure and Milky Way studies. In general, even though the default morphological classifiers used for DES Y1 cosmology studies are sufficient to maintain a low level of systematic contamination from stellar mis-classification, contamination can be reduced to the O (1%) level by using multi-epoch and infrared information from external datasets. For Milky Way studies the stellar sample can be augmented by ~20% for a given flux limit. Reference catalogues used in this work are available at http://des.ncsa.illinois.edu/releases/y1a1.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗