Search NASA⌕ Search

SEARCH · Search NASA

Results for “Expert Judgement”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Laser Confocal Microscopy Uncertainty Quantification Study

At Los Alamos National Laboratory (LANL), the Storage Safety and Engineering (SSE) team completes annual surveillance on a subset of in-use interim nuclear material storage containers in fulfilment of requirements outlined in DOE Manual M 441.1-1. The containers are selected through several methods, such as subject matter expert judgement, random selection, and trending items. Following these selections, the SSE team has the capacity to complete surveillance on 15-20 containers each fiscal year, composed of a combination of SAVY-4000 and Hagan storage containers. Through previous work, the stainless-steel components of the containers have been identified as life limiting components, with an emphasis on the thin-walled bodies. The team is focused on understanding the extent of general and pitting corrosion, due to observations of extensive corrosion from stored contents and bag-out-bag degradation. Quantifying corrosion effects on the thin-walled stainless steel container bodies, and understanding potential impacts to the respective design release rates and design qualification release rates is paramount to the team. To date, destructive examination (DE) has proven to be the most insightful method for developing an understanding on the extent of corrosion on used containers. To standardize this process, the SSE team developed a destructive examination guide for analyzing stainless steel components of the containers. Corroded containers of interest are identified during surveillance activities and set aside for sectioning and characterization. Following sectioning, a major step in the DE workflow is the utilization of laser confocal microscopy for scanning corroded samples of interest and extracting data on pits, such as count, depth, and equivalent diameter. Adhering to the techniques outlined in the DE guide, analysis has been completed on two Hagans and one SAVY-4000 container, with the maximum pit depth recorded as 139.1 ± 22.82 μm on a 17.5 year old Hagan. The findings from the completed destructive examinations will be utilized to support lifetime extension efforts of the SAVY-4000 as the team can better estimate corrosion rates and effects over time based on stored contents and age. Due to the implications of observing extreme pit depths that approach the nominal container body thickness of .0299 inches (0.759 mm) or minimum container thickness of 0.236” (0.6 mm), high confidence in the LCM measurements is desired. Through testing outlined in, it was concluded that the total error ascribed to the 20x objective when conducting large image mapping on the Keyence VK-X3050 laser confocal microscope (LCM) relative to a 50x objective (reference) is 16.4% (± 8.73%). For shallow features on the order of pristine SAVY surface defects (i.e. 5 μm), this uncertainty is appropriate. However, this conservative estimate of total error poses a fundamental concern for pit depths that approach the thickness of the measured samples. That is, with the measurement uncertainty currently employed on all measurements, the LCM would be unable to resolve if a pit with a depth of 515 μm is through wall. Standard step height samples were procured and used in the present study to assess the resolution and repeatability of height measurements. Understanding the resolution and repeatability of height measurements was the first focus of the team as it relates directly to pit depth, which is of primary concern. Calibration gratings were procured to evaluate the resolution and repeatability of measurements in the X and Y axes of the LCM stage. The results of the depth uncertainty study were conducted first and presented in the subsequent sections. The planar uncertainty study is appended to the depth study with conclusions from both summarized at the end of the report.

36 MATERIALS SCIENCE↗

Investigation of Correlation Methods for Use in Criticality Safety

Although their adoption by practitioners has been limited, the introduction of similarity indices in criticality safety was a major step forward in reducing the reliance on expert judgement in discerning applicable experiments for the validation of new appliations in criticality safety analyses. Similarity indices have been successfully employed in bias trending and data assimilation techniques, but it is often unclear which acceptance criteria should be used. In their 2004 paper, Broadhead et al. specify the most widely used similarity parameter, ck, as an acceptance cutoff at 0.9. (Broadhead et al., ”Sensitivity and Uncertainty-Based Criticality Safety Validation Techniques,” Nucl. Sci. Eng. 146, 340–366, 2004). Experiments with a ck < 0.9 are often not considered applicable for code validation. This heuristic is based on quantitative studies and engineering judgement, but in some cases, experiments with ck < 0.9 can be used to accurately estimate computational bias. This suggests that further analysis is needed to determine what components of ck are driving applicability and accuracy in bias estimation. For cases in which applicable experiments may not be available (as is the case with UF6 transport canisters), understanding what distinguishes experiments in providing adequate bias estimates aside from just the similarity index is particularly necessary. To further the goal to better interpret ck values, several visualization tools were developed to assist in the investigation of which components of ck are driving applicability.

ck↗

Inferring Reliability Model Parameters from Expert Opinion

Here, we propose a method for constructing bathtub models of reliability from opinion. The method is intended for reliability studies early in the design and prototyping of a new system, before data concerning reliability has become available. A stylized bathtub curve is presented for soliciting best engineering judgement from technical experts. By pooling these stylized curves, we produce data that can be used to infer parameters for a piece-wise Weibull model of reliability. A numerical example demonstrates the practicality of the method while also highlighting potential pitfalls when working with subjective data.

42 ENGINEERING↗