SEARCH · Search NASA
Results for “Reliability Analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Overview of Human Reliability Analysis Research at Idaho National Laboratory
Introducing following HRA topics to visitors from Naval Nuclear Labs. - Dynamic HRA Method and Software (LWRS) - HRA Data Collection (LWRS) - HRA Consultation (KINS) - HRA for Advanced Nuclear Reactors (Hobby) - HRA for Non-Nuclear Industries (BEES)
GPU Lifetimes on Titan Supercomputer: Survival Analysis and Reliability
The Cray XK7 Titan was the top supercomputer system in the world for a long time and remained critically important throughout its nearly seven year life. It was an interesting machine from a reliability viewpoint as most of its power came from 18,688 GPUs whose operation was forced to execute three rework cycles, two on the GPU mechanical assembly and one on the GPU circuitboards. We write about the last rework cycle and a reliability analysis of over 100,000 years of GPU lifetimes during Titan’s 6-year-long productive period. Using time between failures analysis and statistical survival analysis techniques, we find that GPU reliability is dependent on heat dissipation to an extent that strongly correlates with detailed nuances of the cooling architecture and job scheduling. We describe the history, data collection, cleaning, and analysis and give recommendations for future supercomputing systems. We make the data and our analysis codes publicly available.
Importance of Sample Handling and Preparation for Surface Analysis: A Summary of ISO Standard 20579 Part 1, Documenting and Reporting the Handling of Specimens Prior to Analysis
Reliable and reproducible analysis of surfaces is critically dependent on how samples have been collected, handled, and prepared before analysis. Although there are important, well-established general guidelines to minimize unintended alteration of the surfaces to be analyzed, specific handling steps depend on the nature of the samples and information desired. Assessments of the validity and reliability of the results require adequate information about sampling, handling, and processing. ISO standard 20579 part 1 describes the information to be recorded and reported for samples that are prepared or submitted for surface analysis. This paper summarizes elements of the standard, which includes annexes that justify and inform the sample handling processes. Also included is a checklist of information that needs to be recorded and reported and an appendix containing an example of a form that might be used to report the information.
A functional global sensitivity measure and efficient reliability sensitivity analysis with respect to statistical parameters
Sensitivity analysis and reliability assessment are two important aspects of structural and system safety. Epistemic uncertainty with respect to probabilistic model of input parameters due to lack of knowledge is present in many scarce-data applications and complicates the characterization of uncertainty in model response. In this article, we present two importance measures to evaluate the impact of distribution parameters on the probability distribution function (PDF) of the output and the failure probability. The epistemic uncertainty associated with the distribution parameters is modeled as random variables. Additionally, a modified extended polynomial chaos expansion (MEPCE) approach is introduced in which aleatory and epistemic random variables are modeled and propagated simultaneously while allowing the separate assessment for any single epistemic variable. A MEPCE-based kernel density estimation (KDE) construction provides a composite map from each epistemic variable to the response PDF. The functional global sensitivity index of the PDF with respect to the distribution parameters is thus derived, as a function of output, which is both more informative and more efficient than standard scalar sensitivity measures. Reliability sensitivity indices can be readily evaluated by integrating the global sensitivity index function over the failure zone. Three illustrative examples are used to demonstrate the proposed methodology.
GPU Lifetimes on Titan Supercomputer: Survival Analysis and Reliability
George Ostrouchov, Don Maxwell, Rizwan Ashraf, Mallikarjun Shankar, and James Rogers. 2020. GPU Lifetimes on Titan Supercomputer: Survival Analysis and Reliability. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '20). Association for Computing Machinery, New York, NY, USA. Data and code for SC20 paper about Titan GPU reliability analysis: https://github.com/olcf/TitanGPULife. Includes R code to generate graphics for paper and additional analyses. See code/README for instructions. Includes original Titan GPU reliability data on over 100,000 collective hours of operation: data/titan.gpu.history.txt - history data, data/titan.service.txt - service nodes for exclusion. Includes output data files produced by code/TitanGPUmodel.Rmd: data/gc_full.csv - cleaned up data (see paper and R code); data/gc_summary_loc.csv - one record per GPU (variables: SN, time, nlife, nloc, last, col, row, cage, slot, node, max_loc_events, time_max_loc, dbe, dbe_loc, otb, otb_loc, out, batch, days, years, dead, dead_otb, dead_dbe) (see paper and R code). Includes .Rmd analysis document as TitanGPUmode.html. Includes Python code to process data/gc_full.csv into graphics from time-between-failure analyses: See code/tbf-analyses/README for instructions.
Solutions for Enhanced Legacy Probabilistic Risk Assessment Tools and Methodologies: Improving Efficiency of Model Development and Processing via Innovative Human Reliability Dependency Analysis
Probabilistic risk assessments (PRAs) are integral to nuclear power plant (NPP) operations, having tremendously benefitted the safety of the U.S. reactor fleet for decades. Insights obtained from the models have provided perspectives on a variety of applications, both at the plant and for the regulator. While these models are very useful, they are now being asked to represent and analyze aspects of the plant that were never envisioned by the initial PRA practitioners. Furthermore, heightened demands on the PRA models have led to increased computing power requirements. Additionally, as the complexity of the PRA models increased, the difficulty experienced by non-PRA experts in trying to understand these models, grasp the insights they provide, and effectively use that information has become problematic. The need for research to address key issues regarding PRA tools and methods has never been greater. Although the nuclear power industry has largely been well-served by these tools and methods, the underlying science is dated, remaining mostly unchanged for over two decades. Three areas were identified as most beneficial to address to maintain and improve the usefulness of the current practice legacy PRA tools: improved quantification speed, increased ability to efficiently model multi-hazard models, and improved modeling human action dependency in PRA. This report is focused on the third critical area, improvements in dependency analysis of human actions conducted as part of a typical human reliability assessment.
Composite Power System Reliability with Renewables and Customer Flexibility
Composite Power System Reliability is defined as the computational procedure that quantifies the probability that the power system will perform the function of delivering electric power to customers adequately, on a continuous basis and with an acceptable quality. This definition leaves many details undefined and exemplifies the ambiguity in reliability analysis. The increasing deployment of wind and PV creates additional uncertainties that make reliability analysis a rather complex issue. Because of increased uncertainty the need for composite reliability analysis and utilization of results in power system planning is critical. New approaches are emerging for dealing with these problems from the operational point of view, including demand response programs, tapping on customer and distributed resource flexibility and new control approaches. The key question to be addressed is: how the new operational paradigms affect composite power system reliability. Here, this paper presents the ongoing work of the IEEE Composite System Reliability Task Force of the IEEE PES Reliability, Risk, Probability Application (RRPA) Subcommittee.
Advanced Power Electronics and Electric Machines
The advanced power electronics and electric machines (APEEM) research group at the National Renewable Energy Laboratory (NREL) has developed world-class experimental and modeling capabilities for designing and evaluating efficient and reliable power electronics and electric machines thermal management systems. They also design, fabricate and characterize advanced power electronics packaging, and are developing state-of-health monitoring techniques. These researchers deliver safe, reliable, high performing, power-dense components that allow seamless integration between renewable energy sources, electric transportation, and the grid, helping to make widespread electric vehicle (EV) adoption and greenhouse gas emissions reduction more feasible. This document outlines the group's major capabilities in the areas of power electronics; module development and characterization; thermal modeling and management; thermomechanical reliability analysis of devices, modules, inverters/converters, and electric machines; physics-of-failure-based reliability analysis; and microelectronics. It also overviews the group's state-of-the-art equipment for fluid-based thermal management; thermal measurement & characterization; thermomechanical reliability analysis; micro- and power electronics measurement & characterization; and prototype fabrication, as well as the group's world-class modeling and simulation capabilities.
Transverse mode analysis for free-space laser beams using Bayesian analysis
Reliable and rapid assessment of the transverse mode quality of a free-space laser beam has a wide range of applications in laser development, research, and utilization. It has become even more important with recent advances in developing orbital angular momentum photon beams across a broad spectral region. In this work, a general modal analysis method for a free-space multimode laser beam has been developed based on Bayesian analysis. After transforming mode decomposition into a linear system problem, a Gaussian probabilistic model is used to find a closed-form solution. The method is found to be robust with the presence of Gaussian noise. Prior knowledge about the mode content can be incorporated into the method to improve the solution for situations when coherent disturbances or contamination are present in the laser beam. This method can be used to analyze the mode content for laser beams in different bases, such as Hermite–Gaussian (HG) modes and Laguerre–Gaussian (LG) modes. Three applications of this method are presented: a detailed modal analysis of the beam image from the incoherent intensity addition of HG modes and two examples of mode decomposition using the complex wavefront from the coherent superposition of HG and LG modes. The feasibility of this method is demonstrated using various simulation results. Based on digital images of a laser beam recorded without complex wavelength-limiting optics, in principle, this method can be used in a wide wavelength range from infrared to ultraviolet, and possibly x ray.
Fault Detection via Occupation Kernel Principal Component Analysis
Reliable operation of automatic systems is heavily dependent on the ability to detect faults in the underlying dynamics. While traditional model-based methods have been widely used for fault detection, data-driven approaches have garnered increasing attention due to their ease of deployment and minimal need for expert knowledge. In this letter, we present a novel principal component analysis (PCA) method that uses occupation kernels. Occupation kernels result in feature maps that are tailored to the measured data, have inherent noise-robustness due to the use of integration, and can utilize irregularly sampled system trajectories of variable lengths for PCA. The occupation kernel PCA method is used to develop a reconstruction error approach to fault detection and its efficacy is validated using numerical simulations.
Easy, Fast, and Reproducible Quantification of Cholesterol and Other Lipids in Human Plasma by Combined High Resolution MSX and FTMS Analysis
Reliable, cost-effective, and gold-standard absolute quantification of non-esterified cholesterol in human plasma is of paramount importance in clinical lipidomics and for the monitoring of metabolic health. Here, we compared the performance of three mass spectrometric approaches available for direct detection and quantification of cholesterol in extracts of human plasma. These approaches are high resolution full scan Fourier transform mass spectrometry (FTMS) analysis, parallel reaction monitoring (PRM), and novel multiplexed MS/MS (MSX) technology, where fragments from selected precursor ions are detected simultaneously. Evaluating the performance of these approaches in terms of dynamic quantification range, linearity, and analytical precision showed that the MSX-based approach is superior to that of the FTMS and PRM-based approaches. To further show the efficacy of this approach, we devised a simple routine for extensive plasma lipidome characterization using only 8 μL of plasma, using a new commercially available ready-to-spike-in mixture with 14 synthetic lipid standards, and executing a single 6 min sample injection with combined MSX analysis for cholesterol quantification and FTMS analysis for quantification of sterol esters, glycerolipids, glycerophospholipids, and sphingolipids. Using this simple routine afforded reproducible and absolute quantification of 200 lipid species encompassing 13 lipid classes in human plasma samples. Notably, the analysis time of this procedure can be shortened for high throughput-oriented clinical lipidomics studies or extended with more advanced MS{sup ALL} technology (Almeida R. et al., J. Am. Soc. Mass Spectrom. 26, 133–148 [1]) to support in-depth structural elucidation of lipid molecules. .
Simulator Data Analysis to Inform Digitalized Environment Impacts on Human Reliability
The U.S. Nuclear Regulatory Commission (NRC) has developed a human reliability analysis (HRA) method, termed the Integrated Human Event Analysis System for Event and Condition Assessment (IDHEAS-ECA), in order to estimate human error probabilities (HEPs) in risk-informed regulatory applications. To update the quantification part of IDHEAS-ECA, the NRC required human performance and error data from fully digitalized main control rooms (MCRs); therefore, it requested that Idaho National Laboratory (INL) revisit previous data collection studies and investigate how the following three factors impact human reliability: self-checking, peer-checking, and automation. The HRA data collection studies revisited were the Human Reliability Data Extraction (HuREX) project, developed by the Korea Atomic Energy Research Institute (KAERI), and the Simplified Human Error Experimental Program (SHEEP), developed by INL. HuREX is a representative HRA data collection study that collects human reliability data from full-scope simulators staffed by licensed operators. SHEEP, on the other hand, has been proposed to complement such full-scope studies by collecting data via simplified simulators staffed by non-licensed student operators. In the HuREX study, KAERI collected HRA data from fully digitalized MCRs for the Advanced Power Reactor (APR)–1400. The SHEEP data were obtained from simplified simulators that partially mimicked the features of digitalized MCRs. The present report mainly discusses how the impacts of the aforementioned three factors on human errors were derived from these two data collection studies.
Characterization of a mock up nuclear waste package using energy resolved MeV neutron analysis
Reliable radiographic methods for characterizing nuclear waste packages non-destructively (without the need to open containers) have the potential to significantly contribute to safe handling and future disposal options, particularly for legacy waste of unknown content. Due to required shielding of waste containers and the need to characterize materials consisting of light elements, X-ray methods are not suitable. Here, energy-resolved MeV neutron radiography is demonstrated as a first-of-its-kind application for non-destructive and remote examination of mock up nuclear waste packages from a safe position using time-of-flight techniques enabled by a novel event-mode imaging detector system. Energy-resolved neutron transmission spectra were measured spatially, permitting the detection of analogue materials to actual nuclear waste such as water, melamine, and ion exchange resin within a 2.54 cm wall thickness steel pipe. The results demonstrate the capability to locate the materials through this wall thickness by radiography and tomographic reconstruction, revealing detailed 3D distributions and structural anomalies. The method effectively detects residual water in ion exchange resin, highlighting its sensitivity to moisture content, a crucial parameter for nuclear waste characterization. Monte Carlo simulations are in agreement with the experimental findings, providing a pathway to simulate waste forms more difficult to tackle experimentally. This work paves the way to apply sub-nanosecond intense MeV neutron sources, such as laser-driven neutron sources under development, to nuclear waste characterization.
EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK
This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.
Simulation-Based Recovery Action Analysis Using the EMRALD Dynamic Risk Assessment Tool
Recovery human action is defined as the action that prevents deviant conditions from producing unwanted effects. Analyzing recovery actions has been a critical part in human reliability analysis (HRA). However, there are a couple of limitations to treating recovery actions using only the current HRA methods available. Representatively, the existing recovery analysis does not specifically consider recovery actions as they have occurred in actual nuclear power plants (NPPs). To handle the challenges in the existing recovery analyses, this study suggests a way to analyze recovery actions under a dynamic HRA method, the Procedure-based Risk Investigation MEthod-Human Reliability Analysis (PRIME-HRA) method. The PRIME-HRA method suggests a way on how to develop dynamic simulation models using dynamic risk assessment tools such as the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) [1] and the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) [2]. EMRALD and HUNTER are the dynamic probabilistic risk assessment and HRA tools developed at Idaho National Laboratory. In this paper, differences on analyzing recovery actions in the Technique for Human Error-Rate Prediction (THERP), the Cause-Based Decision Tree (CBDT) and the Korean Standard HRA (K-HRA) and challenges of these approaches are introduced. How we have developed the PRIME-HRA is also introduced in this paper. Then, the proposed approach to analyzing recovery human actions in dynamic context is partially discussed with an example.
Loss Landscape Analysis for Reliable Quantized ML Models for Scientific Sensing
In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are subject to noise and perturbations due to experimental conditions. Our method allows assessing the robustness of ML models to such effects as a function of quantization precision and under different regularization techniques -- two crucial concerns that remained underexplored so far. By investigating the interplay between performance, efficiency, and robustness by means of loss landscape analysis, we both established a strong correlation between gently-shaped landscapes and robustness to input and weight perturbations and observed other intriguing and non-obvious phenomena. Our method allows a systematic exploration of such trade-offs a priori, i.e., without training and testing multiple models, leading to more efficient development workflows. This work also highlights the importance of incorporating robustness into the Pareto optimization of ML models, enabling more reliable and adaptive scientific sensing systems.