Discussion of "Reliability growth management metrics and statistical methods for discrete-use systems: by Hall, Ellner and Mosleh"
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Purpose: Recently, several robotic systems have been developed to perform accurate and consistent image-guided brachytherapy. Before introducing a new device into clinical operations, it is important to assess the reliability and mean time before failure (MTBF) of the system. In this article, the authors present the preclinical evaluation and analysis of the reliability and MTBF of an autonomous robotic system, which is developed for prostate seed implantation. Methods: The authors have considered three steps that are important in reliability growth analysis. These steps are: Identification and isolation of failures, classification of failures, and trend analysis. For any one-of-a-kind product, the reliability enhancement is accomplished through test-fix-test. The authors have used failure mode and effect analysis for collection and analysis of reliability data by identifying and categorizing the failure modes. Failures were classified according to severity. Failures that occurred during the operation of this robotic system were considered as nonhomogenous Poisson process. The failure occurrence trend was analyzed using Laplace test. For analyzing and predicting reliability growth, commonly used and widely accepted models, Duane's model and the Army Material Systems Analysis Activity, i.e., Crow's model, were applied. The MTBF was used as an important measure for assessing the system's reliability. Results: During preclinical testing, 3196 seeds (in 53 test cases) were deposited autonomously by the robot and 14 critical failures were encountered. The majority of the failures occurred during the first few cases. The distribution of failures followed Duane's postulation as well as Crow's postulation of reliability growth. The Laplace test index was -3.82 (<0), indicating a significant trend in failure data, and the failure intervals lengthened gradually. The continuous increase in the failure occurrence interval suggested a trend toward improved reliability. The MTBF was 592 seeds, which implied that several prostate seed implantation cases would be possible without encountering any critical failure. The shape parameter for the MTBF was 0.3859 (<1), suggesting a positive reliability growth of this robotic system. At 95% confidence, the reliability for deposition of 65 seeds was more than 90%. Conclusions: Analyses of failure mode strongly indicated a gradual improvement of reliability of this autonomous robotic system. High MTBF implied that several prostate seed implant cases would be possible without encountering any critical failure.
The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.
The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.
Models of reliability growth relate current system unreliability to currently accumulated experience. But “experience” comes in different forms. Looking back after a major accident, one is sometimes able to identify previous events or measurable performance trends that were, in some sense, signaling the potential for that major accident: potential that could have been recognized and acted upon, but was not recognized until the accident occurred. This could be a previously unrecognized cause of accidents, or underestimation of the likelihood that a recognized potential cause would actually operate. Despite improvements in the state of practice of modeling of risk and reliability, operational experience still has a great deal to teach us, and work has been going on in several industries to try to do a better job of learning from experience before major accidents occur. It is not enough to say that we should review operating experience; there is too much “experience” for such general advice to be considered practical. The paper discusses the following: 1. The challenge of deciding what to focus on in analysis of operating experience. 2. Comparing what different models of learning and reliability growth imply about trending and precursor analysis.
Abstract not provided.
Highly reliable low-cost protective coatings have been sought after for use in crucibles and susceptors for bulk and epitaxial film growth processes involving wide bandgap materials. Here, we propose a production technique for ultra-thick (50–200 μmt) tantalum carbide (TaC) protective coatings on graphite substrates, which consists of TaC slurry application and subsequent sintering processes, i.e., a wet ceramic process. Structural analysis of the sintered TaC layers indicated that they have a dense granular structure containing coarse grain with sizes of 10–50 μm. Furthermore, no cracks or pinholes penetrated through the layers, i.e., the TaC layers are highly reliable protective coatings. The analysis also indicated that no plastic deformation occurred during the production process, and the non-textured crystalline orientation of the TaC layers is the origin of their high reliability and durability. The TaC-coated graphite crucibles were tested in an aluminum nitride (AlN) sublimation growth process, which involves extremely corrosive conditions, and demonstrated their practical reliability and durability in the AlN growth process as a TaC-coated graphite. The application of the TaC-coated graphite materials to crucibles and susceptors for use in bulk AlN single crystal growth, bulk silicon carbide (SiC) single crystal growth, chemical vapor deposition of epitaxial SiC films, and metal-organic vapor phase epitaxy of group-III nitrides will lead to further improvements in crystal quality and reduced processing costs.
Abstract Crystallization is a ubiquitous means of self-assembly that can organize matter over length scales orders of magnitude larger than those of the monomer units. Yet crystallization is notoriously difficult to control because it is exquisitely sensitive to monomer concentration, which changes as monomers are depleted during growth. Living cells control crystallization using chemical reaction networks that offset depletion by synthesizing or activating monomers to regulate monomer concentration, stabilizing growth conditions even as depletion rates change, and thus reliably yielding desired products. Using DNA nanotubes as a model system, here we show that coupling a generic reversible bimolecular monomer buffering reaction to a crystallization process leads to reliable growth of large, uniformly sized crystals even when crystal growth rates change over time. Buffering could be applied broadly as a simple means to regulate and sustain batch crystallization and could facilitate the self-assembly of complex, hierarchical synthetic structures.
One of the most vital emerging commercial markets for hydrogen is fuel cell-powered mobility including cars, trucks, and buses. These vehicles are refueled via a network of hydrogen fueling stations, with the highest number of U.S. stations being in California. The numbers of both fuel cell electric vehicles (FCEVs) and hydrogen stations have increased in the last two years, with anecdotal information from FCEV drivers indicating that station reliability is hurting the consumer acceptability of FCEV technologies. Therefore, this study benchmarks the current state of hydrogen station reliability in practice and presents on-going research that is investigating the failures that are contribute to hydrogen station reliability issues. This is accomplished with an analysis of operation, safety, and maintenance data from hydrogen stations and fuel cell electric vehicles to benchmark the maintenance and failure of hydrogen stations and their components. This analysis, of over 5,000 station maintenance events, presents the leading maintenance categories and failure rates, and is a prerequisite to the development of data-driven reliability improvement plans. We present a reliability growth analysis and on-going research into the root causes of failure for dispensers, a particularly failure-prone subsystem.
Intense electron beams are key to a large number of scientific endeavors, including electron cooling of hadron beams, electron-positron colliders, secondary-particle beams such as photons and positrons, sub-picosecond ultrafast electron diffraction (UED), and new high gradient accelerators that use electron-driven plasmas. The last decade has seen a considerable interest in pursuit and realization of novel light sources such as Free Electron Lasers [1] and Energy Recovery Linacs [2] that promise to deliver unprecedented quality x-ray beams. Many applications for high-intensity electron beams have arisen in recent years in high-energy physics, nuclear physics and energy sciences, such as recent designs for an electron-hadron collider at CERN (LHeC) [3], and beam coolers for hadron beams at LHC and eRHIC [4,5]. Photoinjectors are used at the majority of high-brightness electron linacs today, due to their efficiency, timing structure flexibility and ability to produce high power, high brightness beams. The performance of light source machines is strongly related to the brightness of the electron beam used for generating the x-rays. The brightness of the electron beam itself is mainly limited by the physical processes by which electrons are generated. For laser based photoemission sources this limit is ultimately related to the properties of photocathodes [6]. Most facilities are required to expend significant manpower and money to achieve a workable, albeit often non-ideal, compromise photocathode solution. If entirely fabricated in-house, the photocathode growth process itself is laborious and not always reproducible: it involves the human element while requiring close adherence to recipes and extremely strict control of deposition parameters. Lack of growth reliability and as a consequence, slow adoption of viable photoemitter types, can be partly attributed to the absence of any centralized facility or commercial entity to routinely provide high peak current capable, low emittance, visible-light sensitive photocathodes to the myriad of source systems in use and under development. Successful adoption of photocathodes requires strict adherence to proper fabrication, operation, and maintenance methodologies, necessitating specialized knowledge and skills. Key issues include the choice of photoemitter material, development of a more streamlined growth process to minimize human operator uncertainties, accommodation of varying photoemitter substrate materials and geometries, efficient transport and insertion mechanisms preserving the photo-yield, and properly conveyed photoemitter operational and maintenance methodologies. AES, in collaboration with Cornell University in a Phase I STTR, developed an on-demand industrialized growth and centralized delivery system for high-brightness photocathodes focused upon the alkali antimonide photoemitters. To the end user, future photoemitter sourcing will become as simple as other readily available consumables, rather than a research project requiring large investments in time and personnel.
Reactor protection system (RPS) in nuclear power plant (NPP) is in the process of digitalization in response to advanced features of digital systems. In this context, software integrity in the RPS becomes an important issue since it may cause common-cause failure. Therefore, to guarantee the safety of NPPs, the integrity of the software need to be properly demonstrated or assessed. There are three typical approaches for software reliability quantification: software reliability growth model (SRGM), Bayesian belief network (BBN), and test-based method. Basically, SRGM is difficult to apply to the safety-critical software because not only sufficient failure sets are unavailable but consequence of system failure is also unacceptable. Then the result obtained through the BBN model may have large uncertainty, so it produces difficulties in integrity demonstration of safety-critical software. Thus, the BBN result need to be complemented or verified by test-based method. Currently, for the integrity demonstration of safety-critical software, black-box test which feeds inputs and examines just outputs whether they succeeded or failed is considered based on trajectory-form-of-input (a series of successive values for the input variables that occur during the operation of the software over time). Usually these trajectory-inputs are randomly sampled from operational profile. In this approach, however, there are some practical difficulties. Therefore, we proposed a new test method for safety-critical software in digitalized reactor protection system (DRPS). The main contents described in this paper are about basic concepts under development of finite-test-cases by which the integrity of the software logic can be verified. It should be noted that the influence of the environments, such as operating system and other hardware, are not considered since the method focuses on software logic only. (authors)
The rapid expansion of data centers in the United States is reshaping how the electric distribution system must plan for and accommodate large load interconnections. This report evaluates the role of the distribution grid in serving these loads, from small edge facilities to hyperscale campuses. Using national datasets, utility filings, and industry studies, we assess demand growth, reliability requirements, interconnection thresholds, and infrastructure needs at substations and feeders. The analysis highlights the mismatch between fast data center development timelines and slower utility planning and construction cycles, as well as strategies such as phased energization, on-site generation, hosting capacity maps, and structured interconnection frameworks. While focused on data centers, the insights also apply to other high-density loads such as advanced manufacturing, hydrogen production, and electrified transportation. The report concludes with approaches to align planning processes, transparency tools, and regulatory frameworks so utilities can manage new large loads in ways that support a reliable and resilient grid.
Distribution transformers, used to step-down medium voltage to service-voltage level for end-use electrical consumption, are currently experiencing major shortages. Utilities are experiencing extended lead times for transformers of up to 2 years (a 4x increase on lead times pre-2022) and prices have gone up by as much as 5-6 times in the past 2 years. Current shortages have been attributed to pent-up post-pandemic demand, workforce shortages and low retention rates, component supply chain challenges, and materials shortages (grain-oriented electrical steel, aluminum, and copper). The supply of this equipment is critical for the reliability and growth of the power system, and in meeting administration climate goals in terms of electrification of demand and the growth of renewable energy. This report details some of the initial analysis conducted by the National Renewable Energy Laboratory (NREL), supported by the Department of Energy's Office of Electricity and Office of Policy, in assessing the long-term demand trends for distribution transformers. Expected increased demand is due to a confluence of not only electrification and renewable energy growth, but also in the context of aging electric infrastructure, increased frequency and severity of extreme weather events, and utility-driven investments in reliability and resiliency of the electricity distribution system.
Tin (Sn) whiskers are conductive Sn filaments that grow from Sn-plated surfaces, such as surface finishes on electronic packages. The phenomenon of Sn whiskering has become a concern in recent years due to requirements for lead (Pb)-free soldering and surface finishes in commercial electronics. Pure Sn finishes are more prone to whisker growth than their Sn-Pb counterparts and high profile failures due to whisker formation (causing short circuits) in space applications have been documented. At Sandia, Sn whiskers are of interest due to increased use of Pb-free commercial off-the-shelf (COTS) parts and possible future requirements for Pb-free solders and surface finishes in high-reliability microelectronics. Lead-free solders and surface finishes are currently being used or considered for several Sandia applications. Despite the long history of Sn whisker research and the recently renewed interest in this topic, a comprehensive understanding of whisker growth remains elusive. This report describes recent research on characterization of Sn whiskers with the aim of understanding the underlying whisker growth mechanism(s). The report is divided into four sections and an Appendix. In Section 1, the Sn plating process is summarized. Specifically, the Sn plating parameters that were successful in producing samples with whiskers will be reviewed. In Section 2, the scanning electron microscopy (SEM) of Sn whiskers and time-lapse SEM studies of whisker growth will be discussed. This discussion includes the characterization of straight as well as kinked whiskers. In Section 3, a detailed discussion is given of SEM/EBSD (electron backscatter diffraction) techniques developed to determine the crystallography of Sn whiskers. In Section 4, these SEM/EBSD methods are employed to determine the crystallography of Sn whiskers, with a statistically significant number of whiskers analyzed. This is the largest study of Sn whisker crystallography ever reported. This section includes a review of previous literature on Sn whisker crystallography. The overall texture of the Sn films was also analyzed by EBSD. Finally, a short Appendix is included at the end of this report, in which the X-Ray diffraction (XRD) results are discussed and compared to the EBSD analyses of the overall textures of the Sn films. Sections 2, 3, and 4 have been or will be submitted as stand-alone papers in peer-reviewed technical journals. A bibliography of recent Sandia Sn whisker publications and presentations is included at the end of the report.
Anaerobic gut fungi (AGF) have potential to valorize lignocellulosic biomass owing to their diverse repertoire of carbohydrate-active enzymes (CAZymes). However, AGF metabolism is poorly understood, and no stable genetic tools are available to manipulate growth and metabolic flux to enhance production of specific targets, e.g., cells, CAZymes, or metabolites. Herein, a cost-effective, Arduino-based, continuous-flow anaerobic bioreactor with online optical density control is presented to probe metabolism and predictably tune fluxes in Caecomyces churrovis. Varying the C. churrovis turbidostat setpoint titer reliably controlled growth rate (from 0.04 to 0.20 h −1 ), metabolic flux, and production rates of acetate, formate, lactate, and ethanol. Bioreactor setpoints to maximize production of each product were identified, and all continuous production rates significantly exceed batch rates. Formate spike-ins increased lactate flux and decreased acetate, ethanol, and formate fluxes. The bioreactor and turbidostat culture schemes demonstrated here offer tools to tailor AGF fermentations to application-specific hydrolysate product profiles.
Despite its use in one form or another for at least four decades, HALT and related techniques [e.g., highly accelerated-stress screening (HASS) and stress audits (HASA)] are not well understood within the statistical community and remain controversial. This largely reflects a conflict in motivation between engineers, testing under harsh conditions to discover and eliminate failure modes, and statisticians, taking a more cautious approach to develop quantitative estimates of parameters such as mean time between failures (MTBF). Here, this review article will clarify HALT concepts and methods and explain where it fits within the universe of methods that involve the application of accelerating factors to compress the time required to evaluate or enhance product reliability. A major distinction is between methods such as HALT, a high-stress test-analyze-fix-test iterative process directed at improving reliability by discovering and fixing weak points in a design, and quantitative accelerated life testing (QALT), whose goal is the estimation of product life for a fixed design. We discuss methods such as physics of failure that offer some hope of bridging the gap between the qualitative nature of HALT, and purely quantitative statistical methods. We present a variety of engineering applications of HALT including metal fatigue, piping and pressure vessels, structural damage, radiation damage, and rotating machinery. We also discuss potential synergies between HALT and QALT, such as rapid identification, through HALT, of failure modes requiring quantitative analysis. For further study, extensive references to the applicable literature are provided as well as an appendix that describes related methods.
The properties of a material are often strongly influenced by its surfaces. Depending on the nature of the chemical bonding in a material, its surface can undergo a variety of stabilizing reconstructions that dramatically alter the chemical reactivity, light absorption, and electronic band offsets. For decades, ab initio thermodynamics has been the method of choice for computationally determining the surface phase diagram of a material under different conditions. The surfaces considered for these studies, however, are often human-selected and too few in number, leading both to insufficient exploration of all possible surfaces and to biases toward portions of the composition–structure phase space that often do not encompass the most stable surfaces. To overcome these limitations and automate the discovery of realistic surfaces, we combine density functional theory and grand canonical Monte Carlo (GCMC) into “ab initio GCMC.” This paper presents the successful application of ab initio GCMC to the study of oxide overlayers on Ag(111), which, for many years, mystified experts in surface science and catalysis. Specifically, we report that ab initio GCMC is able to reproduce the surface phase diagram of Ag(111) with no preconceived notions about the system. Using nonlinear, random forest regression, we discover that the Ag coordination number with O and the surface O–Ag–O bond angles are good descriptors of the surface energy. Additionally, using the composition–structure evolution histories produced by ab initio GCMC, we deduce a mechanism for the formation of oxide overlayers based on the Ag 3 O 4 pyramid motif that is common to many reconstructions of Ag(111). Lastly, ab initio GCMC is a promising tool for the discovery of realistic surfaces that can then be used to study phenomena on complex surfaces such as heterogeneous catalysis and material growth, enabling reliable and insightful interpretations of experiments.
Digital transformation and utilization of artificial intelligence (AI) in the electric grid are fundamentally changing the industry’s approach to common problems and enabling a broader paradigm shift in grid planning and operations. The change in approach is circularly both enabling and driving modernization, with load growth and reliable management of data center and AI infrastructure shifting away from planning approaches with relatively predictable behaviors and toward a mix of consumer and industrial choices that surpass human cognitive abilities to process. This movement has potential to condition humans to not understand the system on which the AI depends, while requiring it for development of the necessary infrastructure. Approaches which would address most likely grid conditions and events, such as faults, aging of equipment, and weather, now must also account for large loads which shift not based upon weather or time of day, but the computational load. Quantifying computational load is independent of the traditional grid forecasting variables, where a data center’s aggregate load is determined by user and AI system behavior and decoupled from normal grid planning and operations. AI is both the cause and solution for these challenges, with new grid planning tools integrating massive amounts of decisions into frameworks.