Reliability indices of some elements of automatic systems
Statistical analysis of component reliability data for evaluating operational failures in automatic control systems
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Statistical analysis of component reliability data for evaluating operational failures in automatic control systems
This thesis studies drop durability of electronic assemblies when the acceleration vector is oriented at 45° to the out-of-plane direction of the circuit card. The off-axis drop tests are accomplished with a skewed fixture and are conducted as a proxy for multiaxial drop testing. Advanced shock testing and vibration test methods have been developed over the last few decades to better represent real-world field environments during ground-based laboratory testing. However, many of these test methods require expensive and specialized equipment not available in most laboratories. An alternative approach for approximating simultaneous loading along multiple axes on conventional equipment utilizes skewed fixtures which have seen use in off-axis random vibration and drop impact testing. These methods generally rely on the conversion of a uniaxial input load from the test equipment (using a uniaxial drop tower or shaker) into a multiaxial load when resolved in the reference frame of the test article (mounted on a skewed fixture). Skewed fixture design is presented and recommendations for conducting skewed angle drop testing are introduced based on local measurements along the skewed face of the fixture to accurately monitor the impact event. Characterization tests were performed with a skewed fixture, at simultaneous acceleration loads from 500 to 3,000 g in two (in-plane and out-of-plane) directions, while meeting standard time domain tolerances. Upon experimental characterization, drop shock durability tests were conducted on a printed circuit assembly (PCA). Mean drops-to-failure were measured and quantified with Weibull statistics. Dominant solder joint failure modes were identified via failure analysis. Prior work on inclined angle impact testing is limited, and the majority of solder joint interconnect level fatigue studies are conducted considering perpendicular loading normal the circuit card. Low-cycle fatigue curves are generated based on plastic strain and plastic work density within the solder joint. A multiscale nonlinear finite element model is used to relate board-level flexure to solder joint interconnect level plastic strain. A high strain rate solder constitutive model allows for accurate modeling of solder plasticity resulting from high-impact drop shock. Fatigue parameters are computed from the Coffin-Manson relation and Palmgren-Miner damage accumulation. This work serves to apply established low-cycle fatigue methods for conventional drop shock loading (impact normal to circuit card) to non-perpendicular loading with a skewed fixture.
Experience from tests and flights and engineering analysis represent the two sources of information on which to base conclusions on the reliability or failure risk of aerospace flight systems. It is rarely feasible to establish high reliability at high confidence by testing aerospace flight systems or components. The limitations of testing in evaluating failure risk are discussed and an alternate statistical approach which relies on both test experience and analysis to quantitatively assess reliability is outlined. The implementation of this methodology in the service life assessment of ion thrusters is discussed and examples of failure modes being addressed in the NASA Solar Electric Propulsion Technology Application Readiness (NSTAR) program are given.
Conducting human exploration missions beyond Low Earth Orbit (LEO) will present unique challenges in the areas of supportability and maintainability. The durations of proposed missions can be relatively long and re-supply of logistics, including maintenance and repair items, will be limited or non-existent. In addition, mass and volume constraints in the transportation system will limit the total amount of logistics that can be flown along with the crew. These constraints will require that new strategies be developed with regards to how spacecraft systems are designed and maintained. NASA is currently developing Design Reference Missions (DRMs) as an initial step in defining future human missions. These DRMs establish destinations and concepts of operation for future missions, and begin to define technology and capability requirements. Because of the unique supportability challenges, historical supportability data and models are not directly applicable for establishing requirements for beyond LEO missions. However, supportability requirements could have a major impact on the development of the DRMs. The mass, volume, and crew resources required to support the mission could all be first order drivers in the design of missions, elements, and operations. Therefore, there is a need for enhanced analysis capabilities to more accurately establish mass, volume, and time requirements for supporting beyond LEO missions. Additionally, as new technologies and operations are proposed to reduce these requirements, it is necessary to have accurate tools to evaluate the efficacy of those approaches. In order to improve the analysis of supportability requirements for beyond LEO missions, the Space Missions Analysis Branch at the NASA Langley Research Center is developing the Exploration Maintainability Analysis Tool (EMAT). This tool is a probabilistic simulator that evaluates the need for repair and maintenance activities during space missions and the logistics and crew requirements to support those activities. Using a Monte Carlo approach, the tool simulates potential failures in defined systems, based on established component reliabilities, and then evaluates the capability of the crew to repair those failures given a defined store of spares and maintenance items. Statistical analysis of Monte Carlo runs provides probabilistic estimates of overall mission safety and reliability. This paper will describe the operation of the EMAT, including historical data sources used to populate the model, simulation processes, and outputs. Analysis results are provided for a candidate exploration system, including baseline estimates of required sparing mass and volume. Sensitivity analysis regarding the effectiveness of proposed strategies to reduce mass and volume requirements and improve mission reliability is included in these results.
Thin membrane-delimited fluid cells supporting up to 1 at (0.1 MPa) of pressure are well known and commercially available for use in vacuum chambers of electron, photon, or various particle beam microscopies or spectroscopies. Hereby, we report on the development of fluid cells capable of working at 1–10 MPa, extending the analysis domain for investigating chemical, biochemical, or physical processes at pressures of interest in chemical synthesis, underwater biochemistry studies or underground geology. We explored ways to optimize cell membranes to better resist pressure beyond simply increasing the thickness or decreasing the size of the membranes, using finite element analysis and experimental validation via membrane bulging experiments and failure statistics. Fluid cell prototypes were fabricated using ∼75 nm-thick SiN x membranes, engineered to withstand 4.7 MPa (average value), compared to regular (un-engineered) membranes withstanding only 3.4 MPa (average value). The fluid cell prototypes include eight microchannels for feeding/evacuating the fluids and applying pressure into micro-reaction chambers, two electrodes for electrochemical or conduction measurements in the sample, and a possible pressure or temperature sensor, customizable for specific experiments.
A life cycle test of secondary electric batteries for spacecraft applications was conducted. A sample number of nickel cadmium batteries were subjected to general performance tests to determine the limit of their actual capabilities. Weaknesses discovered in cell design are reported and aid in research and development efforts toward improving the reliability of spacecraft batteries. A statistical analysis of the life cycle prediction and cause of failure versus test conditions is provided.
The service life and storage stability for several storage batteries were determined. The batteries included silver-zinc batteries, nickel-cadmium batteries, and silver-cadmium batteries. The cell performance characteristics and limitations are to be used by spacecraft power systems planners and designers. A statistical analysis of the life cycle prediction and cause of failure versus test conditions is presented.
Sensor redundancy management (SRM) requires a system which will detect failures and reconstruct avionics accordingly. A probability density function to determine false alarm rates, using an algorithmic approach was generated. Microcomputer software was developed which will print out tables of values for the cummulative probability of being in the domain of failure; system reliability; and false alarm probability, given a signal is in the domain of failure. The microcomputer software was applied to the sensor output data for various AFT1 F-16 flights and sensor parameters. Practical recommendations for further research were made.
A Lithium-Ion Cell Low-Earth-Orbit Verification Test Program is being conducted by NASA Glenn Research Center to assess the performance of lithium-ion (Li-ion) cells over a wide range of low-Earth-orbit (LEO) conditions. The data generated will be used to build an empirical model for Li-ion batteries. The goal of the modeling will be to develop a tool to predict the performance and cycle life of Li-ion batteries operating at a specified set of mission conditions. Using this tool, mission planners will be able to design operation points of the battery system while factoring in mission requirements and the expected life and performance of the batteries. Test conditions for the program were selected via a statistical design of experiments to span a range of feasible operational conditions for LEO aerospace applications. The variables under evaluation are temperature, depth-of-discharge (DOD), and end-of-charge voltage (EOCV). The baseline matrix was formed by generating combinations from a set of three values for each variable. Temperature values are 10 C, 20 C and 30 C. Depth-of-discharge values are 20%, 30% and 40%. EOCV values are 3.85 V, 3.95 V, and 4.05 V. Test conditions for individual cells may vary slightly from the baseline test matrix depending upon the cell manufacturer s recommended operating conditions. Cells from each vendor are being evaluated at each of ten sets of test conditions. Cells from four cell manufacturers are undergoing life cycle tests. Life cycling on the first sets of cells began in September 2004. These cells consist of Saft 40 ampere-hour (Ah) cells and Lith ion 30 Ah cells. These cells have achieved over 10,000 cycles each, equivalent to about 20 months in LEO. In the past year, the test program has expanded to include the evaluation of Mine Safety Appliances (MSA) 50 Ah cells and ABSL battery modules. The MSA cells will begin life cycling in October 2006. The ABSL battery modules consist of commercial Sony hard carbon 18650 lithium-ion cells configured in series and parallel combinations to create nominal 14.4 volt, 3 Ah packs (4s-2p). These modules have accumulated approximately 3000 cycles. Results on the performance of the cells and modules will be presented in this paper. The life prediction and performance model for Li-ion cells in LEO will be built by analyzing the data statistically and performing regression analysis. Cells are being cycled to failure so that differences in performance trends that occur at different stages in the life of the cell can be observed and accurately modeled. Cell testing is being performed at the Naval Surface Warfare Center in Crane, IN.
An improved methodology for quantitatively evaluating failure risk for a spaceflight system in order to assess flight readiness is presented. This methodology is of particular value when information relevant to failure prediction, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is limited. In this approach, engineering analysis models that characterize specific failure modes based on the physics and mechanics of the failure phenomena are used in a prescribed probabilistic structure to generate a failure probability distribution that is modified by test and flight experience in a Bayesian statistical procedure. The probabilistic structure and statistical methodology are generally applicable to any failure mode for which quantitative engineering analysis can be employed to characterize the failure phenomenon and are particularly well suited for use under the constraints on information availability that are typical of such spaceflight systems as the Space Shuttle and planetary spacecraft.
This project is an overview and analysis of the past ten years (2013 – present) in global spaceflight, highlighting the orbital launches of countries, particularly the failures that occurred, the reasons they occurred, and a breakdown of the related statistics and background information. The analysis is conducted from a perspective of reliability and maintainability engineering and Probabilistic Risk Assessment (PRA) to formulate a quantifiable understanding of the data and how it is pertinent to Safety and Mission Assurance (SMA) in spaceflight. There is a breakdown by country or group, timelines, and number of launches. The failures over the years are categorized, all given a broad analysis of subsystem failures and details of events. A few failures are given a more in-depth analysis of root causes and failure modes determined by their unique or common nature. The data is retrieved from online, publicly available sources.
Mathematical and statistical analysis components of RICIS (Research Institute for Computing and Information Systems) can be used in the following problem areas: (1) quantification and measurement of software reliability; (2) assessment of changes in software reliability over time (reliability growth); (3) analysis of software-failure data; and (4) decision logic for whether to continue or stop testing software. Other areas of interest to NASA/JSC where mathematical and statistical analysis can be successfully employed include: math modeling of physical systems, simulation, statistical data reduction, evaluation methods, optimization, algorithm development, and mathematical methods in signal processing.
The article begins by examining the fundamentals of traditional deterministic design philosophy. The initial section outlines the concepts of failure criteria and limit state functions two traditional notions that are embedded in deterministic design philosophy. This is followed by a discussion regarding safety factors (a possible limit state function) and the common utilization of statistical concepts in deterministic engineering design approaches. Next the fundamental aspects of a probabilistic failure analysis are explored and it is shown that deterministic design concepts mentioned in the initial portion of the article are embedded in probabilistic design methods. For components fabricated from ceramic materials (and other similarly brittle materials) the probabilistic design approach yields the widely used Weibull analysis after suitable assumptions are incorporated. The authors point out that Weibull analysis provides the rare instance where closed form solutions are available for a probabilistic failure analysis. Since numerical methods are usually required to evaluate component reliabilities, a section on Monte Carlo methods is included to introduce the concept. The article concludes with a presentation of the technical aspects that support the numerical method known as fast probability integration (FPI). This includes a discussion of the Hasofer-Lind and Rackwitz-Fiessler approximations.
To increase nuclear fuel performance and reliability, their mechanical properties require an accurate and statistically relevant assessment. Biaxial flexural strength tests provide an alternative to bend bar techniques for assessing mechanical behavior; namely, the transverse rupture strength (TRS) of ceramic samples. Biaxial test samples require simple geometries and minimal surface preparation, reducing fabrication costs and handling hazards. This study investigated the TRS of polycrystalline UO 2 fuel forms at room temperature using a ball-on-ring test fixture. Here, pellets were fabricated from UO 2 powder using conventional powder processing and sintering techniques. The TRS and Weibull parameters were obtained through Weibull statistics on over 60 UO 2 samples tested under equibiaxial flexure. The larger sample size in this study enabled a more robust Weibull statistical analysis than alternative test methods, which may not capture the stochastic failure of typical ceramics. Furthermore, two different loading ball diameters were employed to assess the impact of contact damage on fracture strength. While Hertzian contact damage was observed with the smaller loading ball, the fracture strength remained unaffected. A fracture analysis of the tested UO 2 samples indicated a mixture of intergranular and transgranular fracture that transitions to transgranular fracture with increasing distance from the fracture origin. The characteristic strength of the combined data sets was determined to be 148 MPa, and the Weibull modulus was determined to be 9.1. The TRS values and Weibull parameters were close to values found in the literature for alternative testing techniques using samples with similar microstructure and density. The findings in this study validate the ball-on-ring method used to obtain the TRS of UO 2 with a sample geometry more representative of nuclear fuels. Additionally, experimental TRS results from this study can be implemented in modeling codes to predict fuel performance, which is critical to fuel burnup extension and advanced nuclear fuel technologies.
A top-down risk assessment in the early phases of space exploration architecture development can provide understanding and intuition of the potential risks associated with new designs and technologies. In this approach, risk analysts draw from their past experience and the heritage of similar existing systems as a source for reliability data. This top-down approach captures the complex interactions of the risk driving parts of the integrated system without requiring detailed knowledge of the parts themselves, which is often unavailable in the early design stages. Traditional probabilistic risk analysis (PRA) technologies, however, suffer several drawbacks that limit their timely application to complex technology development programs. The most restrictive of these is a dependence on static planning scenarios, expressed through fault and event trees. Fault trees incorporating comprehensive mission scenarios are routinely constructed for complex space systems, and several commercial software products are available for evaluating fault statistics. These static representations cannot capture the dynamic behavior of system failures without substantial modification of the initial tree. Consequently, the development of dynamic models using fault tree analysis has been an active area of research in recent years. This paper discusses the implementation and demonstration of dynamic, modular scenario modeling for integration of subsystem fault evaluation modules using the Space Architecture Failure Evaluation (SAFE) tool. SAFE is a C++ code that was originally developed to support NASA s Space Launch Initiative. It provides a flexible framework for system architecture definition and trade studies. SAFE supports extensible modeling of dynamic, time-dependent risk drivers of the system and functions at the level of fidelity for which design and failure data exists. The approach is scalable, allowing inclusion of additional information as detailed data becomes available. The tool performs a Monte Carlo analysis to provide statistical estimates. Example results of an architecture system reliability study are summarized for an exploration system concept using heritage data from liquid-fueled expendable Saturn V/Apollo launch vehicles.
Analysis considers statistical variation of material strength and interactions between catastrophic and failure fatigue modes. Procedure employs concepts of fracture mechanics and extreme point processes associated with stationary narrow-band random vibrations.
The susceptibility of a stereo amplifier to damage from a spectrum of lengths of graphite fibers was calculated. A simple analysis was developed by which such calculations can be based on test results with fibers of uniform lengths. A statistical analysis was applied for the conversation of data for various logical failure criteria.
The authors have conducted a large-scale experiment in N-version programming. A total of 27 versions of a program were prepared independently from the same specification at two universities. The results of executing the versions revealed that the versions were individually extremely reliable but that the number of input cases in which more than one failed was substantially more than would be expected if they were statistically independent. After the versions had been executed, the failures of each version were examined and the associated faults located. The analysis showed that in some cases the programmers made equivalent logical errors, indicating that some parts of the problem were simply more difficult than others. The authors also found cases in which apparently different logical errors yielded faults that caused statistically correlated failures, indicating that there are special cases in the input space that present difficulty in various parts of the solution. A formal model is presented to explain this phenomenon. It appears that minor differences in the software development environment would not have a major impact in reducing the incidence of faults that cause correlated failures.