Search NASA⌕ Search

SEARCH · Search NASA

Results for “hardware failure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

A three-failure-tolerant computer system.

Two basic factors influence the design of highly reliable computer systems: the amount of failures required to be tol erated and the reliability or MTBF required. A computer system designed to tolerate any three single failures in a fail-operational-fail-operational-fail-safe manner for a real-time control application is presented. The design approach uses adaptive majority voting in both hardware and software with a four-level redundant system. Various methods of performing the adaptive majority voting functions were evaluated with the selected approach using a special module termed a voter-comparator switch (VCS). The VCS module allows the computer system to be operated in a variety of redundant modes, depending on the failure tolerance required at any particular time.

Koczela, L. J.↗

Impact of Data Placement on Resilience in Large-Scale Object Storage Systems

Distributed object storage architectures have become the de facto standard for high-performance storage in big data, cloud, and HPC computing. Object storage deployments using commodity hardware to reduce costs often employ object replication as a method to achieve data resilience. Repairing object replicas after failure is a daunting task for systems with thousands of servers and billions of objects, however, and it is increasingly difficult to evaluate such scenarios at scale on realworld systems. Resilience and availability are both compromised if objects are not repaired in a timely manner. In this work we leverage a high-fidelity discrete-event simulation model to investigate replica reconstruction on large-scale object storage systems with thousands of servers, billions of objects, and petabytes of data. We evaluate the behavior of CRUSH, a well-known object placement algorithm, and identify configuration scenarios in which aggregate rebuild performance is constrained by object placement policies. After determining the root cause of this bottleneck, we then propose enhancements to CRUSH and the usage policies atop it to enable scalable replica reconstruction. We use these methods to demonstrate a simulated aggregate rebuild rate of 410 GiB/s (within 5% of projected ideal linear scaling) on a 1,024-node commodity storage system. We also uncover an unexpected phenomenon in rebuild performance based on the characteristics of the data stored on the system.

Carns, Philip↗

2014 Semi-Annual Progress Letter Report on Used Nuclear Fuel Integrity Study in Transportation Environments

The objective of this project is to perform a systematic study on UNF (Used Nuclear Fuel) integrity under simulated transportation environments by using enabling hot-cell testing technology developed recently at ORNL, CIRFT (Cyclic Integrated Reversible-Bending Fatigue Tester) [1-9]. Out-of-cell study will support the ongoing ORNL hot-cell or in-cell testing. Although the use of CIRFT on H. B. Robinson UNF rods generated many interesting data, a number of important issues remain to be addressed arising from the test system and the rod itself. It has been shown that a direct examination of some of these issues in the hot-cell is prohibitive due to high cost and access limitations. The out-of-cell study has been demonstrated to be cost effective and much more feasible to provide quick turn-around solutions. A testing system with the same configuration as that of CIRFT used in hot-cell has been proposed to study the emerging issues from hot-cell testing and also to investigate the fatigue and failure mechanisms of UNF rods that cannot be identified directly with in hot-cell testing. The developments of hardware and software, test protocol, and hot-cell data analysis will be discussed in this report.

Normal Transportation↗

Installation effects on performance of multiple model V/STOL lift fans

An experimental program was performed in which the individual performance of multiple VTOL model lift fans was measured. The model tested consisted of three 5.5 in. diameter tip-turbine driven model VTOL lift fans mounted chordwise in a two-dimensional wing to simulate a pod-type array. The performance data provided significant insight into possible thrust variations and losses caused by the presence of cover doors, adjacent fuselage panels, and adjacent fans. The effect of a partial loss of drive air supply (simulated gas generator failure) on fan performance was also investigated. The results of the tests demonstrated that lift fan installation variables and hardware can have a significant effect on the thrust of the individual fans.

Diedrich, J. H.↗

Magellan/Galileo solder joint failure analysis and recommendations

On or about November 10, 1988 an open circuit solder joint was discovered in the Magellan Radar digital unit (DFU) during integration testing at Kennedy Space Center (KSC). A detailed analysis of the cause of the failure was conducted at the Jet Propulsion Laboratory leading to the successful repair of many pieces of affected electronic hardware on both the Magellan and Galileo spacecraft. The problem was caused by the presence of high thermal coefficient of expansion heat sink and conformal coating materials located in the large (0.055 inch) gap between Dual Inline Packages (DIPS) and the printed wiring board. The details of the observed problems are described and recommendations are made for improved design and testing activities in the future.

Ross, Ronald G., Jr.↗

NASA Contractor Report: Guidelines for Proof Test Analysis

These Guidelines integrate state-of-the-art Elastic-Plastic Fracture Mechanics (EPFM) and proof test implementation issues into a comprehensive proof test analysis procedure in the form of a Road Map which identifies the types of data, fracture mechanics based parameters, and calculations needed to perform flaw screening and minimum proof load analyses of fracture critical components. Worked examples are presented to illustrate the application of the Road Map to proof test analysis. The state-of-the-art fracture technology employed in these Guidelines is based on the EPFM parameter, J, and a pictorial representation of a J fracture analysis, called the Failure Assessment Diagram (FAD) approach. The recommended fracture technology is validated using finite element J results, and laboratory and hardware fracture test results on the nickel-based superalloy IN-718, the aluminum alloy 2024-T351 1, and ferritic pressure vessel steels. In all cases the laboratory specimens and hardware failed by ductile mechanisms. Advanced proof test analyses involving probability analysis and Multiple Cycle Proof Testing (MCPT) are addressed. Finally, recommendations are provided on to how to account for the effects of the proof test overload on subsequent service fatigue and fracture behaviors.

Chell, G. G.↗

[Advanced Development for Space Robotics With Emphasis on Fault Tolerance Technology]

This report describes work developing fault tolerant redundant robotic architectures and adaptive control strategies for robotic manipulator systems which can dynamically accommodate drastic robot manipulator mechanism, sensor or control failures and maintain stable end-point trajectory control with minimum disturbance. Kinematic designs of redundant, modular, reconfigurable arms for fault tolerance were pursued at a fundamental level. The approach developed robotic testbeds to evaluate disturbance responses of fault tolerant concepts in robotic mechanisms and controllers. The development was implemented in various fault tolerant mechanism testbeds including duality in the joint servo motor modules, parallel and serial structural architectures, and dual arms. All have real-time adaptive controller technologies to react to mechanism or controller disturbances (failures) to perform real-time reconfiguration to continue the task operations. The developments fall into three main areas: hardware, software, and theoretical.

Tesar, Delbert↗

Guidelines for Proof Test Analysis

These guidelines integrate state-of-the-art elastic-plastic fracture mechanics (EPFM) and proof test implementation issues into a comprehensive proof test analysis procedure in the form of a road map which identifies the types of data, fracture mechanics based parameters, and calculations needed to perform flaw screening and minimum proof load analyses of fracture critical components. Worked examples are presented to illustrate the application of the road map to proof test analysis. The state-of-the art fracture technology employed in these guidelines is based on the EPFM parameter, J, and a pictorial representation of a J fracture analysis, called the failure assessment diagram (FAD) approach. The recommended fracture technology is validated using finite element J results, and laboratory and hardware fracture test results on the nickel-based superalloy Inconel 718, the aluminum alloy 2024-T3511, and ferritic pressure vessel steels. In all cases the laboratory specimens and hardware failed by ductile mechanisms. Advanced proof test analyses involving probability analysis and multiple-cycle proof testing (MCPT) are addressed. Finally, recommendations are provided on how to account for the effects of the proof test overload on subsequent service fatigue and fracture behaviors.

Chell, G. G.↗

Fault Tolerant Homopolar Magnetic Bearings

Magnetic suspensions (MS) satisfy the long life and low loss conditions demanded by satellite and ISS based flywheels used for Energy Storage and Attitude Control (ACESE) service. This paper summarizes the development of a novel MS that improves reliability via fault tolerant operation. Specifically, flux coupling between poles of a homopolar magnetic bearing is shown to deliver desired forces even after termination of coil currents to a subset of failed poles . Linear, coordinate decoupled force-voltage relations are also maintained before and after failure by bias linearization. Current distribution matrices (CDM) which adjust the currents and fluxes following a pole set failure are determined for many faulted pole combinations. The CDM s and the system responses are obtained utilizing 1D magnetic circuit models with fringe and leakage factors derived from detailed, 3D, finite element field models. Reliability results are presented vs. detection/correction delay time and individual power amplifier reliability for 4, 6, and 7 pole configurations. Reliability is shown for two success criteria, i.e. (a) no catcher bearing contact following pole failures and (b) re-levitation off of the catcher bearings following pole failures. An advantage of the method presented over other redundant operation approaches is a significantly reduced requirement for backup hardware such as additional actuators or power amplifiers.

Li, Ming-Hsiu↗

Commercial Aircraft Integrated Vehicle Health Management Study

Statistical data and literature from academia, industry, and other government agencies were reviewed and analyzed to establish requirements for fixture work in detection, diagnosis, prognosis, and mitigation for IVHM related hardware and software. Around 15 to 20 percent of commercial aircraft accidents between 1988 and 2003 involved inalftfnctions or failures of some aircraft system or component. Engine and landing gear failures/malfunctions dominate both accidents and incidents. The IVI vl Project research technologies were found to map to the Joint Planning and Development Office's National Research and Development Plan (RDP) as well as the Safety Working Group's National Aviation Safety Strategic. Plan (NASSP). Future directions in Aviation Technology as related to IVHlvl were identified by reviewing papers from three conferences across a five year time span. A total of twenty-one trend groups in propulsion, aeronautics and aircraft categories were compiled. Current and ftiture directions of IVHM related technologies were gathered and classified according to eight categories: measurement and inspection, sensors, sensor management, detection, component and subsystem monitoring, diagnosis, prognosis, and mitigation.

Reveley, Mary S.↗

Adjustable Autonomy Testbed

The Adjustable Autonomy Testbed (AAT) is a simulation-based testbed located in the Intelligent Systems Laboratory in the Automation, Robotics and Simulation Division at NASA Johnson Space Center. The purpose of the testbed is to support evaluation and validation of prototypes of adjustable autonomous agent software for control and fault management for complex systems. The AA T project has developed prototype adjustable autonomous agent software and human interfaces for cooperative fault management. This software builds on current autonomous agent technology by altering the architecture, components and interfaces for effective teamwork between autonomous systems and human experts. Autonomous agents include a planner, flexible executive, low level control and deductive model-based fault isolation. Adjustable autonomy is intended to increase the flexibility and effectiveness of fault management with an autonomous system. The test domain for this work is control of advanced life support systems for habitats for planetary exploration. The CONFIG hybrid discrete event simulation environment provides flexible and dynamically reconfigurable models of the behavior of components and fluids in the life support systems. Both discrete event and continuous (discrete time) simulation are supported, and flows and pressures are computed globally. This provides fast dynamic simulations of interacting hardware systems in closed loops that can be reconfigured during operations scenarios, producing complex cascading effects of operations and failures. Current object-oriented model libraries support modeling of fluid systems, and models have been developed of physico-chemical and biological subsystems for processing advanced life support gases. In FY01, water recovery system models will be developed.

Malin, Jane T.↗

Qualification of Bonding Process of Temperature Sensors to Extreme Temperature Deep Space Missions

A process has been explored based on the state-of-the-art technology to bond the platinum resistance thermometer (PRT) on to potential aerospace material such as a flat aluminum surface and a flexible copper tube to simulate coaxial cable for the flight applications. Primarily, PRTs were inserted into a metal plated copper braid to avoid stresses on the sensor while attaching the sensor with braid to the base material for long duration deep space missions. Appropriate pretreatment has been implemented in this study to enhance the adhesion of the PRTs to the base material. NuSil product has been chosen in this research to attach PRT to the base materials. The resistance (approx.1.1 k(Omega)) of PRTs has been electrically monitored continuously during the qualification thermal cycling testing from -150 C to +120 C and -100 C to -35 C. The test hardware has been thermal cycled three times the mission life per JPL design principles for JUNO project. No PRT failures were observed during and after the PRT thermal cycling qualification test for extreme temperature environments. However, there were some failures associated with staking of the PRT pig tails as a result of thermal cycling qualification test.

Extreme temperatures↗

Arecibo Observatory Auxiliary M4N Socket Termination Failure Investigation

The NASA Engineering and Safety Center (NESC) was requested to support the Arecibo Observatory failure investigation in determining the root cause of the Auxiliary M4N cable failure. The NESC and Kennedy Space Center led an integrated NASA investigation with support from Marshall Space Flight Center and The Aerospace Corporation that included forensic investigation of failed hardware, finite element modeling, materials characterization, and root cause analysis. This document contains the outcome of the NESC Assessment.

Zinc Spelter Sockets↗

System safety as applied to Skylab

Procedural and organizational guidelines used in accordance with NASA safety policy for the Skylab missions are outlined. The basic areas examined in the safety program for Skylab were the crew interface, extra-vehicular activity (EVA), energy sources, spacecraft interface, and hardware complexity. Fire prevention was a primary goal, with firefighting as backup. Studies of the vectorcardiogram and sleep monitoring experiments exemplify special efforts to prevent fire and shock. The final fire control study included material review, fire detection capability, and fire extinguishing capability. Contractors had major responsibility for system safety. Failure mode and effects analysis (FMEA) and equipment criticality categories are outlined. Redundancy was provided on systems that were critical to crew survival (category I). The five key checkpoints in Skylab hardware development are explained. Skylab rescue capability was demonstrated by preparations to rescue the Skylab 3 crew after their spacecraft developed attitude control problems.

Kleinknecht, K. S.↗

Bayes Analysis and Reliability Implications of Stress-Rupture Testing a Kevlar/Epoxy COPV Using Temperature and Pressure Acceleration

Composite Overwrapped Pressure Vessels (COPVs) that have survived a long service time under pressure generally must be recertified before service is extended. Flight certification is dependent on the reliability analysis to quantify the risk of stress rupture failure in existing flight vessels. Full certification of this reliability model would require a statistically significant number of lifetime tests to be performed and is impractical given the cost and limited flight hardware for certification testing purposes. One approach to confirm the reliability model is to perform a stress rupture test on a flight COPV. Currently, testing of such a Kevlar49 (Dupont)/epoxy COPV is nearing completion. The present paper focuses on a Bayesian statistical approach to analyze the possible failure time results of this test and to assess the implications in choosing between possible model parameter values that in the past have had significant uncertainty. The key uncertain parameters in this case are the actual fiber stress ratio at operating pressure, and the Weibull shape parameter for lifetime; the former has been uncertain due to ambiguities in interpreting the original and a duplicate burst test. The latter has been uncertain due to major differences between COPVs in the database and the actual COPVs in service. Any information obtained that clarifies and eliminates uncertainty in these parameters will have a major effect on the predicted reliability of the service COPVs going forward. The key result is that the longer the vessel survives, the more likely the more optimistic stress ratio model is correct. At the time of writing, the resulting effect on predicted future reliability is dramatic, increasing it by about one "nine," that is, reducing the predicted probability of failure by an order of magnitude. However, testing one vessel does not change the uncertainty on the Weibull shape parameter for lifetime since testing several vessels would be necessary.

Phoenix, S. Leigh↗

Addressing failures in exascale computing

We present here a report produced by a workshop on “Addressing Failures in Exascale Computing” held in Park City, Utah, August 4–11, 2012. The charter of this workshop was to establish a common taxonomy about resilience across all the levels in a computing system; discuss existing knowledge on resilience across the various hardware and software layers of an exascale system; and build on those results, examining potential solutions from both a hardware and software perspective and focusing on a combined approach. The workshop brought together participants with expertise in applications, system software, and hardware; they came from industry, government, and academia; and their interests ranged from theory to implementation. The combination allowed broad and comprehensive discussions and led to this document, which summarizes and builds on those discussions.

Snir, Marc↗

Command decoder unit

The design and testing of laboratory hardware (a command decoder unit) used in evaluating space shuttle instrumentation, data processing, and ground check-out operations is described. The hardware was a modification of another similar instrumentation system. A data bus coupler was designed and tested to interface the equipment to a central bus controller (computer). A serial digital data transfer mechanism was also designed. Redundant power supplies and overhead modules were provided to minimize the probability of a single component failure causing a catastrophic failure. The command decoder unit is packaged in a modular configuration to allow maximum user flexibility in configuring a system. Test procedures and special test equipment for use in testing the hardware are described. Results indicate that the unit will allow NASA to evaluate future software systems for use in space shuttles. The units were delivered to NASA and appear to be adequately performing their intended function. Engineering sketches and photographs of the command decoder unit are included.

Source record↗

Reducing Waste in Extreme Scale Systems through Introspective Analysis

Resilience is an important challenge for extreme- scale supercomputers. Today, failures in supercomputers are assumed to be uniformly distributed in time. However, recent studies show that failures in high-performance computing systems are partially correlated in time, generating periods of higher failure density. Our study of the failure logs of multiple supercomputers show that periods of higher failure density occur with up to three times more than the average. We design a monitoring system that listens to hardware events and forwards important events to the runtime to detect those regime changes. We implement a runtime capable of receiving notifications and adapt dynamically. In addition, we build an analytical model to predict the gains that such dynamic approach could achieve. We demonstrate that in some systems, our approach can reduce the wasted time by over 30%.

Bautista-Gomez, Leonardo↗