Search NASA⌕ Search

SEARCH · Search NASA

Results for “Failure Rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

A Multi-Objective Bayesian Optimized Human Assessed Multi-Target Generated Spectral Recommender System for Rapid Pareto Discoveries of Material Properties

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameter and function spaces need a rapid strategic search through active learning. However, in all cases prior to optimization, the target material properties are assumed known and fixed, which mostly deviates from real-world scenarios in material synthesis. This can be critical for running expensive experiments on new materials, when the experimental results are fuzzy for any scientific outcomes due to improper target setting, ultimately wasting time and cost. The failure rate and cost are even higher over exploring on multi-target space, where we want to learn the pareto among multiple properties, to jointly optimize during material synthesis for desired applications. To address the challenge, here we introduce the human-operator attempt flexibility in the active learning based automated experiment framework, with generating multiple human assessed targets through a voting-based recommender system during real-time microscope measurements over the large material image space, sequentially learn/update multiple desired targets through a weighting system, and adaptively search in multiple material properties functional space for non-dominated pareto discoveries to maximize the custom structural similarity based acquisition function. We term this a multi-objective Bayesian optimized human assessed multi-target generated spectral recommender systems (MOBO-HAM-SRS). The approach has been demonstrated to peizoresponse force spectroscopy of a ferroelectric thin film, exploring with different kernels and acquisition functions. This work shows an advancement towards human-AI collaborated automated experiments, steering optimization trajectories through human overpowering AI at the early stage when uncertainty is high and AI overpowering human at the later stage with rapid exploration towards optimal goal, following human-assessed multiple targets properties.

Biswas, Arpan↗

The Effects of Maintenance Actions on the PFDavg of Spring Operated Pressure Relief Valves

The safety integrity level (SIL) of equipment used in safety instrumented functions is determined by the average probability of failure on demand (PFDavg) computed at the time of periodic inspection and maintenance, i.e., the time of proof testing. The computation of PFDavg is generally based solely on predictions or estimates of the assumed constant failure rate of the equipment. However, PFDavg is also affected by maintenance actions (or lack thereof) taken by the end user. This paper shows how maintenance actions can affect the PFDavg of spring operated pressure relief valves (SOPRV) and how these maintenance actions may be accounted for in the computation of the PFDavg metric. The method provides a means for quantifying the effects of changes in maintenance practices and shows how these changes impact plant safety.

42 ENGINEERING↗

SU-E-T-760: Tolerance Design for Site-Specific Range in Proton Patient QA Process Using the Six Sigma Model

Purpose: To show how tolerance design and tolerancing approaches can be used to predict and improve the site-specific range in patient QA process in implementing the Six Sigma. Methods: In this study, patient QA plans were selected according to 6 site-treatment groups: head &neck (94 cases), spine (76 cases), lung (89 cases), liver (53 cases), pancreas (55 cases), and prostate (121 cases), treated between 2007 and 2013. We evaluated a model of the Six Sigma that determines allowable deviations in design parameters and process variables in patient-specific QA, where possible, tolerance may be loosened, then customized if it necessary to meet the functional requirements. A Six Sigma problem-solving methodology is known as DMAIC phases, which are used stand for: Define a problem or improvement opportunity, Measure process performance, Analyze the process to determine the root causes of poor performance, Improve the process by fixing root causes, Control the improved process to hold the gains. Results: The process capability for patient-specific range QA is 0.65 with only ±1 mm of tolerance criteria. Our results suggested the tolerance level of ±2–3 mm for prostate and liver cases and ±5 mm for lung cases. We found that customized tolerance between calculated and measured range reduce that patient QA plan failure and almost all sites had failure rates less than 1%. The average QA time also improved from 2 hr to less than 1 hr for all including planning and converting process, depth-dose measurement and evaluation. Conclusion: The objective of tolerance design is to achieve optimization beyond that obtained through QA process improvement and statistical analysis function detailing to implement a Six Sigma capable design.

60 APPLIED LIFE SCIENCES↗

First evaluation of the feasibility of MLC tracking using ultrasound motion estimation

Purpose: To quantify the performance of the Clarity ultrasound (US) imaging system (Elekta AB, Stockholm, Sweden) for real-time dynamic multileaf collimator (MLC) tracking. Methods: The Clarity calibration and quality assurance phantom was mounted on a motion platform moving with a periodic sine wave trajectory. The detected position of a 30 mm hypoechogenic sphere within the phantom was continuously reported via Clarity’s real-time streaming interface to an in-house tracking and delivery software and subsequently used to adapt the MLC aperture. A portal imager measured MV treatment field/MLC apertures and motion platform positions throughout each experiment to independently quantify system latency and geometric error. Based on the measured range of latency values, a prostate stereotactic body radiation therapy (SBRT) delivery was performed with three realistic motion trajectories. The dosimetric impact of system latency on MLC tracking was directly measured using a 3D dosimeter mounted on the motion platform. Results: For 2D US imaging, the overall system latency, including all delay times from the imaging and delivery chain, ranged from 392 to 424 ms depending on the lateral sector size. For 3D US imaging, the latency ranged from 566 to 1031 ms depending on the elevational sweep. The latency-corrected geometric root-mean squared error was below 0.75 mm (2D US) and below 1.75 mm (3D US). For the prostate SBRT delivery, the impact of a range of system latencies (400–1000 ms) on the MLC tracking performance was minimal in terms of gamma failure rate. Conclusions: Real-time MLC tracking based on a noninvasive US input is technologically feasible. Current system latencies are higher than those for x-ray imaging systems, but US can provide full volumetric image data and the impact of system latency was measured to be small for a prostate SBRT case when using a US-like motion input.

60 APPLIED LIFE SCIENCES↗

WE-AB-BRA-09: Registration of Preoperative MRI to Intraoperative Radiographs for Automatic Vertebral Target Localization

Purpose: Accurate localization of target vertebrae is essential to safe, effective spine surgery, but wrong-level surgery occurs with surprisingly high frequency. Recent research yielded the “LevelCheck” method for 3D-2D registration of preoperative CT to intraoperative radiographs, providing decision support for level localization. We report a new method (MR-LevelCheck) to perform 3D-2D registration based on preoperative MRI, presenting a solution for the increasingly common scenario in which MRI (not CT) is used for preoperative planning. Methods: Direct extension of LevelCheck is confounded by large mismatch in image intensity between MRI and radiographs. The proposed method overcomes such challenges with a simple vertebrae segmentation. Using seed points at centroids, vertebrae are segmented using continuous max-flow method and dilated by 1.8 mm to include surrounding cortical bone (inconspicuous in T2w-MRI). MRI projections are computed (analogous to DRR) using segmentation and registered to intraoperative radiographs. The method was tested in a retrospective IRB-approved study involving 11 patients undergoing cervical, thoracic, or lumbar spine surgery following preoperative MRI. Registration accuracy was evaluated in terms of projection-distance-error (PDE) between the true and estimated location of vertebrae in each radiograph. Results: The method successfully registered each preoperative MRI to intraoperative radiographs and maintained desirable properties of robustness against image content mismatch, and large capture range. Segmentation achieved Dice coefficient = 89.2 ± 2.3 and mean-absolute-distance (MAD) = 1.5 ± 0.3 mm. Registration demonstrated robust performance under realistic patient variations, with PDE = 4.0 ± 1.9 mm (median ± iqr) and converged with run-time = 23.3 ± 1.7 s. Conclusion: The MR-LevelCheck algorithm provides an important extension to a previously validated decision support tool in spine surgery by extending its utility to preoperative MRI. With initial studies demonstrating PDE <5 mm and 0% failure rate, the method is now in translation to larger scale prospective clinical studies. S. Vogt and G. Kleinszig are employees of Siemens Healthcare.

60 APPLIED LIFE SCIENCES↗

Memory Errors in Modern Systems: The Good, The Bad, and The Ugly

Several recent publications have shown that hardware faults in the memory subsystem are commonplace. These faults are predicted to become more frequent in future systems that contain orders of magnitude more DRAM and SRAM than found in current memory subsystems. These memory subsystems will need to provide resilience techniques to tolerate these faults when deployed in high-performance computing systems and data centers containing tens of thousands of nodes. Therefore, it is critical to understand the efficacy of current hardware resilience techniques to determine whether they will be suitable for future systems. In this paper, we present a study of DRAM and SRAM faults and errors from the field. We use data from two leadership-class high-performance computer systems to analyze the reliability impact of hardware resilience schemes that are deployed in current systems. Our study has several key findings about the efficacy of many currently deployed reliability techniques such as DRAM ECC, DDR address/command parity, and SRAM ECC and parity. We also perform a methodological study, and find that counting errors instead of faults, a common practice among researchers and data center operators, can lead to incorrect conclusions about system reliability. Lastly, we use our data to project the needs of future large-scale systems. We find that SRAM faults are unlikely to pose a significantly larger reliability threat in the future, while DRAM faults will be a major concern and stronger DRAM resilience schemes will be needed to maintain acceptable failure rates similar to those found on today's systems.

97 MATHEMATICS AND COMPUTING↗

A practical approach to reconciling availability, performance, and capacity in provisioning extreme-scale storage systems

The increasing data demands from high-performance computing applications significantly accelerate the capacity, capability and reliability requirements of storage systems. As systems scale, component failures and repair times increase, significantly impacting data availability. A wide array of decision points must be balanced in designing such systems. We propose a systematic approach that balances and optimizes both initial and continuous spare provisioning based on a detailed investigation of the anatomy and field failure data analysis of extreme-scale storage systems. We consider the component failure characteristics and its cost and impact at the system level simultaneously. We build a tool to evaluate different provisioning schemes, and the results demonstrate that our optimized provisioning can reduce the duration of data unavailability by as much as 52% under a fixed budget. We also observe that non-disk components have much higher failure rates than disks, and warrant careful considerations in the overall provisioning process.

Computer Science↗

A Survey of Architectural Techniques for Near-Threshold Computing

Energy efficiency has now become the primary obstacle in scaling the performance of all classes of computing systems. In low-voltage computing and specifically, near-threshold voltage computing (NTC), which involves operating the transistor very close to and yet above its threshold voltage, holds the promise of providing many-fold improvement in energy efficiency. However, use of NTC also presents several challenges such as increased parametric variation, failure rate and performance loss etc. Our paper surveys several re- cent techniques which aim to offset these challenges for fully leveraging the potential of NTC. By classifying these techniques along several dimensions, we also highlight their similarities and differences. Ultimately, we hope that this paper will provide insights into state-of-art NTC techniques to researchers and system-designers and inspire further research in this field.

97 MATHEMATICS AND COMPUTING↗

Understanding GPU Memory Corruption at Extreme Scale: The Summit Case Study

GPU memory corruption and in particular double-bit errors (DBEs) remain one of the least understood aspects of HPC system reliability. Albeit rare, their occurrences always lead to job termination and can potentially cost thousands of node-hours, either from wasted computations or as the overhead from regular checkpointing needed to minimize the losses. As supercomputers and their components simultaneously grow in scale, density, failure rates, and environmental footprint, the efficiency of HPC operations becomes both an imperative and a challenge. We examine DBEs using system telemetry data and logs collected from the Summit supercomputer, equipped with 27,648 Tesla V100 GPUs with 2nd-generation high-bandwidth memory (HBM2). Using exploratory data analysis and statistical learning, we extract several insights about memory reliability in such GPUs. We find that GPUs with prior DBE occurrences are prone to experience them again due to otherwise harmless factors, correlate this phenomenon with GPU placement, and suggest manufacturing variability as a factor. On the general population of GPUs, we link DBEs to short- and long-term high power consumption modes while finding no significant correlation with higher temperatures. We also show that the workload type can be a factor in memory’s propensity to corruption.

Oles, Vlad↗

A checkpoint compression study for high-performance computing systems

As high-performance computing systems continue to increase in size and complexity, higher failure rates and increased overheads for checkpoint/restart (CR) protocols have raised concerns about the practical viability of CR protocols for future systems. Previously, compression has proven to be a viable approach for reducing checkpoint data volumes and, thereby, reducing CR protocol overhead leading to improved application performance. In this article, we further explore compression-based CR optimization by exploring its baseline performance and scaling properties, evaluating whether improved compression algorithms might lead to even better application performance and comparing checkpoint compression against and alongside other software- and hardware-based optimizations. Our results highlights are: (1) compression is a very viable CR optimization; (2) generic, text-based compression algorithms appear to perform near optimally for checkpoint data compression and faster compression algorithms will not lead to better application performance; (3) compression-based optimizations fare well against and alongside other software-based optimizations; and (4) while hardware-based optimizations outperform software-based ones, they are not as cost effective.

97 MATHEMATICS AND COMPUTING↗

Partial differential equations preconditioner resilient to soft and hard faults

We present a domain-decomposition-based preconditioner for the solution of partial differential equations (PDEs) that is resilient to both soft and hard faults. The algorithm reformulates the PDE as a sampling problem, followed by a solution update through data manipulation that is resilient to both soft and hard faults. This reformulation allows us to recast the problem as a set of independent tasks, and exploit data locality to reduce global communication. We discuss two different parallel implementations: (a) a single program multiple data (SPMD) version based on a one-to-one mapping between subdomain and MPI processes responsible for both state and computation; and (b) an asynchronous server–client implementation where all state information is held by the servers and clients are designed solely as computational units. We present a scalability comparison of both implementations under nominal conditions, showing efficiency within ~80% for up to 12,000 cores. We present a resilience analysis under different fault scenarios based on the server–client implementation. This framework provides resiliency to hard faults such that if a client crashes, it stops asking for work, and the servers simply distribute the work among all of the other clients alive. Erroneous subdomain solves (e.g. due to soft faults) appear as corrupted data, which is either rejected if that causes a task to fail, or is seamlessly filtered out during the regression stage through a suitable noise model. Three different types of faults are modeled: hard faults modeling nodes (or clients) crashing; soft faults occurring during the communication of the tasks between server and clients; and soft faults occurring during task execution. We demonstrate the resiliency of the approach for a 2D elliptic PDE, and explore the effect of the faults at various failure rates.

97 MATHEMATICS AND COMPUTING↗

High quality copy number and genotype data from FFPE samples using Molecular Inversion Probe (MIP) microarrays

A major challenge facing DNA copy number (CN) studies of tumors is that most banked samples with extensive clinical follow-up information are Formalin-Fixed Paraffin Embedded (FFPE). DNA from FFPE samples generally underperforms or suffers high failure rates compared to fresh frozen samples because of DNA degradation and cross-linking during FFPE fixation and processing. As FFPE protocols may vary widely between labs and samples may be stored for decades at room temperature, an ideal FFPE CN technology should work on diverse sample sets. Molecular Inversion Probe (MIP) technology has been applied successfully to obtain high quality CN and genotype data from cell line and frozen tumor DNA. Since the MIP probes require only a small ({approx}40 bp) target binding site, we reasoned they may be well suited to assess degraded FFPE DNA. We assessed CN with a MIP panel of 50,000 markers in 93 FFPE tumor samples from 7 diverse collections. For 38 FFPE samples from three collections we were also able to asses CN in matched fresh frozen tumor tissue. Using an input of 37 ng genomic DNA, we generated high quality CN data with MIP technology in 88% of FFPE samples from seven diverse collections. When matched fresh frozen tissue was available, the performance of FFPE DNA was comparable to that of DNA obtained from matched frozen tumor (genotype concordance averaged 99.9%), with only a modest loss in performance in FFPE. MIP technology can be used to generate high quality CN and genotype data in FFPE as well as fresh frozen samples.

59 BASIC BIOLOGICAL SCIENCES↗

North Carolina Water Utility Builds Resilience with Distributed Energy Resources

As the frequency and duration of grid outages increase, backup power systems are becoming more important for ensuring that critical infrastructure continues to provide essential services. Most facilities rely on diesel generators, which may be ineffective during long outages owing to limited fuel supplies and high generator failure rates. Distributed energy resources such as solar, storage, and combined-heat-and-power systems, coupled with on-site biofuel production, offer an alternative source of on-site generation that can provide both cost savings and resilience (i.e., the ability to respond to catastrophic events with longer-term consequences). A mixed-integer linear program minimizes costs and maximizes resilience at a wastewater treatment plant in Wilmington, North Carolina. We find that the plant can reduce life-cycle energy costs by 3.1% through the installation of a hybrid combined-heat-and-power, photovoltaic, and storage system. When paired with existing diesel generators, this system can sustain full load for seven days while saving $664,000 over 25 years and reducing diesel fuel use by 48% compared with the diesel-only solution. This analysis informed a decision by the Cape Fear Public Utility Authority to allocate funds for the implementation of a combined-heat-and-power system at the wastewater treatment plant in fiscal year 2023. Finally, the benefits of deploying hybrid combined-heat-and-power technologies and the utilization of on-site biofuel production extend, on a national scale, to thousands of wastewater treatment facilities and other types of critical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Wireless Monitoring of Liver Hemodynamics In Vivo

Liver transplants have their highest failure rate in the first two weeks following surgery. There are no devices for continuous, real-time monitoring of the graft, currently. Here, we present a continuous perfusion and oxygen consumption monitor based on photoplethysmography. The sensor is battery operated and communicates wirelessly with a data acquisition computer which provides the possibility of implantation provided sufficient miniaturization. In two in vivo porcine studies, the sensor tracked perfusion changes in hepatic tissue during vascular occlusions with a root mean square error (RMSE) of 0.125 mL/min/g of tissue. We show the possibility of using the pulsatile wave to measure the arterial oxygen saturation similar to pulse oximetry. This signal is used as a feedback to extract the venous oxygen saturation from the DC levels. Arterial and venous oxygen saturation changes were measured with an RMSE of 2.19 and 1.39% respectively when no vascular occlusions were induced. The resulting error increased to 2.82 and 3.83% when vascular occlusions were induced during hypoxia. These errors are similar to the resolution of the oximetry catheter used as a reference. This work is the first realization of a wireless perfusion and oxygenation sensor for continuous monitoring of hepatic perfusion and oxygenation changes.

59 BASIC BIOLOGICAL SCIENCES↗

FRIEDA: Flexible Robust Intelligent Elastic Data Management Framework

Scientific applications are increasingly using cloud resources for their data analysis workflows. However, managing data effectively and efficiently over these cloud resources is challenging due to the myriad storage choices with different performance, cost trade-offs, complex application choices and complexity associated with elasticity, failure rates in these environments. The different data access patterns for data-intensive scientific applications require a more flexible and robust data management solution than the ones currently in existence. FRIEDA is a Flexible Robust Intelligent Elastic Data Management framework that employs a range of data management strategies in cloud environments. FRIEDA can manage storage and data lifecycle of applications in cloud environments. There are four different stages in the data management lifecycle of FRIEDA – (i) storage planning, (ii) provisioning and preparation, (iii) data placement, and (iv) execution. FRIEDA defines a data control plane and an execution plane. The data control plane defines the data partition and distribution strategy, whereas the execution plane manages the execution of the application using a master-worker paradigm. FRIEDA also provides different data management strategies, either to partition the data in real-time, or predetermine the data partitions prior to application execution.

97 MATHEMATICS AND COMPUTING↗

Advanced Outage and Control Center: Strategies for Nuclear Plant Outage Work Status Capabilities

The research effort is a part of the Light Water Reactor Sustainability (LWRS) Program. LWRS is a research and development program sponsored by the Department of Energy, performed in close collaboration with industry to provide the technical foundations for licensing and managing the long-term, safe and economical operation of current nuclear power plants. The LWRS Program serves to help the US nuclear industry adopt new technologies and engineering solutions that facilitate the continued safe operation of the plants and extension of the current operating licenses. The Outage Control Center (OCC) Pilot Project was directed at carrying out the applied research for development and pilot of technology designed to enhance safe outage and maintenance operations, improve human performance and reliability, increase overall operational efficiency, and improve plant status control. Plant outage management is a high priority concern for the nuclear industry from cost and safety perspectives. Unfortunately, many of the underlying technologies supporting outage control are the same as those used in the 1980’s. They depend heavily upon large teams of staff, multiple work and coordination locations, and manual administrative actions that require large amounts of paper. Previous work in human reliability analysis suggests that many repetitive tasks, including paper work tasks, may have a failure rate of 1.0E-3 or higher (Gertman, 1996). With between 10,000 and 45,000 subtasks being performed during an outage (Gomes, 1996), the opportunity for human error of some consequence is a realistic concern. Although a number of factors exist that can make these errors recoverable, reducing and effectively coordinating the sheer number of tasks to be performed, particularly those that are error prone, has the potential to enhance outage efficiency and safety. Additionally, outage management requires precise coordination of work groups that do not always share similar objectives. Outage managers are concerned with schedule and cost, union workers are concerned with performing work that is commensurate with their trade, and support functions (safety, quality assurance, and radiological controls, etc.) are concerned with performing the work within the plants controls and procedures. Approaches to outage management should be designed to increase the active participation of work groups and managers in making decisions that closed the gap between competing objectives and the potential for error and process inefficiency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quality Parameters and Chemical Analysis for Biodiesel Produced in the United States in 2011

Samples of biodiesel (B100) from producers and terminals in 2011were tested for critical properties: free and total glycerin, flash point, cloud point, oxidation stability, cold soak filterability, and metals. Failure rates for cold soak filterability and oxidation stability were below 5%. One sample failed flash point due to excess methanol. One sample failed oxidation stability and metal content. Overall, 95% of the samples from this survey met biodiesel quality specification ASTM D6751. In 2007, a sampling of B100 from production facilities showed that nearly 90% met D6751. In samples meeting D6751, calcium was found above the method detection limit in nearly half the samples. Feedstock analysis revealed half the biodiesel was produced from soy and half was from mixed feedstocks. The saturated fatty acid methyl ester concentration of the B100 was compared to the saturated monoglyceride concentration as a percent of total monoglyceride. The real-world correlation of these properties was very good. The results of liquid chromatograph measurement of monoglycerides were compared to ASTM D6751. Agreement between the two methods was good, particularly for total monoglycerides and unsaturated monoglycerides. Because only very low levels of saturated monoglycerides measured, the two methods had more variability, but the correlation was still acceptable.

09 BIOMASS FUELS↗

Radiation Protection Instrument Reliability and Maintainability Data

This report is a collection of reliability and maintenance data on several types of radiation protection instrumentation. Some radiation detectors are used for personnel safety; others are used for environmental stewardship. Six types of instruments are addressed in this report. These are: continuous air monitors, tritium room air monitors, facility vent stack monitors, tritium bubbler monitors, tritium in effluent water monitors, and general purpose radiation survey meters. Literature searches, operating experience data, and occurrence reports were used to identify failure modes and to estimate quantitative failure rates for several general types of radiation protection instruments. Likewise, data on instrument repair has been found when possible and used to estimate the mean time to repair. These data can be useful for facility safety assessment, personnel safety assessment, environment assessment, and for equipment and labor planning purposes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗