Search NASA⌕ Search

SEARCH · Search NASA

Results for “failure tolerance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Decentralized Failure-Tolerant Optimization of Electric Vehicle Charging

We present a decentralized failure-tolerant algorithm for optimizing electric vehicle (EV) charging, using charging stations as computing agents. The algorithm is based on the alternating direction method of multipliers (ADMM) and it has the following features: (i) It handles capacity, peak demand, and ancillary services coupling constraints. (ii) It does not require a central agent collecting information and performing coordination (e.g. an aggregator), instead all agents exchange information and computations are carried out in a fully decentralized fashion. (iii) It can withstand the failure of any number of computing agents, as long as the remaining computing agents are in a connected communications network. We construct this algorithm by reformulating the optimal EV charging problem in a decomposable form, amenable to ADMM, and then developing efficient decentralized solution methods for the subproblems dealing with coupling constraints. We conduct numerical experiments on industry-scale synthetic EV charging datasets, with up to 1,152 charging stations, using a high performance computing cluster. The experiments demonstrate that the proposed algorithm can solve the optimal EV charging problem fast enough to permit the integration of EV charging with real-time electricity markets, even in the presence of failures.

42 ENGINEERING↗
DOE OSTI2020

3D Coded SUMMA: Communication-Efficient and Robust Parallel Matrix Multiplication

In this paper, we propose a novel fault-tolerant parallel matrix multiplication algorithm called 3D Coded SUMMA that achieves higher failure-tolerance than replication-based schemes for the same amount of redundancy. This work bridges the gap between recent developments in coded computing and fault-tolerance in high-performance computing (HPC). The core idea of coded computing is the same as algorithm-based fault-tolerance (ABFT), which is weaving redundancy in the computation using error-correcting codes. In particular, we show that MatDot codes, an innovative code construction for parallel matrix multiplications, can be integrated into three-dimensional SUMMA (Scalable Universal Matrix Multiplication Algorithm [30]) in a communication-avoiding manner. To tolerate any two node failures, the proposed 3D Coded SUMMA requires ~50% less redundancy than replication, while the overhead in execution time is only about 5–10%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Projected network performance for next-generation xenon monitoring systems

Next-generation radioxenon monitoring systems are reaching maturity and are expected to improve certain aspects of performance in verifying the absence of nuclear tests. To predict the improvement in detecting and locating nuclear releases, thousands of releases all over the globe were simulated and the global detection probability was calculated. This was done for the International Monitoring System network of noble gas samplers as it currently exists (25 certified stations), and how it would be for potential future network sizes of 39 and 79 stations. The probability of detection was calculated for releases ranging from 10 10 Bq to 10 16 Bq of 133 Xe and presented as coverage maps and global integrals for both current and next-generation monitoring systems. Similarly, the number of detecting stations and the number of detecting samples were tabulated to elucidate the possibilities for enhanced location capability. Improvements in global detection coverage are maximized at different release sizes in a way that depends on the station density. For example, for releases of 3×10 14 Bq and 39 stations, the detection probability would rise from 60% to 70% with next-generation systems, while for releases of 10 13 Bq and 79 stations, it would rise from 37% to 52%. Achieving an average of two detecting stations requires a 1015 Bq release for a 39-station network and a 10 14 Bq release for a 79-station network. The largest impact of using next-generation systems may be the confidence, failure tolerance, and location capability that arise from obtaining multiple samples associated with a single release event.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Tolerating memory stack failures in multi-stack systems

Memory management circuitry and processes operate to improve reliability of a group of memory stacks, providing that if a memory stack or a portion thereof fails during the product's lifetime, the system may still recover with no errors or data loss. A front-end controller receives a block of data requested to be written to memory, divides the block into sub-blocks, and creates a new redundant reliability sub-block. The sub-blocks are then written to different memory stacks. When reading data from the memory stacks, the front-end controller detects errors indicating a failure within one of the memory stacks, and recovers corrected data using the reliability sub-block. The front-end controller may monitor errors for signs of a stack failure and disable the failed stack.

Mappouras, Georgios↗
DOE OSTI2020

Degradation and Failure Phenomena of Accident Tolerant Fuel Concepts: FeCrAl Alloy Cladding

The U.S. Nuclear Regulatory Commission (NRC) is anticipating licensing applications and commercial use of accident tolerant fuel (ATF) in United States commercial nuclear power reactors. Pacific Northwest National Laboratory is providing technical assistance to the NRC related to the newly proposed nuclear fuel and cladding designs. This report focuses specifically on the iron-chromium-aluminum (FeCrAl) alloys being investigated to replace zirconium-based alloys for fuel cladding and provides current state-of-the-industry information on material properties and fuel performance considerations under reactor operating conditions and design basis accident conditions. Currently, Global Nuclear Fuels (GNF) is the only U.S.-based fuel vendor considering FeCrAl cladding as a near-term ATF design. GNF has tested several different FeCrAl alloys including Kanthal APMT, C26M, and MA956; fueled C26M rods and unfueled Kanthal APMT, C26M, and MA956 rods have been inserted in lead test assemblies at Plants Hatch and Clinton. This report will focus on those three alloys specifically, with broader information given regarding in-reactor and ex-reactor testing of FeCrAl alloys. To support the NRC’s readiness efforts, this report will identify and discuss degradation and failure modes of FeCrAl cladding concepts, including fuel performance characteristics that may not be addressed within existing regulatory documents.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

A Hot‐Swappable, Fault‐Tolerant, Modular Power Converter System for Solar Photovoltaic Plants

The performance metrics of the state-of-the-art commercial solar inverters, such as system cost, operation and maintenance (O&M) cost, service life, reliability, maintainability, and power density are much lower than the target metrics needed to achieve SunShot’s 2030 levelized cost of energy (LCOE) goals. To overcome the shortcomings of the existing solar inverters, this project proposed a novel Hot-Swappable, Fault-Tolerant, Modular Power Converter (HSFT-MPC) concept for solar photovoltaic (PV) plants and proved the concept through the design, fabrication, and laboratory test validation of a single-phase HSFT-MPC prototype. The HSFT-MPC has the following distinct advantages over the state-of-the-art: 1) elimination of harmonic/ electromagnetic interference (EMI) filter in the inverter stage due to the novel topology, 2) lower system cost and higher power density due to the modular design, elimination of harmonic/EMI filter, and lower cooling requirement, 3) higher efficiency due to lower switching frequencies, 4) higher reliability and longer (50 years) service life due to simpler cooling and fault tolerance capability, 5) easier installation, lower O&M cost, and improved maintainability due to the modular design and hot-swappable power electronic building blocks (PEBBs), and 6) improved manufacturability due to the modular design. This project developed a single-phase HSFT-MPC prototype with 25kW nominal output power, 2.4kV, 60Hz nominal AC output, lower than 5% AC output voltage total harmonic distortion, over 5 kW/L inverter power density, and 99.4% inverter peak efficiency, being tolerant to failure of single and multiple PEBBs, and capable of hot swapping of the failed PEBB(s). The HSFT-MPC enables uninterruptable operation of the solar PV plant when failure of single or multiple PEBBs or PV modules occurs. Compared with the existing solar inverters in the market, the HSFT-MPC is expected to reduce the inverter failure-caused downtime and energy losses of solar PV plants by more than 60% and 50%, respectively. Project findings have been presented at major conferences in the field and published in peer-reviewed papers, which added new knowledge to the field of power electronics for solar PV systems. A minicourse on Solar PV Systems was developed for outreach activities. The minicourse will help attract young individuals to the renewable energy profession which has a significant talent shortage. The HSFT-MPC is expected to overcome all of the shortcomings of the state-of-the-art solar inverters in terms of cost, efficiency, service life, reliability, maintainability, and manufacturability targets needed to achieve SunShot’s 2030 LCOE goals. Therefore, the proposed HSFT-MPC concept has the great potential to disrupt the current solar inverter market. This project created a pathway towards industry adoption of the HSFT-MPC to help achieve 50-year service life solar PV systems. Since the solar PV plants using the HSFT-MPC will feature with higher reliability, longer service life, and easier maintenance, they are particularly useful for the rural areas with underserved populations that demand reliable and affordable clean electricity. The outcomes of the project have the strong potential to address national needs in the field of renewable energy to reduce CO 2 emissions from the electricity sector, reduce imports of energy from foreign sources, and improve energy security, efficiency, and sustainability. Since electricity is used in almost all of society’s sectors, the outcomes of the project will benefit various sectors of society and economy.

14 SOLAR ENERGY↗
DOE OSTI2020

NDE Technology Engineering Program for Hanford DST Non-Visual Volumetric Inspection Technology: Phase II RAVIS Radiation Tolerance Test Report

This test report provides the results of radiation tolerance robustness testing that was performed on samples of robotic components and an ultrasonic guided wave air-slot sensor that represent components/sub-systems of the Robotic Air-slot Volumetric Inspection System (RAVIS) that has been engineered for volumetric inspection of Hanford tank bottom plates via under-tank refractory pad air-slots. The specific components tested for 1) functionality during active irradiation and 2) tolerance to cumulative radiation dose (until failure or upon reaching a cumulative dose test limit) were: • four samples each of a printed circuit board (PCB) and direct current (DC) motor, which are robotic components, and • 26 ultrasonic piezoelectric elements (samples) inside an air-slot sensor. The robotic components are part of the RAVIS air-slot inspection crawler drive control system that is responsible for remote communication with and actuation of the air-slot inspection crawler. The failure of either of these components during under-tank deployment would require manual retrieval via the crawler’s tether, which risks damage to the robot/refractory/tank. Preemptive replacement of the components at appropriately conservative dose/time intervals informed by failure dose would reduce the likelihood of under-tank failure. The components were included in radiation tolerance testing to quantify their failure doses to inform replacement intervals. The air-slot sensor is responsible for collecting ultrasonic inspection data (scan images) for the tank bottom plates during under-tank deployment. Compromised signal quality due to elevated noise levels caused by gamma radiation would compromise inspection performance. The air-slot sensor was included in radiation tolerance testing to quantify the impact of active irradiation on sensor signal quality. The irradiation and in-situ functional tests of the PCBs, DC motors and air-slot sensor took place in June and July 2020 at the Pacific Northwest National Laboratory. Testing was performed at a gamma dose rate near 300 rad/hr., which, in the absence of under-tank dose rate data, has been conservatively estimated to be the upper-bound dose rate beneath the primary tanks at Hanford. Irradiation took place at elevated temperatures of 150-200°F to determine failure doses that reflect the compounding effects of gamma radiation and heat. The test results revealed: • The DC motors can tolerate being actively irradiated at the high dose rate at 200°F and can tolerate a cumulative dose of 300,000 rad, that which would be incurred after 5 years of service at the 300 rad/hr dose rate. The component therefore meets minimum and preferred radiation tolerance and lifecycle requirements for robotic components. • The air-slot sensor can tolerate being actively irradiated at the high dose rate at 150°F and can tolerate a cumulative dose of 60,000 rad, that which would be incurred after 1 year of service at the 300 rad/hr dose rate. The sensor therefore meets minimum radiation tolerance and lifecycle requirements. • The PCB can tolerate being actively irradiated at the high dose rate, but can only tolerate a cumulative dose of 19,000 rad at 150-200°F. The PCB does not meet minimum radiation tolerance and lifecycle requirements; however, because the component is considered replaceable, it can be replaced before a cumulative dose of 19,000 rad is reached, determined through either monitoring with a dosimeter or scheduled time intervals that are calculated based on conservative estimates of under-tank dose rates.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

FIRE: A Failure-Adaptive RL Framework for Edge Computing Migrations

In edge computing, users' service profiles are migrated between edge servers due to user mobility. Reinforcement Learning (RL) frameworks have been proposed to do so, often trained on simulated data. However, existing RL frameworks overlook occasional server failures, which although rare, impact latency-sensitive applications like AR/VR and real- time obstacle detection. These rare failures, being not adequately represented in historical training data, pose a challenge for data-driven RL algorithms. We introduce FIRE, a framework that adapts to rare events by training a RL policy in an edge computing digital twin environment. We propose FIRE-ImRE, an importance sampling-based Q-learning algorithm, which samples rare events proportionally to their impact on the value function. FIRE considers delay, migration, failure, and backup placement costs across individual and shared service profiles. We prove FIRE-ImRE's boundedness and convergence to optimality. Next, we introduce novel deep Q-learning (FIRE-ImDQL) and actor critic (FIRE-ImACRE) versions of our algorithm to enhance scalability. Here, we extend our framework to accommodate users with varying risk tolerances of rare failure events. Through trace-driven experiments, we show that FIRE reduces edge computing costs compared to vanilla RL and the greedy baseline in the event of failures.

Edge computing↗
DOE OSTI2024

ASME – Grappling with the Concept of Component Failure

ASME concepts of component failure. Definition for failure, functionality, damage tolerance, including Magnox reactors and AGRs. How ASME is addressing damage tolerance, and Section III division 5 Design, Classification, Reliability Target for SRC-1 components, Basic analysis approach, simple assessment, and full assessments, Reference to reliability and integrity management and strategy for graphite components.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Massively scalable workflows for quantum chemistry: BigChem and ChemCloud

Electronic structure theory, i.e., quantum chemistry, is the fundamental building block for many problems in computational chemistry. Here we present a new distributed computing framework (BigChem), which allows for an efficient solution of many quantum chemistry problems in parallel. BigChem is designed to be easily composable and leverages industry-standard middleware (e.g., Celery, RabbitMQ, and Redis) for distributed approaches to large scale problems. BigChem can harness any collection of worker nodes, including ones on cloud providers (such as AWS or Azure), local clusters, or supercomputer centers (and any mixture of these). BigChem builds upon MolSSI packages, such as QCEngine to standardize the operation of numerous computational chemistry programs, demonstrated here with Psi4, xtb, geomeTRIC, and TeraChem. BigChem delivers full utilization of compute resources at scale, offers a programable canvas for designing sophisticated quantum chemistry workflows, and is fault tolerant to node failures and network disruptions. We demonstrate linear scalability of BigChem running computational chemistry workloads on up to 125 GPUs. Finally, we present ChemCloud, a web API to BigChem and successor to TeraChem Cloud. ChemCloud delivers scalable and secure access to BigChem over the Internet.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Results of the KRUSTY Nuclear System Test

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY nuclear system test, which operated the power system at various temperatures and power levels for 28 consecutive hours. The testing showed that the system operated as expected and that the reactor is highly tolerant of possible failure conditions and transients. The key feature demonstrated was the ability of the reactor to load-follow the demand of the power conversion system. The thermal power of the test ranged from 1.5 to 5.0 kW(thermal), with a fuel temperature up to 880°C. Each 80-W(electric)–rated Stirling converter produced ~90 W(electric) at a component efficiency of ~35% and an overall system efficiency of ~25%.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Design Considerations and Analysis of Multi-Level Erasure Coding in Large-Scale Data Centers

Multi-level erasure coding (MLEC) has seen large deployments in the field, but there is no in-depth study of design considerations for MLEC at scale. In this paper, we provide comprehensive design considerations and analysis of MLEC at scale. We introduce the design space of MLEC in multiple dimensions, including various code parameter selections, chunk placement schemes, and various repair methods. We quantify their performance and durability, and show which MLEC schemes and repair methods can provide the best tolerance against independent/correlated failures and reduce repair network traffic by orders of magnitude. To achieve this, we use various evaluation strategies including simulation, splitting, dynamic programming, and mathematical modeling. We also compare the performance and durability of MLEC with other EC schemes such as SLEC and LRC and show that MLEC can provide high durability with higher encoding throughput and less repair network traffic over both SLEC and LRC.

Wang, Meng↗
DOE OSTI2024

The influence of electrode crack dimensions on the durability of polymer electrolyte membrane fuel cells

Electrode cracks in polymer electrolyte membrane fuel cells (PEMFCs) are correlated with early onset failures. Here, in this work we investigate the influence of cracked gas diffusion electrodes (GDEs) on the durability of the membrane electrode assembly (MEA) using a combined chemical-mechanical accelerated stress test (AST). Electrode crack dimensions were systematically tuned using ink formulations and material selection strategies. A parameter to describe the crack width areal density (Φ CW ) was used to quantify the degree of discontinuity in the electrode surfaces. Open circuit voltage (OCV) transient analyses were used to benchmark and characterize the failure mechanisms in the MEAs as a function of the Φ CW . While smaller electrode-level cracks, on the order of microns, yielded a 28 % decrease in operating lifetime, larger cracks that propagated from a discontinuous, microporous layer (MPL) coating, decreased the operating lifetime by 56 %. This work emphasizes the need for material processing strategies that consider defect tolerances to limit membrane failures in PEMFCs.

08 HYDROGEN↗
DOE OSTI2023

ASME Non-metallic Component Degradation and Failure Task Group

ASME Non-metallic Component Degradation and Failure Task Group background, component failure and component functionality, the nature of graphite, damage tolerance, AGR design, damage tolerance, non-metallic component degradation and failure task group, task group progress, monitoring and examination, link between degradation processes and their impact on core components in the array of graphite components, the link between degradation processes and RIM options, and a way forward.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Asynchronous distributed-memory task-parallel algorithm for compressible flows on unstructured 3D Eulerian grids

Here, we discuss the implementation of a finite element method, used to numerically solve the Euler equations of compressible flows, using an asynchronous runtime system (RTS). The algorithm is implemented for distributed-memory machines, using stationary unstructured 3D meshes, combining data-, and task-parallelism on top of the Charm++ RTS. Charm++’s execution model is asynchronous by default, allowing arbitrary overlap of computation and communication. Task-parallelism allows scheduling parts of an algorithm independently of, or dependent on, each other. Built-in automatic load balancing enables continuous redistribution of computational load by migration of work units based on real-time CPU load measurement. The RTS also features automatic checkpointing, fault tolerance, resilience against hardware failure, and supports power-, and energy-aware computation. We demonstrate scalability up to 25 x 10 9 cells at $\mathscr{O}$10 4 compute cores and the benefits of automatic load balancing for irregular workloads. The full source code with documentation is available at https://quinoacomputing.org.

42 ENGINEERING↗
DOE OSTI2022

Characterizing the Thermal-Induced Distortion of Large-Scale Polymer Composite Printed Structures

The Big Area Additive Manufacturing (BAAM) system has been used to print large-scale parts, such as automotive structures and molds for tooling, with fiber-reinforced polymer composites. Incorporating reinforcing fibers in printed parts is commonly used to increase stiffness and strength, but it also introduces significant anisotropy in the thermomechanical performance, which can lead to distortion and warping during thermal cycling. Characterizing and understanding how a printed tool distorts is crucial to maintaining tolerances and avoiding part failure. This study uses digital image correlation (DIC) to measure the coefficient of thermal expansion (CTE) of a printed part from room temperature and to a known steady state temperature. The samples were printed with carbon fiber reinforced acrylonitrile butadiene styrene (CF-ABS). Various nozzle geometries were evaluated in this study with the intent of minimizing the thermal- induced distortion experienced by printed parts.

Corum, Tyler↗
DOE OSTI2020

CoREC: Scalable and Resilient In-memory Data Staging for In-situ Workflows

The dramatic increase in the scale of current and planned high-end HPC systems is leading new challenges, such as the growing costs of data movement and IO, and the reduced mean time between failures (MTBF) of system components. In-situ workflows, i.e., executing the entire application workflows on the HPC system, have emerged as an attractive approach to address data-related challenges by moving computations closer to the data, and staging-based frameworks have been effectively used to support in-situ workflows at scale. However, the resilience of these staging-based solutions has not been addressed, and they remain susceptible to expensive data failures. Furthermore, naive use of data resilience techniques such as n-way replication and erasure codes can impact latency and/or result in significant storage overheads. In this article, we present CoREC, a scalable and resilient in-memory data staging runtime for large-scale in-situ workflows. CoREC uses a novel hybrid approach that combines dynamic replication with erasure coding based on data access patterns. It also leverages multiple levels of replications and erasure coding to support diverse data resiliency requirements. Furthermore, the article presents optimizations for load balancing and conflict-avoiding encoding, and a low overhead, lazy data recovery scheme. We have implemented the CoREC runtime and have deployed with the DataSpaces staging service on leadership class computing machines and present an experimental evaluation in the article. Here, the experiments demonstrate that CoREC can tolerate in-memory data failures while maintaining low latency and sustaining high overall storage efficiency at large scales.

97 MATHEMATICS AND COMPUTING↗