SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Mathematically, reliability is the probability of success. First, we will present the calculus needed to comprehend basic probability theory. Second, we will introduce The Reliability Function and its basic properties. Last, we will demonstrate The Reliability Function in a notional fatigue life example.
A reliable nondestructive evaluation (NDE) technique provides minimum 90% probability of detection(POD) with 95% confidence for detection of cracklike flaws of a qualified size. In this case, the flaws are on backside of material. Eddy current array (ECA) probe or a single sensor eddy current probe in c-scanning mode is used for the flaw detection. Here, two geometries are considered for the test specimens. The two geometries are, a flat plate, and tube or pipe. The probe is assumed to be on outer diameter (OD)surface and the flaw is assumed to be at the inner diameter (ID) surface for tube inspection. The flaw and probe are on opposite side of wall thickness for inspection of plate material. The application may be used for acreage inspection or just for inspection of butt weld and heat affected zone (HAZ) in a tube, cylinder, or plate. The proposed approach is based on developing an instrument standardization or calibration procedure. Decision threshold of inspection procedure is determined using empirical qualification and noise data. The work explores essential parameters that are required to meet certain conditions to ensure reliable flaw detection. Physics-based simulation of eddy current array flaw detection is used to understand effect of essential parameters on signal response (amplitude and phase),and therefore flaw detectability. Simulation data is used to justify choice of calibration reference standard requirements and the qualification approach. An ECA technique qualification model is provided. The paper gives brief description of tasks to be completed for qualifying ECA technique for reliable detection of cracklike flaws.
Deterministic damage tolerance guidelines for highly reusable and efficiently designed launch systems can be challenging to meet and result in overly conservative assessments for tightly controlled manufacturing processes. Deterministic approaches may be unconservative when the structure is workmanship sensitive and there is a wide spread in fracture properties. Reliability-based damage tolerance assessments targeting a component reliability over the service life commensurate to mission risk posture is a promising alternative. Low production rates, short fleets, and lack of standards or guidance has slowed down widespread adoption of this method. Guidance for the robust application of reliability-based damage tolerance for space systems are proposed. These guidelines cover the treatment of uncertainty in damage tolerance analysis, the collection of data to develop probabilistic distributions, uncertainty propagation methods, and types of hardware.
The electrical interconnection and isolation design aspects within an inverter must also provide high thermal performance and thermomechanical reliability. In collaboration with ORNL, DuPont, and Indiana Integrated Circuits (IIC), NREL is evaluating new packaging materials and manufacturing techniques for wide-bandgap-based traction inverters. Thermal modeling and experimental evaluation revealed that an organic direct-bond-copper (ODBC) substrate has similar thermal resistance to traditional ceramic substrates. High-temperature thermal cycling has shown the ODBC substrates to have greater reliability than ceramic substrates which is a significant finding in the quest for low-cost, power-dense, high-temperature power electronics. IIC's direct chip-to-chip topside electrical connection will be attached to ODBC substrates and reliability evaluation for both technologies will be performed at NREL in Q4.
This paper is concerned with solving the phase identification problem in a real-world smart grid project; where there is only a few smart meters available on each of the five power distribution feeders in the test site in Riverside, CA. The main idea is to develop and use two reliability criteria that can identify the most reliable components in a broken-down phase identification analysis; thereby significantly improving the accuracy of phase identification. The proposed method consists of three steps. The results from field implementation reveal the accuracy and consistency of the proposed method in practice, in correctly and reliability identifying the phase connectivity.
Pitch bearings, main bearings, and gearboxes in conventional wind turbine drivetrains often do not meet their 20-year minimum specified lifetime, resulting in turbine downtime as well as expensive, time-consuming repairs or replacements. The dominant failure modes of the drivetrain components and the conditions that lead to their failure are not fully accounted for during product design or routinely modeled for life management. Drivetrain reliability improvements and O&M cost reductions remain top priorities for both land-based and offshore wind turbines, especially as wind turbines continue to be deployed in increasingly remote and offshore locations, continue to increase in size, and are becoming expected to be in service beyond their original design life, all of which correspond to an increase in the impact of any reliability issues on O&M costs. This presentation summarizes the most recent activities by NREL and ANL on drivetrain reliability.
A review of the work done on the hydrogen Component Reliability R&D project in the last year. The National Renewable Energy Laboratory's (NREL) Hydrogen Safety Research and Development (HSR&D) program in collaboration with the University of Maryland's Systems Risk and Reliability Analysis Laboratory (SyRRA) are working to improve reliability and reduce risk in hydrogen systems through the use of use quantitative data on component leaks and failures, together with Prognosis and Health Management (PHM), and Quantitative Risk Assessment (QRA).
NREL's Solar and Storage Techno-Economic Analysis (TEA) team reviews live polling results from the Photovoltaic Reliability Workshop (PVRW) related to module technology trends believed to have the greatest reliability impacts. Then, the team reviews the publicly available tools and inputs necessary for evaluating reliability tradeoffs between initial module and system costs, degradation profiles, and levelized cost of energy (LCOE). These tools include the online Detailed Cost Analysis Models (DCAM) and the DuraMAT LCOE calculator.
As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.
In recent years, the field of data-driven neural network-based machine learning (ML) algorithms has grown significantly and spurred research in its applicability to instrumentation and control systems. While they are promising in operational contexts, the trustworthiness of such algorithms is not adequately assessed. Failures of ML-integrated systems are poorly understood; the lack of comprehensive risk modeling can degrade the trustworthiness of these systems. In recent reports by the National Institute for Standards and Technology, trustworthiness in ML is a critical barrier to adoption and will play a vital role in intelligent systems' safe and accountable operation. Thus, in this work, we demonstrate a real-time model-agnostic method to evaluate the relative reliability of ML predictions by incorporating out-of-distribution detection on the training dataset. It is well documented that ML algorithms excel at interpolation (or near-interpolation) tasks but significantly degrade at extrapolation. This occurs when new samples are "far" from training samples. The method, referred to as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets, which is used to calculate a prediction's relative reliability. LADDR is demonstrated on a feedforward neural network-based model used to predict safety significant factors during different loss-of-flow transients. LADDR is intended as a "data supervisor" and determines the appropriateness of well-trained ML models in the context of operational conditions. Ultimately, LADDR illustrates how training data can be used as evidence to support the trustworthiness of ML predictions when utilized for conventional interpolation tasks.
To assess the reliability of critical technologies like nuclear plants and infrastructure systems and improve the robustness of design, engineers have to quantify the uncertainties surrounding the system behavior accurately. However, the complexity of the problem can make standard reliability analysis algorithms prohibitively expensive, primarily due to the high computational cost of estimating the system response at each iteration. This cost can be greatly reduced by using multi-fidelity modeling and machine learning to build a surrogate model to replace the expensive response function. We propose a general and robust method for building surrogates from multiple Low Fidelity (LF) models coupled with machine learning to retain accuracy. Our framework first constructs “Corrected Low Fidelity models” (CLFs) by coupling a High Fidelity (HF) model inferred Gaussian Process correction term with each of the LF models. It then uses the correction terms to assign model probabilities to each of these CLFs in an explainable way before using them to assemble the final surrogate. No assumptions are made about the type of the LF models or their correlation with the HF model. The proposed surrogate modeling framework is used within the subset simulation algorithm (a variance-reduced MCMC-based reliability analysis algorithm) for enhanced efficiency. Additionally, an active learning step is added to the algorithm to adaptively decide when the surrogate is not sufficiently accurate, at which point the HF model is called and used to refine the surrogate. Through a frame buckling example, our method is shown to be highly efficient at reducing the expensive HF model calls while accurately estimating the failure probability.
The Hydrogen Component Reliability Database (HyCReD) is a collaborative project between the National Renewable Energy Laboratory, the University of Maryland, and hydrogen stakeholders to improve safety reliability for hydrogen facilities by integrating risk reduction methodologies and component reliability data taxonomies that support hydrogen infrastructure failure rate analysis.
In its classical definition, risk is defined by three elements: what can go wrong, what are its consequences and how likely is it to occur. While this definition makes sense in a regulatory based framework to estimate risk associated to power plants (in terms of core damage frequency and large early release frequency), this approach does not provide a useful snapshot of the health of the plant. A possible alternate path can start by redefining the word “risk” to a broader meaning that better reflects the needs of a system health and asset management decision making process. Rather than asking how likely an event can occur (in probabilistic terms), we can ask how far this event is from occurring. We will show how, given the data available from plant equipment reliability and monitoring/diagnostic/prognostic centers, a margin can be described and determined for all type of maintenance approaches (e.g., corrective or predictive maintenance). We will show how to link SSC margin-based reliability models to system reliability models (i.e., fault trees) in order to assess system/plant health and how to perform margin-based system calculations. These calculations are not solved using classical probabilistic calculations applied to sets (as performed by any PRA code) but, instead, through metric spaces operations (i.e., distance/margin based approach).
Nuclear energy is the most reliable and environmentally sustainable energy source available today. In the United States, nuclear-generated power accounts for approximately 20% of total electricity and over 55% of clean energy. New advanced reactors have enormous potential to help further decarbonize the energy market, enhance grid resiliency, create new jobs, and build a stronger economy. More than 50 new reactors are being developed in the United States, and the federal government realizes an urgent need to deploy nuclear technologies to meet the country’s energy, environmental, and national security goals. As such, the U.S. Department of Energy launched multiple programs to support advanced reactor deployment. The research described in this paper explores implementation strategies for the Reliability and Integrity Management Program that directly supports the U.S. Department of Energy goal to enable the near-term deployment of the advanced reactor technologies. The project is conducted under the Regulatory Development Program for advanced reactors sponsored by the U.S. Department of Energy.
Increasing cybercrime rates means identifying potential victims is critically important. Social discounting tasks show that individuals share less personally identifying information as social distance increases. However, the test–retest reliability and uniqueness of this measure is unclear. The current study assessed social discounting for personally identifying information (SDPII), delay discounting, risk taking, and personality at two measurement waves 30 days apart for 64 undergraduate students. Test–retest reliability was statistically significant for the SDPII and all other measures, replicating previous studies. SDPII rates were not significantly correlated with other measures during both measurement waves, showing discriminant validity. SDPII rates were lower than those reported in a previous study but were still well described by a hyperbolic discounting function, suggesting replicability across studies. Furthermore, the high test–retest reliability, uniqueness, and replicability of the SDPII suggests that it may quantitatively identify cybercrime victimization. Future research should test which measure or combination of measures can accurately predict scam and cybercrime victimization to inform data-based interventions.
The opposing requirements for the performance and reliability of a thermoelectric generator (TEG) are investigated with numerical finite element analysis simulations. The parameters that significantly influence the operational performance and structural reliability of a TEG are considered for simultaneous optimization. The design of experiments (DOE) based response surface optimization methodology in conjunction with results from finite element analysis was employed to identify optimal parameters from the structural reliability and performance (power output and efficiency) perspectives. A high temperature bismuth telluride based TEG couple was used in the studies to demonstrate the general applicability of the methodology. The response surface methodology is found to be a robust technique that can expedite the process of geometry optimization of a TE device during the research and development phase of TEG devices fabricated from new thermoelectric materials.
Assigning capacity value to renewable energy sources (RES) is a challenge faced in planning their integration with the grid. The difficulties stem from the natural characteristics of variability and intermittency of wind and solar sources. The capacity credit (CC) analysis evaluates the system’s actual power output compared with a constant capacity generator, i.e., conventional generator and determines an effective capacity to use for planning and operation. Herein this paper presents different factors that could affect the CC of a system. Two methods are proposed to determine the CC, namely equivalent firm capacity (EFC) and effective load carrying capability (ELCC). Since these methods are based on satisfying reliability criteria, daily loss of load expectation (LOLE), hourly loss of load (LOLH), and expected energy not served (EENS) have been employed as indices. To obtain the CC value, both methods apply two techniques: traditional and optimization. Genetic algorithm (GA) is the optimization approach used in this paper. Then, this work compares the two techniques and shows the superior performance of the optimization approach. Two hybrid systems, stand-alone (SA) and grid-connected (GC) modes, are proposed and used as case studies. The hybrid systems consist of photovoltaic (PV), wind turbine (WT), and battery energy storage system (BESS). In this work, three different scenarios are used to compare capacity credit: system as a whole, only wind, and no batteries. Finally, sensitivity analysis is carried out to examine the impact of varying the wind speed, solar irradiation, and load. It is demonstrated that the choice of reliability index plays an important role in determining the capacity credit and it is shown that EENS is a more comprehensive and consistent index of reliability.
Abstract Despite ML’s impressive performance in commercial applications, several unique challenges exist when applying ML in materials science applications. In such a context, the contributions of this work are twofold. First, we identify common pitfalls of existing ML techniques when learning from underrepresented/imbalanced material data. Specifically, we show that with imbalanced data, standard methods for assessing quality of ML models break down and lead to misleading conclusions. Furthermore, we find that the model’s own confidence score cannot be trusted and model introspection methods (using simpler models) do not help as they result in loss of predictive performance (reliability-explainability trade-off). Second, to overcome these challenges, we propose a general-purpose explainable and reliable machine-learning framework. Specifically, we propose a generic pipeline that employs an ensemble of simpler models to reliably predict material properties. We also propose a transfer learning technique and show that the performance loss due to models’ simplicity can be overcome by exploiting correlations among different material properties. A new evaluation metric and a trust score to better quantify the confidence in the predictions are also proposed. To improve the interpretability, we add a rationale generator component to our framework which provides both model-level and decision-level explanations. Finally, we demonstrate the versatility of our technique on two applications: (1) predicting properties of crystalline compounds and (2) identifying potentially stable solar cell materials. We also point to some outstanding issues yet to be resolved for a successful application of ML in material science.