SEARCH · Search NASA
Results for “operating experience data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Operating Experience Data Analysis for Digital Instrumentation and Control System Reliability and Risk Assessment in Nuclear Power Plants
The implementation of advanced digital instrumentation and control (DI&C) systems in U.S. nuclear power plants (NPPs) can bring significant advancements in reliability, monitoring, and control capabilities. However, these systems also introduce new challenges, particularly in assessing risks such as common-cause failures (CCFs) and establishing robust reliability estimates for DI&C components. Addressing these challenges is critical for ensuring the safe and efficient operation of NPPs. Recently, Idaho National Laboratory was tasked by the U.S. Nuclear Regulatory Commission (NRC) to conduct a DI&C reliability study using operating experience data from the nuclear industry. The two operating experience data sources for the study are the Institute of Nuclear Power Operations’ Industry Reporting and Information System (IRIS) and the NRC’s Licensee Event Report database which is hosted at Idaho National Laboratory at https://lersearch.inl.gov/LERSearchCriteria.aspx. This report provides a comprehensive examination of DI&C systems, including their architecture, operational advantages, and associated challenges. It reviews existing industry DI&C studies and failure mode taxonomies, along with reliability data from various industries. Through a detailed analysis of these databases, the study provides insights into DI&C system performance. Considerations should be given to incorporate DI&C failure data into the NRC's Integrated Data Collection and Coding System and updating the Reliability and Availability Data System to support ongoing DI&C reliability studies. Recommendations are also provided for modeling DI&C reliability and CCF in probabilistic risk assessment, thereby supporting risk-informed decision-making and enhancing the reliability and safety of NPPs.
Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis to Support Risk Model Parameter Estimations
This set of slides has been prepared for a talk at the INL AI/ML Symposium held on September 8, 2022. Presentation outline: Background - Nuclear power plant operating experience data sources • Research focus and motivation - Analyzing free-text operating experience data: present and future • Research method - Input - Methodological steps - Output • Conclusions and next steps
Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis: Aggregation and Interpretation of Multi-Report Analysis Results
Industry-wide operating experience is a critical source of raw data for reliability and risk model parameter estimations for nuclear power plants. A large portion of operating experience data are failure events stored as reports that contain unstructured data, such as narratives. In current practice, a failure report is usually reviewed and manually coded by analysts. The coding is based on extracting several event characteristics such as system name, component type, sub-part type, failure mode, and failure cause. Event narratives are mostly used to help understand events and extract their characteristics. In this line of research, we aim to maximize the usage of event narratives by leveraging natural language processing (NLP) methods to automatically convert an event narrative to a causal graph. This research has promise to improve physical understanding of failure initiation and propagation and to facilitate use of non-failure data (e.g., near-misses and degradations) to complement the limited data pool of failures. In our previous work, we developed an NLP tool and applied it to analyze a number of licensee event reports submitted by U.S. nuclear power plants to the Nuclear Regulatory Commission. In this paper, we will report our recent research progress in aggregating the results of multiple reports, developing network model(s), and drawing statistical insights.
Digital Instrumentation & Controls Study with Operating Experience Data
The slides present the plan and working progress on the digital instrumentation and control (DI&C) study with nuclear industry operating experience data. They were originally prepared as a working document and presented to the NRC, but then was asked by the NRC to present to an EPRI/NRC meeting on DI&C. The slides will also be distributed to the meeting participants.
Estimation of pipe failure frequencies in the absence of operational experience data: A pilot study
Probabilistic failure metrics such as leak frequency and rupture frequency are commonly used to characterize piping reliability. The methodologies for calculating the failure metrics rely on a complex set of input parameters. Operating experience data and experimental data play an important role in informing the different input parameters. The paper describes results and conclusions of a coordinated research project to benchmark three different reliability models using a four-step procedure: reference case definition of relevance to advanced reactor designs, input parameter calibration, validation of results, and application of different methodologies upon completion of the calibration and validation steps. The reference case is a weld consisting of nickel-base alloy 152/52 and located within a primary pressure boundary of an advanced reactor. This alloy is a class of structural materials known to be highly resistant to stress corrosion cracking. Synergies between the different methods are noted and the importance of a multi-disciplinary approach to input parameter development is underscored. A key conclusion is that the three methods are equally suitable for estimating failure frequencies. In any specific application, a selection of the most practical or effective computational tool can be considered. The comparison of alternative models confirms and helps to gain confidence in the computed failure frequency estimates. The study was part of a coordinated research project organized by the International Atomic Energy Agency.
Advanced Reactor Operating Experience Data Analysis to Support Risk Estimation: Challenges, Current Practice, and Needs
Presentation slides for Nuclear Regulatory Commission Public Meeting on July 18th about advanced nuclear reactor risk metrics and data needs to support risk estimation.
Natural Language Processing-Enhanced Nuclear Industry Operating Experience Data Analysis: Causal Learning and Inference
Slides presented at the National Aeronautics and Space Administration/Nuclear Regulatory Commission Joint Seminar on May 2, 2023.
Exploring Advanced Computational Tools and Techniques with Artificial Intelligence and Machine Learning in Operating Nuclear Plants
This report presents the project Idaho National Laboratory conducted for Nuclear Regulatory Commission to explore the advanced computational tools and techniques, such as artificial intelligence (AI) and machine learning (ML), for operating nuclear plants. The report reviews the nuclear data sources, with the focus on the operating experience data, that could be applied by advanced computational tools and techniques. Plant-specific and generic (national and international) data from different sources are described. The report describes the relationships between statistics and AI/ML and then introduces the most widely used AI/ML algorithms in both supervised and unsupervised learning. The report reviews the recent applications of advanced computational tools and techniques in various fields of nuclear industry, such as reactor system design and analysis, plant operation and maintenance, and nuclear safety and risk analysis. Finally, the report presents the insights from the project on the potential applicability of AI/ML techniques in improving advanced computational capabilities, how the advanced tools and techniques could contribute to the understanding of safety and risk, and what information would be needed to provide meaningful insights to decision makers. The report also documents an NRC survey on the current state of commercial nuclear power operations relative to the use of AI and ML tools as well as the role of AI/ML tools in nuclear power operations was published by the NRC as in FRN NRC-2021-0048 in April 2021. A summary of the survey including the survey questions, survey participants, survey responses, and the conclusions and insights derived from the survey is provided in the report. Finally, the report investigates potential applications of using AI/ML in operating NPPs and advanced reactors (both advanced LWRs and advanced NLWRs) to improve nuclear plant safety and efficiency. Three main application fields are defined and discussed: (1) plant safety and security assessments; (2) plant degradation modeling, fault and accident diagnosis and prognosis; and (3) plant operation and maintenance efficiency improvement.
Recent technology products from Space Human Factors research
The goals of the NASA Space Human Factors program and the research carried out concerning human factors are discussed with emphasis given to the development of human performance models, data, and tools. The major products from this program are described, which include the Laser Anthropometric Mapping System; a model of the human body for evaluating the kinematics and dynamics of human motion and strength in microgravity environment; an operational experience data base for verifying and validating the data repository of manned space flights; the Operational Experience Database Taxonomy; and a human-computer interaction laboratory whose products are the display softaware and requirements and the guideline documents and standards for applications on human-computer interaction. Special attention is given to the 'Convoltron', a prototype version of a signal processor for synthesizing the head-related transfer functions.
Operating Experiences from Existing Fusion Facilities in View of ITER Safety and Reliability
The objective of this ongoing activity is to develop a fusion specific component failure rate database useful to quantify probabilistic safety assessment, support traditional safety analysis, quantify reliability, availability, maintainability, and inspectability (RAMI) analyses, and support any other uses where field experience can provide feedback to fusion facility design and operation. The activity supported by European, American, and Japanese programs is established in the context of the International Energy Agency Agreement on the Environmental, Safety and Economic Aspects of Fusion Power (IEA ESE). The data collection began in 1989. At first, it was to "harvest" already-published data from high-technology industries that can be readily applied to fusion components. Several years later, attention was also directed to collecting and analyzing operating experience data from existing tokamaks and other fusion experiments. For some fusion facilities, the investigations on causes and effects of failures of components and systems have also interested worker exposures and radiological releases induced by maintenance activities on failed components.
A database containing operational experience in spaceflight
A relational data base, called the Operational Experience Data Base, was constructed to electronically store and organize human-factors information from the Skylab and Space Shuttle missions. The taxonomy used to organize this data base builds on the one used for the Skylab human-machine experiments. This information can be used by NASA engineers and operations personnel to remedy design problems, or expand on design successes. Work to improve and expand the data base is underway.
Quantitative Comparison of Proprietary and Open-Source Georeferencing Tools for Use with Astronaut Photography
The Crew Earth Observations (CEO) Facility within the Earth Science and Remote Sensing Unit at NASA’s Johnson Space Center supports the acquisition, analysis, and curation of astronaut photography of Earth’s surface and atmosphere. Astronauts on the International Space Station (ISS) respond to requests from CEO to acquire imagery of scientific and education targets, to include high profile targets in response to activations from the International Charter for Space & Major Disasters (also known as the International Disaster Charter, or IDC) and NASA’s Disasters Program. CEO facilitates the acquisition of astronaut photography in response to IDC events and delivers georeferenced data products to the United States Geological Survey (USGS) for distribution to the disaster community. Using GeoRef, an internal web-based tool developed in collaboration with NASA’s Ames Research Center, CEO generates data packages of georeferenced imagery, uncertainty images for assessing control and tie point accuracy, and metadata documenting raw and processed data. Operational experience with the Georef software identified vulnerabilities to internal code and server errors that can significantly increase time of data production. As such, CEO developed a backup procedure in case the GeoRef software experiences front-end or back-end errors. A system using OSGEO’s open-source QGIS software combined with a semi-automated pipeline using the object-oriented Python language and the Geospatial Abstract Library for generating metadata is quantitatively compared to GeoRef’s data package for quality and productivity. Root Mean Square Error (RMSE) provides a standard measurement of data quality as it relates to ground error. Assessing RMSE measurements generated from georeferenced astronaut photographs acquired with different obliquity and focal length offers a comprehensive accuracy assessment of the software’s transformation algorithms. This assessment will indicate the software's ability to produce data products with the least ground-error or highest data quality regarding ground accuracy. In addition, a comparison of the software’s efficiency in generating a data package that includes georeferenced images, metadata, and uncertainty images for measuring tie/ground point error was performed. Initial results, based on the comparison of three nadir-facing astronaut photographs acquired with a 95mm focal length, reveal the QGIS-based system's average RMSE is 2.36 (pixels) suggesting its georectification system produces data products that meet and perhaps improve upon Georef solution's average RMSE of 32.99 (pixels). However, the QGIS system was unable to reproduce two unique Georef data products, uncertainty images for measuring tie and control point errors and a translated unwrapped image. In addition, the Georef software is designed to accept handheld camera pose information from a hardware component (Geosens) scheduled for deployment on the ISS in late 2018; this information is intended to provide increased accuracy and auto-registration capability for astronaut photographs. Future work is expected to determine the QGIS-based georectification system’s potential as an open-source alternative (and operational backup) to Georef for georeferencing the full range of resolutions and viewing angles unique to handheld digital camera imagery in support of ISS disaster response activities.
Radiation Protection Instrument Reliability and Maintainability Data
This report is a collection of reliability and maintenance data on several types of radiation protection instrumentation. Some radiation detectors are used for personnel safety; others are used for environmental stewardship. Six types of instruments are addressed in this report. These are: continuous air monitors, tritium room air monitors, facility vent stack monitors, tritium bubbler monitors, tritium in effluent water monitors, and general purpose radiation survey meters. Literature searches, operating experience data, and occurrence reports were used to identify failure modes and to estimate quantitative failure rates for several general types of radiation protection instruments. Likewise, data on instrument repair has been found when possible and used to estimate the mean time to repair. These data can be useful for facility safety assessment, personnel safety assessment, environment assessment, and for equipment and labor planning purposes.
Lunar Orbiter 4. Extended-mission spacecraft operations and subsystem performance
Design, mission, flight operations, experiment data, and subsystem performances for Lunar Orbiter 4 extended mission
A unique high intensity solar simulation system
This simulator is unique in that it is capable of producing intensities up to 16.0 solar constants (25 solar constants without spectral filters) and closely simulates the solar spectrum over a 12 inch diameter area. The simulator is described and the capabilities, calibration, operational experiences, data collection, and safety considerations associated with this simulator are discussed.
Improving the Estimates of International Space Station (ISS) Induced K-Factor Failure Rates for On-Orbit Replacement Unit (ORU) Supportability Analyses
This is a case study on revised estimates of induced failure for International Space Station (ISS) on-orbit replacement units (ORUs). We devise a heuristic to leverage operational experience data by aggregating ORU, associated function (vehicle sub -system), and vehicle effective' k-factors using actual failure experience. With this input, we determine a significant failure threshold and minimize the difference between the actual and predicted failure rates. We conclude with a discussion on both qualitative and quantitative improvements the heuristic methods and potential benefits to ISS supportability engineering analysis.
An Investigation of Digital Instrumentation and Control System Failure Modes
A study sponsored by the Nuclear Regulatory Commission study was conducted to investigate digital instrumentation and control (DI&C) systems and module-level failure modes using a number of databases both in the nuclear and non-nuclear industries. The objectives of the study were to obtain relevant operational experience data to identify generic DI&C system failure modes and failure mechanisms, and to obtain generic insights, with the intent of using results to establish a unified framework for categorizing failure modes and mechanisms. Of the seven databases studied, the Equipment Performance Information Exchange database was found to contain the most useful data relevant to the study. Even so, the general lack of quality relative to the objectives of the study did not allow the development of a unified framework for failure modes and mechanisms of nuclear I&C systems. However, an attempt was made to characterize all the failure modes observed (i.e., without regard to the type of I&C equipment under consideration) into common categories. It was found that all the failure modes identified could be characterized as (a) detectable/preventable before failures, (b) age-related failures, (c) random failures, (d) random/sudden failures, or (e) intermittent failures. The percentage of failure modes characterized as (a) was significant, implying that a significant reduction in system failures could be achieved through improved online monitoring, exhaustive testing prior to installation, adequate configuration control or verification and validation, etc.