Search NASA⌕ Search

SEARCH · Search NASA

Results for “Root cause analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Coincident learning for beam-based rf station fault identification using phase information at the SLAC linac coherent light source

Anomalies in radio-frequency (rf) stations can result in unplanned downtime and performance degradation in linear accelerators such as SLAC’s Linac Coherent Light Source (LCLS). Detecting these anomalies is challenging due to the complexity of accelerator systems, high data volume, and scarcity of labeled fault data. Prior work identified faults using beam-based detection, combining rf amplitude and beam position monitor data. Due to the simplicity of the rf amplitude data, classical methods are sufficient to identify faults, but the recall is constrained by the low-frequency and asynchronous characteristics of the data. In this work, we leverage high-frequency, time-synchronous rf phase data to enhance anomaly detection in the LCLS accelerator. Due to the complexity of phase data, classical methods fail, and we instead train deep neural networks within the Coincident Anomaly Detection (CoAD) framework. We find that applying CoAD to phase data detects nearly 3 times as many anomalies as when applied to amplitude data, while achieving broader coverage across rf stations. Furthermore, the rich structure of phase data enables us to cluster anomalies into distinct physical categories. Through the integration of auxiliary system status bits, we link clusters to specific fault signatures, providing additional granularity for uncovering the root cause of faults. We also investigate interpretability via Shapley values, confirming that the learned models focus on the most informative regions of the data and providing insight for cases where the model makes mistakes. This work demonstrates that phase-based anomaly detection for rf stations improves both diagnostic coverage and root cause analysis in accelerator systems and that deep neural networks are essential for effective analysis.

Accelerator Physics (physics.acc-ph)↗

A Machine Learning Framework to Deconstruct the Primary Drivers for Electricity Market Price Events

As the electricity grid is moving towards a 100% Renewable Energy Source Bulk Power Grid, the overall operations of the power system operations and electricity markets are changing. The electricity markets are not only dispatching resources economically but also taking into account various controllable actions like renewable curtailment, transmission congestion mitigation, and energy storage optimization to make sure the grid is operating reliably. As a result, price formations in electricity markets have become quite complex. Traditional root cause analysis and statistical approaches are rendered inapplicable to analyze and infer the main drivers behind price formation in the modern grid and markets with variable renewable energy (VRE). In this paper, we propose a machine learning analysis framework to deconstruct some primary drivers for price formation in modern electricity markets with high renewable energy and the outcomes can be utilized for various critical aspects of market design, renewable dispatch and curtailment, operations, and cyber-security applications. The framework can be applied to any ISO or market data and in this paper it is applied to open-source publicly available datasets from California Independent System Operator (CAISO) and ISO New England.

machine learning (ML), electricity markets, Renewa↗

Review—Thermal Safety Management in Li-Ion Batteries: Current Issues and Perspectives

Approaches for thermal management of lithium-ion (Li-ion) batteries do not always keep pace with advances in energy storage and power delivering capabilities. Root-cause analysis and empirical evidence indicate that thermal runaway (TR) in cells and cell-to-cell thermal propagation are due to adverse changes in physical and chemical characteristics internal to the cell. However, industry widely uses battery management systems (BMS) originally designed for aqueous-based batteries to manage Li-ion batteries. Even the "best" BMS that monitor both voltage and outside-surface temperature of each cell are not capable of preventing TR or TR propagation, because voltage and surface-mounted temperature sensors do not track fast-emerging adverse events inside a cell. Most BMS typically include a few thermistors mounted on select cells to monitor their surface temperature. Technology to track intra-cell changes that are TR precursors is becoming available. Simultaneously, the complex pathways resulting in cell-to-cell TR propagation are being successfully modelled and mapped. Innovative solutions to prevent TR and thermal propagation are being advanced. These include modern BMS for rapid monitoring the internal health of each individual cell and physical as well as chemical methods to reduce the deleterious effects of rapid cell-to-cell heat and material transport in case of TR.

25 ENERGY STORAGE↗

Thermal-Hydraulics Modeling and Simulations of Hot Pool Using the SAS-CFD Coupled Code

The main goal of this activity is to test the dynamic coupling of the SAS4A/SASSYS-1 (SAS) and CFD models, using a recently patched version of the SAS code intended to address an undocumented limitation that hindered the Versatile Test Reactor (VTR) simulation efforts in FY21. As described in previous VTR calculation reports, the undocumented limitation in SAS v5.4 does not allow the user to activate the CFD coupling option during restart calculations. Since the analysts were unaware of this limitation, prior SAS-CFD simulation results for the protected station blackout (PSBO) transient were erroneous. Root-cause analysis was performed to determine the cause of this undocumented limitation in SAS v5.4, the SAS software was updated in a new patch, and the SAS-CFD simulations were repeated with this patched software. The results of the SAS-CFD simulations documented in this report show that the software patch does address the cited issue, and that the patched software indeed supports the activation of the CFD coupling model in restart calculations. The SAS development team will determine the schedule for implementing the patch in an official software release. This report documents updated SAS-CFD simulations of the PSBO transient response in the VTR. The hot pool is modeled with the CFD code STAR-CCM+, which is coupled at the flow boundaries to the SAS model of the primary heat transport system. SAS computes the mass flow rate and temperature at each core subassembly outlet, the thermal insulation cavity bypass, and the IHX inlet windows. CFD in turn computes the absolute pressure and temperature at each of these boundaries. The SAS code will ignore the temperature data at flow boundaries where flow is directed into the hot pool, i.e., at the core subassembly outlets unless flow reversal occurs. Similarly, CFD will ignore temperature data at boundaries where the flow is directed out of the hot pool, i.e., at the IHX inlets except under flow reversal. The focus of this work is to ensure that the SAS software patch addresses the undocumented limitation described in prior VTR calculation reports, rather than the accurate assessment of thermal stratification in the VTR during protected transients. This motivates the development of a new, simplified CFD model with a coarser mesh to accelerate the testing process. The updated model, and simplifying assumptions, are documented in this report. In future work, the thermal stratification assessment should be performed in more detail. The simplified CFD model can be improved by performing grid convergence studies sensitivity studies of turbulence parameters (e.g., Prandtl number, turbulence production and dissipation parameters) on temperature distributions and thermal stratification.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Weapon Systems Risk-Assessment Tool Review

To anticipate, and potentially mitigate, future problems in aging weapon systems, four unique riskassessment techniques were analyzed, including root-cause analysis tools, six-sigma problemsolving approaches, and lean six-sigma tools. Identifying the most efficient process, or tool, is crucial for successful application to current and future weapon systems, subsystems, and components. The following processes were reviewed: Fault Tree Analysis, Failure Modes and Effects Analysis, Bow-Tie Analysis, and Hazard and Operability Study. A systematic assessment was performed to determine the most desirable method, and included investigating qualitative versus quantitative characteristics, scope, process durations, advantages, and limitations. Presented results will outline the study findings and further illustrate a capacity to identify future issues and/or concerns, and ultimately, reduce risk.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Structural Characterization of Deployed Thermoplastic and Thermoset Composite Tidal Turbine Blades

The National Renewable Energy Laboratory worked with Verdant Power to manufacture, and characterize, novel thermoplastic composite blades on their Gen5d 5 m diameter turbines at the Roosevelt Island Tidal Energy (RITE) site in the East River in N.Y. to demonstrate a low-cost manufacturing process for marine energy structures. Verdant had designed, manufactured, and deployed epoxy thermoset composite blades on three Gen5d turbines in October 2020. At a maintenance cycle in May 2021, a Gen5d turbine equipped with the NREL thermoplastic blades was deployed and retrieved in October 2021. Modal, static and fatigue structural characterization was performed on both blade types before and after the deployment. The static and modal test results showed that the thermoplastic blades were slightly stiffer than the epoxy blades both dry and after the deployment. The epoxy blades had about 8% increase in strain at the applied load after the deployment, whereas the thermoplastic blade strains were not changed significantly. Ultimately the thermoplastic blade failed during fatigue testing due to a crack which is thought to have initiated between the internal foam and the laminate at the location of the internal instrumentation. The Verdant Power Gen5d epoxy blades did not have this internal instrumentation and did not have this failure, performing adequately through the operational period. A lack of design information and fatigue data for both the thermoplastic laminates and the adhesive used means that further work is needed to fully understand his failure and the root cause analysis is ongoing. This paper provides details on the thermoplastic blade manufacturing, materials, test methodology and results.

17 WIND ENERGY↗

Investigating Anomalies in Compute Clusters: An Unsupervised Learning Approach

As compute clusters continue to grow in scale and complexity, the frequency of detected anomalies in their operation significantly increases. Timely detection of anomalous events is vital to maintain system efficiency and availability. This study presents an attentionbased graph neural network (GNN) for detecting anomalies in clusters at the compute node level and for providing detailed root cause analysis. We show the effectiveness of attention-based GNNs to accurately detect and localize anomalies on real-world datasets.

Lu, Yiyang↗

Mitigating field emission in SSR2 cryomodules for PIP-II

The SSR2 cavities for PIP-II have consistently been affected by field emission since the first cold tests with the unity coupler. A comprehensive root cause analysis was conducted to investigate the origin of this issue and to identify the fabrication, processing, and handling factors that have the greatest impact on field emission onset. New techniques were developed and effectively implemented to achieve field emission-free SSR2 cavities. In addition, effort was dedicated both to relating the radiation level measured at the test stand with the expected levels in the LINAC tunnel and to understand the evolution of field emission through the assembly steps. The challenge of overcoming field emission also led to a reassessment of design choices, enhancing our understanding of their effects on cavity performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Preparation and Qualification of Preproduction SSR2 Jacketed Cavities for PIP-II

The qualification of 325 MHz Single Spoke Resonators type 2 (SSR2) jacketed cavities to meet technical requirements represents a significant milestone in the development of the SSR2 cryomodules for the PIP-II Project at Fermilab. This poster reports the procedures and lessons learned in processing and preparing these cavities for horizontal cold testing prior to integration into a cavity string assembly, with a focus on addressing the field emission issues observed during the cold testing. A comprehensive root cause analysis identified critical fabrication, processing, and handling factors impacting field emission onset. New techniques were successfully developed and implemented to achieve field emission-free SSR2 cavities, and efforts were made to correlate radiation levels measured at the test stand with expected levels in the LINAC tunnel. Additionally, the evolution of field emission through assembly steps was thoroughly investigated, leading to a reassessment of design choices and enhancing our understanding of their effects on cavity performance.

Grassellino, L. [Fermilab]↗

Enhanced Preparation for Intelligent Cybermanufacturing Systems (EPICS)

Opportunities exist for realizing transformative advances in productivity and reductions in energy footprint through ubiquitous sensing in manufacturing environments. Enhanced Preparation for Intelligent Cybermanufacturing Systems (EPICS) is a 21-month (4 academic semesters, plus one summer) experience for graduate students that focuses on scaling the knowledge, understanding and leadership skills in the cyber manufacturing area. Masters students (8/year, 32 total) complete 2-year projects on industrially-driven project topics, rotating to internships in summer semester to work on scoping and implementation at project partners. Students complete academic training in embedded systems, process modeling, data science, and cloud-based systems design. Their projects are targeted toward sensor retrofit, process monitoring, root cause analysis, and sensor fusion.

Advanced Manufacturing↗

Bifacial Photovoltaic Module Degradation Dynamics

In a comprehensive study conducted at NREL's 75 kW bifacial single-axis-tracked field, accelerated degradation was observed in four out of five bifacial silicon photovoltaic (PV) module technologies when compared to their monofacial counterparts. Root cause analysis of accelerated bifacial degradation involved various analytical tools and techniques. This included employing RdTools to identify rates of power loss, conducting measurements on fielded and control modules using infrared imaging, electroluminescence (EL) and photoluminescence (PL), quantum efficiency (QE) analysis, IV-curves assessment, as well as utilizing handheld Raman and reflectance measurement targeted at anti-reflective coating. Most cases pointed to carrier lifetime degradation causing Voc loss and simultaneous Isc loss. In some cases, Isc further decreases likely due to optical effects from encapsulant degradation. The outcomes and methodologies employed in this investigation are documented in this publication. This study's significance is further emphasized by placing the findings within the broader context of the performance and degradation of various bifacial systems, as identified in the PV Fleets data.

bifacial↗

Facilitating Data Collection of Maintenance Events to Populate the Hydrogen Component Reliability Database (HyCReD)

The Hydrogen Component Reliability Database (HyCReD) is a collaborative project between the National Renewable Energy Laboratory, the University of Maryland, and hydrogen stakeholders to improve safety and reliability for hydrogen facilities by implementing component reliability data taxonomies that support hydrogen infrastructure failure rate analysis. The project aims to quantify failure rates of hydrogen components through high-quality data collection and analysis on root causes and maintenance needed. HyCReD provides a common database for cataloging hydrogen component failures which exists for reliability research in many other mature industries [2]. The database fills a gap for the hydrogen community by providing a scientifically rigorous approach to quantitative risk assessment (QRA), prognostic health management (PHM), and reliability-centered maintenance (RCM) analysis. High level results will be aggregated and anonymized to protect company sensitive information; detailed results will be used to help address issues of hydrogen components. These advanced analytics will support accelerated deployment of hydrogen infrastructure by enabling better: design and safety of projects (safety codes and standards development), infrastructure reliability and cost (component failure rates, maintenance protocols), and component R&D needs (robust supply chain). A key to a successful HyCReD implementation is facilitating the ease of reporting and data quality in the database that can be used for analysis. Maintenance data was a previously identified gap in initial efforts to populate and validate the database taxonomies [3]. Collection of maintenance data will be instrumental in identifying failure modes and rates, identifying incipient component failures or reduced performance, cataloging best practices for maintenance routines and methods for prognostic health management, and quantifying the risk and effect of different failure modes. Several key priorities are identified for streamlined data collection to achieve quality and detailed failure data: Applicability, Ease of Use, Accessibility, and Information Security. The HyCReD team has now begun deployment of the database to several companies and groups that have signed non-disclosure agreements to facilitate the data collection of failures in industry hydrogen refueling station infrastructure. This paper will provide an update into the process of HyCReD deployment including the development of a coding guide for facility personnel to reference and ensure data quality and consistency from one station to another as well as implementation of contextually dependent data fields of system taxonomy and formatted entries to provide ease of use. The goal is to communicate the lessons learned from the roll-out to technicians and engineers in the field, and the addition of need for high level of security to protect all stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Anomaly Detection and Identification Using a Leave-One-Variable-Out Method

At nuclear power plants (NPPs), anomaly detection and identification (i.e., determining the causes of anomalies) are important tasks for ensuring the safe and efficient operation of NPPs. These tasks are currently labor-intensive and costly, and are made more difficult by the size and complexity of NPP systems. An alternative approach to conducting these tasks is to automate them, such as via the reconstruction-based contribution method, which is a well-researched unsupervised machine learning method that uses a data-driven model of anomaly-free behavior to detect events and then identify each variable’s contributions to those events. The present effort developed a novel contribution approach that utilized a leave-one-variable-out (LOVO) model, with which each variable is predicted using all the other variables. The novelty lay in transforming this model into a reconstruction model and modifying the identification algorithm to work with the new reconstruction model. To evaluate this method in a controlled environment, a synthetic dataset based on spring-mass-damper (SMD) systems (commonly found in mechanical engineering references) was used, with known anomalies introduced into the system. The proposed method successfully detected the anomalies and afforded insights into their causes, thus enabling the appropriate identifications to be made.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Unsupervised Process Anomaly Detection and Identification Using the Leave-One-Variable-Out Approach

Automated anomaly detection and identification can signal equipment issues and pinpoint causes in large-scale industrial systems. For systems with limited failure history, unsupervised machine learning methods can be utilized as they do not require past failures. This study introduces the leave-one-variable-out (LOVO) model, which masks one variable at a time to predict the others, learning underlying process correlations. Detection performance was assessed with synthetic and experimental data, while identification performance used only synthetic data due to its ability to generate labeled anomaly types. For detection using synthetic data, the LOVO model generally outperformed comparative models; while using experimental data, the comparative methods outperformed the LOVO model. However, the comparative methods required selecting a latent size, and these conclusions pertain to using the optimal size. In practice, it would not be feasible to always select the optimal value, and incorrect selections impacted performance. In contrast, the LOVO model does not require a latent space. For identification using synthetic data, the LOVO model was slightly outperformed in interpretability and repeatability but still demonstrated impressive results. These outcomes suggest that the LOVO model is an effective model and may be more easily implemented without the challenging tuning process of selecting a latent size.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Understanding Peelle’s Pertinent Puzzle bias in generalized least squares regression through eigenspectrum analysis

Certain correlation structures in the data covariance matrix (DCM) used for generalized least squares (GLS) regression can result in biased estimates, commonly known in the field of nuclear data evaluation as Peele’s Pertinent Puzzle (PPP). This article introduces a generative, forward modeling framework within which the PPP bias is characterized through an eigenspectrum analysis of the DCM. This analysis highlights the root cause of the bias, generalizes the problem beyond the nuclear data field, and provides insight to the problem regimes where it can occur. What follows is an understanding that the bias can show up for any experimental neutron time-of-flight data for which systematic uncertainties have been quantified. Lastly, a discussion of the adaptation of cross validation approaches that require pre-whitening to incorporate the known ‘fix’ to the PPP bias in the GLS estimator.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Study of the Heater-Coil Electrical Insulation for the HL-LHC Low Beta Quadrupoles

In the framework of the HL-LHC project, the present LHC low-β superconducting quadrupoles will be substituted with higher performance Nb 3 Sn magnets (MQXF) with 11.4 T coil peak field. MQXF coils are impregnated with epoxy resin to reduce risk of stress concentration on the brittle conductor. The magnet quench protection is provided by CLIQ and quench heaters to ensure a redundant system. Quench heaters are impregnated with the coils in order to have suitable thermal contact with them, and to prevent the hot spot temperature from exceeding 350K during normal operation in case of a quench. Quench heaters are insulated from the coil by S-2 Glass and polyimide. Here, the test of the first MQXF prototype (4 m long) MQXFAP1 was stopped by a coil-to-ground short circuit triggered by a heater-to-coil short. This issue triggered a root analysis of the causes of this short. Here we prove that the use of a non-conforming cloth in coil impregnation, further weakened by non-conforming high voltage test, has triggered the shorts. Moreover, we present an analysis of the heater-to-coil insulation strength, showing the role of blistering phenomena and how they are triggered by a combination of magnet powering and heater firing.

43 PARTICLE ACCELERATORS↗

Ground observations of a space laser for the assessment of its in-orbit performance

The wind mission Aeolus of the European Space Agency was a groundbreaking achievement for Earth observation. Between 2018 and 2023, the space-borne lidar instrument ALADIN onboard the Aeolus satellite measured atmospheric wind profiles with global coverage, which contributed to improving the accuracy of numerical weather prediction. The precision of the wind observations, however, declined over the course of the mission due to a progressive loss of the atmospheric backscatter signal. The analysis of the root cause was supported by the Pierre Auger Observatory in Argentina whose fluorescence detector registered the ultraviolet laser pulses emitted from the instrument in space, thereby offering an estimation of the laser energy at the exit of the instrument for several days in 2019, 2020, and 2021. The reconstruction of the laser beam not only allowed for an independent assessment of the Aeolus performance, but also helped to improve the accuracy in the determination of the laser beam’s ground track on single pulse level. The results presented in this paper set a precedent for the monitoring of space lasers by ground-based telescopes and open new possibilities for the calibration of cosmic-ray observatories.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Rapid Characterization and Statistical Analysis of High-Volume Field-Harvested Photovoltaic Connectors

Photovoltaic (PV) installations heavily depend on connectors for efficient module and string interconnections without requiring skilled labor. Yet this seemingly innocuous component of PV systems is a leading cause of module failures, multiple high-profile fires, and lawsuits in the PV industry. This work aims to answer critical questions regarding why connectors fail and the contributing factors to their failure. The study involves collecting and analyzing more than 17,000 field-harvested connectors from various solar installations across the United States. The vast dataset, which includes connector metadata, visual inspections, and resistance measurements, provides unprecedented insight into the state of health of PV connectors across the US, including the geographic locations, connector types, and installation practices most prone to failures. The work presented here describes a novel rapid characterization method for processing large numbers of connectors and is supported by parallel forensic analysis to discern the root causes of failures as well as a levelized cost of lifetime model to determine the economic ramifications of connector failure. Ultimately, the findings may inform PV developers about the best practices to extend connector longevity and lead to more resilient and reliable PV systems.

connectors↗