Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reliability Prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Hydrogen Component Leak Rate Quantification for System Risk and Reliability Assessment through QRA and PHM Frameworks: Preprint

The National Renewable Energy Laboratory's (NREL) Hydrogen Safety Research and Development (HSR&D) program in collaboration with the University of Maryland's Systems Risk and Reliability Analysis Laboratory (SyRRA) are working to improve reliability and reduce risk in hydrogen systems. This approach strives to use quantitative data on component leaks and failures, together with Prognosis and Health Management (PHM), and Quantitative Risk Assessment (QRA) to identify at-risk components, reduce component failures and downtime, and predict when components require maintenance. Hydrogen component failures increase facility maintenance cost, facility downtime, and reduce public acceptance of hydrogen technologies, ultimately increasing facility size and cost because of potentially overly conservative requirements. Leaks are a predominant failure mode for hydrogen components. However, uncertainties in the amount of hydrogen emitted from leaking components and the frequency of those failure events limit the understanding of the risks that they present under real-world operational conditions. NREL has deployed a test fixture, the Leak Rate Quantification Apparatus (LRQA), to quantify the mass flow rate of leaking gases from medium and high-pressure components that have failed while in service. Quantitative hydrogen leak rate data from this system could ultimately be used to better inform risk assessment and Regulation Codes and Standards (RCS). Parallel activity explores the use of PHM and QRA techniques to assess and reduce risk, thereby improving safety and reliability of hydrogen systems. The results of QRAs could further provide a systematic and science-based foundation for the design and implementation of RCS, as in the latest versions of the NFPA 2 code for gaseous hydrogen stations. Alternatively, data-driven techniques of PHM could provide new damage diagnosis and health-state prognosis tools. This research will help end users, station owners and operators, and regulatory bodies move towards risk-informed preventative maintenance versus emergency corrective maintenance, reducing cost and improving reliability. Predictive modelling of failures could improve safety and affect RCS requirements such as setback distances at liquid refuelling sites. The combination of leak rate quantification research, PHM, and QRA can lead to better informed models enabling data-based decision to be made for hydrogen system safety improvements.

codes and standards↗

Mechanistic Fission Gas Release Uncertainty Induced by Microstructure Data

Fission Gas Release (FGR) is an important engineering safety parameter for nuclear fuel. While fuel performance modeling with BISON currently relies on mechanistic models to predict it, comparison with experimental data shows both under or over prediction depending on operation mode (steady or transient).Predicting microstructure data is essential to accurately predicts the engineering scale parameters. An important source of uncertainty in mechanistic models arises from the missing captured physics. Continuous validation and refinement of these models against experimental data are also necessary to ensure their reliability and accuracy in predicting engineering parameters.

36 - MATERIALS SCIENCE↗

Probabilistic Forecast of All-Sky Solar Radiation Using Enhanced WRF-Solar: Preprint

This study presents enhancements of the Weather Research and Forecasting model with solar extensions (WRF-Solar) to provide probabilistic forecasts of solar radiation. Our approach builds ensemble WRF-Solar runs by introducing stochastic perturbations of variables that produce the largest uncertainties in predicting surface irradiance and clouds. The key variables are identified using tangent linear sensitivity analysis of six physics packages responsible for all-sky irradiance variability. An optimal strategy to stochastically perturb the selected variables is developed and applied to WRF-Solar to generate ensemble members for day-ahead solar prediction. The National Solar Radiation Database (NSRDB) is used to validate the ensemble forecast at arbitrary locations on the model grid. Preliminary results indicate that the proposed technique can potentially produce WRF-Solar ensembles providing reliable information of solar prediction uncertainty. This study describes the implemented methodology and initial results as well as future research to improve ensemble-based probabilistic forecasts with WRF-Solar.

all-sky↗

Repurposing Fossil-Fueled Assets For Energy Storage

The annual retirement of U.S. coal-fired electricity generation units (CF-EGU) is at an all-time high and is expected to continue. This loss of reliable baseload generation, combined with predicted growth of variable renewable energy (VRE) generation, is expected to stress grid reliability as the number of load-following resources drops below the experienced load variability. Many regions are already experiencing challenges, and fossil retirement-related warnings by the North American Electric Reliability Corp. are becoming more dire. All CF-EGU retirements pose significant challenges to asset owners, local workforces, and their communities. Repurposing a retiring CF-EGU as a long-duration energy storage plant can address these challenges and offer a suite of additional benefits to asset owners, the grid, and society. This project performed a techno-economic evaluation and assessment of repurposing a Duke Energy fossil-fueled asset (in particular, a coal plant) into an energy storage system by integrating the retiring asset with a Malta long duration Pumped Heat Energy Storage (PHES) system. The project validated the technoeconomic benefits of repurposing retiring coal plants into long-duration energy storage using Malta’s PHES. Key findings for this project are summarized below: (1) Technical: (a) Retiring coal plants (and other steam turbine fossil generation) can be repurposed to enable the clean energy transition using Malta’s technology. (b) For older retiring coal plants, repurposing the site and electrical interconnection for a standalone PHES plant is the most economically favorable option. (c) For newer coal plants where there is also a local peaking capacity need, repowering the steam cycle into a hybrid integration with PHES is attractive. (d) A process was developed to assist fossil generation owners in choosing the best path for each plant’s circumstances. (2) Economic (a) Communities facing economic challenges caused by the retirement of fossil generation would benefit from repurposing the plant as long-duration energy storage using Malta’s PHES. (b) On a $/MW basis, repowering retiring coal units into Malta PHES plants can maintain the same number and types of jobs and economic activity. (c) For a 70% carbon reduction scenario, a 10-hour Malta PHES plant is more economic for the asset owner than similar-power 4-hour batteries. This project showed that repurposing a retiring coal unit into thermal energy storage, by integrating it with a Malta PHES system, makes techno-economic sense. At least two integration options are available, with the optimal solution depending on the coal plant and its location. Repurposing retiring coal plant into energy storage results in economic benefits for the plant owner and local communities.

20 FOSSIL-FUELED POWER PLANTS↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Explanation and prediction of observables using continuum strong QCD

The last five years have brought considerable progress in the study of the bound-state problem in continuum quantum field theory. We highlight a subset of that progress; viz., that made within the context of Dyson–Schwinger equation analyses of cold, sparse hadrons. Our focus is primarily on advances in the reliable computation, explanation and prediction of quantities that are truly measurable; but we also review aspects of a new paradigm that has condensates contained within hadrons, and explain that the asymptotic form of parton distribution amplitudes and functions are practically unreachable with terrestrial facilities. Given the pace of expansion in experiment and improvement in theory, it appears possible that the next five years will bring profound growth in our store of knowledge about hadrons and nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗

Microbial impacts on geothermometry temperature predictions

Conventional geothermometry approaches assume that the composition of a collected water sample originating in a deep geothermal reservoir still reflects chemical equilibration of the water with the deep reservoir rocks. However, for geothermal prospecting samples whose temperatures have dropped to <120°C, temperature predictions may be skewed by the activity of microorganisms; microbial metabolism can drastically and rapidly change the water’s chemistry. We hypothesize that knowledge of microbial impacts on exploration sample geochemistry can be used to constrain input into geothermometry models and thereby improve the reliability of reservoir temperature predictions. To evaluate this hypothesis we have chosen to focus on sulfur cycling, because of the significant changes in redox state and pH associated with sulfur chemistry. Redox and pH are critical factors in defining the mineral-fluid equilibria that form the basis of solute geothermometry approaches. Initially we are developing assays to detect the process of sulfate reduction, using knowledge of genes specific to sulfate reducing microorganisms. The assays rely on a common molecular biological technique known as quantitative polymerase chain reaction (qPCR), which allows estimation of the number of target organisms in a particular sample by enumerating genes specific to the organisms rather than actually retrieving and characterizing the organisms themselves. For quantitation of sulfate reducing genes using qPCR, we constructed a plasmid (a piece of DNA) containing portions of two genes (known as dsrA and dsrB) that are directly involved with sulfate reduction and unique to sulfate reducing microorganisms. Using the plasmid as well as DNA from other microorganisms known to be sulfate reducers or non-sulfate reducers, we developed qPCR protocols and showed the assay’s specificity to sulfate reducers and that a qPCR standard curve using the plasmid was linear over >5 orders of magnitude. As a first test with actual field samples, the assay was applied to DNA extracted from water collected at springs located in and around the town of Soda Springs, Idaho. Soda Springs is located in the fold and thrust belt on the eastern boundary of the track of the Yellowstone Hotspot, where a deep carbon dioxide source believed to originate from Mississippian limestone contacts acidic hydrothermal fluids at depth. Both sulfate and sulfide have been measured in samples collected previously at Soda Springs. Preliminary results indicate that sulfate reducing genes were present in each of the samples tested. Our work supports evaluation of the potential for microbial processes to have altered water chemistry in geothermal exploration samples.

15 GEOTHERMAL ENERGY↗

Machine Learning Prediction of H Adsorption Energies on Ag Alloys

Adsorption energies on surfaces are excellent descriptors of their chemical properties, including their catalytic performance. This has prompted a significant amount of work towards efficiently predicting adsorption energies without performing expensive quantum chemical calculations, based on semi-empirical or data scientific models. Here, we develop machine learning models to predict H adsorption energies on stepped Ag surface alloys using a database of energies obtained from first-principles electronic structure calculations based on density functional theory. Starting with a simple model and iteratively refining the features extracted from the calculations, we determine the key characteristics of successful models, and reduce the number of features required for accurate prediction of the adsorption energy. We find that nonlinear models are essential for accurate predictions. Moreover, detailed comparison of model predictions and calculations reveal a counterintuitive "selfpassivation" induced by some alloying elements, as well as unexpected discontinuous electronic structure effects. These findings are rationalized using tight-binding model hamiltonians and by analyzing the electronic density of states. Lastly, we show that we can estimate the reliability of a particular prediction, mitigating the effects of errors in the small fraction of cases where these errors are significant.

36 MATERIALS SCIENCE↗

Impacts of hybridization and forecast errors on the probabilistic capacity credit of batteries

Battery storage is increasingly identified as being among the least-cost mix of technologies in the evolving U.S. electricity mix. This study explores the marginal capacity credit of batteries using a probabilistic, reliability-based, effective firm capacity method, which we apply for multiple battery power ratings, durations, coupling types, deployment locations, and dispatch profiles within a test system that is based on the Texas Interconnection in the year 2024. We find that the capacity credits for all battery durations depend on their ability to predict the timing of reliability events. Even 1-2 h forecast errors - resulting in early or delayed battery discharging relative to the onset of a reliability event - lead pronounced capacity credit reductions, especially for 4-h duration batteries. Coupling batteries with solar mitigates the uncertainty associated with a shorter-duration battery's availability during reliability events, primarily due to the relatively high solar capacity credit in our test system. Coupled (or hybrid) system designs with oversized solar arrays, the ability to charge the coupled battery with grid energy, and larger batteries lead to the greatest capacity credit benefits of hybridization. We do not see evidence that the hybrid capacity credit exceeds the sum of the separate battery and solar capacity credits.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Early Career Award: An Enabling Computational Framework for Uncertainty Assimilation and Propagation in Complex PDE Systems: Sparse and Low-rank Techniques (Final Report)

This project aims to develop a set of new theories, algorithms, and computational tools that enable ultra-scalable representation and propagation of high-dimensional uncertainties to circumvent the issue of curse-of-dimensionality. The research components are motivated by the fact that highly scalable algorithms are needed to achieve exascale performance for uncertainty quantification and predictive simulation at extreme scales. Although these developments are generic and applicable to a wide range of high-dimensional, complex, stochastic, partial-differential-equation (PDE) systems, this research effort will focus on predictive simulation of high-energy-density lithium batteries. To create knowledge about the precise failure mechanisms of these batteries and ultimately predict their performance and reliability, a truly data-driven, multi-scale, multi-physics framework is needed that allows studying (i) dominant sources of uncertainty in the governing physical models at all scales of relevance and (ii) the interface between the interchanging physics and scales. The impact of the planned mathematical and numerical advancements in prediction of high-dimensional uncertain systems will be broad across areas of engineering and science such as climate modeling, fusion energy, combustion, and nanoscience, among others.

97 MATHEMATICS AND COMPUTING↗

High pressure rinse simulations for PIP-II SRF cavities

The implementation of High Pressure Rinse (HPR) not only ensures thorough cleaning of the inner high purity niobium surface of Superconducting Radio Frequency (SRF) cavities but also unlocks their full potential for achieving peak performance. By effectively removing contaminants and impurities, HPR sets the stage for enhanced superconducting properties, improved energy efficiency, and superior operational stability. A simulation tool has been developed, facilitating the accurate prediction of both the quality and effectiveness of the rinsing process before its execution in the cleanroom. This tool, the focus of this paper, stands as a pivotal advancement in optimizing Superconducting Radio Frequency (SRF) cavity preparation. Furthermore, our paper will also present correlations with cavity cold testing results, demonstrating the practical applicability and reliability of the simulation predictions in real-world scenarios.

43 PARTICLE ACCELERATORS↗

Preliminary Results for Using Uncertainty and Out-of-distribution Detection to Identify Unreliable Predictions.

As machine learning (ML) models are deployed into an ever-diversifying set of application spaces, ranging from self-driving cars to cybersecurity to climate modeling, the need to carefully evaluate model credibility becomes increasingly important. Uncertainty quantification (UQ) provides important information about the ability of a learned model to make sound predictions, often with respect to individual test cases. However, most UQ methods for ML are themselves data-driven and therefore susceptible to the same knowledge gaps as the models themselves. Specifically, UQ helps to identify points near decision boundaries where the models fit the data poorly, yet predictions can score as certain for points that are under-represented by the training data and thus out-of-distribution (OOD). One method for evaluating the quality of both ML models and their associated uncertainty estimates is out-of-distribution detection (OODD). We combine OODD with UQ to provide insights into the reliability of the individual predictions made by an ML model.

97 MATHEMATICS AND COMPUTING↗

Structure-aware Initialization via Numerical Continuation and Informed Priors

Scientific machine learning (SciML) often operates in ill-conditioned, weakly identifiable regimes due to limited data or indirect observations. In such settings, optimization and inference are highly sensitive to the starting point, making initialization--often under-reported--a consequential degree of freedom. Random initialization is not a neutral default as it induces an implicit prior over candidate solutions and can systematically bias the result, producing large run-to-run variability. Here, we formalize this view by treating initialization as a hidden confounder in SciML and develop a unifying theory for structure-aware initialization via numerical continuation, constructing warm starts from related problem instances. Across representative tasks, including physics-informed neural networks, maximum likelihood estimation, and variational inference, warm starts have been shown to consistently reduce optimization effort and improve reliability.

Data integrity↗

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests

Accurate and reliable near-real-time satellite precipitation estimation is of great importance for operational large-scale flood forecasting and drought monitoring. The state-of-the-art precipitation post-processing model is based on a deterministic approach to construct relationships between satellites estimates and ground observations. We propose a probabilistic postprocessor, the Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates using Quantile Regression Forests (QRF4P-NRT), based on quantile modeling, yielding both deterministic and probabilistic predictions. The experimental design incorporates different solutions of near-real-time predictors to further improve the model performance. Using the Integrated Multi-satellitE Retrievals Early Run for Global Precipitation Measurement Mission (IMERG-E) product as an example, we illustrate that the proposed method significantly improves the overall quality of the raw IMERG-E and is also superior to the bias-corrected product (IMERG Final Run, IMERG-F) at daily scale in a complex mountain basin. Evaluations of the corrected IMERG-E, raw IMERG-E, and IMERG-F using ground observation show that the corrected IMERG-E improves correlation coefficients (0.7), mean error (-0.14 mm/day) and root mean square error (3.3 mm/day) relative to the raw IMERG-E (0.31, -0.72 and 5.5 mm/day) and IMERG-F (0.34, -0.09 and 6.0 mm/day). The error decomposition further confirms that the QRF4P-NRT improves on the various deficiencies of the raw IMERG-E product. The ensemble assessment also demonstrates that the quantile outputs provide reliable prediction spread and sharp prediction intervals. The promising results indicate the great potential of the proposed method for probabilistic post-processing for near-real-time satellite precipitation estimates, and for further applications such as hydrological ensemble forecasting.

54 ENVIRONMENTAL SCIENCES↗

A Prognostics and Health Management Framework for Wind

Operation and maintenance costs are a major driver for levelized cost of energy of wind power plants and can be reduced through optimized operation and maintenance practices accomplishable by various prognostics and health management (PHM) technologies. In recent years, the wind industry has become more open to adopting PHM solutions, especially those focusing on diagnostics. However, prognostics activities are, in general, still at the research and development stage. On the other hand, the industry has a request to estimate a component's remaining useful life (RUL) when it has faulted, and this is a key output of prognostics. Systematically presenting PHM technologies to the wind industry by highlighting the RUL prediction need potentially helps speed up its acceptance and provides more benefits from PHM to the industry. In this paper, we introduce a PHM for wind framework. It highlights specifics unique to wind turbines and features integration of data and physics domain information and models. The output of the framework focuses on RUL prediction. To demonstrate its application, a data domain method for wind turbine gearbox fault diagnostics is presented. It uses supervisory control and data acquisition system time series data, normalizes gearbox temperature measurements with reference to environmental temperature and turbine power, and leverages big data analytics and machine-learning techniques to make the model scalable and the diagnostics process automatic. Another physics-domain modeling method for RUL prediction of wind turbine gearbox high-speed-stage bearings failed by axial cracks is also discussed. Bearing axial cracking has been shown to be the prevalent wind turbine gearbox failure mode experienced in the field and is different from rolling contact fatigue, which is targeted during the bearing design stage. The method uses probability of failure as a component reliability assessment and RUL prediction metric, which can be expanded to other drivetrain components or failure modes. The presented PHM for wind framework is generic and applicable to both land-based and offshore wind turbines.

17 WIND ENERGY↗