SEARCH · Search NASA

Results for “reliability estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2023

How reliable is distribution of relaxation times (DRT) analysis? A dual regression-classification perspective on DRT estimation, interpretation, and accuracy

The distribution of relaxation times (DRT) has gained increasing attention and adoption in recent years as a versatile method for analyzing electrochemical impedance spectroscopy (EIS) data obtained from complex devices like fuel cells, electrolyzers, and batteries. The DRT deconvolutes the impedance without a priori specification of a generative model, which is especially useful for interpretation and model selection when the governing principles of the system under study are not fully understood. However, DRT estimation is an ill-posed inversion problem that must be addressed with a subjective choice of regularization and tuning, which leaves substantial risk of misleading interpretations of EIS data. In this work, we suggest a new classification view of the DRT inversion to clarify DRT estimation and interpretation. We introduce a dual regression-classification framework that unifies the classification and regression views of the DRT inversion with wide-reaching implications for DRT analysis. The dual framework is employed to demonstrate a new kind of DRT inversion algorithm and develop novel evaluation metrics that capture previously ignored aspects of DRT accuracy. These approaches are applied to both synthetic data and experimental spectra collected from a protonic ceramic fuel cell and a lithium-ion battery to illustrate their broad utility. The dual inversion algorithm shows promising performance for accurate DRT estimation and autonomous model identification, while the dual evaluation approach produces metrics that meaningfully assess the strengths and risks of DRT algorithms. Here this work provides valuable insight for both practical application of the DRT to experimental data and further development of EIS analysis methods.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Development of a Comparison Framework for Evaluating Environmental Contours of Extreme Sea States

Environmental contours of extreme sea states are often utilized for the purposes of reliability-based offshore design. Many methods have been proposed to estimate environmental contours of extreme sea states, including, but not limited to, the traditional inverse first-order reliability method (I-FORM) and subsequent modifications, copula methods, and Monte Carlo methods. These methods differ in terms of both the methodology selected for defining the joint distribution of sea state parameters and in the method used to construct the environmental contour from the joint distribution. It is often difficult to compare the results of proposed methods to determine which method should be used for a particular application or geographical region. The comparison of the predictions from various contour methods at a single site and across many sites is important to making environmental contours of extreme sea states useful in practice. The goal of this paper is to develop a comparison framework for evaluating methods for developing environmental contours of extreme sea states. This paper develops generalized metrics for comparing the performance of contour methods to one another across a collection of study sites, and applies these metrics and methods to develop conclusions about trends in the wave resource across geographic locations, as demonstrated for a pilot dataset. These proposed metrics and methods are intended to judge the environmental contours themselves relative to other contour methods, and are thus agnostic to a specific device, structure, or field of application. The metrics developed and applied in this paper include measures of predictive accuracy, physical validity, and aggregated temporal performance that can be used to both assess contour methods and provide recommendations for the use of certain methods in various geographical regions. The application and aggregation of the metrics proposed in this paper outline a comparison framework for environmental contour methods that can be applied to support design analysis workflows for offshore structures. This comparison framework could be extended in future work to include additional metrics of interest, potentially including those to address issues pertinent to a specific application area or analysis discipline, such as metrics related to structural response across contour methods or additional physics-based metrics based on wave dynamics.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Smart Methane Emission Detection System Development Final Report

03 NATURAL GAS↗

DOE OSTI2021

Smart Methane Emission Detection System Development (Final Report)

Working with the Department of Energy’s National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real- time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI’s Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators. The goals for this research were to develop two types of models with the following goals: 1. Run in real-time on the edge (≥ 12 Hz) 2. Classification: Achieve less than 5% false positive detection 3. Classification: Achieve ≥ 95% methane plume detection rate 4. Regression: achieve ≤ 10 standard cubic feet per hour (scfh) prediction > 70% of the time In order to achieve these results, multiple infrared (IR) and other sensors were investigated in tandem with the midwave IR (MWIR) OGI to provide additional information to train the underlying models. Information on atmospheric conditions including humidity, temperature, pressure, and solar radiation was provided by a weather station. Several machine learning and deep learning architectures and methods, including looking at quantized classification networks and regressions networks, were explored. As further data was collected, curated, and labeled, it allowed for more refined regressive networks to be adequately trained, leading to better insight into the true flow rates being observed. An important valuable deliverable of this research effort was the development of an advanced network which underwent multiple iterations capable of giving a continuous output. The current network has a predicted mean average percentage error (MAPE) of 12.3% just outside our target goal of 10.00%, but an accuracy of 97.78% at ±50 scfh, well within the overall goal for the Department of Energy (DOE) program. Upon closer inspection, it was observed that more than 10% of datapoints contributing to the MAPE predictions were the result of low flow rate predictions and are beyond the sensitivity of instrument measurement as a result of normal operational variation and noise.

03 NATURAL GAS↗

DOE OSTI2021

Smart Methane Emission Detection System Development (Final Report)

Working with the Department of Energy's National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real-time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI's Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators. The goals for this research were to develop two types of models with the following goals: Run in real-time on the edge (≥ 12 Hz), Classification: Achieve less than 5% false positive detection, Classification: Achieve ≥ 95% methane plume detection rate, Regression: achieve ≤ 10 standard cubic feet per hour (scfh) prediction > 70% of the time. In order to achieve these results, multiple infrared (IR) and other sensors were investigated in tandem with the midwave IR (MWIR) OGI to provide additional information to train the underlying models. Information on atmospheric conditions including humidity, temperature, pressure, and solar radiation was provided by a weather station. Several machine learning and deep learning architectures and methods, including looking at quantized classification networks and regressions networks, were explored. As further data was collected, curated, and labeled, it allowed for more refined regressive networks to be adequately trained, leading to better insight into the true flow rates being observed. An important valuable deliverable of this research effort was the development of an advanced network which underwent multiple iterations capable of giving a continuous output. The current network has a predicted mean average percentage error (MAPE) of 12.3% just outside our target goal of 10.00%, but an accuracy of 97.78% at ±50 scfh, well within the overall goal for the Department of Energy (DOE) program. Upon closer inspection, it was observed that more than 10% of datapoints contributing to the MAPE predictions were the result of low flow rate predictions and are beyond the sensitivity of instrument measurement as a result of normal operational variation and noise.

03 NATURAL GAS↗

DOE OSTI2021

Roles of Dynamic State Estimation in Power System Modeling, Monitoring and Operation

—Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the implementation differences between the two, including the measurement configuration, modeling framework and support software features. The important roles of DSE are discussed from modeling, monitoring and operation aspects for today’s synchronous machine dominated systems and the future power electronics-interfaced generation systems. Several examples are presented to demonstrate the benefits of DSE on enhancing the operational robustness and resilience of 21st century power system through time critical applications. Future research directions are identified and discussed, paving the way for developing the next generation of energy management systems.

Zhao, Junbo↗

DOE OSTI2025

Interrelationships among methods of estimating microbial biomass across multiple soil orders and biomes

Understanding the role of soil microbes is critical to ecosystem processes, and more thorough comparisons of measurement proxies for soil microbial biomass could broaden the inclusion of explicit microbial parameterization in soil carbon cycling and earth system models. We measured physical, chemical, and biological data from eight soil orders representing 11 major biomes and four climate regions. Four prominent methods to measure microbial abundance—chloroform fumigation extraction (CFE), total DNA yield, gene copy number by quantitative polymerase chain reaction (GCN), and phospholipid fatty acids (PLFA)—were compared to assess their relationships with each other and with soil characteristics. Correlations were observed when comparing methods, with CFE correlating strongly with total DNA yield, GCN, and PLFA; CFE with bacterial GCN and bacterial PLFA; and to a lesser extent, total PLFA and total DNA yield. Correlations improved with the removal of organic soils (Histosols, Gelisols). Comparisons involving extracted DNA were improved by correcting for clay content, due to DNA extraction inefficiencies in clay-rich soils. Correlations involving fungi (PLFA or GCN) were always less significant. These methods could serve as reliable, inter-relatable proxies for the estimation of total soil microbial biomass while recognizing that the proxies are less effective at parsing differences between bacteria and fungi. Here, we provide specific equations to relate measures of soil microbial biomass by these four different methods to enable microbial models to utilize a greater diversity of observed data sources in parameterizations and simulations. Caveats for the equations and their values are also discussed.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

OzDES Reverberation Mapping Programme: the first Mg ii lags from 5 yr of monitoring

ABSTRACT Reverberation mapping is a robust method to measure the masses of supermassive black holes outside of the local Universe. Measurements of the radius–luminosity (R−L) relation using the Mg ii emission line are critical for determining these masses near the peak of quasar activity at z ≈ 1−2, and for calibrating secondary mass estimators based on Mg ii that can be applied to large samples with only single-epoch spectroscopy. We present the first nine Mg ii lags from our 5-yr Australian Dark Energy Survey reverberation mapping programme, which substantially improves the number and quality of Mg ii lag measurements. As the Mg ii feature is somewhat blended with iron emission, we model and subtract both the continuum and iron contamination from the multiepoch spectra before analysing the Mg ii line. We also develop a new method of quantifying correlated spectroscopic calibration errors based on our numerous, contemporaneous observations of F-stars. The lag measurements for seven of our nine sources are consistent with both the H β and Mg ii R−L relations reported by previous studies. Our simulations verify the lag reliability of our nine measurements, and we estimate that the median false positive rate of the lag measurements is $4{{\ \rm per\ cent}}$.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Raccoon density estimation from camera traps for raccoon rabies management

Abstract Density estimation for unmarked animals is particularly challenging, yet density estimates are often necessary for effective wildlife management. Raccoons ( Procyon lotor ) are the primary terrestrial wildlife reservoir for Lyssavirus rabies within the United States. The raccoon rabies variant (RRVV) is actively managed at landscape scales using oral rabies vaccination (ORV) within the eastern United States. To effectively manage RRVV, it is important to know the density of raccoons to appropriately scale the density of ORV baits distributed on the landscape. We compared methods to estimate raccoon densities from camera‐trap data versus more intensive capture‐mark‐recapture (CMR) estimates across 2 land cover types (upland pine and bottomland hardwood) in the southeastern United States during 2019 and 2020. We evaluated the effect of alternative camera configurations and durations of camera trapping on density estimates and used an N‐mixture model to estimate raccoon densities, including covariates on abundance and detection. We further compared different methods of scaling camera‐based counts, with the maximum number of raccoons seen on any given image within a day best explaining density. Camera‐trap density estimates were moderately correlated with CMR estimates ( r = 0.56). However, densities from camera‐trap data were more reliable when classifying category of density as an index used to inform management (83% correct when compared to CMR estimates), although the densities in our study fell into the 2 lowest density classes only. Using more cameras reduced bias and uncertainty around density estimates; however, if ≤6 camera traps were used at a site, a line transect approach proved less biased than a grid design. Camera trapping should be conducted for at least 3 weeks for more accurate estimates of raccoon population density in our study area (<5% bias). We show that camera‐trap data can be used to assign raccoon densities to management‐relevant density index bins, but more studies are needed to ensure reliability across a greater range of environmental conditions and raccoon densities.

Davis, Amy J.↗

DOE OSTI2025

Estimating the State of Charge in Lithium Primary Batteries: Recent Advances and Critical Insights

Lithium primary batteries (LPBs) remain essential in critical applications such as military, aerospace, medical and emergency devices, and portable electronics. Their superior energy density over lithium-ion batteries offers a significant advantage for long-duration use. Therefore, accurate estimation of the state of charge (SoC) is essential for ensuring the reliable and safe operation of these batteries. While extensive research has been conducted on SoC estimation techniques for lithium-ion secondary batteries, LPBs present unique challenges that complicate accurate SoC estimation. Moreover, research on nondestructive testing techniques for SoC estimation in LPBs is significantly lacking. In this review article, it is aimed to provide a comprehensive overview of recent advancements in SoC estimation for LPBs and generates new insights and directions for future research. Herein, existing methods are discussed and their effectiveness and mechanisms are identified, and areas for further optimization are outlined. More theoretical/experimental efforts to advance SoC detection in LPBs is recommended due to challenges identified with existing techniques.

25 ENERGY STORAGE↗

DOE OSTI2023

Neutron star mass estimates from gamma-ray eclipses in spider millisecond pulsar binaries

Reliable neutron star mass measurements are key to determining the equation of state of cold nuclear matter, but such measurements are rare. Black widows and redbacks are compact binaries consisting of millisecond pulsars and semi-degenerate companion stars. Spectroscopy of the optically bright companions can determine their radial velocities, providing inclination-dependent pulsar mass estimates. Although inclinations can be inferred from subtle features in optical light curves, such estimates may be systematically biased due to incomplete heating models and poorly understood variability. Using data from the Fermi Large Area Telescope, we have searched for gamma-ray eclipses from 49 spider systems, discovering significant eclipses in 7 systems, including the prototypical black widow PSR B1957+20. Gamma-ray eclipses require direct occultation of the pulsar by the companion, and so the detection, or significant exclusion, of a gamma-ray eclipse strictly limits the binary inclination angle, providing new robust, model-independent pulsar mass constraints. For PSR B1957+20, the eclipse implies a much lighter pulsar (1.81 ± 0.07 solar masses) than inferred from optical light curve modelling.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Measuring Success: A Refined Methodology for Estimating Long-term Continuous Improvement

Successful resource management systems require current and detailed feedback on operational and corporate-level performance. As corporate accountability concerns intensify, the precision and reliability of these performance metrics have become crucial. Traditional savings estimation methods can be difficult to understand, particularly linear regression, and can provide varying results. This paper reviews common efficiency metrics and highlights underlying mathematical inconsistencies when estimating total and percent savings with current methods. A refined approach to calculating long-term utility savings is proposed that simplifies current methodologies utilizing ratios to define an adjusted baseline, allowing for consistent and fair aggregation of results across multiple scales from resources to corporate performance. A simplified example demonstrates how the proposed methodology improves upon existing methods, especially in intermediate years. This paper’s major contributions are the simplified approach for converting modeled utility usage into estimated savings and the consistent roll-up methodology enabling more comparable, aggregable, and actionable results across scales.

Price, Chris [ORNL] (ORCID:0000000202007906)↗

DOE OSTI2022

Simultaneous Forward-Backward Prony Estimation

Power system dynamic stability can be evaluated through the analysis of transient oscillations that occur following significant system events. One of the earliest methods for this type of study is Prony analysis, which estimates the system's electromechanical modes. While previous studies have highlighted advantages of performing Prony analysis on data in the forward and backward directions, the proposed method does so simultaneously. As a result, signal poles corresponding to electromechanical modes can be distinguished from spurious poles more reliably. The method also produces a single mode estimate, where independent application in the forward and backward directions would produce two estimates for each mode. The method is validated using simulated and measured power system data.

Follum, James D.↗

DOE OSTI2021

A nudged hybrid analysis and modeling approach for realtime wake-vortex transport and decay prediction

Here, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements for air traffic improvements. Toward emerging applications of digital twins in aviation, the proposed approach allows for constructing a realtime predictive tool for wake-vortex transport and decay systems. We build on the fact that in realistic application, there are uncertainties in initial and boundary conditions, model parameters, as well as measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities, especially for advection-dominated flows with slow decay in the Kolmogorov n-width. In the presented LSTM nudging (LSTM-N) approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate our concept by solving the two-dimensional vorticity transport equation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-N behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity, and offer a huge potential in developing next-generation digital twin technologies for aerospace applications.

42 ENGINEERING↗

DOE OSTI2020

Statistical Tests for Diagnosing Fission Source Convergence and Undersampling in Monte Carlo Criticality Calculations [Slides]

There is a very strong need for statistical testing to determine fission source convergence in Monte Carlo criticality calculations. Automation of such tests will greatly streamline and support the work carried out by NCS practitioners. Recent R&D work has shown that no single statistical test for convergence is sufficiently reliable, robust, and “guaranteed.” However, a combination of several standard statistical tests for the similarity of distributions, coupled with a high-fidelity estimate of the fission-matrix source is sufficiently robust, reliable, and repeatable that convergence can be “guaranteed.” During the course of the EG-AMCT studies, a number of statistical metrics and tests were proposed for diagnosing clustering and undersampling. None of these was robust and reliable enough for practical use in production codes. However, the expert group efforts came close. Some recent R&D work stemming from those past efforts has been very successful and promising. This Sub-Group will provide international input and collaboration on the development and implementation of statistical tests for convergence, with the primary goal of having the MC codes automatically detect convergence (or lack thereof). Newly proposed statistical tests to detect undersampling (after convergence) will also be reviewed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Landsat 8 monitoring of multi-depth suspended sediment concentrations in Lake Erie’s Maumee River using machine learning

Satellite remote sensing has been widely used to map suspended sediment concentration (SSC) in waterbodies. However, due to the complexity of sediment-water interactions, it has been difficult to derive linear and non-linear regression equations to reliably predict SSC, especially when trying to estimate depth of integrated sediment. Herein, this study uses Landsat 8 OLI (Operational Land Imager) sensor to map SSC within the Maumee River in Ohio, USA, at multiple depth intervals (15, 61, 91, and 182 cm). Simple linear least squares regression (LLSR), and three common machine learning models: random forest (RF), support vector regression (SVR), and model averaged neural network (MANN) were used to estimate SSC at the depth intervals. All machine learning models significantly outperformed LLSR while RF performed the best. In both RF and MANN, R2 (coefficient of determination) increases with depth with a maximum R2 of 0.89 and 0.83, respectively, at a depth of 0–182 cm. The results show that machine learning models can implement nonlinear relationships that produce better predictions than traditional linear regression methods in estimating depth integrated SSC, especially when samples are limited.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Quantifying uncertainty in machine learning for nuclear binding energy

Techniques from artificial intelligence and machine learning are increasingly employed in nuclear theory; however, the uncertainties that arise from the complex parameter manifold encoded by the neural networks are often overlooked. Epistemic uncertainties arising from training the same network multiple times for an ensemble of initial weight sets offer a first insight into the confidence of machine learning predictions, but they often come with a high computational cost. Instead, we apply a single-model uncertainty quantification method called Δ-UQ that gives epistemic uncertainties with one-time training. Here, we demonstrate our approach on a two-feature model of nuclear binding energies per nucleon with proton and neutron number pairs as inputs. We show that Δ-UQ can produce reliable and self-consistent epistemic uncertainty estimates and can be used to assess the degree of confidence in predictions made with deep neural networks.

Huang, Mengyao [Lawrence Livermore National Labora↗

DOE OSTI2021

Evaluation of “Tight Oil” Well Performance and Completion Practices in the Powder River Basin - “Time Slice” Analysis

The objective of this paper is to assess how well completion practices and well performance have evolved over time (“time slices”) in the tight sands and shales of the Powder River Basin (PRB). This information can provide a foundation for helping operators define more effective well completion practices and thus optimize well performance in an emerging “tight oil” basin. To start, the authors assembled a “database” containing well completion practices, production data, and geologic information for more than 800 horizontal (Hz) wells targeting three “tight oil” formations -- Turner, Frontier, and Mowry--placed on production in the past dozen years. To control for the impact of geologic and reservoir properties on well performance, the authors defined 12 geologically distinct areas (“partitions”) for the Turner, Frontier, and Mowry Shale in the Powder River Basin (4 partitions in each formation). This paper discusses the methodology for establishing “time slices” for each partition within each of the three “tight oil” formations, including (1) taking out, to the extent practical, the effects of geology by partitioning the three “tight oil” formations based on their geologic parameters; (2) using type curves and estimated ultimate recoveries (EURs) to establish a reliable measure of well performance; and (3) rigorously inspecting the production and well completion data to assure a quality dataset. Partition #2, a high thermal maturity area of the Frontier Sandstone in the western Powder River Basin, helps illustrate the results of the study. Using a dataset of 55 Hz wells, the study found that well performance has steadily improved, with oil EURs increasing from 180 MBbl in 2012-13 to 290 MBbl in 2018-19. Much of this improvement was due to the use of longer Hz laterals, increasing notably from 3,765 ft in 2012-13 to 10,260 ft in 2018-19. More intensive completion practices contributed, as well. For example, the number of frac stages more than doubled, from 17 to 35, and proppant concentrations increased from 1,060 lbs/ft to 1,320 lbs/ft. Finally, the data show diminishing returns to longer laterals and more intensive completion practices. For example, the key performance measure of oil EUR per 1,000 ft of lateral is decreasing. For 2012-13, Hz wells recovered 50 MBbl of oil per 1,000 ft of lateral while the more recent 2018-19 Hz wells only provide 30 MBbl of oil per 1,000 ft of lateral. Considerable insight can be gained by using “time slices” and geologic partitioning to better understand the relationship between changes in well drilling and completion practices and changes in well performance in emerging “tight oil” plays. The results from this study can also serve as a foundation for subsequent, more intense efforts involving data analytics for defining more optimum well completion practices targeting specified geologic settings and formations.

02 PETROLEUM↗