Search NASA⌕ Search

SEARCH · Search NASA

Results for “reliability estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Artificial Neural Network-based State Estimation for Low Observable, Unbalanced Microgrids for Microgrid Building Blocks

The microgrid building blocks (MBB) were proposed as microgrid components with combined sub-components with power conversion, communication, and microgrid control capability, or a subset of such sub-components. This work addresses the microgrid controller, present in an MBB, which requires accurate state estimation to perform its tasks, including for monitoring, power flow (dispatch), fault detection, etc. In this paper, an artificial neural network (ANN)-based framework for state estimation is proposed for an MBB, especially for unbalanced and low observable microgrids. To overcome the challenge of low observability in unbalanced systems, a concept of extended adjacent matrix is introduced to reduce the required number of measurements for state estimation. Addressing the challenges, a feed forward neural network (FNN) is utilized to enhance estimation accuracy and reliability with the reduced number of measurements. The proposed state estimation is validated through extensive simulations on a microgrid, which was achieved from the modified IEEE 34-bus distribution test feeder with multiple distributed energy resources (DERs) and demonstrated superior performance in estimation accuracy and low observability.

Choi, Jongchan↗
DOE OSTI2023

A Bootstrap Approach to Quantifying Reliabilities and Uncertainties of Complex Systems

While much work has been done in analyzing margins and uncertainties at the component level, a gap exists in NNSA methodology relating component level reliabilities and uncertainties to system level reliability and uncertainty. This paper shows how component level reliability data can be combined via a bootstrap analysis to estimate system level reliabilities and uncertainties. The performance of the bootstrap for this problem is validated through simulation studies. This paper extends the original work of Crowder by including sensitivity analyses related to changes in samples sizes and component failure probabilities. The use of the bootstrap as a decision-making tool is thus developed by quantifying the effect of such changes on system reliability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Towards a Robust Sampling Approach: A Computational Review and Design

As pointed out in several other works, the estimation of the reliability of the electrical grid can not be conducted without the estimation of the stochastic phenomena of electicity demand and electricity production by variable renewable sources. Therefore, sampling procedures have become integral in the design of engineering structures and analysis. Commonly referred to as Monte Carlo uncertainty analysis or integration, the general objective of these procedures is to establish specifics about the uncertainty of an output characteristic of such an engineering system, given uncertainty about its input characteristics. These sampling procedures are applied in a context in which establishing such specifics cannot be performed through other means. Variance-reduction techniques are designed to lessen the variability among estimators to estimate statistics of those output uncertainties. Importance-sampling techniques, on the other hand, are designed to reduce the number of samples needed to estimate a particular statistic—e.g., a tail probability. The combination of these approaches can reduce the computational burden considerably for a particular estimator and statistic. Importance sampling—geared and designed as it is toward improving a particular estimator—suffers, unfortunately, from the unintended consequence of reducing the performance of other estimators in terms of their variance. The objective of this paper is to offer an alternative sampling procedure where this variance does not grow unacceptably large for a suite of estimators. Moreover, it is anticipated that, with additional knowledge of how an engineering output characteristic responds to its input characteristics, tuning parameters of the input’s sampling procedure can be set to improve the output characteristic’s estimation. This work proves the effectiveness of the suggested alternative approach. Such positive outcome will lead to a decrease of the computational burden of performing stochastic optimization of integrated energy systems (e.g., components dispatch, and portfolio composition). In particular, capturing the contribution to the overall system cost of rare and unlikely events and patterns of the electricity demand and production will become less computationally expensive. This is due to the fact that the approach demonstrated here will allow the sampling of those rare occurrences more frequently without misrepresenting their probabilistic impacts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Improvement of Quantification in Non-Destructive Characterization of Radioactive Waste Packages -Introduction to the Ideas of a Currently Started Project - 20197

For the characterization of radioactive waste packages (e.g. 200-L drums) with inhomogeneous activity and density distributions preferably non-destructive methods like segmented gamma scanning and transmission measurements are applied. While the first is used for identification of the radioactive inventory, both are necessary for a reliable activity quantification. Although at nuclear facilities, segmented gamma scanner are state-of-the-art and are mostly equipped with a vertically moveable transmission source the combining of this data and further a-priori information improving accuracy in data estimation giving realistic, reliable and traceable uncertainty estimations are improvable. This challenge is tackled by a R and D project funded by the German Federal Ministry of Education and Research (BMBF). The boundary conditions for this project are (i) taking into account the typical instrumentation available at nuclear facilities, (ii) minimize the overall measurement time and (iii) combining data from emission and transmission measurements by Bayesian methods. For the R and D project, being still in its initial stage, the basic ideas, the data used for evaluation and the result of a preliminary investigation demonstrating the proof of principle are presented. Additionally, some first aspects on spatial resolution in emission and transmission measurements are addressed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Covariance-Free Bifidelity Control Variates Importance Sampling for Rare Event Reliability Analysis

Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world problems, particularly when failure is a rare event. To implement multifidelity modeling, estimators that efficiently combine information from multiple models/sources are necessary. In past works, the variance reduction techniques of control variates (CV) and importance sampling (IS) have been leveraged for this task. In this paper, we present the CVIS framework—a creative take on a coupled CV and IS estimator for bifidelity reliability analysis. The framework addresses some of the practical challenges of the CV method by using an estimator for the control variate mean and sidestepping the need to estimate the covariance between the original estimator and the control variate through a clever choice for the tuning constant. Furthermore, the task of selecting an efficient IS distribution is also considered, with a view towards maximally leveraging the bifidelity structure and maintaining expressivity. Additionally, a diagnostic is provided that indicates both the efficiency of the algorithm as well as the relative predictive quality of the models utilized. Finally, the behavior and performance of the framework is explored through analytical and numerical examples.

Markov chain Monte Carlo↗
DOE OSTI2025

Exploring Uncertainty in Moment Estimation for Small Earthquakes in Southern Nevada Using the Coda Envelope Method

Compiling source parameter estimates for small earthquakes is important both for our understanding of earthquake physics and for accurately assessing earthquake hazard. Reliable source parameter estimates are difficult to achieve for small earthquakes, in part due to our inability to accurately model the relevant physical processes at high frequencies. The coda envelope methodology developed by Mayeda and Walter (1996) and Mayeda et al. (2003) can mitigate this concern and estimate the moment of small earthquakes by determining the parameters that control the shape of the S-wave coda envelope while eliminating path effects by minimizing the scatter between seismic stations. Here, we use an open-source implementation of this technique called the Coda Calibration Tool (CCT; Barno, 2017) to calculate CCT-based moment magnitude estimates of small earthquakes (M L 0–3) in the Rock Valley, Nevada, region within the Nevada National Security Site. The Rock Valley data set is of particular interest because it allows us to explore the changes in uncertainties of the coda calibration method with earthquake size and depth. We found that a consistent linear relationship exists between the local magnitude M L and our coda-derived M w estimates for earthquakes as small as M L 0–3, but that current CCT workflows do not accurately characterize very shallow events. We also demonstrate that the epistemic uncertainty in the apparent stress value assumed by the CCT algorithm can influence magnitude estimates of small earthquakes. In conclusion, these results provide valuable insight into the seismicity of this region, and inform future analysis and modeling efforts for nuclear monitoring and seismic hazard.

58 GEOSCIENCES↗
DOE OSTI2021

Leveraging Randomized Compiling for the QITE Algorithm

The success of the current generation of Noisy Intermediate-Scale Quantum (NISQ) hardware shows that quantum hardware may be able to tackle complex problems even without error correction. One outstanding issue is that of coherent errors arising from the increased complexity of these devices. These errors can accumulate through a circuit, making their impact on algorithms hard to predict and mitigate. Iterative algorithms like Quantum Imaginary Time Evolution are susceptible to these errors. This article presents the combination of both noise tailoring using Randomized Compiling and error mitigation with a purification. We also show that Cycle Benchmarking gives an estimate of the reliability of the purification. We apply this method to the Quantum Imaginary Time Evolution of a Transverse Field Ising Model and report an energy estimation and a ground state infidelity both below 1\%. Our methodology is general and can be used for other algorithms and platforms. We show how combining noise tailoring and error mitigation will push forward the performance of NISQ devices.

Ville, Jean-Loup↗
DOE OSTI2023

Spatiotemporal Variability of Electric System Reliability Metrics

As urbanization continues to grow, urban density also rises, placing significant stress on critical infrastructure. Cities often face challenges in investing in new infrastructure or upgrading existing ones. One area of infrastructure that has come under strain is the electric grid, leading to prolonged power outages. According to data from the U.S. Energy Information Administration, the average duration of power outages has steadily doubled from 2013 to 2021, primarily due to extreme weather events. The IEEE has developed a series of reliability metrics to assess the reliability of the electric system. However, these metrics are only applied at the utility level, making it challenging to comprehend the variations in these indices at finer spatial resolutions and, consequently, evaluate reliability at the non-utility level. In this study, we leveraged electric outage data collected at 15-minute intervals at the county level to estimate electric system reliability over a six-year period using a novel data analysis approach. Our findings reveal a gradual decline in reliability in the U.S. Southwest compared to national averages. Furthermore, the duration of outages per customer per event has significantly decreased in large portions of California and Florida. These discoveries can be valuable for utility companies as they seek to pinpoint regional anomalies and plan for prioritized remediation efforts.

Singh, Nagendra↗
DOE OSTI2021

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests

Accurate and reliable near-real-time satellite precipitation estimation is of great importance for operational large-scale flood forecasting and drought monitoring. The state-of-the-art precipitation post-processing model is based on a deterministic approach to construct relationships between satellites estimates and ground observations. We propose a probabilistic postprocessor, the Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates using Quantile Regression Forests (QRF4P-NRT), based on quantile modeling, yielding both deterministic and probabilistic predictions. The experimental design incorporates different solutions of near-real-time predictors to further improve the model performance. Using the Integrated Multi-satellitE Retrievals Early Run for Global Precipitation Measurement Mission (IMERG-E) product as an example, we illustrate that the proposed method significantly improves the overall quality of the raw IMERG-E and is also superior to the bias-corrected product (IMERG Final Run, IMERG-F) at daily scale in a complex mountain basin. Evaluations of the corrected IMERG-E, raw IMERG-E, and IMERG-F using ground observation show that the corrected IMERG-E improves correlation coefficients (0.7), mean error (-0.14 mm/day) and root mean square error (3.3 mm/day) relative to the raw IMERG-E (0.31, -0.72 and 5.5 mm/day) and IMERG-F (0.34, -0.09 and 6.0 mm/day). The error decomposition further confirms that the QRF4P-NRT improves on the various deficiencies of the raw IMERG-E product. The ensemble assessment also demonstrates that the quantile outputs provide reliable prediction spread and sharp prediction intervals. The promising results indicate the great potential of the proposed method for probabilistic post-processing for near-real-time satellite precipitation estimates, and for further applications such as hydrological ensemble forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Vibrational processing of a dynamic structural flight system: A multichannel spectral estimation approach

Dynamic testing of large flight vehicles (rockets) is not only complex, but also can be very costly. These flights are infrequent and can lead to disastrous effects if something were to fail during the flight. The development of sensors coupled to internal components offers a great challenge in reducing their size, yet still maintaining their precision. Sounding rockets provide both a viable and convenient alternative to the more costly vehicular flights. Some of the major objectives are to test various types of sensors for monitoring components of high interest as well as investigating real-time processing techniques. Signal processing presents an extreme challenge in this noisy multichannel environment. The estimation and tracking of modal frequencies from vibrating structures is an important set of features that can provide information about the components under test; therefore, high resolution multichannel spectral processing is required. Finally, the application of both single channel and multichannel techniques capable of producing reliable modal frequency estimates of a vibrating structure from uncertain accelerometer measurements is discussed.

42 ENGINEERING↗
DOE OSTI2022

Are Land‐Use Change Emissions in Southeast Asia Decreasing or Increasing?

Abstract Southeast Asia is a region known for active land‐use changes (LUC) over the past 60 years; yet, how trends in net CO 2 uptake and release resulting from LUC activities (net LUC flux) have changed through past decades remains uncertain. The level of uncertainty in net LUC flux from process‐based models is so high that it cannot be concluded that newer estimates are necessarily more reliable than older ones. Here, we examined net LUC flux estimates of Southeast Asia for the 1980s−2010s from older and newer sets of Dynamic Global Vegetation Model simulations (TRENDY v2 and v7, respectively), and forcing data used for running those simulations, along with two book‐keeping estimates (H&N and BLUE). These estimates yielded two contrasting historical LUC transitions, such that TRENDY v2 and H&N showed a transition from increased emissions from the 1980s to 1990s to declining emissions in the 2000s, while TRENDY v7 and BLUE showed the opposite transition. We found that these contrasting transitions originated in the update of LUC forcing data, which reduced the loss of forest area during the 1990s. Further evaluation of remote sensing studies, atmospheric inversions, and the history of forestry and environmental policies in Southeast Asia supported the occurrence of peak emissions in the 1990s and declining thereafter. However, whether LUC emissions continue to decline in Southeast Asia remains uncertain as key processes in recent years, such as conversion of peat forest to oil‐palm plantation, are yet to be represented in the forcing data, suggesting a need for further revision.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Multi-Frequency Analysis of Simulated versus Observed Variability in Tropospheric Temperature

Studies seeking to identify a human-caused global warming signal generally rely on climate model estimates of the “noise” of intrinsic natural variability. Assessing the reliability of these noise estimates is of critical importance. We evaluate here the statistical significance of differences between climate model and observational natural variability spectra for global-mean mid- to upper-tropospheric temperature (TMT). We use TMT information from satellites and large multimodel ensembles of forced and unforced simulations. Our main goal is to explore the sensitivity of model-versus-data spectral comparisons to a wide range of subjective decisions. These include the choice of satellite and climate model TMT datasets, the method for separating signal and noise, the frequency range considered, and the statistical model used to represent observed natural variability. Of particular interest is the amplitude of the interdecadal noise against which an anthropogenic tropospheric warming signal must be detected. We find that on time scales of 5–20 years, observed TMT variability is (on average) overestimated by the last two generations of climate models participating in the Coupled Model Intercomparison Project. This result is relatively insensitive to different plausible analyst choices, enhancing confidence in previous claims of detectable anthropogenic warming of the troposphere and indicating that these claims may be conservative. A further key finding is that two commonly used statistical models of short-term and long-term memory have deficiencies in their ability to capture the complex shape of observed TMT spectra.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation

Trust calibration for a human–machine team is the process by which a human adjusts their expectations of the automation’s reliability and trustworthiness; adaptive support for trust calibration is needed to engender appropriate reliance on automation. Herein, we leverage an instance-based learning ACT-R cognitive model of decisions to obtain and rely on an automated assistant for visual search in a UAV interface. This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings. The model is able to predict the effect of various potential disruptions, such as environmental changes or particular classes of adversarial intrusions on human trust in automation. Finally, we consider the use of model predictions to improve automation transparency that account for human cognitive biases in order to optimize the bidirectional interaction between human and machine through supporting trust calibration. The implications of our findings for the design of reliable and trustworthy automation are discussed.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Enhanced Boundary Layer Height Detection Using Ceilometer, Surface Meteorology, and Radiation Products With a Random Forest Ensemble Method

This study develops and evaluates a Random Forest (RF) model for estimating planetary boundary layer height (PBLH) using 9 years of data from the Atmospheric Radiation Measurement Southern Great Plains (ARM SGP) user facility, with potential application in the NOAA Surface Radiation (SURFRAD) Network. The model integrates ceilometer, surface meteorology, and radiation measurements, and is trained using thermodynamic PBLH estimates derived from radiosondes. This approach aims to bridge gaps between aerosol-based and thermodynamic-based PBLH estimates. The RF model outperformed traditional methods during daytime and better captured transition periods, demonstrating improved accuracy and robustness. At ARM SGP, it showed a substantial reduction in both bias and RMSE, with a bias near zero (−4.9 m) compared with traditional Haar Wavelet (HW) (70.9 m) and Vaisala BL-View software (124.1 m), and an RMSE of 303.2 m, lower than both BL-View (566.9 m) and HW (404.6 m). During daytime hours, RF consistently outperformed both alternatives, maintaining lower bias and RMSE across all periods. At a second evaluation site, RF achieved the lowest overall RMSE (323.7 m), similar to HW (326.4 m) and significantly better than BL-View (738.3 m). However, all models showed reduced accuracy under stable nighttime conditions, limiting the reliability of PBLH estimates. Key predictors for the model included the lifting condensation level height (LCLH), aerosol gradients, and month for seasonal variability. The study underscores the potential of integrating machine learning with multiple data sets such as surface energy and thermodynamic data to advance PBLH estimation.

boundary layer height↗
DOE OSTI2020

Surprising similarities in model and observational aerosol radiative forcing estimates

Abstract. The radiative forcing from aerosols (particularly through their interaction with clouds) remains one of the most uncertain components of the human forcing of the climate. Observation-based studies have typically found a smaller aerosol effective radiative forcing than in model simulations and were given preferential weighting in the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5). With their own sources of uncertainty, it is not clear that observation-based estimates are more reliable. Understanding the source of the model and observational differences is thus vital to reduce uncertainty in the impact of aerosols on the climate. These reported discrepancies arise from the different methods of separating the components of aerosol forcing used in model and observational studies. Applying the observational decomposition to global climate model (GCM) output, the two different lines of evidence are surprisingly similar, with a much better agreement on the magnitude of aerosol impacts on cloud properties. Cloud adjustments remain a significant source of uncertainty, particularly for ice clouds. However, they are consistent with the uncertainty from observation-based methods, with the liquid water path adjustment usually enhancing the Twomey effect by less than 50 %. Depending on different sets of assumptions, this work suggests that model and observation-based estimates could be more equally weighted in future synthesis studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗