Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A General Decentralized Dynamic State Estimation With Synchronous Generator Magnetic Saturation

We report the saturation of the nonlinear magnetic circuit of synchronous generators is often neglected when performing Kalman filter-based dynamic state estimation (DSE), yielding significant estimation bias. This letter addresses this problem and proposes a generalized DSE framework to handle magnetic saturation. Moreover, this letter derives a state initialization procedure that improves the Kalman filter tracking speed. The framework is flexible in dealing with different saturation functions and generator models. Numerical results on the Texas 2000-bus system verify the effectiveness of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Convergence Rates for Empirical Estimation of Binary Classification Bounds

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error rate depend on information divergences between the pair of class distributions. Recently, the Henze–Penrose (HP) divergence has been proposed for bounding classification error probability. We consider the problem of empirically estimating the HP-divergence from random samples. We derive a bound on the convergence rate for the Friedman–Rafsky (FR) estimator of the HP-divergence, which is related to a multivariate runs statistic for testing between two distributions. The FR estimator is derived from a multicolored Euclidean minimal spanning tree (MST) that spans the merged samples. We obtain a concentration inequality for the Friedman–Rafsky estimator of the Henze–Penrose divergence. We validate our results experimentally and illustrate their application to real datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Solving high-dimensional inverse problems using amortized likelihood-free inference with noisy and incomplete data

Here, we present a likelihood-free probabilistic inversion method based on normalizing flows for high-dimensional inverse problems. The proposed method is composed of two complementary networks: a summary network for data compression and an inference network for parameter estimation. The summary network encodes raw observations into a fixed-size vector of summary features, while the inference network generates samples of the approximate posterior distribution of the model parameters based on these summary features. The posterior samples are produced in a deep generative fashion by sampling from a latent Gaussian distribution and passing these samples through an invertible transformation. We construct this invertible transformation by sequentially alternating conditional invertible neural network and conditional neural spline flow layers. The summary and inference networks are trained simultaneously. We apply the proposed method to an inversion problem in groundwater hydrology to estimate the posterior distribution of the log-conductivity field conditioned on spatially sparse time-series observations of the system’s hydraulic head responses. The conductivity field is represented with 706 degrees of freedom in the considered problem. Comparison with the likelihood-based iterative ensemble smoother PEST-IES method demonstrates that the proposed method accurately estimates the parameter posterior distribution and the observations’ predictive posterior distribution at a fraction of the inference time of PEST-IES.

conditional invertible neural network↗
DOE OSTI2021

Performance Comparison of Circular and Spherical Error Probable Estimators

This report compares the performance of three Circular Error Probable (CEP) estimators: the Grubbs-Patnaik estimator, a new, non-iterative, radial-integration estimator, and a median estimator. It also compares the performance of two Spherical Error Probable (SEP) estimators. The performance of each estimator is assessed in terms of bias, uncertainty, robustness, and computational complexity. Robustness is evaluated with respect to outliers, variations in the underlying statistical distribution characterizing munition impact positions, and impact-position measurement errors. The performance assessments indicate the radial-integration and Grubbs-Patnaik estimators perform nearly identically providing the statistical distribution of impact-position coordinates is jointly normal with zero means. In that case, both estimators outperform the median estimator by about 2% relative to the true CEP in terms of estimator uncertainty. The bias performance of the radial-integration and median estimators is close to zero for jointly normal impacts, however, the Grubbs-Patnaik estimator can be significantly biased for jointly normal impacts with non-zero means. When the statistical distribution characterizing impact positions is known, but not jointly normal, the radial-integration estimator is superior. In this case, the median estimator also outperforms the Grubbs-Patnaik estimator but is not quite as good as the radial-integration estimator. If the statistical distribution characterizing impacts is unknown and not jointly normal, or if distribution parameters are difficult or impractical to estimate, or if test data is corrupted with outliers, then the median estimator dramatically outperforms the other estimators, especially in terms of estimation bias. Unexpectedly, measurement noise did not significantly degrade the performance of any of the estimators, except for cases with signal to noise ratios less than five. Although the Grubbs-Patnaik estimator has remained the gold standard for CEP estimation for over half a century, the performance assessments indicate the new, non-iterative, radial-integration estimator and the median estimator offer significant advantages and, in most practical real-world conditions, are superior estimators. These estimators are also useful for SEP estimation whereas the Grubbs-Patnaik estimator does not extend to three dimensions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Utilizing the maximum likelihood estimator for flow analysis

We explore the possibility of evaluating flow harmonics by employing the maximum likelihood estimator (MLE). For a given finite multiplicity, the MLE simultaneously furnishes estimations for all the parameters of the underlying distribution function while efficiently suppressing the variance of measures. Also, the method provides a means to assess a specific class of mixed harmonics, which is not straightforwardly feasible by the approaches primarily based on particle correlations. The results are analyzed using the Wald, likelihood ratio, and score tests of hypotheses. Besides, the resultant flow harmonics obtained using MLE are compared with those derived using particle correlations and event plane methods. Here, the dependencies of extracted flow harmonics on the multiplicity of individual events and the total number of events are analyzed. It is shown that the proposed approach works efficiently to deal with the deficiency in detector acceptability. Moreover, we elaborate on a fictitious scenario where the event plane is not a well-defined quantity in the distribution function. For the latter case, the MLE is shown to largely perform better than the two-particle correlation estimator. In this regard, one concludes that the MLE furnishes a meaningful alternative to the existing approaches for flow analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Sunyaev–Zel’Dovich Signal from Quasar Hosts: Implications for Detection of Quasar Feedback

Several analytic and numerical studies have indicated that the interstellar medium of a quasar host galaxy heated by feedback can contribute to a substantial secondary signal in the cosmic microwave background (CMB) through the thermal Sunyaev–Zel’dovich (SZ) effect. Recently, many groups have tried to detect this signal by cross-correlating CMB maps with quasar catalogs. Using a self-similar model for the gas in the intra-cluster medium and a realistic halo occupation distribution (HOD) prescription for quasars, we estimate the level of SZ signal from gravitational heating of quasar hosts. The bias in the host halo signal estimation due to an unconstrained high mass HOD tail and yet unknown redshift dependence of the quasar HOD restricts us from drawing any robust conclusions at low redshift ( z < 1.5) from our analysis. However, at higher redshifts ( z > 2.5), we find an excess signal in recent observations than what is predicted from our model. The excess signal could be potentially generated from additional heating due to quasar feedback.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Active operator learning with predictive uncertainty quantification for partial differential equations

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. Here, we propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Detecting Anomalies in Time Series Using Kernel Density Approaches

This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.

Frehner, Robin↗
DOE OSTI2023

Quantifying Uncertainty in Ice Particle Velocity–Dimension Relationships Using MC3E Observations

Abstract Ice particle terminal fall velocity ( V t ) is fundamental for determining microphysical processes, yet remains extremely challenging to measure. Current theoretical best estimates of V t are functions of Reynolds number. The Reynolds number is related to the Best number, which is a function of ice particle mass, area ratio ( A r ), and maximum dimension ( D max ). These estimates are not conducive for use in most models since model parameterizations often take the form , where ( α , β ) depend on habit and D max . A previously developed framework is used to determine surfaces of equally plausible ( α , β ) coefficients whereby ice particle size/shape distributions are combined with V t best estimates to determine mass- ( V M ) or reflectivity-weighted ( V Z ) velocities that closely match parameterized V M ,SD or V Z ,SD calculated using the ( α , β ) coefficients using two approaches. The first uses surfaces of equally plausible ( a , b ) coefficients describing mass ( M )–dimension relationships (i.e., ) to calculate mass- or reflectivity-weighted velocity from size/shape distributions that are then used to determine ( α , β ) coefficients. The second investigates how uncertainties in A r , D max , and size distribution N ( D ) affect V M or V Z . For seven of nine flight legs flown on 20 and 23 May 2011 during the Mesoscale Continental Convective Clouds Experiment (MC3E), uncertainty from natural parameter variability—namely, the variability in ice particle parameters in similar meteorological conditions—exceeds uncertainties arising from different A r assumptions or D max estimates. The combined uncertainty between A r , D max , and N ( D ) produced smaller variability in ( α , β ) compared to varying M ( D ), demonstrating M ( D ) must be accurately quantified for model fall velocities. Primary sources of uncertainty vary considerably depending on environmental conditions. Significance Statement Ice particle fall velocity is fundamental for numerous processes within clouds, and hence is a critical property that must be accurately represented in weather and climate models. Using aircraft observations of ice particle shapes and sizes obtained in clouds behind midlatitude thunderstorms, this work develops a new framework for estimating ice particle fall velocities and their uncertainty, including quantifying the importance of different uncertainty sources from cloud microphysics measurements. Natural parameter variability contributes the most uncertainty in ice particle fall velocity estimates, although other sources can also be important contributors to uncertainty in certain conditions. Additional work examining ice particle data is needed to further understand how dependent uncertainty in certain ice particle properties are to local environmental conditions.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Robust Resilient Signal Reconstruction under Adversarial Attacks

We consider the problem of signal reconstruction for a system under sparse signal corruption by a malicious agent. The reconstruction problem follows the standard error coding problem that has been studied extensively in the literature. We include a new challenge of robust estimation of the attack support. The problem is then cast as a constrained optimization problem merging promising techniques in the area of deep learning and estimation theory. A pruning algorithm is developed to reduce the "false positive" uncertainty of data-driven attack localization results, thereby improving the probability of correct signal reconstruction. Sufficient conditions for the correct reconstruction and the associated reconstruction error bounds are obtained for both exact and inexact attack support estimation. Moreover, a simulation of a water distribution system is presented to validate the proposed techniques.

Robust, Signal reconstruction, Resilient estimator↗
DOE OSTI2017

Chapter 21: Estimating Net Savings - Common Practices. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures

This chapter focuses on the methods used to estimate net energy savings in evaluation, measurement, and verification (EM and V) studies for energy efficiency (EE) programs. The chapter provides a definition of net savings, which remains an unsettled topic both within the EE evaluation community and across the broader public policy evaluation community, particularly in the context of attribution of savings to a program. The chapter differs from the measure-specific Uniform Methods Project (UMP) chapters in both its approach and work product. Unlike other UMP resources that provide recommended protocols for determining gross energy savings, this chapter describes and compares the current industry practices for determining net energy savings but does not prescribe methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

A Versatile and Accurate Method for Halo Mass Determination from Phase-space Distribution of Satellite Galaxies

We propose a versatile and accurate method to estimate the halo mass and concentration from the kinematics of satellite galaxies. We construct the 6D phase-space distribution function of satellites from a cosmological simulation based on the similarity of internal dynamics for different halos. Within the Bayesian statistical framework, not only can we efficiently infer the halo mass and concentration, we can also treat various observational effects, including the selection function, incomplete data, and measurement errors, in a rigorous and straightforward manner. Through tests with mock samples, we show that our method is valid and accurate, as well as more precise than pure steady-state methods. It can constrain the halo mass to within ~20% using only 20 tracers and has a small intrinsic uncertainty of ~10%. In addition to the clear application to the Milky Way and similar galaxies, our method can be extended to galaxy groups or clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Understanding Aitken Mode Aerosol Variability over the Southern Ocean and Antarctica: Insights from Cloud Condensation Nuclei Data

Aitken mode aerosol particles play an important role influencing cloud properties and sustenance, acting as a reservoir of potential cloud condensation nuclei against precipitation scavenging. However, there is limited data on Aitken mode aerosols. In this study, we develop a method to estimate Aitken mode aerosol concentrations and size distribution using cloud condensation nuclei measurements (CCN) and κ-Köhler theory. The performance of this method is evaluated using scanning mobility particle sizer (SMPS) data from recent field campaigns to demonstrate its skills and applicability. The method reasonably estimates Aitken- and accumulation-mode aerosol concentrations, achieving correlations of 0.7–0.9 with only modest biases (mean fractional bias within ±23% for Aitken mode and ±34% for accumulation-mode). This method is further applied to measurements collected over the Southern Ocean and Antarctica in recent years from multiple platforms, including ground sites, aircraft, and ships, to derive Aitken and accumulation-mode aerosol concentrations. Using the derived data, we examine the seasonal cycle, latitudinal variations, and vertical distribution of aerosols. Aitken mode aerosol concentrations are elevated over the Southern Ocean and Antarctica during the austral summer similar to the accumulation mode. In the austral summer, the free troposphere has more Aitken mode aerosols and fewer accumulation mode aerosols than the boundary layer, and thus likely serves as an important source of cloud-forming aerosol while also diluting the accumulation mode.

Kang, Litai [University of Washington] (ORCID:0000↗
DOE OSTI2020

A Comparison of DER Voltage Regulation Technologies Using Real-Time Simulations

Grid operators are now considering using distributed energy resources (DERs) to provide distribution voltage regulation rather than installing costly voltage regulation hardware. DER devices include multiple adjustable reactive power control functions, so grid operators have the difficult decision of selecting the best operating mode and settings for the DER. In this work, we develop a novel state estimation-based particle swarm optimization (PSO) for distribution voltage regulation using DER-reactive power setpoints and establish a methodology to validate and compare it against alternative DER control technologies (volt–VAR (VV), extremum seeking control (ESC)) in increasingly higher fidelity environments. Distribution system real-time simulations with virtualized and power hardware-in-the-loop (PHIL)-interfaced DER equipment were run to evaluate the implementations and select the best voltage regulation technique. Each method improved the distribution system voltage profile; VV did not reach the global optimum but the PSO and ESC methods optimized the reactive power contributions of multiple DER devices to approach the optimal solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Assessment of the Geomechanical Risks Associated with CO 2 Injection at the FutureGen 2.0 Site: Application of the State of Stress Assessment Tool (SOSAT)

This report presents the results of the application of the State of Stress Assessment Tool (SOSAT) on the FutureGen 2.0 data set. SOSAT was developed as part of the National Risk Assessment Partnership (NRAP) project and provides a unique integrated framework for estimating the state of stress probability distribution at a given depth in the subsurface and evaluating the risk of induced shear and tensile failure resulting from the injection of carbon dioxide (CO 2 ). The approach implemented by SOSAT is based on two deterministic and widely used methods of determining the state of stress (i.e., stress polygon and one-dimensional tectonic-elastic approach). These methods have been modified using a probabilistic approach to account for uncertainties in the input parameters. The methodology proposed in SOSAT was demonstrated using the data obtained for the FutureGen 2.0 project located in the Illinois Basin. Although the FutureGen 2.0 project was suspended by the U.S. Department of Energy prior to the start of injection operations, the extensive characterization efforts undertaken at the storage site have yielded a considerable amount of valuable data about this part of the sedimentary basin. The FutureGen 2.0 storage site was designed to accommodate the injection of 1.1 million metric tons of CO 2 per year over a 20-year period. The injection of CO 2 and the associated pressure buildup in the reservoir is expected to alter the state of stress over the course of the injection. These changes in the initial stress state may affect fault stability and potentially lead to the unintentional creation of hydraulic fractures, which could pose a leakage risk if not contained within the reservoir. Assessing these risks is critical to making informed decisions about the characterization, management of the injection operation, and monitoring of the storage site. The data required by SOSAT for the geomechanical assessment of the FutureGen 2.0 site were identified, and the methodology proposed in SOSAT was followed to evaluate the probability of reactivating critically oriented faults or potentially creating hydraulic fractures in the reservoir. The results of the geomechanical analysis performed using the SOSAT led to the following conclusions. 1. The probability distribution of the state of stress indicates significant uncertainties in the magnitude of the maximum horizontal stress S Hmax , while the minimum horizontal stress S hmin is well constrained by the stress measurements conducted during the characterization efforts at the storage site. This uncertainty in the magnitude of S Hmax is a common challenge and has significant implications for geomechanical risk at sites like FutureGen 2.0 where a strike-slip tectonic regime exists. 2. The probability that the Mount Simon reservoir was initially critically stressed is relatively high—25%. When the pore pressure increases to the maximum allowable pressure permitted under the Underground Injection Control Class VI regulation of the FutureGen 2.0 project, the risk of shear failure approaches a probability of 43%. These relatively high probabilities reflect the current state of information about the geomechanical conditions in this part of the Illinois Basin. For future operations in this basin this should be a high characterization priority because it could significantly lower the risk of operations. 3. Based on the maximum injection pressure allowed in the UIC Class VI, the risk of unintentional hydraulic fracturing is limited. The risk of shear failure as determined by SOSAT is based on a very conservative approach assuming that critically oriented faults exist in the subsurface. While no faults have been formally identified at the FutureGen 2.0 site, the results obtained with SOSAT using the FutureGen 2.0 data set highlight the importance of integrating uncertainties in critical parameters to quantify geomechanical risks in a defensible way. Should SOSAT have been available at the time the characterization activities were being planned, more characterization efforts would have been implemented to reduce the uncertainties on the magnitude of the maximum horizontal stress, and to dismiss with confidence the potential existence of a critically-oriented fault in the reservoir (e.g., 3D seismic survey).

54 ENVIRONMENTAL SCIENCES↗