Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Characterization of Partially Observed Epidemics - Application to COVID-19

This report documents a statistical method for the "real-time" characterization of partially observed epidemics. Observations consist of daily counts of symptomatic patients, diagnosed with the disease. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information for the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and is predicated on a model for the distribution of the incubation period. The model parameters are estimated as distributions using a Markov Chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. The method is applied to the COVID-19 pandemic of 2020, using data at the country, provincial (e.g., states) and regional (e.g. county) levels. The epidemiological model includes a stochastic component due to uncertainties in the incubation period. This model-form uncertainty is accommodated by a pseudo-marginal Metropolis-Hastings MCMC sampler, which produces posterior distributions that reflect this uncertainty. We approximate the discrepancy between the data and the epidemiological model using Gaussian and negative binomial error models; the latter was motivated by the over-dispersed count data. For small daily counts we find the performance of the calibrated models to be similar for the two error models. For large daily counts the negative-binomial approximation is numerically unstable unlike the Gaussian error model. Application of the model at the country level (for the United States, Germany, Italy, etc.) generally provided accurate forecasts, as the data consisted of large counts which suppressed the day-to-day variations in the observations. Further, the bulk of the data is sourced over the duration before the relaxation of the curbs on population mixing, and is not confounded by any discernible country-wide second wave of infections. At the state-level, where reporting was poor or which evinced few infections (e.g., New Mexico), the variance in the data posed some, though not insurmountable, difficulties, and forecasts were able to capture the data with large uncertainty bounds. The method was found to be sufficiently sensitive to discern the flattening of the infection and epidemic curve due to shelter-in-place orders after around 90% quantile for the incubation distribution (about 10 days for COVID-19). The proposed model was also used at a regional level to compare the forecasts for the central and north-west regions of New Mexico. Modeling the data for these regions illustrated different disease spread dynamics captured by the model. While in the central region the daily counts peaked in the late April, in the north-west region the ramp-up continued for approximately three more weeks.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

High Time Resolution Modelled and Measured New Particle Formation Rates During the 2023 Pittsburgh, PA Campaign

Particle size distributions are used to calculate nucleation rates during new particle formation (NPF). However, the low time resolution and poor sensitivity of instruments deployed to observe particle size distributions can lead to inaccurate estimates of nucleation rates. We calculated nucleation rates in Pittsburgh, PA from particle size distributions measured with the new high time resolution Condensation Particle Counters For Atmospheric Rapid Measurements (CPC FARM) and from gas precursor concentrations measured with a chemical ionization mass spectrometer. The CPC FARM nucleation rates were calculated by examining the appearance rate of particles in the smallest size bin at 1.6 nm. The nucleation rate of 1.6 nm determined every second resulted in positive and negative rates, indicating the influence of inhomogeneous mixing and advection of precursor gases and clusters. These effects are not currently considered when estimating nucleation rates from measurements. The nucleation rates from the CPC FARM were compared to the nucleation rates determined from a transient acid‐base reaction model using measured sulfuric acid concentration, strong base concentrations, and CPC detection efficiencies. The transient form of the model allowed the advection of heterogeneously mixed precursors to influence the nucleation rate. Good agreement between particle and gas‐based nucleation rates is observed during sulfuric acid‐driven NPF events. This study demonstrates that high time resolution measurements of short‐lived and rapidly formed particles are needed to accurately capture nucleation rates, which are likely influenced by advection of nucleation precursors and clusters in heterogeneous environments such as urban areas.

Cheng, D. [Carnegie Mellon Univ., Pittsburgh, PA (↗
DOE OSTI2022

Aggregation bias and its drivers in large‐scale flood loss estimation: A Massachusetts case study

Abstract Large‐scale estimations of flood losses are often based on spatially aggregated inputs. This makes risk assessments vulnerable to aggregation bias, a well‐studied, sometimes substantial outcome in analyses that model fine‐grained spatial phenomena at coarse spatial units. To evaluate this potential in the context of large‐scale flood risk assessments, we use data from a high‐resolution flood hazard model and structure inventory for over 1.3 million properties in Massachusetts and examine how prominent data aggregation approaches affect the magnitude and spatial distribution of flood loss estimates. All considered aggregation approaches rely on aggregate structure inventories but differ in whether flood hazard is also aggregated. We find that aggregating only structure inventories slightly underestimates overall losses (−10% bias), and when flood hazard data is spatially aggregated to even relatively small spatial units (census block), statewide aggregation bias can reach +366%. All aggregation‐based procedures fail to capture the spatial covariation of inputs distributions in the upper tails that disproportionately generate total expected losses. Our findings are robust to several key assumptions, add important context to published risk assessments and highlight opportunities to improve flood loss estimation uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Distributionally Robust Resilience Enhancement Strategy for Distribution Networks Considering Decision-Dependent Contingencies

When performing the resilience enhancement for distribution networks, there are two obstacles to reliably model the uncertain contingencies: 1) decision-dependent uncertainty (DDU) due to various line hardening decisions, and 2) distributional ambiguity due to limited outage information during extreme weather events (EWEs). Here, to address these two challenges, this paper develops scenario-wise decision-dependent ambiguity sets (SWDD-ASs), where the DDU and distributional ambiguity inherent in EWE-induced contingencies are simultaneously captured for each possible EWE scenario. Then, a two-stage tri-level decision-dependent distributionally robust resilient enhancement (DD-DRRE) model is formulated, whose outputs include the optimal line hardening, distributed generation (DG) allocation, and proactive network reconfiguration strategy under the worst-case distributions in SWDD-ASs. Subsequently, the DD-DRRE model is equivalently recast to a mixed-integer linear programming (MILP)-based master problem and multiple scenario-wise subproblems, facilitating the adoption of a customized column-and-constraint generation (C&CG) algorithm. Finally, case studies demonstrate a remarkable improvement in the out-of-sample performance of our model, compared to its prevailing stochastic and robust counterparts. Moreover, the potential values of incorporating the ambiguity and distributional information are quantitatively estimated, providing a useful reference for planners with different budgets and risk-aversion levels.

decision-dependent uncertainty↗
DOE OSTI2026

Evaluating the Collision‐Coalescence Process in Idealized Cloud Convection Using Large‐Eddy Simulations With Lagrangian Microphysics

Drizzle initiation through the collision and coalescence of cloud droplets plays a crucial role in warm cloud precipitation. Recent theoretical studies suggest that the influence of collisional growth on the droplet size distribution can be quantified by a non-dimensional drizzle number (Dz). Here, large-eddy simulations with Lagrangian microphysics are employed to evaluate the theory by simulating a tall convection-cloud chamber under various conditions. Results show that the smaller the Dz, the larger the impact of collisions on the right tail of the droplet size distribution, consistent with the theory. The simulations confirm that the collision rate can be estimated from the droplet size distribution interacting only with cloud droplets of the same size at the mode radius. This suggests that the idealized theory can be a useful tool to design a cloud chamber for drizzle investigation, as well as to represent drizzle formation in models of real atmospheric clouds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Comparative Analysis of Imaging and Measurements of Micrometer-Scale Fracture Aperture Fields Within a Heterogeneous Rock Using PET and X-ray CT

Knowledge of the spatial distribution of fracture apertures is essential for reliable characterization of flow and transport processes in fractured systems and for better understanding of physicochemical matrix–fracture interactions. Here, we propose and test two image-based methods, thereby extending the current experimental capabilities to characterize aperture size distribution in structurally heterogeneous geologic porous media noninvasively. The first approach utilizes an inversion method based on the dataset acquired from positron emission tomography (PET) and the second approach considers an extension of the classic missing attenuation technique that relies on clinical X-ray computed tomography (X-ray CT). Independent sets of imaging experiments are conducted on a fractured basalt core with heterogeneous matrix properties and aperture distributions to compare the two methodologies. A repeat of each experiment is conducted to verify the proposed workflows. The performance of these two imaging techniques is systematically evaluated through the analysis of signal-to-noise ratio, minimum fracture size detectability, and measurement errors. While both approaches provide a reliable estimation of fracture aperture distributions, PET yields a signal-to-noise ratio that is substantially higher than the corresponding X-ray CT measurements. Furthermore, uncertainties of the aperture values for PET are considerably lower ($\bar {\sigma}_{\text {d}} = 15\%$) compared to those obtained from X-ray CT ($\bar {\sigma}_{\text {d}} = 29\%$), allowing for the detection of minimum aperture sizes of 20 $\mu$m with 70% confidence level. Finally, these approaches provide key experimental tools for better understanding dynamic hydromechanical fracture properties in geologic systems.

58 GEOSCIENCES↗
DOE OSTI2019

Dynamic Power Network State Estimation with Asynchronous Measurements: Preprint

The operation of distribution networks is becoming increasingly volatile, due to fast variations of renewables and, hence, net-loading conditions. To perform a reliable state estimation under these conditions, this paper considers the case where measurements from meters, phasor measurement units, and distributed energy resources are collected and processed in real time to produce estimates of the state at a fast time scale. Streams of measurements collected in real time and at heterogenous rates render the underlying processing asynchronous, and poses severe strains on workhorse state estimation algorithms. In this work, a real-time state estimation algorithm is proposed, where data are processed on the fly. Starting from a regularized least-squares model, and leveraging appropriate linear models, the proposed scheme boils down to a linear dynamical system where the state is updated based on the previous estimate and on the measurement gathered from a few available sensors. The estimation error is shown to be always bounded under mild condition. Numerical simulations are provided to corroborate the analytical findings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

AutoEnRichness: A hybrid empirical and analytical approach for estimating the richness of galaxy clusters

ABSTRACT We introduce AutoEnRichness, a hybrid approach that combines empirical and analytical strategies to determine the richness of galaxy clusters (in the redshift range of 0.1 ≤ z ≤ 0.35) using photometry data from the Sloan Digital Sky Survey Data Release 16, where cluster richness can be used as a proxy for cluster mass. In order to reliably estimate cluster richness, it is vital that the background subtraction is as accurate as possible when distinguishing cluster and field galaxies to mitigate severe contamination. AutoEnRichness is comprised of a multistage machine learning algorithm that performs background subtraction of interloping field galaxies along the cluster line of sight and a conventional luminosity distribution fitting approach that estimates cluster richness based only on the number of galaxies within a magnitude range and search area. In this proof-of-concept study, we obtain a balanced accuracy of 83.20 per cent when distinguishing between cluster and field galaxies as well as a median absolute percentage error of 33.50 per cent between our estimated cluster richnesses and known cluster richnesses within r200. In the future, we aim for AutoEnRichness to be applied on upcoming large-scale optical surveys, such as the Legacy Survey of Space and Time and Euclid, to estimate the richness of a large sample of galaxy groups and clusters from across the halo mass function. This would advance our overall understanding of galaxy evolution within overdense environments as well as enable cosmological parameters to be further constrained.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Revealing the Statistics of Extreme Events Hidden in Short Weather Forecast Data

Extreme weather events have significant consequences, dominating the impact of climate on society. While high-resolution weather models can forecast many types of extreme events on synoptic timescales, long-term climatological risk assessment is an altogether different problem. A once-in-a-century event takes, on average, 100 years of simulation time to appear just once, far beyond the typical integration length of a weather forecast model. Therefore, this task is left to cheaper, but less accurate, low-resolution or statistical models. But there is untapped potential in weather model output: despite being short in duration, weather forecast ensembles are produced multiple times a week. Integrations are launched with independent perturbations, causing them to spread apart over time and broadly sample phase space. Collectively, these integrations add up to thousands of years of data. We establish methods to extract climatological information from these short weather simulations. Using ensemble hindcasts by the European Center for Medium-range Weather Forecasting archived in the subseasonal-to-seasonal (S2S) database, we characterize sudden stratospheric warming (SSW) events with multi-centennial return times. Consistent results are found between alternative methods, including basic counting strategies and Markov state modeling. By carefully combining trajectories together, we obtain estimates of SSW frequencies and their seasonal distributions that are consistent with reanalysis-derived estimates for moderately rare events, but with much tighter uncertainty bounds, and which can be extended to events of unprecedented severity that have not yet been observed historically. These methods hold potential for assessing extreme events throughout the climate system, beyond this example of stratospheric extremes.

58 GEOSCIENCES↗
DOE OSTI2023

Plasma-parameter dependence of ro-vibrational temperatures for H 2 in LHD divertor

We analyzed a thousand visible spectra of Fulcher-α band measured for divertor plasmas in Large Helical Device. With a coronal model and Bayesian inference, the population distribution of hydrogen molecule in the electronic ground state was estimated. The non-thermal population distribution was recovered with a two-temperature model, which has two sets of rotational and vibrational temperatures, as well as their mixture coefficient. The lower rotational temperature significantly changes according to the plasma parameters. Its nearly linear dependence on the electron density was found, which is consistent with previous works. The lower vibrational temperature also shows a small density dependence, as reported by a previous work. On the other hand, the higher rotational and vibrational temperatures as well as the mixture coefficient only show slight changes over the broad range of plasma parameters. These population parameters show a significant correlation; with higher electron density, all the temperatures and the fraction of the higher-temperature component increase simultaneously. In conclusion, this suggests that the electron impact plays an important role to determine the population distribution.

42 ENGINEERING↗
DOE OSTI2023

Determination of aquatic hazard concentrations for the oil spill response product class of surface washing agents using species sensitivity distributions

Surface washing agents (SWAs) are a diverse class of oil spill response products intended to facilitate removal of stranded oil from shorelines. This class of agents has high application rates relative to other categories of spill response products, but global toxicity data is generally limited to two standard test species: inland silverside and mysid shrimp. Here, in this study, we provide a framework to maximize the utility of limited toxicity data across a product class. To characterize species sensitivity to SWAs, the toxicity of three agents spanning a range of chemical and physical properties were tested in eight species. The relative sensitivity of mysids shrimp and inland silversides as surrogate test organisms was determined. Toxicity normalized species sensitivity distributions (SSDn) were used to estimate fifth centile hazard concentration (HC5) values for SWAs with limited toxicity data. Chemical toxicity distributions (CTD) of SWA HC5 values were used to compute a fifth centile chemical hazard distribution (HD5) to provide a more comprehensive assessment of hazard across a spill response product class with limited toxicity data than traditional single species or single agent approaches can give.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2025

The Poisson tensor completion non-parametric differential entropy estimator

We introduce the Poisson tensor completion (PTC) estimator, a non-parametric differential entropy estimator. The PTC estimator leverages inter-sample relationships to compute a low-rank Poisson tensor decomposition of the frequency histogram. Our crucial observation is that the histogram bins are an instance of a space partitioning of counts and thus can be identified with a spatial Poisson process. The Poisson tensor decomposition leads to a completion of the intensity measure over all bins—including those containing few to no samples—and leads to our proposed PTC differential entropy estimator. A Poisson tensor decomposition models the underlying distribution of the count data and guarantees non-negative estimated values and so can be safely used directly in entropy estimation. Our estimator is the first tensor-based estimator that exploits the underlying spatial Poisson process related to the histogram explicitly when estimating the probability density with low-rank tensor decompositions for the purpose of tensor completion. Furthermore, we demonstrate that our PTC estimator is a substantial improvement over standard histogram-based estimators for sub-Gaussian probability distributions because of the concentration of norm phenomenon.

42 ENGINEERING↗
DOE OSTI2021

Tractable Learning in Underexcited Power Grids

Estimating the structure of physical flow networks, such as power grids, is critical to secure delivery of energy. This article discusses statistical structure estimation in power grids in the “underexcited” regime, where a subset of internal nodes has zero injection fluctuations. Prior estimation algorithms based on nodal voltages fail for such grids as the voltage covariance matrix is not invertible. Here, we propose a novel topology learning algorithm for learning underexcited general networks. Our algorithm uses physics-informed conservation laws to first identify the zero-injection buses and their neighbors, and then estimates the remaining edges in the grid. We prove the asymptotic correctness of our algorithm for grids with nonadjacent internal zero-injection nodes. More important, we theoretically analyze our algorithm’s efficacy under noisy measurements, and determine bounds on maximum noise under which asymptotically correct recovery is guaranteed. Our approach is validated through simulations with voltage samples generated on test distribution grids with real injection data and nonlinear power flow models.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning

We reconstruct the extra-galactic gamma-ray source-count distribution, or dN/dS, of resolved and unresolved sources by adopting machine learning techniques. Specifically, we train a convolutional neural network on synthetic 2-dimensional sky-maps, which are built by varying parameters of underlying source-counts models and incorporate the Fermi-LAT instrumental response functions. The trained neural network is then applied to the Fermi-LAT data, from which we estimate the source count distribution down to flux levels a factor of 50 below the Fermi-LAT threshold. We perform our analysis using 14 years of data collected in the (1,10) GeV energy range. The results we obtain show a source count distribution which, in the resolved regime, is in excellent agreement with the one derived from cataloged sources, and then extends as dN/dS ~ S -2 in the unresolved regime, down to fluxes of 5 · 10 -12 cm -2 s -1 . The neural network architecture and the devised methodology have the flexibility to enable future analyses to study the energy dependence of the source-count distribution.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Scaled Implementation of Smart Charge Management for Electric Vehicles

Smart charge management (SCM) has become a critical strategy for mitigating potential grid impacts and reducing electricity costs for all customers. This study will evaluate the economics of implementing light-duty EV SCM at scale across the United States. This work will enhance distribution system analysis by estimating SCM implementation costs, exploring viable business cases, and developing a framework for national-level applications. The primary methodology involves leveraging detailed grid modeling from a specific service territory and using spatial extrapolation techniques to generalize findings to other regions. The analysis will develop key metrics to quantify the costs and benefits of SCM, including implementation costs relative to strategy and scale, the cost of distribution system upgrades with and without SCM, and the percentage of peak-load reduction. The objective is to produce a comprehensive report and a parameterized framework that enables utilities to self-assess the value of SCM in their own service territories. This will support the development of cost-effective charging strategies, accelerate the energization of new EV chargers, and facilitate the seamless integration of EVs into the nation's power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

DSO+T: Valuation Methodology and Economic Metrics (DSO+T Study: Volume 4)

This report summarizes a rigorous valuation analysis methodology used by the Distribution System Operator with Transactive (DSO+T) study to estimate the financial benefits and costs of adopting Transactive Energy coordination of distributed energy resources for key stakeholders (for example distribution system operators and customers). This was achieved by modeling the value exchanges between stakeholders and determining the annualized costs and revenues experienced by stakeholders, enabling the evaluation of overall impact on stakeholder’s annualized cash flow. Extensive work was conducted developing methods to estimate the operating costs of distribution system operators at a level of granularity that would allow the financial impact of implementing a transactive energy approach to be estimated. This work included developing parametric models for labor and software costs, distribution system capital and maintenance costs, growth rates, and factors to determine annualized costs of capital investments. Simulation results were used to calculate wholesale energy costs and revenues from retail sales. Valuation analysis methods were also developed for other stakeholders including customers, the transmission system operator, independent system operator, and generators. The resulting capability allows a complete mapping of the flow of financial value between stakeholders that can be directly integrated with the results of demand flexibility simulations. Example results are provided for a business-as-usual case and compared to a transactive energy case as well as to actual cost data.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Estimating the Contributions to Human Error Probability from the Convolution of the Distribution of Time Available and Time Required

As part of their duties, Human Reliability Analysis must often evaluate if crews in nuclear power plants (NPPs) can complete tasks associated with a human-failure event within time limits. For example, the time required in NPP scenarios is determined by systematic and structured walkthroughs, feasibility studies, recorded times from training exercises, and interviews with experienced operators and experts. Typically, a point estimate is derived for the estimate (mean, maximum, or 95th percentile of time required). Using point-estimate values can mask the risk associated with variability among crews, plant conditions and set-up, environmental conditions, and other impact factors under which these actions are executed. While point estimates for time required and time available have served the industry well, without considering the uncertainty they could lead to biased understanding about the risk. The Integrated Human Event Analysis System - General Methodology (IDHEAS-G) model (developed by the US Nuclear Regulatory Commission, NRC) for human error probability calculates human error probability by summing two probabilities: insufficient time and cognitive error. As such, the model takes a more holistic approach by considering the full distributions for time required and time available to calculate the human error probability because the time available to complete the task is insufficient. In this study, we expand on the work of the NRC and discuss methods for estimating these time considerations. For example, for the time required, the impact of Performance Influencing Factors (PIFs) on the distribution was divided into impacts that are aleatory in nature, such as crew-to-crew variability, and those that are epistemic (i.e., the PIFs). Starting with the factors that introduce aleatory uncertainty, a first-order distribution was developed from a large set of time required (i.e., NPP task completion times) data for the range of operator actions that occur in the NPP control room under simulated accident conditions. The first-order distribution can then be adjusted to account for epistemic uncertainty using research associated with the impact of applicable PIFs on the time required. We also develop guidance for analysts to address the probability distributions for the time available. The guidance we developed on how to estimate time required and time available distributions is based on the identification of pertinent research and data, data analyses, and expert knowledge elicitation.

human error probability, human performance, time e↗
DOE OSTI2020

Recent Development of Frequency Estimation Methods for Future Smart Grid

The frequency estimated by the Phasor Measurement Unit (PMU) is a critical index of power system status and supports many smart grid applications. The future smart grid features high penetration of renewables and more fast-moving power electronics inverters but raises challenges to the reliable frequency estimation. This article presents three methods to address these challenges. First, an enhanced zero-crossing algorithm was developed to track the fast-changing frequency in system dynamics. Second, we propose a technology that can tolerate the system transient and suppress the outliers. Third, an algorithm was developed to export high time-resolution frequency estimations with minimum computational effort. All of the proposed methods are realized in hardware and compared with classical frequency estimation methods. The testing results indicate that the proposed methods have excellent performance. They can be used in future PMUs and provide reliable and high time resolution data for smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗