Results for “PROBABILISTIC ESTIMATION” — Page 4

DOE OSTI2024

Analytic Neural Network Gaussian Process Enabled Chance-Constrained Voltage Regulation for Active Distribution Systems with PVs, Batteries and EVs

This paper proposes an analytic neural network Gaussian process (NNGP)-based chance-constrained real-time voltage regulation method for active distribution systems with photovoltaics (PVs), batteries, and electric vehicles (EVs). NNGP can utilize historical measurement data to achieve real-time probabilistic node voltage estimation through Bayesian inference. Then, NNGP is fully analytically embedded into the optimal power flow model to perform voltage regulation and adapt to various topological changes. The uncertainties of voltage estimations are easily considered via the chance constraint, and it has been shown that the adoption of this chance constraint can significantly improve the reliability of voltage regulation under various scenarios. The comparison results with other methods, carried out on a real 759-node distribution system located in western Colorado, U.S., show that the proposed method can achieve accurate voltage estimation across different topologies and reliably perform voltage regulation considering PVs, batteries, and EVs.

active distribution systems↗

DOE OSTI2024

Probabilistic Analysis of Long-Term Degradation of Microwave Cavity Flow Sensor

We are investigating a microwave resonant cavity transducer for flow sensing in the vessel of a high temperature fluid advanced reactor (AR), such as a molten salt cooled reactor (MSCR) or a sodium fast reactor (SFR). This transducer is a hollow metallic cylindrical cavity, with the flat wall of the cylinder flexible enough to undergo microscopic deflection due to dynamic fluid pressure. Membrane deflection leads to a shift in the resonant frequency, which can be detected with a spectrum analyzer. We have performed a proof-of-concept experiment of flow sensing with the transducer in liquid sodium at 340°C in impinging liquid jet geometry. The transducer remained in liquid sodium for 70 days. After removal, no structural damage was observed, and the expected transducer response was verified in a water test. Because long-term (multi-year) experimental tests of transducer resilience to harsh environment are not practical, we have developed a probabilistic model of creep to estimate transducer resilience to the harsh environment. The probabilistic model considers diffusion creep under the condition of high temperature and low stress, where the stress and temperature are allowed to be random variables with Gaussian distributions. Using the probabilistic model, we estimate inelastic membrane deflections due to creep for several temperature ranges. We conclude that for temperatures less than 650°C, creep has negligible long-term effect on the transducer performance. Since a yellowish residue was observed on the transducer surface after 70 days of immersion in liquid sodium, we have investigated possible evidence of corrosion. Chromium depletion is a typical indicator of the corrosion process in stainless steel. Scraping off a residue from the transducer and performing scanning electron microscopy (SEM) with energy dispersive analysis (EDS) did not find any chromium in the residue. Approximately 60% of the residue consisted of copper, which can be attributed to contamination of sodium due to powder residue from machining of copper and brass components of the transducer.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Final Report on Development of Microwave Resonant Cavity Transducer for Fluid Flow Sensing: Development of Microwave Cavity Flow Meter for Advanced Reactor High Temperature Fluids

We are investigating a microwave resonant cavity transducer for flow sensing in the vessel of a high temperature fluid advanced reactor (AR), such as a molten salt cooled reactor (MSCR) or a sodium fast reactor (SFR). This transducer is a hollow metallic cylindrical cavity, with one of the flat walls of the cylinder flexible enough to undergo microscopic deflection due to dynamic fluid pressure. Membrane deflection leads to a shift in the microwave resonant frequency, which can be detected with a spectrum analyzer. We have developed a continuum electromechanics model of the microwave resonant cavity transducer performance. The deflection of the membrane is calculated using equations from the theory of plates and shells for deflection of radially constrained thin circular disk under uniform load. The microwave frequency shift is calculated using the equations from the microwave cavity perturbation theory. The transducer model was validated with proof-of-concept experimental data of water flow sensing with a Brass 360 right circular cylinder with 22.2mm diameter and 203µm thick wall. The cavity was excited through a subwavelength hole in TE 011 mode with resonant frequency f ≈ 17.8GHz. Subsequently, we have performed a preliminary proof-of-principle test of flow sensing in high temperature liquid sodium in environment. For this test, we have developed a cylindrical resonator with the same dimensions as for the Brass 360 cavity. The resonator for high temperature liquid sodium test was machined from stainless steel 316 and electroplated with silver on the interior surfaces. We have also developed and insertion probe consisting of a 50cm WR-42 brass waveguide enclosed in a protective SS316 tube. The cavity was excited through a subwavelength hole on the side of the wall of the cylinder in the TE 011 mode with resonant frequency f ≈ 17.8GHz. The liquid sodium setup consists of a cylindrical vessel with a center feed line, where a transducer inserted through the top cap of the vessel measures velocity of the impinging liquid jet. The sodium flow sensing study was performed in a liquid sodium vessel at 340°C temperature and ambient pressure. The flow rate was changed by varying sodium pump power, and a frequency shift of several hundred kHz was observed. The transducer was removed after 70 days of testing. No visual damage was observed, and the electromagnetic response remained the same. As a calibration experiment, we have assembled a water vessel with a center feed, and with dimensions similar to those of the liquid sodium setup. Water flow sensing was performed before and after liquid sodium test. The responses in both cases are similar and agree with COMSOL computer simulations. Because long-term (multi-year) experimental tests of transducer resilience to harsh environment are not practical, we have developed a probabilistic model of creep to estimate transducer resilience to the harsh environment. The probabilistic model considers diffusion creep under the condition of high temperature and low stress, where the stress and temperature are allowed to be random variables with Gaussian distributions. Using the probabilistic model, we estimate inelastic membrane deflections due to creep for several temperature ranges. We conclude that for temperatures less than 650°C, creep has negligible long-term effect on the transducer performance.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation: Preprint

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

Bayesian structural time series↗

DOE OSTI2022

A reforecasting-based dynamic reserve estimation for variable renewable generation and demand uncertainty

The installed capacity of renewables-based energy sources has been increasing in traditional power systems. In order to accommodate the increased variability and uncertainty associated with the deeper penetration of renewable sources like solar and wind, adjusted amounts of dynamic reserve are needed. Although probabilistic dynamic reserve estimation methods have been previously developed, most of them consider the uncertainty to be represented by parametric density functions that tend to perform poorly under extreme events and, moreover, neglect uncertainty introduced by the forecasting model itself. Toward addressing these limitations, this work presents, for the first time, a dynamic reserve estimation method for flexibility that incorporates nonparametric density estimation and a machine learning based reforecasting to provide a day-ahead prediction of the mean and spread of uncertainty around the base forecast. The prediction is, in turn, used to estimate the up and down reserve relative to the base forecast. Here, the present method takes various endogenous and exogenous features, including the calendar variables, as input to estimate the day-ahead reserve. Using a combination of reforecasting and dynamic reserve estimation techniques, the method is shown to adjust better to the dynamic nature of reserve requirements providing only what is needed to accommodate the expected deviations. Considering California Independent System Operator (CAISO) solar, wind and load data over an 18 month period, up to 67% reduction in the amount of reserve capacity needed for a one day reserve and reserve penalty for solar uncertainty is demonstrated. Additionally, the risk of reserve insufficiency in meeting the net demand is reduced by 20% with the proposed method.

14 SOLAR ENERGY↗

DOE OSTI2021

Probabilistic Assessment and Uncertainty Analysis of CO2 Storage Capacity of the Morrow B Sandstone—Farnsworth Field Unit

This paper presents probabilistic methods to estimate the quantity of carbon dioxide (CO2) that can be stored in a mature oil reservoir and analyzes the uncertainties associated with the estimation. This work uses data from the Farnsworth Field Unit (FWU), Ochiltree County, Texas, which is currently undergoing a tertiary recovery process. The input parameters are determined from seismic, core, and fluid analyses. The results of the estimation of the CO2 storage capacity of the reservoir are presented with both expectation curve and log probability plot. The expectation curve provides a range of possible outcomes such as the P90, P50, and P10. The deterministic value is calculated as the statistical mean of the storage capacity. The coefficient of variation and the uncertainty index, P10/P90, is used to analyze the overall uncertainty of the estimations. A relative impact plot is developed to analyze the sensitivity of the input parameters towards the total uncertainty and compared with Monte Carlo. In comparison to the Monte Carlo method, the results are practically the same. The probabilistic technique presented in this paper can be applied in different geological settings as well as other engineering applications.

03 NATURAL GAS↗

DOE OSTI2021

Convex Optimization of Integrated Power-Gas Energy Flow Model With Applications to Probabilistic Energy Flow

Energy flow calculation is a fundamental problem of the integrated power and gas system (IPGS) operation and planning. However, the nonlinear gas flow model introduces major challenges to the energy flow calculation. In this paper, we propose a tractably convex optimization model to solve the energy flow problem in IPGSs. It is demonstrated that the proposed optimization model has the same optimal solution as the original nonlinear steady energy flow model. Also, piecewise linearization is adopted to tightly linearize the nonlinear objective function of the model, which transforms the formulated convex optimization into a linear program one. Thus, the computation complexity of the proposed energy flow model is significantly reduced as compared with the existing methods. In addition, the proposed model can be extended to probabilistic energy flow estimation. Extensive case studies are conducted to validate the effectiveness of the proposed energy flow model using three IPGSs.

42 ENGINEERING↗

DOE OSTI2023

Managing Uncertainty and Flexibility in Day-Ahead Electricity Markets

Net load imbalances from day ahead forecasts can lead to significant grid operations costs and are expected to increase as variable renewable energy adoption grows. We propose a new wholesale market product to manage the risk of net load imbalances called Flexibility Options. This product relies on probabilistic forecasts to estimate flexibility demand and would be co-optimized in the day-ahead market. We also propose stochastic methods that enable DER and flexible load aggregators to participate in flexibility markets while considering the uncertainty in weather and occupant behavior.

day-ahead market↗

DOE OSTI2026

Re-evaluating probable maximum precipitation estimates: sensitivity to transposition domains and storm rotation using modern datasets

This study examines the sensitivity of Probable Maximum Precipitation (PMP) estimates to key methodological decisions embedded in the legacy approach adopted in the U.S. National Weather Service Hydrometeorological Reports No. 51 and No. 52. Although widely used for infrastructure design and risk regulation, fundamental aspects of PMP estimation—such as storm sample size, transposition domain, maximization procedures, and storm rotation—remain poorly constrained and lack formal guidance. Using the Red Rock watershed in Iowa as a case study, and leveraging the 2002–2023 NOAA Analysis of Record for Calibration (AORC) precipitation dataset, we systematically evaluate how each methodological choice, individually and in combination, influences PMP estimates. Our findings demonstrate that PMP is not a fixed physical upper bound but rather a modeling construct shaped heavily by user-defined assumptions. Notably, PMP values derived from modern gridded rainfall datasets can be substantially higher than the legacy estimate used in the original spillway design for Red Rock Dam. Decisions regarding storm sample size, domain extent, climatological window, and particularly storm rotation all contributed to higher PMP estimates. Storm rotation alone—a loosely constrained element in the current PMP practice—can amplify PMP by more than 25%. These results reveal the lack of standardized bounds in current PMP workflows and the need for systematic sensitivity and uncertainty analysis. As PMP estimation shifts toward probabilistic approaches, incorporating physically meaningful storm attributes will be key to developing more transparent, defensible methods for dam safety and climate-resilient infrastructure.

Probable maximum precipitation↗

DOE OSTI2020

Optimizing High Performance Markov Clustering for Pre-Exascale Architectures

HipMCL is a high-performance distributed memory implementation of the popular Markov Cluster Algorithm (MCL) and can cluster large-scale networks within hours using a few thousand CPU-equipped nodes. It relies on sparse matrix computations and heavily makes use of the sparse matrix-sparse matrix multiplication kernel (SpGEMM). The existing parallel algorithms in HipMCL are not scalable to Exascale architectures, both due to their communication costs dominating the runtime at large concurrencies and also due to their inability to take advantage of accelerators that are increasingly popular. In this work, we systematically remove scalability and performance bottlenecks of HipMCL. We enable GPUs by performing the expensive expansion phase of the MCL algorithm on GPU. Additionally, we propose a CPU-GPU joint distributed SpGEMM algorithm called pipelined Sparse SUMMA and integrate a probabilistic memory requirement estimator that is fast and accurate. Furthermore, we develop a new merging algorithm for the incremental processing of partial results produced by the GPUs, which improves the overlap efficiency and the peak memory usage. We also integrate a recent and faster algorithm for performing SpGEMM on CPUs. We validate our new algorithms and optimizations with extensive evaluations. With the enabling of the GPUs and integration of new algorithms, HipMCL is up to 12.4x faster, being able to cluster a network with 70 million proteins and 68 billion connections just under 15 minutes using 1024 nodes of ORNL's Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Feedbackless Relaying for Enhancing Reliability of Connected Vehicles

Not provided.

Engineering↗

DOE OSTI2020

Effects of social structure and management on risk of disease establishment in wild pigs

Contact heterogeneity among hosts determines invasion and spreading dynamics of infectious disease, thus its characterization is essential for identifying effective disease control strategies. Yet, little is known about the factors shaping contact networks in many 28 wildlife species and how wildlife management actions might affect contact networks. Wild pigs in North America are an invasive, socially-structured species that pose a health concern for domestic swine given their ability to transmit numerous devastating diseases 2 such as African swine fever (ASF). Using proximity loggers and GPS data from 48 wild pigs in Florida and South Carolina, USA, we employed a probabilistic framework to estimate weighted contact networks. We determined the effects of sex, social group, and spatial distribution (monthly home range overlap and distance) on wild pig contact. We also estimated the impacts of management-induced perturbations on contact and inferred their effects on ASF establishment in wild pigs with simulation. Social group membership was the primary factor influencing contacts. Between-group contacts depended primarily on space use characteristics, with fewer contacts among groups separated by >2 km and no contacts among groups >4 km apart within a month. Modeling ASF dynamics on the contact network demonstrated that indirect contacts resulting from baiting (a typical method of attracting wild pigs or game species to a site to enhance recreational hunting) increased the risk of disease establishment by ~33% relative to direct contact. Low-intensity population reduction (<5.9% of the population) had no detectable impact on contact structure but reduced predicted ASF establishment risk relative to no population reduction. Here, we demonstrate an approach for understanding the relative role of spatial, social, and individual-level characteristics in shaping contact networks and predicting their effects on disease establishment risk, thus providing insight for optimizing disease control in spatially- and socially-structured wildlife species.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Low-energy Electron-track Imaging for a Liquid Argon Time-projection-chamber Telescope Concept Using Probabilistic Deep Learning

The GammaTPC is an MeV-scale single-phase liquid argon time-projection-chamber gamma-ray telescope concept with a novel dual-scale pixel-based charge-readout system. It promises to enable a significant improvement in sensitivity to MeV-scale gamma rays over previous telescopes. The novel pixel-based charge readout allows for imaging of the tracks of electrons scattered by Compton interactions of incident gamma rays. The two primary contributors to the accuracy of a Compton telescope in reconstructing an incident gamma-ray’s original direction are its energy and position resolution. In this work, we focus on using deep learning to optimize the reconstruction of the initial position and direction of electrons scattered in Compton interactions, including using probabilistic models to estimate predictive uncertainty. We show that the deep-learning models are able to predict locations of Compton scatters of MeV-scale gamma rays from simulated 500 μm pixel-based data to better than 1 mm rms error and are sensitive to the initial direction of the scattered electron. We compare and contrast different deep-learning uncertainty estimation algorithms for reconstruction applications. Additionally, we show that event-by-event estimates of the uncertainty of the locations of the Compton scatters can be used to select those events that were reconstructed most accurately, leading to improvement in locating the origin of gamma-ray sources on the sky.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

bayesian structural time series↗

DOE OSTI2025

LandScan mosaic enables high-resolution gridded population estimates with explicit uncertainty

Gridded population datasets represent high-resolution distributions of human occupancy, enabling informed decision-making across a broad range of fields. These data products are valuable for assessing environmental risk, urban development, disaster preparedness and resource allocation—areas where accurate population estimates directly enhance policy effectiveness and optimize resource distribution. Despite the importance of gridded population datasets, traditional population modeling approaches often overlook inherent uncertainties in the estimation process. This limitation can create a false sense of certainty in population estimates, potentially leading to flawed decisions by those who rely on the data. To address this methodological gap, we introduce a probabilistic machine learning modeling framework, LandScan Mosaic, that explicitly incorporates uncertainty into the population modeling process. Our approach systematically quantifies uncertainty in three key modeling parameters of the LandScan HD gridded population dataset: building use types, floor counts, and occupancy rates. By employing Monte Carlo simulations, we propagate these uncertainties through the modeling process, yielding probability distributions of population counts in place of deterministic point estimates. We demonstrate the practical application of this framework in Iloilo City, Philippines, using structured decision-making techniques and our probabilistic estimates to identify and prioritize areas most affected by projected flooding, supporting targeted interventions that address both economic and social risks. In doing so, we propose a population-specific approach for incorporating confidence into structured decision making processes. Through a comparative analysis with conventional deterministic approaches and point estimate approaches, including LandScan HD and WorldPop, we evaluate how the incorporation of machine learning and uncertainty influences decision rankings. This research advances population distribution modeling by offering a robust, quantitative approach that explicitly accounts for uncertainty in the underlying data, along with guidance for how users can apply uncertainty in their decision-making.

Environmental sciences↗

DOE OSTI2020

Probabilistic risk-based Area of Review (AoR) determination for a deep-saline carbon storage site

Regulatory oversight of a geologic carbon sequestration (GCS) project relies on iterative estimations, throughout the project lifetime, of the area where increased risks to underground sources of drinking water (USDWs) may occur due to injection of CO2. This area, referred to as Area of Review (AoR), is typically delineated by predicting the migration of fluid between the reservoir and the lowermost USDW via an open wellbore using predictions from physics-based reservoir simulators. The inherent uncertainty in input parameters used in reservoir modeling therefore affects the accuracy of determining the AoR for a project. Furthermore, the standard analytical approaches for calculating a critical pressure to delineate the risk area yield an infinite AoR for cases where the injection reservoir is overpressured relative to the USDW. A methodology is presented in this paper to better characterize the risk to USDWs while accounting for the uncertainty in reservoir modeling, with an application to a permitted GCS project with an overpressured injection formation, FutureGen 2.0. The methodology is demonstrated using the National Risk Assessment Partnership’s open-source integrated assessment model (NRAP-Open-IAM) to develop a probabilistic estimate of impact risk to USDW quality. CO2 and pressure predictions from the reservoir modeling conducted using the STOMP-CO2 simulator for the FutureGen 2.0 site are used in a NRAP-Open-IAM model with reservoir, wellbore, and aquifer components to: (1) assess the extent of potential leakage into the USDW for the predicted reservoir pressure conditions; (2) evaluate the extent of potential impact using “no-net-degradation” thresholds; and (3) account for uncertainty in reservoir permeabilities.

03 NATURAL GAS↗

DOE OSTI2020

Wind Turbine Rotor Design Optimization Using Importance Sampling: Preprint

Probabilistic methods are commonly adopted to estimate both ultimate and fatigue loads in wind turbines, and multiple papers have presented a variety of approaches. In contrast, system-level, integrated design optimization methods for wind turbines have so far relied on deterministic methods to estimate loads and deflections. This work aims at addressing this gap by adopting importance sampling to estimate ultimate blade deflection for use within a rotor design optimization. A comparison between the results of this approach against traditional approaches using deterministic load evaluations show that the probabilistic approach is more conservative and that the solutions found with deterministic approaches violate the probabilistic constraint on tip deflection between 13% and 17%. This highlights the importance of accurate load and deflection estimates and demonstrates that probabilistic approaches can be successfully integrated within a wind turbine design process despite the higher computational costs.

17 WIND ENERGY↗

DOE OSTI2020

A Bayesian Approach to Regional Decadal Predictability: Sparse Parameter Estimation in High-Dimensional Linear Inverse Models of High-Latitude Sea Surface Temperature Variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies—typically focusing more on tropical or midlatitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation–dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on 1) estimating parameter values on a perfect model experiment and 2) producing calibrated 1-yr SST anomaly forecast distributions using a preindustrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which an LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model’s ability to capture variability of SST anomalies.

54 ENVIRONMENTAL SCIENCES↗