Search NASA⌕ Search

SEARCH · Search NASA

Results for “Copulas”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

XPCA -Python Implementation

Principal component analysis (PCA) is arguably the most popular tool in multivariate exploratory data analysis. We consider the question of how to handle heterogeneous variables that include continuous, binary, and ordinal. In the probabilistic interpretation of low-rank PCA, the data has a normal multivariate distribution and, therefore, normal marginal distributions for each column. If some marginals are continuous but not normal, the semiparametric copula-based principal component analysis (COCA) method is an alternative to PCA that combines a Gaussian copula with nonparametric marginals. If some marginals are discrete or semi-continuous, we present a new extended PCA (XPCA) method that also uses a Gaussian copula and nonparametric marginals and accounts for discrete variables in the likelihood calculation by integrating over appropriate intervals. Like PCA, the factors produced by XPCA can be used to find latent structure in data, build predictive models, and perform dimensionality reduction. We implement the new model, XPCA, and its ancestors PCA and COCA in both R and Python. This software provides implementations of XPCA, COCA, and probabilistic PCA in both R and Python. XPCA is written in arXiv report https://arxiv.org/abs/1808.07510. SAND2019-10591 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Kincher-Winoto, Kina↗

A Data-Driven Nonparametric Approach for Probabilistic Load-Margin Assessment Considering Wind Power Penetration

A modern power system is characterized by an increasing penetration of wind power, which results in large uncertainties in its states. These uncertainties must be quantified properly; otherwise, the system security may be threatened. Facing this challenge, here we propose a cost-effective, data-driven approach to assessing a power system's load margin probabilistically. Using actual wind data, a kernel density estimator is applied to infer the nonparametric wind speed distributions, which are further merged into the framework of a vine copula. The latter enables us to simulate complex multivariate and highly dependent model inputs with a variety of bivariate copulae that precisely represent the tail dependence in the correlated samples. Furthermore, to reduce the prohibitive computational time of traditional Monte-Carlo simulations that process a large amount of samples, we propose to use a nonparametric, Gaussian-process-emulator-based reduced-order model to replace the original complicated continuation power-flow model through a Bayesian-learning framework. To accelerate the convergence rate of this Bayesian algorithm, a truncated polynomial chaos surrogate, which serves as a highly efficient, parametric Bayesian prior, is developed. This emulator allows us to execute the time-consuming continuation power-flow solver at the sampled values with a negligible computational cost. Results of simulations that are performed on several test systems reveal the impressive performance of the proposed method in the probabilistic load-margin assessment.

17 WIND ENERGY↗

A Bivariate Mixed Distribution with a Heavy-tailed Component and its Application to Single-site Daily Rainfall Simulation

This paper presents an improved brivariate mixed distribution, which is capable of modeling the dependence of daily rainfall from two distinct sources (e.g., rainfall from two stations, two consecutive days, or two instruments such as satellite and rain gauge). The distribution couples an existing framework for building a bivariate mixed distribution, the theory of copulae and a hybrid marginal distribution. Contributions of the improved distribution are twofold. One is the appropriate selection of the bivariate dependence structure from a wider admissible choice (10 candidate copula families). The other is the introduction of a marginal distribution capable of better representing low to moderate values as well as extremes of daily rainfall. Among several applications of the improved distribution, particularly presented here is its utility for single-site daily rainfall simulation. Rather than simulating rainfall occurrences and amounts separately, the developed generator unifies the two processes by generalizing daily rainfall as a Markov process with autocorrelation described by the improved bivariate mixed distribution. The generator is first tested on a sample station in Texas. Results reveal that the simulated and observed sequences are in good agreement with respect to essential characteristics. Then, extensive simulation experiments are carried out to compare the developed generator with three other alternative models: the conventional two-state Markov chain generator, the transition probability matrix model and the semi-parametric Markov chain model with kernel density estimation for rainfall amounts. Analyses establish that overall the developed generator is capable of reproducing characteristics of historical extreme rainfall events and is apt at extrapolating rare values beyond the upper range of available observed data. Moreover, it automatically captures the persistence of rainfall amounts on consecutive wet days in a relatively natural and easy way. Another interesting observation is that the recognized ‘overdispersion’ problem in daily rainfall simulation ascribes more to the loss of rainfall extremes than the under-representation of first-order persistence. The developed generator appears to be a sound option for daily rainfall simulation, especially in particular hydrologic planning situations when rare rainfall events are of great importance.

Singh, Vijay P.↗

Estimating manufacturing electricity costs by simulating dependence between production parameters

The electricity costs associated with manufacturing generally consist of an energy charge and a demand charge, which are calculated by total kWh × kWh and peak kW × kW, respectively. While these two charges have been extensively studied with production scheduling, dependence between production parameters has not been thoroughly investigated for production energy costs when the production parameters are assumed to be independent. Such dependence, however, can significantly affect the peak kW and resulting energy costs. Therefore, industrial practitioners need a tool to simulate the production power demand and cost to evaluate energy costs for each production plan and for any dependence in the parameters. In this paper, we propose a method for simulating the power demand at the machine and facility levels, focusing on the dependence in milling machine parameters. Using probabilistic techniques with copulas, we quantify the degree of dependence between two milling parameters (processing times and processing amounts) and build a power demand simulator combining discrete event simulation and numerical simulation models. From 35 illustrative examples, we show that a production strategy to adjust dependence can reduce the peak kW and energy costs by more than 15% and 4%, respectively. In addition to dependence, less variability in processing times results in less peak kW and energy costs. Other factors such as a marginal probability distribution and copula types having the same degree of variability have been found to have limited effects on reducing energy costs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The hidden structure of hydrodynamic transport in random fracture networks

We study the large-scale dynamics and prediction of hydrodynamic transport in random fracture networks. The flow and transport behaviour is characterized by first passage times and displacement statistics, which show heavy tails and anomalous dispersion with a strong dependence on the injection condition. The origin of these behaviours is investigated in terms of Lagrangian velocities sampled equidistantly along particle trajectories, unlike classical sampling strategies at a constant rate. The velocity series are analysed by their copula density, the joint distribution of the velocity unit scores, which reveals a simple, albeit hidden, correlation structure that can be described by a Gaussian copula. Based on this insight, we derive a Langevin equation for the evolution of equidistant particle speeds. In this framework, particle motion is quantified by a stochastic time-domain random walk, the joint density of particle position, and speed satisfies a Klein–Kramers equation. The upscaled theory quantifies particle motion in terms of the characteristic fracture length scale and the distribution of Eulerian flow velocities. That is, it is predictive in the sense that it does not require the a priori knowledge of transport attributes. The upscaled model captures non-Fickian transport features, and their dependence on the injection conditions in terms of the velocity point statistics and average fracture length. It shows that the first passage times and displacement moments are dominated by extremes occurring at the first step. The presented approach integrates the interaction of flow and structure into a predictive model for large-scale transport in random fracture networks.

42 ENGINEERING↗

Disentangling direct from indirect relationships in association networks

Networks are vital tools for understanding and modeling interactions in complex systems in science and engineering, and direct and indirect interactions are pervasive in all types of networks. However, quantitatively disentangling direct and indirect relationships in networks remains a formidable task. Here, we present a framework, called iDIRECT (Inference of Direct and Indirect Relationships with Effective Copula-based Transitivity), for quantitatively inferring direct dependencies in association networks. Using copula-based transitivity, iDIRECT eliminates/ameliorates several challenging mathematical problems, including ill-conditioning, self-looping, and interaction strength overflow. With simulation data as benchmark examples, iDIRECT showed high prediction accuracies. Application of iDIRECT to reconstruct gene regulatory networks in Escherichia coli also revealed considerably higher prediction power than the best-performing approaches in the DREAM5 (Dialogue on Reverse Engineering Assessment and Methods project, #5) Network Inference Challenge. In addition, applying iDIRECT to highly diverse grassland soil microbial communities in response to climate warming showed that the iDIRECT-processed networks were significantly different from the original networks, with considerably fewer nodes, links, and connectivity, but higher relative modularity. Further analysis revealed that the iDIRECT-processed network was more complex under warming than the control and more robust to both random and target species removal ( P < 0.001). As a general approach, iDIRECT has great advantages for network inference, and it should be widely applicable to infer direct relationships in association networks across diverse disciplines in science and engineering.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗

Multi-Mechanism Flood Hazard Assessment: Critical Review of Current Practice and Approaches

This report documents the initial findings from the Nuclear Regulatory commission (NRC)-sponsored research project Methods for Estimating Joint Probabilities of Coincident and Correlated Flooding Mechanisms for Nuclear Power Plant Flood Hazard Assessments.1 This research project is a part of NRC’s Probabilistic Flood Hazard Assessment (PFHA) Research Program and will aid the development of guidance on the use of PFHA methods to evaluate infrastructure safety for existing and proposed US nuclear power plants (NPPs). More specifically, this project intends to provide technical background for the development of flood hazard curves for multi-mechanism floods (MMFs). MMFs are flood events caused by more than one flooding mechanism (e.g., flood events due to the simultaneous occurrence of precipitation-induced river flooding and storm surge). Project activities include three main tasks: Task 1—Survey of current concepts and methods in assessing MMF hazards; Task 2—Critical assessment of selected methods and approaches for quantifying probabilistic MMF hazard risk; Task 3—Development of example case studies to illustrate best practices for quantifying probabilistic MMF hazard risk The initial findings from Tasks 1 and 2 are documented in this report. Task 1 comprised a survey of approaches and methods that have been applied to understand and assess flood hazards due to MMFs. Task 2 involved a critical review of the selected approaches and methods. To that end, the scope of this report includes documentation of (1) a reconnaissance-level survey of the current state of concepts and practice for MMF hazard assessment; (2) a generalized MMF assessment framework to address the distinctions among various types of flood-forcing phenomena, flood mechanisms (grouped into three mechanism types), and flood severity metrics; (3) a wide-ranging survey of approaches and methods that have been applied to various flooding phenomena and settings; and (4) a critical assessment of MMF hazard assessment methods. Studies were identified involving MMFs related to coastal flooding mechanisms, fluvial (rivers/streams) flooding mechanisms, and associated combinations of coastal and fluvial flooding mechanisms. Studies were also identified that address MMFs involving coastal and fluvial flooding mechanisms as well as coastal flooding mechanisms along with extreme precipitation (without specific attribution to fluvial or pluvial mechanisms). The studies identified for review in this report included assessments at varying spatial scales (from local to global) with differing geographic regions of focus using both observed and synthetic data. The majority of studies identified and reviewed were site-specific assessments focusing on relatively short return periods. Studies considered a range of flood severity metrics, made differing assumptions regarding the occurrence of extrema, and used multiple statistical techniques; the use of copulas for the development of joint distributions was a particularly popular analysis technique. The literature review highlighted the differences among existing studies relative to terminology used, means of presenting results, framework and techniques employed, and level of sophistication regarding the number and types of variables considered. Despite the significant diversity in existing studies, the review identified several promising techniques that will be considered in future work under this project, including the development of joint distributions for MMFs using copula and Bayesian-motivated approaches.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

The Arctic LDRD project: What happened?

This presentation overviews results from the 2019 LDRD Reserve project “Diagnosing near-future changes in Arctic sea ice and ocean conditions” and a follow-up 2020 CSES Rapid Response project “Multi- Model Risk Assessment for Arctic Navigability.” We analyzed Arctic simulations from 4 CMIP6 model ensembles (E3SM, CESM-CAM, CESM-WACCM and CESM-DPLE), comparing them with observations. We then applied a machine-learning approach using copulas to produce joint probabilities of adverse conditions along potential shipping transit routes through the Arctic. Here we compare and contrast the different models and examine the utility of the copula approach applied to these data sets.

58 GEOSCIENCES↗

A nonparametric approach to modeling dependence among production parameters for energy cost estimation

Dependence existing among production parameters can significantly affect energy costs. For material removal processes, processing times and material amounts to be cut have positive dependence, and the dependence can affect energy costs by varying a peak electricity load. Existing methods to model the dependence of production parameters are based on parametric approaches that cannot accurately represent the dependence due to the rigid nature of parametric models. To address this issue, this study proposes a method to quantify dependence among manufacturing parameters through the application of the empirical copula to the dependence between the milling processing time and the amount of volume to be cut. The proposed method is illustrated by a case study of a manufacturing facility consisting of milling machines; a total of 27 scenarios are simulated for energy cost estimations. The case study clearly shows that the proposed method can capture the dependence between the milling parameters more accurately than a conventional dependence measure from parametric correlation models. Furthermore, the findings from this study would be useful to estimate energy costs in that the proposed method provides a better fit to real production data than conventional parametric approaches can.

42 ENGINEERING↗

Large‐Scale Statistically Meaningful Patterns (LSMPs) Associated With Precipitation Extremes Over Northern California

Abstract We analyze large‐scale statistically meaningful patterns (LSMPs) that precede extreme precipitation (PEx) events over Northern California (NorCal). We find LSMPs by applying k‐means clustering to the two leading principal components of daily 500 hPa geopotential height anomalies two days before the onset, from October to March during 1948–2015. Statistical significance testing based on Monte Carlo simulations suggests a minimum of four statistically distinguished LSMP clusters. The four LSMP clusters are characterized as Northwest continental negative height anomaly, Eastward positive “Pacific‐North American Pattern (PNA),” Westward negative “PNA,” and Prominent Alaskan ridge. These four clusters, shown in multiple variables, evolve very differently and have differing links to the Arctic and tropical Pacific regions. Using binary forecast skill measures and a new copula‐based framework for predicting PEx events, we find LSMP indices that are useful predictors of NorCal PEx events, with moisture‐based variables being the best predictors of PEx events at least 6 days before the onset, and the lower atmospheric variables being better than their upper atmospheric counterparts any day in advance tested. To ensure statistical rigor, the LSMPs analyzed here (with the modified acronym) include local tests of both significance and consistency, which are not always featured in the literature on large‐scale meteorological patterns.

54 ENVIRONMENTAL SCIENCES↗

Numerical Water Tracers in the Atmospheric Component of the Energy Exascale Earth System Model: Implementation and Changes in Moisture Origin

Numerical water tracers are implemented in the Energy Exascale Earth System Model version 2. Simulations performed with the water‐tag‐enabled model for both pre‐industrial and future greenhouse gas concentrations reveal a marked increase in the role of mid‐latitude and southern subtropical regions as exporters of atmospheric moisture—to the extratropical upper troposphere and the tropical free troposphere. For the latter, the northward shift of the Intertropical Convergence Zone increases cross‐hemispheric transport of subtropical water vapor to the Northern Hemisphere. In the polar regions, most of the lower tropospheric moistening instead arises from increases in local evaporation. These findings illustrate the utility of the water tags, underscore critical changes in global hydrologic cycle, and provide insight into atmospheric dynamics under future climate scenarios. For applications when a global grid is desired, we additionally propose a novel statistical reconstruction, based on copula modeling, of the joint distribution of origin of water vapor, which reduces the number of tracers from order $\mathcal{O}\left({n}^{2}\right)$to order $\mathcal{O}(n)$, substantially ameliorating the considerable computational cost of water tracers. This statistical reconstruction is particularly beneficial to the interpretation of the relationship between latitude and longitude of origin of moisture over the tropical oceans and in the lower troposphere over land.

copula modeling↗

Activity start time and duration: incorporating regret theory into joint discrete–continuous models

Activity start time and duration decisions are two key elements of activity-travel behaviour. As an effort towards a more realistic representation of individuals’ decision behaviour, this paper presents a new copula-based joint model of activity start time and duration. In this work, we incorporate the regret theory into the joint modelling framework, which assumes that individuals tend to avoid the situation where non-chosen alternatives outperform the chosen one in one or more attributes. The proposed joint model comprises a hybrid utility-regret model as the discrete component to estimate activity start time and a hazard duration model as the continuous component to estimate activity duration. The comparative analysis of estimation results reveals that the proposed structure is statistically superior to the utility-based joint model and independent models. We also found that applying the regret-based decision rule for variables of travel time and travel time variability significantly improves the model.

42 ENGINEERING↗

Identification of topology changes in power grids using phasor measurements

Phasor measurement units (PMUs) are increasingly important for monitoring the state of an electrical power grid and quickly detecting topology changes caused by events such as lines going down or large loads being dropped. Phasors are complex‐valued measurements of voltage and current at various points of generation and consumption. If a line goes down or a load is removed, power flows change throughout the grid according to known physical laws, and the probability distribution of phasor measurements changes accordingly. This paper develops a method to estimate the current topology of a power grid from phasor measurements and considers the design goal of placing PMUs at strategic points in a distribution system to achieve good sensitivity to single‐line outages. From a vector of phasor measurements, probabilities are computed corresponding to the scenario that all power lines are operational and to alternate scenarios in which each line goes down individually. These probabilities are functions of the joint distributions of phasor measurements under each possible scenario, obtained through Monte Carlo simulations with random load profiles. We use log‐spline densities to estimate marginal distributions of phasor measurements and fold these into a multivariate Gaussian copula to capture important correlations. Sensitivity to outages varies according to which line goes down and where PMUs are placed on the grid. A greedy search algorithm is demonstrated for placing PMUs at locations that provide good sensitivity to single‐line outages. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

Wiel, Scott Vander↗

A global analysis strategy to resolve neutrino NSI degeneracies with scattering and oscillation data

Neutrino non-standard interactions (NSI) with the first generation of standard model fermions can span a parameter space of large dimension and exhibit degeneracies that cannot be broken by a single class of experiment. Oscillation experiments, together with neutrino scattering experiments, can merge their observations into a highly informational dataset to combat this problem. We consider combining neutrino-electron and neutrino-nucleus scattering data from the Borexino and COHERENT experiments, including a projection for the upcoming coherent neutrino scattering measurement at the CENNS-10 liquid argon detector. We extend the reach of these data sets over the NSI parameter space with projections for neutrino scattering at a future multi-ton scale dark matter detector and future oscillation measurements from atmospheric neutrinos at the Deep Underground Neutrino Experiment (DUNE). In order to perform this global anal- ysis, we adopt a novel approach using the copula method, utilized to combine posterior information from different experiments with a large, generalized set of NSI parameters. We find that the contributions from DUNE and a dark matter detector to the Borexino and COHERENT fits can improve constraints on the electron and quark NSI parameters by up to a factor of 2 to 3, even when relatively many NSI parameters are left free to vary in the analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A new method for detecting abrupt changes in the dependence among multivariate hydrological series based on moving cut total correlation

Knowledge of how to define and estimate the dependence among multivariate hydrological series is essential for detecting abrupt changes in the dependence. Here, in this paper, a new method (BMCTC) is proposed to detect all possible abrupt change points in the dependence among multivariate hydrological series. The total correlation estimated by the matrix-based Renyi's alpha-order entropy functional is firstly introduced to define and measure the dependence strength among multivariate hydrological series. Then, the moving cut total correlation (MCTC) sequence is built by the moving window technique, which is used to measure changes in the dependence strength among multivariate hydrological series. Finally, the Bernaola-Galvan algorithm is used to detect all change points of the MCTC sequence. Simulations are performed to compare the effectiveness of BMCTC with Pearson correlation (BMCPC) and Spearman correlation (BMCSC), Cramer-von Mises (CvM) and copula-based likelihood-ratio (CLR). The results show that all change points are detected by BMCTC regardless of the samples size, but wrong change points or no change points are detected by other methods in most cases. BMCTC is applied to detect change points in the dependence among annual runoff, precipitation and sediment discharge series in the Xiliugou and the Kuyehe River, China. It is found that the dependence among runoff, precipitation and sediment discharge changed abruptly in 1980 and 1996 in the Kuyehe River and in 1999 in the Xiliugou River. These changes are mainly caused by human activities such as construction of water conservancy projects and coal mining.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Stochastic Correlation Models

Five models of stochastic correlation are compared on the basis of the generated associations of Wiener processes. Associations are characterised by the copulas and their K-functions. A confidence domain for the randomly changing K-functions is build on the basis of simulated Wiener process pairs. The models are ordered by the magnitude of the domains of confidence bounds. Larger confidence domains or higher bounds represent higher correlation risk when the models are applied in mathematical finance.

97 MATHEMATICS AND COMPUTING↗

An information diffusion technique to assess integrated hazard risks

An integrated risk is a scene in the future associated with some adverse incident caused by multiple hazards. An integrated probability risk is the expected value of disaster. Due to the difficulty of assessing an integrated probability risk with a small sample, weighting methods and copulas are employed to avoid this obstacle. To resolve the problem, in this paper, we develop the information diffusion technique to construct a joint probability distribution and a vulnerability surface. Then, an integrated risk can be directly assessed by using a small sample. A case of an integrated risk caused by flood and earthquake is given to show how the suggested technique is used to assess the integrated risk of annual property loss.

58 GEOSCIENCES↗