Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Surrogate Modeling For Efficiently Accurately and Conservatively Estimating Measures of Risk

We present a surrogate modeling framework for conservatively estimating measures of risk from limited realizations of an expensive physical experiment or computational simulation. We adopt a probabilistic description of risk that assigns probabilities to consequences associated with an event and use risk measures, which combine objective evidence with the subjective values of decision makers, to quantify anticipated outcomes. Given a set of samples, we construct a surrogate model that produces estimates of risk measures that are always greater than their empirical estimates obtained from the training data. These surrogate models not only limit over-confidence in reliability and safety assessments, but produce estimates of risk measures that converge much faster to the true value than purely sample-based estimates. We first detail the construction of conservative surrogate models that can be tailored to the specific risk preferences of the stakeholder and then present an approach, based upon stochastic orders, for constructing surrogate models that are conservative with respect to families of risk measures. The surrogate models introduce a bias that allows them to conservatively estimate the target risk measures. We provide theoretical results that show that this bias decays at the same rate as the L 2 error in the surrogate model. Our numerical examples confirm that risk-aware surrogate models do indeed over-estimate the target risk measures while converging at the expected rate.

97 MATHEMATICS AND COMPUTING↗

Identification of linear stochastic systems through projection filters

A novel method is presented for identifying a state-space model and a state estimator for linear stochastic systems from input and output data. The method is primarily based on the relationship between the state-space model and the finite-difference model of linear stochastic systems derived through projection filters. It is proved that least-squares identification of a finite difference model converges to the model derived from the projection filters. System pulse response samples are computed from the coefficients of the finite difference model.

Chen, Chung-Wen↗

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗

Dynamical Mass Estimates of the β Pictoris Planetary System through Gaussian Process Stellar Activity Modeling

Nearly 15 yr of radial velocity (RV) monitoring and direct imaging enabled the detection of two giant planets orbiting the young, nearby star β Pictoris. The δ Scuti pulsations of the star, which overwhelm planetary signals, need to be carefully suppressed. In this work, we independently revisit the analysis of the RV data following a different approach than available in the literature to model the activity of the star. We show that a Gaussian process (GP) with a stochastically driven damped harmonic oscillator kernel can model the δ Scuti pulsations. It provides similar results to parametric models but with a simpler framework, using only three hyperparameters. It also enables us to model poorly sampled RV data that were excluded from previous analyses, hence extending the RV baseline by nearly five years. Altogether, the orbit and mass of both planets can be constrained from RV only, which was not possible with the parametric modeling. To characterize the system more accurately, we also perform a joint fit of all available relative astrometry and RV data. Our orbital solutions for β Pic b favor a low eccentricity of 0.029$_{−0.024}^{+0.061}$ and a relatively short period of 21.1$_{−0.8}^{+2.0}$ yr. The orbit of β Pic c is eccentric with 0.206$_{−0.063}^{+0.074}$ with a period of 3.36 ± 0.03 yr. We find model-independent masses of 11.7 ± 1.4 and 8.5 ± 0.5 M Jup for β Pic b and c, respectively, assuming coplanarity. The mass of β Pic b is consistent with the hottest start evolutionary models, at an age of 25 ± 3 Myr. A direct detection of β Pic c would provide a second calibration measurement in a coeval system.

79 ASTRONOMY AND ASTROPHYSICS↗

Cellular Statistical Models of Broken Cloud Fields. Part IV: Effects of Pixel Size on Idealized Satellite Observations

In the fourth part of our “Cellular Statistical Models of Broken Cloud Fields” series we use the binary Markov processes framework for quantitative investigation of the effects of low resolution of idealized satellite observations on the statistics of the retrieved cloud masks. We assume that the cloud fields are Markovian and are characterized by the “actual” cloud fraction (CF) and scale length. We use two different models of observations: a simple discrete-point sampling and a more realistic “pixel” protocol. The latter is characterized by a state attribution function (SAF) which has the meaning of the probability that the pixel with a certain CF is declared cloudy in the observed cloud mask. The stochasticity of the SAF means that the cloud/clear attribution is not ideal and can be affected by external or unknown factors. We show that the observed cloud masks can be accurately described as Markov chains of pixels and use the master-matrix formalism (introduced in Part III of the series) for analytical computation of their parameters: the “observed” CF and scale length. This procedure allows us to establish a quantitative relationship (which is pixel-size dependent) between the actual and the observed cloud-field statistics. The feasibility of restoring the former from the latter is considered. The adequacy of our analytical approach to idealized observations is evaluated using numerical simulations. Comparison of the observed parameters of the simulated datasets with their theoretical expectations showed an agreement within 0.005 for the CF, while for the scale length it is within 1% in the sampling case and within 4% in the pixel case.

Mikhail D. Alexandrov↗

Unbiased Resource Evaluations with Kriging and Stochastic Models of Heterogeneous Rock Properties

This paper revisits the computation of product combinations for quantification of resources (e.g., pore volume for hydrocarbon reservoir formations). The explanations have been simplified by considering the exhaustive numerical model for properties that are multiplied first and then added or averaged for evaluation. The analysis starts without any probabilistic considerations. Abbreviated (up-scaled) computations in the sum of multiplications are proposed by substituting the individual values by averages for each rock property in the coarser cell resolution model. A result found is that averaged properties can be utilized for estimation at non-sampled locations, instead of individual values; however, covariances and cumulants must also be included in the abbreviated computations. The smoothing effect of kriging is found to be irrelevant if the kriging variance is also included in the up-scaled abbreviated pore volume computations. Thus, the equivalence between computation of resource volumes from kriging estimates and conditional stochastic simulations is established, with the condition that numerical estimation must incorporate the complete covariance and cumulant information as well. An example shows pore volume prediction from a kriging model matches the unbiased result from stochastic simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Efficient Bayesian inference with latent Hamiltonian neural networks in No-U-Turn Sampling

When sampling for Bayesian inference, one popular approach in the computational field is to use Hamiltonian Monte Carlo (HMC) and specifically the No-U-Turn Sampler (NUTS), which automatically decides the end time of the Hamiltonian trajectory. However, HMC and NUTS can require numerous numerical gradients of the target density and can prove slow in practice when relying on computationally expensive forward models. We propose Latent Hamiltonian neural networks (L-HNNs) with HMC and NUTS for solving Bayesian inference problems. Once trained, L-HNNs do not require numerical gradients of the target density during sampling, and hence numerous evaluations of the forward computational model. Moreover, L-HNNs satisfy important properties such as perfect time reversibility and Hamiltonian conservation, making them well-suited for use within HMC and NUTS because stationarity can be shown. We also propose the integration of L-HNNs in an online error monitoring scheme, in which numerical gradients of the target density are used for a few samples whenever the L-HNNs prediction errors are large. This online error monitor scheme prevents sample degeneracy in regions of low probability density and ensures robust uncertainty quantification. We demonstrate L-HNNs in NUTS with online error monitoring on several analytical examples involving complex, heavy-tailed, and high-local-curvature probability densities. We then demonstrate the applicability of L-HNNs in NUTS to two computational case studies, namely the Allen-Cahn stochastic partial differential equation and an elliptic partial differential equation with 25 and 50 inference parameters, respectively. Overall, the L-HNNs in NUTS with online error monitoring satisfactorily inferred these probability densities. In conclusion, compared to traditional NUTS, L-HNNs in NUTS with online error monitoring required 1–2 orders of magnitude fewer numerical gradients of the target density and improved the effective sample size (ESS) per gradient (which is a measure of both the sampling quality and the computational expense) by an order of magnitude.

97 MATHEMATICS AND COMPUTING↗

S-OPT: A Points Selection Algorithm for Hyper-Reduction in Reduced Order Models

While projection-based reduced order models can reduce the dimension of full order solutions, the resulting reduced models may still contain terms that scale with the full order dimension. Hyper-reduction techniques are sampling-based methods that further reduce this computational complexity by approximating such terms with a much smaller dimension. The goal of this work is to introduce the points selection algorithm developed by Shin and Xiu as a hyper-reduction method. The selection algorithm was originally proposed as a stochastic collocation method for uncertainty quantification. Since the algorithm aims at maximizing a quantity $\mathcal{S}$ that measures both the column orthogonality and the determinant, we refer to the algorithm as S-OPT. Numerical examples are provided to demonstrate the performance of S-OPT and to compare its performance with a gappy proper orthogonal decomposition (POD) algorithm. Here, we found that using the S-OPT algorithm is shown to predict the full order solutions with higher accuracy than gappy POD especially when the number of sampling points is small, although we note that S-OPT shows slow asymptotic convergence with respect to the number of samples for some applications, e.g., Lagrangian hydrodynamics.

97 MATHEMATICS AND COMPUTING↗

Disk-loss and disk-renewal phases in classical Be stars. II. Contrasting with stable and variable disks

Recent observational and theoretical studies of classical Be stars have established the utility of polarization color diagrams (PCDs) in helping to constrain the time-dependent mass decretion rates of these systems. We expand on our pilot observational study of this phenomenon, and report the detailed analysis of a long-term (1989-2004) spectropolarimetric survey of nine additional classical Be stars, including systems exhibiting evidence of partial disk-loss/disk-growth episodes as well as systems exhibiting long-term stable disks. After carefully characterizing and removing the interstellar polarization along the line of sight to each of these targets, we analyze their intrinsic polarization behavior. We find that many steady-state Be disks pause at the top of the PCD, as predicted by theory. We also observe sharp declines in the Balmer jump polarization for later spectral type, near edge-on steady-state disks, again as recently predicted by theory, likely caused when the base density of the disk is very high, and the outer region of the edge-on disk starts to self absorb a significant number of Balmer jump photons. The intrinsic V-band polarization and polarization position angle of γ Cas exhibits variations that seem to phase with the orbital period of a known one-armed density structure in this disk, similar to the theoretical predictions of Halonen and Jones. We also observe stochastic jumps in the intrinsic polarization across the Balmer jump of several known Be+sdO systems, and speculate that the thermal inflation of part of the outer region of these disks could be responsible for producing this observational phenomenon. Finally, we estimate the base densities of this sample of stars to be between ≈8 × 10{sup –11} and ≈4 × 10{sup –12} g cm{sup –3} during quasi steady state periods given there maximum observed polarization.

79 ASTRONOMY AND ASTROPHYSICS↗

Assembly of the Populus Microbiome Is Temporally Dynamic and Determined by Selective and Stochastic Factors

Recent work shows that the plant microbiome, particularly the initial assembly of this microbiome, influences plant health, survival, and fitness. Here, we characterize the initial assembly of the Populus microbiome across ten genotypes belonging to two poplar species in a common garden using 16S rRNA gene and ITS2 region amplicon sequencing of the leaf endosphere, leaf surface, root endosphere, and rhizosphere. We sampled these microbiomes three times throughout the first growing season and found that the composition of the microbiome changed dramatically over time across all plant-associated habitats and host genotypes. For archaea and bacteria, these changes were dominated by strong homogenizing selection (accounting for 29 to 62% of pairwise comparisons). However, fungal assembly was generally characterized by multiple ecological assembly processes (i.e., a mix of weak selective and dispersal processes). Interestingly, genotype, while a significant moderator of microbiome composition, generally explained less variation than sample date across plant-associated habitats. We defined a set of core genera that accounted for, on average, 36% of the microbiome. The relative abundance of this core community was consistent over time. Additionally, using source tracking modeling, we determined that new microbial taxa colonize from both aboveground and belowground sources, and combined with our ecological assembly null models, we found that both selective and dispersal processes explained the differences between exo- (i.e., leaf surface and rhizosphere) and endospheric microbiomes. Taken together, our results suggest that the initial assembly of the Populus microbiome is time-, genotype-, and habitat-dependent and is moderated by both selective and stochastic factors.

16S rRNA↗

Stochastic derivative-free optimization using a trust region framework

This study presents a trust region algorithm to minimize a function f when one has access only to noise-corrupted function values f¯. The model-based algorithm dynamically adjusts its step length, taking larger steps when the model and function agree and smaller steps when the model is less accurate. The method does not require the user to specify a fixed pattern of points used to build local models and does not repeatedly sample points. If f is sufficiently smooth and the noise is independent and identically distributed with mean zero and finite variance, we prove that our algorithm produces iterates such that the corresponding function gradients converge in probability to zero. As a result, we present a prototype of our algorithm that, while simplistic in its management of previously evaluated points, solves benchmark problems in fewer function evaluations than do existing stochastic approximation methods.

97 MATHEMATICS AND COMPUTING↗

Physics-Informed Sparse Gaussian Process for Probabilistic Stability Analysis of Large-Scale Power System with Dynamic PVs and Loads

This work proposes a physics-informed sparse Gaussian process (SGP) for probabilistic stability assessment of large-scale power systems in the presence of uncertain dynamic PVs and loads. The differential and algebraic equations considering uncertainties from dynamic PVs and loads are reformulated to a nonlinear mapping relationship that allows the application of SGP. Thanks to the nonparametric characteristic of Gaussian process, the proposed framework does not require distributions of uncertain inputs and this distinguishes it from existing approaches. As the original Gaussian process is not scalable to large-scale systems with high dimensional uncertain inputs, this paper develops the SGP with a stochastic variational inference technique. It leads to approximately two orders of complex reduction. A data pre-processing step is also introduced to tackle the coexistence of stable and unstable cases by sample clustering and constructing separate SGPs. The probabilistic transient stability index is analyzed to assess system stability under different uncertain dynamics loads and PVs. Comparisons are performed with the sampling-based, the polynomial chaos expansion-based, and traditional Gaussian process-based methods on the modified IEEE 118-bus and Texas 2000-bus systems under various scenarios, including different levels of uncertainties and the existence of nonlinear correlations among dynamic PVs. The impacts of data quality and quantity issues are also investigated. It is shown that the proposed SGP achieves significantly improved computational efficiency while maintaining high accuracy with a limited number of data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Intrusive analysis for NEK5000: development of intrusive uncertainty quantification for high-dimensional, high-fidelity codes.

We study the use of lower-fidelity training data for uncertainty quantification of complex simulation models. In our approach, computationally expensive full-model outputs are approximated applying proper orthogonal-decomposition-based dimensionality reduction to the full model. A Gaussian-processes-based machine learning approach is then used to model the difference (or, rather, the correspondence) between the higher-fidelity and the lower-fidelity data. This stochastic model can be constructed by using few additional full code evaluations; it is used to calibrate arbitrarily many lower-quality outputs in order to create additional training data for sampling-based analysis. In effect, an adequate approximation of the simulation model’s response to uncertainty can be constructed at a modest computational cost. In fact, we aim at the number of full-model evaluations comparable to that required for a linear approximation (as opposed to numbers traditionally associated with sampling in high-dimensional spaces). In this report, we explain the basic algorithm, suggest some performance tuning options, and give a first characterization for the class of simulation models of nuclear engineering for which the suggested report is effective.

Roderick, O.↗

An information theory approach for evaluating earth radiation budget (ERB) measurements - Nonuniform sampling of diurnal longwave flux variations

Satellite measurements are subject to a wide range of uncertainties due to their temporal, spatial, and directional sampling characteristics. An information-theory approach is suggested to examine the nonuniform temporal sampling of ERB measurements. The information (i.e., its entropy or uncertainty) before and after the measurements is determined, and information gain (IG) is defined as a reduction in the uncertainties involved. A stochastic model for the diurnal outgoing flux variations that affect the ERB is developed. Using Gaussian distributions for the a priori and measured radiant exitance fields, the IG is obtained by computing the a posteriori covariance. The IG for the monthly outgoing flux measurements is examined for different orbital parameters and orbital tracks, using the Earth Observing System orbital parameters as specific examples. Variations in IG due to changes in the orbit's inclination angle and the initial ascending node local time are investigated.

Halyo, Nesim↗

Generalized correlation integral vectors: A distance concept for chaotic dynamical systems

Several concepts of fractal dimension have been developed to characterise properties of attractors of chaotic dynamical systems. Numerical approximations of them must be calculated by finite samples of simulated trajectories. In principle, the quantities should not depend on the choice of the trajectory, as long as it provides properly distributed samples of the underlying attractor. In practice, however, the trajectories are sensitive with respect to varying initial values, small changes of the model parameters, to the choice of a solver, numeric tolerances, etc. The purpose of this paper is to present a statistically sound approach to quantify this variability. We modify the concept of correlation integral to produce a vector that summarises the variability at all selected scales. The distribution of this stochastic vector can be estimated, and it provides a statistical distance concept between trajectories. Here, we demonstrate the use of the distance for the purpose of estimating model parameters of a chaotic dynamic model. The methodology is illustrated using computational examples for the Lorenz 63 and Lorenz 95 systems, together with a framework for Markov chain Monte Carlo sampling to produce posterior distributions of model parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An improved target velocity sampling algorithm for free gas elastic scattering

We present an improved algorithm for sampling the target velocity when simulating elastic scattering in a Monte Carlo neutron transport code that correctly accounts for the energy dependence of the scattering cross section. The algorithm samples the relative velocity directly, thereby avoiding a potentially inefficient rejection step based on the ratio of cross sections. Here, we have shown that this algorithm requires only one rejection step, whereas other methods of similar accuracy require two rejection steps. The method was verified against stochastic and deterministic reference results for upscattering percentages in 238 U. Simulations of a light water reactor pin cell problem demonstrate that using this algorithm results in a 3% or less penalty in performance when compared with an approximate method that is used in most production Monte Carlo codes

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

COSMOS: STOCHASTIC BIAS FROM MEASUREMENTS OF WEAK LENSING AND GALAXY CLUSTERING

In the theory of structure formation, galaxies are biased tracers of the underlying matter density field. The statistical relation between galaxy and matter density field is commonly referred to as galaxy bias. In this paper, we test the linear bias model with weak-lensing and galaxy clustering measurements in the 2 deg{sup 2} COSMOS field. We estimate the bias of galaxies between redshifts z = 0.2 and z = 1 and over correlation scales between R = 0.2 h{sup -1} Mpc and R = 15 h{sup -1} Mpc. We focus on three galaxy samples, selected in flux (simultaneous cuts I{sub 814W} < 26.5 and K{sub s} < 24) and in stellar mass (10{sup 9} < M{sub *} < 10{sup 10} h{sup -2} M{sub Sun} and 10{sup 10} < M{sub *} < 10{sup 11} h{sup -2} M{sub Sun }). At scales R > 2 h{sup -1} Mpc, our measurements support a model of bias increasing with redshift. The Tinker et al. fitting function provides a good fit to the data. We find the best-fit mass of the galaxy halos to be log (M{sub 200}/h{sup -1} M{sub Sun }) = 11.7{sup +0.6}{sub -1.3} and log (M{sub 200}/h{sup -1} M{sub Sun }) = 12.4{sup +0.2}{sub -2.9}, respectively, for the low and high stellar-mass samples. In the halo model framework, bias is scale dependent with a change of slope at the transition scale between the one and the two halo terms. We detect a scale dependence of bias with a turndown at scale R = 2.3 {+-} 1.5 h{sup -1} Mpc, in agreement with previous galaxy clustering studies. We find no significant amount of stochasticity, suggesting that a linear bias model is sufficient to describe our data. We use N-body simulations to quantify both the amount of cosmic variance and systematic errors in the measurement.

79 ASTRONOMY AND ASTROPHYSICS↗

Growth phase estimation for abundant bacterial populations sampled longitudinally from human stool metagenomes

Longitudinal sampling of the stool has yielded important insights into the ecological dynamics of the human gut microbiome. However, human stool samples are available approximately once per day, while commensal population doubling times are likely on the order of minutes-to-hours. Despite this mismatch in timescales, much of the prior work on human gut microbiome time series modeling has assumed that day-to-day fluctuations in taxon abundances are related to population growth or death rates, which is likely not the case. Here, we propose an alternative model of the human gut as a stationary system, where population dynamics occur internally and the bacterial population sizes measured in a bolus of stool represent a steady-state endpoint of these dynamics. We formalize this idea as stochastic logistic growth. We show how this model provides a path toward estimating the growth phases of gut bacterial populations in situ. We validate our model predictions using an in vitro Escherichia coli growth experiment. Finally, we show how this method can be applied to densely-sampled human stool metagenomic time series data. We discuss how these growth phase estimates may be used to better inform metabolic modeling in flow-through ecosystems, like animal guts or industrial bioreactors.

59 BASIC BIOLOGICAL SCIENCES↗