Nonparametric estimation of mean and variance when a few sample values possibly outliers
Nonparametric estimation of mean and variance in random sampling with observations of varying values
Walsh, J. E.↗
SEARCH · Search NASA
Results for “Variance to Mean”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data-Informed Evaluation Framework for Integrated Energy Systems: Insights from Power, Process Heat, and Hydrogen Production Applications
The multi-criteria decision analysis (MCDA) framework provides a systematic evaluation of the diverse preferences and performance metrics associated with alternative solutions. This approach is advantageous over a single-criterion methodology, which are only valid under conditions that assume ceteris paribus or an "apples-to-apples" comparison. However, selecting suitable technologies for integrated energy systems (IES) can be likened to an "apples-to-oranges" comparison, given the heterogeneous factors at stake. These factors include economics and performance parameters, geological compatibility, and environmental impacts. Consequently, past research has often employed a mixture of qualitative and quantitative criteria tailored to the specific interests of each study. While the method proves effective in handling the intricate interplay of criteria, the resulting rankings and scores can vary from study to study. This inconsistency is introduced from the use of subjectively defined thresholds and weights. As a result, decision-makers frequently find it challenging to establish clear connections between specific criteria and the resulting scores, as the transformation of criteria into ordinal scores results in a substantial loss of information. To address this challenge, we introduce a data-informed IES evaluation framework that offers comprehensive, interpretable, and traceable evaluations backed by quantifiable rationale. First, we identified key IES evaluation criteria from a decade of literature, focusing on relevant IES applications in power, process heat, and hydrogen production. We leveraged state-of-the-art cost estimates from the Idaho National Laboratory (INL) and technical data from 78 reactor designs from the International Atomic Energy Agency (IAEA) and the Organization for Economic Co-operation and Development - Nuclear Energy Agency (OECD-NEA). Lastly, we established thresholds by analyzing the mean, variance, root mean square, and slope of values across alternatives, categorizing the preferences of decision-makers into distinct utility functions, such as linear, saturating, exponential, and stepwise. Our approach yielded two main outcomes: (1) it provided consistent assessments across different stakeholder groups and (2) it visualized uncertainties in the decision-making context via comprehensive sensitivity analysis. To demonstrate the impact of our framework, we conducted case studies on 6 reactor designs (AP1000, NuScale, BWRX-300, Xe-100, eVinci, iMSR) for the three applications. Our data-driven framework proved to be highly effective in addressing heterogenous uncertainties faced by varied decision-makers? preferences and IES applications, as well as cost and technical estimates of advanced reactors.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Data-Informed Evaluation Framework for Integrated Energy Systems: Insights from Power, Process Heat, and Hydrogen Production Applications
The multi-criteria decision analysis (MCDA) framework provides a systematic evaluation of the diverse preferences and performance metrics associated with alternative solutions. This approach is advantageous over a single-criterion methodology, which are only valid under conditions that assume ceteris paribus or an "apples-to-apples" comparison. However, selecting suitable technologies for integrated energy systems (IES) can be likened to an "apples-to-oranges" comparison, given the heterogeneous factors at stake. These factors include economics and performance parameters, geological compatibility, and environmental impacts. Consequently, past research has often employed a mixture of qualitative and quantitative criteria tailored to the specific interests of each study. While the method proves effective in handling the intricate interplay of criteria, the resulting rankings and scores can vary from study to study. This inconsistency is introduced from the use of subjectively defined thresholds and weights. As a result, decision-makers frequently find it challenging to establish clear connections between specific criteria and the resulting scores, as the transformation of criteria into ordinal scores results in a substantial loss of information. To address this challenge, we introduce a data-informed IES evaluation framework that offers comprehensive, interpretable, and traceable evaluations backed by quantifiable rationale. First, we identified key IES evaluation criteria from a decade of literature, focusing on relevant IES applications in power, process heat, and hydrogen production. We leveraged state-of-the-art cost estimates from the Idaho National Laboratory (INL) and technical data from 78 reactor designs from the International Atomic Energy Agency (IAEA) and the Organization for Economic Co-operation and Development - Nuclear Energy Agency (OECD-NEA). Lastly, we established thresholds by analyzing the mean, variance, root mean square, and slope of values across alternatives, categorizing the preferences of decision-makers into distinct utility functions, such as linear, saturating, exponential, and stepwise. Our approach yielded two main outcomes: (1) it provided consistent assessments across different stakeholder groups and (2) it visualized uncertainties in the decision-making context via comprehensive sensitivity analysis. To demonstrate the impact of our framework, we conducted case studies on 6 reactor designs (AP1000, NuScale, BWRX-300, Xe-100, eVinci, iMSR) for the three applications. Our data-driven framework proved to be highly effective in addressing heterogenous uncertainties faced by varied decision-makers? preferences and IES applications, as well as cost and technical estimates of advanced reactors.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
A case study: Comparing testers for means and variances in a balanced incomplete block design
In this article, we present a gauge R & R study that is different from the standard setup in several ways. A balanced incomplete block design (BIBD) was used to collect the data because the measurement is destructive. Besides addressing reproducibility, differences in repeatability (i.e., tester variances) were also of interest. Here we use Bayesian methods to analyze the study data to address whether the three tester means and variances are similar. We also consider what happens if the BIBD structure of the data and possibly different tester variances are ignored in analyzing the study data.
42 ENGINEERING↗
Evaluation of errors in prior mean and variance in the estimation of integrated circuit failure rates using Bayesian methods
The critical point of any Bayesian analysis concerns the choice and quantification of the prior information. The effects of prior data on a Bayesian analysis are studied. Comparisons of the maximum likelihood estimator, the Bayesian estimator, and the known failure rate are presented. The results of the many simulated trails are then analyzed to show the region of criticality for prior information being supplied to the Bayesian estimator. In particular, effects of prior mean and variance are determined as a function of the amount of test data available.
Fletcher, B. C.↗
Reference data, predictors, and probability grids for forest degradation classes in three sites in the Brazilian Amazon
Forest degradation by fires and selective logging is widespread in the Amazon region. We implemented a gradient boosted classification modeling framework to classify intact, logged, and burned forests at three Amazonian sites: Feliz Natal Municipality and Xingu Indigenous Territory in Mato Grosso State, and Saracá-Taquera National Forest in Pará State. We used forest degradation history from Landsat time-series as reference data and textural metrics derived from PlanetScope images as predictors. Textural metrics were computed using the Gray-Level Co-Occurrence Matrix (GLCM) textural technique. Included in the attached zip file are ten files: - a shapefile containing the reference data (fire and selective logging polygons and year of event) for each site; - a multiband tif file containing the 8 GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, Correlation) at the original PlanetScope resolution (3.125m) for each site; - a multiband tif file containing the 72 aggregated GLCM metrics used as predictors (Mean, Variance, Homogeneity, Contrast, Dissimilarity, Entropy, Angular Second Moment, and Correlation aggregated using the mean, first quartile, third quartile, maximum, median, minimum, root mean square, standard deviation, and skewness statistics) at 562m resolution for each site; - a multiband tif file containing the 3 probability grids for either intact, logged, or burned forests at the aggregation resolution (562m) for each site.
54 ENVIRONMENTAL SCIENCES↗
Ion-beam radiation-induced Eshelby transformations: The mean and variance in hydrostatic and shear residual stresses
Ion beam plays a pivotal role in ion implantations and the fabrication of nanostructures. However, there lacks a quantitative model to describe the residual stresses associated with the ion-beam radiation. Radiation-induced residual stress/transformation strain have been mostly recognized in the hydrostatic sub strain space. Here, in this study, we use molecular dynamics (MD) simulations to show that the response of a material to irradiation is generally anisotropic that depends on the ion-beam direction, and should be described using tensorial quantities. We demonstrate that accelerator-based ion beam irradiation, combined with the intrinsic lattice anisotropy and externally induced anisotropy (such as anisotropic mechanical loadings), causes radiation-actuated shear transformation strains in addition to hydrostatic expansion. We map out these complex correlations for several materials. Radiation-induced defects are shown to be responsible for residual shear stresses in the manner of Eshelby inclusion transformation. We propose such tensorial response model should be considered for accurate nanoscale fabrication using ion-beam irradiation.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Sporadic E Morphology from GPS-CHAMP Radio Occultation
The scintillations of phase and amplitude in terms of signal-to-noise ratio (SNR) of the GPS radio occultation signal are caused by thin ionization layers. These thin irregular electron density layers in the E region ionosphere are often called sporadic E (Es). For a monthly retrieval of Es morphology we use the variances of the phase and SNR fluctuations of worldwide ~6000 GPS/CHAMP occultations in the E region. The Es climatology is studied globally with the SNR and phase variances in terms of monthly zonal means, seasonal maps, and diurnal and long-term variations. The zonal mean variances reveal strong, extended Es activities at summertime midlatitudes but weak, confined activities in wintertime high latitudes, peaking at ~105 km. Global maps at 105-km altitude show clear dependence of Es activities on the geomagnetic dip angle, where the summertime midlatitude Es occurs mostly at dip angles of 30 deg. - 60 deg. and the wintertime high-latitude enhancement occurs mostly at dip angles greater than 80 deg. The midlatitude Es variances exhibit a strong semidiurnal variation with peak hours near 0800 1000 and 2000 local solar time, respectively. The peak hours are delayed slightly with decreasing height, suggesting influences from the semidiurnal tide. To provide more insights on the observed SNR and phase variances, we model radio wave propagation for the CHAMP observing geometry under several perturbed cases in the E region ionosphere. The model simulations indicate that the SNR variance has the maximum response to Es perturbations at vertical wavelengths of 1.2 km, whereas the phase response maximizes at ~2 km (for the 1-s variance analysis). The characteristic scale depends little on the truncation time used in the SNR variance analysis, but it increases with the truncation time for the phase variances. Initial studies show that reasonable global Es morphology can be produced on a monthly and seasonal basis with the CHAMP one-antenna occultations. Better results from other existing and upcoming GPS occultation missions are anticipated in future studies, and they will significantly improve our understanding of this important phenomenon.
signal to noise ration (SNR)↗
A study of stratospheric vacillations and sudden warmings on a beta-plane. I - Single wave-mean flow interaction
A beta-plane model of the stratosphere is used to investigate the planetary-wave amplitude vacillations first reported by Holton and Mass (1976). This model differs from theirs in allowing more horizontal modes. For low surface wave amplitudes, a new class of solutions is found which exhibits a stationary, partially reflecting critical line at steady state. The critical line equilibrates at lower altitudes as the wave forcing is increased. Vacillating solutions occur when the steady state critical line occurs near the lower boundary. The maximum wave amplitude and the maximum steady-state wave amplitude found in the model are in the ratio of 2:1, in good agreement with theoretical predictions. The maximum wave amplitude never exceeds 2200 gpm which is quite close to the saturation limit predicted by Schoeberl (1982). An analysis of the statistics of slowly and rapidly vacillating flows shows that both the wave and zonal mean variances are important in determining the time mean, zonal mean dynamics of the upper stratosphere.
Schoeberl, M. R.↗
Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls
Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.
Frequency control↗
Impacts of Permeability Heterogeneity and Background Flow on Supercritical CO 2 Dissolution in the Deep Subsurface
Motivated by CO 2 capture and sequestration (CCS) design considerations, we consider the coupled effects of permeability heterogeneity and background flow on the dissolution of a supercritical CO 2 lens into an underlying deep, confined aquifer. We present the results of a large-scale Monte Carlo simulation study examining the interaction of background flow rate and three parameters describing multi-Gaussian log-permeability fields: mean, variance, and correlation length. Hundreds of high-resolution simulations were performed using the PFLOTRAN finite volume software to model CO 2 dissolution in a kilometer-scale aquifer over 1,000 years. Predictive dimensionless scaling relationships relating CO 2 dissolution rate to heterogeneity statistics, Rayleigh (Ra) and Péclet (Pe) numbers were developed for both gravitationally dominated free convection to background flow-dominated forced convection regimes. An empirical criterion, Pe = Ra 3/4 , was discovered for regime transition. All simulations converged quickly to a quasi-steady, approximately linear dissolution rate. However, this rate displayed profound variability between permeability field realizations sharing the same heterogeneity statistics, even under mild permeability heterogeneity. In general, increased heterogeneity was associated with a lower mean and higher variance of dissolution rate, undesirable from a CCS design perspective. The relationship between dissolution rate and background flow was found to be complex and nonlinear. Dimensionless scaling relationships were uncovered for a number of special cases. Results call into question the validity of the Boussinesq approximation in the context of modest-to-high background flow rates and the general applicability of numerical simulations without background flow.
42 ENGINEERING↗
Distinct dynamical and structural properties of marine stratocumulus and shallow cumulus clouds in the Eastern North Atlantic
Low-level clouds in a marine environment are examined using multiple ground-based instruments. Here, we used Doppler radar and Doppler lidar measurements (1) to examine cloud properties including cloud base and top height and thickness and (2) to investigate vertical velocity (w) statistics throughout the subcloud and in-cloud layers. Marine stratocumulus (Sc) and shallow cumulus (Cu) clouds have distinct properties in their horizontal and vertical extent. We also find that the two cloud types have different thermodynamic (coupled and decoupled conditions) and dynamical characteristics for the first four moments of the w distributions (mean, variance, skewness, and kurtosis). We identify a strong dependence of subcloud mean w on near-surface horizontal wind direction, implying that topographic effects exert a substantial impact on boundary layer dynamics and cloud properties at Graciosa Island. Our findings strongly suggest that care must be taken when interpreting island-based observations as representative of a generic marine dynamical environment. This information also can be useful for guiding and constraining the future global model development using observational dataset.
54 ENVIRONMENTAL SCIENCES↗
Distributions of the Interplanetary Magnetic Field Revisite
The adequacy of the power spectrum to characterize the variations of a parameter depends on whether or not the parameter has a Gaussian distribution. We here perform very simple tests of Gaussianit on the distributions of the magnitudes of the interplanetary magnetic field, and on the distributions of the componentsi.e. we find the first four cumulants of the distributions (mean, variance, skewness and kurtosis).
pwer↗
Image correlation and sampling study
The development of analytical approaches for solving image correlation and image sampling of multispectral data is discussed. Relevant multispectral image statistics which are applicable to image correlation and sampling are identified. The general image statistics include intensity mean, variance, amplitude histogram, power spectral density function, and autocorrelation function. The translation problem associated with digital image registration and the analytical means for comparing commonly used correlation techniques are considered. General expressions for determining the reconstruction error for specific image sampling strategies are developed.
Popp, D. J.↗
Bootstrapping outperforms community‐weighted approaches for estimating the shapes of phenotypic distributions
Abstract Estimating phenotypic distributions of populations and communities is central to many questions in ecology and evolution. These distributions can be characterized by their moments (mean, variance, skewness and kurtosis) or diversity metrics (e.g. functional richness). Typically, such moments and metrics are calculated using community‐weighted approaches (e.g. abundance‐weighted mean). We propose an alternative bootstrapping approach that allows flexibility in trait sampling and explicit incorporation of intraspecific variation, and show that this approach significantly improves estimation while allowing us to quantify uncertainty. We assess the performance of different approaches for estimating the moments of trait distributions across various sampling scenarios, taxa and datasets by comparing estimates derived from simulated samples with the true values calculated from full datasets. Simulations differ in sampling intensity (individuals per species), sampling biases (abundance, size), trait data source (local vs. global) and estimation method (two types of community‐weighting, two types of bootstrapping). We introduce the traitstrap R package, which contains a modular and extensible set of bootstrapping and weighted‐averaging functions that use community composition and trait data to estimate the moments of community trait distributions with their uncertainty. Importantly, the first function in the workflow, trait_fill , allows the user to specify hierarchical structures (e.g. plot within site, experiment vs. control, species within genus) to assign trait values to each taxon in each community sample. Across all taxa, simulations and metrics, bootstrapping approaches were more accurate and less biased than community‐weighted approaches. With bootstrapping, a sample size of 9 or more measurements per species per trait generally included the true mean within the 95% CI. It reduced average percent errors by 26%–74% relative to community‐weighting. Random sampling across all species outperformed both size‐ and abundance‐biased sampling. Our results suggest randomly sampling ~9 individuals per sampling unit and species, covering all species in the community and analysing the data using nonparametric bootstrapping generally enable reliable inference on trait distributions, including the central moments, of communities. By providing better estimates of community trait distributions, bootstrapping approaches can improve our ability to link traits to both the processes that generate them and their effects on ecosystems.
Maitner, Brian S.↗
On the error in crop acreage estimation using satellite (LANDSAT) data
The problem of crop acreage estimation using satellite data is discussed. Bias and variance of a crop proportion estimate in an area segment obtained from the classification of its multispectral sensor data are derived as functions of the means, variances, and covariance of error rates. The linear discriminant analysis and the class proportion estimation for the two class case are extended to include a third class of measurement units, where these units are mixed on ground. Special attention is given to the investigation of mislabeling in training samples and its effect on crop proportion estimation. It is shown that the bias and variance of the estimate of a specific crop acreage proportion increase as the disparity in mislabeling rates between two classes increases. Some interaction is shown to take place, causing the bias and the variance to decrease at first and then to increase, as the mixed unit class varies in size from 0 to 50 percent of the total area segment.
Chhikara, R.↗
Closures and Simulation for Thermal Radiation Transport in Stochastic Media with Nonlinear Temperature Dependence
Because of the practical challenge of rendering very complex realistic spatial structures for numerical work, it is common practice to resort to characterizing such media as stochastic mixtures of materials, ideally parametrized with low order statistics such as the mean, variance, and correlation functions of the now random material properties. This enables realizations of the medium to be repeatedly generated and radiation transport computations to, in principle, be performed for a large ensemble of these realizations to obtain a statistically well-characterized radiation field. Statistical post-processing yields desired quantities such as conditional and unconditional mean radiation flux and probability distributions of transmitted radiation. However, such computations prove expensive for all but the simplest stochastic geometries and are most suited for benchmarking approximate models. The most common approximations lead to homogenized media so that transport computations are required only on a single medium realization but by construct provide only limited statistical information on the radiation field. Almost all approximate approaches to this problem attempt to develop equations for low order moments of the radiation intensity (mean, second moment, correlation function) but inevitably encounter a closure problem: the equation for any statistical moment will contain terms depending on unknown higher-order moments. Thus, the challenge shifts to one of developing closure relations that relate the unknown moments to the lower order moments. Under very special conditions, an exact closure can be derived but in general closures are heuristically stated constitutive relations. Also, closure approaches depend on whether the mixing statistics are spatially and/or temporally continuous as in fluctuating turbulent fields, or discontinuous as in randomly mixed solid chunks of material. Thus, unconditional averaging is generally applied in the former case but conditional averaging is more appropriate when the mixing is discontinuous. In this work, the emphasis is on binary statistical mixtures of immiscible fluids as as such the quantities of interest are averages (flux, temperature) conditioned on the material type.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Improving Self-Driving Labs: Quantifying System-Level Experiment Repeatability and Broadening Instrument-Level Compatibility
Modular Autonomous Research System (MARS) is a self-driving laboratory (SDL) which performs wet-lab science with peptide-lanthanide combinations in an automated and, ultimately, an autonomous manner to aid in soil analysis for domestic lithium mining. Autonomous experimentation involves automated experimentation, experiment planning, and active learning. MARS consists of a 6-axis robotic arm (UR5e) on a linear rail, pipette robots (Opentrons 2), and microplate readers. These components transport, operate on, and collect data with chemical solutions in standard labware. For effective autonomy, MARS must perform system-level labware operations repeatably, plan experiments autonomously, and be portable between research-domains. Repeatability is evaluated by labware placement precision, such that future operations can properly locate labware, as well as the elapsed time, so that low variance mean estimates of experiment duration can inform high-level researcher decision making. Autonomous experiment planning is the next step to decouple experimentation from human management; however, there is a conflict between the ideal system-level experiment goals and the constraints imposed by instruments’ limitations. Sub-domain portability is a long-term goal to extend MARS’ research beyond the chemistry of peptide-lanthanide binding to other sub-domains without having to invest significant overhead to system retrofitting. To address these goals, we manually trained the robotic arm labware placement and modelled statistical failurerate and uncertainty Additionally, we benchmarked the duration and variance of each experiment sub-operation as a heuristic for research decision making. Next, we use a parameterized geometric program (PGP) approach to design experiments that optimize system-level objectives and satisfy instrument-level constraints. Lastly, we proposed a Python framework to maximize MARS’ extensibility to other scientific sub-domains through a JSON-based experiment specification.
36 MATERIALS SCIENCE↗