Search NASA⌕ Search

SEARCH · Search NASA

Results for “sampling size”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Spectroscopy-based isotopic (δ 13 C) analysis for high spatial resolution of carbon exchange in the rhizosphere

The rhizosphere is a highly dynamic zone bridging plant roots with needed nutrient resources in soil. While the rhizosphere may be small, it has a disproportionally large impact on plant success and biomass production. A suite of rhizosphere-hosted microbial and geochemical interactions facilitate nutrient acquisition by plant roots, and, in turn, the roots stimulate these processes by supplying organic carbon into the rhizosphere. The small physical dimensions of the rhizosphere, however, can constrain efforts to elucidate key carbon exchange processes and their spatial extent and localization. We present a method for spatially resolved δ 13 C analysis of rhizosphere samples by coupling laser ablation (LA) sampling with isotopic analysis using capillary absorption spectroscopy (CAS) which differs from conventional mass spectrometer (MS) approaches. The CAS system has high sensitivity (requires fewer nanomoles of CO 2 per analysis) than comparable MS systems, which enables reduced sample size requirements to thereby improve spatial resolution (from 25 μm to as low as a projected 5 μm spatial resolution). We demonstrate the utility of CAS using rhizosphere samples from switchgrass plants exposed to 13 CO 2 . As a result, this technique will provide a capability for tracking the extent and spatial distribution of root exudate into the rhizosphere at highly detailed spatial scales.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

In-Situ SEM High Strain Rate Testing of Large Diameter Micropillars Followed by TEM and EBSD Postmortem Analysis

Background Dislocation dynamic simulations are intended as a tool to understand and predict the mechanical behavior of metallic materials, but its prediction has never been directly verified by experiments due to differences in specimen strain rate and size. Objective In this work, a comprehensive experimental framework is proposed to attempt direct comparison between experiments and discrete dislocation dynamics (DDD) modelling. Methods By integrating high-throughput sample fabrication and a customized testing apparatus, the sample size and strain rate typically employed in DDD simulations are explored experimentally. Constitutive properties such as stress-strain response are measured, and microstructural information is obtained from transmission electron microscopy (TEM) imaging, electron backscatter diffraction (EBSD), and TEM-based orientation mapping. Results Magnesium and copper were selected, as case studies, to demonstrate the newly developed experimental procedure. Measured stress-strain responses for Mg are consistent with those obtained with a miniaturized Hopkison bar experiments. Furthermore, by exploiting the validated workflow, the effect of strain rate on micropillar heterogeneous deformation and associated dislocation plasticity were revealed. Conclusion The work establishes a methodology for the systematic study of not only metals but also other materials and structures at the microscale and high strain rates.

42 ENGINEERING↗
DOE OSTI2026

Dataset 3: A National Dataset on Actionable Items in Improving Pooled Rideshare, 2025.

Dataset 3: A National Dataset on Actionable Items in Improving Pooled Rideshare.” 2025. Dataset Description: Pooled Rideshare Acceptance Survey - Phase 3 (2025, N = 8,296). This dataset represents the third and final phase of a national survey aimed at understanding user acceptance and preferences related to pooled rideshare (PR) services in the United States. Building on insights from earlier phases, this phase expands both the sample size and the depth of analysis to support policymaking, transportation planning, and service design for sustainable mobility systems. The Phase 3 survey was administered online to a nationally representative sample of 8,296 U.S. adults. The sample includes a wide range of demographics. The survey retained core questions from previous phases while introducing 77 detailed service features (actionable items) to evaluate potential improvements to PR offerings. Each feature was designed to assess whether a specific improvement, such as enhanced safety measures, real-time ride tracking, or user training would increase participants’ willingness to adopt PR services. In addition, behavioral predictors, current rideshare habits, environmental attitudes, and perceived barriers (e.g., safety, privacy, and comfort) were captured. - Phase_3_Final - The dataset contains rows corresponding to individual respondents and columns representing survey items, demographic characteristics, and response values. The data is available in both .CSV and .SAV formats. - Phase_3_Final_MapFile - Accompanying this dataset is a data dictionary explaining each variable, value range, and coding schema. An .XLSX format of the full survey instrument is included to support interpretation and reuse of the dataset.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Using a Neural Network Classifier to Select Galaxies with the Most Accurate Photometric Redshifts

The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will produce several billion photometric redshifts (photo-z's), enabling cosmological analyses to select a subset of galaxies with the most accurate photo-z. For this work, we perform initial redshift fits on Subaru Strategic Program galaxies with deep grizy photometry using Trees for Photo-Z (TPZ) before applying a custom neural network classifier (NNC) tuned to select galaxies with (z phot – z spec )/(1 + z spec ) < 0.10. We consider four cases of training and test sets ranging from an idealized case to using data augmentation to increase the representation of dim galaxies in the training set. Selections made using the NNC yield significant further improvements in outlier fraction and photo-z scatter (σ z ) over those made with typical photo-z uncertainties. As an example, when selecting the best third of the galaxy sample, the NNC achieves a 35% improvement in outlier rate and a 23% improvement in σ z compared to using uncertainties from TPZ. For cosmology and galaxy evolution studies, this method can be tuned to retain a particular sample size or to achieve a desired photo-z accuracy; our results show that it is possible to retain more than a third of an LSST-like galaxy sample while reducing σ z by a factor of 2 compared to the full sample, with one-fifth as many photo-z outliers. For surveys like LSST that are not limited by shot noise, this method enables a larger number of tomographic redshift bins and hence a significant increase in the total signal to noise of galaxy angular power spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Cluster expansion by transfer learning for phase stability predictions

Recent progress towards universal machine-learned interatomic potentials holds considerable promise for materials discovery. Yet the accuracy of these potentials for predicting phase stability may still be limited. In contrast, cluster expansions provide accurate phase stability predictions but are computationally demanding to parameterize from first principles, especially for structures of low dimension or with a large number of components, such as interfaces or multimetal catalysts. We overcome this trade-off via transfer learning. Using Bayesian inference, we incorporate prior statistical knowledge from machine-learned and physics-based potentials, enabling us to sample the most informative configurations and to efficiently fit first-principles cluster expansions. Furthermore, this algorithm is tested on Pt:Ni, showing robust convergence of the mixing energies as a function of sample size with reduced statistical fluctuations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Advanced biorefinery feedstock from non-recyclable municipal solid waste by mechanical preprocessing

Because of accelerated urbanization and the development of a global economy, a large quantity of municipal solid waste (MSW) has been collected and disposed of by the municipalities. Due to this drastic increase in the disposal of MSW, the need for its management is a must to preserve the environment. Currently, approximately 50% of the total MSW generated in the United States has been utilized through various recycling, combustion, and composting technologies, which means the remaining 50% is sent to landfill; this is often known as non-recyclable MSW (nMSW). As this nMSW is physically and chemically heterogenous and contains very high amounts of inorganic material, processing is required prior to using it as a biorefinery feedstock. Thus, this study focused on how mechanical preprocessing advanced the physical and chemical properties of nMSW. The physical and chemical properties were investigated in terms of particle size distribution, bulk density, ultimate and proximate analysis, and the higher heating value (HHV). The combustion properties were examined in terms of ignition temperature, peak heat release rate, and combustion efficiency. Results showed that the variability of physical and chemical properties of nMSW can be reduced by mechanical preprocessing. For example, the variability of the bulk density of the as-received nMSW was approximately 17.3% while it reduced to 5.8% when the sample size was reduced to 2 mm. Similarly, the variability of ash and HHV reduced from 49.2% to 11.0% and 13.4%–4.2%, respectively. Combustion thermograms showed that the size reduction positively improved the combustion properties. For example, 2 mm of spec sample started to ignite approximately 4 times earlier and took 6.5 folds less time to reach the peak heating rate compared to as-received nMSW. Overall, the mechanical preprocessing reduced the variability of physical and chemical properties in addition to the improvement of combustion behavior of the nMSW which is one step forward toward the biorefinery feedstock.

09 BIOMASS FUELS↗
DOE OSTI2024

Investigating the ecological fallacy through sampling distributions constructed from finite populations

Correlation coefficients and linear regression values computed from group averages can differ from correlation coefficients and linear regression values computed using individual scores. This observation known as the ecological fallacy often assumes that all the individual scores are available from a population. In many situations, one must use a sample from the larger population. In such cases, the computed correlation coefficient and linear regression values will depend on the sample that is chosen and the underlying sampling distribution. The sampling distribution of correlation coefficients and linear regression values for group averages will be identical to the sampling distribution for individuals for normally distributed variables for random samples drawn from infinitely large continuous distributions. However, data that is acquired in practice is often acquired when sampling without replacement from a finite population. Our objective is to demonstrate through Monte Carlo simulations that the sampling distributions for correlation and linear regression will also be similar for individuals and group averages when sampling without replacement from normally distributed variables. These simulations suggest that when a random sample from a population is selected, the correlation coefficients and linear regression values computed from individual scores will not be more accurate in estimating the entire population values compared to samples when group averages are used as long as the sample size is the same.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Design of a robot-automated flat plate/reflection geometry x-ray diffraction setup for accelerated materials discovery and structural screening

Here, we report the design, construction, and automation of a flat plate sample loading, alignment, and data acquisition system for X-ray diffraction measurements in reflection geometry implemented at the Stanford Synchrotron Radiation Lightsource. The system is built onto a single platform, enabling facile transferability, and is compartmentalized into sample storage, sample transfer, and sample position/alignment segments. The core feature of this system is a six-axis robotic arm that offers a large range of highly reproducible and programable movements. The degrees of freedom of the robot arm enable adaptability in which movements can be modified to fit various beamline environments and sample configurations. Samples are housed on 3D printed sample mounts, which are arranged onto a 6 × 2 array of sample cassettes capable of holding 7 samples. Using sample mounts designed for solid oxide electrolysis button cells (SOECs), the maximum tray capacity is 84 samples, which can be aligned and run in ~ 24 hours with long exposure scans. The sample array is additionally capable of accommodating a range of sample sizes and geometries due to the rapid 3D printed fabrication. The components of the setup will be described in detail and performance will be demonstrated with a set of representative SOEC and XRD standard samples. Opportunities for future developments and integration with the automated setup are summarized.

08 HYDROGEN↗
DOE OSTI2023

Overestimated prediction using polygenic prediction derived from summary statistics

When polygenic risk score (PRS) is derived from summary statistics, independence between discovery and test sets cannot be monitored. We compared two types of PRS studies derived from raw genetic data (denoted as rPRS) and the summary statistics for IGAP (sPRS). Two variables with the high heritability in UK Biobank, hypertension, and height, are used to derive an exemplary scale effect of PRS. sPRS without APOE is derived from International Genomics of Alzheimer’s Project (IGAP), which records ΔAUC and ΔR 2 of 0.051 ± 0.013 and 0.063 ± 0.015 for Alzheimer’s Disease Sequencing Project (ADSP) and 0.060 and 0.086 for Accelerating Medicine Partnership - Alzheimer’s Disease (AMP-AD). On UK Biobank, rPRS performances for hypertension assuming a similar size of discovery and test sets are 0.0036 ± 0.0027 (ΔAUC) and 0.0032 ± 0.0028 (ΔR 2 ). For height, ΔR 2 is 0.029 ± 0.0037. Considering the high heritability of hypertension and height of UK Biobank and sample size of UK Biobank, sPRS results from AD databases are inflated. Independence between discovery and test sets is a well-known basic requirement for PRS studies. However, a lot of PRS studies cannot follow such requirements because of impossible direct comparisons when using summary statistics. Thus, for sPRS, potential duplications should be carefully considered within the same ethnic group.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Transport Simulations on Scanning Transmission Electron Microscope Images of Nanoporous Shale

Digital rock physics is an often-mentioned approach to better understand and model transport processes occurring in tight nanoporous media including the organic and inorganic matrix of shale. Workflows integrating nanometer-scale image data and pore-scale simulations are relatively undeveloped, however. In this paper, a workflow is demonstrated progressing from sample acquisition and preparation, to image acquisition by Scanning Transmission Electron Microscopy (STEM) tomography, to volumetric reconstruction to pore-space discretization to numerical simulation of pore-scale transport. Key aspects of the workflow include (i) STEM tomography in high angle annular dark field (HAADF) mode to image three-dimensional pore networks in µm-sized samples with nanometer resolution and (ii) lattice Boltzmann method (LBM) simulations to describe gas flow in slip, transitional, and Knudsen diffusion regimes. It is shown that STEM tomography with nanoscale resolution yields excellent representation of the size and connectivity of organic nanopore networks. In turn, pore-scale simulation on such networks contributes to understanding of transport and storage properties of nanoporous shale. Interestingly, flow occurs primarily along pore networks with pore dimensions on the order of tens of nanometers. Smaller pores do not form percolating pathways in the sample volume imaged. Apparent gas permeability in the range of 10−19 to 10−16 m2 is computed.

42 ENGINEERING↗
DOE OSTI2024

The DEHVILS in the details: Type Ia supernova Hubble residual comparisons and mass step analysis in the near-infrared

Measurements of type Ia supernovae (SNe Ia) in the near-infrared (NIR) have been used both as an alternate path to cosmology compared to optical measurements and as a method of constraining key systematics for the larger optical studies. With the DEHVILS sample, the largest published NIR sample with consistent NIR coverage of maximum light across three NIR bands ( Y, J , and H ), we check three key systematics: (i) the reduction in Hubble residual scatter as compared to the optical, (ii) the measurement of a “mass step” or lack thereof and its implications, and (iii) the ability to distinguish between various dust models by analyzing slopes and correlations between Hubble residuals in the NIR and optical. We produce SN Ia simulations of the DEHVILS sample and find that it is harder to differentiate between various dust models than previously understood. Additionally, we find that fitting with the current SALT3-NIR model does not yield accurate wavelength-dependent stretch-luminosity correlations, and we propose a limited solution for this problem. From the data, we see that (i) the standard deviation of Hubble residual values from NIR bands treated as standard candles are 0.007–0.042 mag smaller than those in the optical, (ii) the NIR mass step is not constrainable with the current sample size of 47 SNe Ia from DEHVILS, and (iii) Hubble residuals in the NIR and optical are correlated in the data. We test a few variations on the number and combinations of filters and data samples, and we observe that none of our findings or conclusions are significantly impacted by these modifications.

Astronomy & Astrophysics↗
DOE OSTI2021

Universal L - 3 finite-size effects in the viscoelasticity of amorphous systems

We present a theory of viscoelasticity of amorphous media, which takes into account the effects of confinement along one of three spatial dimensions. The framework is based on the nonaffine extension of lattice dynamics to amorphous systems, or nonaffine response theory. The size effects due to the confinement are taken into account via the nonaffine part of the shear storage modulus G'. The nonaffine contribution is written as a sum over modes in k-space. With a rigorous argument based on the analysis of the k-space integral over modes, it is shown that the confinement size L in one spatial dimension, e.g., the z axis, leads to a infrared cutoff for the modes contributing to the nonaffine (softening) correction to the modulus that scales as L -3 . Corrections for finite sample size D in the two perpendicular dimensions scale as ~(L/D) 4 , and are negligible for L«D. For liquids it is predicted that G'~L -3 is in agreement with a previous more approximate analysis, whereas for amorphous materials G'~G' bulk +βL -3 . For the case of liquids, four different experimental systems are shown to be very well described by the L-3 law. The theory can also explain previous simulation data of confined jammed granular packings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Online MCMC Thinning with Kernelized Stein Discrepancy

A fundamental challenge in Bayesian inference is efficient representation of a target distribution. Many nonparametric approaches do so by sampling a large number of points using variants of Markov chain Monte Carlo (MCMC). Here, we propose an MCMC variant that retains only those posterior samples which exceed a kernelized Stein discrepancy (KSD) threshold, which we call KSD thinning. We establish the convergence and complexity trade-offs for several settings of KSD thinning as a function of the KSD threshold parameter, sample size, and other problem parameters. We provide experimental comparisons against other online nonparametric Bayesian methods that generate low-complexity posterior representations. We observe superior consistency/complexity trade-offs across a range of settings including MCMC sampling on two Bayesian inference problems from the biological sciences, and 10 × inference speedup and storage reduction for Bayesian neural networks with no loss of accuracy and no increase in training time. Our code is available at https://github.com/colehawkins/KSD-Thinning.

Bayesian inference↗
DOE OSTI2022

Quasar Identification Using Multivariate Probability Density Estimated from Nonparametric Conditional Probabilities

Nonparametric estimation for a probability density function that describes multivariate data has typically been addressed by kernel density estimation (KDE). A novel density estimator recently developed by Farmer and Jacobs offers an alternative high-throughput automated approach to univariate nonparametric density estimation based on maximum entropy and order statistics, improving accuracy over univariate KDE. This article presents an extension of the single variable case to multiple variables. The univariate estimator is used to recursively calculate a product array of one-dimensional conditional probabilities. In combination with interpolation methods, a complete joint probability density estimate is generated for multiple variables. Good accuracy and speed performance in synthetic data are demonstrated by a numerical study using known distributions over a range of sample sizes from 100 to 10 6 for two to six variables. Performance in terms of speed and accuracy is compared to KDE. The multivariate density estimate developed here tends to perform better as the number of samples and/or variables increases. As an example application, measurements are analyzed over five filters of photometric data from the Sloan Digital Sky Survey Data Release 17. The multivariate estimation is used to form the basis for a binary classifier that distinguishes quasars from galaxies and stars with up to 94% accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Optimizing radar scan strategies for tracking isolated deep convection using observing system simulation experiments

Abstract. Optimizing radar observation strategies is one of the most important considerations in pre-field campaign periods. This is especially true for isolated convective clouds that typically evolve faster than the observations captured by operational radar networks. This study investigates uncertainties in radar observations of the evolution of the microphysical and dynamical properties of isolated deep convective clouds developing in clean and polluted environments. It aims to optimize the radar observation strategy for deep convection through the use of high-spatiotemporal cloud-resolving model simulations, which resolve the evolution of individual convective cells every 1 min, coupled with a radar simulator and a cell tracking algorithm. The radar simulation settings are based on the Tracking Aerosol Convection Interactions ExpeRiment (TRACER) and Experiment of Sea Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field campaigns held in the Houston, TX, area but are generalizable to other field campaigns focusing on isolated deep convection. Our analysis produces the following four outcomes. First, a 5–7 m s−1 median difference in maximum updrafts of tracked cells is shown between the clean and polluted simulations in the early stages of the cloud lifetimes. This demonstrates the importance of obtaining accurate estimates of vertical velocity from observations if aerosol impacts are to be properly resolved. Second, tracking of individual cells and using vertical cross section scanning every minute capture the evolution of precipitation particle number concentration and size represented by polarimetric observables better than the operational radar observations that update the volume scan every 5 min. This approach also improves multi-Doppler radar updraft retrievals above 5 km above ground level for regions with updraft velocities greater than 10 m s−1. Third, we propose an optimized strategy composed of cell tracking by quick (1–2 min) vertical cross section scans from more than one radar in addition to the operational volume scans. We also propose the use of a single-RHI (range height indicator) updraft retrieval technique for cells close to the radars, for which multi-Doppler radar retrievals are still challenging. Finally, increasing the number of deep convective cells sampled by such observations better represents the median maximum updraft evolution with sample sizes of more than 10 deep cells, which decreases the error associated with sampling the true population to less than 3 m s−1.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

An Improved Boosting to Amplify Signal with Isobaric Labeling (iBASIL) Strategy for Precise Quantitative Single-cell Proteomics

Mass spectrometry (MS)-based proteomics has great potential for overcoming the limitations of antibody-based immunoassays for antibody-independent, comprehensive, and quantitative proteomic analysis of single cells. Indeed, recent advances in nanoscale sample preparation have enabled effective processing of single cells. In particular, the concept of using boosting/carrier channels in isobaric labeling to increase the sensitivity in MS detection has also been increasingly used for quantitative proteomic analysis of small-sized samples including single cells. However, the full potential of such boosting/carrier approaches has not been significantly explored, nor has the resulting quantitation quality been carefully evaluated. Herein, we have further evaluated and optimized our recent boosting to amplify signal with isobaric labeling (BASIL) approach, originally developed for quantifying phosphorylation in small number of cells, for highly effective analysis of proteins in single cells. This improved BASIL (iBASIL) approach enables reliable quantitative single-cell proteomics analysis with greater proteome coverage by carefully controlling the boosting-to-sample ratio (e.g. in general <100×) and optimizing MS automatic gain control (AGC) and ion injection time settings in MS/MS analysis (e.g. 5E5 and 300 ms, respectively, which is significantly higher than that used in typical bulk analysis). By coupling with a nanodroplet-based single cell preparation (nanoPOTS) platform, iBASIL enabled identification of ~2500 proteins and precise quantification of ~1500 proteins in the analysis of 104 FACS-isolated single cells, with the resulting protein profiles robustly clustering the cells from three different acute myeloid leukemia cell lines. This study highlights the importance of carefully evaluating and optimizing the boosting ratios and MS data acquisition conditions for achieving robust, comprehensive proteomic analysis of single cells.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Data for: Patel et al. Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data

This dataset contains data and code used for the paper "Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data" [DOI COMING SOON]A large literature exists on mechanisms driving soil production of the greenhouse gases CO2 and CH4. Measurements of these gases’ fluxes are often performed using closed-chamber incubations in the laboratory or in situ, i.e., in the field. Although it is common knowledge that measurements obtained through field studies vs. laboratory incubations can diverge because of the vastly different conditions of these environments, few studies have systematically examined these patterns. It is crucial to understand the magnitude and reasons for any differences, as these data are used to parametrize and benchmark ecosystem- to global-scale models, which are then susceptible to the biases of the source data. Here, we specifically examine how greenhouse gas measurements may be influenced by whether the measurement/incubation was conducted in the field vs. laboratory, focusing on CO2 and CH4 measurements. We use Q10 of greenhouse gas flux (temperature sensitivity) for our analyses, because of the ubiquity of this metric in biological and Earth system sciences and its importance to many modeling frameworks. We predicted that laboratory measurements would be less variable, but also less representative of true field conditions. However, there was greater variability in the Q10 values calculated from lab-based measurements of CO2 fluxes, because lab experiments explore extremes rarely seen in situ, and reflect the physical and chemical disturbances occurring during sampling, transport, and incubation. Overall, respiration Q10 values were significantly greater in laboratory incubations (mean = 4.19) than field measurements (mean = 3.05), with strong influences of incubation temperature and climate region/biome. However, this was in part because field measurements typically represent total respiration (Rs), whereas lab incubations typically represent heterotrophic respiration (Rh), making direct comparisons difficult to interpret. Focusing only on Rh-derived Q10, these values showed almost identical distributions across laboratory (n = 1110) and field (n = 581) experiments, providing strong support for using the former as an experimental proxy for the latter, although we caution that geographic biases in the extant data make this conclusion tentative. Due to a smaller sample size of CH4 Q10 data, we were unable to perform a comparable robust analysis, but we expect similar interactions with soil temperature, moisture, and environmental/climatic variables. Our results here suggest the need for more concerted efforts to document and standardize these data, including sample and site metadata. This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/field_lab_q10 (DOI: 10.5281/zenodo.7106554).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Extreme metrics from large ensembles: investigating the effects of ensemble size on their estimates

Abstract. We consider the problem of estimating the ensemble sizes required to characterize the forced component and the internal variability of a number of extreme metrics. While we exploit existing large ensembles, our perspective is that of a modeling center wanting to estimate a priori such sizes on the basis of an existing small ensemble (we assume the availability of only five members here). We therefore ask if such a small-size ensemble is sufficient to estimate accurately the population variance (i.e., the ensemble internal variability) and then apply a well-established formula that quantifies the expected error in the estimation of the population mean (i.e., the forced component) as a function of the sample size n, here taken to mean the ensemble size. We find that indeed we can anticipate errors in the estimation of the forced component for temperature and precipitation extremes as a function of n by plugging into the formula an estimate of the population variance derived on the basis of five members. For a range of spatial and temporal scales, forcing levels (we use simulations under Representative Concentration Pathway 8.5) and two models considered here as our proof of concept, it appears that an ensemble size of 20 or 25 members can provide estimates of the forced component for the extreme metrics considered that remain within small absolute and percentage errors. Additional members beyond 20 or 25 add only marginal precision to the estimate, and this remains true when statistical inference through extreme value analysis is used. We then ask about the ensemble size required to estimate the ensemble variance (a measure of internal variability) along the length of the simulation and – importantly – about the ensemble size required to detect significant changes in such variance along the simulation with increased external forcings. Using the F test, we find that estimates on the basis of only 5 or 10 ensemble members accurately represent the full ensemble variance even when the analysis is conducted at the grid-point scale. The detection of changes in the variance when comparing different times along the simulation, especially for the precipitation-based metrics, requires larger sizes but not larger than 15 or 20 members. While we recognize that there will always exist applications and metric definitions requiring larger statistical power and therefore ensemble sizes, our results suggest that for a wide range of analysis targets and scales an effective estimate of both forced component and internal variability can be achieved with sizes below 30 members. This invites consideration of the possibility of exploring additional sources of uncertainty, such as physics parameter settings, when designing ensemble simulations.

54 ENVIRONMENTAL SCIENCES↗