Search NASA⌕ Search

SEARCH · Search NASA

Results for “ordered statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

A statistical model approximation for perovskite solid-solutions: a Raman study of lead-zirconate- titanate single crystal

Lead titanate (PbTiO3) is a classical example of a ferroelectric perovskite oxide illustrating a displacive phase transition accompanied by a softening of a symmetry-breaking mode. The underlying assumption justifying the soft-mode theory is that the crystal is macroscopically sufficiently uniform so that a meaningful free energy function can be formed. In contrast to PbTiO3, experimental studies show that the phase transition behaviour of lead-zirconate-titanate solid solution (PZT) is far more subtle. Most of the studies on the PZT system have been dedicated to ceramic or powder samples, in which case an unambiguous soft-mode study is not possible, as modes with different symmetries appear together. Our Raman scattering study on titanium-rich PZT single crystal shows that the phase transitions in PZT cannot be described by a simple soft-mode theory. In strong contrast to PbTiO3, splitting of transverse E-symmetry modes reveals that there are different locally-ordered regions. The role of crystal defects, random distribution of Ti and Zr at the B- cation site and Pb ions shifted away from their ideal positions, dictates the phase transition mechanism. A statistical model explaining the observed peak splitting and phase transformation to a complex state with spatially varying local order in the vicinity of the morphotropic phase boundary is given.

Frantti, Johannes↗

Assessment of the accuracy of coupled cluster perturbation theory for open-shell systems. I. Triples expansions

The accuracy at which total energies of open-shell atoms and organic radicals may be calculated is assessed for selected coupled cluster perturbative triples expansions, all of which augment the coupled cluster singles and doubles (CCSD) energy by a non-iterative correction for the effect of triple excitations. Namely, the second- through sixth-order models of the recently proposed CCSD(T–n) triples series [J. J. Eriksen et al., J. Chem. Phys. 140, 064108 (2014)] are compared to the acclaimed CCSD(T) model for both unrestricted as well as restricted open-shell Hartree-Fock (UHF/ROHF) reference determinants. By comparing UHF- and ROHF-based statistical results for a test set of 18 modest-sized open-shell species with comparable RHF-based results, no behavioral differences are observed for the higher-order models of the CCSD(T–n) series in their correlated descriptions of closed- and open-shell species. In particular, we find that the convergence rate throughout the series towards the coupled cluster singles, doubles, and triples (CCSDT) solution is identical for the two cases. For the CCSD(T) model, on the other hand, not only its numerical consistency, but also its established, yet fortuitous cancellation of errors breaks down in the transition from closed- to open-shell systems. The higher-order CCSD(T–n) models (orders n > 3) thus offer a consistent and significant improvement in accuracy relative to CCSDT over the CCSD(T) model, equally for RHF, UHF, and ROHF reference determinants, albeit at an increased computational cost.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Generalizing the self-healing diffusion Monte Carlo approach to finite temperature: A path for the optimization of low-energy many-body bases

A statistical method is derived for the calculation of thermodynamic properties of many-body systems at low temperatures. This method is based on the self-healing diffusion Monte Carlo method for complex functions [F. A. Reboredo, J. Chem. Phys. 136, 204101 (2012)] and some ideas of the correlation function Monte Carlo approach [D. M. Ceperley and B. Bernu, J. Chem. Phys. 89, 6316 (1988)]. In order to allow the evolution in imaginary time to describe the density matrix, we remove the fixed-node restriction using complex antisymmetric guiding wave functions. In the process we obtain a parallel algorithm that optimizes a small subspace of the many-body Hilbert space to provide maximum overlap with the subspace spanned by the lowest-energy eigenstates of a many-body Hamiltonian. We show in a model system that the partition function is progressively maximized within this subspace. We show that the subspace spanned by the small basis systematically converges towards the subspace spanned by the lowest energy eigenstates. Possible applications of this method for calculating the thermodynamic properties of many-body systems near the ground state are discussed. The resulting basis can also be used to accelerate the calculation of the ground or excited states with quantum Monte Carlo.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

BARS DO DRIVE SPIRAL DENSITY WAVES

Recently, Buta et al. examined the question 'Do Bars Drive Spiral Density Waves?', an idea supported by theoretical studies and also from a preliminary observational analysis. They estimated maximum bar strengths Q{sub b} , maximum spiral strengths Q{sub s} , and maximum m = 2 arm contrasts A {sub 2s} for 23 galaxies with deep Anglo-Australian Telescope (AAT) K{sub s} -band images. These were combined with previously published Q{sub b} and Q{sub s} values for 147 galaxies from the Ohio State University Bright Spiral Galaxy Survey (OSUBSGS) sample and with the 12 galaxies from Block et al. Weak correlation between Q{sub b} and Q{sub s} was confirmed for the combined sample, whereas the AAT subset alone showed no significant correlations between Q{sub b} and Q{sub s} , nor between Q{sub b} and A {sub 2s}. A similar negative result was obtained in Durbala et al. for 46 galaxies. Based on these studies, the answer to the above question remains uncertain. Here we use a novel approach, and show that although the correlation between the maximum bar and spiral parameters is weak, these parameters do correlate when compared locally. For the OSUBSGS sample, a statistically significant correlation is found between the local spiral amplitude, and the forcing due to the bar's potential at the same distance, out to {approx}1.6 bar radii (the typical bar perturbation is then of the order of a few percent). Also for the sample of 23 AAT galaxies of Buta et al., we find a significant correlation between local parameters out to {approx}1.4 bar radii. Our new results confirm that, at least in a statistical sense, bars do indeed drive spiral density waves.

79 ASTRONOMY AND ASTROPHYSICS↗

Jensen-Feynman approach to the statistics of interacting electrons

Faussurier et al. [Phys. Rev. E 65, 016403 (2001)] proposed to use a variational principle relying on Jensen-Feynman (or Gibbs-Bogoliubov) inequality in order to optimize the accounting for two-particle interactions in the calculation of canonical partition functions. It consists of a decomposition into a reference electron system and a first-order correction. The procedure appears to be very efficient in order to evaluate the free energy and the orbital populations. In this work, we present numerical applications of the method and propose to extend it using a reference energy which includes the interaction between two electrons inside a given orbital. This is possible, thanks to our efficient recursion relation for the calculation of partition functions. We also show that a linear reference energy, however, is usually sufficient to achieve a good precision and that the most promising way to improve the approach of Faussurier et al. is to apply Jensen's inequality to a more convenient convex function.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integrated Process Monitoring based on Systems of Sensors for Enhanced Nuclear Safeguards Sensitivity and Robustness

This paper illustrates safeguards benefits that process monitoring (PM) can have as a diversion deterrent and as a complementary safeguards measure to nuclear material accountancy (NMA). In order to infer the possible existence of proliferation-driven activities, the objective of NMA-based methods is often to statistically evaluate materials unaccounted for (MUF) computed by solving a given mass balance equation related to a material balance area (MBA) at every material balance period (MBP), a particular objective for a PM-based approach may be to statistically infer and evaluate anomalies unaccounted for (AUF) that may have occurred within a MBP. Although possibly being indicative of proliferation-driven activities, the detection and tracking of anomaly patterns is not trivial because some executed events may be unobservable or unreliably observed as others. The proposed similarity between NMA- and PM-based approaches is important as performance metrics utilized for evaluating NMA-based methods, such as detection probability (DP) and false alarm probability (FAP), can also be applied for assessing PM-based safeguards solutions. To this end, AUF count estimates can be translated into significant quantity (SQ) equivalents that may have been diverted within a given MBP. A diversion alarm is reported if this mass estimate is greater than or equal to the selected value for alarm level (AL), appropriately chosen to optimize DP and FAP based on the particular characteristics of the monitored MBA, the sensors utilized, and the data processing method employed for integrating and analyzing collected measurements. To illustrate the application of the proposed PM approach, a protracted diversion of Pu in a waste stream was selected based on incomplete fuel dissolution in a dissolver unit operation, as this diversion scenario is considered to be problematic for detection using NMA-based methods alone. Results demonstrate benefits of conducting PM under a system-centric strategy that utilizes data collected from a system of sensors and that effectively exploits known characterizations of sensors and facility operations in order to significantly improve anomaly detection, reduce false alarm, and enhance assessment robustness under unreliable partial sensor information.

97 MATHEMATICS AND COMPUTING↗

Statistical results from the Virginia Tech propagation experiment using the Olympus 12, 20, and 30 GHz satellite beacons

Virginia Tech has performed a comprehensive propagation experiment using the Olympus satellite beacons at 12.5, 19.77, and 29.66 GHz (which we refer to as 12, 20, and 30 GHz). Four receive terminals were designed and constructed, one terminal at each frequency plus a portable one with 20 and 30 GHz receivers for microscale and scintillation studies. Total power radiometers were included in each terminal in order to set the clear air reference level for each beacon and also to predict path attenuation. More details on the equipment and the experiment design are found elsewhere. Statistical results for one year of data collection were analyzed. In addition, the following studies were performed: a microdiversity experiment in which two closely spaced 20 GHz receivers were used; a comparison of total power and Dicke switched radiometer measurements, frequency scaling of scintillations, and adaptive power control algorithm development. Statistical results are reported.

Stutzman, Warren L.↗

Statistical Inference for Porous Materials using Persistent Homology.

We propose a porous materials analysis pipeline using persistent homology. We rst compute persistent homology of binarized 3D images of sampled material subvolumes. For each image we compute sets of homology intervals, which are represented as summary graphics called persistence diagrams. We convert persistence diagrams into image vectors in order to analyze the similarity of the homology of the material images using the mature tools for image analysis. Each image is treated as a vector and we compute its principal components to extract features. We t a statistical model using the loadings of principal components to estimate material porosity, permeability, anisotropy, and tortuosity. We also propose an adaptive version of the structural similarity index (SSIM), a similarity metric for images, as a measure to determine the statistical representative elementary volumes (sREV) for persistence homology. Thus we provide a capability for making a statistical inference of the uid ow and transport properties of porous materials based on their geometry and connectivity.

36 MATERIALS SCIENCE↗

Light-cone matrix product

We show how to combine the light-cone and matrix product algorithms to simulate quantum systems far from equilibrium for long times. For the case of the XXZ spin chain at {delta}=0.5, we simulate to a time of {approx_equal}22.5. While part of the long simulation time is due to the use of the light-cone method, we also describe a modification of the infinite time-evolving bond decimation algorithm with improved numerical stability, and we describe how to incorporate symmetry into this algorithm. While statistical sampling error means that we are not yet able to make a definite statement, the behavior of the simulation at long times indicates the appearance of either 'revivals' in the order parameter as predicted by Hastings and Levitov (e-print arXiv:0806.4283) or of a distinct shoulder in the decay of the order parameter.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonlinear, noniterative, single-distance phase retrieval and developmental biology

For coherent X-ray imaging, based on phase contrast through free-space Fresnel propagation, we discuss two noniterative, nonlinear approaches to the phase-retrieval problem from a single-distance intensity map of a pure-phase object. On one hand, a perturbative set-up is proposed where nonlinear corrections to the linearized transport-of-intensity situation are expanded in powers of the object-detector distance z and are evaluated in terms of the linear estimate. On the other hand, a nonperturbative projection algorithm, which is based on the (linear and local) contrast-transfer function (CTF), works with an effective phase in Fourier space. This effective phase obeys a modified CTF relation between intensity contrast at z > 0 and phase contrast at z= 0: Unphysical singularities of the local CTF model are cut off to yield 'quasiparticles' in analogy to the theory of the Fermi liquid. By identifying the positions of the zeros of the Fourier transformed intensity contrast as order parameters for the dynamical breaking of scaling symmetry we investigate the phase structure of the forward-propagation problem when interpreted as a statistical system. Results justify the quasiparticle approach for a wide range of intermediary phase variations. The latter algorithm is applied to data from biological samples recorded at the beamlines TopoTomo and ID19 at ANKA and ESRF, respectively.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Numerical simulation of involute-plate research reactor flow behavior using RANS, LES and DNS

This paper investigates the flow behavior of involute-plate research reactors by performing Reynolds-Averaged Navier Stokes simulation (RANS), Large Eddy Simulation (LES) and Direct Numerical Simulation (DNS) of the channel flow between fuel plates. By modeling turbulence with different numerical approaches, this study provides data with three levels of fidelity. For the RANS simulation, three widely used turbulence models, i.e., k-ε, k-ω, Reynolds Stress Turbulence model (RST) are applied by using the commercial CFD code STAR-CCM +. For LES and DNS, the open-source CFD code, Nek5000, is used given its outstanding scalability on High Performance Computer (HPC) and high-order technique. The results from RANS simulations are compared with that from LES and DNS for benchmarking. Both macroscale parameters and turbulence statistics, such as velocity magnitude, lateral velocity and turbulence kinetic energy, are presented and analyzed. The results from RANS simulation achieve good agreement with LES and DNS on velocity and turbulence kinetic energy prediction. The RST turbulence model predicts the most similar flow pattern of lateral velocity as compared to LES and DNS. The Lambda-2 (λ2) criterion with a reasonable threshold is used to demonstrate the instantaneous vortices distribution in the involute channel from both LES and DNS calculation. The DNS simulation captures more detailed turbulence especially near the corner, which explains the discrepancy between LES and DNS results near the corner. The normalized RMS error are defined and calculated to assess the performance of those turbulence models. The RST model captures the anisotropic feature of turbulence, which enable it to outperform other turbulence models for predicting the flow behavior in an involute channel. Although some discrepancies are found between LES and DNS results in the corner, the overall deviations between LES and DNS are found to be small. In conclusion, given that the computational cost of DNS calculation is an order of magnitude higher, using LES data for benchmarking RANS model is a cost-effective approach.

DNS↗

On the statistical theory of self-gravitating collisionless dark matter flow

Dark matter, if it exists, accounts for five times as much as the ordinary baryonic matter. Compared to hydrodynamic turbulence, the flow of dark matter might possess the widest presence in our universe. This paper presents a statistical theory for the flow of dark matter that is compared with N-body simulations. By contrast to hydrodynamics of normal fluids, dark matter flow is self-gravitating, long-range, and collisionless with a scale-dependent flow behavior. The peculiar velocity field is of constant divergence nature on small scale and irrotational on large scale. The statistical measures, i.e., correlation, structure, dispersion, and spectrum functions, are modeled on both small and large scales, respectively. Kinematic relations between statistical measures are fully developed for incompressible, constant divergence, and irrotational flow. Incompressible and constant divergence flow share the same kinematic relations for even order correlations. The limiting correlation of velocity $\mathrm{ρ_{L}=1/2}$ on the smallest scale ( r = 0) is a unique feature of collisionless flow (⁠$\mathrm{ρ_{L}=1}$ for incompressible flow). On large scale, transverse velocity correlation has an exponential form $T_{2}∝e^{–r/r_2}$ with a constant comoving scale r 2 =21.3 Mpc/h that may be related to the horizon size at matter–radiation equality. All other correlation, structure, dispersion, and spectrum functions for velocity, density, and potential fields are derived analytically from kinematic relations for irrotational flow. On small scale, longitudinal structure function follows one-fourth law of ${S}_{2}^{1}∝r^{1/4}$. All other statistical measures can be obtained from kinematic relations for constant divergence flow. Vorticity is negatively correlated for scale r between 1 and 7 Mpc/h. Divergence is negatively correlated for r > 30 Mpc/h that leads to a negative density correlation.

79 ASTRONOMY AND ASTROPHYSICS↗

Kinetic corrections from analytic non-Maxwellian distribution functions in magnetized plasmas

In magnetized plasma physics, almost all developed analytic theories assume a Maxwellian distribution function (MDF) and in some cases small deviations are described using the perturbation theory. The deviations with respect to the Maxwellian equilibrium, called kinetic effects, are required to be taken into account especially for fusion reactor plasmas. Generally, because the perturbation theory is not consistent with observed steady-state non-Maxwellians, these kinetic effects are numerically evaluated by very central processing unit (CPU)-expensive codes, avoiding the analytic complexity of velocity phase space integrals. We develop here a new method based on analytic non-Maxwellian distribution functions constructed from non-orthogonal basis sets in order to (i) use as few parameters as possible, (ii) increase the efficiency to model numerical and experimental non-Maxwellians, (iii) help to understand unsolved problems such as diagnostics discrepancies from the physical interpretation of the parameters, and (iv) obtain analytic corrections due to kinetic effects given by a small number of terms and removing the numerical error of the evaluation of velocity phase space integrals. This work does not attempt to derive new physical effects even if it could be possible to discover one from the better understandings of some unsolved problems, but here we focus on the analytic prediction of kinetic corrections from analytic non-Maxwellians. As applications, examples of analytic kinetic corrections are shown for the secondary electron emission, the Langmuir probe characteristic curve, and the entropy. This is done by using three analytic representations of the distribution function: the Kappa distribution function, the bi-modal or a new interpreted non-Maxwellian distribution function (INMDF). The existence of INMDFs is proved by new understandings of the experimental discrepancy of the measured electron temperature between two diagnostics in JET. As main results, it is shown that (i) the empirical formula for the secondary electron emission is not consistent with a MDF due to the presence of super-thermal particles, (ii) the super-thermal particles can replace a diffusion parameter in the Langmuir probe current formula, and (iii) the entropy can explicitly decrease in presence of sources only for the introduced INMDF without violating the second law of thermodynamics. Moreover, the first order entropy of an infinite number of super-thermal tails stays the same as the entropy of a MDF. The latter demystifies the Maxwell's demon by statistically describing non-isolated systems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Real-time verification of multileaf collimator-driven radiotherapy using a novel optical attenuation-based fluence monitor

Purpose: Multileaf collimator (MLC)-driven conformal radiotherapy modalities [e.g., such as intensity-modulated radiotherapy (IMRT), intensity-modulated arc therapy, and stereotactic body radiotherapy] are more subject to delivery errors and dose calculation inaccuracies than standard modalities. Fluence monitoring during treatment delivery could reduce such errors by allowing an independent interface to quantify and assess measured difference between the delivered and planned treatment administration. We developed an optical attenuation-based detector to monitor fluence for the on-line quality control of radiotherapy delivery. The purpose of the current study was to develop the theoretical background of the invention and to evaluate the detector's performance both statistically and in clinical situations. Methods: We aligned 60 27-cm scintillating fibers coupled to a photodetector via clear optical fibers in the direction of motion of each of the 60 leaf pairs of a 120 leaves Millenium MLC on a Varian Clinac iX. We developed a theoretical model to predict the intensity of light collected on each side of the scintillating fibers when placed under radiation fields of varying sizes, intensities, and positions. The model showed that both the central position of the radiation field on the fiber (x{sub c}) and the integral fluence passing through the fiber ({Phi}{sub int}) could be assessed independently in a single measurement. We evaluated the performance of the prototype by (1) measuring the intrinsic variation of the measured values of x{sub c} and {Phi}{sub int}, (2) measuring the impact on the measured values of x{sub c} and {Phi}{sub int} of random leaf positioning errors introduced into IMRT fields, and (3) comparing the predicted values of x{sub c} and {Phi}{sub int} calculated with the treatment planning software to the measured values of x{sub c} and {Phi}{sub int} in order to assess the predictive effectiveness of the developed theoretical model. Results: We observed a very low intrinsic dispersion, dominated by Poisson statistics, for both x{sub c} (standard deviations of less than 1 mm) and {Phi}{sub int} (standard deviations of less than 0.20%). When confronted with random leaf positioning errors from IMRT segments, {Phi}{sub int} was highly sensitive to single leaf positioning errors as small as 1 mm at isocenter, while x{sub c} was sensitive to leaf pair translation errors of at least 2 mm at isocenter. Owing to the uncertainties in the doses calculated in regions of high perpendicular dose gradients, the measured values of x{sub c} and {Phi}{sub int} deviated from the predicted values of x{sub c} and {Phi}{sub int} by a mean of 1.3 mm and 2.6%, respectively. Conclusion: Our study showed that an optical attenuation-based detector can be used to effectively monitor integral fluence during radiotherapy delivery. The performance of such a system would enable real-time quality control of the incident fluence in current MLC-driven treatments such as IMRT and future adaptive radiotherapy procedures where new treatment plans will have to be delivered without passing thru the current standard quality control chain.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Constant pressure and temperature discrete-time Langevin molecular dynamics

We present a new and improved method for simultaneous control of temperature and pressure in molecular dynamics simulations with periodic boundary conditions. The thermostat-barostat equations are built on our previously developed stochastic thermostat, which has been shown to provide correct statistical configurational sampling for any time step that yields stable trajectories. Here, we extend the method and develop a set of discrete-time equations of motion for both particle dynamics and system volume in order to seek pressure control that is insensitive to the choice of the numerical time step. The resulting method is simple, practical, and efficient. The method is demonstrated through direct numerical simulations of two characteristic model systems—a one-dimensional particle chain for which exact statistical results can be obtained and used as benchmarks, and a three-dimensional system of Lennard-Jones interacting particles simulated in both solid and liquid phases. The results, which are compared against the method of Kolb and Dünweg [J. Chem. Phys. 111, 4453 (1999)], show that the new method behaves according to the objective, namely that acquired statistical averages and fluctuations of configurational measures are accurate and robust against the chosen time step applied to the simulation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Optimal constraints on local primordial non-Gaussianity from the two-point statistics of large-scale structure

One of the main signatures of primordial non-Gaussianity of the local type is a scale-dependent correction to the bias of large-scale structure tracers such as galaxies or clusters, whose amplitude depends on the bias of the tracers itself. The dominant source of noise in the power spectrum of the tracers is caused by sampling variance on large scales (where the non-Gaussian signal is strongest) and shot noise arising from their discrete nature. Recent work has argued that one can avoid sampling variance by comparing multiple tracers of different bias, and suppress shot noise by optimally weighting halos of different mass. Here we combine these ideas and investigate how well the signatures of non-Gaussian fluctuations in the primordial potential can be extracted from the two-point correlations of halos and dark matter. On the basis of large N-body simulations with local non-Gaussian initial conditions and their halo catalogs we perform a Fisher matrix analysis of the two-point statistics. Compared to the standard analysis, optimal weighting and multiple-tracer techniques applied to halos can yield up to 1 order of magnitude improvements in f{sub NL}-constraints, even if the underlying dark matter density field is not known. In this case one needs to resolve all halos down to 10{sup 10}h{sup -1}M{sub sun} at z=0, while with the dark matter this is already achieved at a mass threshold of 10{sup 12}h{sup -1}M{sub sun}. We compare our numerical results to the halo model and find satisfactory agreement. Forecasting the optimal f{sub NL}-constraints that can be achieved with our methods when applied to existing and future survey data, we find that a survey of 50h{sup -3} Gpc{sup 3} volume resolving all halos down to 10{sup 11}h{sup -1}M{sub sun} at z=1 will be able to obtain {sigma}{sub f{sub N{sub L}}}{approx}1 (68% cl), a factor of {approx}20 improvement over the current limits. Decreasing the minimum mass of resolved halos, increasing the survey volume or obtaining the dark matter maps can further improve these limits, potentially reaching the level of {sigma}{sub f{sub N{sub L}}}{approx}0.1. This precision opens up the possibility to distinguish different types of primordial non-Gaussianity and to probe inflationary physics of the very early Universe.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗