Small-Sample Estimator Decisions – Certainly Uncertain in Human Spaceflight at NASA
Within statistics when estimating means, we rely heavily on the Central Limit Theorem (CLT) to aid in our inference, however in cases where the CLT does not apply we begin to be strongly limited in our choices. If a violation to the CLT comes in the form of small samples and unknown population variance, yet we maintain the assumption of normality, the use of t-distributions is perfectly valid. We explore cases where population normality is not assumed, where sample sizes are small, and where some actionable estimate of the central tendency of a distribution is needed such as for spaceflight operational decisions. Here we identify different scenarios based on measures taken from spaceflight, characterizing performance of estimators of central tendency within our set of simulations. We examine bias and variability of standard estimators of central tendency as they apply to varying small sample sizes and varying population distributions. Further work in this area is needed to develop a framework or set of guidelines for individuals set in these situations. Even with limited information, decisions need to be made.