Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Report on Hydrogen Content Measurements of Yttrium Hydrides

This report describes the hydrogen content measurements of yttrium samples as irradiated at Advanced Test Reactor as part of the Microreactor Program. Irradiated samples were prepared at the facilities of Analytical Research Laboratory (ARL) of Materials and Fuels Complex (MFC). Hydrogen content measurements were performed on reduced size specimens using an inert gas fusion analyzer. For a single sample, replicate samples were prepared and tested to improve statistics of results. Uncertainty analyses were conducted using two approaches to determine the hydrogen content variations in the samples. Hydrogen content of irradiated specimens were both lower and higher than the expected values, indicating stoichiometry variations. Hydrogen was detected in all samples, even for the cracked capsule’s specimens. Results also suggested a potential hydrogen redistribution is present between samples inside the capsules.

08 HYDROGEN↗
DOE OSTI2021

Preventing Failures By Dataset Shift Detection in Safety-Critical Graph Applications

Dataset shift refers to the problem where the input data distribution may change over time (e.g., between training and test stages). Since this can be a critical bottleneck in several safety-critical applications such as healthcare, drug-discovery, etc., dataset shift detection has become an important research issue in machine learning. Though several existing efforts have focused on image/video data, applications with graph-structured data have not received sufficient attention. Therefore, in this paper, we investigate the problem of detecting shifts in graph structured data through the lens of statistical hypothesis testing. Specifically, we propose a practical two-sample test based approach for shift detection in large-scale graph structured data. Our approach is very flexible in that it is suitable for both undirected and directed graphs, and eliminates the need for equal sample sizes. Using empirical studies, we demonstrate the effectiveness of the proposed test in detecting dataset shifts. We also corroborate these findings using real-world datasets, characterized by directed graphs and a large number of nodes.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1985

Extended testing of a general contextual classifier using the massively parallel processor - Preliminary results and test plans

Earlier encouraging test results of a contextual classifier that combines spatial and spectral information employing a general statistical approach are expanded. The earlier results were of limited meaning because they were produced from small (50-by-50 pixel) data sets. An implementation of the contextual classifier on NASA Goddard's Massively Parallel Processor (MPP) is presented; for the first time the MPP makes feasible the testing of the classifier on large data sets (a 12-hour test on a VAX-11/780 minicomputer now takes 5 minutes on the MPP). The MPP is a Single-Instruction, Multiple Data Stream computer, consisting of 16,384 bit serial microprocessors connected in a 128-by-128 mesh array with each element having data transfer connections with its four nearest neighbors so that the MPP is capable of billions of operations per second. Preliminary results are given (with more expected for the conference) and plans are mentioned for extended testing of the contextual classifier on Thematic Mapper data sets.

Tilton, J. C.↗
NASA NTRS2022

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗
DOE OSTI2020

Modeling the Functional Forms of Grid Disturbances

This report introduces a functional form that may be used to quantitatively predict the impacts of new grid tools and changing system qualities on the likelihoods, durations, and depths of various grid disturbances. Each disturbance scenario is modeled to have three component stages—avoidance, reactance and recovery, which together parametrically estimate one disturbance’s impacts. The modeled scenario is then placed and replicated within an analysis period to represent the likelihood or frequency of the scenario and its consequent impacts. Whereas analysts have struggled to define and apply metrics for grid resilience, the functional form introduced by this report shares units of measurement with accepted grid-status measures (e.g., numbers of customers currently experiencing a service outage). Furthermore, the integrated and averaged functional form over an analysis period provides a meaningful normalized performance metric (e.g., customer outage minutes per year) that is ultimately independent of the duration of the period of. The approach may be applied similarly regardless of the severity or frequency of the disturbances that are being analyzed. Because metrics can be chosen to be identical in both the hypothetical future and the actual historical past, the historical past eventually becomes the test of the future predictions, at least in a statistical sense. The authors originally developed this approach to facilitate analysis of the effects of transactive energy (TE) systems effects on electric power grid resilience. TE systems invite energy suppliers and consumers to actively collaborate toward the discovery of, and their responses to, the locational value of energy. The findings from this process are often embodied as energy prices, the dynamics of which indicate the locational value of energy and can further represent important grid service needs. While some academic papers claim to quantify the value of a specific TE system design toward grid resilience, the answer, in general, has been elusive. Not only do multiple and conflicting definitions of resilience and reliability exist, but countless TE systems are being invented. We conclude the following: (1) The ideal analysis should harmonize rather than differentiate resilience and reliability. Therefore, this report uses the more general term disturbance whenever the overloaded terms resilience and reliability can be avoided. (2) The effectiveness of TE systems must be mapped to underlying qualities of a TE system, thereby avoiding presumptions that every TE design offers similar advantages. The authors seek to evaluate the parametric effects of TE system qualities (e.g., spatial granularity, granularity of time steps, length of future prediction horizon) on avoiding, reacting to, and recovering from grid disturbances. Furthermore, any advantages (or disadvantages) must be fairly compared with the many alternative tools, systems, and strategies that might offer comparable benefits.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2009

Exploring Modeling Options and Conversion of Average Response to Appropriate Vibration Envelopes for a Typical Cylindrical Vehicle Panel with Rib-stiffened Design

Although applications for Statistical Energy Analysis (SEA) techniques are more widely used in the aerospace industry today, opportunities to anchor the response predictions using measured data from a flight-like launch vehicle structure are still quite valuable. Response and excitation data from a ground acoustic test at the Marshall Space Flight Center permitted the authors to compare and evaluate several modeling techniques available in the SEA module of the commercial code VA One. This paper provides an example of vibration response estimates developed using different modeling approaches to both approximate and bound the response of a flight-like vehicle panel. Since both vibration response and acoustic levels near the panel were available from the ground test, the evaluation provided an opportunity to learn how well the different modeling options can match band-averaged spectra developed from the test data. Additional work was performed to understand the spatial averaging of the measurements across the panel from measured data. Finally an evaluation/comparison of two conversion approaches from the statistical average response results that are output from an SEA analysis to a more useful envelope of response spectra appropriate to specify design and test vibration levels for a new vehicle.

Harrison, Phil↗
DOE OSTI2021

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) peak intensity normalization for complex mixture analyses

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) is a preferred technique for analyzing complex organic mixtures. Currently, there is no consensus normalization approach, nor an objective method for selecting one, for quantitative analyses of FT-ICR-MS data. We investigate a method to evaluate and score the amount of bias various normalization approaches introduce into the data. We evaluate the ability of the Statistical Procedure for the Analysis of Normalization Strategies (SPANS) to guide selection of appropriate normalization approaches for two different FT-ICR-MS datasets. Further, we test the robustness of SPANS results to changes in SPANS parameter values and assess the impact of using various normalization approaches on downstream statistical analyses. The normalization approach identified by SPANS differed for the two datasets. Normalization methods impacted the statistical significance of peaks differently, underscoring the importance of carefully evaluating potential methods. More consistent SPANS scores resulted when at least 120 significant peaks are used, where larger sets of peaks were obtained by increasing the p-value threshold. Interestingly, we show that Total Sum Scaling and highest peak normalization, used in previous studies, underperformed relative to SPANS-recommended normalization approaches. While there is no single, best normalization method for all datasets, SPANS provides a mechanism to identify an appropriate normalization method for analyzing FT-ICR-MS data quantitatively. As a result, the number of peaks used in the background distributions of SPANS contributes more significantly to the reproducibility of results than the p-value thresholds used to obtain those peaks.

47 OTHER INSTRUMENTATION↗
NASA NTRS2008

Close Approach Prediction Analysis of the Earth Science Constellation with the Fengyun-1C Debris

Routine satellite operations for the Earth Science Constellation (ESC) include collision risk assessment between members of the constellation and other orbiting space objects. Each day, close approach predictions are generated by a U.S. Department of Defense Joint Space Operations Center Orbital Safety Analyst using the high accuracy Space Object Catalog maintained by the Air Force's 1" Space Control Squadron. Prediction results and other ancillary data such as state vector information are sent to NASAJGoddard Space Flight Center's (GSFC's) Collision Risk Assessment analysis team for review. Collision analysis is performed and the GSFC team works with the ESC member missions to develop risk reduction strategies as necessary. This paper presents various close approach statistics for the ESC. The ESC missions have been affected by debris from the recent anti-satellite test which destroyed the Chinese Fengyun- 1 C satellite. The paper also presents the percentage of close approach events induced by the Fengyun-1C debris, and presents analysis results which predict the future effects on the ESC caused by this event. Specifically, the Fengyun-1C debris is propagated for twenty years using high-performance computing technology and close approach predictions are generated for the ESC. The percent increase in the total number of conjunction events is considered to be an estimate of the collision risk due to the Fengyun-1C break- UP.

Duncan, Matthew↗
NASA NTRS2012

The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles

Future generations of NASA and U.S. Air Force vehicles will require lighter mass while being subjected to higher loads and more extreme service conditions over longer time periods than the present generation. Current approaches for certification, fleet management and sustainment are largely based on statistical distributions of material properties, heuristic design philosophies, physical testing and assumed similitude between testing and operational conditions and will likely be unable to address these extreme requirements. To address the shortcomings of conventional approaches, a fundamental paradigm shift is needed. This paradigm shift, the Digital Twin, integrates ultra-high fidelity simulation with the vehicle s on-board integrated vehicle health management system, maintenance history and all available historical and fleet data to mirror the life of its flying twin and enable unprecedented levels of safety and reliability.

Glaessgen, Edward H.↗
DOE OSTI2026

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗
NASA NTRS2006

Static and Dynamic Model Update of an Inflatable/Rigidizable Torus Structure

The present work addresses the development of an experimental and computational procedure for validating finite element models. A torus structure, part of an inflatable/rigidizable Hexapod, is used to demonstrate the approach. Because of fabrication, materials, and geometric uncertainties, a statistical approach combined with optimization is used to modify key model parameters. Static test results are used to update stiffness parameters and dynamic test results are used to update the mass distribution. Updated parameters are computed using gradient and non-gradient based optimization algorithms. Results show significant improvements in model predictions after parameters are updated. Lessons learned in the areas of test procedures, modeling approaches, and uncertainties quantification are presented.

Horta, Lucas G.↗
DOE OSTI2024

To have value, comparisons of high-throughput phenotyping methods need statistical tests of bias and variance

The gap between genomics and phenomics is narrowing. The rate at which it is narrowing, however, is being slowed by improper statistical comparison of methods. Quantification using Pearson’s correlation coefficient ( r ) is commonly used to assess method quality, but it is an often misleading statistic for this purpose as it is unable to provide information about the relative quality of two methods. Using r can both erroneously discount methods that are inherently more precise and validate methods that are less accurate. These errors occur because of logical flaws inherent in the use of r when comparing methods, not as a problem of limited sample size or the unavoidable possibility of a type I error. A popular alternative to using r is to measure the limits of agreement (LOA). However both r and LOA fail to identify which instrument is more or less variable than the other and can lead to incorrect conclusions about method quality. An alternative approach, comparing variances of methods, requires repeated measurements of the same subject, but avoids incorrect conclusions. Variance comparison is arguably the most important component of method validation and, thus, when repeated measurements are possible, variance comparison provides considerable value to these studies. Statistical tests to compare variances presented here are well established, easy to interpret and ubiquitously available. The widespread use of r has potentially led to numerous incorrect conclusions about method quality, hampering development, and the approach described here would be useful to advance high throughput phenotyping methods but can also extend into any branch of science. The adoption of the statistical techniques outlined in this paper will help speed the adoption of new high throughput phenotyping techniques by indicating when one should reject a new method, outright replace an old method or conditionally use a new method.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Reconstruction of a direction-dependent primordial power spectrum from Planck CMB data

We consider the possibility that the primordial curvature perturbation is direction-dependent. To first order this is parameterised by a quadrupolar modulation of the power spectrum and results in statistical anisotropy of the CMB, which can be quantified using `bipolar spherical harmonics'. We compute these for the Planck DR2-2015 SMICA map and estimate the noise covariance from Planck Full Focal Plane 9 simulations. A constant quadrupolar modulation is detected with 2.2$σ$ significance, dropping to 2$σ$ when the primordial power is assumed to scale with wave number k as a power law. Going beyond previous work we now allow the spectrum to have arbitrary scale-dependence. Our non-parametric reconstruction then suggests several spectral features, the most prominent at k ~ 0.006 Mpc -1 . When a constant quadrupolar modulation is fitted to data in the range 0.005 ≤ k/Mpc -1 ≤ 0.008, its preferred directions are found to be related to the cosmic hemispherical asymmetry and the CMB dipole. To determine the significance we apply two test statistics to our reconstructions of the quadrupolar modulation from data, against reconstructions of realisations of noise only. With a test statistic sensitive only to the amplitude of the modulation, the reconstructions from the multipole range 30 ≤ ℓ ≤ 1200 are unusual with 2.1$σ$ significance. With the second test statistic, sensitive also to the direction, the significance rises to 6.9$σ$. Our approach is easily generalised to include other data sets such as polarisation, large-scale structure and forthcoming 21-cm line observations which will enable these anomalies to be investigated further.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2020

Improved State Estimation in Distorted Magnetic Fields

The magnetic field of the Earth – besides varying naturally – may be disturbed locally by the (man-made) environment. State estimation and corresponding navigation frameworks that use magnetometers on-board of mobile platforms suffer from severe performance loss or failure upon local magnetic distortions if these are not detected and mitigated adequately. Advanced estimators include the magnetic variation in the state vector. However, Cartesian coordinates, although widely used in the literature, suffer from observability issues when it comes to disturbance detection. This paper shows the importance of representing the magnetic variation in a spherical coordinate system and subsequent improvements with respect to the common representation in Cartesian coordinates. The spherical representation improves estimator consistency and allows for accurate and fast mitigation of magnetic disturbances through consistent statistical tests which leads to better system state estimates in magnetically distorted areas. The approach is validated by performing tests with simulated and real-world data on embedded hardware.

Brommer, Christian↗
DOE OSTI2017

Life Prediction of Large Lithium-Ion Battery Packs with Active and Passive Balancing

Lithium-ion battery packs take a major part of large-scale stationary energy storage systems. One challenge in reducing battery pack cost is to reduce pack size without compromising pack service performance and lifespan. Prognostic life model can be a powerful tool to handle the state of health (SOH) estimate and enable active life balancing strategy to reduce cell imbalance and extend pack life. This work proposed a life model using both empirical and physical-based approaches. The life model described the compounding effect of different degradations on the entire cell with an empirical model. Then its lower-level submodels considered the complex physical links between testing statistics (state of charge level, C-rate level, duty cycles, etc.) and the degradation reaction rates with respect to specific aging mechanisms. The hybrid approach made the life model generic, robust and stable regardless of battery chemistry and application usage. The model was validated with a custom pack with both passive and active balancing systems implemented, which created four different aging paths in the pack. The life model successfully captured the aging trajectories of all four paths. The life model prediction errors on capacity fade and resistance growth were within +/-3% and +/-5% of the experiment measurements.

25 ENERGY STORAGE↗
DOE OSTI2024

Bayesian stability and force modeling for uncertain machining processes

Accurately simulating machining operations requires knowledge of the cutting force model and system frequency response. However, this data is collected using specialized instruments in an ex-situ manner. Bayesian statistical methods instead learn the system parameters using cutting test data, but to date, these approaches have only considered milling stability. This paper presents a physics-based Bayesian framework which incorporates both spindle power and milling stability. Initial probabilistic descriptions of the system parameters are propagated through a set of physics functions to form probabilistic predictions about the milling process. The system parameters are then updated using automatically selected cutting tests to reduce parameter uncertainty and identify more productive cutting conditions, where spindle power measurements are used to learn the cutting force model. The framework is demonstrated through both numerical and experimental case studies. Results show that the approach accurately identifies both the system natural frequency and cutting force model.

42 ENGINEERING↗
DOE OSTI2020

Detecting differential protein abundance by combining peptide level P -values

The majority of methods for detecting differentially abundant proteins between samples in label-free LC-MS bottom-up proteomics experiments rely on statistically testing inferred protein abundances derived from peptide ionization intensities or averaging peptide level statistics. Here in this paper, we statistically test peptide ionization intensities directly and combine the resulting dependent P-values using the Empirical Brown's Method (EBM), avoiding error introduced through the estimation of protein abundances or summarizing test statistics. We show that on a spike-in proteomics dataset, a peptide level approach using EBM outperforms differential abundance detection using a protein level approach and several analysis workflows, including MSstats. Additionally, we demonstrate the effectiveness of this approach by detecting enriched proteins from an activity-based protein profiling dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Impact of Climate Variabilities and Human Activities on Surface Water Extents in Reservoirs of Yongding River Basin, China, from 1985 to 2016 Based on Landsat Observations and Time Series Analysis

Yongding River is the largest river flowing through Beijing, the capital city of China. In recent years, Yongding River Basin (YDRB) has seen increasing human impacts on water resources, posing serious challenges in hydrological and ecological health. In this study, remote sensing techniques and statistical time series approaches for hydrological studies were combined to characterize the dynamics and driving factors of reservoir water extents in YDRB during 1985–2016. First, 107 Landsat 4, 5, 7 and 8 images were used to extract surface water extents in YDRB during 1985–2016 using a combination of water indices and Otsu threshold algorithm. Significant positive correlation was found between water extents and the annual inflow for the two biggest reservoirs, the downstream Guanting and upstream Cetian reservoirs, proving their representativeness of surface water availability in this basin. Then, statistical time series approaches including trend-free pre-whitening Mann-Kendall trend test, Pettit change-point test and double mass curve method, which are frequently used in hydrological studies, were adopted to quantify the trend of reservoir water extents dynamics and the relative contributions of climate variability and human activities. Results showed that the water extents in both reservoirs exhibited significant downward trend with change point occurring in 2001 and 2005 for Guanting and Cetian, respectively. About 74%~75% of the shrinkage during the post-change period can be attributed to human activities, among which GDP, population, electricity power production, raw coal production, steel and crude iron production, value of agriculture output, and urban area were the major human drivers. Hydrological connectivity between the upstream Cetian and downstream Guanting reservoirs declined during the post-change period. Since 2012, water extents in both reservoirs recovered as a result of various governmental water management policies including the South-to-North Water Diversion Project. The methodology introduced in this study can be used for analyzing the dynamics and driving mechanism of surface water resources, especially for un-gauged or poorly-gauged watersheds.

47 OTHER INSTRUMENTATION↗