Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical processing methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Autonomous Correction of Sensor Data Applied to Building Technologies Utilizing Statistical Processing Methods

Autonomous detection and correction of potentially missing or corrupt sensor data is a essential concern in building technologies since data availability and correctness is necessary to develop accurate software models for instrumented experiments. Therefore, this paper aims to address this problem by using statistical processing methods including: (1) least squares; (2) maximum likelihood estimation; (3) segmentation averaging; and (4) threshold based techniques. Application of these validation schemes are applied to a subset of data collected from Oak Ridge National Laboratory s (ORNL) ZEBRAlliance research project, which is comprised of four single-family homes in Oak Ridge, TN outfitted with a total of 1,218 sensors. The focus of this paper is on three different types of sensor data: (1) temperature; (2) humidity; and (3) energy consumption. Simulations illustrate the threshold based statistical processing method performed best in predicting temperature, humidity, and energy data.

building technologies.↗

SU-D-BRD-07: Evaluation of the Effectiveness of Statistical Process Control Methods to Detect Systematic Errors For Routine Electron Energy Verification

Purpose: To evaluate the ability of statistical process control methods to detect systematic errors when using a two dimensional (2D) detector array for routine electron beam energy verification. Methods: Electron beam energy constancy was measured using an aluminum wedge and a 2D diode array on four linear accelerators. Process control limits were established. Measurements were recorded in control charts and compared with both calculated process control limits and TG-142 recommended specification limits. The data was tested for normality, process capability and process acceptability. Additional measurements were recorded while systematic errors were intentionally introduced. Systematic errors included shifts in the alignment of the wedge, incorrect orientation of the wedge, and incorrect array calibration. Results: Control limits calculated for each beam were smaller than the recommended specification limits. Process capability and process acceptability ratios were greater than one in all cases. All data was normally distributed. Shifts in the alignment of the wedge were most apparent for low energies. The smallest shift (0.5 mm) was detectable using process control limits in some cases, while the largest shift (2 mm) was detectable using specification limits in only one case. The wedge orientation tested did not affect the measurements as this did not affect the thickness of aluminum over the detectors of interest. Array calibration dependence varied with energy and selected array calibration. 6 MeV was the least sensitive to array calibration selection while 16 MeV was the most sensitive. Conclusion: Statistical process control methods demonstrated that the data distribution was normally distributed, the process was capable of meeting specifications, and that the process was centered within the specification limits. Though not all systematic errors were distinguishable from random errors, process control limits increased the ability to detect systematic errors using routine measurement of electron beam energy constancy.

07 ISOTOPE AND RADIATION SOURCES↗

Single Gaussian process method for arbitrary tokamak regimes with a statistical analysis

Abstract Gaussian process regression is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including intrinsic uncertainty quantification and robustness to over-fitting. This work investigates the use of a new method, the change-point method, for handling the varying length scales found in different tokamak regimes. The use of the Student’s t-distribution for the Bayesian likelihood probability is also investigated and shown to be advantageous in providing good fits in profiles with many outliers. To compare different methods, synthetic data generated from analytic profiles is used to create a database enabling a quantitative statistical comparison of which methods perform the best. Using a full Bayesian approach with the change-point method, Matérn kernel for the prior probability, and Student’s t-distribution for the likelihood is shown to give the best results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Variation and Control of Process Behavior

The purpose of this work was to highlight the importance of controlling process variability for successful quality assurance (QA). We describe the method of statistical process control for characterizing and controlling a process. Traditionally, QA has been performed by comparing some important measurement (e.g., linear accelerator output) against a corresponding specification. Although useful in determining the fitness of a particular measurement, this approach does not provide information about the underlying process behavior over time. A modern view of QA is to consider the time-ordered behavior of a process. Every process displays characteristic behaviors that are independent of the specifications imposed on it. The goal of modern QA is, not only to ensure that a process is on-target, but that it is also operating with minimal variation. This is accomplished by way of a data-driven approach using process behavior charts. The development of process behavior charts, historically known as control charts, and process behavior (action) limits are described. The effect these concepts have on quality management is also discussed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Out-of-Distribution Detection and Radiological Data Monitoring Using Statistical Process Control

Abstract Machine learning (ML) models often fail with data that deviates from their training distribution. This is a significant concern for ML-enabled devices as data drift may lead to unexpected performance. This work introduces a new framework for out of distribution (OOD) detection and data drift monitoring that combines ML and geometric methods with statistical process control (SPC). We investigated different design choices, including methods for extracting feature representations and drift quantification for OOD detection in individual images and as an approach for input data monitoring. We evaluated the framework for both identifying OOD images and demonstrating the ability to detect shifts in data streams over time. We demonstrated a proof-of-concept via the following tasks: 1) differentiating axial vs. non-axial CT images, 2) differentiating CXR vs. other radiographic imaging modalities, and 3) differentiating adult CXR vs. pediatric CXR. For the identification of individual OOD images, our framework achieved high sensitivity in detecting OOD inputs: 0.980 in CT, 0.984 in CXR, and 0.854 in pediatric CXR. Our framework is also adept at monitoring data streams and identifying the time a drift occurred. In our simulations tracking drift over time, it effectively detected a shift from CXR to non-CXR instantly, a transition from axial to non-axial CT within few days, and a drift from adult to pediatric CXRs within a day—all while maintaining a low false positive rate. Through additional experiments, we demonstrate the framework is modality-agnostic and independent from the underlying model structure, making it highly customizable for specific applications and broadly applicable across different imaging modalities and deployed ML models.

Zamzmi, Ghada↗

Unraveling the discontinuous plastic flow of a Co-Cr-Fe-Ni-Mo multiprincipal-element alloy at deep cryogenic temperatures

We report an analysis of the discontinuous plastic flow of a multiprincipal-element alloy, Co 17.5 Cr 12.5 Fe 55 Ni 10 Mo 5 (atomic percent, at. %), in the temperature range of 0.5–4.2 K showing serrated deformation curves. Using the analytical techniques, we studied the statistics of the stress drops associated with the unstable plastic flow. The analysis showed that the complexity and heterogeneity of a discontinuous plastic flow were reduced when the temperature was lowered. This behavior was associated with the effects of dynamic recovery and adiabatic heating on the dislocation-density evolution.

36 MATERIALS SCIENCE↗

Bayesian Model Averaging for Ensemble-Based Estimates of Solvation Free Energies

This paper applies the Bayesian Model Averaging (BMA) statistical ensemble technique to estimate small molecule solvation free energies. There is a wide range methods for predicting solvation free energies, ranging from empirical statistical models to {\it ab initio} quantum mechanical approaches. Each of these methods are based on a set of conceptual assumptions that can affect a method's predictive accuracy and transferability. Using an iterative statistical process, we have selected and combined solvation energy estimates using an ensemble of 17 diverse methods from the SAMPL4 blind prediction study to form a single, aggregated solvation energy estimate. The ensemble design process evaluates the statistical information in each individual method as well as the performance of the aggregate estimate obtained from the ensemble as a whole. Methods that possess minimal or redundant information are pruned from the ensemble and the evaluation process repeats until aggregate predictive performance can no longer be improved. We show that this process results in a final aggregate estimate that outperforms all individual methods by reducing estimate errors by as much as 91% to 1.2 kcal/mol accuracy. We also compare our iterative refinement approach to other statistical ensemble approaches and demonstrate that this iterative process reduces estimate errors by as much as 61%. This work provides a new approach for accurate solvation free energy prediction and lays the foundation for future work on aggregate models that can balance computational cost with predictive accuracy.

solvation, Bayesian model averaging, Electrostatic↗

A new angle on complex dynamics

Analyzing changes in direction in stochastic trajectories can offer valuable insights.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A comprehensive analysis of the IMRT dose delivery process using statistical process control (SPC)

The aim of this study is to introduce tools to improve the security of each IMRT patient treatment by determining action levels for the dose delivery process. To achieve this, the patient-specific quality control results performed with an ionization chamber--and which characterize the dose delivery process--have been retrospectively analyzed using a method borrowed from industry: Statistical process control (SPC). The latter consisted in fulfilling four principal well-structured steps. The authors first quantified the short term variability of ionization chamber measurements regarding the clinical tolerances used in the cancer center ({+-}4% of deviation between the calculated and measured doses) by calculating a control process capability (C{sub pc}) index. The C{sub pc} index was found superior to 4, which implies that the observed variability of the dose delivery process is not biased by the short term variability of the measurement. Then, the authors demonstrated using a normality test that the quality control results could be approximated by a normal distribution with two parameters (mean and standard deviation). Finally, the authors used two complementary tools--control charts and performance indices--to thoroughly analyze the IMRT dose delivery process. Control charts aim at monitoring the process over time using statistical control limits to distinguish random (natural) variations from significant changes in the process, whereas performance indices aim at quantifying the ability of the process to produce data that are within the clinical tolerances, at a precise moment. The authors retrospectively showed that the analysis of three selected control charts (individual value, moving-range, and EWMA control charts) allowed efficient drift detection of the dose delivery process for prostate and head-and-neck treatments before the quality controls were outside the clinical tolerances. Therefore, when analyzed in real time, during quality controls, they should improve the security of treatments. They also showed that the dose delivery processes in the cancer center were in control for prostate and head-and-neck treatments. In parallel, long term process performance indices (P{sub p}, P{sub pk}, and P{sub pm}) have been analyzed. Their analysis helped defining which actions should be undertaken in order to improve the performance of the process. The prostate dose delivery process has been shown statistically capable (0.08% of the results is expected to be outside the clinical tolerances) contrary to the head-and-neck dose delivery process (5.76% of the results are expected to be outside the clinical tolerances).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Multiple-point statistical prediction on fracture networks at Yucca Mountain

In many underground nuclear waste repository systems, such as at Yucca Mountain, water flow rate and amount of water seepage into the waste emplacement drifts are mainly determined by hydrological properties of fracture network in the surrounding rock mass. Natural fracture network system is not easy to describe, especially with respect to its connectivity which is critically important for simulating the water flow field. In this paper, we introduced a new method for fracture network description and prediction, termed multi-point-statistics (MPS). The process of the MPS method is to record multiple-point statistics concerning the connectivity patterns of a fracture network from a known fracture map, and to reproduce multiple-scale training fracture patterns in a stochastic manner, implicitly and directly. It is applied to fracture data to study flow field behavior at the Yucca Mountain waste repository system. First, the MPS method is used to create a fracture network with an original fracture training image from Yucca Mountain dataset. After we adopt a harmonic and arithmetic average method to upscale the permeability to a coarse grid, THM simulation is carried out to study near-field water flow in the surrounding waste emplacement drifts. Our study shows that connectivity or patterns of fracture networks can be grasped and reconstructed by MPS methods. In theory, it will lead to better prediction of fracture system characteristics and flow behavior. Meanwhile, we can obtain variance from flow field, which gives us a way to quantify model uncertainty even in complicated coupled THM simulations. It indicates that MPS can potentially characterize and reconstruct natural fracture networks in a fractured rock mass with advantages of quantifying connectivity of fracture system and its simulation uncertainty simultaneously.

54 ENVIRONMENTAL SCIENCES↗

Debiasing cosmic gravitational wave sirens

ABSTRACT Accurate estimation of the Hubble constant, and other cosmological parameters, from distances measured by cosmic gravitational wave sirens requires sufficient allowance for the dark energy evolution. We demonstrate how model-independent statistical methods, specifically Gaussian process regression, can remove bias in the reconstruction of H(z), and can be combined to model independently with supernova distances. This allows stringent tests of both H0 and Λ cold dark matter, and can detect unrecognized systematics. We also quantify the redshift systematic control necessary for the use of dark sirens, showing that it must approach spectroscopic precision to avoid significant bias.

Keeley, Ryan E.↗

SU-D-201-04: Evaluation of Elekta Agility MLC Performance Using Statistical Process Control

Purpose: to evaluate the performance and stability of the Elekta Agility MLC model using an automated quality control (QC) test in combination with statistical process control tools. Methods: Leaf positions were collected daily for 11 Elekta units over 5–19 months using the automated QC test, which analyzes 23 MV images to determine the location of MLC leaves relative to the radiation isocenter. The leaf positions are measured at 5 nominal positions, and images are acquired at collimator 0° and 180° to capture all MLC leaves in the field-of-view. Leaf positioning accuracy was assessed using individual and moving range control charts. Control limits were recomputed following MLC recalibration (occurred 1–2 times for 4 units). Specification levels of ±0.5, ±1 and ±1.5mm were tested. The mean and range of duration between out-of-control and out-of-specification events were determined. Results: Leaf position varied little over time, as confirmed by very tight individual control limits (mean ±0.19mm, range 0.09–0.44). Mean leaf position error was −0.03mm (range −0.89–0.83). Due to sporadic out-of-control events, the mean in-control duration was 3.3 days (range 1–23). Data stayed within ±1mm specification for 205 days on average (range 3–372) and within ±1.5mm for the entire date range. Measurements stayed within ±0.5mm for 1 day on average (range 0–17); however, our MLC leaves were not calibrated to this level of accuracy. Conclusion: The Elekta Agility MLC model was found to perform with high stability, as evidenced by the tight control limits. The in-specification durations support the current recommendation of monthly MLC QC tests with a ±1mm tolerance. Future work is on-going to determine if Agility performance can be optimized further using high-frequency QC test results to drive recalibration frequency. Factors that can affect leaf positioning accuracy, including beam spot motion, leaf gain calibration, drifting leaves, and image artifacts, are under investigation.

60 APPLIED LIFE SCIENCES↗

TU-FG-201-05: Varian MPC as a Statistical Process Control Tool

Purpose: Quality assurance in radiotherapy requires the measurement of various machine parameters to ensure they remain within permitted values over time. In Truebeam release 2.0 the Machine Performance Check (MPC) was released allowing beam output and machine axis movements to be assessed in a single test. We aim to evaluate the Varian Machine Performance Check (MPC) as a tool for Statistical Process Control (SPC). Methods: Varian’s MPC tool was used on three Truebeam and one EDGE linac for a period of approximately one year. MPC was commissioned against independent systems. After this period the data were reviewed to determine whether or not the MPC was useful as a process control tool. Analyses on individual tests were analysed using Shewhart control plots, using Matlab for analysis. Principal component analysis was used to determine if a multivariate model was of any benefit in analysing the data. Results: Control charts were found to be useful to detect beam output changes, worn T-nuts and jaw calibration issues. Upper and lower control limits were defined at the 95% level. Multivariate SPC was performed using Principal Component Analysis. We found little evidence of clustering beyond that which might be naively expected such as beam uniformity and beam output. Whilst this makes multivariate analysis of little use it suggests that each test is giving independent information. Conclusion: The variety of independent parameters tested in MPC makes it a sensitive tool for routine machine QA. We have determined that using control charts in our QA programme would rapidly detect changes in machine performance. The use of control charts allows large quantities of tests to be performed on all linacs without visual inspection of all results. The use of control limits alerts users when data are inconsistent with previous measurements before they become out of specification. A. Carver has received a speaker’s honorarium from Varian.

07 ISOTOPE AND RADIATION SOURCES↗

On the Emergent Constraints of Climate Sensitivity

Differences among climate models in equilibrium climate sensitivity (ECS; the equilibrium surface temperature response to a doubling of atmospheric CO 2 ) remain a significant barrier to the accurate assessment of societally important impacts of climate change. Relationships between ECS and observable metrics of the current climate in model ensembles, so-called emergent constraints, have been used to constrain ECS. Here a statistical method (including a backward selection process) is employed to achieve a better statistical understanding of the connections between four recently proposed emergent constraint metrics and individual feedbacks influencing ECS. The relationship between each metric and ECS is largely attributable to a statistical connection with shortwave low cloud feedback, the leading cause of intermodel ECS spread. This result bolsters confidence in some of the metrics, which had assumed such a connection in the first place. Additional analysis is conducted with a few thousand artificial metrics that are randomly generated but are well correlated with ECS. The relationships between the contrived metrics and ECS can also be linked statistically to shortwave cloud feedback. Thus, any proposed or forthcoming ECS constraint based on the current generation of climate models should be viewed as a potential constraint on shortwave cloud feedback, and physical links with that feedback should be investigated to verify that the constraint is real. In addition, any proposed ECS constraint should not be taken at face value since other factors influencing ECS besides shortwave cloud feedback could be systematically biased in the models.

58 GEOSCIENCES↗

Analysis of the VERA Core Physics Benchmark Problems using cosRMC Code

In reactor physics, two kinds of numerical methods are generally employed to solve the neutron transport equations, one of which is the deterministic method and the other one is the Monte Carlo method. Monte Carlo is widely used to provide reference solution because of its ability to deal with continuous energy cross sections and complex geometry. Just like any statistical process, the Monte Carlo method requires repetition to achieve a small relative uncertainty, and therefore may inevitably have larger simulation times than deterministic method. Fortunately, the great advancements of computer technology make it possible to apply Monte Carlo method in reactor core analysis. To promote nuclear power plant system design and simulation software self-reliance development, a Monte Carlo neutron/photon transport code cosRMC has been developed jointly by State Nuclear Power Software Development Center (SNPSDC) and Tsinghua University. The cosRMC is aimed at achieving full core calculations and analysis with high fidelity and efficiency by means of advanced methodologies and algorithms as well as high performance computing techniques. The cosRMC has many functions as criticality calculation, fixed-source calculation, burnup calculation, etc. In order to ensure its reliability, several types of verification and validation (V and V) work have been and are being carried out for cosRMC. The simulation results of cosRMC based on Problem 1 to 3 of VERA Core Physics Benchmark showed its good capability of 2D lattice and 3D assembly modeling. In this paper, some progressive verification results of multi-assembly and full core problems are presented.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantification and prediction of solidification textures under additive manufacturing conditions

Crystallographic textures are a major determinant of the macroscale anisotropic properties of polycrystalline metallic alloys produced in a wide range of additive manufacturing (AM) processes. Here, we introduce a statistical method that can accurately quantify the degree of orientational order of textures despite the large random fluctuations in the orientation of individual grains inherent in AM processes. The method, demonstrated for laser and resolidification of AlSi thin films, extends Z-scoring to a dynamical regime to assess the statistical significance of observed textures compared to randomly generated ones at different stages of solidification. We further show that, combined with phase-field modeling, this method can be used to infer fundamental anisotropic properties of the solid-liquid interface that are essential for texture prediction, and are compared here to the results of atomistic simulations. In addition, phase-field modeling reveals that, even at rapid AM solidification rates, the observed 〈110〉-dominated textures in the AlSi thin films are controlled predominantly by the anisotropy of the interface free-energy and sheds light on the physical mechanism of grain competition. These results significantly enhance both the existing tools for the quantification and prediction of AM crystallographic textures and our basic understanding of their formation.

36 MATERIALS SCIENCE↗