Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

An analysis of tolerance levels in IMRT quality assurance procedures

Increased use of intensity modulated radiation therapy (IMRT) has resulted in increased efforts in patient quality assurance (QA). Software and detector systems intended to streamline the IMRT quality assurance process often report metrics, such as percent discrepancies between measured and computed doses, which can be compared to benchmark or threshold values. The purpose of this work is to examine the relationships between two different types of IMRT QA processes in order to define, or refine, appropriate tolerances values. For 115 IMRT plans delivered in a 3 month period, we examine the discrepancies between (a) the treatment planning system (TPS) and results from a commercial independent monitor unit (MU) calculation program; (b) TPS and results from a commercial diode-array measurement system; and (c) the independent MU calculation and the diode-array measurements. Statistical tests were performed to assess significance in the IMRT QA results for different disease site and machine models. There is no evidence that the average total dose discrepancy in the monitor unit calculation depends on the disease site. Second, the discrepancies in the two IMRT QA methods are independent: there is no evidence that a better --or worse--monitor unit validation result is related to a better--or worse--diode-array measurement result. Third, there is marginal benefit in repeating the independent MU calculation with a more suitable dose point, if the initial IMRT QA failed a certain tolerance. Based on these findings, the authors conclude at some acceptable tolerances based on disease site and IMRT QA method. Specifically, monitor unit validations are expected to have a total dose discrepancy of 3% overall, and 5% per beam, independent of disease site. Diode array measurements are expected to have a total absolute dose discrepancy of 3% overall, and 3% per beam, independent of disease site. The percent of pixels exceeding a 3% and 3 mm threshold in a gamma analysis should be greater than or equal to 95% for non-head and neck IMRT cases, and 88% for head and neck IMRT cases. The IMRT QA methodology described here is neither unique nor ubiquitous, and the ability to deliver a safe IMRT does not simply require IMRT QA tests to pass a given tolerance; however, the selection of a tolerance should be meaningful when assessing a complex plan. The methodology in defining appropriate tolerances, described in this article, is based on an interpretation of IMRT QA results from IMRT plans deemed safe to deliver.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comparison of GEANT4 very low energy cross section models with experimental data in water

Purpose: The GEANT4 general-purpose Monte Carlo simulation toolkit is able to simulate physical interaction processes of electrons, hydrogen and helium atoms with charge states (H{sup 0}, H{sup +}) and (He{sup 0}, He{sup +}, He{sup 2+}), respectively, in liquid water, the main component of biological systems, down to the electron volt regime and the submicrometer scale, providing GEANT4 users with the so-called ''GEANT4-DNA'' physics models suitable for microdosimetry simulation applications. The corresponding software has been recently re-engineered in order to provide GEANT4 users with a coherent and unique approach to the simulation of electromagnetic interactions within the GEANT4 toolkit framework (since GEANT4 version 9.3 beta). This work presents a quantitative comparison of these physics models with a collection of experimental data in water collected from the literature. Methods: An evaluation of the closeness between the total and differential cross section models available in the GEANT4 toolkit for microdosimetry and experimental reference data is performed using a dedicated statistical toolkit that includes the Kolmogorov-Smirnov statistical test. The authors used experimental data acquired in water vapor as direct measurements in the liquid phase are not yet available in the literature. Comparisons with several recommendations are also presented. Results: The authors have assessed the compatibility of experimental data with GEANT4 microdosimetry models by means of quantitative methods. The results show that microdosimetric measurements in liquid water are necessary to assess quantitatively the validity of the software implementation for the liquid water phase. Nevertheless, a comparison with existing experimental data in water vapor provides a qualitative appreciation of the plausibility of the simulation models. The existing reference data themselves should undergo a critical interpretation and selection, as some of the series exhibit significant deviations from each other. Conclusions: The GEANT4-DNA physics models available in the GEANT4 toolkit have been compared in this article to available experimental data in the water vapor phase as well as to several published recommendations on the mass stopping power. These models represent a first step in the extension of the GEANT4 Monte Carlo toolkit to the simulation of biological effects of ionizing radiation.

61 RADIATION PROTECTION AND DOSIMETRY↗

Tomotherapy treatment plan quality assurance: The impact of applied criteria on passing rate in gamma index method

Purpose: Pretreatment patient plan verification with gamma index (GI) metric analysis is standard procedure for intensity modulated radiation therapy (IMRT) treatment. The aim of this paper is to evaluate the variability of the local and global gamma index obtained during standard pretreatment quality assurance (QA) measurements for plans performed with Tomotherapy unit. The QA measurements were performed with a 3D diode array, using variable passing criteria: 3%/3 mm, 2%/2 mm, 1%/1 mm, each with both local and global normalization.Methods: The authors analyzed the pretreatment QA results for 73 verifications; 37 were prostate cancer plans, 16 were head and neck plans, and 20 were other clinical sites. All plans were treated using the Tomotherapy Hi-Art System. Pretreatment QA plans were performed with the commercially available 3D diode array ArcCHECK™. This device has 1386 diodes arranged in a helical geometry spaced 1 cm apart. The dose measurements were acquired on the ArcCHECK™ and then compared with the calculated dose using the standard gamma analysis method. The gamma passing rate (%GP), defined as the percentage of points satisfying the condition GI < 1, was calculated for different criteria (3%/3 mm, 2%/2 mm, 1%/1 mm) and for both global and local normalization. In the case of local normalization method, the authors set three dose difference threshold (DDT) values of 2, 3, and 5 cGy. Dose difference threshold is defined as the minimum absolute dose error considered in the analysis when using local normalization. Low-dose thresholds (TH) of 5% and 10% were also applied and analyzed.Results: Performing a paired-t-test, the authors determined that the gamma passing rate is independent of the threshold values for all of the adopted criteria (5%TH vs 10%TH, p > 0.1). Our findings showed that mean %GPs for local (or global) normalization for the entire study group were 93% (98%), 84% (92%), and 66% (61%) for 3%/3 mm, 2%/2 mm, and 1%/1 mm criteria, respectively. DDT was equal to 2 cGy for the local normalization analysis cases. The authors observed great variability in the resulting %GP. With 3%/3 mm gamma criteria, the overall passing rate with local normalization was 4.6% less on the average than with global one, as expected. The wide difference between %GP calculated with global or local approach is also confirmed by an unpaired t-test statistical analysis.Conclusions: The variability of %GP obtained confirmed the necessity to establish defined agreement criteria that could be universal and comparable between institutions. In particular, while the gamma passing rate does not depend on the choice of threshold, the choice of DDT strongly influences the gamma passing rate for local calculations. The difference between global and local %GP was statistically significant for prostate and other treatment sites when DDT was changed from 2 to 3 cGy.

61 RADIATION PROTECTION AND DOSIMETRY↗

SU-E-J-248: Comparative Study of Two Image Registration for Image-Guided Radiation Therapy in Esophageal Cancer

Purpose: Image-guided radiation therapy (IGRT) is one of the major treatment of esophageal cancer. Gray value registration and bone registration are two kinds of image registration, the purpose of this work is to compare which one is more suitable for esophageal cancer patients. Methods: Twenty three esophageal patients were treated by Elekta Synergy, CBCT images were acquired and automatically registered to planning kilovoltage CT scans according to gray value or bone registration. The setup errors were measured in the X, Y and Z axis, respectively. Two kinds of setup errors were analysed by matching T test statistical method. Results: Four hundred and five groups of CBCT images were available and the systematic and random setup errors (cm) in X, Y, Z directions were 0.35, 0.63, 0.29 and 0.31, 0.53, 0.21 with gray value registration, while 0.37, 0.64, 0.26 and 0.32, 0.55, 0.20 with bone registration, respectively. Compared with bone registration and gray value registration, the setup errors in X and Z axis have significant differences. In Y axis, both measurement comparison results of T value is 0.256 (P value > 0.05); In X axis, the T value is 5.287(P value < 0.05); In Z axis, the T value is −5.138 (P value < 0.05). Conclusion: Gray value registration is recommended in image-guided radiotherapy for esophageal cancer and the other thoracic tumors. Manual registration could be applied when it is necessary. Bone registration is more suitable for the head tumor and pelvic tumor department where composed of redundant interconnected and immobile bone tissue.

60 APPLIED LIFE SCIENCES↗

TU-CD-BRB-02: BEST IN PHYSICS (JOINT IMAGING-THERAPY): Identification of Molecular Phenotypes by Integrating Radiomics and Genomics

Purpose: To uncover the mechanistic connections between radiomic features, molecular pathways, and clinical outcomes, to develop radiomic based predictors of pathway activation states in individual patients, and to assess whether combining radiomic with clinical and genomic data improves prognostication. Methods: We analyzed two independent lung cancer cohorts totaling 351 patients, for whom diagnostic computed tomography (CT) scans, gene-expression profiles, and clinical outcomes were available. The tumor phenotype was characterized based on 636 radiomic features describing tumor intensity, texture, shape and size. We performed an integrative analysis by developing and independently validating association modules of coherently expressed radiomic features and molecular pathways. These modules were statistically tested for significant associations to overall survival (OS), TNM stage, and pathologic histology. Results: We identified thirteen radiomic-pathway association modules (p < 0.05), the most prominent of which were associated with the immune system, p53 pathway, and other pathways involved in cell cycle regulation. Eleven modules were significantly associated with clinical outcomes (p < 0.05). Strong predictive power for pathway activation states in individual patients was observed using radiomics; the strongest per module predictions ranged from an intra-tumor heterogeneity feature predicting RNA III polymerase transcription (AUC 0.62, p = 0.03), to a tumor intensity dispersion feature predicting pyruvate metabolism and citric acid TCA cycle (AUC 0.72, p < 10−{sup 6}). Stepwise combinations of radiomic data with clinical outcomes and gene expression profiles resulted in consistent increases of prognostic power to predict OS (concordance index max = 0.73, p < 10−{sup 9}). Conclusion: This study demonstrates that radiomic approaches permit a non-invasive assessment of molecular and clinical characteristics of tumors, and therefore have the unprecedented potential to cost-effectively advance clinical decision-making using routinely acquired, standard-of-care imaging data. We show that prognostic value complementary to clinical and genomic information can be obtained by radiomic strategies.

60 APPLIED LIFE SCIENCES↗

TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images

Purpose: With the combined interest of managing patient dose, maintaining or improving image quality, and maintaining or improving the diagnostic utility of mammographic data, this study aims to compare the intrinsic image quality of Hologic’s synthesized 2-D (C-View) and 2-D FFDM images in terms of resolution, contrast, and noise. Methods: This study utilized a novel 3-D printed anthropomorphic breast phantom in addition to the American College of Radiology (ACR) mammography accreditation phantom. Analysis of the 3-D anthropomorphic phantom included visual assessment of resolution and analysis of the normalized noise power spectrum. Analysis of the ACR phantom included both visual inspection and objective automated analysis using in-house software. The software incorporates image- and object-specific CNR visibility thresholds which account for image characteristics such as noise texture which affect object visualization. T- test statistical analysis was also performed on ACR phantom scores. Results: The spatial resolution of C-View images is markedly lower (at least 50% worse) than that of FFDM. And while this is generally associated with the benefit of reduced relative noise magnitude, the noise in C-View images tends to have a more mottled (predominantly low-frequency) texture. In general, for high contrast objects, C-View provides superior visualization over FFDM; however this benefit diminishes for low contrast objects and is applicable only to objects that are sufficiently larger than the spatial resolution threshold. Based on both observer and automated ACR phantom analysis, between 50–70% of C-View images failed to meet ACR minimum accreditation requirements – primarily due to insufficient (unbroken) fiber visibility. Conclusion: Compared to FFDM, C-View offers better depiction of objects of certain size and contrast, but provides poorer overall resolution and noise properties. Based on these findings, the utilization of C-View images in the clinical setting requires careful consideration, especially if considering the discontinuation of FFDM imaging.

60 APPLIED LIFE SCIENCES↗

Machine Learning Leveraging Genomes from Metagenomes Identifies Influential Antibiotic Resistance Genes in the Infant Gut Microbiome

Antibiotic resistance in pathogens is extensively studied, and yet little is known about how antibiotic resistance genes of typical gut bacteria influence microbiome dynamics. Here, we leveraged genomes from metagenomes to investigate how genes of the premature infant gut resistome correspond to the ability of bacteria to survive under certain environmental and clinical conditions. We found that formula feeding impacts the resistome. Random forest models corroborated by statistical tests revealed that the gut resistome of formula-fed infants is enriched in class D beta-lactamase genes. Interestingly, Clostridium difficile strains harboring this gene are at higher abundance in formula-fed infants than C. difficile strains lacking this gene. Organisms with genes for major facilitator superfamily drug efflux pumps have higher replication rates under all conditions, even in the absence of antibiotic therapy. Using a machine learning approach, we identified genes that are predictive of an organism’s direction of change in relative abundance after administration of vancomycin and cephalosporin antibiotics. The most accurate results were obtained by reducing annotated genomic data to five principal components classified by boosted decision trees. Among the genes involved in predicting whether an organism increased in relative abundance after treatment are those that encode subclass B2 beta-lactamases and transcriptional regulators of vancomycin resistance. This demonstrates that machine learning applied to genome-resolved metagenomics data can identify key genes for survival after antibiotics treatment and predict how organisms in the gut microbiome will respond to antibiotic administration.

59 BASIC BIOLOGICAL SCIENCES↗

On automation of the procedure for crystal structure model refinement

The methods of automation of the procedure for crystal structure model refinement from experimental diffraction data, implemented in the ASTRA program package, are described. Such tools as statistical tests, parameter scanning, and data scanning reduce the time necessary for structural investigation. At strong correlations between parameters, especially when the data set is limited, parameter scanning has an advantage over the full-matrix refinement.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Investigation of the accuracy of modeling the orientation distribution function of polycrystalline materials from individual orientations

The accuracy of reconstructing the orientation distribution function of grains in polycrystalline materials by the kernel method from a set of individual orientations has been studied. In particular, the influence of choosing the smoothing kernel in the kernel method and the influence of the dependence on the resulting distribution are taken into account. The rotations obeying the normal distribution on the group SO(3) and obtained by the statistical test method are used as an orientation set. Some aspects of electron backscattering diffraction measurements are considered. This problem is urgent in view of the expanding potential of the experimental study of the texture of polycrystalline materials, especially for electron microscopy, which makes it possible to measure the orientations of individual grains.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

G-Mapper: Learning a Cover in the Mapper Construction

The Mapper algorithm is a visualization technique in topological data analysis (TDA) that outputs a graph reflecting the structure of a given dataset. However, the Mapper algorithm requires tuning several parameters in order to generate a “nice” Mapper graph. This paper focuses on selecting the cover parameter. We present an algorithm that optimizes the cover of a Mapper graph by splitting a cover repeatedly according to a statistical test for normality. Our algorithm is based on G-means clustering, which searches for the optimal number of clusters in 𝑘-means by iteratively applying the Anderson–Darling test. Our splitting procedure employs a Gaussian mixture model to carefully choose the cover according to the distribution of the given data. In conclusion, experiments for synthetic and real-world datasets demonstrate that our algorithm generates covers so that the Mapper graphs retain the essence of the datasets, while also running significantly faster than a previous iterative method.

G-means clustering↗

jansson_snijders_collaborative_cross

This is supplemental material for a scientific paper. This project 'bernstein-2017-founders-species', explores community succession using a lake biofilm as a model. The code here was used to process and analyze environmental metadata and genetic sequencing data. Statistical tests and data visualization are included. This code makes use of commodity software that is freely available and commonly used in this field. No new methods or techniques are introduced in this code.

Brislawn, Colin↗

SF_Microbe_Methane (SFMM) v1

Scripts for analyzing microbial community taxonomy and function, running statistical tests, and making complex graphics.

de Mesquita, CliftonB↗

apricots

APRICOTS: Averaged-Polarization Resampled Integrated Correlated Omnidirectional Test Statistics (O4835)

Meadors, Grant David↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Environmental sciences↗

Causal Interactions between Southern Ocean Polynyas and High-Latitude Atmosphere–Ocean Variability

Abstract Weddell Sea open-ocean polynyas have been observed to occasionally release heat from the deep ocean to the atmosphere, indicating that their sporadic appearances may be an important feature of high-latitude atmosphere–ocean variability. Yet, observations of the phenomenon are sparse and many standard-resolution models represent these features poorly, if at all. We use a fully coupled, synoptic-scale preindustrial control simulation of the Energy Exascale Earth System Model (E3SMv0-HR) to effectively simulate open-ocean polynyas and investigate their role in the climate system. Our approach employs statistical tests of Granger causality to diagnose local and remote drivers of, and responses to, polynya heat loss on interannual to decadal time scales. First, we find that polynya heat loss Granger causes a persistent increase in surface air temperature over the Weddell Sea, strengthening the local cyclonic wind circulation. Along with responding to polynyas, atmospheric conditions also facilitate their development. When the Southern Ocean experiences a rapid poleward shift in the circumpolar westerlies following a prolonged negative phase of the southern annular mode (SAM), Weddell Sea salinity increases, promoting density destratification and convection in the water column. Finally, we find that the reduction of surface heat fluxes during periods of full ice cover is not fully compensated by ocean heat transport into the high latitudes. This imbalance leads to a buildup of ocean heat content that supplies polynya heat loss. These results disentangle the complex, coupled climate processes that both enable the polynya’s existence and respond to it, providing insights to improve the representation of these highly episodic sea ice features in climate models.

Kaufman, Zachary S.↗

β1 integrin mediates an alternative survival pathway in breast cancer cells resistant to lapatinib

The overexpression of human epidermal growth factor receptor (HER)-2 in 20% of human breast cancers and its association with aggressive growth has led to widespread use of HER2-targeted therapies, such as trastuzumab (T) and lapatinib (L). Despite the success of these drugs, their efficacy is limited in patients whose tumors demonstrate de novo or acquired resistance to treatment. The b1 integrin resides on the membrane of the breast cancer cell, activating several elements of breast tumor progression including proliferation and survival. We developed a panel of HER2-overexpressing cell lines resistant to L, T, and the potent LT combination through long-term exposure and validated these models in 3D culture. Parental and L/T/LT-resistant cells were subject to HER2 and b1 integrin inhibitors in 3D and monitored for 12 days, followed by quantification of colony number. Parallel experiments were conducted where cells were either stained for Ki-67 and Terminal deoxynucleotidyl transferase dUTP nick end labeling (TUNEL) or harvested for protein and analyzed by immunoblot. Results were subjected to statistical testing using analysis of variance and linear contrasts, followed by adjustment with the Sidak method. Using multiple cell lines including BT474 and HCC1954, we reveal that in L and LT resistance, where phosphorylation of EGFR/HER1, HER2, and HER3 are strongly inhibited, kinases downstream of b1 integrin– including focal adhesion kinase (FAK) and Src–are up-regulated. Blockade of b1 by the antibody AIIB2 abrogates this up-regulation and functionally achieves significant growth inhibition of L and LT resistant cells in 3D, without dramatically affecting the parental cells. SiRNA against b1 as well as pharmacologic inhibition of FAK achieve the same growth inhibitory effect. In contrast, trastuzumab-resistant cells, which retain high levels of phosphorylated EGFR/HER1, HER2, and HER3, are only modestly growth-inhibited by AIIB2. Our data suggest that HER2 activity, which is suppressed in resistance involving L but not T alone, dictates whether b1 mediates an alternative pathway driving resistance. Our findings justify clinical studies investigating the inhibition of b1 or its downstream signaling moieties as strategies to overcome acquired L and LT resistance.

59 BASIC BIOLOGICAL SCIENCES↗

Sub-pixel high-resolution imaging of high-energy x-rays inspired by sub-wavelength optical imaging

We have developed and demonstrated an image super-resolution method—XR-UNLOC: X-Ray UNsupervised particle LOCalization—for hard x-rays measured with fast-frame-rate detectors that is an adaptation of the principle of photo-activated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), which enabled biological fluorescence imaging at sub-optical-wavelength scales. We demonstrate the approach on experimental coherent Bragg diffraction data measured with 52 keV x-rays from a nanocrystalline sample. From this sample, we resolve the fine fringe detail of a high-energy x-ray Bragg coherent diffraction pattern to an upsampling factor of 16 of the native pixel pitch of 30 μ m of a charge-integrating fastCCD detector. This was accomplished by analysis of individual photon locations in a series of “nearly-dark” instances of the diffraction pattern that each contain only a handful of photons. Central to our approach was the adaptation of the UNLOC photon fitting routine for PALM/STORM to the hard x-ray regime to handle much smaller point spread functions, which required a different statistical test for photon detection and for sub-pixel localization. A comparison to a photon-localization strategy used in the x-ray community (“droplet analysis”) showed that XR-UNLOC provides significant improvement in super-resolution. We also developed a metric by which to estimate the limit of reliable upsampling with XR-UNLOC under a given set of experimental conditions in terms of the signal-to-noise ratio of a photon detection event and the size of the point spread function for guiding future x-ray experiments in many disciplines where detector pixelation limits must be overcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Measures of illuminant-induced metameric mismatch: theory, comparative analysis, and implications for application

Illuminant-induced metameric mismatch is an important consideration in the specification of light sources for some architectural environments, yet there is currently no standardized performance measure. The goal of this work was to evaluate two recent research proposals: the metameric uncertainty index ( R t ) and the metamer mismatching color rendering index (MMCRI). To compare the relative performance of these two measures, 100,000 spectral power distributions were generated with 3, 4, 5, 6, and 7 Gaussian spectral components and spectral widths varying from 1 nm (monochromatic) to 100 nm. Both measures generally agree with the theory that broadband radiation should cause less metameric mismatch than narrowband radiation. The two measures have relatively better agreement for broadband SPDs and relatively worse agreement for narrower spectra. Despite some similarities, non-parametric statistical tests suggest that R t and MMCRI are significantly different quantifications of illuminant-induced metameric mismatch ( p < 0.0001 for all comparisons). Characteristics of the MMCRI computation that are potentially problematic for applied lighting were observed.

42 ENGINEERING↗