Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Reproducible radiation-damage processes in proteins irradiated by intense x-ray pulses

X-ray free-electron lasers have enabled femtosecond protein nanocrystallography, a novel method to determine the structure of proteins. It allows time-resolved imaging of nanocrystals that are too small for conventional crystallography. The short pulse duration helps in overcoming the detrimental effects of radiation damage because x rays are scattered before the sample has been significantly altered. It has been suggested that, fortuitously, the diffraction process self-terminates abruptly once radiation damage destroys the crystalline order. Our calculations show that high-intensity x-ray pulses indeed trigger a cascade of damage processes in ferredoxin crystals, a particular metalloprotein of interest. However, we found that the damage process is initially not completely random. Correlations exist among the protein monomers, so that Bragg diffraction still occurs in the damaged crystals, despite significant atomic displacements. Our results show that the damage process is reproducible to a certain degree, which is potentially beneficial for the orientation step in single-molecule imaging.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Derivation of a realistic forcing term to reproduce the turbulent characteristics of round jets on the centerline

Turbulence forcing techniques are often required in the numerical simulation of statistically stationary turbulent flows. However, the existing forcing techniques are not based on physics, but rather arbitrary numerical methods that sustain the turbulent kinetic energy. In this work, a forcing technique is devised to reproduce the centerline turbulent characteristics of round jets in a triply periodic box. It is derived from the Navier-Stokes equations by applying aReynolds decompositionwith themean velocity of the axisymmetric jet. The result is an anisotropic linear forcing term, which is intended to be used in a three-dimensional box to create turbulence. Four direct numerical simulations with different Re λ have been performed with these forcing terms. We report the budget of the terms in the kinetic energy equation is very close to the experimental measurement on the centerline. The anisotropy, kinetic energy k, and dissipation rate ε of the simulations are also comparable to experimental values. Finally, the kinetic energy spectrum in the axial direction, $\phi(κ_1)$, is presented. With appropriate normalizations, the spectrum agrees well with the round jet spectrum on its centerline.

42 ENGINEERING↗

Enhanced Control and Reproducibility of Non-Neutral Plasmas

The simultaneous control of the density and particle number of non-neutral plasmas confined in Penning-Malmberg traps is demonstrated. Control is achieved by setting the plasma’s density by applying a rotating electric field while simultaneously fixing its axial potential via evaporative cooling. This novel method is particularly useful for stabilizing positron plasmas, as the procedures used to collect positrons from radioactive sources typically yield plasmas with variable densities and particle numbers; it also simplifies optimization studies that require plasma parameter scans. The reproducibility achieved by applying this technique to the positron and electron plasmas used by the ALPHA antihydrogen experiment at CERN, combined with other developments, contributed to a 10-fold increase in the antiatom trapping rate.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A round-robin approach provides a detailed assessment of biomolecular small-angle scattering data reproducibility and yields consensus curves for benchmarking

Through an expansive international effort that involved data collection on 12 small-angle X-ray scattering (SAXS) and four small-angle neutron scattering (SANS) instruments, 171 SAXS and 76 SANS measurements for five proteins (ribonuclease A, lysozyme, xylanase, urate oxidase and xylose isomerase) were acquired. From these data, the solvent-subtracted protein scattering profiles were shown to be reproducible, with the caveat that an additive constant adjustment was required to account for small errors in solvent subtraction. Further, the major features of the obtained consensus SAXS data over the q measurement range 0–1 Å −1 are consistent with theoretical prediction. The inherently lower statistical precision for SANS limited the reliably measured q -range to <0.5 Å −1 , but within the limits of experimental uncertainties the major features of the consensus SANS data were also consistent with prediction for all five proteins measured in H 2 O and in D 2 O. Thus, a foundation set of consensus SAS profiles has been obtained for benchmarking scattering-profile prediction from atomic coordinates. Additionally, two sets of SAXS data measured at different facilities to q > 2.2 Å −1 showed good mutual agreement, affirming that this region has interpretable features for structural modelling. SAS measurements with inline size-exclusion chromatography (SEC) proved to be generally superior for eliminating sample heterogeneity, but with unavoidable sample dilution during column elution, while batch SAS data collected at higher concentrations and for longer times provided superior statistical precision. Careful merging of data measured using inline SEC and batch modes, or low- and high-concentration data from batch measurements, was successful in eliminating small amounts of aggregate or interparticle interference from the scattering while providing improved statistical precision overall for the benchmarking data set.

59 BASIC BIOLOGICAL SCIENCES↗

DataFed: Towards Reproducible Research via Federated Data Management

The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a logical and holistic view of data that greatly simplifies and empowers data organization, curation, searching, sharing, dissemination, etc. We present DataFed - a lightweight, distributed SDMS that spans a federation of storage systems within a loosely-coupled network of scientific facilities. Unlike existing SDMS offerings, DataFed uses high-performance and scalable user management and data transfer technologies that simplify deployment, maintenance, and expansion of DataFed. DataFed provides web-based and command-line interfaces to manage data and integrate with complex scientific workflows. DataFed represents a step towards reproducible scientific research by enabling reliable staging of the correct data at the desired environment.

Stansberry, Dale↗

Device Engineering Towards Improved Tin Sulfide Solar Cell Performance and Performance Reproducibility

As novel absorber materials are developed and screened for their photovoltaic (PV) properties, the challenge remains to rapidly test promising candidates in high-performing PV devices. There is a need to engineer new compatible device architectures, including the development of novel transparent conductive oxides and buffer layers. Here, we consider the two approaches of a substrate-style and a superstrate-style device architecture for novel thin-film solar cells. We use tin sulfide as a test absorber material. Upon device engineering, we demonstrate new approaches to improve device performance and performance reproducibility.

14 SOLAR ENERGY↗

Simple steps to enable reproducibility: culture conditions affecting Chlamydomonas growth and elemental composition

Even subtle modifications in growth conditions elicit acclimation responses affecting the molecular and elemental makeup of organisms, both in the laboratory and in natural habitats. Here, we systematically explored the effect of temperature, pH, nutrient availability, culture density, and access to CO 2 and O 2 in laboratory-grown algal cultures on growth rate, the ionome, and the ability to accumulate Fe. We found algal cells accumulate Fe in alkaline conditions, even more so when excess Fe is present, coinciding with a reduced growth rate. Using a combination of Fe-specific dyes, X-ray fluorescence microscopy, and NanoSIMS, we show that the alkaline-accumulated Fe was intracellularly sequestered into acidocalcisomes, which are localized towards the periphery of the cells. At high photon flux densities, Zn and Ca specifically over-accumulate, while Zn alone accumulates at low temperatures. The impact of aeration was probed by reducing shaking speeds and changing vessel fill levels; the former increased the Cu quota of cultures, the latter resulted in a reduction in P, Ca, and Mn at low fill levels. Trace element quotas were also affected in the stationary phase, where specifically Fe, Cu, and Zn accumulate. Cu accumulation here depends inversely on the Fe concentration of the medium. Individual laboratory strains accumulate Ca, P, and Cu to different levels. All together, we identified a set of specific changes to growth rate, elemental composition, and the capacity to store Fe in response to subtle differences in culturing conditions of Chlamydomonas, affecting experimental reproducibility. Accordingly, we recommend that these variables be recorded and reported as associated metadata.

59 BASIC BIOLOGICAL SCIENCES↗

SU-E-QI-16: Reproducibility of Computed Tomography Quantitative Structural Features Using the FDA Thoracic Phantom Image Database

Purpose: To assess the reproducibility of quantitative structural features using images from the computed tomography thoracic FDA phantom database under different scanning conditions. Methods: Development of quantitative image features to describe lesion shape and size, beyond conventional RECIST measures, is an evolving area of research in need of benchmarking standards. Gavrielides et al. (2010) scanned a FDA-developed thoracic phantom with nodules of various Hounsfield units (HU) values, shapes and sizes close to vascular structures using several scanners and varying scanning conditions/parameters; these images are in the public domain. We tested six structural features, namely, Convexity, Perimeter, Major Axis, Minor Axis, Extent Mean and Eccentricity, to characterize lung nodules. Convexity measures lesion irregularity referenced to a convex surface. Previously, we showed it to have prognostic value in lung adenocarcinoma. The above metrics and RECIST measures were evaluated on three spiculated (8mm/-300HU, 12mm/+30HU and 15mm/+30HU) and two non-spiculated (8mm/+100HU and 10mm/+100HU) nodules (from layout 2) imaged at three different mAs values: 25, 100 and 200 mAs; on a Phillips scanner (16-slice Mx8000-IDT; 3mm slice thickness). The nodules were segmented semi-automatically using a commercial software tool; the same HU range was used for all nodules. Results: Analysis showed convexity having the lowest maximum coefficient of variation (MCV): 1.1% and 0.6% for spiculated and non-spiculated nodules, respectively, much lower compared to RECIST Major and Minor axes whose MCV were 10.1% and 13.4% for spiculated, and 1.9% and 2.3% for non-spiculated nodules, respectively, across the various mAs. MCVs were consistently larger for speculated nodules. In general, the dependence of structural features on mAs (noise) was low. Conclusion: The FDA phantom CT database may be used for benchmarking of structural features for various scanners and scanning conditions; we used only a small fraction of available data. Our feature convexity outperformed other structural features including RECIST measures.

60 APPLIED LIFE SCIENCES↗

SU-E-T-450: How Important Is a Reproducible Breath Hold for DIBH Breast Radiotherapy?

Purpose: Deep inspiration breath hold (DIBH) for left-sided breast cancer has been shown to reduce heart dose. Surface imaging helps to ensure accurate breast positioning, but does not guarantee a reproducible breath hold (BH) at DIBH treatments. We examine the effects of variable BH positions for DIBH treatments. Methods: Twenty-Five patients with free breathing (FB) and DIBH scans were reviewed. Four plans were created for each patient: 1) FB, 2) DIBH, 3) FB-DIBH – the DIBH plans were copied to the FB images and recalculated (image registration was based on breast tissue), and 4) P-DIBH – a partial BH with the heart shifted midway between the FB and DIBH positions. The FB-DIBH plans give “worst case” scenarios for surface imaging DIBH, where the breast is aligned by surface imaging but the patient is not holding their breath. Students t-tests were used to compare dose metrics. Results: The DIBH plans gave lower heart dose and comparable breast coverage versus FB in all cases. The FB-DIBH plans showed no significant difference versus FB plans for breast coverage, mean heart dose, or maximum heart dose (p >= 0.10). The mean heart dose differed between FB-DIBH and FB by < 2 Gy for all cases, the maximum heart dose differed by < 2 Gy for 21 cases. The P-DIBH plans showed significantly lower mean heart dose than FB (p = 0.01). The mean heart doses for the P-DIBH plans were < FB for 22 cases, the maximum dose < FB for 18 cases. Conclusions: A DIBH plan delivered to a FB patient set-up with surface imaging will yield similar dosimetry to a plan created and delivered FB. A DIBH plan delivered with even a partial BH can give reduced heart dose compared to FB techniques when the breast tissue is well aligned.

60 APPLIED LIFE SCIENCES↗

TU-AB-BRA-06: Texture Feature Reproducibility Between PET/CT and PET/MR Imaging Modalities

Purpose: Radiomics involves the extraction of texture features from different imaging modalities with the purpose of developing models to predict patient treatment outcomes. The purpose of this study is to investigate texture feature reproducibility across [18F]FDG PET/CT and [18F]FDG PET/MR imaging in patients with primary malignancies. Methods: Twenty five prospective patients with solid tumors underwent clinical [18F]FDG PET/CT scan followed by [18F]FDG PET/MR scans. In all patients the lesions were identified using nuclear medicine reports. The images were co-registered and segmented using an in-house auto-segmentation method. Fifty features, based on the intensity histogram, second and high order matrices, were extracted from the segmented regions from both image data sets. One-way random-effects ANOVA model of the intra-class correlation coefficient (ICC) was used to establish texture feature correlations between both data sets. Results: Fifty features were classified based on their ICC values, which were found in the range from 0.1 to 0.86, in three categories: high, intermediate, and low. Ten features extracted from second and high-order matrices showed large ICC ≥ 0.70. Seventeen features presented intermediate 0.5 ≤ ICC ≤ 0.65 and the remaining twenty three presented low ICC ≤ 0.45. Conclusion: Features with large ICC values could be reliable candidates for quantification as they lead to similar results from both imaging modalities. Features with small ICC indicates a lack of correlation. Therefore, the use of these features as a quantitative measure will lead to different assessments of the same lesion depending on the imaging modality from where they are extracted. This study shows the importance of the need for further investigation and standardization of features across multiple imaging modalities.

60 APPLIED LIFE SCIENCES↗

SU-F-J-122: Rectal Sparing Reproducibility in Prostate Cancer Patients Treated with Hydrogel Spacer and Proton Therapy

Purpose: Rectal hydrogel spacer has been shown to improve rectal sparing in prostate radiotherapy. The purpose of this study was to determine the reproducibility of rectal sparing throughout treatment in patients undergoing proton therapy. Methods: At our facility, prostate cancer patients are treated with pencil beam scanning proton therapy, utilizing an endorectal balloon (ERB) or rectal spacer hydrogel (Gel) “SpaceOAR” implant. All patients were treated with a full bladder and empty rectum (low residue diet and stool softeners). A quality assurance CT (QACT) was performed periodically throughout treatment to ensure rectal filling consistency and sparing in 41 patients treated with Gel. The treatment planning (TP) dose was calculated on each QACT and the rectum V90%, V75%, V65%, V50%, and V40% were recorded. QACT scans were acquired on day 0, week 1, week 3, and week 5. Results: 144 QACT scans were analyzed, each patient receiving 3–4 QACTs. Rectum V90% was within +/−1% of the TP dose in 70% of the QACTs and within +/−5% in 95% of scans. From previous data analyses, our ERB rectum V90% average is 6%. This value was used as an upper threshold for the Gel QACT analysis. 5 of the 41 patients (12%), corresponding to 7 QACTs, had a rectum V90% that exceeded 6% on one or more QACTs. However, the average rectal V90% measured over multiple QACTs never exceeded 6%. 55% of the QACTs had a rectum volume within 5cc of the TPCT volume, 68% were within 10cc. Conclusion: In this study, we have shown that a majority of our prostate patients can maintain consistent rectal sparing when treated with a hydrogel spacer. QACT rectal V90% exceeding our threshold was most often related to increased rectal filling and gas, which was addressed with improved dietary compliance and the intensification of stool softeners or laxatives.

60 APPLIED LIFE SCIENCES↗

Reproducible growth of Brachypodium in EcoFAB 2.0 reveals that nitrogen form and starvation modulate root exudation

Understanding plant-microbe interactions requires examination of root exudation under nutrient stress using standardized and reproducible experimental systems. We grew Brachypodium distachyon hydroponically in fabricated ecosystem devices (EcoFAB 2.0) under three inorganic nitrogen forms (nitrate, ammonium, and ammonium nitrate), followed by nitrogen starvation. Analyses of exudates with liquid chromatography–tandem mass spectrometry, biomass, medium pH, and nitrogen uptake showed EcoFAB 2.0’s low intratreatment data variability. Furthermore, the three inorganic nitrogen forms caused differential exudation, generalized by abundant amino acids–peptides and alkaloids. Comparatively, nitrogen deficiency decreased nitrogen-containing compounds but increased shikimates-phenylpropanoids. Subsequent bioassays with two shikimates-phenylpropanoids (shikimic and p-coumaric acids) on soil bacteria or Brachypodium seedlings revealed their distinct capacity to regulate both bacterial and plant growth. Our results suggest that (i) Brachypodium alters exudation in response to nitrogen status, which can affect rhizobacterial growth, and (ii) EcoFAB 2.0 is a valuable standardized plant research tool.

59 BASIC BIOLOGICAL SCIENCES↗

Asymptotically Compatible Reproducing Kernel Collocation and Meshfree Integration for Nonlocal Diffusion

Reproducing kernel (RK) approximations are meshfree methods that construct shape functions from sets of scattered data. We present an asymptotically compatible (AC) RK collocation method for nonlocal diffusion models with Dirichlet boundary condition. The numerical scheme is shown to be convergent to both nonlocal diffusion and its corresponding local limit as nonlocal interaction vanishes. The analysis is carried out on a special family of rectilinear Cartesian grids for a linear RK method with designed kernel support. The key idea for the stability of the RK collocation scheme is to compare the collocation scheme with the standard Galerkin scheme, which is stable. In addition, assembling the stiffness matrix of the nonlocal problem requires costly computational resources because high-order Gaussian quadrature is necessary to evaluate the integral. We thus provide a remedy to the problem by introducing a quasi-discrete nonlocal diffusion operator for which no numerical quadrature is further needed after applying the RK collocation scheme. The quasi-discrete nonlocal diffusion operator combined with RK collocation is shown to be convergent to the correct local diffusion problem by taking the limits of nonlocal interaction and spatial resolution simultaneously. The theoretical results are then validated with numerical experiments. We additionally illustrate a connection between the proposed technique and an existing optimization based approach based on generalized moving least squares.

97 MATHEMATICS AND COMPUTING↗

Reproducing heavy-ion fusion cross sections at extreme sub-barrier energies with a simple formula: Analysis of fusion hindrance with a Gaussian barrier distribution

Heavy-ion fusion hindrance occurs at extreme sub-barrier energies. This behavior is well reproduced with a simple cross section formula, which was developed by Siwek-Wilczynska et al., based on a single-Gaussian distribution of fusion barrier heights, before the discovery of the hindrance phenomenon. This expression has not yet been widely used and referenced in the literature. An analysis by using this simple formula is presented for 29 systems, from 16 O + 18 O to 64 Ni + 124 Sn , all being measured down to less than 10μb. The agreement with the data is even better than the ones from sophisticated Coupled-channels calculations. This simple expression also applies to fusion reactions in lighter systems. Here, the three parameters contained in this formula vary in a relatively smooth fashion over the whole mass range, and can be used to extrapolate cross sections or to obtain an estimate of the excitation function for systems which have not been measured. Extensions and restrictions of this method are also discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗

How to Obtain Reproducible Results for Lithium Sulfur Batteries

The basic requirements for getting reliable Li-S battery data have been discussed in this work. Unlike Li-ion batteries, electrolyte-rich environment significantly affects the cycling stability of Li-S batteries prepared and tested under the same conditions. The reason has been assigned to the different concentrations of polysulfide-containing electrolytes in the cells, which have profound influences on both sulfur cathode and lithium anode. At optimized S/E ratio of 50 g L-1, a good balance among electrolyte viscosity, wetting ability, diffusion rate dissolved polysulfide and nucleation/growth of short-chain Li2S/Li2S2 has been built along with largely reduced contamination on the lithium anode side. Accordingly, good cyclability, high reversible capacity and Coulombic efficiency are achieved in Li-S cell with controlled S/E ratio without any additive. Other factors such as sulfur content in the composite and sulfur loading on the electrode also need careful concern in Li-S system in order to generate reproducible results and gauge the various methods used to improve Li-S battery technology.

Cycling stability↗

Limitations of Bin and Bulk Microphysics in Reproducing the Observed Spatial Structure of Light Precipitation

Abstract Coarse-gridded atmospheric models often account for subgrid-scale variability by specifying probability distribution functions (PDFs) of process rate inputs such as cloud and rainwater mixing ratios ( q c and q r , respectively). PDF parameters can be obtained from numerous sources: in situ observations, ground- or space-based remote sensing, or fine-scale modeling such as large-eddy simulation (LES). LES is appealing to constrain PDFs because it generates large sample sizes, can simulate a variety of cloud regimes/case studies, and is not subject to the ambiguities of observations. However, despite the appeal of using model output for parameterization development, it has not been demonstrated that LES satisfactorily reproduces the observed spatial structure of microphysical fields. In this study, the structure of observed and modeled microphysical fields are compared by applying bifractal analysis, an approach that quantifies variability across spatial scales, to simulations of a drizzling stratocumulus field that span a range of domain sizes, drop concentrations (a proxy for mesoscale organization), and microphysics schemes (bulk and bin). Simulated q c closely matches observed estimates of bifractal parameters that measure smoothness and intermittency. There are major discrepancies between observed and simulated q r properties, though, with bulk simulated q r consistently displaying the bifractal properties of observed clouds (smooth, minimally intermittent) rather than rain while bin simulations produce q r that is appropriately intermittent but too smooth. These results suggest fundamental limitations of bulk and bin schemes to realistically represent higher-order statistics of the observed rain structure.

54 ENVIRONMENTAL SCIENCES↗

Improved quality metrics for association and reproducibility in chromatin accessibility data using mutual information

Correlation metrics are widely utilized in genomics analysis and often implemented with little regard to assumptions of normality, homoscedasticity, and independence of values. This is especially true when comparing values between replicated sequencing experiments that probe chromatin accessibility, such as assays for transposase-accessible chromatin via sequencing (ATAC-seq). Such data can possess several regions across the human genome with little to no sequencing depth and are thus non-normal with a large portion of zero values. Despite distributed use in the epigenomics field, few studies have evaluated and benchmarked how correlation and association statistics behave across ATAC-seq experiments with known differences or the effects of removing specific outliers from the data. Here, we developed a computational simulation of ATAC-seq data to elucidate the behavior of correlation statistics and to compare their accuracy under set conditions of reproducibility. Using these simulations, we monitored the behavior of several correlation statistics, including the Pearson’s R and Spearman’s ρ coefficients as well as Kendall’s τ and Top–Down correlation. We also test the behavior of association measures, including the coefficient of determination R 2 , Kendall’s W, and normalized mutual information. Our experiments reveal an insensitivity of most statistics, including Spear man’s ρ, Kendall’s τ, and Kendall’s W, to increasing differences between simulated ATAC-seq replicates. The removal of co-zeros (regions lacking mapped sequenced reads) between simulated experiments greatly improves the estimates of correlation and association. After removing co-zeros, the R 2 coefficient and normalized mutual information display the best performance, having a closer one-to-one relationship with the known portion of shared, enhanced loci between simulated replicates. When comparing values between experimental ATAC-seq data using a random forest model, mutual information best predicts ATAC-seq replicate relationships. Collectively, this study demonstrates how measures of correlation and association can behave in epigenomics experiments. We provide improved strategies for quantifying relationships in these increasingly prevalent and important chromatin accessibility assays.

59 BASIC BIOLOGICAL SCIENCES↗