Search NASA⌕ Search

SEARCH · Search NASA

Results for “error indicators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Measuring qubit stability in a gate-based NISQ hardware processor

Some of the most problematic issues that limit the implementation of applications on Noisy Intermediate Scale Quantum (NISQ) machines are the adverse impacts of both incoherent and coherent errors. We conducted an in-depth study of coherent errors on a quantum hardware platform using a transverse field Ising model Hamiltonian as a sample user application. We report here on the results from these computations using several error mitigation protocols that profile these errors and provide an indication of the hardware qubit stability. Through a detailed set of measurements we identify inter-day and intra-day qubit calibration drift and the impacts of quantum circuit placement on groups of qubits in different physical locations on the processor. This paper also discusses how these measurements can provide a better understanding of these types of errors and how they may improve efforts to validate the accuracy of quantum computations.

Yeter-Aydeniz, Kübra↗

WE-E-18A-09: Application of a Channelized Hotelling Observer Model to Evaluate Angiographic Imaging Equipment

Purpose: To develop and apply an observer model to objectively evaluate and compare the performance of different angiographic imaging equipment and acquisition variables. Methods: Image Acquisition— Iodine-based phantoms were created with target diameters: 0.5, 1, 2, and 4 mm. The phantoms were imaged using both planes of a bi-plane angiography system with detector pixel dimensions 0.1542 mm{sup 2} and 0.1842 mm{sup 2}, respectively. All four phantoms were imaged with magnification factors 1.5, 1.25 and 1 and with the large and small focal spots. Phantom position and the dose per frame (0.12– 0.24 μ Gy/frame) were varied for a single phantom size, magnification and focal spot. Observer Model— For each experimental condition, 1200 signal-present and signal-absent images were acquired and a detectability index (d') was calculated with a Gabor-channelized Hotelling observer (CHO) model. Detectability indices were evaluated as a function of dose, phantom size, and magnification. The model was then applied to compare d' of the two imaging planes and focal spots. Uncertainty in d' was estimated by bootstrapping the data and by examining the shift-variance of systems. Results: Detectability indices varied linearly with magnification and the square root of dose. For the 2 and 4 mm phantoms, d' varied linearly with diameter. For the 0.5 and 1 mm phantoms, d' expectedly deviated from this linear relationship due to substantial detector and focal spot blurring of the phantoms. The small focal spot yielded up to 50% greater d' values than the large focal spot. For the two detectors, differences in d' did not exceed the estimated ∼7% error. Conclusions: The detectability indices predictably scaled with dose, diameter, magnification, and focal spot size and serve to validate the model. Results demonstrate statistically similar target detectability for both investigated detectors, despite differences in pixel dimensions. This CHO model provides a framework to evaluate angiographic system performance.

60 APPLIED LIFE SCIENCES↗

Applications of aggregation theory to sustainability assessment

In order to aid in transition towards operations that promote sustainability goals, researchers and stakeholders use sustainability assessments. Although assessments take various forms, many utilize diverse sets of indicators that can number anywhere from two to over 2000. Indices, composite indicators, or aggregate values are used to simplify high dimensional and complex data sets and to clarify assessment results. Although the choice of aggregation function is a key component in the development of the assessment, there are few examples to be found in literature to guide appropriate aggregation function selection. This paper develops a connection between the mathematical study of aggregation functions and sustainability assessment in order to aid in providing criteria for aggregation function selection. Relevant mathematical properties of aggregation functions are presented and interpreted. Lastly, we provide cases of these properties and their relation to previous sustainability assessment research. Examples show that mathematical aggregation properties can be used to address the topics of compensatory behavior and weak versus strong sustainability, aggregation of data under varying units of measurements, multiple site multiple indicator aggregation, and the determination of error bounds in aggregate output for normalized and non-normalized indicator measures.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The REFLEX project: Comparing different algorithms and implementations for the inversion of a terrestrial ecosystem model against eddy covariance data

We describe a model-data fusion (MDF) inter-comparison project (REFLEX), which compared various algorithms for estimating carbon (C) model parameters consistent with both measured carbon fluxes and states and a simple C model. Participants were provided with the model and with both synthetic net ecosystem exchange (NEE) ofCO2 and leaf area index (LAI) data, generated from the model with added noise, and observed NEE and LAI data from two eddy covariance sites. Participants endeavoured to estimate model parameters and states consistent with the model for all cases over the two years for which data were provided, and generate predictions for one additional year without observations. Nine participants contributed results using Metropolis algorithms, Kalman filters and a genetic algorithm. For the synthetic data case, parameter estimates compared well with the true values. The results of the analyses indicated that parameters linked directly to gross primary production (GPP) and ecosystem respiration, such as those related to foliage allocation and turnover, or temperature sensitivity of heterotrophic respiration,were best constrained and characterised. Poorly estimated parameters were those related to the allocation to and turnover of fine root/wood pools. Estimates of confidence intervals varied among algorithms, but several algorithms successfully located the true values of annual fluxes from synthetic experiments within relatively narrow 90% confidence intervals, achieving>80% success rate and mean NEE confidence intervals <110 gCm-2 year-1 for the synthetic case. Annual C flux estimates generated by participants generally agreed with gap-filling approaches using half-hourly data. The estimation of ecosystem respiration and GPP through MDF agreed well with outputs from partitioning studies using half-hourly data. Confidence limits on annual NEE increased by an average of 88% in the prediction year compared to the previous year, when data were available. Confidence intervals on annual NEE increased by 30% when observed data were used instead of synthetic data, reflecting and quantifying the addition of model error. Finally, our analyses indicated that incorporating additional constraints, using data on C pools (wood, soil and fine roots) would help to reduce uncertainties for model parameters poorly served by eddy covariance data.

09 BIOMASS FUELS↗

The use of digital thread for reconstruction of local fiber orientation in a compression molded pin bracket via deep learning

A deep convolutional neural network (DCNN) was used for microstructure reconstruction using artificial intelligence (MR-AI) by predicting local average fiber orientation distributions (FOD) in a 3D prepreg platelet molded composite (PPMC) pin bracket. To train the MR-AI model, surface strain fields from residual stresses simulated in PPMC plates were used as the input to the DCNN. A training dataset included PPMC plates with various degrees of global fiber alignment, based on the information obtained from high-fidelity flow simulation of a pin bracket. Further, the MR-AI model was then deployed to analyze FOD in the 3D pin bracket by conducting thermo-elastic residual stress analysis. Initially, the MR-AI model was established entirely on the synthetic simulation data. Then, a μCT scan of a physically molded pin bracket was used to create a finite element model that provided data for additional validation of the DCNN model. For the μCT scan finite element pin bracket the MR-AI model predicted the distribution of fiber orientation tensor components with MAE of 0.10 indicating a global prediction error of 10%. For the flow simulated pin bracket, the MR-AI model predicted the distribution of fiber orientation tensor components with a global prediction error of 11%. The MR-AI model showed the ability to predict regions of varying alignment in the base and flange of the pin bracket. The proposed MR-AI methodology allows for rapid prediction of FOD in geometrically complex parts and offers a promising path to detecting unique fiber orientation states in molded components.

42 ENGINEERING↗

Predicting Device Parameters for Dye-Sensitized Solar Cells from Electronic Structure Calculations to Reproduce Experiment.

Given that improvements to the power-conversion efficiency (PCE) of dye-sensitized solar cells (DSSCs) have slowed in recent years, a means to accurately predict the device parameters yielded by trial dyes in silico, without having to synthesize them, would be extremely valuable to speed up the design process. Currently, the best-performing methods of calculating device parameters rely on a set of experimentally determined kinetic coefficients. In practice, it is very difficult to measure these kinetic parameters accurately, limiting the overall accuracy of such predictive methods. This work proposes a model to obtain key parameters such as J(SC), V-OC, and PCE using only the results from density functional theory (DFT) and time-dependent DFT calculations, noting that rates of electron-transfer steps are ultimately linked to the electronic structure of the dye center dot center dot center dot TiO2 working electrode. Six organic DSSC dyes from dissimilar chemical classes (L0, L1, L2, WS-2, WS-92, and C281) were chosen to demonstrate the power of this approach. Their a priori known experimentally determined device performance metrics served to validate our predictions. The greatest absolute error in our predicted PCE values was 0.36% relative to the experiment, while the greatest fractional error was 0.042. This indicates that the proposed model offers a dramatic improvement on previous predictive methods for DSSC device parameters, both in accuracy and in consistency. Moreover, such a predictive model has great potential to be applied to other photovoltaic applications, further enabling the design of novel, highly efficient photoactive materials.

density functional theory↗

Deterministic High-Fidelity Neutronics Simulation of Pebble Bed Reactors Using Pebble Tracking Transport

The pebble tracking transport (PTT) algorithm offers a high-fidelity deterministic approach for neutron transport for pebble bed reactors (PBRs). This approach requires the mesh for the active-core region to consist exclusively of tetrahedral elements, where each node in the pebble-packing region represents a pebble centroid. This paper investigates the application of PTT for full-scale PBRs, considering both the isothermal and the temperature-dependent core conditions. Macroscopic cross sections are generated using Serpent 2 full-core eigenvalue simulations where pebbles are grouped into disjoint subsets using machine learning. To minimize the need for individual cross-section sets for each pebble in the core, K-means clustering is used to group pebbles by temperature and neutronic environment parameters. Here, we compare the multiplication factor and power rate distributions between PTT simulations using the Griffin reactor physics software and reference solutions from Serpent 2. Our analysis shows that a full-core, high-fidelity PTT calculation produces accurate results with minimal local (pebblewise) errors. Additionally, timing results indicate that PTT simulations converge rapidly on modern supercomputing platforms.

Griffin↗

An Evaluation of Redd Counts as a Measure of Bull Trout Population Size and Trend

Abstract The use of redd counts to monitor abundance and trend of bull trout Salvelinus confluentus has been clouded by uncertainties concerning measurement error, life history variation, and correspondence of redd counts to adult population size. We compared census redd counts with population estimates of mature females for a migratory fluvial population of bull trout (primarily ≥ 300 mm fork length) and for a population of small (<200 mm), likely resident, bull trout. We also compared the measurement error of the experienced surveyors who conducted the redd counts to that of a group of inexperienced surveyors. Although the regression of redd counts on adult females for the migratory population was statistically significant, a large proportion of the variation in the relationship was unexplained (r 2 = 0.47). Despite that variation, redd counts accurately reflected a greater than 50% decline in the population over 10 years; however, 5-year trends in redd counts could be misleading. Power analysis parameterized by using the variation in the number of females per redd and measurement error of experienced surveyors indicated that minimum declines of 44–56% or increases of 78–118% over 10–15 years would be necessary for detection using traditional statistical criteria. Geometric mean abundance of migratory adults derived from redd counts and adults-per-redd values from the present study and published averages were similar to measured adult numbers in most cases. For both migratory and resident populations, redd counts by experienced surveyors were substantially more accurate and precise than those by inexperienced surveyors. Counts of migratory bull trout redds were more accurate and precise than counts of resident bull trout redds, which were significantly smaller and consistently underestimated. Thus, bull trout redd counts can be used to estimate abundance levels and to detect substantial longer-term changes in abundance, particularly for migratory populations. However, the reliability of the counts depends on the skill of the surveyors. Received April 4, 2011; accepted August 8, 2011

Howell, Philip J.↗

POPULATION EFFECTS ON THE METALLICITY DISTRIBUTION FUNCTION DERIVED FROM THE RED GIANT BRANCH

We have tested the reliability of the red giant branch (RGB) as a metallicity indicator accounting for observational errors as well as the complexity of star formation histories and chemical evolution histories observed in various stellar systems. We generate model color–magnitude diagrams (CMDs) produced with a variety of evolutionary histories and compare the resultant metallicity estimates from the colors and magnitudes of RGB stars to the true input metallicities. We include realistic models for photometric errors and completeness in our synthetic CMDs. As expected, for simple simple stellar populations dominated by old stars, the RGB provides a very accurate estimate of the modular metallicity value for a population. An error in the age of a system targeted for this type of study may produce metallicity errors of a few tenths of a dex. The size of this metallicity error depends linearly on the age error, and we find this dependence to be stronger with more precise photometry. If the population has experienced any significant star formation within the last ∼6 Gyr, the metallicity estimates, [M/H], derived from the RGB may be in error by up to ∼0.5 dex. Perhaps the most important consideration for this technique is an accurate, independent estimate of the average age for the target stellar system, especially if it is probable that a significant fraction of the population formed less than ∼6 Gyr ago.

79 ASTRONOMY AND ASTROPHYSICS↗

The Sloan Digital Sky Survey COADD: 275 deg{sup 2} of deep Sloan Digital Sky Survey imaging on stripe 82

We present details of the construction and characterization of the coaddition of the Sloan Digital Sky Survey (SDSS) Stripe 82 ugriz imaging data. This survey consists of 275 deg{sup 2} of repeated scanning by the SDSS camera over –50° ≤ α ≤ 60° and –1.°25 ≤ δ ≤ +1.°25 centered on the Celestial Equator. Each piece of sky has ∼20 runs contributing and thus reaches ∼2 mag fainter than the SDSS single pass data, i.e., to r ∼ 23.5 for galaxies. We discuss the image processing of the coaddition, the modeling of the point-spread function (PSF), the calibration, and the production of standard SDSS catalogs. The data have an r-band median seeing of 1.''1 and are calibrated to ≤1%. Star color-color, number counts, and PSF size versus modeled size plots show that the modeling of the PSF is good enough for precision five-band photometry. Structure in the PSF model versus magnitude plot indicates minor PSF modeling errors, leading to misclassification of stars as galaxies, as verified using VVDS spectroscopy. There are a variety of uses for this wide-angle deep imaging data, including galactic structure, photometric redshift computation, cluster finding and cross wavelength measurements, weak lensing cluster mass calibrations, and cosmic shear measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Systematic Uncertainties from Gribov Copies in Lattice Calculation of Parton Distributions in the Coulomb Gauge

Recently, a new method has been proposed to compute parton distributions using boosted correlators fixed in the Coulomb gauge (CG) within the framework of large-momentum effective theory. This approach, which does not involve Wilson lines, could greatly improve the efficiency and precision of lattice quantum chromodynamics calculations. However, concerns remain regarding whether systematic uncertainties from Gribov copies, which correspond to ambiguities in lattice gauge-fixing, are adequately controlled. This work assesses the effects of Gribov copies on Coulomb-gauge-fixed quark correlators. We utilize different strategies for Coulomb-gauge fixing, selecting two different groups of Gribov copies based on lattice gauge configurations. We examine the differences in the resulting spatial quark correlators in both vacuum and pion states. Our findings indicate that the statistical errors of the matrix elements from both Gribov copies, regardless of the correlation range, decrease proportionally to the square root of the number of gauge configurations. The difference between the strategies does not show statistical significance compared to the gauge noise, demonstrating that the effect of the Gribov copies can be neglected in practical lattice calculations of quark parton distributions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Charge Radius of Neutron-Deficient Ni 54 and Symmetry Energy Constraints Using the Difference in Mirror Pair Charge Radii

he nuclear root-mean-square charge radius of Ni 54 was determined with collinear laser spectroscopy to be R ( Ni 54 ) = 3.737 ( 3 ) fm . In conjunction with the known radius of the mirror nucleus Fe 54 , the difference of the charge radii was extracted as Δ R ch = 0.049 ( 4 ) fm . Based on the correlation between Δ R ch and the slope of the symmetry energy at nuclear saturation density ( L ), we deduced 21 ≤ L ≤ 88 MeV . The present result is consistent with the L from the binary neutron star merger GW170817, favoring a soft neutron matter EOS, and barely consistent with the PREX-2 result within 1 σ error bands. Our result indicates the neutron-skin thickness of Ca 48 as 0.15–0.21 fm.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Adaptive Impact-Driven Detection of Silent Data Corruption for HPC Applications

For exascale HPC applications, silent data corruption (SDC) is one of the most dangerous problems because there is no indication that there are errors during the execution. We propose an adaptive impact-driven method that can detect SDCs dynamically. The key contributions are threefold. (1) We carefully characterize 18 real-world HPC applications and discuss the runtime data features, as well as the impact of the SDCs on their execution results. (2) We propose an impact-driven detection model that does not blindly improve the prediction accuracy, but instead detects only influential SDCs to guarantee user-acceptable execution results. (3) Our solution can adapt to dynamic prediction errors based on local runtime data and can automatically tune detection ranges for guaranteeing low false alarms. Experiments show that our detector can detect 80-99.99% of SDCs with a false alarm rate less that 1% of iterations for most cases. The memory cost and detection overhead are reduced to 15% and 6.3%, respectively, for a large majority of applications.

Exascale HPC↗

The impact of anthropometric patient-phantom matching on organ dose: A hybrid phantom study for fluoroscopy guided interventions

Purpose: To investigate the benefits and limitations of patient-phantom matching for determining organ dose during fluoroscopy guided interventions. Methods: In this study, 27 CT datasets representing patients of different sizes and genders were contoured and converted into patient-specific computational models. Each model was matched, based on height and weight, to computational phantoms selected from the UF hybrid patient-dependent series. In order to investigate the influence of phantom type on patient organ dose, Monte Carlo methods were used to simulate two cardiac projections (PA/left lateral) and two abdominal projections (RAO/LPO). Organ dose conversion coefficients were then calculated for each patient-specific and patient-dependent phantom and also for a reference stylized and reference hybrid phantom. The coefficients were subsequently analyzed for any correlation between patient-specificity and the accuracy of the dose estimate. Accuracy was quantified by calculating an absolute percent difference using the patient-specific dose conversion coefficients as the reference. Results: Patient-phantom matching was shown most beneficial for estimating the dose to heavy patients. In these cases, the improvement over using a reference stylized phantom ranged from approximately 50% to 120% for abdominal projections and for a reference hybrid phantom from 20% to 60% for all projections. For lighter individuals, patient-phantom matching was clearly superior to using a reference stylized phantom, but not significantly better than using a reference hybrid phantom for certain fields and projections. Conclusions: The results indicate two sources of error when patients are matched with phantoms: Anatomical error, which is inherent due to differences in organ size and location, and error attributed to differences in the total soft tissue attenuation. For small patients, differences in soft tissue attenuation are minimal and are exceeded by inherent anatomical differences. For large patients, difference in soft tissue attenuation can be large. In these cases, patient-phantom matching proves most effective as differences in soft tissue attenuation are mitigated. With increasing obesity rates, overweight patients will continue to make up a growing fraction of all patients undergoing medical imaging. Thus, having phantoms that better represent this population represents a considerable improvement over previous methods. In response to this study, additional phantoms representing heavier weight percentiles will be added to the UFHADM and UFHADF patient-dependent series.

60 APPLIED LIFE SCIENCES↗

Performance Comparison of Circular and Spherical Error Probable Estimators

This report compares the performance of three Circular Error Probable (CEP) estimators: the Grubbs-Patnaik estimator, a new, non-iterative, radial-integration estimator, and a median estimator. It also compares the performance of two Spherical Error Probable (SEP) estimators. The performance of each estimator is assessed in terms of bias, uncertainty, robustness, and computational complexity. Robustness is evaluated with respect to outliers, variations in the underlying statistical distribution characterizing munition impact positions, and impact-position measurement errors. The performance assessments indicate the radial-integration and Grubbs-Patnaik estimators perform nearly identically providing the statistical distribution of impact-position coordinates is jointly normal with zero means. In that case, both estimators outperform the median estimator by about 2% relative to the true CEP in terms of estimator uncertainty. The bias performance of the radial-integration and median estimators is close to zero for jointly normal impacts, however, the Grubbs-Patnaik estimator can be significantly biased for jointly normal impacts with non-zero means. When the statistical distribution characterizing impact positions is known, but not jointly normal, the radial-integration estimator is superior. In this case, the median estimator also outperforms the Grubbs-Patnaik estimator but is not quite as good as the radial-integration estimator. If the statistical distribution characterizing impacts is unknown and not jointly normal, or if distribution parameters are difficult or impractical to estimate, or if test data is corrupted with outliers, then the median estimator dramatically outperforms the other estimators, especially in terms of estimation bias. Unexpectedly, measurement noise did not significantly degrade the performance of any of the estimators, except for cases with signal to noise ratios less than five. Although the Grubbs-Patnaik estimator has remained the gold standard for CEP estimation for over half a century, the performance assessments indicate the new, non-iterative, radial-integration estimator and the median estimator offer significant advantages and, in most practical real-world conditions, are superior estimators. These estimators are also useful for SEP estimation whereas the Grubbs-Patnaik estimator does not extend to three dimensions.

97 MATHEMATICS AND COMPUTING↗

Revisiting Multi-Material Composite Structures with Homogenized Composite Properties

Composite structures inherently develop residual stresses during their curing process. Driven predominately by mismatched thermal strains between differing materials or ply orientations, but also affected by curing process phenomena like polymer shrinkage, these residual stresses can lead to failure within composite structures. There are several methods varying in complexity that can be used to model the development of residual stresses, all of which are capable of capturing sufficient detail to understand the residual stress state at the ply level. However, explicitly modeling all plies of a layup in a composite structure can be prohibitively expensive based on the number of plies, structure size, and required element size. The computational cost can be reduced through the homogenization of the composite layup without losing much fidelity of the overall response of the structure. The homogenization process reduces the many plies of a laminate to a single lamina that reduces complexity and increases the mesh size where a single element can span multiple plies. This report focuses on verification and validation efforts for a homogenization process using a suite of finite element simulations rather than an analytic solution derived from classical laminate theory. Initial verification using representative element volumes indicated there was minimal error in the homogenization process; however, this compounded to a small, but acceptable error in strip and split ring experimental composite structures. The error does under predict the residual stress state in the strip and split ring and should be accounted for when simulating composite structures with homogenized properties.

36 MATERIALS SCIENCE↗