Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

The Art of Automation: Translating Electron Microscopy Workflows Into Automated Processes

Acquiring data using a scanning transmission electron microscope (STEM) is a complex, multi-step process. The intricacy of the process depends on the type of sample, composition of the material, desired results of the experiment, resolution requirement and other experimental factors. Each experiment presents unique complications, such as sample drift and contamination, that the microscopist must consider when acquiring data. All these challenges are handled fluidly and expertly by experienced microscopists, but to reach new levels of innovation in material development, including greater reproducibility, throughput, and precision, the automation of these workflows is essential. The initial phase of this work involved translating intuition-based workflows into discrete, programmable steps. Some common key stages in STEM workflows are the initial tuning, scanning the sample for areas of interest, and then acquiring the data. Each stage can be broken further into specific parameter adjustments, such as aberration correction and dwell time optimization, depending on the experiment. When deconstructing various experiments each step was assessed for automation feasibility based on the amount of real time operator decisions. There are steps that lend themselves to automation more readily than others, such as course focusing and sample screening, but there is potential for full automation of all stages with time. As an initial step, an automated montage routine was developed, allowing for the efficient acquisition of large portions of the sample without requiring continuous intervention from the operator. The automation of this small process of the procedure demonstrates the value of this capability. A major challenge in automation arises from discrepancies between commanded, reported and actual stage movements. Using systematic tests, stage movement was quantified. This error can be corrected algorithmically for more accurate workflows in the future. Expanding automation capabilities would result in larger, more efficient data acquisition which allows for more robust statistical analysis. Additionally, this work lays the groundwork for a closed loop system where machine learning algorithms would intake automatically acquired data and make real time decisions. By progressively automating this instrument, this work establishes the foundation for fully automated experimentation in transmission electron microscopy.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Analyses for Localized Tallies in Monte Carlo Eigenvalue Calculations

It is well known that statistical estimates obtained from Monte Carlo criticality simulations can be adversely affected by cycle-to-cycle correlations in the fission source. In addition, there are several other more fundamental issues that may lead to errors in Monte Carlo results. These factors can have a significant impact on the calculated eigenvalue, localized tally means and their associated standard deviations. In fact, modern Monte Carlo computational tools may generate standard deviation estimates that are a factor of five or more lower than the true standard deviation for a particular tally due to the inter-cycle correlations in the fission source. The magnitude of this under-prediction can climb as high as one hundred when combined with an ill-converged fission source or poor sampling techniques. Since Monte Carlo methods are widely used in reactor analysis (as a benchmarking tool) and criticality safety applications, an in-depth understanding of the effects of these issues must be developed in order to support the practical use of Monte Carlo software packages. A rigorous statistical analysis of localized tally results in eigenvalue calculations is presented using the SCALE/KENO-VI and MCNP Monte Carlo codes. The purpose of this analysis is to investigate the under-prediction in the uncertainty and its sensitivity to problem characteristics and calculational parameters, and to provide a comparative study between the two codes with respect to this under-prediction. It is shown herein that adequate source convergence along with proper specification of Monte Carlo parameters can reduce the magnitude of under-prediction in the uncertainty to reasonable levels; below a factor of 2 when inter-cycle correlations in the fission source are not a significant factor. In addition, through the use of a modified sampling procedure, the effects of inter-cycle correlations on both the mean value and standard deviation estimates can be isolated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stabilized FE simulation of prototype thermal-hydraulics problems with integrated adjoint-based capabilities

A critical aspect of applying modern computational solution methods to complex multiphysics systems of relevance to nuclear reactor modeling, is the assessment of the predictive capability of specific proposed mathematical models. In this respect the understanding of numerical error, the sensitivity of the solution to parameters associated with input data, boundary condition uncertainty, and mathematical models is critical. Additionally, the ability to evaluate and or approximate the model efficiently, to allow development of a reasonable level of statistical diagnostics of the mathematical model and the physical system, is of central importance. In this study we report on initial efforts to apply integrated adjoint-based computational analysis and automatic differentiation tools to begin to address these issues. The study is carried out in the context of a Reynolds averaged Navier–Stokes approximation to turbulent fluid flow and heat transfer using a particular spatial discretization based on implicit fully-coupled stabilized FE methods. Initial results are presented that show the promise of these computational techniques in the context of nuclear reactor relevant prototype thermal-hydraulics problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

WE-AB-204-09: Respiratory Motion Correction in 4D-PET by Simultaneous Motion Estimation and Image Reconstruction (SMEIR)

Purpose: In conventional 4D-PET, images from different frames are reconstructed individually and aligned by registration methods. Two issues with these approaches are: 1) Reconstruction algorithms do not make full use of all projections statistics; and 2) Image registration between noisy images can Result in poor alignment. In this study we investigated the use of simultaneous motion estimation and image reconstruction (SMEIR) method for cone beam CT for motion estimation/correction in 4D-PET. Methods: Modified ordered-subset expectation maximization algorithm coupled with total variation minimization (OSEM- TV) is used to obtain a primary motion-compensated PET (pmc-PET) from all projection data using Demons derived deformation vector fields (DVFs) as initial. Motion model update is done to obtain an optimal set of DVFs between the pmc-PET and other phases by matching the forward projection of the deformed pmc-PET and measured projections of other phases. Using updated DVFs, OSEM- TV image reconstruction is repeated and new DVFs are estimated based on updated images. 4D XCAT phantom with typical FDG biodistribution and a 10mm diameter tumor was used to evaluate the performance of the SMEIR algorithm. Results: Image quality of 4D-PET is greatly improved by the SMEIR algorithm. When all projections are used to reconstruct a 3D-PET, motion blurring artifacts are present, leading to a more than 5 times overestimation of the tumor size and 54% tumor to lung contrast ratio underestimation. This error reduced to 37% and 20% for post reconstruction registration methods and SMEIR respectively. Conclusion: SMEIR method can be used for motion estimation/correction in 4D-PET. The statistics is greatly improved since all projection data are combined together to update the image. The performance of the SMEIR algorithm for 4D-PET is sensitive to smoothness control parameters in the DVF estimation step.

60 APPLIED LIFE SCIENCES↗

Retrieval of Aerosol Optical Depth in Vicinity of Broken Clouds from Reflectance Ratios: Sensitivity Study

We conducted a sensitivity study to better understand the potential of a new method for retrieving aerosol optical depth (AOD) under partly cloudy conditions. This method exploits reflectance ratios in the visible spectral range and provides an effective way to avoid three-dimensional (3D) cloud effects. The sensitivity study is performed for different observational conditions and random errors in input data. The results of the sensitivity study suggest that this ratio method has the ability to detect clear pixels even in close proximity to clouds. Such detection does not require a statistical analysis of the two-dimensional (2D) horizontal distribution of reflected solar radiation, and thus it could be customized for operational retrievals. In comparison with previously suggested approaches, the ratio method has the capability to increase the "harvest" of clear pixels. Similar to the traditional Independent Pixel Approximation (IPA), the ratio method has a low computational cost for retrieving AOD. In contrast to the IPA method, the ratio method provides much more accurate estimations of the AOD values under broken cloud conditions: pixel-based and domain-averaged estimations of errors in AOD are about 25% and 10%, respectively. Finally, both the ratio-based cloud screening and the accuracy of domain-averaged ratio-based AOD values do not suffer greatly when 5% random errors are introduced in the reflectances.

54 ENVIRONMENTAL SCIENCES↗

Third international challenge to model the medium- to long-range transport of radioxenon to four Comprehensive Nuclear-Test-Ban Treaty monitoring stations

In 2015 and 2016, atmospheric transport modeling challenges were conducted in the context of the Comprehensive Nuclear-Test-Ban Treaty (CTBT) verification, however, with a more limited scope with respect to emission inventories, simulation period and number of relevant samples (i.e., those above the Minimum Detectable Concentration (MDC)) involved. Therefore, a more comprehensive atmospheric transport modeling challenge was organized in 2019. Stack release data of Xe-133 were provided by the Institut National des Radioéléments/IRE (Belgium) and the Canadian Nuclear Laboratories/CNL (Canada) and accounted for in the simulations over a three (mandatory) or six (optional) months period. Best estimate emissions of additional facilities (radiopharmaceutical production and nuclear research facilities, commercial reactors or relevant research reactors) of the Northern Hemisphere were included as well. Model results were compared with observed atmospheric activity concentrations at four International Monitoring System (IMS) stations located in Europe and North America with overall considerable influence of IRE and/or CNL emissions for evaluation of the participants’ runs. Participants were prompted to work with controlled and harmonized model set-ups to make runs more comparable, but also to increase diversity. It was found that using the stack emissions of IRE and CNL with daily resolution does not lead to better results than disaggregating annual emissions of these two facilities taken from the literature if an overall score for all stations covering all valid observed samples is considered. A moderate benefit of roughly 10% is visible in statistical scores for samples influenced by IRE and/or CNL to at least 50% and there can be considerable benefit for individual samples. Effects of transport errors, not properly characterized remaining emitters and long IMS sampling times (12–24 h) undoubtedly are in contrast to and reduce the benefit of high-quality IRE and CNL stack data. Complementary best estimates for remaining emitters push the scores up by 18% compared to just considering IRE and CNL emissions alone. Despite the efforts undertaken the full multi-model ensemble built is highly redundant. An ensemble based on a few arbitrary runs is sufficient to model the Xe-133 background at the stations investigated. The effective ensemble size is below five. An optimized ensemble at each station has on average slightly higher skill compared to the full ensemble. However, the improvement (maximum of 20% and minimum of 3% in RMSE) in skill is likely being too small for being exploited for an independent period.

54 ENVIRONMENTAL SCIENCES↗

THE YOUNG SOLAR ANALOGS PROJECT. I. SPECTROSCOPIC AND PHOTOMETRIC METHODS AND MULTI-YEAR TIMESCALE SPECTROSCOPIC RESULTS

This is the first in a series of papers presenting methods and results from the Young Solar Analogs Project, which began in 2007. This project monitors both spectroscopically and photometrically a set of 31 young (300–1500 Myr) solar-type stars with the goal of gaining insight into the space environment of the Earth during the period when life first appeared. From our spectroscopic observations we derive the Mount Wilson S chromospheric activity index (S{sub MW}), and describe the method we use to transform our instrumental indices to S{sub MW} without the need for a color term. We introduce three photospheric indices based on strong absorption features in the blue-violet spectrum—the G-band, the Ca i resonance line, and the Hydrogen-γ line—with the expectation that these indices might prove to be useful in detecting variations in the surface temperatures of active solar-type stars. We also describe our photometric program, and in particular our “Superstar technique” for differential photometry which, instead of relying on a handful of comparison stars, uses the photon flux in the entire star field in the CCD image to derive the program star magnitude. This enables photometric errors on the order of 0.005–0.007 magnitude. We present time series plots of our spectroscopic data for all four indices, and carry out extensive statistical tests on those time series demonstrating the reality of variations on timescales of years in all four indices. We also statistically test for and discover correlations and anti-correlations between the four indices. We discuss the physical basis of those correlations. As it turns out, the “photospheric” indices appear to be most strongly affected by emission in the Paschen continuum. We thus anticipate that these indices may prove to be useful proxies for monitoring emission in the ultraviolet Balmer continuum. Future papers in this series will discuss variability of the program stars on medium (days–months) and short (minutes to hours) timescales.

79 ASTRONOMY AND ASTROPHYSICS↗

CONSTRAINING CHANGES IN THE PROTON-ELECTRON MASS RATIO WITH INVERSION AND ROTATIONAL LINES

We report deep Green Bank Telescope spectroscopy in the redshifted NH{sub 3} (1,1), CS 1-0, and H{sub 2}CO 0{sub 00}-1{sub 01} lines from the z {approx} 0.685 absorber toward B0218+357. The inversion (NH{sub 3}) and rotational (CS, H{sub 2}CO) line frequencies have different dependences on the proton-electron mass ratio {mu}, implying that a comparison between the line redshifts is sensitive to changes in {mu}. A joint three-component fit to the NH{sub 3}, CS, and H{sub 2}CO lines yields [{Delta}{mu}/{mu}] = (-3.5 {+-} 1.2) x 10{sup -7}, from z {approx} 0.685 to today, where the error includes systematic effects from comparing lines from different species and possible frequency-dependent source morphology. Two additional sources of systematic error remain, due to time variability in the source morphology and velocity offsets between nitrogen-bearing and carbon-bearing species. We find no statistically significant ({>=}3{sigma}) evidence for changes in {mu} and obtain the stringent 3{sigma} constraint, [{Delta}{mu}/{mu}] < 3.6 x 10{sup -7}, over 6.2 Gyr; this is the best present limit on temporal changes in {mu} from any technique, and for any look-back time, by a factor {approx}>5.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimum Full Information, Unlimited Complexity, Invariant and Minimax Clock Skew and Offset Estimators for IEEE 1588

This paper presents the problem of clock skew and offset estimation for the IEEE 1588 precision time protocol. Built on the classical two-way message exchange scheme, IEEE 1588 is a prominent synchronization protocol for packet switched networks. Because of the presence of random queuing delays in a packet switched network, the joint recovery of clock skew and offset from the received packet timestamps can be viewed as a statistical estimation problem. Recently, assuming perfect clock skew information, minimax optimum clock offset estimators were developed for IEEE 1588. Building on this work, we first develop joint optimum invariant clock skew and offset estimators for IEEE 1588 for known queuing delay statistics and unlimited computational complexity. We then show the developed estimators are minimax optimum, i.e., these estimators minimize the maximum skew normalized mean square estimation error over all possible values of the unknown parameters. Minimax optimum estimators that utilize information from past timestamps to improve accuracy are also introduced. The developed optimum estimators provide useful fundamental limits for evaluating the performance of clock skew and offset estimation schemes. These performance limits can aid system designers to develop algorithms with the desired computational complexity that achieve performance close to the performance of the optimum estimators. If a designer finds an approach with a complexity they find acceptable and which provides performance close to the optimum performance, they can use it and know they have near optimum performance. This is precisely the approach used in communications when comparing to capacity.

Cellular networks↗

Predicting initial dissolution rates using structural features from molecular dynamics simulations

Predicting chemical durability of glass materials is important for various applications from daily life such as drink glass and kitchen ware to advanced technologies such as nuclear waste disposal and biomedicine. In this work, we explored prediction of initial dissolution rate through structural features from molecular dynamics (MD) simulations for a wide range of glass compositions (total 28) including borosilicate and aluminosilicate glasses, ZrO 2 -containing and V 2 O 5 -containing boroaluminosilicate glasses. The initial dissolution rates (r 0 ) measured experimentally at 90 °C with varying solution conditions were correlated with structural features (e.g., polyhedral linkages and non-bridging oxygen species) obtained from MD simulations, either from this study or from literature. Since hydrolysis of the glass network through breaking of the network former linkages (e.g., Si-O-Si, Si-O-Al, etc.) is a critical step of network glass dissolution, the statistics of these linkages obtained from MD were correlated to r0 through linear regression, where the coefficient of determination (R 2 ) and root mean square error are found to be 0.949 and 0.681, respectively. This model was compared and discussed with existing models developed by various approaches including machine learning, the kinetic rate equation, topological constraint theory, and other descriptors from MD simulations. The discussion provides insights on future model improvements to predict glass dissolution. In addition, the impact of V 2 O 5 on the glass dissolution was examined in detail, implicating that the impact is not the same across all glass compositions and test conditions.

36 MATERIALS SCIENCE↗

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗

In-memory interconnect protocol configuration registers

Systems, apparatuses, and methods for moving the interconnect protocol configuration registers into the main memory space of a node. The region of memory used for storing the interconnect protocol configuration registers may also be made cacheable to reduce the latency of accesses to the interconnect protocol configuration registers. Interconnect protocol configuration registers which are used during a startup routine may be prefetched into the host's cache to make the startup routine more efficient. The interconnect protocol configuration registers for various interconnect protocols may include one or more of device capability tables, memory-side statistics (e.g., to support two-level memory data mapping decisions), advanced memory and interconnect features such as repair resources and routing tables, prefetching hints, error correcting code (ECC) bits, lists of device capabilities, set and store base address, capability, device ID, status, configuration, capabilities, and other settings.

97 MATHEMATICS AND COMPUTING↗

Application of Neutron Detection Third Order Time Correlation

Neutron noise experiments on fissile materials are used to get information such as reactivity, fissile mass, neutron sources, prompt neutron lifetime. One of the more popular methods is based on correlated moments of the neutron counts distribution. The second correlated moment method originally proposed by Feynman was extended to the third order. In this paper we present the application of the third order correlation moments method to SILENE reactor measurements. The third order correlation moments method has been applied to analyse time list mode - subcritical measurements on SILENE reactor in order to evaluate the system subcriticality, The multiplication coefficient is obtained with large statistical uncertainties, but remains consistent with MCNP calculations. To reduce the experimental uncertainties longer measurement time and higher detector efficiency should be necessary. The systematic errors coming from the fission neutron data (moments of the fission neutron distributions) and point model formulas should also be investigated. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Statistical Testing Approach for Quantifying Software Reliability; Application to an Example System

The U.S. Nuclear Regulatory Commission (NRC) encourages the use of probabilistic risk assessment (PRA) technology in all regulatory matters, to the extent supported by the state-of-the-art in PRA methods and data. Although much has been accomplished in the area of risk-informed regulation, risk assessment for digital systems has not been fully developed. The NRC established a plan for research on digital systems to identify and develop methods, analytical tools, and regulatory guidance for (1) including models of digital systems in the PRA's of nuclear power plants (NPPs), and, (2) incorporating digital systems in the NRC's risk-informed licensing and oversight activities. Under NRC's sponsorship, Brookhaven National Laboratory (BNL) explored approaches for addressing the failures of digital instrumentation and control (I and C) systems in the current NPP PRA framework. Specific areas investigated included PRA modeling digital hardware , development of a philosophical basis for defining software failure , and identification of desirable attributes of quantitative software reliability methods . Based on the earlier research, statistical testing is considered a promising method for quantifying software reliability. It is widely recognized that software failures are due to the triggering of pre-existing defects by the software's operational environment. Software defects can arise from errors made in user requirements or coding errors introduced during the developmental process. The software's operational environment includes factors such as the time history of digital system inputs, communication interfaces, the internal state of the digital system, and external conditions. Thus, software reliability is a function of both the number of pre-existing defects and the presence of a triggering condition caused by the manner in which the software is used. In this paper, we describe a statistical software-testing approach for quantifying software reliability and applied it to the loop-operating control system (LOCS) of an experimental loop of the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL). The work involved collaboration between BNL and INL. The objectives of the study include: (1) Development of a statistical testing approach for estimating software failure probability on demand, the results of which are suitable for including in a probabilistic risk assessment (PRA); and, (2) Application of the approach to the LOCS to estimate its failure probability, and obtain insights into the feasibility, practicality, and usefulness of the estimation in models of digital systems for inclusion in nuclear power plants' PRAs. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SU-F-T-303: Quantification of MLC Positioning Accuracy in VMAT Delivery of Head and Neck Cancer Treatment

Purpose: Knowing MLC leaf positioning error over the course of treatment would be valuable for treatment planning, QA design, and patient safety. The objective of the current study was to quantify the MLC positioning accuracy for VMAT delivery of head and neck treatment plans. Methods: A total of 837 MLC log files were collected from 14 head and neck cancer patients undergoing full arc VMAT treatment on one Varian Trilogy machine. The actual and planned leaf gaps were extracted from the retrieved MLC log files. For a given patient, the leaf gap error percentage (LGEP), defined as the ratio of the actual leaf gap over the planned, was evaluated for each leaf pair at all the gantry angles recorded over the course of the treatment. Statistics describing the distribution of the largest LGEP (LLGEP) of the 60 leaf pairs including the maximum, minimum, mean, Kurtosis, and skewness were evaluated. Results: For the 14 studied patients, their PTV located at tonsil, base of tongue, larynx, supraglottis, nasal cavity, and thyroid gland with volume ranging from 72.0 cm{sup 3} to 602.0 cm{sup 3}. The identified LLGEP differed between patients. It ranged from 183.9% to 457.7% with a mean of 368.6%. For the majority of the patients, the LLGEP distributions peaked at non-zero positions and showed no obvious dependence on gantry rotations. Kurtosis and skewness, with minimum/maximum of 66.6/217.9 and 6.5/12.6, respectively, suggested relatively more peaked while right-skewed leaf error distribution pattern. Conclusion: The results indicate pattern of MLC leaf gap error differs between patients of lesion located at similar anatomic site. Understanding the systemic mechanisms underlying these observed error patterns necessitates examining more patient-specific plan parameters in a large patient cohort setting.

60 APPLIED LIFE SCIENCES↗

Measurement of Hubble constant: non-Gaussian errors in HST Key Project data

Assuming the Central Limit Theorem, experimental uncertainties in any data set are expected to follow the Gaussian distribution with zero mean. We propose an elegant method based on Kolmogorov-Smirnov statistic to test the above; and apply it on the measurement of Hubble constant which determines the expansion rate of the Universe. The measurements were made using Hubble Space Telescope. Our analysis shows that the uncertainties in the above measurement are non-Gaussian.

79 ASTRONOMY AND ASTROPHYSICS↗

Advanced Error Modeling for Prompt Yield Estimation [Slides]

Multi-Phenomenology Explosion Monitoring (MultiPEM) Toolbox provides a capability for post-detonation characterization focusing on yield estimation; Synthesize information from multiple sensor types; Leverage historical databases to inform statistical models; Allows for rapid or comprehensive analysis; Implemented in R code.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

A Two-Step Approach to Uncertainty Quantification of Core Simulators

For the multiple sources of error introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily to quantify the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the “two-step” method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the two-step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution was examined in the framework of phase I-3 of the OECD Uncertainty Analysis in Modeling benchmark. With the Three Mile Island Unit 1 core as a base model for analysis, the XSUSA and two-step methods were applied with certain limitations, and the results were compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions were drawn as to the method that is currently more viable for computing uncertainties in burnup and transient calculations.

Yankov, Artem↗