Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Empirical Validation of UBEM: An Assessment of Bias in Urban Building Energy Modeling for Chicago

Residential and commercial buildings currently account for 30% of total global final energy consumption. Urban-scale building energy modeling (UBEM) can enable scalable investments and unlock building improvements by quantifying energy, demand, emissions, and cost reductions of specific measures or packages for building-specific technologies in large geographic regions. While the sophistication of UBEM data sources and technologies have increased dramatically in the past decade, there remains a knowledge gap for empirical validation and sources of bias between building-specific energy models and measured data at varying geographic scales.As UBEM continues to develop, systemic analysis of accuracy, bias, and limitations of the resulting models is necessary to inform best practices and move toward standardization. These are characterized for the Automatic Building Energy Modeling (AutoBEM) software suite with an initial case study involving metered electricity consumption data from 247,188 buildings in Chicago, Illinois, USA - averaged across years 2019-2021 - compared to the following datasets: (1) the AutoBEM-generated nation-scale Model America version 2 (MAv2) data for 596,064 buildings, (2) tax assessor data for 579,829 buildings, (3) tax assessor data filled with MAv2, and (4) 102 representative dynamic archetypes. The accuracy is reported for every building type and vintage combination, along with multiple sources of bias for unique building descriptors. The AutoBEM simulation workflow produced energy consumption estimates that closely match aggregated metered electricity consumption data for different types of buildings constructed during various time periods at the city scale - with initial normalized mean bias error of 10.9%, and 1.1% after removing outliers. Contribution of statistically significant factors including building type, land use, age, and size to variance in UBEM bias is quantified.

Garg, Ankur↗

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MULTI-WAVELENGTH STUDY OF A COMPLETE IRAC 3.6 {mu}m SELECTED GALAXY SAMPLE: A FAIR CENSUS OF RED AND BLUE POPULATIONS AT REDSHIFTS 0.4-1.2

We present a multi-wavelength study of a 3.6 {mu}m selected galaxy sample in the Extended Groth Strip (EGS). The sample is complete for galaxies with stellar mass >10{sup 9.5} M{sub Sun} and redshift 0.4 < z < 1.2. In this redshift range, the Infrared Array Camera 3.6 {mu}m band measures the rest-frame near-infrared band, permitting nearly unbiased selection with respect to both quiescent and star-forming galaxies. The numerous spectroscopic redshifts available in the EGS are used to train an artificial neural network to estimate photometric redshifts. The distribution of photometric redshift errors is Gaussian with standard deviation {approx}0.025(1 + z), and the fraction of redshift failures (>3{sigma} errors) is about 3.5%. A new method of validation based on pair statistics confirms the estimate of standard deviation even for galaxies lacking spectroscopic redshifts. Basic galaxy properties measured include rest-frame U - B colors, B- and K-band absolute magnitudes, and stellar masses. We divide the sample into quiescent and star-forming galaxies according to their rest-frame U - B colors and 24-3.6 {mu}m flux density ratios and derive rest K-band luminosity functions and stellar mass functions for quiescent, star-forming, and all galaxies. The results show that massive, quiescent galaxies were in place by z Almost-Equal-To 1, but lower mass galaxies generally ceased their star formation at later epochs.

79 ASTRONOMY AND ASTROPHYSICS↗

An Optimized Autoregressive Forecast Error Generator for Wind and Load Uncertainty Study

This paper presents a first-order autoregressive algorithm to generate real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast errors. The methodology aims at producing random wind and load forecast time series reflecting the autocorrelation and cross-correlation of historical forecast data sets. Five statistical characteristics are considered: the means, standard deviations, autocorrelations, and cross-correlations. A stochastic optimization routine is developed to minimize the differences between the statistical characteristics of the generated time series and the targeted ones. An optimal set of parameters are obtained and used to produce the RT, HA, and DA forecasts in due order of succession. This method, although implemented as the first-order regressive random forecast error generator, can be extended to higher-order. Results show that the methodology produces random series with desired statistics derived from real data sets provided by the California Independent System Operator (CAISO). The wind and load forecast error generator is currently used in wind integration studies to generate wind and load inputs for stochastic planning processes. Our future studies will focus on reflecting the diurnal and seasonal differences of the wind and load statistics and implementing them in the random forecast generator.

17 WIND ENERGY↗

Leading-order hadronic contribution to g-2 from lattice QCD

We calculate the leading-order hadronic correction to the anomalous magnetic moments of each of the three charged leptons in the Standard Model: the electron, muon and tau. Working in two-flavor lattice QCD, we address essentially all sources of systematic error: lattice artifacts, finite-size effects, quark-mass extrapolation, momentum extrapolation and disconnected diagrams. The only remaining significant systematic error, the exclusion of the strange and charm quark contributions, will be addressed in our four-flavor calculation. We achieve a statistical accuracy of 2% or better for the physical values for each of the three leptons and the systematic errors are at most comparable.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Design Study of an Incinerator Ash Conveyor Counting System - 13323

A design study has been performed for a system that should measure the Cs-137 activity in ash from an incinerator. Radioactive ash, expected to consist of both Cs-134 and Cs-137, will be transported on a conveyor belt at 0.1 m/s. The objective of the counting system is to determine the Cs-137 activity and direct the ash to the correct stream after a diverter. The decision levels are ranging from 8000 to 400000 Bq/kg and the decision error should be as low as possible. The decision error depends on the total measurement uncertainty which depends on the counting statistics and the uncertainty in the efficiency of the geometry. For the low activity decision it is necessary to know the efficiency to be able to determine if the signal from the Cs-137 is above the minimum detectable activity and that it generates enough counts to reach the desired precision. For the higher activity decision the uncertainty of the efficiency needs to be understood to minimize decision errors. The total efficiency of the detector is needed to be able to determine if the detector will be able operate at the count rate at the highest expected activity. The design study that is presented in this paper describes how the objectives of the monitoring systems were obtained, the choice of detector was made and how ISOCS (In Situ Object Counting System) mathematical modeling was used to calculate the efficiency. The ISOCS uncertainty estimator (IUE) was used to determine which parameters of the ash was important to know accurately in order to minimize the uncertainty of the efficiency. The examined parameters include the height of the ash on the conveyor belt, the matrix composition and density and relative efficiency of the detector. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Enhancing Model Predictability for a Scramjet Using Probabilistic Learning on Manifolds

In this study, the computational burden of a large-eddy simulation for reactive flows is exacerbated in the presence of uncertainty in flow conditions or kinetic variables. A comprehensive statistical analysis, with a sufficiently large number of samples, remains elusive. Statistical learning is an approach that allows for extracting more information using fewer samples. Such procedures, if successful, will greatly enhance the predictability of models in the sense of improving exploration and characterization of uncertainty due to model error and input dependencies, all while being constrained by the size of the associated statistical samples. In this paper, it is shown how a recently developed procedure for probabilistic learning on manifolds can serve to improve the predictability in a probabilistic framework of a scramjet simulation. The estimates of the probability density functions of the quantities of interest are improved together with estimates of the statistics of their maxima. Lastly, it is also demonstrated how the improved statistical model adds critical insight to the performance of the model.

42 ENGINEERING↗

MONTE-CARLO BURNUP CALCULATION UNCERTAINTY QUANTIFICATION AND PROPAGATION DETERMINATION

MONTEBURNS is a Monte-Carlo depletion routine utilizing MCNP and ORIGEN 2.2. Uncertainties exist in the MCNP transport calculation, but this information is not passed to the depletion calculation in ORIGEN or saved. To quantify this transport uncertainty and determine how it propagates between burnup steps, a statistical analysis of a multiple repeated depletion runs is performed. The reactor model chosen is the Oak Ridge Research Reactor (ORR) in a single assembly, infinite lattice configuration. This model was burned for a 25.5 day cycle broken down into three steps. The output isotopics as well as effective multiplication factor (k-effective) were tabulated and histograms were created at each burnup step using the Scott Method to determine the bin width. It was expected that the gram quantities and k-effective histograms would produce normally distributed results since they were produced from a Monte-Carlo routine, but some of results do not. The standard deviation at each burnup step was consistent between fission product isotopes as expected, while the uranium isotopes created some unique results. The variation in the quantity of uranium was small enough that, from the reaction rate MCNP tally, round off error occurred producing a set of repeated results with slight variation. Statistical analyses were performed using the {chi}{sup 2} test against a normal distribution for several isotopes and the k-effective results. While the isotopes failed to reject the null hypothesis of being normally distributed, the {chi}{sup 2} statistic grew through the steps in the k-effective test. The null hypothesis was rejected in the later steps. These results suggest, for a high accuracy solution, MCNP cell material quantities less than 100 grams and greater kcode parameters are needed to minimize uncertainty propagation and minimize round off effects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of an Automatic Registration-Based Algorithm for Direct Measurement of Volume Change in Tumors

Purpose: Assuming that early tumor volume change is a biomarker for response to therapy, accurate quantification of early volume changes could aid in adapting an individual patient's therapy and lead to shorter clinical trials. We investigated an image registration-based approach for tumor volume change quantification that may more reliably detect smaller changes that occur in shorter intervals than can be detected by existing algorithms. Methods and Materials: Variance and bias of the registration-based approach were evaluated using retrospective, in vivo, very-short-interval diffusion magnetic resonance imaging scans where true zero tumor volume change is unequivocally known and synthetic data, respectively. The interval scans were nonlinearly registered using two similarity measures: mutual information (MI) and normalized cross-correlation (NCC). Results: The 95% confidence interval of the percentage volume change error was (-8.93% to 10.49%) for MI-based and (-7.69%, 8.83%) for NCC-based registrations. Linear mixed-effects models demonstrated that error in measuring volume change increased with increase in tumor volume and decreased with the increase in the tumor's normalized mutual information, even when NCC was the similarity measure being optimized during registration. The 95% confidence interval of the relative volume change error for the synthetic examinations with known changes over {+-}80% of reference tumor volume was (-3.02% to 3.86%). Statistically significant bias was not demonstrated. Conclusion: A low-noise, low-bias tumor volume change measurement algorithm using nonlinear registration is described. Errors in change measurement were a function of tumor volume and the normalized mutual information content of the tumor.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Lossy compression of statistical data using quantum annealer

Abstract We present a new lossy compression algorithm for statistical floating-point data through a representation learning with binary variables. The algorithm finds a set of basis vectors and their binary coefficients that precisely reconstruct the original data. The optimization for the basis vectors is performed classically, while binary coefficients are retrieved through both simulated and quantum annealing for comparison. A bias correction procedure is also presented to estimate and eliminate the error and bias introduced from the inexact reconstruction of the lossy compression for statistical data analyses. The compression algorithm is demonstrated on two different datasets of lattice quantum chromodynamics simulations. The results obtained using simulated annealing show 3–3.5 times better compression performance than the algorithm based on neural-network autoencoder. Calculations using quantum annealing also show promising results, but performance is limited by the integrated control error of the quantum processing unit, which yields large uncertainties in the biases and coupling parameters. Hardware comparison is further studied between the previous generation D-Wave 2000Q and the current D-Wave Advantage system. Our study shows that the Advantage system is more likely to obtain low-energy solutions for the problems than the 2000Q.

97 MATHEMATICS AND COMPUTING↗

Analysis of error floor of LDPC codes under LP decoding over the BSC

We consider linear programming (LP) decoding of a fixed low-density parity-check (LDPC) code over the binary symmetric channel (BSC). The LP decoder fails when it outputs a pseudo-codeword which is not a codeword. We propose an efficient algorithm termed the instanton search algorithm (ISA) which, given a random input, generates a set of flips called the BSC-instanton and prove that: (a) the LP decoder fails for any set of flips with support vector including an instanton; (b) for any input, the algorithm outputs an instanton in the number of steps upper-bounded by twice the number of flips in the input. We obtain the number of unique instantons of different sizes by running the ISA sufficient number of times. We then use the instanton statistics to predict the performance of the LP decoding over the BSC in the error floor region. We also propose an efficient semi-analytical method to predict the performance of LP decoding over a large range of transition probabilities of the BSC.

97 MATHEMATICS AND COMPUTING↗

Validation of the NSRDB-SUNY global horizontal irradiance in California

Satellite derived global horizontal solar irradiance (GHI) from the SUNY modeled dataset in the National Solar Radiation Database (NSRDB) was compared to measurements from 27 weather stations in California during the years 1998-2005. The statistics of spatial and temporal differences between the two datasets were analyzed and related to meteorological phenomena. Overall mean bias errors (MBE) of the NSRDB-SUNY indicated a GHI overprediction of 5%, which is smaller than the sensor accuracy of ground stations. However, at coastal sites, year-round systematic positive MBEs in the NSRDB-SUNY data up to 18% were observed and monthly MBEs increased up to 54% in the summer months during the morning. These differences were explained by a tendency for the NSRDB-SUNY model to overestimate GHI under cloudy conditions at the coast during summer mornings. A persistent positive evening MBE which was independent of site location and cloudiness occurred at all stations and was explained by an error in the time-shifting method applied in the NSRDB-SUNY. A correction method was derived for these two errors to improve the accuracy of the NSRDB-SUNY data in California. (author)

14 SOLAR ENERGY↗

Particle image velocimetry (PIV) uncertainty quantification using moment of correlation (MC) plane

Here, we present a new uncertainty estimation method for particle image velocimetry (PIV), that uses the correlation plane as a model for the probability density function (PDF) of displacements and calculates the second order moment of the correlation (MC). The cross-correlation between particle image patterns is the summation of all particle matches convolved with the apparent particle image diameter. MC uses this property to estimate the PIV uncertainty from the shape of the cross-correlation plane. In this new approach, the generalized cross-correlation (GCC) plane corresponding to a PIV measurement is obtained by removing the particle image diameter contribution. The GCC primary peak represents a discretization of the displacement PDF, from which the standard uncertainty is obtained by convolving the GCC plane with a Gaussian function. Then a Gaussian least-squares-fit is applied to the peak region, accounting for the stretching and rotation of the peak, due to the local velocity gradients and the effect of the convolved Gaussian. The MC method was tested with simulated image sets and the predicted uncertainties show good sensitivity to the error sources and agreement with the expected RMS error. Subsequently, the method was demonstrated in three PIV challenge cases and two experimental datasets and was compared with the published image matching (IM) and correlation statistics (CS) techniques. Results show that the MC method has a better response to spatial variation in RMS error and the predicted uncertainty is in good agreement with the expected standard uncertainty. The uncertainty prediction was also explored as a function of PIV interrogation window size. Overall, the MC method performance establishes itself as a valid uncertainty estimation tool for planar PIV.

47 OTHER INSTRUMENTATION↗

Impact of numerical choices on water conservation in the E3SM Atmosphere Model version 1 (EAMv1)

Abstract. The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1∘ horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model becomes negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors in early V1 versions decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in V1 results in a very thin model layer at the Earth's surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for V1.

54 ENVIRONMENTAL SCIENCES↗

Impact of numerical choices on water conservation in the E3SM Atmosphere Model Version 1 (EAM V1)

The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations for sea level rise projection. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1&deg; horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model is negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in the new model results in a very thin model layer at the Earth’s surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for this model.

Zhang, Kai↗

Lensing corrections to the E {sub g} ( z ) statistics from large scale structure

We study the impact of the often neglected lensing contribution to galaxy number counts on the E {sub g} statistics which is used to constrain deviations from GR. This contribution affects both the galaxy-galaxy and the convergence-galaxy spectra, while it is larger for the latter. At higher redshifts probed by upcoming surveys, for instance at z = 1.5, neglecting this term induces an error of (25–40)% in the spectra and therefore on the E {sub g} statistics which is constructed from the combination of the two. Moreover, including it, renders the E {sub g} statistics scale and bias-dependent and hence puts into question its very objective.

79 ASTRONOMY AND ASTROPHYSICS↗

The image quality of ion computed tomography at clinical imaging dose levels

Purpose: Accurately predicting the range of radiotherapy ions in vivo is important for the precise delivery of dose in particle therapy. Range uncertainty is currently the single largest contribution to the dose margins used in planning and leads to a higher dose to normal tissue. The use of ion CT has been proposed as a method to improve the range uncertainty and thereby reduce dose to normal tissue of the patient. A wide variety of ions have been proposed and studied for this purpose, but no studies evaluate the image quality obtained with different ions in a consistent manner. However, imaging doses ion CT is a concern which may limit the obtainable image quality. In addition, the imaging doses reported have not been directly comparable with x-ray CT doses due to the different biological impacts of ion radiation. The purpose of this work is to develop a robust methodology for comparing the image quality of ion CT with respect to particle therapy, taking into account different reconstruction methods and ion species. Methods: A comparison of different ions and energies was made. Ion CT projections were simulated for five different scenarios: Protons at 230 and 330 MeV, helium ions at 230 MeV/u, and carbon ions at 430 MeV/u. Maps of the water equivalent stopping power were reconstructed using a weighted least squares method. The dose was evaluated via a quality factor weighted CT dose index called the CT dose equivalent index (CTDEI). Spatial resolution was measured by the modulation transfer function. This was done by a noise-robust fit to the edge spread function. Second, the image quality as a function of the number of scanning angles was evaluated for protons at 230 MeV. In the resolution study, the CTDEI was fixed to 10 mSv, similar to a typical x-ray CT scan. Finally, scans at a range of CTDEI’s were done, to evaluate dose influence on reconstruction error. Results: All ions yielded accurate stopping power estimates, none of which were statistically different from the ground truth image. Resolution (as defined by the modulation transfer function = 10% point) was the best for the helium ions (18.21 line pairs/cm) and worst for the lower energy protons (9.37 line pairs/cm). The weighted quality factor for the different ions ranged from 1.23 for helium to 2.35 for carbon ions. For the angle study, a sharp increase in absolute error was observed below 45 distinct angles, giving the impression of a threshold, rather than smooth, limit to the number of angles. Conclusions: The method presented for comparing various ion CT modalities is feasible for practical use. While all studied ions would improve upon x-ray CT for particle range estimation, helium appears to give the best results and deserves further study for imaging.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Calculation of binodals and spinodals in multicomponent alloys by different statistical methods with application to iron-copper-manganese alloys

A generalization of the pair-cluster (PC) approximation in the theory of disordered systems to multicomponent alloys is proposed. It is shown that phase equilibrium boundaries (binodals) calculated in the mean-field (MF) approximation, which is used in standard calculations of phase diagrams by the CALPHAD method, coincide with the results of rigorous calculations for dilute alloys; however, the application of these methods to calculating the boundaries of the stability region with respect to the decomposition of an alloy (spinodals) leads to large errors. At the same time, in the PC approximation, the description of all statistical properties, including binodals and spinodals, turns out to be exact for dilute alloys. The methods developed are illustrated by an example of iron-copper-manganese ternary alloys.

36 MATERIALS SCIENCE↗