Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Implementing machine learning methods on QICK hardware for qubit readout & control

Quantum readout and control is a fundamental aspect of quantum computing that requires accurate measurement of qubit states. Errors emerge in all stages, from initialization to readout, and identifying errors in post-processing necessitates resource-intensive statistical analysis. In our work, we use a lightweight fully-connected neural network (NN) to classify states of a transmon system with no prior processing. Our NN accelerator yields higher fidelities (92%) than the classical matched filter method (84%). By exploiting the natural parallelism of NNs and their placement near the source of data on field-programmable gate arrays (FPGAs), we can achieve ultra-low latency on the Quantum Instrumentation Control Kit (QICK). Integrating machine learning methods on QICK opens several pathways for efficient real-time processing of quantum circuits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A collection of sub-daily pressure and temperature observations for the early instrumental period with a focus on the "year without a summer" 1816

The eruption of Mount Tambora (Indonesia) in April 1815 is the largest documented volcanic eruption in history. It is associated with a large global cooling during the following year, felt particularly in parts of Europe and North America, where the year 1816 became known as the "year without a summer". This paper describes an effort made to collect surface meteorological observations from the early instrumental period, with a focus on the years of and immediately following the eruption (1815–1817). Although the collection aimed in particular at pressure observations, correspondent temperature observations were also recovered. Some of the series had already been described in the literature, but a large part of the data, recently digitised from original weather diaries and contemporary magazines and newspapers, is presented here for the first time. The collection puts together more than 50 sub-daily series from land observatories in Europe and North America and from ships in the tropics. The pressure observations have been corrected for temperature and gravity and reduced to mean sea level. Moreover, an additional statistical correction was applied to take into account common error sources in mercury barometers. To assess the reliability of the corrected data set, the variance in the pressure observations is compared with modern climatologies, and single observations are used for synoptic analyses of three case studies in Europe. All raw observations will be made available to the scientific community in the International Surface Pressure Databank.

54 ENVIRONMENTAL SCIENCES↗

Enhanced Named Entity Extraction via Error-Driven Aggregation

Despite recent advances in named entity extraction technologies, state-of-the-art extraction tools achieve insufficient accuracy rates for practical use in many operational settings. However, they are not generally prone to the same types of error, suggesting that substantial improvements may be achieved via appropriate combinations of existing tools, provided their behavior can be accurately characterized and quantified. In this paper, we present an inference methodology for the aggregation of named entity extraction technologies that is founded upon a black-box analysis of their respective error processes. This method has been shown to produce statistically significant improvements in extraction relative to standard performance metrics and to mitigate the weak performance of entity extractors operating under suboptimal conditions. Moreover, this approach provides a framework for quantifying uncertainty and has demonstrated the ability to reconstruct the truth when majority voting fails.

97 MATHEMATICS AND COMPUTING↗

Stokhos v 1.0

A Trilinos package for applying stochastic Galerkin uncertainty quantification methods to large-scale C++ application codes, primarily stochastic partial differential equations. Stokhos is intended for use in estimating uncertainties for general scientific computations and is based on published algorithms. It provides no capability for implementing those computations itself. Estimating uncertainties and errors from solution algorithms or simulations, primarily simulations of partial differential equations, arising from uncertainties or errors in solution algorithm or simulation input data, including statistical moments, probabilities, and coefficients of variation.

Source record↗

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗

Multivariate statistics applications in phase analysis of STEM-EDS spectrum images

Spectrum imaging (SI) methods are displacing traditional spot analyses as the predominant paradigm for spectroscopic analysis with electron beam instrumentation. The multivariate nature of SI provides clear advantages for qualitative analysis of multiphase specimens relative to traditional gray-scale images acquired with non-spectroscopic signals, where different phases with similar average atomic number may exhibit the same intensity. However, with the improvement in qualitative analysis with the SI paradigm has come a decline in the quantitative analysis of the phases thus identified, since the spectra from individual pixels typically have insufficient counting statistics for proper quantification. The present paper outlines a methodology for quantitative analysis within the spectral imaging paradigm, which is illustrated through X-ray energy-dispersive spectroscopy (EDS) of a multiphase (Pb,La)(Zr,Ti)O{sub 3} ceramic in scanning transmission electron microscopy (STEM). Statistical analysis of STEM-EDS SI is shown to identify the number of distinct phases in the analyzed specimen and to provide better segmentation than the STEM high-angle annular dark-field (HAADF) signal. Representative spectra for the identified phases are extracted from the segmented images with and without exclusion of pixels that exhibit spectral contributions from multiple phases, and subsequently quantified using Cliff-Lorimer sensitivity factors. The phase compositions extracted with the method while excluding pixels from multiple phases are found to be in good agreement with those extracted from user-selected regions of interest, while providing improved confidence intervals. Without exclusion of multiphase pixels, the extracted composition is found to be in poor statistical agreement with the other results because of systematic errors arising from the cross-phase spectral contamination. The proposed method allows quantification to be performed in the presence of discontinuous phase distributions and overlapping phases, challenges that are typical of many nanoscale analyses performed by STEM-EDS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improved dark energy detection through the polarization-assisted cross correlation of the cosmic microwave background with radio sources

Integrated Sachs-Wolfe (ISW) effect can be estimated by cross-correlating the cosmic microwave background (CMB) sky with tracers of the local matter distribution. At late cosmic time, the dark energy-induced decay of gravitation potential generates a cross correlation signal on large angular scales. The dominant noise is the intrinsic CMB anisotropies from the inflationary epoch. In this paper we use CMB polarization to reduce this intrinsic noise. We cross-correlate the microwave sky observed by Wilkinson Microwave Anisotropy Probe (WMAP) with the radio source catalog compiled by NRAO VLA Sky Survey (NVSS) to study the efficiency of the noise suppression. We find that the error bars are reduced by about 4 to 14% and the statistical power in the signal is improved.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Computational prediction of lattice thermal conductivity: A comparison of molecular dynamics and Boltzmann transport approaches

The predictive modeling of lattice thermal conductivity is of fundamental importance for the understanding and design of materials for a wide range of applications. Two major approaches, namely molecular dynamics (MD) simulations and calculations solving approximately the Boltzmann transport equation (BTE), have been developed to compute the lattice thermal conductivity. We present a detailed direct comparison of these two approaches, using as prototypical cases MgO and PbTe. The comparison, carried out using empirical potentials, takes into account the effects of fourth order phonon scattering, temperature-dependent phonon frequencies (phonon renormalization), and investigates the effects of quantum vs classical statistics. We clarify that equipartition, as opposed to Maxwell-Boltzmann, govern the statistics of phonons in MD simulations. We find that lattice thermal conductivity values from MD and BTE show an apparent, satisfactory agreement; however such an agreement is the result of error cancellations. As a result we also show that the primary effect of statistics on thermal conductivity is via the scattering rate dependence on phonon populations.

36 MATERIALS SCIENCE↗

Optimizing Prediction Error for Time-dependent Solar Radiation Modeling

Numerical weather forecasting models and statistical methods have found wide use to help power companies estimate renewable output, but better methods are needed, particularly for extended forecasts. Machine learning approaches have been used here as well, but so far a major limitation is the ability to also predict the corresponding uncertainty in a forecast. Here we show that both can be done and demonstrate this using a long-term-short memory neural network where the difference between predicted and ground truth data are used to train a model for the corresponding forecast uncertainties.

97 MATHEMATICS AND COMPUTING↗

Error Analysis And Propagation In Metabolomics Data Aanalysis

Error analysis plays a fundamental role in describing the uncertainty in experimental results. It has several fundamental uses in metabolomics including experimental design, quality control of experiments, the selection of appropriate statistical methods, and the determination of uncertainty in results. Furthermore, the importance of error analysis has grown with the increasing number, complexity, and heterogeneity of measurements characteristic of ‘omics research. The increase in data complexity is particularly problematic for metabolomics, which has more heterogeneity than other omics technologies due to the much wider range of molecular entities detected and measured. This review introduces the fundamental concepts of error analysis as they apply to a wide range of metabolomics experimental designs and it discusses current methodologies for determining the propagation of uncertainty in appropriate metabolomics data analysis. These methodologies include analytical derivation and approximation techniques, Monte Carlo error analysis, and error analysis in metabolic inverse problems. Current limitations of each methodology with respect to metabolomics data analysis are also discussed.

59 BASIC BIOLOGICAL SCIENCES↗

The orbit and transit prospects for β pictoris b constrained with one milliarcsecond astrometry

A principal scientific goal of the Gemini Planet Imager (GPI) is obtaining milliarcsecond astrometry to constrain exoplanet orbits. However, astrometry of directly imaged exoplanets is subject to biases, systematic errors, and speckle noise. Here, we describe an analytical procedure to forward model the signal of an exoplanet that accounts for both the observing strategy (angular and spectral differential imaging) and the data reduction method (Karhunen–Loève Image Projection algorithm). We use this forward model to measure the position of an exoplanet in a Bayesian framework employing Gaussian processes and Markov-chain Monte Carlo to account for correlated noise. In the case of GPI data on β Pic b, this technique, which we call Bayesian KLIP-FM Astrometry (BKA), outperforms previous techniques and yields 1σ errors at or below the one milliarcsecond level. We validate BKA by fitting a Keplerian orbit to 12 GPI observations along with previous astrometry from other instruments. The statistical properties of the residuals confirm that BKA is accurate and correctly estimates astrometric errors. Our constraints on the orbit of β Pic b firmly rule out the possibility of a transit of the planet at 10-σ significance. However, we confirm that the Hill sphere of β Pic b will transit, giving us a rare chance to probe the circumplanetary environment of a young, evolving exoplanet. As a result, we provide an ephemeris for photometric monitoring of the Hill sphere transit event, which will begin at the start of April in 2017 and finish at the end of January in 2018.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of the Four-Dimensional Ensemble-Variational Hybrid Data Assimilation with Self-Consistent Regional Background Error Covariance for Improved Hurricane Intensity Forecasts

The feasibility of a hurricane initialization framework based on the Gridpoint Statistical Interpolation (GSI)-based four-dimensional ensemble-variational (GSI-4DEnVar) hybrid data assimilation system for the Hurricane Weather Research and Forecasting model (HWRF) model is evaluated in this study. The system considers the temporal evolution of error covariances via the use of four-dimensional ensemble perturbations that are provided by high-resolution, self-consistent HWRF ensemble forecasts. It is different from the configuration of the GSI-based three-dimensional ensemble-variational (GSI-3DEnVar) hybrid data assimilation system, similar to that used in the operational HWRF, which employs background error covariances provided by coarser-resolution global ensembles from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) ensemble Kalman filtering data assimilation system. In addition, our proposed initialization framework discards the empirical intensity correction in the vortex initialization package that is employed by the GSI-3DEnVar initialization framework in operational HWRF. Data assimilation and numerical simulation experiments for Hurricanes Joaquin (2015), Patricia (2015), and Matthew (2016) are conducted during their intensity changes. The impacts of two initialization frameworks on the HWRF analyses and forecasts are compared. It is found that GSI-4DEnVar leads to a reduction in track, minimum sea level pressure (MSLP), and maximum surface wind (MSW) forecast errors in all of the HWRF simulations, compared with the GSI-3DEnVar initialization framework. With assimilating high-resolution observations within the hurricane inner-core region, GSI-4DEnVar can produce the initial hurricane intensity reasonably well without the empirical vortex intensity correction. Further diagnoses with Hurricane Joaquin indicate that GSI-4DEnVar can significantly alleviate the imbalances in the initial conditions and enhance the performance of the data assimilation and subsequent hurricane intensity and precipitation forecasts

54 ENVIRONMENTAL SCIENCES↗

A Comparison of Forecast Error Generators for Modeling Wind and Load Uncertainty

This paper presents four algorithms to generate random forecast error time series, including a truncated-normal distribution model, a state-space based Markov model, a seasonal autoregressive moving average (ARMA) model, and a stochastic-optimization based model. The error time series are used to create real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast time series that statistically match historically observed forecasting data sets, used for variable generation integration studies. A comparison is made using historical DA load forecast and actual load values to generate new sets of DA forecasts with similar stoical forecast error characteristics. This paper discusses and compares the capabilities of each algorithm to preserve the characteristics of the historical forecast data sets.

Lu, Ning↗

Reynolds stress tensor measurements using magnetic resonance velocimetry: expansion of the dynamic measurement range and analysis of systematic measurement errors

This study presents magnetic resonance velocimetry (MRV) Reynolds Stress measurements in a periodic hill channel with a hill Reynolds number of Re = 29,500. The velocity encoding scheme is based on the ICOSA6 method with six icosahedral encoding directions and multiple encoding values are measured to increase the dynamic range. The full Reynolds stress tensor is obtained from a voxel-wise three-dimensional Gaussian fit using the magnitude data of all acquisitions. The MRV results are compared to a wall-resolved large eddy simulation and laser Doppler velocimetry measurements conducted in the same channel. It is shown that the MRV Reynolds stress data have excellent precision and agree qualitatively with the reference data. However, there are apparent systematic deviations. One of the most prominent error contributions is the signal attenuation caused by higher orders of motion, which leads to an overestimation of the turbulence level. Another fundamental error is identified in the assumption that the turbulence is Gaussian distributed. With the presented reconstruction technique, the MRV data are fitted to a statistical model, and depending on the examined flow setup, the Gaussian model can lead to considerable errors. Possible ways of how to reduce all identified errors are presented. In summary, this technique enables Reynolds stress tensor measurements in complex internal flows with high dynamic range and excellent precision. However, several issues need to be resolved to make the turbulence quantification more accurate.

42 ENGINEERING↗

ARETE: Accurate Error Assessment via Machine Learning-Guided Dynamic-Timing Analysis

Nanometer circuits are increasingly prone to timing errors, escalating the need for fault injection frameworks to accurately evaluate their impact on applications. Here in this paper, we propose ARETE, a novel cross-layer, fault-injection framework that combines dynamic-binary instrumentation with machine learning-guided dynamic-timing analysis. ARETE enables accurate fault-injection into any application by estimating the location of the injecting errors via dynamic-timing analysis. To accelerate fault-injection, we develop a novel, data-aware, machine learning-based mechanism that dynamically pre-selects the error-prone instructions and limits the application of the costly dynamic-timing analysis only to them. To evaluate ARETE's accuracy, our fully automated toolflow is configured to support fault-injection based on detailed post-layout gate-level simulations as well as via existing workload-agnostic error models. Our results for various workloads, including an autonomous-driving library, show that the location and time of injected errors performed by ARETE, is 89.9% consistent with fault-injection based on full gate-level simulation. On average, ARETE executes 84.6x faster than gate-level simulation and at a cost of 3.4% loss in the program output quality estimation. When compared to the existing statistical fault-injection tools that are based on workload-agnostic error models, ARETE improves the accuracy of fault-injection rate and output quality estimation by 143.9% and 40.4% on average, respectively.

97 MATHEMATICS AND COMPUTING↗

Consistent Procedure for Nuclear Data Evaluation Based on Modeling

A complete and consistent procedure to generate evaluated nuclear data files and the associated covariance matrices is presented. The novel procedure is fully based on Bayesian statistics and makes use of the theoretically formulated prior for parameter uncertainties presented by Leeb and Pigni recently. In addition the prior includes also model defects based on a statistical study of the gross structure of experimental data. Furthermore, a so-called correlated Bayesian update approach (CBUA) is proposed in order to account for a realistic treatment of systematic errors in experiments.

99 GENERAL AND MISCELLANEOUS↗

KiDS-1000 cosmology: Combined second- and third-order shear statistics

Aims.In this work, we perform the first cosmological parameter analysis of the fourth release of Kilo Degree Survey (KiDS-1000) data with second- and third-order shear statistics. This paper builds on a series of studies aimed at describing the roadmap to third-order shear statistics. Methods.We derived and tested a combined model of the second-order shear statistic, namely, the COSEBIs and the third-order aperture mass statistics 〈ℳ ap 3 〉 in a tomographic set-up. We validated our pipeline withN-body mock simulations of the KiDS-1000 data release. To model the second- and third-order statistics, we used the latest version of HMCODE2020 for the power spectrum and BIHALOFITfor the bispectrum. Furthermore, we used an analytic description to model intrinsic alignments and hydro-dynamical simulations to model the effect of baryonic feedback processes. Lastly, we decreased the dimension of the data vector significantly by considering only equal smoothing radii for the 〈ℳ ap 3 〉 part of the data vector. This makes it possible to carry out a data analysis of the KiDS-1000 data release using a combined analysis of COSEBIs and third-order shear statistics. Results.We first validated the accuracy of our modelling by analysing a noise-free mock data vector, assuming the KiDS-1000 error budget, finding a shift in the maximum of the posterior distribution of the matter density parameter, ΔΩ m < 0.02 σ Ω m , and of the structure growth parameter, ΔS 8 < 0.05 σ S 8 . Lastly, we performed the first KiDS-1000 cosmological analysis using a combined analysis of second- and third-order shear statistics, where we constrained Ω m = 0.248 −0.055 +0.062 andS 8 = σ 8 √(Ω m /0.3 )= 0.772 ± 0.022. The geometric average on the errors of Ω m andS 8 of the combined statistics decreases, compared to the second-order statistic, by a factor of 2.2.

Astronomy & Astrophysics↗

Assessment of Interfraction Patient Setup for Head-and-Neck Cancer Intensity Modulated Radiation Therapy Using Multiple Computed Tomography-Based Image Guidance

Purpose: Various image guidance systems are commonly used in conjunction with intensity modulated radiation therapy (IMRT) in head-and-neck cancer irradiation. The purpose of this study was to assess interfraction patient setup variations for 3 computed tomography (CT)-based on-board image guided radiation therapy (IGRT) modalities. Methods and Materials: A total of 3302 CT scans for 117 patients, including 53 patients receiving megavoltage cone-beam CT (MVCBCT), 29 receiving kilovoltage cone-beam CT (KVCBCT), and 35 receiving megavoltage fan-beam CT (MVFBCT), were retrospectively analyzed. The daily variations in the mediolateral (ML), craniocaudal (CC), and anteroposterior (AP) dimensions were measured. The clinical target volume-to-planned target volume (CTV-to-PTV) margins were calculated using 2.5Σ + 0.7 σ, where Σ and σ were systematic and random positioning errors, respectively. Various patient characteristics for the MVCBCT group, including weight, weight loss, tumor location, and initial body mass index, were analyzed to determine their possible correlation with daily patient setup. Results: The average interfraction displacements (± standard deviation) in the ML, CC, and AP directions were 0.5 ± 1.5, −0.3 ± 2.0, and 0.3 ± 1.7 mm (KVCBCT); 0.2 ± 1.9, −0.2 ± 2.4, and 0.0 ± 1.7 mm (MVFBCT); and 0.0 ± 1.8, 0.5 ± 1.7, and 0.8 ± 3.0 mm (MVCBCT). The day-to-day random errors for KVCBCT, MVFBCT, and MVCBCT were 1.4-1.6, 1.7, and 2.0-2.1 mm. The interobserver variations were 0.8, 1.1, and 0.7 mm (MVCBCT); 0.5, 0.4, and 0.8 mm (MVFBCT); and 0.5, 0.4, and 0.6 mm (KVCBCT) in the ML, CC, and AP directions, respectively. The maximal calculated uniform CTV-to-PTV margins were 5.6, 6.9, and 8.9 mm for KVCBCT, MVFBCT, and MVCBCT, respectively. For the evaluated patient characteristics, the calculated margins for different patient parameters appeared to differ; analysis of variance (ANOVA) and/or t test analysis found no statistically significant setup difference in any direction. Conclusions: Daily random setup errors and CTV-to-PTV margins for treatment of head-and-neck cancer were affected by imaging quality. Our data indicated that larger margins were associated with MVFBCT and MVCBCT, compared with smaller margins for KVCBCT. IGRT modalities with better image quality are encouraged in clinical practice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗