Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Energy Conservation in Distributed Interference as a Guarantee for Detecting a Detector Blinding Attack in Quantum Cryptography

An avalanche single-photon detector blinding attack is one of the methods for quantum hacking of quantum key distribution (QKD) systems. The attack was experimentally demonstrated for both phase- and polarization-encoded QKD systems. During this attack, an eavesdropper knows the entire key, does not produce errors and саnnot be detected. However, the phase encoding has neglected some significant features of the photocount statistics in the receiving party. It is shown in the paper at the level of fundamental principles that this attack changes the photocount statistics and leads to the detection of an eavesdropper. Expressions for the secret key length are obtained for this attack. This does not require any changes in the design and control electronics of the phase-encoded QKD system, and only changes in processing the results of registration of quantum states are sufficient. At the same time, the secret key vulnerability and compromise in polarization-encoded QKD systems is an existing fact rather than a potential menace.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cosmological Parameters from Observations of Galaxy Clusters

Studies of galaxy clusters have proved crucial in helping to establish the standard model of cosmology, with a universe dominated by dark matter and dark energy. A theoretical basis that describes clusters as massive, multi-component, quasi-equilibrium systems is growing in its capability to interpret multi-wavelength observations of expanding scope and sensitivity. We review current cosmological results, including contributions to fundamental physics, obtained from observations of galaxy clusters. These results are consistent with and complementary to those from other methods. We highlight several areas of opportunity for the next few years, and emphasize the need for accurate modeling of survey selection and sources of systematic error. Capitalizing on these opportunities will require a multi-wavelength approach and the application of rigorous statistical frameworks, utilizing the combined strengths of observers, simulators and theorists.

79 ASTRONOMY AND ASTROPHYSICS↗

CMM Interim Check (U)

Coordinate Measuring Machines (CMM) are widely used in industry, throughout the Nuclear Weapons Complex and at Los Alamos National Laboratory (LANL) to verify part conformance to design definition. Calibration cycles for CMMs at LANL are predominantly one year in length. Unfortunately, several nonconformance reports have been generated to document the discovery of a certified machine found out of tolerance during a calibration closeout. In an effort to reduce risk to product quality two solutions were proposed – shorten the calibration cycle which could be costly, or perform an interim check to monitor the machine’s performance between cycles. The CMM interim check discussed makes use of Renishaw’s Machine Checking Gauge. This off-the-shelf product simulates a large sphere within a CMM’s measurement volume and allows for error estimation. Data was gathered, analyzed, and simulated from seven machines in seventeen different configurations to create statistical process control run charts for on-the-floor monitoring.

42 ENGINEERING↗

Can Agricultural Management Induced Changes in Soil Organic Carbon Be Detected Using Mid-Infrared Spectroscopy?

A major limitation to building credible soil carbon sequestration programs is the cost of measuring soil carbon change. Diffuse reflectance spectroscopy (DRS) is considered a viable low-cost alternative to traditional laboratory analysis of soil organic carbon (SOC). While numerous studies have shown that DRS can produce accurate and precise estimates of SOC across landscapes, whether DRS can detect subtle management induced changes in SOC at a given site has not been resolved. Here, we leverage archived soil samples from seven long-term research trials in the U.S. to test this question using mid infrared (MIR) spectroscopy coupled with the USDA-NRCS Kellogg Soil Survey Laboratory MIR spectral library. Overall, MIR-based estimates of SOC%, with samples scanned on a secondary instrument, were excellent with the root mean square error ranging from 0.10 to 0.33% across the seven sites. In all but two instances, the same statistically significant (p < 0.10) management effect was found using both the lab-based SOC% and MIR estimated SOC% data. Despite some additional uncertainty, primarily in the form of bias, these results suggest that large existing MIR spectral libraries can be operationalized in other laboratories for successful carbon monitoring.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗

PARAMETER ESTIMATION OF THE EXPONENTIALLY DAMPED SINUSOID FOR NOISY SIGNALS

The damped sinusoid equation is a common model for many scientific processes involving damped periodic signals. Here we present two methods for estimating the damped sinusoid parameters for noisy signals. Both methods are based upon an exact, closed form solution to fit the parameters for signals without noise, and they estimate the parameters for the noisy signals by the statistical maximum likelihood criterion. The first method relies on an optimizer to minimize the mean square signal error. The second method estimates the parameters by direct calculation and is suitable when the signal noise is small and the frequencies are sufficiently far from the integer and half integer values.

Pelaia, II, Tom↗

TH-CD-207A-07: Prediction of High Dimensional State Subject to Respiratory Motion: A Manifold Learning Approach

Purpose: The development of high dimensional imaging systems (e.g. volumetric MRI, CBCT, photogrammetry systems) in image-guided radiotherapy provides important pathways to the ultimate goal of real-time volumetric/surface motion monitoring. This study aims to develop a prediction method for the high dimensional state subject to respiratory motion. Compared to conventional linear dimension reduction based approaches, our method utilizes manifold learning to construct a descriptive feature submanifold, where more efficient and accurate prediction can be performed. Methods: We developed a prediction framework for high-dimensional state subject to respiratory motion. The proposed method performs dimension reduction in a nonlinear setting to permit more descriptive features compared to its linear counterparts (e.g., classic PCA). Specifically, a kernel PCA is used to construct a proper low-dimensional feature manifold, where low-dimensional prediction is performed. A fixed-point iterative pre-image estimation method is applied subsequently to recover the predicted value in the original state space. We evaluated and compared the proposed method with PCA-based method on 200 level-set surfaces reconstructed from surface point clouds captured by the VisionRT system. The prediction accuracy was evaluated with respect to root-mean-squared-error (RMSE) for both 200ms and 600ms lookahead lengths. Results: The proposed method outperformed PCA-based approach with statistically higher prediction accuracy. In one-dimensional feature subspace, our method achieved mean prediction accuracy of 0.86mm and 0.89mm for 200ms and 600ms lookahead lengths respectively, compared to 0.95mm and 1.04mm from PCA-based method. The paired t-tests further demonstrated the statistical significance of the superiority of our method, with p-values of 6.33e-3 and 5.78e-5, respectively. Conclusion: The proposed approach benefits from the descriptiveness of a nonlinear manifold and the prediction reliability in such low dimensional manifold. The fixed-point iterative approach turns out to work well practically for the pre-image recovery. Our approach is particularly suitable to facilitate managing respiratory motion in image-guide radiotherapy. This work is supported in part by NIH grant R01 CA169102-02.

60 APPLIED LIFE SCIENCES↗

At-wavelength characterization of X-ray wavefronts in Bragg diffraction from crystals

The advent of next-generation synchrotron radiation sources and X-ray free-electron lasers calls for high-quality Bragg-diffraction crystal optics to preserve the X-ray beam coherence and wavefront. This requirement brings new challenges in characterizing crystals in Bragg diffraction in terms of Bragg-plane height errors and wavefront phase distortions. Here, a quantitative methodology to characterize crystal optics using a state-of-the-art at-wavelength wavefront sensing technique and statistical analysis is proposed. The method was tested at the 1-BM-B optics testing beamline at the Advanced Photon Source for measuring silicon and diamond crystals in a self-referencing single-crystal mode and an absolute double-crystal mode. The phase error sensitivity of the technique is demonstrated to be at the λ/100 level required by most applications, such as the characterization of diamond crystals for cavity-based X-ray free-electron lasers.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Convergence Rates for Empirical Estimation of Binary Classification Bounds

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error rate depend on information divergences between the pair of class distributions. Recently, the Henze–Penrose (HP) divergence has been proposed for bounding classification error probability. We consider the problem of empirically estimating the HP-divergence from random samples. We derive a bound on the convergence rate for the Friedman–Rafsky (FR) estimator of the HP-divergence, which is related to a multivariate runs statistic for testing between two distributions. The FR estimator is derived from a multicolored Euclidean minimal spanning tree (MST) that spans the merged samples. We obtain a concentration inequality for the Friedman–Rafsky estimator of the Henze–Penrose divergence. We validate our results experimentally and illustrate their application to real datasets.

97 MATHEMATICS AND COMPUTING↗

ACCOUNTING FOR CALIBRATION UNCERTAINTIES IN X-RAY ANALYSIS: EFFECTIVE AREAS IN SPECTRAL FITTING

While considerable advance has been made to account for statistical uncertainties in astronomical analyses, systematic instrumental uncertainties have been generally ignored. This can be crucial to a proper interpretation of analysis results because instrumental calibration uncertainty is a form of systematic uncertainty. Ignoring it can underestimate error bars and introduce bias into the fitted values of model parameters. Accounting for such uncertainties currently requires extensive case-specific simulations if using existing analysis packages. Here, we present general statistical methods that incorporate calibration uncertainties into spectral analysis of high-energy data. We first present a method based on multiple imputation that can be applied with any fitting method, but is necessarily approximate. We then describe a more exact Bayesian approach that works in conjunction with a Markov chain Monte Carlo based fitting. We explore methods for improving computational efficiency, and in particular detail a method of summarizing calibration uncertainties with a principal component analysis of samples of plausible calibration files. This method is implemented using recently codified Chandra effective area uncertainties for low-resolution spectral analysis and is verified using both simulated and actual Chandra data. Our procedure for incorporating effective area uncertainty is easily generalized to other types of calibration uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards optimal sensor placement for inverse problems in spaces of measures

The objective of this work is to quantify the reconstruction error in sparse inverse problems with measures and stochastic noise, motivated by optimal sensor placement. To be useful in this context, the error quantities must be explicit in the sensor configuration and robust with respect to the source, yet relatively easy to compute in practice, compared to a direct evaluation of the error by a large number of samples. In particular, we consider the identification of a measure consisting of an unknown linear combination of point sources from a finite number of measurements contaminated by Gaussian noise. The statistical framework for recovery relies on two main ingredients: first, a convex but non-smooth variational Tikhonov point estimator over the space of Radon measures and, second, a suitable mean-squared error based on its Hellinger–Kantorovich distance to the ground truth. To quantify the error, we employ a non-degenerate source condition as well as careful linearization arguments to derive a computable upper bound. This leads to asymptotically sharp error estimates in expectation that are explicit in the sensor configuration. Thus they can be used to estimate the expected reconstruction error for a given sensor configuration and guide the placement of sensors in sparse inverse problems.

97 MATHEMATICS AND COMPUTING↗

SU-D-BRA-03: Analysis of Systematic Errors with 2D/3D Image Registration for Target Localization and Treatment Delivery in Stereotactic Radiosurgery

Purpose: Determine systematic deviations between 2D/3D and 3D/3D image registrations with six degrees of freedom (6DOF) for various imaging modalities and registration algorithms on the Varian Edge Linac. Methods: The 6DOF systematic errors were assessed by comparing automated 2D/3D (kV/MV vs. CT) with 3D/3D (CBCT vs. CT) image registrations from different imaging pairs, CT slice thicknesses, couch angles, similarity measures, etc., using a Rando head and a pelvic phantom. The 2D/3D image registration accuracy was evaluated at different treatment sites (intra-cranial and extra-cranial) by statistically analyzing 2D/3D pre-treatment verification against 3D/3D localization of 192 Stereotactic Radiosurgery/Stereotactic Body Radiation Therapy treatment fractions for 88 patients. Results: The systematic errors of 2D/3D image registration using kV-kV, MV-kV and MV-MV image pairs using 0.8 mm slice thickness CT images were within 0.3 mm and 0.3° for translations and rotations with a 95% confidence interval (CI). No significant difference between 2D/3D and 3D/3D image registrations (P>0.05) was observed for target localization at various CT slice thicknesses ranging from 0.8 to 3 mm. Couch angles (30, 45, 60 degree) did not impact the accuracy of 2D/3D image registration. Using pattern intensity with content image filtering was recommended for 2D/3D image registration to achieve the best accuracy. For the patient study, translational error was within 2 mm and rotational error was within 0.6 degrees in terms of 95% CI for 2D/3D image registration. For intra-cranial sites, means and std. deviations of translational errors were −0.2±0.7, 0.04±0.5, 0.1±0.4 mm for LNG, LAT, VRT directions, respectively. For extra-cranial sites, means and std. deviations of translational errors were - 0.04±1, 0.2±1, 0.1±1 mm for LNG, LAT, VRT directions, respectively. 2D/3D image registration uncertainties for intra-cranial and extra-cranial sites were comparable. Conclusion: The Varian Edge radiosurgery 6DOF-based system, can perform 2D/3D image registration with high accuracy for target localization in image-guided stereotactic radiosurgery. The work was supported by a Research Scholar Grant, RSG-15-137-01-CCE from the American Cancer Society.

60 APPLIED LIFE SCIENCES↗

Cross-Market Price Difference Forecast Using Deep Learning for Electricity Markets

Price forecasting is in the center of decision making in electricity markets. Many researches have been done in forecasting energy prices while little research has been reported on forecasting price difference between day-ahead and realtime markets due to its high volatility, which however plays a critical role in virtual trading. To this end, this paper takes the first attempt to employ novel deep learning architecture with Bidirectional Long-Short Term Memory (LSTM) units to forecast the price difference between day-ahead and real-time markets for the same node. The raw data is collected from PJM market, processed and fed into the proposed network. The Root Mean Squared Error (RMSE) and customized performance metric are used to evaluate the performance of the proposed method. Case studies show that it outperforms the traditional statistical models like ARIMA, and machine learning models like XGBoost and SVR methods in both RMSE and the capability of forecasting the sign of price difference. Additionally, to cross-market price difference forecast, the proposed approach has the potential to be applied to solve other forecasting problems such as price spread forecast in DA market for Financial Transmission Right (FTR) trading purpose.

DA/RT price difference↗

Direction-dependent localization errors in SPECT images

Purpose: Single photon emission computed tomography (SPECT) is being investigated for imaging inside radiation therapy treatment rooms to localize biological targets. Here, computer simulations were used to analyze locational and directional dependencies in localization errors and to assess the effects of spatial resolution modeling and observer normalization on localization performance. Methods: SPECT images of the XCAT phantom, containing 12 hot tumors, were reconstructed with detector response function compensation (DRC) and without DRC (nDRC). Numerical observers were forced to select the most suspicious tumor location, using normalized cross correlation (NXC) or un-normalized cross correlation (XC), from 3 cm diameter search volumes that each contained only one tumor. For each tumor site, localization was optimized as a function of the iteration number and postreconstruction smoothing. Localization error, the distance between true and estimated tumor positions, was calculated across the ensembles of 80 images. Direction-dependent localization bias and precision were estimated from the image ensemble. Results: For the six superficial tumors in close proximity to the detector trajectory, mean localization errors were <2 mm and were lowest or comparable using DRC-NXC, though differences from DRC-XC and nDRC-NXC were not statistically significant. DRC-NXC did provide statistically significantly better localization than nDRC-XC for five of these six tumors. At the other six sites where attenuation was more severe and the distance was generally greater between the tumor and detector, DRC typically did not show better localization than nDRC. Observer normalization improved the localization substantially for a tumor near the hotter heart. Localization errors were anisotropic and dependent on tumor location relative to the detector trajectory. Conclusions: This computer-simulation study compared localization performance for normalized and un-normalized numerical observers, which were used to estimate tumor positions in SPECT images, reconstructed with and without DRC. For tumors localized to <2 mm on average, which are good candidates for SPECT-guided radiation therapy, localization performance typically improved by compensating for the detector response function and by using a normalized observer. The observed direction-dependent localization errors have important implications for radiation therapy and are relevant to SPECT imaging in general.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An Evaluation of Redd Counts as a Measure of Bull Trout Population Size and Trend

Abstract The use of redd counts to monitor abundance and trend of bull trout Salvelinus confluentus has been clouded by uncertainties concerning measurement error, life history variation, and correspondence of redd counts to adult population size. We compared census redd counts with population estimates of mature females for a migratory fluvial population of bull trout (primarily ≥ 300 mm fork length) and for a population of small (<200 mm), likely resident, bull trout. We also compared the measurement error of the experienced surveyors who conducted the redd counts to that of a group of inexperienced surveyors. Although the regression of redd counts on adult females for the migratory population was statistically significant, a large proportion of the variation in the relationship was unexplained (r 2 = 0.47). Despite that variation, redd counts accurately reflected a greater than 50% decline in the population over 10 years; however, 5-year trends in redd counts could be misleading. Power analysis parameterized by using the variation in the number of females per redd and measurement error of experienced surveyors indicated that minimum declines of 44–56% or increases of 78–118% over 10–15 years would be necessary for detection using traditional statistical criteria. Geometric mean abundance of migratory adults derived from redd counts and adults-per-redd values from the present study and published averages were similar to measured adult numbers in most cases. For both migratory and resident populations, redd counts by experienced surveyors were substantially more accurate and precise than those by inexperienced surveyors. Counts of migratory bull trout redds were more accurate and precise than counts of resident bull trout redds, which were significantly smaller and consistently underestimated. Thus, bull trout redd counts can be used to estimate abundance levels and to detect substantial longer-term changes in abundance, particularly for migratory populations. However, the reliability of the counts depends on the skill of the surveyors. Received April 4, 2011; accepted August 8, 2011

Howell, Philip J.↗

SpotSDC: Revealing the Silent Data Corruption Propagation in High-Performance Computing Systems

We report the trend of rapid technology scaling is expected to make the hardware of high-performance computing (HPC) systems more susceptible to computational errors due to random bit flips. Some bit flips may cause a program to crash or have a minimal effect on the output, but others may lead to silent data corruption (SDC), i.e., undetected yet significant output errors. Classical fault injection analysis methods employ uniform sampling of random bit flips during program execution to derive a statistical resiliency profile. However, summarizing such fault injection result with sufficient detail is difficult, and understanding the behavior of the fault-corrupted program is still a challenge. In this article, we introduce SpotSDC, a visualization system to facilitate the analysis of a program's resilience to SDC. SpotSDC provides multiple perspectives at various levels of detail of the impact on the output relative to where in the source code the flipped bit occurs, which bit is flipped, and when during the execution it happens. SpotSDC also enables users to study the code protection and provide new insights to understand the behavior of a fault-injected program. Based on lessons learned, we demonstrate how what we found can improve the fault injection campaign method.

97 MATHEMATICS AND COMPUTING↗

ON THE HUBBLE SPACE TELESCOPE TRIGONOMETRIC PARALLAX OF THE DWARF NOVA SS CYGNI

SS Cygni is one of the brightest dwarf novae (DNe), and one of the best studied prototypes of the cataclysmic variables. Astrometric observations with the Fine Guidance Sensors (FGSs) on the Hubble Space Telescope (HST), published in 2004, gave an absolute trigonometric parallax of 6.06 {+-} 0.44 mas. However, recent very long baseline interferometry (VLBI), obtained during radio outbursts of SS Cyg, has yielded a significantly larger absolute parallax of 8.80 {+-} 0.12 mas, as well as a large difference in the direction of the proper motion (PM) compared to the HST result. The VLBI distance reduces the implied luminosity of SS Cyg by about a factor of two, giving good agreement with predictions based on accretion-disk theory in order to explain the observed DN outburst behavior. This discrepancy raises the possibility of significant systematic errors in FGS parallaxes and PMs. We have reanalyzed the archival HST/FGS data, including (1) a critical redetermination of the parallaxes of the background astrometric reference stars, (2) updated input values of the reference-star PMs, and (3) correction of the position measurements for color-dependent shifts. Our new analysis yields a PM of SS Cyg that agrees well with the VLBI motion, and an absolute parallax of 8.30 {+-} 0.41 mas, also statistically concordant with the VLBI result at the {approx}1.2 {sigma} level. Our results suggest that HST/FGS parallaxes are free of large systematic errors, when the data are reduced using high-quality input values for the astrometry of the reference stars, and when instrumental signatures are properly removed.

79 ASTRONOMY AND ASTROPHYSICS↗

An open-access CMIP5 pattern library for temperature and precipitation: Description and methodology

Pattern scaling is used to efficiently emulate general circulation models and explore uncertainty in climate projections under multiple forcing scenarios. Pattern scaling methods assume that local climate changes scale with a global mean temperature increase, allowing for spatial patterns to be generated for multiple models for any future emission scenario. For uncertainty quantification and probabilistic statistical analysis, a library of patterns with descriptive statistics for each file would be beneficial, but such a library does not presently exist. Of the possible techniques used to generate patterns, the two most prominent are the delta and least squared regression methods. We explore the differences and statistical significance between patterns generated by each method and assess performance of the generated patterns across methods and scenarios. Differences in patterns across seasons between methods and epochs were largest in high latitudes (60-90°N/S). Bias and mean errors between modeled and pattern predicted output from the linear regression method were smaller than patterns generated by the delta method. Across scenarios, differences in the linear regression method patterns were more statistically significant, especially at high latitudes. We found that pattern generation methodologies were able to approximate the forced signal of change to within ≤ 0.5°C, but choice of pattern generation methodology for pattern scaling purposes should be informed by user goals and criteria. As a result, this paper describes our library of least squared regression patterns from all CMIP5 models for temperature and precipitation on an annual and sub-annual basis, along with the code used to generate these patterns.

54 ENVIRONMENTAL SCIENCES↗