Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

A Beam-Specific Planning Target Volume (PTV) Design for Proton Therapy to Account for Setup and Range Uncertainties

Purpose: To report a method for explicitly designing a planning target volume (PTV) for treatment planning and evaluation in heterogeneous media for passively scattered proton therapy and scanning beam proton therapy using single-field optimization (SFO). Methods and Materials: A beam-specific PTV (bsPTV) for proton beams was derived by ray-tracing and shifting ray lines to account for tissue misalignment in the presence of setup error or organ motion. Range uncertainties resulting from inaccuracies in computed tomography-based range estimation were calculated for proximal and distal surfaces of the target in the beam direction. The bsPTV was then constructed based on local heterogeneity. The bsPTV thus can be used directly as a planning target as if it were in photon therapy. To test the robustness of the bsPTV, we generated a single-field proton plan in a virtual phantom. Intentional setup and range errors were introduced. Dose coverage to the clinical target volume (CTV) under various simulation conditions was compared between plans designed based on the bsPTV and a conventional PTV. Results: The simulated treatment using the bsPTV design performed significantly better than the plan using the conventional PTV in maintaining dose coverage to the CTV. With conventional PTV plans, the minimum coverage to the CTV dropped from 99% to 67% in the presence of setup error, internal motion, and range uncertainty. However, plans using the bsPTV showed minimal drop of target coverage from 99% to 94%. Conclusions: The conventional geometry-based PTV concept used in photon therapy does not work well for proton therapy. We investigated and validated a beam-specific PTV method for designing and evaluating proton plans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Regularization and Error Characterization of GRACE Mascons

We present a new global time-variable gravity mascon solution derived from Gravity Recovery and Climate Experiment (GRACE) Level 1B data. The new product from the NASA Goddard Space Flight Center (GSFC) results from a novel approach that combines an iterative solution strategy with geographical binning of inter-satellite range-acceleration residuals in the construction of time-dependent regularization matrices applied in the inversion of mascon parameters. This estimation strategy is intentionally conservative as it seeks to maximize the role of the GRACE measurements on the final solution while minimizing the influence of the regularization design process. We fully reprocess the Level 1B data in the presence of the final mascon solution to generate true post-fit inter-satellite residuals, which are utilized to confirm solution convergence and to validate the mascon noise uncertainties. We also present the mathematical case that regularized mascon solutions are biased, and that this bias, or leakage, must be combined with the estimated noise variance to accurately assess total mascon uncertainties. The estimated leakage errors are determined from the monthly resolution operators. We present a simple approach to compute the total uncertainty for both individual mascon and regional analysis of the GSFC mascon product, and validate the results in comparison with independent mascon solutions and calibrated Stokes uncertainties. Lastly, we present the new solution and uncertainties with global analyses of the mass trends and annual amplitudes, and compute updated trends for the global ocean, and the respective contributions of the Greenland Ice Sheet, Antarctic Ice Sheet, Gulf of Alaska, and terrestrial water storage. This analysis highlights the successful closure of the global mean sea level budget, that is, the sum of global ocean mass from the GSFC mascons and the steric component from Argo floats agrees well with the total determined from sea surface altimetry.

B. D. Loomis↗

Regularization and Error Characterization of GRACE Mascons

We present a new global time-variable gravity mascon solution derived from Gravity Recovery and Climate Experiment (GRACE) Level 1B data. The new product from the NASA Goddard Space Flight Center (GSFC) results from a novel approach that combines an iterative solution strategy with geographical binning of inter-satellite range-acceleration residuals in the construction of time-dependent regularization matrices applied in the inversion of mascon parameters. This estimation strategy is intentionally conservative as it seeks to maximize the role of the GRACE measurements on the final solution while minimizing the influence of the regularization design process. We fully reprocess the Level 1B data in the presence of the final mascon solution to generate true post-fit inter-satellite residuals, which are utilized to confirm solution convergence and to validate the mascon noise uncertainties. We also present the mathematical case that regularized mascon solutions are biased, and that this bias, or leakage, must be combined with the estimated noise variance to accurately assess total mascon uncertainties. The estimated leakage errors are determined from the monthly resolution operators. We present a simple approach to compute the total uncertainty for both individual mascon and regional analysis of the GSFC mascon product, and validate the results in comparison with independent mascon solutions and calibrated Stokes uncertainties. Lastly, we present the new solution and uncertainties with global analyses of the mass trends and annual amplitudes, and compute updated trends for the global ocean, and the respective contributions of the Greenland Ice Sheet, Antarctic Ice Sheet, Gulf of Alaska, and terrestrial water storage. This analysis highlights the successful closure of the global mean sea level budget, that is, the sum of global ocean mass from the GSFC mascons and the steric component from Argo floats agrees well with the total determined from sea surface altimetry.

Loomis, B. D.↗

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗

Benchmarking noise extrapolation with the OpenPulse control framework

Distilling precise estimates from noisy intermediate scale quantum (NISQ) data has recently attracted considerable attention Kandala et al., Nature (London) 567, 491 (2019). In order to augment digital qubit metrics, such as gate fidelity, we discuss analog error mitigability, i.e., the ability to accurately distill precise observable estimates, as a hybrid quantum classical computing benchmarking task. Specifically, using Rabi oscillations as a test program, we characterize single qubit error rates on IBM's Poughkeepsie superconducting quantum hardware, incorporate control-mediated noise dependence into a generalized rescaling protocol, and analyze how noise characteristics influence Richardson extrapolation-based error mitigation. Finally, our results identify regions in the space of Hamiltonian control fields and circuit depth which are most amenable to reliable noise extrapolation, as well as shed light on how low-level hardware characterization can be used as a predictive tool for uncertainty quantification in error-mitigated NISQ computations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

High-Accuracy Surface Figure Measurement of Silicon Mirrors at 80 K

This report describes the equipment, experimental methods, and first results at a new facility for interferometric measurement of cryogenically-cooled spherical mirrors at the Goddard Space Flight Center Optics Branch. The procedure, using standard phase-shifting interferometry, has an standard combined uncertainty of 3.6 nm rms in its representation of the two-dimensional surface figure error at 80, and an uncertainty of plus or minus 1 nm in the rms statistic itself. The first mirror tested was a concave spherical silicon foam-core mirror, with a clear aperture of 120 mm. The optic surface was measured at room temperature using standard absolute techniques; and then the change in surface figure error from room temperature to 80 K was measured. The mirror was cooled within a cryostat. and its surface figure error measured through a fused-silica window. The facility and techniques will be used to measure the surface figure error at 20K of prototype lightweight silicon carbide and Cesic mirrors developed by Galileo Avionica (Italy) for the European Space Agency (ESA).

Blake, Peter↗

A Two-Step Approach to Uncertainty Quantification of Core Simulators

For the multiple sources of error introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily to quantify the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the “two-step” method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the two-step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution was examined in the framework of phase I-3 of the OECD Uncertainty Analysis in Modeling benchmark. With the Three Mile Island Unit 1 core as a base model for analysis, the XSUSA and two-step methods were applied with certain limitations, and the results were compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions were drawn as to the method that is currently more viable for computing uncertainties in burnup and transient calculations.

Yankov, Artem↗

Weak lensing measurement of the mass–richness relation of SDSS redMaPPer clusters

Here, we perform a measurement of the mass–richness relation of the redMaPPer galaxy cluster catalogue using weak lensing data from the Sloan Digital Sky Survey. We carefully characterized a broad range of systematic uncertainties, including shear calibration errors, photo-zz biases, dilution by member galaxies, source obscuration, magnification bias, incorrect assumptions about cluster mass profiles, cluster centering, halo triaxiality, and projection effects. We then compare measurements of the lensing signal from two independently-produced shear and photometric redshift catalogues to characterize systematic errors in the lensing signal itself. Using a sample of 5,570 clusters from 0.1 ≤ zz ≤ 0.33, the normalization of our power-law mass vs. λ relation is log 10 [M 200m /h -1 M ⊙ ] = 14.344 ± 0.021 (statistical) ±0.023 (systematic) at a richness λ = 40, a 7 per cent calibration uncertainty, with a power-law index of 1.33+0.09-0.101.33$+0.09\atop{-0.10}$ (1σ). Finally, the detailed systematics characterization in this work renders it the definitive weak lensing mass calibration for SDSS redMaPPer clusters at this time.

79 ASTRONOMY AND ASTROPHYSICS↗

Space Shuttle Debris Impact Tool Assessment Using the Modern Design of Experiments

Complex computer codes are used to estimate thermal and structural reentry loads on the Shuttle Orbiter induced by ice and foam debris impact during ascent. Such debris can create cavities in the Shuttle Thermal Protection System. The sizes and shapes of these cavities are approximated to accommodate a code limitation that requires simple "shoebox" geometries to describe the cavities -- rectangular areas and planar walls that are at constant angles with respect to vertical. These approximations induce uncertainty in the code results. The Modern Design of Experiments (MDOE) has recently been applied to develop a series of resource-minimal computational experiments designed to generate low-order polynomial graduating functions to approximate the more complex underlying codes. These polynomial functions were then used to propagate cavity geometry errors to estimate the uncertainty they induce in the reentry load calculations performed by the underlying code. This paper describes a methodological study focused on evaluating the application of MDOE to future operational codes in a rapid and low-cost way to assess the effects of cavity geometry uncertainty.

DeLoach, Richard↗

Preliminary Studies for a CBCT Imaging Protocol for Offline Organ Motion Analysis: Registration Software Validation and CTDI Measurements

Cone-beam X-ray volumetric imaging in the treatment room, allows online correction of set-up errors and offline assessment of residual set-up errors and organ motion. In this study the registration algorithm of the X-ray volume imaging software (XVI, Elekta, Crawley, United Kingdom), which manages a commercial cone-beam computed tomography (CBCT)-based positioning system, has been tested using a homemade and an anthropomorphic phantom to: (1) assess its performance in detecting known translational and rotational set-up errors and (2) transfer the transformation matrix of its registrations into a commercial treatment planning system (TPS) for offline organ motion analysis. Furthermore, CBCT dose index has been measured for a particular site (prostate: 120 kV, 1028.8 mAs, approximately 640 frames) using a standard Perspex cylindrical body phantom (diameter 32 cm, length 15 cm) and a 10-cm-long pencil ionization chamber. We have found that known displacements were correctly calculated by the registration software to within 1.3 mm and 0.4{sup o}. For the anthropomorphic phantom, only translational displacements have been considered. Both studies have shown errors within the intrinsic uncertainty of our system for translational displacements (estimated as 0.87 mm) and rotational displacements (estimated as 0.22{sup o}). The resulting table translations proposed by the system to correct the displacements were also checked with portal images and found to place the isocenter of the plan on the linac isocenter within an error of 1 mm, which is the dimension of the spherical lead marker inserted at the center of the homemade phantom. The registration matrix translated into the TPS image fusion module correctly reproduced the alignment between planning CT scans and CBCT scans. Finally, measurements on the CBCT dose index indicate that CBCT acquisition delivers less dose than conventional CT scans and electronic portal imaging device portals. The registration software was found to be accurate, and its registration matrix can be easily translated into the TPS and a low dose is delivered to the patient during image acquisition. These results can help in designing imaging protocols for offline evaluations.

61 RADIATION PROTECTION AND DOSIMETRY↗

Validation of SAS4A/SASSYS-1 for predicting steady-state single-phase natural circulation

The validation of system analysis codes for nuclear reactor systems is required for the development and application of these computational tools. Designed as a comprehensive system analysis code for advanced nuclear reactors, SAS4A/SASSYS-1 requires validation of its physics model for capturing single-phase natural circulation behavior. To support the validation of SAS4A/SASSYS-1, high-precision experiments are performed capturing steady-state single-phase natural circulation on a scaled facility with comprehensive instrumentation. In this work, dedicated tests are performed quantifying the critical modeling parameters, and a single-phase natural circulation benchmark dataset is obtained with well-documented uncertainty and comprehensive facility description. The validation is then performed against the dataset examining the capability of SAS4A/SASSYS-1 in simulating steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators which quantify and restrict numerical errors from discretization. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, quantifying the output uncertainty in a Monte Carlo approach. The composition of the output uncertainty is also quantified through a variance-based sensitivity analysis. With the uncertainty quantified for each individual condition, a detailed comparison between the simulation results and experimental data is performed covering the whole dataset. The results show consistent agreement for all primary parameters. The current validation activity provides a valuable benchmark dataset for the validation of system analysis codes in capturing single-phase natural circulation and demonstrates satisfactory prediction capability of SAS4A/SASSYS1 for steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Monitoring robot actions for error detection and recovery

Reliability is a serious problem in computer controlled robot systems. Although robots serve successfully in relatively simple applications such as painting and spot welding, their potential in areas such as automated assembly is hampered by programming problems. A program for assembling parts may be logically correct, execute correctly on a simulator, and even execute correctly on a robot most of the time, yet still fail unexpectedly in the face of real world uncertainties. Recovery from such errors is far more complicated than recovery from simple controller errors, since even expected errors can often manifest themselves in unexpected ways. Here, a novel approach is presented for improving robot reliability. Instead of anticipating errors, researchers use knowledge-based programming techniques so that the robot can autonomously exploit knowledge about its task and environment to detect and recover from failures. They describe preliminary experiment of a system that they designed and constructed.

Gini, M.↗

Quantifying uncertainties in global and regional temperature change using an ensemble of observational estimates: The HadCRUT4 data set

Recent developments in observational near-surface air temperature and sea-surface temperature analyses are combined to produce HadCRUT4, a new data set of global and regional temperature evolution from 1850 to the present. This includes the addition of newly digitized measurement data, both over land and sea, new sea-surface temperature bias adjustments and a more comprehensive error model for describing uncertainties in sea-surface temperature measurements. An ensemble approach has been adopted to better describe complex temporal and spatial interdependencies of measurement and bias uncertainties and to allow these correlated uncertainties to be taken into account in studies that are based upon HadCRUT4. Climate diagnostics computed from the gridded data set broadly agree with those of other global near-surface temperature analyses. Fitted linear trends in temperature anomalies are approximately 0.07°C/decade from 1901 to 2010 and 0.17°C/decade from 1979 to 2010 globally. Northern/southern hemispheric trends are 0.08/0.07°C/decade over 1901 to 2010 and 0.24/0.10°C/decade over 1979 to 2010. Linear trends in other prominent near-surface temperature analyses agree well with the range of trends computed from the HadCRUT4 ensemble members.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty propagation in full-core Monte Carlo depletion simulations using Serpent

The desire to accurately model the heterogeneity of the nuclear reactor environment combined with the ever more powerful computational resources have made in recent years the use of Monte Carlo method more attractive and feasible (if challenging) even for 3-D full core depletion simulation. However, in this case statistical uncertainty is combined with error propagating through the calculation from previous steps. In an effort to understand this error propagation, a numerical study was undertaken and previously reported modeling depletion of a four fuel assemblies (a 'quad'). This work extends results and analysis on a full nuclear reactor core depletion simulation where isotopics of individual fuel pins is tracked. By changing the code's initial random number seed, the data produced by a series of 19 replica runs was used to investigate the true and apparent variance in k{sub eff} and pin powers. It is hoped that this results can help to identify some common regularities in the behavior of uncertainty in several key parameters, and ultimately develop a predictive model. (authors)

97 MATHEMATICS AND COMPUTING↗

MO-FG-BRA-06: Electromagnetic Beacon Insertion in Lung Cancer Patients and Resultant Surrogacy Errors for Dynamic MLC Tumour Tracking

Purpose: To assess endo-bronchial electromagnetic beacon insertion and to quantify the geometric accuracy of using beacons as a surrogate for tumour motion in real-time multileaf collimator (MLC) tracking of lung tumours. Methods: The LIGHT SABR trial is a world-first clinical trial in which the MLC leaves move with lung tumours in real time on a standard linear accelerator. Tracking is performed based on implanted electromagnetic beacons (CalypsoTM, Varian Medical Systems, USA) as a surrogate for tumour motion. Five patients have been treated and have each had three beacons implanted endo-bronchially under fluoroscopic guidance. The centre of mass (C.O.M) has been used to adapt the MLC in real-time. The geometric error in using the beacon C.O.M as a surrogate for tumour motion was measured by measuring the tumour and beacon C.O.M in all phases of the respiratory cycle of a 4DCT. The surrogacy error was defined as the difference in beacon and tumour C.O.M relative to the reference phase (maximum exhale). Results: All five patients have had three beacons successfully implanted with no migration between simulation and end of treatment. Beacon placement relative to tumour C.O.M varied from 14 to 74 mm and in one patient spanned two lobes. Surrogacy error was measured in each patient on the simulation 4DCT and ranged from 0 to 3 mm. Surrogacy error as measured on 4DCT was subject to artefacts in mid-ventilation phases. Surrogacy error was a function of breathing phase and was typically larger at maximum inhale. Conclusion: Beacon placement and thus surrogacy error is a major component of geometric uncertainty in MLC tracking of lung tumours. Surrogacy error must be measured on each patient and incorporated into margin calculation. Reduction of surrogacy error is limited by airway anatomy, however should be taken into consideration when performing beacon insertion and planning. This research is funded by Varian Medical Systems via a collaborative research agreement.

60 APPLIED LIFE SCIENCES↗

Online Tools for Uncovering Data Quality (DQ) Issues in Satellite-Based Global Precipitation Products

Data quality (DQ) has many attributes or facets (i.e., errors, biases, systematic differences, uncertainties, benchmark, false trends, false alarm ratio, etc.)Sources can be complicated (measurements, environmental conditions, surface types, algorithms, etc.) and difficult to be identified especially for multi-sensor and multi-satellite products with bias correction (TMPA, IMERG, etc.) How to obtain DQ info fast and easily, especially quantified info in ROI Existing parameters (random error), literature, DIY, etc.How to apply the knowledge in research and applications.Here, we focus on online systems for integration of products and parameters, visualization and analysis as well as investigation and extraction of DQ information.

precipitation↗

Development of Neural Network for X-59 Air Data Probe Calibration

Two wind tunnel tests were conducted in the NASA Glenn Research Center (GRC) 8- by 6-Foot Supersonic Wind Tunnel to calibrate the nose-mounted air data probe for the X-59. The probe will be the primary instrument for the flight test of the X-59 for determining angle of attack, angle of sideslip, airspeed, and pressure altitude of the aircraft in flight. This paper documents the development of several neural net algorithms that can be used to relate air data probe port pressures from those tests to relevant X-59 flight parameters, such as angle of attack, angle of sideslip, mach number, and static and dynamic pressure. These calibration algorithms address accuracy effects for significant real-world conditions, such as initial sensor measurement uncertainties, assumed parameter constraints on NN modelling errors, and malfunctioning or plugged ports. Resultant integrated uncertainties are provided for each algorithm; these uncertainties are then used to estimate the effects on relevant X-59 mission parameters.

Kurtis Roy Long↗