Search NASA⌕ Search

SEARCH · Search NASA

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

TU-G-BRD-08: In-Vivo EPID Dosimetry: Quantifying the Detectability of Four Classes of Errors

Purpose: EPID dosimetry is an emerging method for treatment verification and QA. Given that the in-vivo EPID technique is in clinical use at some centers, we investigate the sensitivity and specificity for detecting different classes of errors. We assess the impact of these errors using dose volume histogram endpoints. Though data exist for EPID dosimetry performed pre-treatment, this is the first study quantifying its effectiveness when used during patient treatment (in-vivo). Methods: We analyzed 17 patients; EPID images of the exit dose were acquired and used to reconstruct the planar dose at isocenter. This dose was compared to the TPS dose using a 3%/3mm gamma criteria. To simulate errors, modifications were made to treatment plans using four possible classes of error: 1) patient misalignment, 2) changes in patient body habitus, 3) machine output changes and 4) MLC misalignments. Each error was applied with varying magnitudes. To assess the detectability of the error, the area under a ROC curve (AUC) was analyzed. The AUC was compared to changes in D99 of the PTV introduced by the simulated error. Results: For systematic changes in the MLC leaves, changes in the machine output and patient habitus, the AUC varied from 0.78–0.97 scaling with the magnitude of the error. The optimal gamma threshold as determined by the ROC curve varied between 84–92%. There was little diagnostic power in detecting random MLC leaf errors and patient shifts (AUC 0.52–0.74). Some errors with weak detectability had large changes in D99. Conclusion: These data demonstrate the ability of EPID-based in-vivo dosimetry in detecting variations in patient habitus and errors related to machine parameters such as systematic MLC misalignments and machine output changes. There was no correlation found between the detectability of the error using the gamma pass rate, ROC analysis and the impact on the dose volume histogram. Funded by grant R18HS022244 from AHRQ.

60 APPLIED LIFE SCIENCES↗

Shuttle entry trajectory reconstruction using inflight accelerometer and gyro measurements

An error analysis has been made of a Shuttle postflight entry trajectory reconstruction process to obtain trajectory state estimation errors and to assess the impact of these errors on Shuttle aerodynamic force coefficient extraction. In this analysis, the entry trajectory is assumed to be reconstructed via numerical integration of onboard accelerometer and gyro measurements and constrained to satisfy ground-based radio tracking. The trajectory state estimation errors are calculated using a Kalman-Schmidt sequential filter assuming various measurement error models and combinations of ground-based tracking. The resultant trajectory estimation errors are analyzed in a simplified perturbation process to establish the accuracy to which postflight aerodynamic force coefficients can be determined. Results are presented which show that the principal error sources affecting the trajectory reconstruction and thus the force coefficient extraction, assuming perfect atmospheric density knowledge, are the accelerometer and gyro resolution, acceleration-sensitive gyro drifts, and the alignment uncertainties associated with integration on the Shuttle.

Compton, H. R.↗

MAXIMUM LIKELIHOOD ANALYSIS OF SYSTEMATIC ERRORS IN INTERFEROMETRIC OBSERVATIONS OF THE COSMIC MICROWAVE BACKGROUND

We investigate the impact of instrumental systematic errors in interferometric measurements of the cosmic microwave background (CMB) temperature and polarization power spectra. We simulate interferometric CMB observations to generate mock visibilities and estimate power spectra using the statistically optimal maximum likelihood technique. We define a quadratic error measure to determine allowable levels of systematic error that does not induce power spectrum errors beyond a given tolerance. As an example, in this study we focus on differential pointing errors. The effects of other systematics can be simulated by this pipeline in a straightforward manner. We find that, in order to accurately recover the underlying B-modes for r = 0.01 at 28 < l < 384, Gaussian-distributed pointing errors must be controlled to 0. Degree-Sign 7 root mean square for an interferometer with an antenna configuration similar to QUBIC, in agreement with analytical estimates. Only the statistical uncertainty for 28 < l < 88 would be changed at {approx}10% level. With the same instrumental configuration, we find that the pointing errors would slightly bias the 2{sigma} upper limit of the tensor-to-scalar ratio r by {approx}10%. We also show that the impact of pointing errors on the TB and EB measurements is negligibly small.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 1 Results: Multi-Probe Methodology and Simulated Likelihood Analyses

We present the methodology for and detail the implementation of the Dark Energy Survey (DES) 3x2pt DES Year 1 (Y1) analysis, which combines configuration-space two-point statistics from three different cosmological probes: cosmic shear, galaxy-galaxy lensing, and galaxy clustering, using data from the first year of DES observations. We have developed two independent modeling pipelines and describe the code validation process. We derive expressions for analytical real-space multi-probe covariances, and describe their validation with numerical simulations. We stress-test the inference pipelines in simulated likelihood analyses that vary 6-7 cosmology parameters plus 20 nuisance parameters and precisely resemble the analysis to be presented in the DES 3x2pt analysis paper, using a variety of simulated input data vectors with varying assumptions. We find that any disagreement between pipelines leads to changes in assigned likelihood $\Delta \chi^2 \le 0.045$ with respect to the statistical error of the DES Y1 data vector. We also find that angular binning and survey mask do not impact our analytic covariance at a significant level. We determine lower bounds on scales used for analysis of galaxy clustering (8 Mpc$~h^{-1}$) and galaxy-galaxy lensing (12 Mpc$~h^{-1}$) such that the impact of modeling uncertainties in the non-linear regime is well below statistical errors, and show that our analysis choices are robust against a variety of systematics. These tests demonstrate that we have a robust analysis pipeline that yields unbiased cosmological parameter inferences for the flagship 3x2pt DES Y1 analysis. We emphasize that the level of independent code development and subsequent code comparison as demonstrated in this paper is necessary to produce credible constraints from increasingly complex multi-probe analyses of current data.

79 ASTRONOMY AND ASTROPHYSICS↗

CHARACTERIZATION OF THE BICEP TELESCOPE FOR HIGH-PRECISION COSMIC MICROWAVE BACKGROUND POLARIMETRY

The Background Imaging of Cosmic Extragalactic Polarization (BICEP) experiment was designed specifically to search for the signature of inflationary gravitational waves in the polarization of the cosmic microwave background (CMB). Using a novel small-aperture refractor and 49 pairs of polarization-sensitive bolometers, BICEP has completed three years of successful observations at the South Pole beginning in 2006 February. To constrain the amplitude of the inflationary B-mode polarization, which is expected to be at least 7 orders of magnitude fainter than the 3 K CMB intensity, precise control of systematic effects is essential. This paper describes the characterization of potential systematic errors for the BICEP experiment, supplementing a companion paper on the initial cosmological results. Using the analysis pipelines for the experiment, we have simulated the impact of systematic errors on the B-mode polarization measurement. Guided by these simulations, we have established benchmarks for the characterization of critical instrumental properties including bolometer relative gains, beam mismatch, polarization orientation, telescope pointing, sidelobes, thermal stability, and timestream noise model. A comparison of the benchmarks with the measured values shows that we have characterized the instrument adequately to ensure that systematic errors do not limit BICEP's two-year results, and identifies which future refinements are likely necessary to probe inflationary B-mode polarization down to levels below a tensor-to-scalar ratio r = 0.1.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards the 1 mm/y Stability of the Radial Orbit Error at Regional Scales

An estimated orbit error budget for the Jason-1 and Jason-2 GDR-D solutions is constructed, using several measures of orbit error. The focus is on the long-term stability of the orbit time series for mean sea level applications on a regional scale. We discuss various issues related to the assessment of radial orbit error trends; in particular this study reviews orbit errors dependent on the tracking technique, with an aim to monitoring the long-term stability of all available tracking systems operating on Jason-1 and Jason-2 (GPS, DORIS, SLR). The reference frame accuracy and its effect on Jason orbit is assessed. We also examine the impact of analysis method on the inference of Geographically Correlated Errors as well as the significance of estimated radial orbit error trends versus the time span of the analysis. Thus a long-term error budget of the 10-year Jason-1 and Envisat GDR-D orbit time series is provided for two time scales: interannual and decadal. As the temporal variations of the geopotential remain one of the primary limitations in the Precision Orbit Determination modeling, the overall accuracy of the Jason-1 and Jason-2 GDR-D solutions is evaluated through comparison with external orbits based on different time-variable gravity models. This contribution is limited to an East-West "order-1" pattern at the 2 mm/y level (secular) and 4 mm level (seasonal), over the Jason-2 lifetime. The possibility of achieving sub-mm/y radial orbit stability over interannual and decadal periods at regional scales and the challenge of evaluating such an improvement using in situ independent data is discussed.

Precision Orbit Determination (POD)↗

Verification of Unstructured Grid Adaptation Components

Adaptive unstructured grid techniques have made limited impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic grid adaptation mechanics. Known differences and previously unknown differences in grid adaptation components and their integrated processes are identified here for study. Unstructured grid adaptation tools are verified using analytic functions and the Code Comparison Principle. Three analytic functions with different smoothness properties are adapted to show the impact of smoothness on implementation differences. A scalar advection-diffusion problem with an analytic solution that models a boundary layer is adapted to test individual grid adaptation components. Laminar flow over a delta wing and turbulent flow over an ONERA M6 wing are verified with multiple, independent grid adaptation procedures to show consistent convergence to fine-grid forces and a moment. The scalar problems illustrate known differences in a grid adaptation component implementation and a previously unknown interaction between components. The wing adaptation cases in the current study document a clear improvement to existing grid adaptation procedures. The stage is set for the infusion of verified grid adaptation into production fluid flow simulations.

Park, Michael A.↗

Verification of Unstructured Grid Adaptation Components

Adaptive unstructured grid techniques have made limited impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic grid adaptation mechanics. Known differences and previously unknown differences in grid adaptation components and their integrated processes are identified here for study. Unstructured grid adaptation tools are verified using analytic functions and the Code Comparison Principle. Three analytic functions with different smoothness properties are adapted to show the impact of smoothness on implementation differences. A scalar advection-diffusion problem with an analytic solution that models a boundary layer is adapted to test individual grid adaptation components. The scalar problems illustrate known differences in a grid adaptation component implementation and a previously unknown interaction between components. Laminar flow over a delta wing is verified with multiple, independent grid adaptation procedures to show consistent convergence to fine-grid forces and pitching moment.

Park, Michael A.↗

Mechanical properties of silicate glasses exposed to a low-Earth orbit

The effects of a 5.8 year exposure to low earth orbit environment upon the mechanical properties of commercial optical fused silica, low iron soda-lime-silica, Pyrex 7740, Vycor 7913, BK-7, and the glass ceramic Zerodur were examined. Mechanical testing employed the ASTM-F-394 piston on 3-ball method in a liquid nitrogen environment. Samples were exposed on the Long Duration Exposure Facility (LDEF) in two locations. Impacts were observed on all specimens except Vycor. Weibull analysis as well as a standard statistical evaluation were conducted. The Weibull analysis revealed no differences between control samples and the two exposed samples. We thus concluded that radiation components of the Earth orbital environment did not degrade the mechanical strength of the samples examined within the limits of experimental error. The upper bound of strength degradation for meteorite impacted samples based upon statistical analysis and observation was 50 percent.

Wiedlocher, David E.↗

Orbit determination error analysis and comparison of station-keeping costs for Lissajous and halo-type libration point orbits and sensitivity analysis using experimental design techniques

Spacecraft in orbit near libration point L1 in the Sun-Earth system are excellent platforms for research concerning solar effects on the terrestrial environment. One spacecraft mission launched in 1978 used an L1 orbit for nearly 4 years, and future L1 orbital missions are also being planned. Orbit determination and station-keeping are, however, required for these orbits. In particular, orbit determination error analysis may be used to compute the state uncertainty after a predetermined tracking period; the predicted state uncertainty levels then will impact the control costs computed in station-keeping simulations. Error sources, such as solar radiation pressure and planetary mass uncertainties, are also incorporated. For future missions, there may be some flexibility in the type and size of the spacecraft's nominal trajectory, but different orbits may produce varying error analysis and station-keeping results. The nominal path, for instance, can be (nearly) periodic or distinctly quasi-periodic. A periodic 'halo' orbit may be constructed to be significantly larger than a quasi-periodic 'Lissajous' path; both may meet mission requirements, but perhaps the required control costs for these orbits are probably different. Also for this spacecraft tracking and control simulation problem, experimental design methods can be used to determine the most significant uncertainties. That is, these methods can determine the error sources in the tracking and control problem that most impact the control cost (output); it also produces an equation that gives the approximate functional relationship between the error inputs and the output.

Gordon, Steven C.↗

Disruption of giant comets in the solar system and around other stars

In a standard cometary mass distribution (dN/dM) alpha M(-a), a = 1.5 to 2.0) most of the mass resides in the largest comets. The maximum mass M sub max for which this distribution holds uncertain but there are theoretical and observational indications that M sub max is at least approx. 10(23)g. Chiron, although formally classified as an asteroid, is most likely a giant comet in this mass range. Its present orbit is unstable and it is expected to evolve into a more typical short period comet orbit on a timescale of approx. 10(6) to 10(7)yr. The breakup of a chiron-like comet of mass approx. 10(23)g could in principle produce approx. 10(5) Halley-size comets, or a distribution with an even larger number. If a giant comet was in a typical short period comet orbit, such a breakup could result in a relatively brief comet shower (duration approx. less than 10(6)yr) with some associated terrestrial impacts. However, the most significant climatic effects may not in general be due to the impacts themselves but to the greatly enhanced zodiacal dust cloud in the inner Solar System. (Although this is probably not the case for the unique K-T impact). Researchers used a least Chi square program with error analysis to confirm that the 2 to 5 micrometer excess spectrum of Giclas 29 to 38 can be adequately fitted with either a disk of small inefficient (or efficient) grains or a single temperature black body. Further monitoring of this star may allow discrimination between these two models.

Whitmire, D. P.↗

Verification of Viscous Goal-Based Anisotropic Mesh Adaptation

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, error estimation methods, and anisotropic mesh adaptation mechanics. Anisotropic metric construction methods are evaluated with analytically defined primal and adjoint fields. This allows the comparison of different metric formulations and different implementations of the same formulation without the complications of a flow and adjoint solution method. Unstructured mesh adaptation tools are verified by comparison on analytic primal and dual field before verification on benchmark aerodynamics cases. The documentation of these verification exercises helps to prepare these goal-based methods for routine use in production simulation workflows.

Mesh adaptation↗

Verification of Viscous Goal-Based Anisotropic Mesh Adaptation

Adaptive unstructured mesh techniques have a limited, but growing impact on production analysis workflows where the control of discretization error is critical to obtaining reliable simulation results. Recent progress has matured a number of independent implementations of flow solvers, anisotropic metric construction methods, and anisotropic mesh adaptation mechanics. A key ingredient for the broader acceptance of unstructured mesh adaptation is the verification of these implementations. Anisotropic metric construction methods are evaluated with analytically defined primal fields and the corresponding entropy variables as adjoint fields. This allows the comparison of different metric formulations and different implementations of the same formulation without the complications of a flow and adjoint solution method. The convergence of the output associated with the entropy variable adjoint is studied for mesh adaptation to these fields and a manufactured solution. Mesh adapted drag output is studied for two simple wings in compressible laminar flow to show fine-mesh convergence of multiple metric construction methods to less than a single drag count. The documentation of these verification exercises helps to prepare these goal-based methods for routine use in more complex simulations for production workflows.

mesh adaptation↗

Adiabatic Gravitational Waveform Model for Compact Objects Undergoing Quasi-Circular Inspirals Into Rotating Massive Black Holes

We present bhpwave: a new python-based, open-source tool for generating the gravitational waveforms of stellar-mass compact objects undergoing quasicircular inspirals into rotating massive black holes. These binaries, known as extreme-mass-ratio inspirals (EMRIs), are exciting mHz gravitational wave sources for future space-based detectors such as the Laser Interferometer Space Antenna (LISA). Relativistic models of EMRI gravitational wave signals are necessary to unlock the full scientific potential of mHz detectors, yet few open-source EMRI waveform models exist. Thus we built bhpwave, which uses the adiabatic approximation from black hole perturbation theory to rapidly construct gravitational waveforms based on the leading-order inspiral dynamics of the binary. In this work, we present the theoretical and numerical foundations underpinning bhpwave. We also demonstrate how bhpwave can be used to assess the impact of EMRI modeling errors on LISA gravitational wave data analysis. In particular, we find that for retrograde orbits and slowly spinning black holes we can mismodel the gravitational wave phasing by as much as ∼10 radians without significantly biasing EMRI parameter estimation.

Zachary Nasipak↗

ARETE: Accurate Error Assessment via Machine Learning-Guided Dynamic-Timing Analysis

Nanometer circuits are increasingly prone to timing errors, escalating the need for fault injection frameworks to accurately evaluate their impact on applications. Here in this paper, we propose ARETE, a novel cross-layer, fault-injection framework that combines dynamic-binary instrumentation with machine learning-guided dynamic-timing analysis. ARETE enables accurate fault-injection into any application by estimating the location of the injecting errors via dynamic-timing analysis. To accelerate fault-injection, we develop a novel, data-aware, machine learning-based mechanism that dynamically pre-selects the error-prone instructions and limits the application of the costly dynamic-timing analysis only to them. To evaluate ARETE's accuracy, our fully automated toolflow is configured to support fault-injection based on detailed post-layout gate-level simulations as well as via existing workload-agnostic error models. Our results for various workloads, including an autonomous-driving library, show that the location and time of injected errors performed by ARETE, is 89.9% consistent with fault-injection based on full gate-level simulation. On average, ARETE executes 84.6x faster than gate-level simulation and at a cost of 3.4% loss in the program output quality estimation. When compared to the existing statistical fault-injection tools that are based on workload-agnostic error models, ARETE improves the accuracy of fault-injection rate and output quality estimation by 143.9% and 40.4% on average, respectively.

97 MATHEMATICS AND COMPUTING↗

Estimating Uncertainty in Long Term Total Ozone Records from Multiple Sources

Total ozone measurements derived from the TOMS and SBUV backscattered solar UV instrument series cover the period from late 1978 to the present. As the SBUV series of instruments comes to an end, we look to the 10 years of data from the AURA Ozone Monitoring Instrument (OMI) and two years of data from the Ozone Mapping Profiler Suite (OMPS) on board the Suomi National Polar-orbiting Partnership satellite to continue the record. When combining these records to construct a single long-term data set for analysis we must estimate the uncertainty in the record resulting from potential biases and drifts in the individual measurement records. In this study we present a Monte Carlo analysis used to estimate uncertainties in the Merged Ozone Dataset (MOD), constructed from the Version 8.6 SBUV2 series of instruments. We extend this analysis to incorporate OMI and OMPS total ozone data into the record and investigate the impact of multiple overlapping measurements on the estimated error. We also present an updated column ozone trend analysis and compare the size of statistical error (error from variability not explained by our linear regression model) to that from instrument uncertainty.

TOMS and SBUV↗

GPS Data Filtration Method for Drive Cycle Analysis Applications

When employing GPS data acquisition systems to capture vehicle drive-cycle information, a number of errors often appear in the raw data samples, such as sudden signal loss, extraneous or outlying data points, speed drifting, and signal white noise, all of which limit the quality of field data for use in downstream applications. Unaddressed, these errors significantly impact the reliability ofsource data and limit the effectiveness of traditional drive-cycle analysis approaches and vehicle simulation software. Without reliable speed and time information, the validity of derived metrics for drive cycles, such as acceleration, power, and distance, become questionable. This study explores some of the common sources of error present in raw onboard GPS data and presents a detailedfiltering process designed to correct for these issues. Test data from both light and medium/heavy duty applications are examined to illustrate the effectiveness of the proposed filtration process across the range of vehicle vocations. Graphical comparisons of raw and filtered cycles are presented, and statistical analyses are performed to determine the effects of the proposed filtration processon raw data. Finally, an evaluation of the overall benefits of data filtration on raw GPS data and present potential areas for continued research is presented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Measurement and correction of leaf open times in helical tomotherapy

Purpose: The binary multileaf collimator (MLC) is one of the most important components in helical tomotherapy (HT), as it modulates the dose delivered to the patient. However, methods to ensure MLC quality in HT treatments are lacking. The authors obtained data on the performance of the MLC in treatments administered in their department in order to assess possible delivery errors due to the MLC. Correction methods based on their data are proposed. Methods: Twenty sinograms from treatments delivered using both of the authors HT systems were measured and analyzed by recording the fluence collected by the imaging detector. Planned and actual sinograms were compared using distributions of leaf open time (LOT) errors, as well as differences in fluence reconstructed at each of the 51 projections into which the treatment planning system divides each rotation for optimization purposes. They proposed and applied a method based on individual leaf error correction and the increase in projection time to prevent latency effects when LOT is close to projection time. In order to analyze the dosimetric impact of the corrections, inphantom measurements were made for four corrected treatments. Results: The LOTs measured were consistent with those planned. Most of the mean errors in LOT distributions were within 1 ms with standard deviations of over 4 ms. Reconstructed fluences showed good results, with over 90% of points passing the 3% criterion, except in treatments with a short mean LOT, where the percentage of passing points was as low as 66%. Individual leaf errors were as long as 4 ms in some cases. Corrected sinograms improved error distribution, with standard deviations of over 3 ms and increased percentages of points passing 3% in the fluence per angle analysis, especially in treatments with a short mean LOT and those that were more subject to latency effects. The minimum percentage of points within 3% increased to 86%. In-phantom measurements of the corrected treatments showed that, while treatments affected by latency effects were improved, those affected by individual leaf errors were not. Conclusions: Measurement of MLC performance in real treatments provides the authors with a valuable tool for ensuring the quality of HT delivery. The LOTs of MLC are very accurate in most cases. Sources of error were found and correction methods proposed and applied. The corrections decreased the amount of LOT errors. The dosimetric impact of these corrections should be evaluated more thoroughly using 3D dose distribution analysis.

07 ISOTOPE AND RADIATION SOURCES↗