Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Predeployment validation of fault-tolerant systems through software-implemented fault insertion

Fault injection-based automated testing (FIAT) environment, which can be used to experimentally characterize and evaluate distributed realtime systems under fault-free and faulted conditions is described. A survey is presented of validation methodologies. The need for fault insertion based on validation methodologies is demonstrated. The origins and models of faults, and motivation for the FIAT concept are reviewed. FIAT employs a validation methodology which builds confidence in the system through first providing a baseline of fault-free performance data and then characterizing the behavior of the system with faults present. Fault insertion is accomplished through software and allows faults or the manifestation of faults to be inserted by either seeding faults into memory or triggering error detection mechanisms. FIAT is capable of emulating a variety of fault-tolerant strategies and architectures, can monitor system activity, and can automatically orchestrate experiments involving insertion of faults. There is a common system interface which allows ease of use to decrease experiment development and run time. Fault models chosen for experiments on FIAT have generated system responses which parallel those observed in real systems under faulty conditions. These capabilities are shown by two example experiments each using a different fault-tolerance strategy.

Czeck, Edward W.↗

Toward on-demand measurements of greenhouse gas emissions using an uncrewed aircraft AirCore system

This paper evaluates the performance of a multirotor uncrewed aircraft and AirCore system (UAAS) for measuring vertical profiles of wind velocity (speed and direction) and the mole fractions of methane (CH 4 ) and carbon dioxide (CO 2 ), and it presents a use case that combines UAAS measurements and dispersion modeling to quantify CH 4 emissions from a dairy farm. To evaluate the atmospheric sensing performance of the UAAS, four field deployments were performed at three locations in the San Joaquin Valley of California where CH 4 hotspots were observed downwind of dairy farms. A comparison of the observations collected on board the UAAS and an 11 m meteorological tower show that the UAAS can measure wind velocity trends with a root mean squared error varying between 0.4 and 1.1 m s -1 when the wind magnitude is less than 3.5 m s -1 . Findings from UAAS flight deployments and a calibration experiment also show that the UAAS can reliably resolve temporal variations in the mole fractions of CH 4 and CO 2 occurring over periods of 10 s or longer. Results from the UAAS and dispersion modeling use case further demonstrate that UAASs have great potential as low-cost tools for detecting and quantifying CH 4 emissions in near real time.

54 ENVIRONMENTAL SCIENCES↗

21 Tesla Fourier Transform Ion Cyclotron Resonance Mass Spectrometer Greatly Expands Mass Spectrometry Toolbox

We provide the initial performance evaluation of a 21 Tesla Fourier transform ion cyclotron resonance mass spectrometer operating at the Environmental Molecular Sciences Laboratory at Pacific Northwest National Laboratory. The spectrometer constructed for the 21T system employs a commercial dual linear ion trap mass spectrometer coupled to a FTICR spectrometer designed and built in-house. Performance gains from moving to higher magnetic field strength are exemplified by the measurement of peptide isotopic fine structure, complex natural organic matter mixtures, and large proteins. Accurate determination of isotopic fine structure was demonstrated for doubly charged substance P with minimal spectral averaging, and 8,158 molecular formulas assigned to Suwannee River Fulvic Acid standard with RMS error of 10 ppb. We also demonstrated superior performance for intact proteins; namely, broadband isotopic resolution of the entire charge state distribution of apotransferrin (78 kDa) and facile isotopic resolution of monoclonal antibody under a variety of acquisition parameters (e.g. 6 s time-domains with absorption mode processing yielded resolution of approximately 1M at m/z =2,700).

Environmental Molecular Sciences Laboratory↗

Prediction of annual soil respiration from its flux at mean annual temperature

Accurately scaling soil respiration (SR, the soil-to-atmosphere flow of CO2) across time and space is important to constrain and understand ecosystem to global scale SR, a major terrestrial carbon flux to the atmosphere. Year-round SR measurements are however expensive and sometimes impossible to perform. Bahn et al. (2010) developed an approach to estimate annual SR (SRannual) from the flux measured at mean soil temperature (SRMAST), but the robustness of this approach needs to be evaluated in diverse ecosystem types and climatic conditions globally. We used a global soil respiration database (SRDB-V4, with 823 SR observations worldwide) to test the capability of SRMAST to predict SRannual. SRMAST estimated using a variety of methods all showed clear relationships with annual SRannual. Two single-rate methods (i.e., using the single SR rate most close to mean annual soil temperature, or the single SR rate most close to mean annual air temperature) showed the most pronounced divergence from the true SRannual, but errors significantly decreased when using multiple SR rates within 1 ? of the mean annual soil temperature to estimate SRMAST. SRannual was most closely correlated with SRMAST estimated via a Q10 relationship, but this method has a potential autocorrelation issue that we explore and discuss. Air temperature data are much more widely available than is soil temperature, and we found that SR at mean annual air temperature (SRMAAT) can be used to predict SRannual as well. This study builds on Bahn et al. (2010) to demonstrate that SR measured at both annual mean soil and air temperature can be used to predict annual SR, with well-quantified errors. This capability could be used to reduce SR measurement frequency required for estimating SRannual and greatly decrease cost, factors that are generally important but especially in lower-income countries and cold, inaccessible regions.

Soil respiration, temperature, modeling↗

Stress intensity factor models using mechanics-guided decomposition and symbolic regression

The finite element method can be used to compute accurate stress intensity factors (SIFs) for cracks with complex geometries and boundary conditions. In contrast, handbook solutions act as surrogate SIF models that provide significantly faster evaluation times. However, the development of conventional surrogate SIF models relies on manual development based on low-order parameterizations. This limits surrogate model accuracy and generalizability. Here, in this paper, we develop a framework for the automated development of mechanics-guided handbook SIF solutions by using interpretable machine learning via genetic programming for symbolic regression (GPSR). Formalizing the mechanics-based approach of Raju and Newman, SIF training data is decomposed into multiple subsets. This decomposition enables parallel GPSR model development of subfunctions, each of which accounts for specific geometrical corrections with respect to a known analytical model. Using this mechanics-based approach with GPSR allows for equations to be learned with improved accuracy and reduced complexity relative to the Raju Newman equations while maintaining the inherent interpretability of mathematical expressions. In this paper, we present equations that match the complexity of the Raju Newman equations while having reduced error, as well as equations with similar errors and reduced complexity.

42 ENGINEERING↗

Laser schlieren deflectometry for temperature analysis of filamentary non-thermal atmospheric pressure plasma

The heat convection generated by micro filaments of a self-organized non-thermal atmospheric pressure plasma jet in Ar is characterized by employing laser schlieren deflectometry (LSD). It is demonstrated as a proof of principle, that the spatial and temporal changes of the refractive index n in the optical beam path related to the neutral gas temperature of the plasma jet can be monitored and evaluated simultaneously. The refraction of a laser beam in a high gradient field of n(r) with cylindrical symmetry is given for a general real refraction index profile. However, the usually applied Abel approach represents an ill-posed problem and in particular for this plasma configuration. A simple analytical model is proposed in order to minimize the statistical error. Based on that, the temperature profile, specifically the absolute temperature in the filament core, the FWHM, and the frequencies of the collective filament dynamics are obtained for non-stationary conditions. For a gas temperature of 700 K inside the filament, the presented model predicts maximum deflection angles of the laser beam of 0.3 mrad which is in accordance to the experimental results obtained with LSD. Furthermore, the experimentally obtained FWHM of the temperature profile produced by the filament at the end of capillary is (1.5 {+-} 0.2) mm, which is about 10 times wider than the visual radius of the filament. The obtained maximum temperature in the effluent is (450 {+-} 30) K and is in consistence with results of other techniques. The study demonstrates that LSD represents a useful low-cost method for monitoring the spatiotemporal behaviour of microdischarges and allows to uncover their dynamic characteristics, e.g., the temperature profile even for challenging diagnostic conditions such as moving thin discharge filaments. The method is not restricted to the miniaturized and self-organized plasma studied here. Instead, it can be readily applied to other configurations that produce measurable gradients of refractive index by local gas heating and opens new diagnostics prospects particularly for microplasmas.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

TU-AB-BRC-12: Optimized Parallel MonteCarlo Dose Calculations for Secondary MU Checks

Purpose: Secondary MU checks are an important tool used during a physics review of a treatment plan. Commercial software packages offer varying degrees of theoretical dose calculation accuracy, depending on the modality involved. Dose calculations of VMAT plans are especially prone to error due to the large approximations involved. Monte Carlo (MC) methods are not commonly used due to their long run times. We investigated two methods to increase the computational efficiency of MC dose simulations with the BEAMnrc code. Distributed computing resources, along with optimized code compilation, will allow for accurate and efficient VMAT dose calculations. Methods: The BEAMnrc package was installed on a high performance computing cluster accessible to our clinic. MATLAB and PYTHON scripts were developed to convert a clinical VMAT DICOM plan into BEAMnrc input files. The BEAMnrc installation was optimized by running the VMAT simulations through profiling tools which indicated the behavior of the constituent routines in the code, e.g. the bremsstrahlung splitting routine, and the specified random number generator. This information aided in determining the most efficient compiling parallel configuration for the specific CPU’s available on our cluster, resulting in the fastest VMAT simulation times. Our method was evaluated with calculations involving 10{sup 8} – 10{sup 9} particle histories which are sufficient to verify patient dose using VMAT. Results: Parallelization allowed the calculation of patient dose on the order of 10 – 15 hours with 100 parallel jobs. Due to the compiler optimization process, further speed increases of 23% were achieved when compared with the open-source compiler BEAMnrc packages. Conclusion: Analysis of the BEAMnrc code allowed us to optimize the compiler configuration for VMAT dose calculations. In future work, the optimized MC code, in conjunction with the parallel processing capabilities of BEAMnrc, will be applied to provide accurate and efficient secondary MU checks.

60 APPLIED LIFE SCIENCES↗

Calculating Control Rod Differential Worth Using Adjoint-Weighted Method

Recently, there are more and more research on using Monte Carlo method to calculate reactor important parameters. Control rod worth is one of the important parameters as it can determine the critical control rod position. There are two presentations of the control rod worth for utilization purpose, integral and differential. The former is the total reactivity change, while the latter is the reactivity change caused by per unit movement. In Monte Carlo calculation, differential control rod worth of a particular position is estimated by finite difference of reactivity between a small gap divided by gap distance. Though easy to implemented, the problem of this approach lies in that too large gap will enlarge error between 'differential' and 'difference', while too small gap will be disturbed by error caused by random fluctuation. Monte Carlo perturbation theory has been used to calculate the k{sub eff} sensitivity to certain parameters for a long time. By calculating the differential coefficient along with the k{sub eff}, this method is quite time-consuming and relatively accurate compared to finite difference method. Nevertheless, most of perturbation research focus on the perturbation of nuclide density or nuclear data. For geometrical perturbation, limited research was done before. Takahashi estimated the k{sub eff} sensitivity to reflector movement of pulsed fast reactor. MCNP6 used adjoint-weighted method for Godiva, Zeus and uranium oxyfluoride solution container benchmarks. This paper tries to apply the perturbation method to the determination of control rod differential worth. In this paper, based on RMC, a continuous-energy Reactor Monte Carlo transport code, Iterated Fission Probability method (IFP) is researched to calculate control rod differential worth on assembly level. IFP was originally developed by Hurwitz, and has been adopted by most of Monte Carlo code to compute adjoint-weighted parameters. This paper is organized with four parts. The first is introduction. Adjoint-weighted method is introduced in the second part. Problem 4 of benchmark from CASL is built to verify the method. Conclusion is given in final part.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Adaptive immersed isogeometric level-set topology optimization

Here, this paper presents for the first time an adaptive immersed approach for level-set topology optimization using higher-order truncated hierarchical B-spline discretizations for design and state variable fields. Boundaries and interfaces are represented implicitly by the iso-contour of one or multiple level-set functions. An immersed finite element method, the eXtended IsoGeometric Analysis, is used to predict the physical response. The proposed optimization framework affords different adaptively refined higher-order B-spline discretizations for individual design and state variable fields. The increased continuity of higher-order B-spline discretizations together with local refinement enables direct control over the accuracy of the representation of each field while simultaneously reducing computational cost compared to uniformly refined discretizations. A flexible mesh adaptation strategy enables local refinement based on geometric measures or physics-based error indicators. These adaptive discretization and analysis approaches are integrated into gradient-based optimization schemes, evaluating the design sensitivities using the adjoint method. Numerical studies illustrate the features of the proposed framework with static, linear elastic, multi-material, two- and three-dimensional problems. The examples provide insight into the effect of refining the design variable field on the optimization result and the convergence rate of the optimization process. Using coarse higher-order B-spline discretizations for level-set fields promotes the development of smooth designs and suppresses the emergence of small features. Moreover, adaptive mesh refinement for state variable fields results in a reduction of overall computational cost. Higher-order B-spline discretizations are especially interesting when evaluating gradients of state variable fields due to their higher inter-element continuity.

36 MATERIALS SCIENCE↗

Being WISE II: reducing the influence of star formation history on the mass-to-light ratio of quiescent galaxies

Stellar population synthesis models can now reproduce the photometry of old stellar systems (age > 2 Gyr) in the near-infrared (NIR) bands at 3.4 and 4.6 μm (WISE W1 and W2 or IRAC 1 and 2). In this paper, we derive stellar mass-to-light ratios for these and optical bands, and confirm that the NIR M/L shows dramatically reduced sensitivity to both age and metallicity compared to optical bands, and further, that this behavior leads to significantly more robust stellar masses for quiescent galaxies with [Fe/H] ≳ −0.5 regardless of star-formation history (SFH). We then use realistic early-type galaxy SFHs and metallicity distributions from the EAGLE simulations of galaxy formation to investigate two methods to determine the appropriate M/L for a galaxy. (1) We show that the uncertainties introduced by an unknown SFH can be largely removed using a spectroscopically inferred luminosity-weighted age and metallicity for the population to select the appropriate single stellar population (SSP) equivalent M/L. Using this method, the maximum systematic error due to SFH on the M/L of an early-type galaxy is <4% at 3.4 μm and typical uncertainties due to errors in the age and metallicity create a scatter of ≲13%. The equivalent values for optical bands are more than two to three times greater, even before considering uncertainties associated with internal dust extinction. (2) We demonstrate that if the EAGLE SFHs and metallicities accurately reproduce the true properties of early-type galaxies, the use of an iterative approach to select a mass dependent M/L can provide even more accurate stellar masses for early-type galaxies, with typical uncertainties of <9%.

79 ASTRONOMY AND ASTROPHYSICS↗

An Evaluation of Aircraft Emissions Inventory Methodology by Comparisons with Reported Airline Data

This report provides results of work done to evaluate the calculation methodology used in generating aircraft emissions inventories. Results from the inventory calculation methodology are compared to actual fuel consumption data. Results are also presented that show the sensitivity of calculated emissions to aircraft payload factors. Comparisons of departures made, ground track miles flown and total fuel consumed by selected air carriers were made between U.S. Dept. of Transportation (DOT) Form 41 data reported for 1992 and results of simplified aircraft emissions inventory calculations. These comparisons provide an indication of the magnitude of error that may be present in aircraft emissions inventories. To determine some of the factors responsible for the errors quantified in the DOT Form 41 analysis, a comparative study of in-flight fuel flow data for a specific operator's 747-400 fleet was conducted. Fuel consumption differences between the studied aircraft and the inventory calculation results may be attributable to several factors. Among these are longer flight times, greater actual aircraft weight and performance deterioration effects for the in-service aircraft. Results of a parametric study on the variation in fuel use and NOx emissions as a function of aircraft payload for different aircraft types are also presented.

Daggett, D. L.↗

Coupled Stochastic Time-Inverted Lagrangian Transport/Weather Forecast and Research/Vegetation Photosynthesis and Respiration Model: Simulations of Tower-Based and Airborne CO2 Measurements - Part II

This paper evaluates simulations of atmospheric CO2 measured in 2004 at continental surface and airborne receptors, intended to test the capability to use data with high temporal and spatial resolution for analyses of carbon sources and sinks at regional and continental scales. The simulations were performed using the Stochastic Time-Inverted Lagrangian Transport (STILT) model driven by the Weather Forecast and Research (WRF) model, and linked to surface fluxes from the satellite-driven Vegetation Photosynthesis and Respiration Model (VPRM). The simulations provide detailed representations of hourly CO2 tower data and reproduce the shapes of airborne vertical profiles with high fidelity. WRF meteorology gives superior model performance compared with standard meteorological products, and the impact of including WRF convective mass fluxes in the STILT trajectory calculations is significant in individual cases. Important biases in the simulation are associated with the nighttime CO2 build-up and subsequent morning transition to convective conditions, and with errors in the advected lateral boundary condition. Comparison of STILT simulations driven by the WRF model against those driven by the Brazilian variant of the Regional Atmospheric Modeling System (BRAMS) shows that model-to-model differences are smaller than between an individual transport model and observations, pointing to systematic errors in the simulated transport. Future developments in the WRF model s data assimilation capabilities, basic research into the fundamental aspects of trajectory calculations, and intercomparison studies involving other transport models, are possible venues for reducing these errors. Overall, the STILT/WRF/VPRM offers a powerful tool for continental and regional scale carbon flux estimates.

Eluszkiewicz, Janusz↗

Assessment of Evolving TRMM-Based Real-Time Precipitation Estimation Methods and Their Impacts on Hydrologic Prediction in a High-Latitude Basin

The real-time availability of satellite-derived precipitation estimates provides hydrologists an opportunity to improve current hydrologic prediction capability for medium to large river basins. Due to the availability of new satellite data and upgrades to the precipitation algorithms, the Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis real-time estimates (TMPA-RT) have been undergoing several important revisions over the past ten years. In this study, the changes of the relative accuracy and hydrologic potential of TMPA-RT estimates over its three major evolving periods were evaluated and inter-compared at daily, monthly and seasonal scales in the high-latitude Laohahe basin in China. Assessment results show that the performance of TMPA-RT in terms of precipitation estimation and streamflow simulation was significantly improved after 3 February 2005. Overestimation during winter months was noteworthy and consistent, which is suggested to be a consequence from interference of snow cover to the passive microwave retrievals. Rainfall estimated by the new version 6 of TMPA-RT starting from 1 October 2008 to present has higher correlations with independent gauge observations and tends to perform better in detecting rain compared to the prior periods, although it suffers larger mean error and relative bias. After a simple bias correction, this latest dataset of TMPA-RT exhibited the best capability in capturing hydrologic response among the three tested periods. In summary, this study demonstrated that there is an increasing potential in the use of TMPA-RT in hydrologic streamflow simulations over its three algorithm upgrade periods, but still with significant challenges during the winter snowing events.

hydrologic prediction↗

Controlling Structural, Electronic, and Energy Flow Dynamics of Catalytic Processes through Tailored Nanostructures

MoS 2 (molybdenum disulfide) is a highly-versatile catalyst material for support of numerous reactions from hydrodesulfurization and denitrogenation to the focus of this renewal proposal: hydrogenation of CO/CO 2 towards (higher) alcohols. At the same time, MoS 2 is a non-toxic, environmentally-benign and rather inert material- which under ambient conditions for some time has served as a lubricant and, more recently, as next-generation electronic material. The apparent contrast between inertness and stability in ambient, and catalytic activity under reactive conditions is puzzling and calls for a synergistic theoretical and experimental investigation with the long-term objective of enabling the rational design of MoS 2 -based catalysts for alcohol-formation reactions by providing a microscopic understanding of the environmental factors that determines site activity and selectivity. Our research project seeks answers to the questions (a) what conformation does MoS 2 adopt under reaction conditions (as opposed to that under ultrahigh vacuum and low temperatures)?; (b) what reaction pathways exist on such a material?; (c) how can the local environment of the active sites be manipulated so as to make MoS 2 an efficient catalyst for production of higher alcohol from syngas? In particular, research strategies will explore how the basal plane composed of sulfur atoms can be activated so as to exhibit a reactivity of its own, by addressing three research targets and building on extensive preliminary and enabling work: (1) vacancies and vacancy aggregates on the basal plane; (2) non-local catalyst transformation through alkali doping, hydrogenation and phase transition; (3) fabrication of a metal-nanoparticle-activated MoS 2 system, in which particle anchoring, reactive sites and pathways as well as selectivity are controlled by design, as an example of predictive development of a catalyst material,. All strategies are directed to improve the efficacy of the key reactive sites and selectivity of chemical pathways by design, to replace the inefficient methodology of trial and error in catalyst development. This research project represents a synergistic combination of computational guidance, foundational surface-science-based experiments and validation under reactive conditions that aims at transformative new insights into the working of MoS 2 -based hydrogenation-catalysts, a topic squarely at the center of the interest of DOE BES. Guided and led by Talat Rahman, a computational physicist, this project will apply density functional theory to understand structure, reaction pathways and chemical potentials associated with MoS 2 -based CO/CO 2 hydrogenation, augmented by kinetic Monte Carlo methods for reaction rates and prefactors as well as ab-initio molecular dynamics for evaluation of thermal stability. Complementary experimental input and validation will originate from co-PI Ludwig Bartels, a physical chemist and materials scientist, whose group focuses on local imaging and preparation of MoS 2 materials, from co-PI Peter Dowben, an experimental physicist, whose group is expert in the spectroscopy of occupied and unoccupied electronic states, and from senior collaborator Michael White of Brookhaven National Laboratory, whose group generates high-resolution electronic and activity information on size-selected well-defined metal chalcogenide clusters. This collaborative effort will enable a comprehensive understanding of the correlation of structural integrity and catalytic activity of MoS 2 in forms ranging from extended films to individual particles with known geometries and binding sites. Alcohol formation from syngas is a rapidly emerging application that has great potential through facile, economic, and decentralized biomass gasification. CO 2 activation is one of the most pressing concerns of our time: increasing CO 2 levels in the atmosphere change the climate and expose the globe to environmental transformations with the potential for enormous economic and societal impact. We will investigate CO/CO 2 hydrogenation via an interdisciplinary research collaboration with established synergy – one that, in accordance with the mission of the DOE, involves accredited Hispanic-Serving Institutions and that, through student exchange with international collaborators and National Labs, will directly benefit a broad spectrum of communities and generate human resources in sciences essential to their future.

2D materials↗

A Refined Global Segmentation of X-Ray CT Images for Multi-phase Geomaterials

X-ray computed tomography images of three-phase silica sand and glass bead specimens are analyzed and used to evaluate the segmentation performances of Otsu-, and recursion-based multilevel algorithms. A global image segmentation technique that combines iterative and recursive algorithms, namely a refined statistics-based global segmentation is proposed for segmenting multi-phase granular geomaterials. The performance of the proposed algorithm is tested by segmenting partially saturated silica sand and glass bead specimens. For the tested silica sand specimen, the refined statistics method estimated void ratio and degree of saturation were 0.67 and 39.35%. The estimates for the glass bead specimen yielded 0.64 and 43.49%, respectively. The true void ratio (0.66) and degree of saturation (37.71%) were determined with a user-controlled Image processing software package—Image-Pro. It was found that the proposed method estimated the void ratio and the degree of saturation with 1.52 and 4.35 percent errors for the silica sand and with 15.63 and 0.34 percent errors for the glass bead, respectively. The computational time of the proposed method was found to be shorter than other methods considered. Overall, it is concluded that the proposed technique performed better in segmenting three-phase granular geomaterials.

42 ENGINEERING↗

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗

SU-E-T-434: Evaluation of the Machine Performance Check (MPC) Program for Truebeam 2.0

Purpose: Machine Performance Check (MPC) is a software application used to verify that the TrueBeam machine is operating within major specifications prior to treatment. Used in combination with a phantom named Isocal, it verifies beam output, beam uniformity, treatment isocenter size, coincidence of treatment and imaging isocenters, positioning accuracy of kV and MV imaging systems, accuracy of collimator and gantry rotation angle, positioning accuracy of jaws and MLC leafs, and couch positioning. The tests can be performed semi-automatically and requires approximately 10 minutes of machine time. It is the purpose of this study to report the performance of this program. Methods: A pre-release version of the MPC tool was installed on a Truebeam linac with 6D couch at our center. Baseline beam output measurements were taken for 5 photon beams (6–15 MV, 6 FFF, 10 FFF) and 5 electron beams (6–20 MeV). Deviations from the baseline output were subsequently recorded for several days and compared against independent measurements from a PTW farmer chamber and our daily QA device (Fluke Biomedical Tracker) as part of an ongoing evaluation. Results: The beam output deviations between the MPC and the PTW chamber measurements were within ±0.7% for photons beams and ±1.0% for electrons beams. This was similar to the tracker performance. There were some isolated incidents where the MPC measurements had unexplained spikes (>3%) that disappeared on a repeat measurement. MPC was also able to detect maximum positioning errors in the jaws (1.12 mm), MLCs (1.14 mm), and couch roll (0.11°). Conclusion: Overall, the ability of the MPC to monitor linac output stability was comparable to that of ionization chamber-based measurements. MPC also provided fast daily mechanical tests not currently available in the clinic. How best to utilize this previously unavailable data is still under investigation.

07 ISOTOPE AND RADIATION SOURCES↗

Reply to Comment by Laprise on 'the Added Value to Global Model Projections of Climate Change by Dynamical Downscaling: a Case Study over the Continental U.S. Using the GISS-ModelE2 and WRF Models'

In his comment, Laprise raises several points that we agree merit consideration. His primary critique is that our study [Racherla et al., 2012] tested the ability of the WRF regional climate model to reproduce historical temperature and precipitation change relative to the driving global climate model (GCM) using only a single simulation rather than an ensemble. He asserts that the observed changes are smaller than the internal variability in the climate system (i.e., not statistically significant) and that thus a single simulation should not necessarily be able to capture the observations. Laprise points out that the statistical signal is reduced for a multi-decadal trend such as the one we analyzed in comparison with mean climatology and cites two studies showing that for particular climate parameters it can take any years for a signal to be discerned over internal variability. He states that The results of theexperiment as designed were strongly influenced by the presence of internal variability and sampling errors,which masked the rather small climate changes that may have occurred as a consequence of changes inforcing during the period considered. While Laprise discusses statistics in general terms at some length, for the actual climate trends examined in our study, he offers no evidence that the forced signal was smallcompared with internal variability. The two studies he cites [de Ela et al., 2013; Maraun, 2013] do not provide convincing evidence as they concern climate variables averaged over different times and areas. One in fact examines extreme precipitation events, which by definition are rare and thus have a lower significance level. We accept the general point that it is important to consider internal variability, and as noted in our paper we agree that an ensemble of simulations is in principle an optimal, though computationally expensive, approach. While we did not present the statistical significance of the observations in our original paper, we have now evaluated those for the regional temperature trends used in our study to evaluate the added value of WRF and thus can analyze data as to the magnitude of the trends with respect to internal variability.

climate↗