Search NASA⌕ Search

SEARCH · Search NASA

Results for “QA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

SU-F-T-275: A Correlation Study On 3D Fluence-Based QA and 2D Dose Measurement-Based QA

Purpose: The aim of this paper was to demonstrate the feasibility and creditability of computing and verifying 3D fluencies to assure IMRT and VMAT treatment deliveries, by correlating the passing rates of the 3D fluence-based QA (P(ά)) to the passing rates of 2D dose measurementbased QA (P(Dm)). Methods: 3D volumetric primary fluencies are calculated by forward-projecting the beam apertures and modulated by beam MU values at all gantry angles. We first introduce simulated machine parameter errors (MU, MLC positions, jaw, gantry and collimator) to the plan. Using passing rates of voxel intensity differences (P(Ir)) and 3D gamma analysis (P(γ)), calculated 3D fluencies, calculated 3D delivered dose, and measured 2D planar dose in phantom from the original plan are then compared with those from corresponding plans with errors, respectively. The correlations of these three groups of resultant passing rates, i.e. 3D fluence-based QA (P(ά,Ir) and P(ά,γ)), calculated 3D dose (P(Dc,Ir) and P(Dc,γ)), and 2D dose measurement-based QA (P(Dm,Ir) and P(Dm,γ)), will be investigated. Results: 20 treatment plans with 5 different types of errors were tested. Spearman’s correlations were found between P(ά,Ir) and P(Dc,Ir), and also between P(ά,γ) and P(Dc,γ), with averaged p-value 0.037, 0.065, and averaged correlation coefficient ρ-value 0.942, 0.871 respectively. Using Matrixx QA for IMRT plans, Spearman’s correlations were also obtained between P(ά,Ir) and P(Dm,Ir) and also between P(ά,γ) and P(Dm,γ), with p-value being 0.048, 0.071 and ρ-value being 0.897, 0.779 respectively. Conclusion: The demonstrated correlations improve the creditability of using 3D fluence-based QA for assuring treatment deliveries for IMRT/VMAT plans. Together with advantages of high detection sensitivity and better visualization of machine parameter errors, this study further demonstrates the accuracy and feasibility of 3D fluence based-QA in pre-treatment QA and daily QA. Research reported in this study is supported by the Agency for Healthcare Research and Quality (AHRQ) under award 1R01HS0222888. The senior author received research grants from ViewRay Inc. and Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Crystal structure of Qa-1 a with bound Qa-1 determinant modifier peptide

Qa-1 is a non-classical Major Histocompatibility (MHC) class I molecule that generally presents hydrophobic peptides including Qdm derived from the leader sequence of classical MHC I molecules for immune surveillance by NK cells. Qa-1 bound peptides derived from the TCR Vβ8.2 of activated T cells also activates CD8 + regulatory T cells to control autoimmunity and maintain self-tolerance. Four allotypes of Qa-1 (Qa-1 a-d ) are expressed that are highly conserved in sequence but have several variations that could affect peptide binding to Qa-1 or TCR recognition. Here, we determined the structure of Qa-1 a with bound Qdm peptide. While the overall structure is very similar to that of Qa-1 b , there are several amino acid differences around the peptide binding platform that could affect TCR recognition. Most notably, two amino acid substitutions are found in the pocket P2, which binds the anchor residue Met2 of the Qdm peptide. These residues affect both the size and shape of the binding pocket, as well as affect the charge at physiologic pH, suggesting Qa-1 a and Qa-1 b could present slightly distinct peptide reservoirs, which could presumably be recognized by different populations of CD8 + T cells.

59 BASIC BIOLOGICAL SCIENCES↗

Implementing RapidArc into clinical routine: A comprehensive program from machine QA to TPS validation and patient QA

Purpose: With the increased commercial availability of intensity modulated arc therapy (IMAT) comes the need for comprehensive QA programs, covering the different aspects of this newly available technology. This manuscript proposes such a program for the RapidArc (RA) (Varian Medical Systems, Palo Alto) IMAT solution. Methods: The program was developed and tested out for a Millennium120 MLC on iX Clinacs and a HighDefinition MLC on a Novalis TX, using a variety of measurement equipment including Gafchromic film, 2D ion chamber arrays (Seven29 and StarCheck, PTW, Freiburg, Germany) with inclinometer and Octavius phantom, the Delta4 systam (ScandiDos, Uppsala, Sweden) and the portal imager (EPID). First, a number of complementary machine QA tests were developed to monitor the correct interplay between the accelerating/decelerating gantry, the variable dose rate and the MLC position, straining the delivery to the maximum allowed limits. Second, a systematic approach to the validation of the dose calculation for RA was adopted, starting with static gantry and RA specific static MLC shapes and gradually moving to dynamic gantry, dynamic MLC shapes. RA plans were then optimized on a series of artificial structures created within the homogeneous Octavius phantom and within a heterogeneous lung phantom. These served the double purpose of testing the behavior of the optimization algorithm (PRO) as well as the precision of the forward dose calculation. Finally, patient QA on a series of clinical cases was performed with different methods. In addition to the well established in-phantom QA, we evaluated the portal dosimetry solution within the Varian approach. Results: For routine machine QA, the ''Snooker Cue'' test on the EPID proved to be the most sensitive to overall problem detection. It is also the most practical one. The ''Twinkle'' and ''Sunrise'' tests were useful to obtain well differentiated information on the individual treatment delivery components. The AAA8.9 dose calculations showed excellent agreement with all corresponding measurements, except in areas where the 2.5 mm fixed fluence resolution was insufficient to accurately model the tongue and groove effect or the dose through nearly closed opposing leafs. Such cases benefited from the increased fluence resolution in AAA10.0. In the clinical RA fields, these effects were smeared out spatially and the impact of the fluence resolution was considerably less pronounced. The RA plans on the artificial structure sets demonstrated some interesting characteristics of the PRO8.9 optimizer, such as a sometimes unexpected dependence on the collimator rotation and a suboptimal coverage of targets within lung tissue. Although the portal dosimetry was successfully validated, we are reluctant to use it as a sole means of patient QA as long as no gantry angle information is embedded. Conclusions: The all-in validation program allows a systematic approach in monitoring the different levels of RA treatments. With the systematic approach comes a better understanding of both the capabilities and the limits of the used solution. The program can be useful for implementation, but also for the validation of major upgrades.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Moving from gamma passing rates to patient DVH-based QA metrics in pretreatment dose QA

Purpose: The purpose of this work is to explore the usefulness of the gamma passing rate metric for per-patient, pretreatment dose QA and to validate a novel patient-dose/DVH-based method and its accuracy and correlation. Specifically, correlations between: (1) gamma passing rates for three 3D dosimeter detector geometries vs clinically relevant patient DVH-based metrics; (2) Gamma passing rates of whole patient dose grids vs DVH-based metrics, (3) gamma passing rates filtered by region of interest (ROI) vs DVH-based metrics, and (4) the capability of a novel software algorithm that estimates corrected patient Dose-DVH based on conventional phan-tom QA data are analyzed. Methods: Ninety six unique ''imperfect'' step-and-shoot IMRT plans were generated by applying four different types of errors on 24 clinical Head/Neck patients. The 3D patient doses as well as the dose to a cylindrical QA phantom were then recalculated using an error-free beam model to serve as a simulated measurement for comparison. Resulting deviations to the planned vs simulated measured DVH-based metrics were generated, as were gamma passing rates for a variety of difference/distance criteria covering: dose-in-phantom comparisons and dose-in-patient comparisons, with the in-patient results calculated both over the whole grid and per-ROI volume. Finally, patient dose and DVH were predicted using the conventional per-beam planar data as input into a commercial ''planned dose perturbation'' (PDP) algorithm, and the results of these predicted DVH-based metrics were compared to the known values. Results: A range of weak to moderate correlations were found between clinically relevant patient DVH metrics (CTV-D95, parotid D{sub mean}, spinal cord D1cc, and larynx D{sub mean}) and both 3D detector and 3D patient gamma passing rate (3%/3 mm, 2%/2 mm) for dose-in-phantom along with dose-in-patient for both whole patient volume and filtered per-ROI. There was considerable scatter in the gamma passing rate vs DVH-based metric curves. However, for the same input data, the PDP estimates were in agreement with actual patient DVH results. Conclusions: Gamma passing rate, even if calculated based on patient dose grids, has generally weak correlation to critical patient DVH errors. However, the PDP algorithm was shown to accurately predict the DVH impact using conventional planar QA results. Using patient-DVH-based metrics IMRT QA allows per-patient dose QA to be based on metrics that are both sensitive and specific. Further studies are now required to analyze new processes and action levels associated with DVH-based metrics to ensure effectiveness and practicality in the clinical setting.

61 RADIATION PROTECTION AND DOSIMETRY↗

MO-A-16A-01: QA Procedures and Metrics: In Search of QA Usability

Radiation therapy has undergone considerable changes in the past two decades with a surge of new technology and treatment delivery methods. The complexity of radiation therapy treatments has increased and there has been increased awareness and publicity about the associated risks. In response, there has been proliferation of guidelines for medical physicists to adopt to ensure that treatments are delivered safely. Task Group recommendations are copious, and clinical physicists' hours are longer, stretched to various degrees between site planning and management, IT support, physics QA, and treatment planning responsibilities.Radiation oncology has many quality control practices in place to ensure the delivery of high-quality, safe treatments. Incident reporting systems have been developed to collect statistics about near miss events at many radiation oncology centers. However, tools are lacking to assess the impact of these various control measures. A recent effort to address this shortcoming is the work of Ford et al (2012) who recently published a methodology enumerating quality control quantification for measuring the effectiveness of safety barriers. Over 4000 near-miss incidents reported from 2 academic radiation oncology clinics were analyzed using quality control quantification, and a profile of the most effective quality control measures (metrics) was identified.There is a critical need to identify a QA metric to help the busy clinical physicists to focus their limited time and resources most effectively in order to minimize or eliminate errors in the radiation treatment delivery processes. In this symposium the usefulness of workflows and QA metrics to assure safe and high quality patient care will be explored.Two presentations will be given:Quality Metrics and Risk Management with High Risk Radiation Oncology ProceduresStrategies and metrics for quality management in the TG-100 Era Learning Objectives: Provide an overview and the need for QA usability metrics: Different cultures/practices affecting the effectiveness of methods and metrics. Show examples of quality assurance workflows, Statistical process control, that monitor the treatment planning and delivery process to identify errors. To learn to identify and prioritize risks and QA procedures in radiation oncology. Try to answer the question: Can a quality assurance program aided by quality assurance metrics help minimize errors and ensure safe treatment delivery. Should such metrics be institution specific.

07 ISOTOPE AND RADIATION SOURCES↗

SU-E-T-441: Gamma Passing Rates for IMRT QA and VMAT QA

Purpose: This study compares gamma passing rates for a cohort of similar intensity modulated radiotherapy (IMRT) and volumetric modulated arc therapy (VMAT) quality assurance (QA) plans to determine the equivalence of the patient specific QA plan delivery. The passing criterion is 90% gamma index with 3% dose difference (DD), 3mm distance-to-agreement (DTA) and a dose threshold of 10%. Methods: Gamma passing results of previously treated IMRT QA plans, delivered to Sun Nuclear MapCheck phantom, and VMAT QA plans, delivered to ScandiDos Delta4 phantom, are organized by anatomical site and treatment machine. Both Varian and Elekta machines are included. Pairs of IMRT and VMAT plans are matched based on site, machine, and PTV volume to ensure similar plan cohorts. A two-tailed t-test analysis of the data with an alpha of 0.05 determines if there exists a statistically significant difference. Power was calculated to detect a difference of 4%; all data sets were strong with above a 0.8 power. Results: The first data set consisting of 20 matched pairs of prostate plans was statistically insignificant (p-value=0.90, Power=0.99). The 14 matched pairs set of head and neck plans has a statistically significant Result (p-value=0.028, Power=0.88). The head and neck IMRT gamma indexes have a mean of 93.1% and range of 82%-100% while the VMAT gamma indexes have a mean of 96.7% and range of 92%-100%. The two combined data sets of matched plans had a statistically insignificant Result (p-value=0.073, Power=0.99). Conclusion: Overall, IMRT and VMAT have equivalent passing rates when comparing the gamma analysis using a passing criterion of 3% DD and 3mm DTA. When separated by site, prostate IMRT and VMAT plans have equivalent passing rates while head and neck plans have a statistically significant variation of passing rates. The passing rates for the two modalities are independent of delivery machine for matched PTV target volumes.

60 APPLIED LIFE SCIENCES↗

SU-F-T-287: A Preliminary Study On Patient Specific VMAT Verification Using a Phosphor-Screen Based Geometric QA System (Raven QA)

Purpose: The RavenQA system (LAP Laser, Germany) is a QA device with a phosphor screen detector for performing the QA tasks of TG-142. This study tested if it is feasible to use the system for the patient specific QA of the Volumetric Modulated Arc Therapy (VMAT). Methods: Water equivalent material (5cm) is attached to the front of the detector plate of the RavenQA for dosimetry purpose. Then the plate is attached to the gantry to synchronize the movement between the detector and the gantry. Since the detector moves together with gantry, The ’Reset gantry to 0’ function of the Eclipse planning system (Varian, CA) is used to simulate the measurement situation when calculating dose of the detector plate. The same gantry setup is used when delivering the treatment beam for feasibility test purposes. Cumulative dose is acquired for each arc. The optical scatter component of each captured image from the CCD camera is corrected by deconvolving the 2D spatial invariant optical scatter kernel (OSK). We assume that the OSK is a 2D isotropic point spread function with inverse-squared decrease as a function of radius from the center. Results: Three cases of VMAT plans including head & neck, whole pelvis and abdomen-pelvis are tested. Setup time for measurements was less than 5 minutes. Passing rates of absolute gamma were 99.3, 98.2, 95.9 respectively for 3%/3mm criteria and 96.2, 97.1, 86.4 for 2%/2mm criteria. The abdomen-pelvis field has long treatment fields, 37cm, which are longer than the detector plate (25cm). This plan showed relatively lower passing rate than other plans. Conclusion: An algorithm for IMRT/VMAT verification using the RavenQA has been developed and tested. The model of spatially invariant OSK works well for deconvolution purpose. It is proved that the RavenQA can be used for the patient specific verification of VMAT. This work is funded in part by a Maryland Industrial Partnership Program grant to University of Maryland and to JPLC who owns the Raven technology. John Wong is a co-founder of JPLC.

60 APPLIED LIFE SCIENCES↗

Review of the Constellation Level II Safety, Reliability, and Quality Assurance (SR&QA) Requirements Documents during Participation in the Constellation Level II SR&QA Forum

At the request of the Exploration Systems Mission Directorate (ESMD) and the Constellation Program (CxP) Safety, Reliability; and Quality Assurance (SR&QA) Requirements Director, the NASA Engineering and Safety Center (NESC) participated in the Cx SR&QA Requirements forum. The Requirements Forum was held June 24-26; 2008, at GRC's Plum Brook Facility. The forums purpose was to gather all stakeholders into a focused meeting to help complete the process of refining the CxP to refine its Level II SR&QA requirements or defining project-specific requirements tailoring. Element prime contractors had raised specific questions about the wording and intent of many requirements in areas they felt were driving costs without adding commensurate value. NESC was asked to provide an independent and thorough review of requirements that contractors believed were driving Program costs, by active participation in the forum. This document contains information from the forum.

Cameron, Kenneth D.↗

Biological consequences of MLC calibration errors in IMRT delivery and QA

Purpose: The purpose of this work is threefold: (1) to explore biological consequences of the multileaf collimator (MLC) calibration errors in intensity modulated radiotherapy (IMRT) of prostate and head and neck cancers, (2) to determine levels of planning target volume (PTV) and normal tissue under- or overdose flagged with clinically used QA action limits, and (3) to provide biologically based input for MLC QA and IMRT QA action limits. Methods: Ten consecutive prostate IMRT cases and ten consecutive head and neck IMRT cases were used. Systematic MLC offsets (i.e., calibration error) were introduced for each control point of the plan separately for X1 and X2 leaf banks. Offsets were from - 2 to 2 mm with a 0.5 mm increment. The modified files were imported into the planning system for forward dose recalculation. The original plan served as the reference. The generalized equivalent uniform dose (gEUD) was used as the biological index for the targets, rectum, parotid glands, brainstem, and spinal cord. Each plan was recalculated on a CT scan of a 27 cm diameter cylindrical phantom with a contoured 0.6 cc ion chamber. Dose to ion chamber and 3D gamma analysis were compared to the reference plan. QA pass criteria: (1) at least 95% of voxels with a dose cutoff of 50% of maximum dose have to pass at 3 mm/3% and (2) dose to chamber within 2% of the reference dose. Results: For prostate cases, differences in PTV and rectum gEUD greater than 2% were identified. However, a larger proportion of plans leading to greater than 2% difference in prostate PTV gEUD passed the ion chamber QA but not 3D gamma QA. A similar trend was found for the rectum gEUD. For head and neck IMRT, the QA pass criteria flagged plans leading to greater than 4% differences in PTV gEUD and greater than 5% differences in the maximum dose to brainstem. If pass criteria were relaxed to 90% for gamma and 3% for ion chamber QA, plans leading to a 5% difference in PTV gEUD and a 5%-8% difference in brainstem maximum dose would likely pass IMRT QA. A larger proportion of head and neck plans with greater than 2% PTV gEUD difference passed 3D gamma QA compared to ion chamber QA. Conclusions: For low modulation plans, there is a better chance to catch MLC calibration errors with 3D gamma QA rather than ion chamber QA. Conversely, for high modulation plans, there is a better chance to catch MLC calibration errors with ion chamber QA rather than with 3D gamma QA. Ion chamber and 3D gamma analysis IMRT QA can detect greater than 2% change in gEUD for PTVs and critical structures for low modulation treatment plans. For high modulation treatment plans, ion chamber and 3D gamma analysis can detect greater than 2% change in gEUD for PTVs and a 5% change in critical structure gEUD since either QA methods passes the QA criteria. For gEUD changes less than those listed above, either QA method has the same proportion of passing rate.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

WE-AB-201-00: Treatment Planning System Commissioning and QA

Treatment planning systems (TPS) are a cornerstone of modern radiation therapy. Errors in their commissioning or use can have a devastating impact on many patients. To support safe and high quality care, medical physicists must conduct efficient and proper commissioning, good clinical integration, and ongoing quality assurance (QA) of the TPS. AAPM Task Group 53 and related publications have served as seminal benchmarks for TPS commissioning and QA over the past two decades. Over the same time, continuing innovations have made the TPS even more complex and more central to the clinical process. Medical goals are now expressed in terms of the dose and margins around organs and tissues that are delineated from multiple imaging modalities (CT, MR and PET); and even temporally resolved (i.e., 4D) imaging. This information is passed on to optimization algorithms to establish accelerator movements that are programmed directly for IMRT, VMAT and stereotactic treatments. These advances have made commissioning and QA of the TPS much more challenging. This education session reviews up-to-date experience and guidance on this subject; including the recently published AAPM Medical Physics Practice Guideline (MPPG) #5 “Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams”. Treatment Planning System Commissioning and QA: Challenges and Opportunities (Greg Salomons) This session will provide some key background and review publications describing prominent incidents relating to TPS commissioning and QA. Traditional approaches have been hardware and feature oriented. They aim to establish a functional configuration and establish specifications for regular testing of features (like dose calculation) to assure stable operation and detect failures. With the advent of more complex systems, more patient-specific testing has also been adopted. A number of actual TPS defects will be presented along with heuristics for identifying similar defects in the future. Finally, the Gamma test has become a popular metric for reporting TPS Commissioning and QA results. It simplifies complex testing into a numerical index, but noisy data and casual application can make it misleading. A brief review of the issues around the use of the Gamma test will be presented. TPS commissioning and QA: A process orientation and application of control charts (Michael Sharpe) A framework for commissioning a treatment planning system will be presented, focusing on preparations, practical aspects of configuration, priorities, specifications, and establishing performance. The complexity of the modern TPS make modular testing of features inadequate, and modern QA tools can provide “too much information” about the performance of techniques like IMRT and VMAT. We have adopted a process orientation and quality tools, like control charts, for ongoing TPS QA and assessment of patient-specific tests. The trending nature of these tools reveals the overall performance of the TPS system, and quantifies the variations that arise from individual plans, discrete calculations, and experimentation based on discrete measurements. Examples demonstrating application of these tools to TPS QA will be presented. TPS commissioning and QA: Incorporating the entire planning process (Sasa Mutic) The TPS and its features do not perform in isolation. Instead, the features and modules are key components in a complex process that begins with CT Simulation and extends to treatment delivery, along with image guidance and verification. Most importantly, the TPS is used by people working in a multi-disciplinary environment. It is very difficult to predict the outcomes of human interactions with software. Therefore, an interdisciplinary approach to training, commissioning and QA will be presented, along with an approach to the physics chart check and end-to-end testing as a tool for TPS QA. The role of standardization and automation in QA will also be discussed. The recommendations of MPPG #5 and practical implementation strategies (Jennifer Smilowitz) The recently published recommendations from Task Group No. 244, Medical Physics Practice Guideline on Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams will be presented. The recommendations focus on the validation of commissioning data and dose calculations. Tolerance values for non-IMRT beam configurations are summarized based on established criteria and data collected by the IROC. More stringent evaluation criteria for IMRT dose calculations are suggested to test the limitations of the TPS dose algorithms for advanced delivery conditions. The MPPG encourages users to create a suite of validation tests for dose calculation for various conditions for static photon beams, heterogeneities, IMRT/VMAT and electron beams. This test suite is intended to be used for subsequent testing, including TPS software upgrades. In the past, the recommendations of some reports have not been widely implemented due to practical limitations. Implementation strategies, tools and processes developed by multiple centers for efficient and “do-able” MPPG # 5 testing will be presented, as well as a discussion on the overall validation experience. Learning Objectives: Identify some of the key documents relevant for TPS commissioning and QA Understand strategies for testing TPS software Gain a practical knowledge of the Gamma test criteria Increase familiarity with the process of commissioning a TPS Learn about the use of Control Charts for TPS QA Review the role of the TPS in the overall planning process Increase awareness of the link between TPS QA and chart checking Gain an increased appreciation for the importance of interdisciplinary communication Understand the new recommendations from MPPG #5 on TPS Dose Algorithm Commissioning and QC/QA Learn practical implementation processes and tools for MPPG #5 validation recommendations.

60 APPLIED LIFE SCIENCES↗

WE-AB-201-01: Treatment Planning System Commissioning and QA: Challenges and Opportunities

Treatment planning systems (TPS) are a cornerstone of modern radiation therapy. Errors in their commissioning or use can have a devastating impact on many patients. To support safe and high quality care, medical physicists must conduct efficient and proper commissioning, good clinical integration, and ongoing quality assurance (QA) of the TPS. AAPM Task Group 53 and related publications have served as seminal benchmarks for TPS commissioning and QA over the past two decades. Over the same time, continuing innovations have made the TPS even more complex and more central to the clinical process. Medical goals are now expressed in terms of the dose and margins around organs and tissues that are delineated from multiple imaging modalities (CT, MR and PET); and even temporally resolved (i.e., 4D) imaging. This information is passed on to optimization algorithms to establish accelerator movements that are programmed directly for IMRT, VMAT and stereotactic treatments. These advances have made commissioning and QA of the TPS much more challenging. This education session reviews up-to-date experience and guidance on this subject; including the recently published AAPM Medical Physics Practice Guideline (MPPG) #5 “Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams”. Treatment Planning System Commissioning and QA: Challenges and Opportunities (Greg Salomons) This session will provide some key background and review publications describing prominent incidents relating to TPS commissioning and QA. Traditional approaches have been hardware and feature oriented. They aim to establish a functional configuration and establish specifications for regular testing of features (like dose calculation) to assure stable operation and detect failures. With the advent of more complex systems, more patient-specific testing has also been adopted. A number of actual TPS defects will be presented along with heuristics for identifying similar defects in the future. Finally, the Gamma test has become a popular metric for reporting TPS Commissioning and QA results. It simplifies complex testing into a numerical index, but noisy data and casual application can make it misleading. A brief review of the issues around the use of the Gamma test will be presented. TPS commissioning and QA: A process orientation and application of control charts (Michael Sharpe) A framework for commissioning a treatment planning system will be presented, focusing on preparations, practical aspects of configuration, priorities, specifications, and establishing performance. The complexity of the modern TPS make modular testing of features inadequate, and modern QA tools can provide “too much information” about the performance of techniques like IMRT and VMAT. We have adopted a process orientation and quality tools, like control charts, for ongoing TPS QA and assessment of patient-specific tests. The trending nature of these tools reveals the overall performance of the TPS system, and quantifies the variations that arise from individual plans, discrete calculations, and experimentation based on discrete measurements. Examples demonstrating application of these tools to TPS QA will be presented. TPS commissioning and QA: Incorporating the entire planning process (Sasa Mutic) The TPS and its features do not perform in isolation. Instead, the features and modules are key components in a complex process that begins with CT Simulation and extends to treatment delivery, along with image guidance and verification. Most importantly, the TPS is used by people working in a multi-disciplinary environment. It is very difficult to predict the outcomes of human interactions with software. Therefore, an interdisciplinary approach to training, commissioning and QA will be presented, along with an approach to the physics chart check and end-to-end testing as a tool for TPS QA. The role of standardization and automation in QA will also be discussed. The recommendations of MPPG #5 and practical implementation strategies (Jennifer Smilowitz) The recently published recommendations from Task Group No. 244, Medical Physics Practice Guideline on Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams will be presented. The recommendations focus on the validation of commissioning data and dose calculations. Tolerance values for non-IMRT beam configurations are summarized based on established criteria and data collected by the IROC. More stringent evaluation criteria for IMRT dose calculations are suggested to test the limitations of the TPS dose algorithms for advanced delivery conditions. The MPPG encourages users to create a suite of validation tests for dose calculation for various conditions for static photon beams, heterogeneities, IMRT/VMAT and electron beams. This test suite is intended to be used for subsequent testing, including TPS software upgrades. In the past, the recommendations of some reports have not been widely implemented due to practical limitations. Implementation strategies, tools and processes developed by multiple centers for efficient and “do-able” MPPG #5 testing will be presented, as well as a discussion on the overall validation experience. Learning Objectives: Identify some of the key documents relevant for TPS commissioning and QA Understand strategies for testing TPS software Gain a practical knowledge of the Gamma test criteria Increase familiarity with the process of commissioning a TPS Learn about the use of Control Charts for TPS QA Review the role of the TPS in the overall planning process Increase awareness of the link between TPS QA and chart checking Gain an increased appreciation for the importance of interdisciplinary communication Understand the new recommendations from MPPG #5 on TPS Dose Algorithm Commissioning and QC/QA Learn practical implementation processes and tools for MPPG #5 validation recommendations.

60 APPLIED LIFE SCIENCES↗

WE-AB-201-02: TPS Commissioning and QA: A Process Orientation and Application of Control Charts

Treatment planning systems (TPS) are a cornerstone of modern radiation therapy. Errors in their commissioning or use can have a devastating impact on many patients. To support safe and high quality care, medical physicists must conduct efficient and proper commissioning, good clinical integration, and ongoing quality assurance (QA) of the TPS. AAPM Task Group 53 and related publications have served as seminal benchmarks for TPS commissioning and QA over the past two decades. Over the same time, continuing innovations have made the TPS even more complex and more central to the clinical process. Medical goals are now expressed in terms of the dose and margins around organs and tissues that are delineated from multiple imaging modalities (CT, MR and PET); and even temporally resolved (i.e., 4D) imaging. This information is passed on to optimization algorithms to establish accelerator movements that are programmed directly for IMRT, VMAT and stereotactic treatments. These advances have made commissioning and QA of the TPS much more challenging. This education session reviews up-to-date experience and guidance on this subject; including the recently published AAPM Medical Physics Practice Guideline (MPPG) #5 “Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams”. Treatment Planning System Commissioning and QA: Challenges and Opportunities (Greg Salomons) This session will provide some key background and review publications describing prominent incidents relating to TPS commissioning and QA. Traditional approaches have been hardware and feature oriented. They aim to establish a functional configuration and establish specifications for regular testing of features (like dose calculation) to assure stable operation and detect failures. With the advent of more complex systems, more patient-specific testing has also been adopted. A number of actual TPS defects will be presented along with heuristics for identifying similar defects in the future. Finally, the Gamma test has become a popular metric for reporting TPS Commissioning and QA results. It simplifies complex testing into a numerical index, but noisy data and casual application can make it misleading. A brief review of the issues around the use of the Gamma test will be presented. TPS commissioning and QA: A process orientation and application of control charts (Michael Sharpe) A framework for commissioning a treatment planning system will be presented, focusing on preparations, practical aspects of configuration, priorities, specifications, and establishing performance. The complexity of the modern TPS make modular testing of features inadequate, and modern QA tools can provide “too much information” about the performance of techniques like IMRT and VMAT. We have adopted a process orientation and quality tools, like control charts, for ongoing TPS QA and assessment of patient-specific tests. The trending nature of these tools reveals the overall performance of the TPS system, and quantifies the variations that arise from individual plans, discrete calculations, and experimentation based on discrete measurements. Examples demonstrating application of these tools to TPS QA will be presented. TPS commissioning and QA: Incorporating the entire planning process (Sasa Mutic) The TPS and its features do not perform in isolation. Instead, the features and modules are key components in a complex process that begins with CT Simulation and extends to treatment delivery, along with image guidance and verification. Most importantly, the TPS is used by people working in a multi-disciplinary environment. It is very difficult to predict the outcomes of human interactions with software. Therefore, an interdisciplinary approach to training, commissioning and QA will be presented, along with an approach to the physics chart check and end-to-end testing as a tool for TPS QA. The role of standardization and automation in QA will also be discussed. The recommendations of MPPG #5 and practical implementation strategies (Jennifer Smilowitz) The recently published recommendations from Task Group No. 244, Medical Physics Practice Guideline on Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams will be presented. The recommendations focus on the validation of commissioning data and dose calculations. Tolerance values for non-IMRT beam configurations are summarized based on established criteria and data collected by the IROC. More stringent evaluation criteria for IMRT dose calculations are suggested to test the limitations of the TPS dose algorithms for advanced delivery conditions. The MPPG encourages users to create a suite of validation tests for dose calculation for various conditions for static photon beams, heterogeneities, IMRT/VMAT and electron beams. This test suite is intended to be used for subsequent testing, including TPS software upgrades. In the past, the recommendations of some reports have not been widely implemented due to practical limitations. Implementation strategies, tools and processes developed by multiple centers for efficient and “do-able” MPPG #5 testing will be presented, as well as a discussion on the overall validation experience. Learning Objectives: Identify some of the key documents relevant for TPS commissioning and QA Understand strategies for testing TPS software Gain a practical knowledge of the Gamma test criteria Increase familiarity with the process of commissioning a TPS Learn about the use of Control Charts for TPS QA Review the role of the TPS in the overall planning process Increase awareness of the link between TPS QA and chart checking Gain an increased appreciation for the importance of interdisciplinary communication Understand the new recommendations from MPPG #5 on TPS Dose Algorithm Commissioning and QC/QA Learn practical implementation processes and tools for MPPG #5 validation recommendations.

60 APPLIED LIFE SCIENCES↗

WE-AB-201-03: TPS Commissioning and QA: Incorporating the Entire Planning Process

Treatment planning systems (TPS) are a cornerstone of modern radiation therapy. Errors in their commissioning or use can have a devastating impact on many patients. To support safe and high quality care, medical physicists must conduct efficient and proper commissioning, good clinical integration, and ongoing quality assurance (QA) of the TPS. AAPM Task Group 53 and related publications have served as seminal benchmarks for TPS commissioning and QA over the past two decades. Over the same time, continuing innovations have made the TPS even more complex and more central to the clinical process. Medical goals are now expressed in terms of the dose and margins around organs and tissues that are delineated from multiple imaging modalities (CT, MR and PET); and even temporally resolved (i.e., 4D) imaging. This information is passed on to optimization algorithms to establish accelerator movements that are programmed directly for IMRT, VMAT and stereotactic treatments. These advances have made commissioning and QA of the TPS much more challenging. This education session reviews up-to-date experience and guidance on this subject; including the recently published AAPM Medical Physics Practice Guideline (MPPG) #5 “Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams”. Treatment Planning System Commissioning and QA: Challenges and Opportunities (Greg Salomons) This session will provide some key background and review publications describing prominent incidents relating to TPS commissioning and QA. Traditional approaches have been hardware and feature oriented. They aim to establish a functional configuration and establish specifications for regular testing of features (like dose calculation) to assure stable operation and detect failures. With the advent of more complex systems, more patient-specific testing has also been adopted. A number of actual TPS defects will be presented along with heuristics for identifying similar defects in the future. Finally, the Gamma test has become a popular metric for reporting TPS Commissioning and QA results. It simplifies complex testing into a numerical index, but noisy data and casual application can make it misleading. A brief review of the issues around the use of the Gamma test will be presented. TPS commissioning and QA: A process orientation and application of control charts (Michael Sharpe) A framework for commissioning a treatment planning system will be presented, focusing on preparations, practical aspects of configuration, priorities, specifications, and establishing performance. The complexity of the modern TPS make modular testing of features inadequate, and modern QA tools can provide “too much information” about the performance of techniques like IMRT and VMAT. We have adopted a process orientation and quality tools, like control charts, for ongoing TPS QA and assessment of patient-specific tests. The trending nature of these tools reveals the overall performance of the TPS system, and quantifies the variations that arise from individual plans, discrete calculations, and experimentation based on discrete measurements. Examples demonstrating application of these tools to TPS QA will be presented. TPS commissioning and QA: Incorporating the entire planning process (Sasa Mutic) The TPS and its features do not perform in isolation. Instead, the features and modules are key components in a complex process that begins with CT Simulation and extends to treatment delivery, along with image guidance and verification. Most importantly, the TPS is used by people working in a multi-disciplinary environment. It is very difficult to predict the outcomes of human interactions with software. Therefore, an interdisciplinary approach to training, commissioning and QA will be presented, along with an approach to the physics chart check and end-to-end testing as a tool for TPS QA. The role of standardization and automation in QA will also be discussed. The recommendations of MPPG #5 and practical implementation strategies (Jennifer Smilowitz) The recently published recommendations from Task Group No. 244, Medical Physics Practice Guideline on Commissioning and QA of Treatment Planning Dose Calculations: Megavoltage Photon and Electron Beams will be presented. The recommendations focus on the validation of commissioning data and dose calculations. Tolerance values for non-IMRT beam configurations are summarized based on established criteria and data collected by the IROC. More stringent evaluation criteria for IMRT dose calculations are suggested to test the limitations of the TPS dose algorithms for advanced delivery conditions. The MPPG encourages users to create a suite of validation tests for dose calculation for various conditions for static photon beams, heterogeneities, IMRT/VMAT and electron beams. This test suite is intended to be used for subsequent testing, including TPS software upgrades. In the past, the recommendations of some reports have not been widely implemented due to practical limitations. Implementation strategies, tools and processes developed by multiple centers for efficient and “do-able” MPPG #5 testing will be presented, as well as a discussion on the overall validation experience. Learning Objectives: Identify some of the key documents relevant for TPS commissioning and QA Understand strategies for testing TPS software Gain a practical knowledge of the Gamma test criteria Increase familiarity with the process of commissioning a TPS Learn about the use of Control Charts for TPS QA Review the role of the TPS in the overall planning process Increase awareness of the link between TPS QA and chart checking Gain an increased appreciation for the importance of interdisciplinary communication Understand the new recommendations from MPPG #5 on TPS Dose Algorithm Commissioning and QC/QA Learn practical implementation processes and tools for MPPG #5 validation recommendations.

60 APPLIED LIFE SCIENCES↗

SU-E-T-153: Establish a Comprehensive Patient-Specific Plan QA Database for Instituitional Quality Control Program

Purpose: Since the publication of TG-119, several new treatment techniques requiring new QA devices have been implemented in the clinic. To monitor and analyze our institutional QA performance, we have created a comprehensive QA database using Research Electronic Data Capture (REDCap). The database will also assist us in creating IMRT QA Analysis practice guidelines. Methods: Since Oct. 2013, 336 patient plan QA results were entered into the database. Plan parameters such as plan ID, treatment site, technique, energy, optimization constraints, modulation factor, leaf speed, leaf opening.etc were automatically extracted from the Varian Eclipse database to allow us to refine our evaluation and analysis method. Specific QA device, LINAC-related information, and measurement and analysis results were manually entered by the QA team. IMRT plans were measured using MapCHECK2 while RapidArc plans were measured using ArcCHECK. Distance-To-Agreement 3%/3mm without global maximum normalization was used. Results: The data indicates that different treatment techniques might benefit from a different site-specific action level(AL) depending on the complexity of the plan and optimization parameter used (e.g., breast IMRT QA= 97.8% and pelvis IMRT QA=93.1%). Different QA devices may also benefit from a different AL (MapCHECK2 = 94.1% while ArcCHECK = 83.0%). The relationship between the parameters and passing rate suggests that the complexity of each plan, characterized by leaf travel, leaf opening and modulation factor, affect the passing rate significantly. The database is reviewed regularly, and any abnormal point of the QA result or a trend of lower QA passing rate on a specific LINAC is further investigated. Conclusion: Establishing a comprehensive QA database provides an overview of the quality assurance program. It not only helps in answering the question “what is a reasonable and achievable standard for each institution”, but also saves time in monitoring and investigating the daily machine and QA performance.

07 ISOTOPE AND RADIATION SOURCES↗

SU-E-T-11: A Cloud Based CT and LINAC QA Data Management System

Purpose: The current status quo of QA data management consists of a mixture of paper-based forms and spreadsheets for recording the results of daily, monthly, and yearly QA tests for both CT scanners and LINACs. Unfortunately, such systems suffer from a host of problems as, (1) records can be easily lost or destroyed, (2) data is difficult to access — one must physically hunt down records, (3) poor or no means of historical data analysis, and (4) no remote monitoring of machine performance off-site. To address these issues, a cloud based QA data management system was developed and implemented. Methods: A responsive tablet interface that optimizes clinic workflow with an easy-to-navigate interface accessible from any web browser was implemented in HTML/javascript/CSS to allow user mobility when entering QA data. Automated image QA was performed using a phantom QA kit developed in Python that is applicable to any phantom and is currently being used with the Gammex ACR, Las Vegas, Leeds, and Catphan phantoms for performing automated CT, MV, kV, and CBCT QAs, respectively. A Python based resource management system was used to distribute and manage intensive CPU tasks such as QA phantom image analysis or LaTeX-to-PDF QA report generation to independent process threads or different servers such that website performance is not affected. Results: To date the cloud QA system has performed approximately 185 QA procedures. Approximately 200 QA parameters are being actively tracked by the system on a monthly basis. Electronic access to historical QA parameter information was successful in proactively identifying a Linac CBCT scanner’s performance degradation. Conclusion: A fully comprehensive cloud based QA data management system was successfully implemented for the first time. Potential machine performance issues were proactively identified that would have been otherwise missed by a paper or spreadsheet based QA system.

60 APPLIED LIFE SCIENCES↗

SU-E-T-468: Implementation of the TG-142 QA Process for Seven Linacs with Enhanced Beam Conformance

Purpose: To develop a TG-142 compliant QA process for 7 Varian TrueBeam linear accelerators (linacs) with enhanced beam conformance and dosimetrically matched beam models. To ensure consistent performance of all 7 linacs, the QA process should include a common set of baseline values for use in routine QA on all linacs. Methods: The TG 142 report provides recommended tests, tolerances and frequencies for quality assurance of medical accelerators. Based on the guidance provided in the report, measurement tests were developed to evaluate each of the applicable parameters listed for daily, monthly and annual QA. These tests were then performed on each of our 7 new linacs as they came on line at our institution. Results: The tolerance values specified in TG-142 for each QA test are either absolute tolerances (i.e. ±2mm) or require a comparison to a baseline value. The results of our QA tests were first used to ensure that all 7 linacs were operating within the suggested tolerance values provided in TG −142 for those tests with absolute tolerances and that the performance of the linacs was adequately matched. The QA test results were then used to develop a set of common baseline values for those QA tests that require comparison to a baseline value at routine monthly and annual QA. The procedures and baseline values were incorporated into a spreadsheets for use in monthly and annual QA. Conclusion: We have developed a set of procedures for daily, monthly and annual QA of our linacs that are consistent with the TG-142 report. A common set of baseline values was developed for routine QA tests. The use of this common set of baseline values for comparison at monthly and annual QA will ensure consistent performance of all 7 linacs.

07 ISOTOPE AND RADIATION SOURCES↗