Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software Acceptance Test Plan”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Variations in the Contouring of Organs at Risk: Test Case From a Patient With Oropharyngeal Cancer

Purpose: Anatomy contouring is critical in radiation therapy. Inaccuracy and variation in defining critical volumes will affect everything downstream: treatment planning, dose-volume histogram analysis, and contour-based visual guidance used in image-guided radiation therapy. This study quantified: (1) variation in the contouring of organs at risk (OAR) in a clinical test case and (2) corresponding effects on dosimetric metrics of highly conformal plans. Methods and Materials: A common CT data set with predefined targets from a patient with oropharyngeal cancer was provided to a population of clinics, which were asked to (1) contour OARs and (2) design an intensity-modulated radiation therapy plan. Thirty-two acceptable plans were submitted as DICOM RT data sets, each generated by a different clinical team. Using those data sets, we quantified: (1) the OAR contouring variation and (2) the impact this variation has on dosimetric metrics. New technologies were employed, including a software tool to quantify three-dimensional structure comparisons. Results: There was significant interclinician variation in OAR contouring. The degree of variation is organ-dependent. We found substantial dose differences resulting strictly from contouring variation (differences ranging from -289% to 56% for mean OAR dose; -22% to 35% for maximum dose). However, there appears to be a threshold in the OAR comparison metric beyond which the dose differences stabilize. Conclusions: The effects of interclinician variation in contouring organs-at-risk in the head and neck can be large and are organ-specific. Physicians need to be aware of the effect that variation in OAR contouring can play on the final treatment plan and not restrict their focus only to the target volumes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Control of Technology Transfer at JPL

Controlled Technology: 1) Design: preliminary or critical design data, schematics, technical flow charts, SNV code/diagnostics, logic flow diagrams, wirelist, ICDs, detailed specifications or requirements. 2) Development: constraints, computations, configurations, technical analyses, acceptance criteria, anomaly resolution, detailed test plans, detailed technical proposals. 3) Production: process or how-to: assemble, operated, repair, maintain, modify. 4) Manufacturing: technical instructions, specific parts, specific materials, specific qualities, specific processes, specific flow. 5) Operations: how-to operate, contingency or standard operating plans, Ops handbooks. 6) Repair: repair instructions, troubleshooting schemes, detailed schematics. 7) Test: specific procedures, data, analysis, detailed test plan and retest plans, detailed anomaly resolutions, detailed failure causes and corrective actions, troubleshooting, trended test data, flight readiness data. 8) Maintenance: maintenance schedules and plans, methods for regular upkeep, overhaul instructions. 9) Modification: modification instructions, upgrades kit parts, including software

Jet Propulsion Laboratory (JPL)↗

Adaptive Protection and Validated Models to Enable Deployment of High Penetrations of Solar PV (PV-MOD)

The availability and validation of various PV models in commercial tools differ, with some models not yet thoroughly validated for advanced inverter functionalities and reliable performance under weak system conditions. Many existing models do not fully incorporate new inverter control functions, which can affect system stability. The increasing deployment of solar PV and other inverter-based resources (IBRs), including distributed energy resources (DERs), is influencing the reliable operation of protection schemes in distribution systems and microgrids. Emerging adaptive protection schemes (APS) offer new opportunities for protecting these systems during varying configurations and DER operating conditions, though their demonstration and validation remain limited. Adaptive protection schemes face similar challenges, as they are typically designed for specific configurations. There is a growing need for tools and methodologies to streamline the deployment of adaptive protection for safe and reliable DER integration. The project main objective was to develop and validate high-fidelity generic models of solar PV facilities for stability, protection, EMT, and QSTS analyses. This objective was achieved, and these models can now be integrated into commercial software tools, enabling utilities, vendors, and developers to study high-penetration PV systems more confidently. The project also demonstrated advanced applications of these models, including the design and deployment of adaptive protection schemes in high-penetration field applications and microgrids, supporting grid safety and reliability. Several milestones were reached by the end of the project. A sophisticated inverter test plan was developed, and inverters representative of the North American marketplace were selected. EPRI and NREL tested various inverters, conforming to IEEE standards. Improvements were made to existing generic models of IBR units, IBR plants, and aggregated feeders for various analyses. The first generic electromagnetic transient (EMT) model for a solar PV plant was developed, conforming to IEEE Std 2800™-2022 and validated against laboratory measurements of a 2.2 MVA large-scale battery energy storage system (BESS) inverter. That model was then used to produce reference responses illustrating examples of validated and verified IBR plant models that pass or fail tests for technical minimum capability and performance as specified in the IEEE standard. The developed, tested, and validated generic models can be used for transmission planning, stability assessments, expansion planning, and evaluating potential future IBR interconnection requirements. They can also support interconnection screens and conformity assessments of IBR plants, including solar PV. The project significantly contributed to the ongoing standardization and model-based representation and verification of IBR responses. The project further addressed challenges of common distribution protection schemes with increasing deployment of DER by developing, validating, and demonstrating adaptive protection schemes (APS) that can improve the reliable and safe integration of DER into distribution systems. New APS were designed using improved DER models for three common distribution systems: a radial feeder, a meshed network, and a microgrid. Modeling and hardware-in-the-loop (HIL) testing of the APS were conducted, successfully showing their effectiveness and selectivity. Proof-of-concept field demonstration was achieved for two APS, i.e., one on a radial feeder and another one in a microgrid. Field demonstration could not be achieved for the APS on a meshed network, primarily due apprehension of one utility partner and also due to limited access to the protective algorithms in the network protectors. Guidelines developed from the lessons learned in the project lay out the general process followed in the design, installation, and commissioning of APS for various distribution systems. Distribution utility partners’ apprehension about field demonstration of the new APS were addressed—with varying success—by taking a stepped risk-management approach of modeling of a wide range of sensitivities first, performing in-depth proof-of-concept testing in the laboratory including HIL next, and finally deliberately implementing and commissioning the actual protection equipment and algorithms into parts of—or in parallel operation to—the three real distribution systems. Future work should include pilot projects that further show the acceptable performance of the developed APS before these schemes be rolled out more widely. Inclusion of both utility and original equipment manufacturers (OEMs) in future projects could increase chances of successful field demonstration. Despite challenges in achieving the field demonstration goal of the project for all three APS, the research significantly contributed to the innovation of adaptive protection solutions for scalable and reliable DER integration into distribution systems. This project significantly enhances the understanding of the impact of using appropriate inverter models on distribution and transmission (T&D) systems. By addressing the limitations of existing generic models, the project introduces high-fidelity models for stability, protection, electromagnetic transient (EMT), and quasi-static time series (QSTS) analyses. These models, integrated into commercial software tools, enable utilities, vendors, and developers to confidently study high-penetration PV systems. The project also demonstrates advanced applications, including adaptive protection schemes (APS) for distribution systems and microgrids, ensuring grid safety and reliability. The technical effectiveness and economic feasibility of the methods are evident through the development and validation of sophisticated inverter test plans and the selection of representative inverters. Testing by EPRI and NREL on retail, commercial, and utility-scale inverters, conforming to IEEE standards, underscores the robustness of the models. Improvements to existing generic models for various analyses further enhance their validity and applicability. The project also identifies gaps in common distribution protection schemes and designed new APS using improved DER models, demonstrating their effectiveness through modeling and hardware-in-the-loop (HIL) testing. The project’s benefits to the public are manifold. By advancing the standardization and model-based representation of IBR response, it supports transmission planning, stability assessments, and future IBR interconnection requirements. The generic models can facilitate better communication between transmission planners and developers, supporting expected IBR plant capability and performance. Additionally, the development of APS for radial feeders, meshed networks, and microgrids supports the integration of distributed energy resources (DERs) into distribution systems, enhancing grid reliability and safety. The project’s emphasis on thorough testing and simplicity in design ensures practical and scalable solutions for DER integration.

14 SOLAR ENERGY↗

Status of the data acquisition, trigger, and slow control systems of the Mu2e experiment at Fermilab

The Mu2e experiment at the Fermilab will search for a coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10,000 over existing limits. In this work, the Mu2e Trigger and Data Acquisition System (TDAQ) uses otsdaq framework as the online Data Acquisition System (DAQ) solution. Developed at Fermilab, otsdaq integrates several framework components — an artdaq-based DAQ, an art-based event processing, and an EPICS-based detector control system (DCS), and provides a uniform multi-user interface to its components through a web browser. Data streams from the Mu2e tracker and calorimeter are handled by the artdaq-based DAQ and processed by a one-level software trigger implemented within the art framework. Events accepted by the trigger have their data combined, post-trigger, with the separately read out data from the Mu2e Cosmic Ray Veto system. Foundation of the Mu2e DCS, EPICS – an Experimental Physics and Industrial Control System – is an open-source platform for monitoring, controlling, alarming, and archiving. A prototype of the TDAQ and the DCS systems has been built and tested over the last three years at Fermilab’s Feynman Computing Center, and now the production system installation is underway. This work presents their status and focus on the installation plans and procedures for racks, workstations, network switches, gateway computers, DAQ hardware, slow controls implementation, and testing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Roadmap for NEAMS Capability Transfer

The vision of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program is to bring truly predictive modeling and simulation (M&S) capabilities to the nuclear engineering community in order to enable a new approach to the design and analysis of nuclear energy systems. From its inception, the NEAMS program has always envisioned a broad user base for its software and scientific products, including researchers within the DOE complex, nuclear industry technology developers and vendors, and operators. However activities to date have focused almost exclusively on interactions with NEAMS sponsors, who are also near-term users of NEAMS technologies. The task of the NEAMS Capability Transfer (CT) program element for FY2011 is to develop a comprehensive plan to support the program's needs for user outreach and technology transfer. In order to obtain community input to this plan, a 'NEAMS Capability Transfer Roadmapping Workshop' was held 4-5 April 2011 in Chattanooga, TN, and is summarized in this report. The 30 workshop participants represented the NEAMS program, the DOE and industrial user communities, and several outside programs. The workshop included a series of presentations providing an overview of the NEAMS program and presentations on the user outreach and technology transfer experiences of (1) The Advanced Simulation and Computing (ASC) program, (2) The Standardized Computer Analysis for Licensing Evaluation (SCALE) project, and (3) The Consortium for Advanced Simulation of Light Water Reactors (CASL), followed by discussion sessions. Based on the workshop and other discussions throughout the year, we make a number of recommendations of key areas for the NEAMS program to develop the user outreach and technology transfer activities: (1) Engage not only DOE, but also industrial users sooner and more often; (2) Engage with the Nuclear Regulatory Commission to facilitate their understanding and acceptance of NEAMS approach to predictive M&S; (3) Place requirements gathering from prospective users on a more formal footing, updating requirements on a regular basis and incorporate them into planning and execution of the project in a traceable fashion; (4) Seek out the best available data for validation purposes, and work with experimental programs to design and carry out new experiments that satisfy the need for data suitable for validation of high-fidelity M&S codes; (5) Develop and implement program-wide plans and policies for export control, licensing, and distribution of NEAMS software products; (6) Establish a program of sponsored alpha testing by experienced users in order to obtain feedback on NEAMS codes; (7) Provide technical support for NEAMS software products; (8) Develop and deliver documentation, tutorial materials, and live training classes; and (9) Be prepared to support outside users who wish to contribute to the codes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Verification of the DIF3D Software to Support Fast Reactor Analysis

Ongoing design activities at Argonne National Laboratory are requiring a thorough verification of the Argonne Reactor Computation codes be performed. DIF3D is central to this system. The driver for this effort requires the 3D Cartesian, triangular-Z, and hexagonal-Z core geometry options of DIF3D be verified. Previous work identified the DIF3D features required to be verified to support current design activities, features of which are generally applicable to hexagonal-Z fast reactor designs. The scope of this verification effort includes verifying DIF3D’s ability to correctly translate the user’s model in to DIF3D’s preferred format, verifying that options planned for use have the desired effect, and verifying the correctness of the eigenvalue, fixed-source, forward, and adjoint solvers in DIF3D-FD and DIF3D-VARIANT. This manuscript provides the verification tasks and their results with respect to the features needed for current design activities. Since analytic solutions of the neutron diffusion and transport equations are either limited in scope or not possible, multiple tiers of problems unique to each solver and geometry type were implemented. Each of these tiers tests features independent and complementary arguments for why the separate testing of functionalities is acceptable. Finally, this separate testing was also supplemented with a high-level integral check of each the diffusion and transport capabilities and applicable geometries. To accommodate cases which an analytic solution is not feasible, MCNP6.2 was relied upon to provide a higher-order reference solution. This therefore required that the capabilities within MCNP6.2 which were relied upon for this work are also verified in this work. No MCNP discrepancies were noted in this effort. Note that the MCNP6.2 verification included in this work does not stand as a full verification of MCNP6.2, but merely verifies the features used in verifying DIF3D. The verification effort identified no issues that are debilitating or otherwise impactful to design usage of DIF3D, and thus DIF3D version 11.0, release 3012 is considered verified. As some additional changes have been made to the ARC software since this point all versions between release 3012 and 3266 can be considered verified as version 3253 was used for all updates in this revision. The types of issues that were identified were predominantly in the areas of: unclear documentation, software bugs which were inconsequential to final results, editing options which were ignored in favor of printing more information than requested, bugs in the outputs of intermediate results, or secondary output binary file information which was not present. While not a bug, this verification report also identified that the algorithm used to evaluate the peak fast flux in a nodal transport solution can be quite unreliable due to the methodology used and the location of the peak within the mesh. The authors of the report therefore recommend the usage of the EvaluateFlux software (distributed with ARC) as a more robust alternative noting that DIF3D will properly notify the user when the peaking values it is providing are potentially incorrect.

97 MATHEMATICS AND COMPUTING↗

Verification of the DIF3D Software to Support Fast Reactor Analysis (Rev. 3)

Ongoing design activities at Argonne National Laboratory are requiring a thorough verification of the Argonne Reactor Computation codes be performed. DIF3D is central to this system. The driver for this effort requires the 3D Cartesian, triangular-Z, and hexagonal-Z core geometry options of DIF3D be verified. Previous work identified the DIF3D features required to be verified to support current design activities, features of which are generally applicable to hexagonal-Z fast reactor designs. The scope of this verification effort includes verifying DIF3D’s ability to correctly translate the user’s model in to DIF3D’s preferred format, verifying that options planned for use have the desired effect, and verifying the correctness of the eigenvalue, fixed-source, forward, and adjoint solvers in DIF3D-FD and DIF3D-VARIANT. This manuscript provides the verification tasks and their results with respect to the features needed for current design activities. Since analytic solutions of the neutron diffusion and transport equations are either limited in scope or not possible, multiple tiers of problems unique to each solver and geometry type were implemented. Each of these tiers tests features independent and complementary arguments for why the separate testing of functionalities is acceptable. Finally, this separate testing was also supplemented with a high-level integral check of each the diffusion and transport capabilities and applicable geometries. To accommodate cases which an analytic solution is not feasible, MCNP6.2 was relied upon to provide a higher-order reference solution. This therefore required that the capabilities within MCNP6.2 which were relied upon for this work are also verified in this work. No MCNP discrepancies were noted in this effort. Note that the MCNP6.2 verification included in this work does not stand as a full verification of MCNP6.2, but merely verifies the features used in verifying DIF3D. The verification effort identified no issues that are debilitating or otherwise impactful to design usage of DIF3D, and thus DIF3D version 11.0, release 3012 is considered verified. As some additional changes have been made to the ARC software since this point all versions between release 3012 and 3266 can be considered verified as version 3253 was used for all updates in this revision. The types of issues that were identified were predominantly in the areas of: unclear documentation, software bugs which were inconsequential to final results, editing options which were ignored in favor of printing more information than requested, bugs in the outputs of intermediate results, or secondary output binary file information which was not present. While not a bug, this verification report also identified that the algorithm used to evaluate the peak fast flux in a nodal transport solution can be quite unreliable due to the methodology used and the location of the peak within the mesh. The authors of the report therefore recommend the usage of the EvaluateFlux software (distributed with ARC) as a more robust alternative noting that DIF3D will properly notify the user when the peaking values it is providing are potentially incorrect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification of the DIF3D Software to Support Fast Reactor Analysis

Ongoing design activities at Argonne National Laboratory are requiring a thorough verification of the Argonne Reactor Computation codes be performed. DIF3D is central to this system. The driver for this effort requires the 3D Cartesian, triangular-Z, and hexagonal-Z core geometry options of DIF3D be verified. Previous work identified the DIF3D features required to be verified to support current design activities, features of which are generally applicable to hexagonal-Z fast reactor designs. The scope of this verification effort includes verifying DIF3D’s ability to correctly translate the user’s model in to DIF3D’s preferred format, verifying that options planned for use have the desired effect, and verifying the correctness of the eigenvalue, fixed-source, forward, and adjoint solvers in DIF3D-FD and DIF3D-VARIANT. This manuscript provides the verification tasks and their results with respect to the features needed for current design activities. Since analytic solutions of the neutron diffusion and transport equations are either limited in scope or not possible, multiple tiers of problems unique to each solver and geometry type were implemented. Each of these tiers tests features independent and complementary arguments for why the separate testing of functionalities is acceptable. Finally, this separate testing was also supplemented with a high-level integral check of each the diffusion and transport capabilities and applicable geometries. To accommodate cases which an analytic solution is not feasible, MCNP6.2 was relied upon to provide a higher-order reference solution. This therefore required that the capabilities within MCNP6.2 which were relied upon for this work are also verified in this work. No MCNP discrepancies were noted in this effort. Note that the MCNP6.2 verification included in this work does not stand as a full verification of MCNP6.2, but merely verifies the features used in verifying DIF3D. The verification effort identified no issues that are debilitating or otherwise impactful to design usage of DIF3D, and thus DIF3D version 11.0, release 3012 is considered verified. The types of issues that were identified were predominantly in the areas of: unclear documentation, software bugs which were inconsequential to final results, editing options which were ignored in favor of printing more information than requested, bugs in the outputs of intermediate results, or secondary output binary file information which was not present. While not a bug, this verification report also identified that the algorithm used to evaluate the peak fast flux in a nodal transport solution can be quite unreliable due to the polynomial order used and the location of the peak within the mesh. The authors of the report therefore recommend the usage of the EvaluateFlux software (distributed with ARC) as a more robust alternative.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Utility of Four-Dimensional Computed Tomography for Analysis of Intrafractional and Interfractional Variation in Lung Volumes

Purpose: To assess the viability of four-dimensional (4D) computed tomography (CT) in describing intrafractional and interfractional changes in lung volumes and to determine which breathing phase, if any, produces the most highly reproducible lung volumes among fractions. Methods and Materials: Weekly 4D CT scans were acquired for 13 patients with non-small-cell lung cancer during a course of radiotherapy. Contours delineating the right lung, left lung, and total lung were obtained by adapting library models of the anatomic structures to the CT images and propagating them to all 10 respiratory phases represented in the 4D CT image data set. Lung volumes were calculated using software tools in a commercial radiation treatment-planning system and analyzed for interfractional volume reproducibility using t tests and for phase reproducibility using a phase-dependent uncertainty curve across all patients. Probability (p) values of <0.05 were considered to indicate significant differences in all comparisons. Results: The average mean coefficient of variation of tidal volume across all patients was 25.0%. The average standard deviation of tidal volumes was 5.7% relative to the lung volume at end-expiration. Total volumes measured at the 30% phase were 15% more consistent than those measured at end-inspiration (p = 0.03). Conclusions: Four-dimensional CT assesses lung volume with acceptable precision; but the technique was unable to accurately predict interfractional changes in lung volume because wide variations in intra- and interfractional breathing cause high uncertainties in 4D CT data acquisition. The most reproducible breathing phase seems to be at the 30-40% phase (just before end-expiration)

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-E-T-624: Portal Dosimetry Commissioning of Multiple (6) Varian TrueBeam Linacs Equipped with PortalVision DMI MV Imager

Purpose: To show that a single model for Portal Domisetry (PD) can be established for beam-matched TrueBeam™ linacs that are equipped with the DMI imager (43×43cm effective area). Methods: Our department acquired 6 new TrueBeam™s, 4 “Slim” and 2 “Edge” models. The Slims were equipped with 6 and 10MV photons, and the Edges with 6MV. MLCs differed between the Slims and Edges (Millennium 120 vs HD-MLC respectively). PD model was created from data acquired using a single linac (Slim). This includes maximum field size profile, as well as output factors and acquired measured fluence using the DMI imager. All identical linacs were beam-matched, profiles were within 1% at maximum field size at a variety of depths. The profile correction file was generated from 40×40 profile acquired at 5cm depth, 95cm SSD, and was adjusted for deviation at the field edges and corners. The PD model and profile correction was applied to all six TrueBeam™s and imagers. A variety of jaw only and sliding window (SW) MLC test fields, as well as TG-119 and clinical SW and VMAT plans were run on each linac to validate the model. Results: For 6X and 10X, field by field comparison using 3mm/3% absolute gamma criteria passed 90% or better for all cases. This was also true for composite comparisons of TG-199 and clinical plans, matching our current department criteria. Conclusion: Using a single model per photon energy for PD for the TrueBeam™ equipped with a DMI imager can produce clinically acceptable results across multiple identical and matched linacs. It is also possible to use the same PD model despite different MLCs. This can save time during commissioning and software updates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Delivery of Colloid Micro-Newton Thrusters for the Space Technology 7 Mission

Two flight-qualified clusters of four Colloid Micro-Newton Thruster (CMNT) systems have been delivered to the Jet Propulsion Laboratory (JPL). The clusters will provide precise spacecraft control for the drag-free technology demonstration mission, Space Technology 7 (ST7). The ST7 mission is sponsored by the NASA New Millennium Program and will demonstrate precision formation flying technologies for future missions such as the Laser Interferometer Space Antenna (LISA) mission. The ST7 disturbance reduction system (DRS) will be on the ESA LISA Pathfinder spacecraft using the European gravitational reference sensor (GRS) as part of the ESA LISA Technology Package (LTP). Developed by Busek Co. Inc., with support from JPL in design and testing, the CMNT has been developed over the last six years into a flight-ready and flight-qualified microthruster system, the first of its kind. Recent flight-unit qualification tests have included vibration and thermal vacuum environmental testing, as well as performance verification and acceptance tests. All tests have been completed successfully prior to delivery to JPL. Delivery of the first flight unit occurred in February of 2008 with the second unit following in May of 2008. Since arrival at JPL, the units have successfully passed through mass distribution, magnetic, and EMI/EMC measurements and tests as part of the integration and test (I&T) activities including the integrated avionics unit (IAU). Flight software sequences have been tested and validated with the full flight DRS instrument successfully to the extent possible in ground testing, including full functional and 72 hour autonomous operations tests. Delivery of the cluster assemblies along with the IAU to ESA for integration into the LISA Pathfinder spacecraft is planned for the summer of 2008 with a planned launch and flight demonstration in late 2010.

Precision Formation Flying↗

Software for Analyzing Laminar-to-Turbulent Flow Transitions

Software assurance is the planned and systematic set of activities that ensures that software processes and products conform to requirements, standards, and procedures. Examples of such activities are the following: code inspections, unit tests, design reviews, performance analyses, construction of traceability matrices, etc. In practice, software development projects have only limited resources (e.g., schedule, budget, and availability of personnel) to cover the entire development effort, of which assurance is but a part. Projects must therefore select judiciously from among the possible assurance activities. At its heart, this can be viewed as an optimization problem; namely, to determine the allocation of limited resources (time, money, and personnel) to minimize risk or, alternatively, to minimize the resources needed to reduce risk to an acceptable level. The end result of the work reported here is a means to optimize quality-assurance processes used in developing software. This is achieved by combining two prior programs in an innovative manner

Chang, Chau-Lyan↗

Software for Optimizing Quality Assurance of Other Software

Software assurance is the planned and systematic set of activities that ensures that software processes and products conform to requirements, standards, and procedures. Examples of such activities are the following: code inspections, unit tests, design reviews, performance analyses, construction of traceability matrices, etc. In practice, software development projects have only limited resources (e.g., schedule, budget, and availability of personnel) to cover the entire development effort, of which assurance is but a part. Projects must therefore select judiciously from among the possible assurance activities. At its heart, this can be viewed as an optimization problem; namely, to determine the allocation of limited resources (time, money, and personnel) to minimize risk or, alternatively, to minimize the resources needed to reduce risk to an acceptable level. The end result of the work reported here is a means to optimize quality-assurance processes used in developing software.

Feather, Martin↗

Extreme Programming: Maestro Style

"Extreme Programming: Maestro Style" is the name of a computer programming methodology that has evolved as a custom version of a methodology, called extreme programming that has been practiced in the software industry since the late 1990s. The name of this version reflects its origin in the work of the Maestro team at NASA's Jet Propulsion Laboratory that develops software for Mars exploration missions. Extreme programming is oriented toward agile development of software resting on values of simplicity, communication, testing, and aggressiveness. Extreme programming involves use of methods of rapidly building and disseminating institutional knowledge among members of a computer-programming team to give all the members a shared view that matches the view of the customers for whom the software system is to be developed. Extreme programming includes frequent planning by programmers in collaboration with customers, continually examining and rewriting code in striving for the simplest workable software designs, a system metaphor (basically, an abstraction of the system that provides easy-to-remember software-naming conventions and insight into the architecture of the system), programmers working in pairs, adherence to a set of coding standards, collaboration of customers and programmers, frequent verbal communication, frequent releases of software in small increments of development, repeated testing of the developmental software by both programmers and customers, and continuous interaction between the team and the customers. The environment in which the Maestro team works requires the team to quickly adapt to changing needs of its customers. In addition, the team cannot afford to accept unnecessary development risk. Extreme programming enables the Maestro team to remain agile and provide high-quality software and service to its customers. However, several factors in the Maestro environment have made it necessary to modify some of the conventional extreme-programming practices. The single most influential of these factors is that continuous interaction between customers and programmers is not feasible.

Norris, Jeffrey↗

Deploying the NASA Meter Class Autonomous Telescope (MCAT) on Ascension Island

NASA has successfully constructed the 1.3m Meter Class Autonomous Telescope (MCAT) facility on Ascension Island in the South Atlantic Ocean. MCAT is an optical telescope designed specifically to collect ground-based data for the statistical characterization of orbital debris ranging from Low Earth Orbit (LEO) through Middle Earth Orbits (MEO) and beyond to Geo Transfer and Geosynchronous Orbits (GTO/GEO). The location of Ascension Island has two distinct advantages. First, the near-equatorial location fills a significant longitudinal gap in the Ground-based Electro-Optical Deep Space Surveillance (GEODSS) network of telescopes, and second, it allows access to objects in Low Inclination Low-Earth Orbits (LILO). The MCAT facility will be controlled by a sophisticated software suite that operates the dome and telescope, assesses sky and weather conditions, conducts all necessary calibrations, defines an observing strategy (as dictated by weather, sky conditions and the observing plan for the night), and carries out the observations. It then reduces the collected data via four primary observing modes ranging from tracking previously cataloged objects to conducting general surveys for detecting uncorrelated debris. Nightly observing plans, as well as the resulting text file of reduced data, will be transferred to and from Ascension, respectively, via a satellite connection. Post-processing occurs at NASA Johnson Space Center. Construction began in September, 2014 with dome and telescope installation occurring in April through early June, 2015. First light was achieved in June, 2015. Acceptance testing, full commissioning, and calibration of this soon-to-be fully autonomous system commenced in summer 2015. The initial characterization of the system from these tests is presented herein.

Lederer, S. M.↗

A Structured, Model-Based Systems Engineering Methodology for Operations System Design

Two widely accepted techniques for lowering the cost and risk of developing systems are (1) the use of a defined systems engineering (SE) process or methodology and (2) the reuse of existing (previously built) system components. The first technique is represented, for example, in materials published by NASA (e.g., NASA Systems Engineering Handbook) or by professional societies such as INCOSE (International Council on Systems Engineering). Well-formed SE techniques provide value by establishing the proper scope of the system (e.g., requirements), and by identifying and resolving problems relatively early in project lifecycles, when fixes are less expensive. The second technique (reuse) is applied most commonly to hardware and software; it seeks to avoid replicating design and implementation costs while also reducing risk by placing proven capabilities into operational use. In this paper, we outline a methodology combining these two techniques and extending reuse beyond hardware and software to foundational aspects of a Mission Operation System’s (MOS) design. We describe the system design artifacts that result (e.g., requirements, design documentation), as well as the reusable patterns and elements of the design, and their interrelationships. This approach is enabled by model-based systems engineering (MBSE) techniques and tools and is currently available in SysML form as a plug-in to MagicDraw. Additionally, usage of a rigorous MBSE approach allows for training materials and tutorials to be packaged within the overall model itself. The results of such an approach include decreased cost and risk during the design phase, improved ability of the MOS development team to investigate trade spaces and identify impacts to important flight-ground trade studies. Such results extend into decreased costs and risk in later phases due to improved design, decreased need for late fixes or development of "glue-ware" or scripts to fill unanticipated gaps in functionality, and improved ability to identify and plan testing and other validation activities. Finally, lower operational costs can be expected, both due to improved quality of the MOS, increased ease of maintaining updated knowledge of system configuration, and the fact that training and procedural materials are also updated at the same time as accepted system changes.

Bindschadler, Duane L.↗

Accuracy of cranial coplanar beam therapy using an oblique, stereoscopic x-ray image guidance system

A system for measuring two-dimensional (2D) dose distributions in orthogonal anatomical planes in the cranium was developed and used to evaluate the accuracy of coplanar conformal therapy using ExacTrac image guidance. Dose distributions were measured in the axial, sagittal, and coronal planes using a CIRS (Computerized Imaging Reference Systems, Inc.) anthropomorphic head phantom with a custom internal film cassette. Sections of radiographic Kodak EDR2 film were cut, processed, and digitized using custom templates. Spatial and dosimetric accuracy and precision of the film system were assessed. BrainScan planned a coplanar-beam treatment to conformally irradiate a 2-cm-diameterx2-cm-long cylindrical planning target volume. Prior to delivery, phantom misalignments were imposed in combinations of {+-}8 mm offsets in each of the principal directions. ExacTrac x-ray correction was applied until the phantom was within an acceptance criteria of 1 mm/1 deg. (first two measurement sets) or 0.4 mm/0.4 deg. (last two measurement sets). Measured dose distributions from film were registered to the treatment plan dose calculations and compared. Alignment errors, displacement between midpoints of planned and measured 70% isodose contours ({delta}c), and positional errors of the 80% isodose line were evaluated using 49 2D film measurements (98 profiles). Comparison of common, but independent measurements of {delta}c showed that systematic errors in the measurement technique were 0.2 mm or less along all three anatomical axes and that random error averaged ({sigma}{+-}{sigma}{sub {sigma}}) 0.29{+-}0.06 mm for the acceptance criteria of 1 mm/1 deg. and 0.15{+-}0.02 mm for the acceptance criteria of 0.4 mm/0.4 deg. . The latter was consistent with independent estimates that showed the precision of the measurement system was 0.3 mm (2{sigma}). Values of {delta}c were as great as 0.9, 0.3, and 1.0 mm along the P-A, R-L, and I-S axes, respectively. Variations in {delta}c along the P-A axis were correlated to misalignments between laser isocenter and radiation isocenter as documented by daily clinical Lutz tests. Based on results of comparisons of measured with calculated positions of the 80% dose lines along the major anatomical axes, a 1.25, 1.0, and 1.0 mm (0.75, 0.5, and 0.25 mm) gross tumor volume (GTV)-planning target volume (PTV) margin to account for delivery error would be appropriate for the P-A, R-L, and I-S axes, respectively, for an acceptance criteria of 1 mm/1 deg. (0.4 mm/0.4 deg. ). It typically took 2 (3) ExacTrac x-ray image sets to achieve and verify acceptance criteria of 1 mm/1 deg. (0.4 mm/0.4 deg. ). Our results demonstrated a measurement technique using a CIRS anthropomorphic head phantom with a modified film cassette, radiographic film (Kodak EDR2) with a custom film cutting template, and film dosimetry software has been developed and successfully applied to our clinic. It is recommended that a third party offer this service. Our goal of achieving accuracy of delivery of 1 mm or better in each of the three major anatomical axes was almost, but not quite achieved, not because of the accuracy of the image guidance system, but likely due to inaccuracy of laser isocenter and other systematic errors.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Neurovascular bundle–sparing radiotherapy for prostate cancer using MRI-CT registration: A dosimetric feasibility study

Purpose: Sexual dysfunction after radiotherapy for prostate cancer remains an important late adverse toxicity. The neurovascular bundles (NVB) that lie posterolaterally to the prostate are typically spared during prostatectomy, but in traditional radiotherapy planning they are not contoured as an organ-at-risk with dose constraints. Our goal was to determine the dosimetric feasibility of “NVB-sparing” prostate radiotherapy while still delivering adequate dose to the prostate. Methods: Twenty-five consecutive patients with prostate cancer (with no extraprostatic disease on pelvic magnetic resonance imaging [MRI]) who that were treated with external beam radiotherapy, with the same primary planning target volume margins, to a dose of 79.2 Gy were evaluated. Pelvic MRI and simulation computed tomography scans were registered using dedicated software to allow for bilateral NVB target delineation on T2-weighted MRI. A volumetric modulated arc therapy plan was generated using the NVB bilaterally with 2 mm margin as an organ to spare and compared to the patient’s previously delivered plan. Dose-volume histogram endpoints for NVB, rectum, bladder, and planning target volume 79.2 were compared between the 2 plans using a 2-tailed paired t-test. Results: The V70 for the NVB was significantly lower on the NVB-sparing plan (p <0.01), while rectum and bladder endpoints were similar. Target V100% was similar but V{sub 105%} was higher for the NVB-sparing plans (p <0.01). Conclusions: “NVB-sparing” radiotherapy is dosimetrically feasible using CT-MRI registration, and for volumetric modulated arc therapy technology — target coverage is acceptable without increased dose to other normal structures, but with higher target dose inhomogeneity. The clinical impact of “NVB-sparing” radiotherapy is currently under study at our institution.

61 RADIATION PROTECTION AND DOSIMETRY↗