Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

The CNSC's Inspector Training and Qualification Program and its Importance to the Nuclear Industry - 19370

Trained, qualified, and designated staff at the Canadian Nuclear Safety Commission (CNSC) conduct inspections of licensed nuclear sites as a method of compliance verification. This paper will describe the unique and comprehensive qualification process for CNSC inspectors, known as the Inspector Training and Qualification Program (ITQP). The ITQP includes service-line-specific training that is unique to each inspection group within the CNSC, dependent on the facility/industry type. The training requirements specific to staff in the Wastes and Decommissioning Division and its impact on safety at waste management sites across Canada will be discussed. This paper will specifically identify the importance of CNSC inspector training and detail how the unique training program requirements enable the CNSC to better identify and encourage compliance among nuclear waste and decommissioning sites in Canada. CNSC inspectors are designated under section 29 of the Nuclear Safety and Control Act (NSCA), and the powers of inspectors are outlined in section 32 of the NSCA. Having trained, qualified, and designated inspectors is paramount for both the CNSC and the nuclear industry. For the CNSC, this ensures that staff in the field are aware of potential hazards and how to mitigate such hazards (if applicable), that staff understand the regulatory framework and how to measure compliance against it, and that staff consistently apply CNSC values across the nuclear industry. For the industry, this ensures that staff present at nuclear facilities are knowledgeable and professional, that inspections are conducted in a consistent manner, and that any compliance actions issued are measurable and defendable against the regulatory framework. The CNSC's ITQP incorporates both theoretical (in-class and online) and practical training, and is broken down into six categories: mandatory training for all new employees; core training; service-line-specific training; on-the-job training; CNSC regulations training; and, recommended additional training. This paper will discuss in detail the specific aspects of each of these categories, the importance of each category including the difference between knowledge and skills acquired in theoretical versus hands-on training, and how CNSC staff in designated inspector positions (inspectors-in-training) progress through the program. The complete list of core training and service-line-specific training for inspectors in the Wastes and Decommissioning Division, including re-qualification requirements, will be explored throughout the paper. It is further important that CNSC designated inspectors undergo continuous learning to ensure that their skills remain up to date, as well as to ensure that inspectors requalify at defined intervals to enable the maintenance of the core knowledge and skills with which the determination of the person's qualification was based. The steps involved in this requalification process, as well as the importance of continuous learning and the maintenance of skills and knowledge will be further discussed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Analysis of Phenix end-of-life natural convection test with the MARS-LMR code

The end-of-life test of Phenix reactor performed by the CEA provided an opportunity to have reliable and valuable test data for the validation and verification of a SFR system analysis code. KAERI joined this international program for the analysis of Phenix end-of-life natural circulation test coordinated by the IAEA from 2008. The main objectives of this study were to evaluate the capability of existing SFR system analysis code MARS-LMR and to identify any limitation of the code. The analysis was performed in three stages: pre-test analysis, blind posttest analysis, and final post-test analysis. In the pre-test analysis, the design conditions provided by the CEA were used to obtain a prediction of the test. The blind post-test analysis was based on the test conditions measured during the tests but the test results were not provided from the CEA. The final post-test analysis was performed to predict the test results as accurate as possible by improving the previous modeling of the test. Based on the pre-test analysis and blind test analysis, the modeling for heat structures in the hot pool and cold pool, steel structures in the core, heat loss from roof and vessel, and the flow path at core outlet were reinforced in the final analysis. The results of the final post-test analysis could be characterized into three different phases. In the early phase, the MARS-LMR simulated the heat-up process correctly due to the enhanced heat structure modeling. In the mid phase before the opening of SG casing, the code reproduced the decrease of core outlet temperature successfully. Finally, in the later phase the increase of heat removal by the opening of the SG opening was well predicted with the MARS-LMR code. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Some guidance on preparing validation plans for the DART Full System Models.

Planning is an important part of computational model verification and validation (V&V) and the requisite planning document is vital for effectively executing the plan. The document provides a means of communicating intent to the typically large group of people, from program management to analysts to test engineers, who must work together to complete the validation activities. This report provides guidelines for writing a validation plan. It describes the components of such a plan and includes important references and resources. While the initial target audience is the DART Full System Model teams in the nuclear weapons program, the guidelines are generally applicable to other modeling efforts. Our goal in writing this document is to provide a framework for consistency in validation plans across weapon systems, different types of models, and different scenarios. Specific details contained in any given validation plan will vary according to application requirements and available resources.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Verification of Electromagnetic Physics Models for Parallel Computing Architectures in the GeantV Project

An intensive R&D and programming effort is required to accomplish new challenges posed by future experimental high-energy particle physics (HEP) programs. The GeantV project aims to narrow the gap between the performance of the existing HEP detector simulation software and the ideal performance achievable, exploiting latest advances in computing technology. The project has developed a particle detector simulation prototype capable of transporting in parallel particles in complex geometries exploiting instruction level microparallelism (SIMD and SIMT), task-level parallelism (multithreading) and high-level parallelism (MPI), leveraging both the multi-core and the many-core opportunities. We present preliminary verification results concerning the electromagnetic (EM) physics models developed for parallel computing architectures within the GeantV project. In order to exploit the potential of vectorization and accelerators and to make the physics model effectively parallelizable, advanced sampling techniques have been implemented and tested. In this paper we introduce a set of automated statistical tests in order to verify the vectorized models by checking their consistency with the corresponding Geant4 models and to validate them against experimental data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A k-NN METHOD TO CLASSIFY RARE ASTRONOMICAL SOURCES: PHOTOMETRIC SEARCH OF BROWN DWARFS WITH SPITZER/IRAC

We present a statistical method for the photometric search of rare astronomical sources based on the weighted k-Nearest Neighbors method. A metric is defined in a multidimensional color-magnitude space based only on the photometric properties of template sources and the photometric uncertainties of both templates and data, without the need to define ad hoc color and magnitude cuts which could bias the search. The metric is defined as a function of two parameters, the number of neighbors k and a threshold distance D {sub th} that can be optimized for maximum selection efficiency and completeness. We apply the method to the search of L and T dwarfs in the Spitzer Extragalactic First Look Survey and the Booetes field of the Spitzer Shallow Survey, as well as to the search of substellar mass companions around nearby stars. With high level of completeness, we confirm the absence of late-T dwarfs detected in at least two bands in the First Look Survey, and only one in the Shallow Survey (previously discovered by Stern et al.). This result is in agreement with the expected statistics for late-T dwarfs. One L/early-T candidate is found in the First Look Survey, and three in the Shallow Surveys, currently undergoing follow-up spectroscopic verification. Finally, we discuss the potential for brown dwarf searches with this method in the Spitzer warm mission Exploration Science programs.

79 ASTRONOMY AND ASTROPHYSICS↗

ASC CSSE Level 2 Milestone #6362: Resilient Asynchronous Many Task Programming Model

This report is an outcome of the ASC CSSE Level 2 Milestone 6362: Analysis of Re- silient Asynchronous Many-Task (AMT) Programming Model. It comprises a summary and in-depth analysis of resilience schemes adapted to the AMT programming model. Herein, performance trade-offs of a resilient-AMT prograrnming model are assessed through two ap- proaches: (1) an analytical model realized by discrete event simulations and (2) empirical evaluation of benchmark programs representing regular and irregular workloads of explicit partial differential equation solvers. As part of this effort, an AMT execution simulator and a prototype resilient-AMT programming framework have been developed. The former permits us to hypothesize the performance behavior of a resilient-AMT model, and has undergone a verification and validation (V&V) process. The latter allows empirical evaluation of the perfor- mance of resilience schemes under emulated program failures and enabled the aforementioned V&V process. The outcome indicates that (1) resilience techniques implemented within an AMT framework allow efficient and scalable recovery under frequent failures, that (2) the abstraction of task and data instances in the AMT programming model enables readily us- able Application Program Interfaces (APIs) for resilience, and that (3) this abstraction enables predicting the performance of resilient-AMT applications with a simple simulation infrastruc- ture. This outcome will provide guidance for the design of the AMT programming model and runtime systems, user-level resilience support, and application development for ASC's next generation platforms (NGPs).

97 MATHEMATICS AND COMPUTING↗

Applying Human-performance Models to Designing and Evaluating Nuclear Power Plants: Review Guidance and Technical Basis

Human performance models (HPMs) are simulations of human behavior with which we can predict human performance. Designers use them to support their human factors engineering (HFE) programs for a wide range of complex systems, including commercial nuclear power plants. Applicants to U.S. Nuclear Regulatory Commission (NRC) can use HPMs for design certifications, operating licenses, and license amendments. In the context of nuclear-plant safety, it is important to assure that HPMs are verified and validated, and their usage is consistent with their intended purpose. Using HPMs improperly may generate misleading or incorrect information, entailing safety concerns. The objective of this research was to develop guidance to support the NRC staff's reviews of an applicant's use of HPMs in an HFE program. The guidance is divided into three topical areas: (1) HPM Verification, (2) HPM Validation, and (3) User Interface Verification. Following this guidance will help ensure the benefits of HPMs are achieved in a technically sound, defensible manner. During the course of developing this guidance, I identified several issues that could not be addressed; they also are discussed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

International comparison of product certification and verification methods for appliances

Enforcement of appliance standards and consumer trust in appliance labeling are important foundations of growing a more energy efficient economy. Product certification and verification increase compliance rates which in turn increase both energy savings and consumer trust. This paper will serve two purposes: 1) to review international practices for product certification and verification as they relate to the enforcement of standards and labeling programs in the U.S., E.U., Australia, Japan, Canada, and China; and 2) to make recommendations for China to implement improved certification processes related to their mandatory standards and labeling program such as to increase compliance rates and energy savings potential.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

International Comparison of Product Certification and Verification Methods for Appliances

Enforcement of appliance standards and consumer trust in appliance labeling are important foundations of growing a more energy efficient economy. Product certification and verification increase compliance rates which in turn increase both energy savings and consumer trust. This paper will serve two purposes: 1) to review international practices for product certification and verification as they relate to the enforcement of standards and labeling programs in the U.S., E.U., Australia, Japan, Canada, and China; and 2) to make recommendations for China to implement improved certification processes related to their mandatory standards and labeling program such as to increase compliance rates and energy savings potential.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Baseline Human Factors and Ergonomics in Support of Control Room Modernization at Nuclear Power Plants

As part of control room modernization at a nuclear power plant, a utility should carefully follow the four phases prescribed by the U.S. Nuclear Regulatory Commission in NUREG-0711, Human Factors Engineering Program Review Model . These four phases include Planning and Analysis, Design, Verification and Validation, and Implementation and Operation. While NUREG-0711 is a useful guideline, it is written primarily from the perspective of regulatory review, and it therefore does not provide a nuanced account of many of the steps the utility might undertake as part of control room modernization. The guideline is largely summative—meant to catalog final products—rather than formative—meant to guide the overall modernization process. In this report, we highlight two crucial formative subelements of the Planning and Analysis phase specific to control room modernization that are not covered in NUREG-0711. These two subelements are the usability and ergonomics baseline evaluations. A baseline evaluation entails evaluating the system as-built and currently in use. The usability baseline evaluation provides key insights into operator performance using the control system currently in place. The ergonomic baseline evaluation identifies possible deficiencies in the physical configuration of the control system. Both baseline evaluations feed into the design of the replacement system and help ensure that control room modernization represents the successful evolution of the control system.

99 GENERAL AND MISCELLANEOUS↗

Realizing high-accuracy low-cost measurement and verification for deep cost savings (Final Project Report)

The project “Realizing high-accuracy low-cost measurement and verification for deep cost savings”, that began in Fiscal Year (FY) 2017, was funded to conduct the technical analyses, demonstration, market evaluation, and regulatory engagement necessary to realize a cost-effective high-accuracy advanced measurement and verification (M&V) method that could be applied to certain efficiency programs in the Pacific Northwest. Advanced M&V (also known as M&V 2.0), is a method that uses advanced metering infrastructure (AMI) data in combination with analytics to quantify energy efficiency savings.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Baseline Evaluations to Support Control Room Modernization at Nuclear Power Plants

For any major control room modernization activity at a commercial nuclear power plant (NPP) in the U.S., a utility should carefully follow the four phases prescribed by the U.S. Nuclear Regulatory Commission in NUREG-0711, Human Factors Engineering Program Review Model. These four phases include Planning and Analysis, Design, Verification and Validation, and Implementation and Operation. While NUREG-0711 is a useful guideline, it is written primarily from the perspective of regulatory review, and it therefore does not provide a nuanced account of many of the steps the utility might undertake as part of control room modernization. The guideline is largely summative—intended to catalog final products—rather than formative—intended to guide the overall modernization process. In this paper, we highlight two crucial formative sub-elements of the Planning and Analysis phase specific to control room modernization that are not covered in NUREG-0711. These two sub-elements are the usability and ergonomics baseline evaluations. A baseline evaluation entails evaluating the system as-built and currently in use. The usability baseline evaluation provides key insights into operator performance using the control system currently in place. The ergonomics baseline evaluation identifies possible deficiencies in the physical configuration of the control system. Both baseline evaluations feed into the design of the replacement system and subsequent summative benchmarking activities that help ensure that control room modernization represents a successful evolution of the control system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

SU-F-T-277: Using Dose Weighted Mean Effective Depth to Improve Accuracy of Secondary MU Calculation for VMAT Plans

Purpose: In commercial secondary dose calculation system, an average effective depth is used to calculate the Monitor Units for an arc beam from the volumetric modulated arc (VMAT) plans. Typically, an arithmetic mean of the effective depths (AMED) of a VMAT arc beam is used, which may result in large MU discrepancy from that of the primary treatment planning system. This study is to demonstrate the use of a dose weighted mean effective depth (DWED) can improve accuracy of MU calculation for the secondary MU verification. Methods: In-house scripts were written in the primary treatment planning system (TPS) to first convert a VMAT arc beam to a series of static step & shoot beams (every 4 degree). The computed dose and effective depth of each static beam were then used to obtain the dose weighted mean effective depth (DWED) for the VMAT beam. The DWED was used for the secondary MU calculation for VMAT plans. Six lung SBRT VMAT plans, eight head and neck VMAT plans and ten prostate VMAT plans that had > 5% MU deviations (failed MU verification) using the AMED method were recalculated with the DWED. For comparison, same number VMAT plans that had < 5% MU deviations (passed MU verification) using AMED method were also reevaluated with the dose weighted mean effective depth method. Results: For MU verification passed plans, the mean and standard deviation of MU differences between the TPS and the secondary calculation program were 2.2%±1.5% for the AMED and 2.1%±1.7% for the DMED method. For the failed plans, the mean and standard deviation of MU differences of TPS to the secondary calculation program were 9.9%±4.7% and 4.7%±2.6, respectively. Conclusion: The dose weighted mean effective depth improved MU calculation accuracy which can be used for the pre-treatment MU verification of VMAT plans.

60 APPLIED LIFE SCIENCES↗

SU-E-T-465: Implementation of An Automated Collision Detection Program Using Open Source Software for the Pinnacle Treatment Planning System

Purpose: Potential collisions between the gantry head and the patient or table assembly are difficult to detect in most treatment planning systems. We have developed and implemented a novel software package for the representation of potential gantry collisions with the couch assembly at the time of treatment planning. Methods: Physical dimensions of the Varian Edge linear accelerator treatment head were measured and reproduced using the Visual Python display package. A script was developed for the Pinnacle treatment planning system to generate a file with the relevant couch, gantry, and isocenter positions for each beam in a planning trial. A python program was developed to parse the information from the TPS and produce a representative model of the couch/gantry system. Using the model and the Visual Python libraries, a rendering window is generated for each beam that allows the planner to evaluate the possibility of a collision. Results: Comparison against heuristic methods and direct verification on the machine validated the collision model generated by the software. Encounters of <1 cm between the gantry treatment head and table were visualized as collisions in our virtual model. Visual windows were created depicting the angle of collision for each beam, including the anticipated table coordinates. Visual rendering of a 6 arc trial with multiple couch positions was completed in under 1 minute, with network bandwidth being the primary bottleneck. Conclusion: The developed software allows for quick examination of possible collisions during the treatment planning process and helps to prevent major collisions prior to plan approval. The software can easily be implemented on future planning systems due to the versatility and platform independence of the Python programming language. Further integration of the software with the treatment planning system will allow the possibility of patient-gantry collision detection for a range of treatment machines.

60 APPLIED LIFE SCIENCES↗

Fiscal Year 2023 Software Quality Assurance Activities for the ARC Software

The Argonne Reactor Code (ARC) software suite [1-17] has been developed by Argonne researchers for fast reactor design and analysis since the 1970s. With the ARC software suite, a user can quickly build a model of a proposed or existing fast spectrum reactor and carry out fuel cycle, nominal thermal analysis and flow requirements, and assess, as is appropriate, whether the core design and constraint system yield an acceptable mechanical behavior. For transient reactor analysis with SAS4A [18], the ARC software suite can be used to generate reactivity coefficients and kinetics parameters at any modeled fuel cycle time point which forms part of the input to SAS4A. The ARC suite was consistently being developed until the 1990s and followed a software QA program which was an appropriate standard for the time. In the 1990s, the DOE funding to fast reactor research and development was all but eliminated and the ARC software was put into maintenance mode. In the early 2000s, the software quality assurance (SQA) program for ARC was still in place to define an official version, but by 2005 it all but was abandoned as there were insufficient staff to fill the work roles. Since 2005, there has been a considerable increase in research and design work on fast spectrum reactors. The ARC software as a whole has since been exported to many universities and commercial companies and ANL support has been given to the various projects over the years [19-23]. Further, MC 2 -3, PERSENT, and DASSH were all developed after 2005 without any adherence to a software standard. In recent time, the DOE VTR project [22] paid for verification work to be done on the ARC software as part of the goal of making it NQA-1 complaint. The VTR project was not considered the appropriate pathway to fund and maintain a SQA program for the ARC software and while software developments (DASSH) were made and several manuals were updated and software verification work was carried out, the ARC software is not NQA-1 compliant. More recently the Advanced Reactor Development Program (ARDP [23]) has funded the creation of manuals for some ARC utility programs and funded additional software verification work on DIF3D [6, 7] and MC 2 -3 [2-5] for the purpose of commercial grade dedication. Because of the VTR and ARDP projects, software verification work was completed on MC 2 -3 and DIF3D, and detailed reports were created for each piece of software, which discuss the inputs and outputs from the codes that are covered by the verification work and link various analytic, code-to-code, and hand calculation based verification work presented in the report with verification test problems provided with the software. This is a key part of the commercial grade dedication work and constitutes the bulk of the cost to get the ARC software to commercial grade. The ARC software suite is a valuable asset as a fast reactor design and analysis tool set that has been reasonably well verified and validated with various fast reactor benchmark problems and experiments over decades. Some or all of the ARC software suite has been utilized for designing the IFR [20], PGSFR [21], VTR [22], and Natrium [23] reactors and we can expect it to continue to be used for advanced fast reactor design and/or confirmatory calculation purposes in the future. Due to increased interest by commercial companies and regulatory bodies, it is becoming more important to make the ARC software suite complete and ready-to-use in terms of its SQA pedigree and commercial grade dedication needs. This report discusses the achievements made towards building a new SQA program for the ARC software and dealing with outstanding identified QA gaps.

97 MATHEMATICS AND COMPUTING↗

A Principled Kernel Testbed for Hardware/Software Co-Design Research

Recently, advances in processor architecture have become the driving force for new programming models in the computing industry, as ever newer multicore processor designs with increasing number of cores are introduced on schedules regimented by marketing demands. As a result, collaborative parallel (rather than simply concurrent) implementations of important applications, programming languages, models, and even algorithms have been forced to adapt to these architectures to exploit the available raw performance. We believe that this optimization regime is flawed. In this paper, we present an alternate approach that, rather than starting with an existing hardware/software solution laced with hidden assumptions, defines the computational problems of interest and invites architects, researchers and programmers to implement novel hardware/software co-designed solutions. Our work builds on the previous ideas of computational dwarfs, motifs, and parallel patterns by selecting a representative set of essential problems for which we provide: An algorithmic description; scalable problem definition; illustrative reference implementations; verification schemes. This testbed will enable comparative research in areas such as parallel programming models, languages, auto-tuning, and hardware/software codesign. For simplicity, we focus initially on the computational problems of interest to the scientific computing community but proclaim the methodology (and perhaps a subset of the problems) as applicable to other communities. We intend to broaden the coverage of this problem space through stronger community involvement.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Verification of EPA's ''Preliminary Remediation Goals for radionuclides'' (PRG) electronic calculator

The U.S. Environmental Protection Agency (EPA) requested an external, independent verification study of their updated “Preliminary Remediation Goals for Radionuclides” (PRG) electronic calculator. The calculator provides PRGs for radionuclides that are used as a screening tool at Comprehensive Environmental Response, Compensation, and Liability Act (CERCLA) and Resource Conservation and Recovery Act (RCRA) sites. These risk-based PRGs establish concentration limits under specific exposure scenarios. The purpose of this verification study is to determine that the calculator has no inherit numerical problems with obtaining solutions as well as to ensure that the equations are programmed correctly. There are 167 equations used in the calculator. To verify the calculator, all equations for each of seven receptor types (resident, construction worker, outdoor and indoor worker, recreator, farmer, and composite worker) were hand calculated using the default parameters. The same four radionuclides (Am-241, Co-60, H-3, and Pu-238) were used for each calculation for consistency throughout.

54 ENVIRONMENTAL SCIENCES↗

Viscosity Solutions for a System of Integro-PDEs and Connections to Optimal Switching and Control of Jump-Diffusion Processes

We develop a viscosity solution theory for a system of nonlinear degenerate parabolic integro-partial differential equations (IPDEs) related to stochastic optimal switching and control problems or stochastic games. In the case of stochastic optimal switching and control, we prove via dynamic programming methods that the value function is a viscosity solution of the IPDEs. In our setting the value functions or the solutions of the IPDEs are not smooth, so classical verification theorems do not apply.

97 MATHEMATICS AND COMPUTING↗