buildtest v0.9.1
Buildtest is used on Cori system to run regression test, there is a Cori test suite at https://github.com/buildtesters/buildtest-cori that leverages buildtest to run the tests.
Siddiqui, Shahzeb↗
SEARCH · Search NASA
Results for “regression testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
An Evaluation of Army Wellness Center Clients’ Health-Related Outcomes
Purpose: To examine whether Army community members participating in a best-practice based workplace health promotion program (WHPP) experience goal-moderated improvements in health-related outcomes. Design: Pretest/posttest outcome evaluation examining an autonomously participating client cohort over 1 year. Setting: Army Wellness Center facilities on 19 Army installations. Participants: Army community members sample (N = 5703), mostly Active Duty Soldiers (64%). Intervention: Assessment of health risks with feedback, health assessments, health education classes, and health coaching sessions conducted by health educators at a recommended frequency of once a month for 3 to 12 months. Measures: Initial and follow-up outcome assessments of body mass index (BMI), body fat, cardiorespiratory fitness, blood pressure, and perceived stress. Analysis: Mixed model linear regression testing for goal-moderated improvements in outcomes. Results: Clients experienced significant improvements in body fat (−2% change), perceived stress (−6% to −12% change), cardiorespiratory fitness (+6% change), and blood pressure (−1% change) regardless of health-related goal. Only clients with a weight loss goal experienced BMI improvement (−1% change). Follow-up outcome assessment rates ranged from 44% (N = 2509) for BMI to 6% (N = 342) for perceived stress. Conclusion: Army Wellness Center clients with at least 1 follow-up outcome assessment experienced improvements in military readiness correlates and chronic disease risk factors. Evaluation design and follow-up-related limitations notwithstanding results suggest that best practices in WHPPs can effectively serve a globally distributed military force.
Rivera, L. Omar↗
FY16 Status Report on NEAMS Neutronics Activities
The goal of the NEAMS neutronics effort is to develop a neutronics toolkit for use on sodium-cooled fast reactors (SFRs) which can be extended to other reactor types. The neutronics toolkit includes the high-fidelity deterministic neutron transport code PROTEUS and many supporting tools such as a cross section generation code MC 2 -3, a cross section library generation code, alternative cross section generation tools, mesh generation and conversion utilities, and an automated regression test tool. The FY16 effort for NEAMS neutronics focused on supporting the release of the SHARP toolkit and existing and new users, continuing to develop PROTEUS functions necessary for performance improvement as well as the SHARP release, verifying PROTEUS against available existing benchmark problems, and developing new benchmark problems as needed. The FY16 research effort was focused on further updates of PROTEUS-SN and PROTEUS-MOCEX and cross section generation capabilities as needed.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
User Manual for the PROTEUS Mesh Tools
PROTEUS is built around a finite element representation of the geometry for visualization. In addition, the PROTEUS-SN solver was built to solve the even-parity transport equation on a finite element mesh provided as input. Similarly, PROTEUS-MOC and PROTEUS-NEMO were built to apply the method of characteristics on unstructured finite element meshes. Given the complexity of real world problems, experience has shown that using commercial mesh generator to create rather simple input geometries is overly complex and slow. As a consequence, significant effort has been put into place to create multiple codes that help assist in the mesh generation and manipulation. There are three input means to create a mesh in PROTEUS: UFMESH, GRID, and NEMESH. At present, the UFMESH is a simple way to generate two-dimensional Cartesian and hexagonal fuel assembly geometries. The UFmesh input allows for simple assembly mesh generation while the GRID input allows the generation of Cartesian, hexagonal, and regular triangular structured grid geometry options. The NEMESH is a way for the user to create their own mesh or convert another mesh file format into a PROTEUS input format. Given that one has an input mesh format acceptable for PROTEUS, we have constructed several tools which allow further mesh and geometry construction (i.e. mesh extrusion and merging). This report describes the various mesh tools that are provided with the PROTEUS code giving both descriptions of the input and output. In many cases the examples are provided with a regression test of the mesh tools. The most important mesh tools for any user to consider using are the MT_MeshToMesh.x and the MT_RadialLattice.x codes. The former allows the conversion between most mesh types handled by PROTEUS while the second allows the merging of multiple (assembly) meshes into a radial structured grid. Note that the mesh generation process is recursive in nature and that each input specific for a given mesh tool (such as .axial or .merge) can be used as “mesh” input for any of the mesh tools discussed in this manual.
97 MATHEMATICS AND COMPUTING↗
MOOSE IPL Extensions (Documentation)
In FY-2015, The development of MOOSE was driven by the needs of the NEAMS MOOSE-based applications, BISON, MARMOT, and RELAP-7. An emphasis was placed on the continued upkeep and improvement MOOSE in support of the product line integration goals. New unified documentation tools have been developed, several improvements to regression testing have been enforced and overall better software quality practices have been implemented. In addition the Multiapps and Transfers systems have seen significant refactoring and robustness improvements, as has the “Restart and Recover” system in support of Multiapp simulations. Finally, a completely new “Control Logic” system has been engineered to replace the prototype system currently in use in the RELAP-7 code. The development of this system continues and is expected to handle existing needs as well as support future enhancements.
99 GENERAL AND MISCELLANEOUS↗
STDA05-51 milestone
In the case for each of the tasks, implementation started in a private topic branch. That branch was later submitted as a merge request where the code was run through regression tests across multiple test platforms. The merge requests were also subjected to human reviewers for approval. After necessary modifications were made, the code was merged to VTK-m's master branch. Subsequently, documentation was written for the VTK-m User's Guide.
97 MATHEMATICS AND COMPUTING↗
The Opus radiative opacity code, a new implementation of the super-transition array method
This report describes the development of our new radiative opacity code Opus, submitted as part of a 2020 Level 2 milestone requirement. This code aims to incorporate the capabilities in existing but separate opacity codes previously developed at LLNL (Opal, Topaz, and Tycho). The first phase in the development, which was to implement the super-transition (STA) method of Bar-Shalom and co-workers is now completed. In this work, we describe the underlying physics, implementation, usage, and regression testing as well as providing numerical examples for the opacity tables of boron, chromium, iron, and nickel. The latter are benchmarked against the LLNL legacy STA code Tycho, with an average absolute relative difference of ~1.5 and 0.5% for Planck and Rosseland opacity means, respectively. The cases where differences are larger are well understood in terms of numerical instabilities near discontinuities of the average degree of ionization inherent to the assumed opacity/equation-of-state model.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Engineering Computational Practices (Rev. 1)
This manual will attempt to motivate the use of an automated build system for the purposes of computational science and engineering. As part of this motivation, the surrounding computational practices of version control, documen tation, compute environment management, and regression testing will also be addressed as applied to the practice of computational engineering. Specifically, this manual intends to motivate the adoption of these traditional software engineering practices for use in research and production engineering simulation projects. This manual is not the first such effort in the greater scientific computing community. In fact, the authors relied heavily on the lesson plans of the Software Carpentry, established to teach computing skills to researchers in 1998. As the intention for this manual is to lay out fundamental practices of engineering computing, it will not attempt to fully teach the underlying concepts and will instead reference the well designed lesson plans of the Software Carpentry. Where possible, this manual will explain to general computing practices and concepts and limit discussion of specific software implementations to examples or vehicles for practice in concrete application. The specific software taught by the Software Carpentry curriculum is an excellent starting point to learn the core concepts of computational engi neering. However, the authors have found that applications to engineering simulation and analysis require translation of these software development concepts into the language and workflows of computational engineers. Adopting these computational tools may require engineers to re-imagine their workflows in some combination of traditional engineer ing and software concepts. It has also been necessary to extend existing software build systems for engineering practices beyond the simple wrap ping of engineering software execution. Where necessary, examples of specific software and their method of extension to engineering simulations will be given, with reference to the User Manual for recommended practical use. Where this manual relies on specific implementation examples, it should be understood that the practicing engineer may find that different software is more amenable to their specific work. It is always the overall collection of computational practices is more important than any specific software implementation. The ability to recognize which concepts are implemented by a software package will make a practicing engineer agile to changing project needs, computing resources, numeric solvers, programming languages, and even available funding.
42 ENGINEERING↗
Development and Refinement of Bison Models for Higher Burnup Application
Electric Power Research Institute (EPRI) is an international research organization funded by organizations in the energy and government sectors. The company conducts research to tackle the energy challenges of its member organizations. In support of the U.S. nuclear industry, EPRI and Idaho National Laboratory were awarded a U.S. Department of Energy Technology Commercialization Fund to develop a loss of coolant accident (LOCA) analysis tool. This tool was developed to support burnup extension activities by supplementing the existing capabilities of operators of existing large light-water reactor plants. The tool couples INL developed codes Bison and RELAP5-3D for advanced simulation of LOCA behavior. The project consists of seven major tasks, one of which is the development and refinement of Bison models for higher burnup applications. This task is broken down into six targeted areas of development and refinement including: formation of high burnup structure, fuel fracture and pulverization, transient fission gas release, axial gas communication within a fuel rod, cladding ballooning and burst, and axial fuel relocation. This report summarizes the models for both the fuel and cladding in Bison for high burnup application, identifies the areas of development and refinement necessary to enhance the Bison capabilities to be used in the coupled simulation tool with RELAP5-3D. Integration and regression testing to demonstrate proper implementation of the new features in Bison is highlighted.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
MPACT Verification and Validation Manual (rev 1)
The MPACT code provides the capability to calculate the steady-state and transient reactor core neutron distribution for operating nuclear power plant (PWR) conditions across multiple fuel cycles. As required in the CASL SQA plan, it is the responsibility of UM and ORNL as joint owners of MPACT to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be distributed for reference and distribution within VERA. This document provides the first revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the framework for future MPACT V&V activities. During FY16, MPACT V&V activities in the areas of code verification have continued to mature and work has progressed on code error evaluation using the Method of Manufactured Solutions (MMS). Several specific tasks have also been completed to improve MPACT code verification to include tasks to improve the unit and regression test coverage. A joint UM/ORNL task was completed to develop standardize coding standards and workflow for the continued collaborative development of MPACT. During the past year, MPACT validation work has continued in both the areas of measured data from critical experiments as well as measured data from operating nuclear power plants. Preliminary work was also performed in FY16 on the use of post-irradiation examinations for evaluation and validation of the isotopic depletion capability in MPACT. Based on the results of V&V efforts this past year, the confidence level has increased in the ability of MPACT to model an operational Pressurized Water Reactor. Areas were identified which require increased emphasis during FY17 to include updating all the V&V problems with the new 51-group library, the completion of cycle 2 of the BEAVRS benchmark, initial validation for BWR applications, the addition of Uncertainty Quantification results into the benchmark results, and the completion of specific validation tasks for the CASL Challenge problems.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Analysis of the Einstein sample of early-type galaxies
The EINSTEIN galaxy catalog contains x-ray data for 148 early-type (E and SO) galaxies. A detailed analysis of the global properties of this sample are studied. By comparing the x-ray properties with other tracers of the ISM, as well as with observables related to the stellar dynamics and populations of the sample, we expect to determine more clearly the physical relationships that determine the evolution of early-type galaxies. Previous studies with smaller samples have explored the relationships between x-ray luminosity (L(sub x)) and luminosities in other bands. Using our larger sample and the statistical techniques of survival analysis, a number of these earlier analyses were repeated. For our full sample, a strong statistical correlation is found between L(sub X) and L(sub B) (the probability that the null hypothesis is upheld is P less than 10(exp -4) from a variety of rank correlation tests. Regressions with several algorithms yield consistent results.
Eskridge, Paul B.↗
Interactive Software Fault Analysis Tool for Operational Anomaly Resolution
Resolving software operational anomalies frequently requires a significant amount of resources for software troubleshooting activities. The time required to identify a root cause of the anomaly in the software may lead to significant timeline impacts and in some cases, may extend to compromise of mission and safety objectives. An integrated tool that supports software fault analysis based on the observed operational effects of an anomaly could significantly reduce the time required to resolve operational anomalies; increase confidence for the proposed solution; identify software paths to be re-verified during regression testing; and, as a secondary product of the analysis, identify safety critical software paths.
Chen, Ken↗
Spoken Language Processing in the Clarissa Procedure Browser
Clarissa, an experimental voice enabled procedure browser that has recently been deployed on the International Space Station, is as far as we know the first spoken dialog system in space. We describe the objectives of the Clarissa project and the system's architecture. In particular, we focus on three key problems: grammar-based speech recognition using the Regulus toolkit; methods for open mic speech recognition; and robust side-effect free dialogue management for handling undos, corrections and confirmations. We first describe the grammar-based recogniser we have build using Regulus, and report experiments where we compare it against a class N-gram recogniser trained off the same 3297 utterance dataset. We obtained a 15% relative improvement in WER and a 37% improvement in semantic error rate. The grammar-based recogniser moreover outperforms the class N-gram version for utterances of all lengths from 1 to 9 words inclusive. The central problem in building an open-mic speech recognition system is being able to distinguish between commands directed at the system, and other material (cross-talk), which should be rejected. Most spoken dialogue systems make the accept/reject decision by applying a threshold to the recognition confidence score. NASA shows how a simple and general method, based on standard approaches to document classification using Support Vector Machines, can give substantially better performance, and report experiments showing a relative reduction in the task-level error rate by about 25% compared to the baseline confidence threshold method. Finally, we describe a general side-effect free dialogue management architecture that we have implemented in Clarissa, which extends the "update semantics'' framework by including task as well as dialogue information in the information state. We show that this enables elegant treatments of several dialogue management problems, including corrections, confirmations, querying of the environment, and regression testing.
Rayner, M.↗
Enabling Thread Safety and Parallelism in the Program to Optimize Simulated Trajectories II
Development of the Program to Optimize Simulated Trajectories (POST) began in the 1970s. Since then, it has become widely utilized across NASA, industry, and academia to solve a variety of atmospheric ascent and entry problems. Its successor, POST2, has undergone many upgrades since its release in the 1990s. Recently, there has been an increasing desire to take advantage of the advances in parallel computing for both offline and online systems. Thus, modifications were made to allow POST2 to simulate multiple trajectories simultaneously without adversely affecting results. This capability is leveraged to calculate optimization solutions in parallel as opposed to sequentially. A demonstration of the benefits is presented using a small set of POST2 regression tests, as well as a project simulating a human-scale Lunar lander.
R. Anthony Williams↗
Enabling Thread Safety and Parallelism in the Program to Optimize Simulated Trajectories II
Development of the Program to Optimize Simulated Trajectories (POST) began in the 1970s. Since then, it has become widely utilized across NASA, industry, and academia to solve a variety of atmospheric ascent and entry problems. Its successor, POST2, has undergone many upgrades since its release in the 1990s. Recently, there has been an increasing desire to take advantage of the advances in parallel computing for both offline and online systems. Thus, modifications were made to allow POST2 to simulate multiple trajectories simultaneously without adversely affecting results. This capability is leveraged to calculate optimization solutions in parallel as opposed to sequentially. A demonstration of the benefits is presented using a small set of POST2 regression tests, as well as a project simulating a human-scale Lunar lander.
Anthony Williams↗
DoSSiER: Database of scientific simulation and experimental results
The Geant4, GeantV and GENIE collaborations regularly perform validation and regression tests for simulation results. DoSSiER (Database of Scientific Simulation and Experimental Results) is being developed as a central repository to store the simulation results as well as the experimental data used for validation. DoSSiER can be easily accessed via a web application. In addition, a web service allows for programmatic access to the repository to extract records in json or xml exchange formats. In this paper, we describe the functionality and the current status of various components of DoSSiER as well as the technology choices we made.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
radlibTests v. 1.0
Suite of scripts for performing regression testing of the SCEPTRE radiation transport code, include MMS testing and mesh-convergence analyses
Fan, Wesley↗
Penalized Logistic Regression Likelihood Ratio Test Analysis to Detect Signals of Adverse Events From Interactions in Postmarket Safety Surveillance
Not provided.
Mathematical & Computational Biology↗