Search NASA⌕ Search

SEARCH · Search NASA

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

REALIZATION OF A AUTOMATED T-WAY COMBINATORIAL TESTING APPROACH FOR A SOFTWARE BASED EMBEDDED DIGITAL DEVICE

Under the Department of Energy’s Light Water Reactor Sustainability Program, within the Plant Modernization research pathway, the Digital I&C Qualification Project is identifying new methods that would be beneficial in qualifying digital I&C systems and devices for safety-related usage. One such method that would be useful in qualifying field components such as sensors and actuators is the concept of testability. The Nuclear Regulatory Commission (NRC) considers testability to be one of two design attributes sufficient to eliminate consideration of software-based or software logic-based common cause failure (the other being diversity). The NRC defines acceptable “testability” as follows: Testability – A system is sufficiently simple such that every possible combination of inputs and every possible sequence of device states are tested and all outputs are verified for every case (100% tested). [NUREG 0800, Chapter 7, Branch Technical Position (BTP) 7-19] This qualification method has never proven to be practical in view of the very large number of combinations of inputs and sequences of device states for a typical I&C device. However, many of these combinations are not unique in the sense that they represent the same state space or in that that they represent state space that would not affect the critical design basis functions of the device. Therefore, the state space of interest might possibly be reduced to a manageable dimension through such analysis. This project will focus on a representative I&C device similar in design, function, and complexity to the types of devices that would likely be deployed in nuclear power plants as digital or software based sensors and actuators (e.g. Smart Sensors). Analysis will be conducted to determine the feasibility of testing this device in a manner consistent with the NRC definition. This report describes the development of test process for Bounded Exhaustive Testing with respect to Combinatorial Test (CT) methods. The report describes the candidate Device Under Test SW – the VCU smart sensor, conceptual experimental methods for stated test objectives, description of the process, tools, resources, and computing. This information will be used to fully develop a detailed test plan (based on statistical measure needs) and test environment for conducting an I&C device testability demonstration study. The future planed experimental study of this project is to demonstrate digital qualification via Bounded Exhaustive Testability with respect to Common Cause Failure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Test GammaPix™ Radiation Detection Software with Smartphones

GammaPix™ is a smartphone application that uses smartphone cameras to detect ionizing radiation. Brookhaven National Laboratory (BNL) evaluated the performance of the software in detecting radioactive materials. For this purpose, a series of tests were conducted at the Radiation Calibration Facility Annex at BNL. The experiments included dose measurements with three types of NIST-traceable calibration sources, 60Co, 241Am, and 137Cs. The recorded results by GammaPix™ were compared with the values measured by calibrated dosimeters to determine the detection thresholds. Several selected models of iPhones and Android cell phones with different pixel sizes and resolution were tested. In this paper, we present the test procedures and discuss the test results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Single-Bar SMT Creep-Fatigue Testing on Alloy 617 with Software Controls on elastic Follow-Up Feedback in Support of New Creep-Fatigue Design Methodology

The Simplified Model Test (SMT) is one of the alternative ways to calculate the creep-fatigue damage of elevated temperature components. The SMT approach unifies the creep and fatigue damage, simplifying the damage calculation process with improved accuracy. Traditionally, SMT tests has have been conducted through the two bars: first is the driver bar and second is the test bar. The driver bar stays elastic and imposes the confinement to the second bar. This experimental procedure requires two test frames and a large test specimen, which limits the test parameter range and accessibility of this testing procedures. Hence, a single-bar SMT (SB-SMT) tests has been developed to simplify complexity in SMT experiment setup. The software-controlled SB-SMT test process has been introduced which completely replaces the driver bar. This paper discusses the single-bar SMT (SB-SMT) test procedure with software controls. The challenges and critical parameters in the software-controlled SB-SMT procedure are addresses addressed and recommendations are provided. A scoping test with a set of wider strain range, elastic follow-ups and dwell time validated the proposed test procedure.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Creation of a Weather Drivers Test Suite for Inclusion in ASHRAE Standard 140

Weather conditions are an important boundary condition for building performance simulation (BPS) calculations. For existing test cases in ASHRAE Standard 140 "Method of Test for Evaluating Building Performance Simulation Software" (ANSI/ASHRAE 2020), it was assumed that the software being tested could adequately read and interpret the weather data in the provided standard weather files. As differences between the programs have been reduced and as more programs have shifted to sub-hourly time steps this assumption has become more stretched. To address these concerns a new test suite testing a program's ability to read and interpret the data from a standard weather file was developed. The purpose of the test suite is to test the use of the typical data used from standard weather files.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Prototyping the BOPTEST Framework for Simulation-Based Testing of Advanced Control Strategies in Buildings

Advanced control strategies are becoming increasingly necessary in buildings in order to meet and balance requirements for energy efficiency, demand flexibility, and occupant comfort. Additional development and widespread adoption of emerging control strategies, however, ultimately require low implementation costs to reduce payback period and verified performance to gain control vendor, building owner, and operator trust. This is difficult in an already first-cost driven and risk-averse industry. Recent innovations in building simulation can significantly aid in meeting these requirements and spurring innovation at early stages of development by evaluating performance, comparing state-of-the-art to new strategies, providing installation experience, and testing controller implementations. This paper presents the development of a simulation framework consisting of test cases and software platform for the testing of advanced control strategies (BOPTEST - Building Optimization Performance Test). The objectives and requirements of the framework, components of a test case, and proposed software platform architecture are described, and the framework is demonstrated with a prototype implementation and example test case.

Blum, David↗
DOE OSTI2025

Package Testing Program Process for Validation and Verification of Software

The purpose of this document is to define the process for validation and verification (V&V) of software used to test the thermal data acquisition equipment in the Oak Ridge National Laboratory (ORNL) Package Testing Program (PTP) as part of the testing configuration(s). This process adheres to all applicable ORNL Standards Based Management System requirements and correlates with the PTP Quality Management System and the Software Quality Assurance Plan.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Requirements Description of the REBUS Software for the Versatile Test Reactor

This report presents the modeling and simulation capabilities of Argonne National Laboratory’s fuel cycle analysis code, the REactor BUrnup System (REBUS), that will be relied on for the VTR project. These capabilities will then be used to establish the set of REBUS verification tasks necessary to verify REBUS for usage on the VTR project. A similar path was followed for the DIF3D software where its’ requirements and verification tasks were established. REBUS has been maintained by Argonne since the early 1960s to support its reactor design mission. That software transitioned from the original REBUS to REBUS-2 in the mid 1970s and to REBUS-3 in the mid 1980s. Since then REBUS has gone through many revisions to the current REBUS-11. Note that this version numbering is consistent with the progression of DIF3D, the base flux solver that REBUS is built upon. The name REBUS refers to a pictorial based puzzle as the original developers were inspired by having to track thousands of unique fuel assemblies as they are inserted into the reactor, depleted, shuffled, discharged, and reprocessed.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

MARVEL Instrumentation, Control, and Software Considerations

This paper details the various I&C considerations and design decisions made throughout the MARVEL (Micro-reactor Applications Research Validation and Evaluation) project, including sensor and actuator selection, safety-related functionality, digital control hardware and software, and testing methodologies. Key challenges such as managing radiation, temperature, and space constraints are discussed, along with the trade-offs between using standard equipment and custom solutions. The successful integration of off-the-shelf components, the emphasis on minimizing safety-related instrumentation, and the lessons learned from prototyping and testing are highlighted. The authors aim to provide insights that can benefit future micro-reactor designs and emphasize the importance of real-world testing in advancing reactor technology.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2018

M&V Tool Testing Portal v1

Software is an online self-service portal for testing M&V methods/tools using buildings' interval meter data. After registering as a user in the portal, that user can download test data files, run those test data files through their own M&V software, and then upload software modeling results to the online portal as a csv file. After the user has uploaded their modeling results the portal will develop statistical accuracy metrics for that M&V tool. The online portal will summarize test results for some or all of the submitted tests. This online portal has been developed by LBNL, and we have been collaborating with the Efficiency Valuation Organization (EVO) with the objective of EVO managing the portal as an ongoing service. Portal is currently posted at http://mvportal.evo-world.org/

Cholia, Shreyas↗
DOE OSTI2018

Argonne Reactor Code Software Verification and Validation Plan for the Versatile Test Reactor

This Argonne Reactor Code (ARC) software has taken a pivotal role in the design work of the Versatile Test Reactor. The ARC software itself consists of several independent or semiindependent pieces of software that are used in concert to carry out specific analysis and design objectives. In this report, we discuss the validation that is needed for the ARC software overall and discuss available, usable experimental data and how it relates to the VTR project. We also discuss the verification that is required for the ARC software with respect to its usage in the VTR project and give some concrete examples as to what it must accomplish. A list of goals for the verification and validation work are presented as the general procedure that will be implemented for every individual piece of software in ARC. The ARC software has been continuously developed for over 50 years and many of the features used for the VTR project have thus been rigorously tested for accuracy during that timeframe. The ARC software is presently under source code control and undergoes nightly regression testing of not only the individual pieces, but the interconnected aspects that are common to most analysis projects. Its greatest weakness, from a software verification and validation perspective, is both a lack of documentation and outdated documentation. As an example, much of the previous validation work will require contemporary effort to re-evaluate given the updated base data libraries and modifications to the software that have occurred since. This requires new documentation to be produced to support the usage of the software in the VTR project. The bulk of the ARC software is focused on steady state neutronics and TH behavior of a reactor system. In this regard, we have identified the ZPPR, FFTF, and EBR-II programs as the best candidates for sources of validation data for the VTR project. The ZPPR-15 series in the ZPPR program was chosen as it is the best representation of the VTR fuel form and reactor core layout of all of the ZPPR measurements. Additional support for it comes from the fact that most of the data has already been processed into usable ARC models for VTR validation. The FFTF and EBR-II reactors were both functional reactors that provide reactor scale measurements. FFTF is clearly a closer match to VTR and its startup measurements would be a very valuable validation basis. EBR-II has invaluable burnup related measurements that will play a key role in the ARC software validation work. Each piece of ARC software will require a report detailing the software verification. The validation work will be logically split into the results of modeling each identified experimental resource (ZPPR, EBR-II, FFTF). The intended timeline for the VTR project is to have the ARC software verified and validated by the end of fiscal year 2020. This is incumbent on sufficient funding allocated to V&V activities and no change in programmatic priorities.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

ComPort: Rigorous Testing Methods to Safeguard Software Porting (Final Technical Report)

This is a technical report from the lead institution – University of Utah, Kahlert School of Computing – funded under the Department of Energy, Office of Science, Office of Advanced Scientific Computing Research under award number DE-SC0022252. We summarize our work done over the three years of funding received. The relevant papers and software have already been uploaded at the DOE site.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Testing deviations from GR at cosmological scales including dynamical dark energy, massive neutrinos, functional or binned parametrizations, and spatial curvature

Here we introduce a new version of the Integrated Software in Testing General Relativity (ISiTGR) which is a patch to the software CAMB and CosmoMC . ISiTGR is intended to test deviations from GR at cosmological scales using cosmological datasets. While doing so, it allows for various extensions to the standard flat Λ cold dark matter model. In this new release, we have support for the following: (1) dynamical dark energy parametrizations with a constant or time-dependant equation of state; (2) a consistent implementation of anisotropic shear to model massive neutrinos throughout the full formalism; (3) multiple commonly used parametrizations of modified growth (MG) parameters; (4) functional, binned and hybrid time and scale dependencies for all MG parameters; (5) spatially flat or curved backgrounds. ISiTGR is designed to allow cosmological analyses to take full advantage of ongoing and future surveys to test simultaneously or separately various extensions to the standard model. We describe here the formalism and its implementation in the cosmic microwave background (CMB) code, the Integrated Sachs-Wolfe effect, and the 3 × 2 point statistics. Next, we apply ISiTGR to current datasets from Planck-2018, Planck-2015, Dark Energy Survey YR1 release, baryonic acoustic oscillations (BAO), redshift space distortions (BAO/RSD) from the BOSS Data Release 12, the 6DF Galaxy Survey and the SDSS Data Release 7 Main Galaxy Sample, and Supernova from the Pantheon compilation, joint SNLS/SDSS data analysis and the Hubble Space Telescope. We derive constraints on MG parameters for various combinations of the five features above and find that general relativity is consistent with current datasets in all cases.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Update of ASHRAE Standard 140 Section 5.2 and Related Sections (BESTEST Building Thermal Fabric Test Cases)

This report documents new work intended to update the current building thermal fabric software-to-software comparative test specifications and example results of ANSI/ASHRAE Standard 140-2017, Sections 5.2.1, 5.2.2, 5.2.3, and related supporting sections. The Building Energy Simulation Test and Diagnostic Method (BESTEST) test specification and example results that provide the basis for these Standard 140 sections were originally published in 1995. The state of the art in building energy simulation modeling has advanced since then. Additionally, comments on the test specification over the years highlighted ambiguities, further necessitating the update to the original work. This new work was conducted for the U.S. Department of Energy (DOE) by Argonne National Laboratory (Argonne) and National Renewable Energy Laboratory (NREL), in collaboration with a working group of international experts associated with the American Society of Heating, Refrigerating, and Air-Conditioning Engineers (ASHRAE) Standing Standard Project Committee (SSPC) 140. SSPC 140 is responsible for ANSI/ASHRAE Standard 140. The new work, presented in this report, defined the test cases and specifications such that building energy simulation programs with time steps of one hour or less can perform the tests. Revisions to the test specification and update of example results follow the vetting process of iterative field trials established for previous BESTEST work that has been adapted for ASHRAE Standard 140.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Update to the Microcontroller Benchmark for Radiation Testing

LANL developed a benchmark of software code for radiation testing of microprocessors several years ago, and it was published under an open-source license on GitHub. Publishing the software is necessary for other researchers to adopt and implement this benchmark for radiation testing of other microprocessors to standardize test practices so that test data can be compared across different microprocessors. The original codes have been used several times by other organizations to test a wide range of microcontrollers and microprocessors. After several years of research, LANL is ready to update the benchmark. Changes include: 1. Addition of new codes that allow common software codes to be tested, 2. Addition of new codes that instrument more microprocessor circuitry, 3. Addition of input patterns that allow for a more compressive understanding of how the memory layout affects the sensitivity to radiation-induced faults and better use of automated test pattern generation standards, and 4. Modification of current codes for faster and more resilient detection, reporting and correction of radiation-induced faults. These codes have been tested by LANL researchers over the last few years, which has been published in the open literature. As the code base for the new benchmarks are stable, it is time to release the update to the GitHub repository, where the original codes were released.

Quinn, Heather↗