Search NASA⌕ Search

SEARCH · Search NASA

Results for “quality assurance framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

AMPX: A Modern cross section processing system for generating nuclear data libraries - 14619

Nuclear data libraries are essential for nuclear analysis code systems like SCALE. AMPX has been continuously developed since the early 1970's and is used to generate these data libraries for SCALE. Recently, Oak Ridge National Laboratory (ORNL) initiated a major modernization effort to position AMPX for continued development and deployment on modern computing platforms. An important step toward modernization has been to merge AMPX under the SCALE continuous integration (CI) development framework. As a result, AMPX is now developed under the SCALE software quality assurance plan, providing increased confidence in the quality of data libraries developed and deployed by AMPX. This merge allowed us to develop novel methods to generate self-shielding factors that combine SCALE's resonance self-shielding capabilities with the AMPX library-generation capabilities. AMPX processes Evaluated Nuclear Data Format (ENDF/B) files. The ENDF community is working to develop a more modern format that will replace the existing ENDF/B format. Due to strict space and memory requirements when AMPX was first developed, the original AMPX processing and reading of ENDF data were tightly integrated. On newer computer systems, this is no longer necessary. Now there is a separation between reading and processing which allows for simultaneous support of current and new ENDF formats. As a result, AMPX is positioned to adopt any new ENDF format when available. For end users, the modernization effort has resulted in improved processing capabilities for generating nuclear data libraries. The objective of the paper is to document the latest AMPX cross-section processing capabilities and provide the current status of the AMPX modernization effort. (authors)

42 ENGINEERING↗
NASA NTRS2020

NASA Quality Assurance in an MBSE world

Over the past decade or so, the emergence of Model Based Systems Engineering (MBSE) has demonstrated its desirability and value in terms of 1) being a single source of truth, 2) unambiguous definitions and relationships, and 3) after representation, the ability to explore/extract any sets of data on demand. While much work has been done in showing the value to the system engineering discipline in these areas, how does that value translate to the Safety and Mission Assurance (S&MA) world? This paper provides a vision of a very desirable future of NASA S&MA after it is fully integrated into the MBSE framework. We explore the impact and consequences of the MBSE Value items discussed above and how they impact the disciplines of quality assurance, reliability and maintainability, system safety, and software assurance. We provide insight into how the MBSE modeling tools can be used to define S&MA processes (ideally as a result of Use Case [1] elaboration of processes represented in MagicDraw®), produce S&MA products (ViewEditor output of various items), and represent S&MA disciplines (S&MA inside of MagicDraw). We also provide insight into the degree to which some elements can be directly integrated into a SysML® model and when, as often happens, an interface to some external source must be provided. The desirability of this future is part of the reason for the NASA Office of Safety and Mission Assurance’s (OSMA) recent creation of a Model Based Mission Assurance (MBMA) Program [2] and the MBMA annual workshops. We briefly summarize the efforts to date to generate S&MA Use Cases for eventual deployment into pilot and project efforts. Even simple use of the SysML modeling tools can be used to capture quality assurance tasks and integrate them with the systems engineering and produce products that are easy to use by quality practitioners that are unfamiliar with these methods. We anticipate finding opportunities to pilot and implement various Quality Assurance (QA) Use Cases in FY20. The MBMA Program is focused on implementation; the NASA Office of the Chief Engineer's Community of Practice, as well as the SmallSat communities, are very interested in the integration of S&MA. Finally, as projects move forward utilizing whatever efficiency increases they can find in a cost-constrained environment, the S&MA community cannot be caught unawares and needs to continue preparing for the ever-growing implementation of MBSE across NASA and our government and commercial partners.

Evans, John W↗
DOE OSTI2019

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗
DOE OSTI2025

NEML2: An efficient and modular multiphysics constitutive modeling library for hybrid computing environments

This paper presents NEML2, an open-source, high-performance library developed for constitutive material modeling, designed to support the flexible and modular development of models for complex material behavior. Building on the foundational structure of its predecessor, NEML, the NEML2 library introduces significant improvements, including enhanced vectorization, automatic differentiation, and seamless integration with PyTorch, facilitating the application of machine learning techniques in material simulations. NEML2 provides a C++ backend with Python bindings, enabling users to create custom material models that can be executed efficiently on both CPU and GPU platforms. The library also supports coupling with Multiphysics simulation frameworks like MOOSE, making it suitable for realistic simulations involving coupled physical processes. Rigorous quality assurance through unit and regression testing ensures the reliability of results, while the extensible, user-friendly design encourages collaboration and reproducibility across the scientific community. This paper provides an overview of NEML2’s architecture, core features, and applications, highlighting its impact on accelerating material qualification and advancing computational methods in materials science.

GPU↗
DOE OSTI2018

NEAMS-IPL MOOSE Midyear Framework Activities

Multiphysics Object Oriented Simulation Environement (MOOSE) is a modular, pluggable framework for building complex simulations. The ability to add new objects with custom syntax is a core capability that makes MOOSE a powerful platform for coupling multiple applications together within a single environment. Documentation is not only a required component for a complete software quality assurance plan, but is critical to the overall success and wide-spread adoption of the platform by other researchers and institutions. Therefore, the notion of a modular, pluggable framework has been extended to the creation of documentation content. This report details the methodology for defining the NQA-1 compliant requirements in a manner that allows for the automatic generation of the Software Requirement Specification (SRS), Software Design Description (SDD), and Requirement Traceabiltity Matrix (RTM) from any repository revision.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Multi-Branch Decoder Network Approach to Adaptive Temporal Data Selection and Reconstruction for Big Scientific Simulation Data

A key challenge in scientific simulation is that the simulation outputs often require intensive I/O and storage space to store the results for effective post hoc analysis. This article focuses on a quality-aware adaptive temporal data selection and reconstruction problem where the goal is to adaptively select simulation data samples at certain key timesteps in situ and reconstruct the discarded samples with quality assurance during post hoc analysis. This problem is motivated by the limitation of current solutions that a significant amount of simulation data samples are either discarded or aggregated during the sampling process, leading to inaccurate modeling of the simulated phenomena. Two unique challenges exist: 1) the sampling decisions have to be made in situ and adapted to the dynamics of the complex scientific simulation data; 2) the reconstruction error must be strictly bounded to meet the application requirement. To address the above challenges, we develop DeepSample , an error-controlled convolutional neural network framework, that jointly integrates a set of coherent multi-branch deep decoders to effectively reconstruct the simulation data with rigorous quality assurance. The results on two real-world scientific simulation applications show that DeepSample significantly outperforms other state-of-the-art methods on both sampling efficiency and reconstructed simulation data quality.

Zhang, Yang↗
DOE OSTI2022

A Knowledge-based Framework for Building Energy Model Performance Verification

Building energy modeling (BEM) has been widely used by researchers, regulators, and engineers to quantify building energy performance. Quality assurance (QA) and quality control (QC) of the model's performance are essential parts of such analysis. Currently, QA/QC is done in a manual and ad-hoc manner, which is tedious, error-prone, and time-consuming when QA/QC a large number of models. To solve these challenges, we propose a a dAta-driveN buIlding perforMance verificATion framEwork (ANIMATE), which conducts automated output-based verification of building operations requirements (especially for time-series output-based verification of control requirements). While this framework was developed for verifying energy model performance, it can be extended for other applications such as BEM software testing and performance verification of real buildings in the field.

Chen, Yan↗
DOE OSTI2014

SU-E-T-148: Efficient Verification Method for Modulated Electron Radiotherapy Treatment Plans

Purpose: For shallow tumors, modulated electron radiotherapy (MERT) promises a reduction of dose to distal organs at risk. At our institution a framework was developed in order to create treatment plans for MERT employing both forward and inverse optimization. In this work, an efficient quality assurance (QA) process is established. Methods: Treatment plans for three different tumor sites were created using an inverse optimization. These plans consist of 6–12 segments and energies between 6 and 18 MeV. An already established QA process for photon IMRT plans is now extended to additionally handle MERT plans. First, the dose distributions are calculated in a homogenous water phantom. For this task a dedicated Monte Carlo (MC) framework for MERT is used. Second, the segments are applied on a stand-alone amorphous silicon electronic portal imaging device (EPID) using a source-to-surface distance of 70 cm. This device was calibrated for electron beams in a previous work. An in-house developed analysis software, is then utilized for comparisons and evaluation of the measured and calculated dose distributions. Results: For all three plans the calculated dose distributions agree well with the measured ones. Using a 2D gamma comparison (2% of dose max/2 mm and 10% dose threshold) passing rates >98% are achieved.The dose calculation for each plan on the water phantom, using voxels of 0.2×0.2×0.2 cm{sup 3}, takes at maximum 30 min on a single core Pentium 2.66 GHz system with 6 GB RAM, to reach a statistical uncertainty of 2% (1 std. dev.). Conclusion: An already established QA procedure for IMRT photon plans was applied for MERT. The dedicated MC framework and the use of EPID measurements allow an efficient QA procedure in a clinical environment. This work was supported by Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

CLAS12 remote data-stream processing using ERSAP framework

Implementing a physics data processing application is relatively straightforward with the use of current containerization technologies and container image runtime services, which are prevalent in most high-performance computing (HPC) environments. However, the process is complicated by the challenges associated with data provisioning and migration, impacting the ease of workflow migration and deployment. Transitioning from traditional file-based batch processing to data-stream processing workflows is suggested as a method to streamline these workflows. This transition not only simplifies file provisioning and migration but also significantly reduces the necessity for extensive disk space. Data-stream processing is particularly effective for real-time processing during data acquisition, thereby enhancing data quality assurance. This paper introduces the integration of the JLAB CLAS12 event reconstruction application within the ERSAP data-stream processing framework that facilitates the execution of streaming event reconstruction at a remote data center and enables the return streaming of reconstructed events to JLAB while circumventing the need for temporary data storage throughout the process.

Gyurjyan, Vardan↗
NASA NTRS2001

Incorporating cost-benefit analyses into software assurance planning

The objective is to use cost-benefit analyses to identify, for a given project, optimal sets of software assurance activities. Towards this end we have incorporated cost-benefit calculations into a risk management framework.

investment software quality software process impro↗
DOE OSTI2024

Initial Development of Fusion Magnet Simulation Capabilities for Performance and Safety Evaluation Using the MOOSE Framework

Fusion energy holds the promise of being a transformative technology as a carbon-neutral, sustainable source of energy. Whole device modeling and the development of fusion digital twins will be increasingly important for emerging fusion device concepts at both national laboratories and within the commercial fusion industry. However, meeting the challenge of whole device modeling of fusion energy devices requires robust, multiphysics, multiscale modeling and simulation technologies capable of running on large-scale supercomputers. Detailed analysis of individual systems at-scale is also required to ensure safe and efficient operation as well as provide the safety basis for future device designs and licensing activities. In a tokamak, toroidal and poloidal magnets confine and shape the fusion plasma to promote the fusion reaction. High plasma temperatures and high magnetic field requirements in modern design concepts (leading to high amounts of energy stored within each magnet) impose electrical, thermal, and mechanical loads on the magnet components, which in turn impacts the safety considerations of the magnet and their supporting systems. Idaho National Laboratory (INL) has a history of working in this space, including development and benchmarking of the Magnetic System Circuitry Analysis Program (MSCAP) and Magnet Arcing (MAGARC) codes to study magnet quench events; notably, MAGARC was used to study quenching during the ITER Engineering Design Activity. However, these legacy codes and capabilities are not parallel and scalable, and new tools are required for future advances in this area, which leads to the INL-developed Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Developed originally for fission reactor systems under United States Department of Energy, Office of Nuclear Energy modeling and simulation programs, the MOOSE framework has been well-suited to multiscale, multiphysics modeling and simulation needs for nuclear systems. The framework is open-source, well-tested, under continuous development and deployment, and developed to a Nuclear Quality Assurance, Level 1 software quality standard. MOOSE has also been used in the fusion space previously in several projects: INL’s Tritium Migration Analysis Program, Version 8 (TMAP8) for tritium migration, UK Atomic Energy Authority’s A Unified Resource for OpenMC (fusion) Reactor Applications (AURORA) code for fusion thermo-mechanical and neutronics analysis, and Argonne National Laboratory’s Cardinal for high-fidelity computational fluid dynamics and neutronics. However, to model superconducting magnets, several MOOSE enhancements are required: additions to the current MOOSE electromagnetic capabilities, new material libraries for superconductors of interest (such as YBCO), as well as fusion-specific models for thermo-mechanics. This talk will discuss initial development activities to build these capabilities in MOOSE, focusing on initial validation and benchmarking activities. Proposed coupling workflows and future work to support the simulation of fusion magnets and magnet structural assemblies for performance and safety evaluation in MOOSE will also be discussed.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Implementation of Software QA for SAS4A/SASSYS-1 Rev. 1

In an effort to support closure of gaps in advanced reactor licensing pathways, a multi-year task to systematically develop sodium-cooled fast reactor (SFR) codes and methods for use in a licensing framework was launched as part of the DOE-NE Advanced Reactor Technologies (ART) Program’s Regulatory Technology Development Plan (RTDP). This report documents Phase 2 of this task, which was focused on the finalization and initial implementation of a software quality assurance (SQA) program for SAS4A/SASSYS-1 and completion of high-priority SQA-related technical activities. The ultimate goal of this ongoing RTDP task is to develop an SQA framework that satisfies the fundamental requirements of relevant SQA standards and guidance while still maintaining sufficient flexibility and efficiency such that the framework can be sustained with modest resources.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Software Quality Assurance Plan: Cardinal

The Cardinal Software Quality Assurance (SQA) Program aims to provide the controls and processes necessary to enable continuous, high-quality software development while meeting user and program sponsor requirements. This SQA Plan (SQAP) delineates the SQA Program framework for Cardinal by describing the Program activities, organization, and documentation, and by clearly defining the interconnection of all Program items. It should be noted that this SQAP is aligned with the current version of the Argonne Quality Assurance Program Plan, which was designed to align with DOE O 414.1D. This SQAP is also aligned with the revision 10 of the SQAP for MOOSE and MOOSE-based applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

SU-F-P-10: A Web-Based Radiation Safety Relational Database Module for Regulatory Compliance

Purpose: Maintaining compliance with Radioactive Materials Licenses is inherently a time-consuming task requiring focus and attention to detail. Staff tasked with these responsibilities, such as the Radiation Safety Officer and associated personnel must retain disparate records for eventual placement into one or more annual reports. Entering results and records in a relational database using a web browser as the interface, and storing that data in a cloud-based storage site, removes procedural barriers. The data becomes more adaptable for mining and sharing. Methods: Web-based code was written utilizing the web framework Django, written in Python. Additionally, the application utilizes JavaScript for front-end interaction, SQL, HTML and CSS. Quality assurance code testing is performed in a sequential style, and new code is only added after the successful testing of the previous goals. Separate sections of the module include data entry and analysis for audits, surveys, quality management, and continuous quality improvement. Data elements can be adapted for quarterly and annual reporting, and for immediate notification of user determined alarm settings. Results: Current advances are focusing on user interface issues, and determining the simplest manner by which to teach the user to build query forms. One solution has been to prepare library documents that a user can select or edit in place of creation a new document. Forms are being developed based upon Nuclear Regulatory Commission federal code, and will be expanded to include State Regulations. Conclusion: Establishing a secure website to act as the portal for data entry, storage and manipulation can lead to added efficiencies for a Radiation Safety Program. Access to multiple databases can lead to mining for big data programs, and for determining safety issues before they occur. Overcoming web programming challenges, a category that includes mathematical handling, is providing challenges that are being overcome.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

A Framework for Patient-Centered Pathways of Care for Radiopharmaceutical Therapy: An ASTRO Consensus Document

Radiopharmaceutical therapy (RPT) is an area of projected growth and importance with several agents in clinical use, new agents in late-phase clinical trials, and many others under testing and development. This article proposes a framework for developing pathways of care that can be broadly applied to all RPTs, representing the current status of RPT. It suggests foundational elements for many pathways of care for patients with cancer and concludes with areas in active development and the future horizon for RPT treatment centers. Developing a framework for patient-centered pathways of care is a critical step in establishing RPT as standard therapy for patients with a diverse spectrum of cancers. This expected increase in RPT treatment options will affect a much larger population of patients with complex cancer. It will also require enhanced coordination and collaboration among appropriately qualified personnel with diverse expertise in image acquisition, image interpretation, quantitative imaging, dosimetry calculation, radiation quality assurance and safety as well as oncology care and RPT-induced sequelae and response assessment. The essential role of this evolving RPT care team within multidisciplinary oncology care is a cornerstone of this framework for a patient-centered pathway of care for RPT. Given the status of current RPT practice and the horizon for future applications, this patient-centered pathway of care guidance is timely and should help inform future clinical RPT practice paradigms. A task force was recruited from the Theranostic Working Group of the American Society for Radiation Oncology (ASTRO) in May 2019 with equal representation from the nuclear medicine community. The task force expanded on a framework that was originally conceived by the Working Group for patient-centered care. This framework was developed to incorporate the strengths of both radiation oncologists and nuclear medicine physicians. The manuscript was then developed by the task force and posted on the ASTRO website for a 6-week public comment period ending in July 2020. Comments were adjudicated, and the draft was sent to external organizations for potential endorsement. This document was sent to the ASTRO Board of Directors in October 2020 for approval.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

The catalog-to-cosmology framework for weak lensing and galaxy clustering for LSST

We present TXPipe, a modular, automated and reproducible pipeline for ingesting catalog data and performing all the calculations required to obtain quality-assured two-point measurements of lensing and clustering, and their covariances, with the metadata necessary for parameter estimation. The pipeline is developed within the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC), and designed for cosmology analyses using LSST data. In this paper, we present the pipeline for the so-called 3x2pt analysis -- a combination of three two-point functions that measure the auto- and cross-correlation between galaxy density and shapes. We perform the analysis both in real and harmonic space using TXPipe and other LSST-DESC tools. We validate the pipeline using Gaussian simulations and show that it accurately measures data vectors and recovers the input cosmology to the accuracy level required for the first year of LSST data under this simplified scenario. We also apply the pipeline to a realistic mock galaxy sample extracted from the CosmoDC2 simulation suite (Korytov et al. 2019). TXPipe establishes a baseline framework that can be built upon as the LSST survey proceeds. Furthermore, the pipeline is designed to be easily extended to science probes beyond the 3x2pt analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Advanced Reactor Technology -- Regulatory Technology Development Plan (RTDP)

This DOE-NE Advanced Small Modular Reactor (AdvSMR) regulatory technology development plan (RTDP) will link critical DOE nuclear reactor technology development programs to important regulatory and policy-related issues likely to impact a “critical path” for establishing a viable commercial AdvSMR presence in the domestic energy market. Accordingly, the regulatory considerations that are set forth in the AdvSMR RTDP will not be limited to any one particular type or subset of advanced reactor technology(s) but rather broadly consider potential regulatory approaches and the licensing implications that accompany all DOE-sponsored research and technology development activity that deal with commercial non-light water reactors. However, it is also important to remember that certain “minimum” levels of design and safety approach knowledge concerning these technology(s) must be defined and available to an extent that supports appropriate pre-licensing regulatory analysis within the RTDP. Final resolution to advanced reactor licensing issues is most often predicated on the detailed design information and specific safety approach as documented in a facility license application and submitted for licensing review. Because the AdvSMR RTDP is focused on identifying and assessing the potential regulatory implications of DOE-sponsored reactor technology research very early in the pre-license application development phase, the information necessary to support a comprehensive regulatory analysis of a new reactor technology, and the resolution of resulting issues, will generally not be available. As such, the regulatory considerations documented in the RTDP should be considered an initial “first step” in the licensing process which will continue until a license is issued to build and operate the said nuclear facility. Because a facility license application relies heavily on the data and information generated by technology development studies, the anticipated regulatory importance of key DOE reactor research initiatives should be assessed early in the technology development process. Quality assurance requirements supportive of later licensing activities must also be attached to important research activities to ensure resulting data is usable in that context. Early regulatory analysis and licensing approach planning thus provides a significant benefit to the formulation of research plans and also enables the planning and development of a compatible AdvSMR licensing framework, should significant modification be required.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2001

Cost-benefit based assurance planning

We have extended an existing risk management framework with a refined cost-benefit model. Benefits are measured in terms of reduction of risk.

risk requirements tradeoffs design quality assuran↗