Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software Quality Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Open-Source Steady-State Models for Integration of Wave Energy Converter into Microgrids

This paper proposes a software framework, WEC-Grid, for integrating wave energy converters (WECs) into power flow software, such as Siemens PSS®E, to aid the integration of alternative energy sources into Microgrids. While integrating alternative sources such as WECs presents specific challenges such as cost, power quality, and power variability, wave energy is a promising renewable energy resource. Evaluating the integration of WECs into the power grid is a complex and nuanced problem that requires seamless communication between a WEC model and power flow software. The presented WEC-Grid software framework bridges and extends the functionality of WEC-Sim, an open-source WEC modeling package for MATLAB, through a wave-to-wire (W2W) electro-mechanical power conversion and processing model. WEC-Grid acts as a software wrapper, handler, and communication layer between the W2W modeler and power flow software. The software is designed to represent each grid system as a class object, allowing power system operators to perform power system duties such as contingency planning and dispatch operations. The integration of WECs with PSS®E’s power flow calculations workflow is demonstrated with an IEEE RTS case study.

16 TIDAL AND WAVE POWER↗
NASA NTRS1990

Towards a mature measurement environment: Creating a software engineering research environment

Software engineering researchers are building tools, defining methods, and models; however, there are problems with the nature and style of the research. The research is typically bottom-up, done in isolation so the pieces cannot be easily logically or physically integrated. A great deal of the research is essentially the packaging of a particular piece of technology with little indication of how the work would be integrated with other prices of research. The research is not aimed at solving the real problems of software engineering, i.e., the development and maintenance of quality systems in a productive manner. The research results are not evaluated or analyzed via experimentation or refined and tailored to the application environment. Thus, it cannot be easily transferred into practice. Because of these limitations we have not been able to understand the components of the discipline as a coherent whole and the relationships between various models of the process and product. What is needed is a top down experimental, evolutionary framework in which research can be focused, logically and physically integrated to produce quality software productively, and evaluated and tailored to the application environment. This implies the need for experimentation, which in turn implies the need for a laboratory that is associated with the artifact we are studying. This laboratory can only exist in an environment where software is being built, i.e., as part of a real software development and maintenance organization. Thus, we propose that Software Engineering Laboratory (SEL) type activities exist in all organizations to support software engineering research. We describe the SEL from a researcher's point of view, and discuss the corporate and government benefits of the SEL. The discussion focuses on the benefits to the research community.

Basili, Victor R.↗
NASA NTRS1992

The experience factory: Can it make you a 5? or what is its relationship to other quality and improvement concepts?

The concepts of quality improvements have permeated many businesses. It is clear that the nineties will be the quality era for software and there is a growing need to develop or adapt quality improvement approaches to the software business. Thus we must understand software as an artifact and software as a business. Since the business we are dealing with is software, we must understand the nature of software and software development. The software discipline is evolutionary and experimental; it is a laboratory science. Software is development not production. The technologies of the discipline are human based. There is a lack of models that allow us to reason about the process and the product. All software is not the same; process is a variable, goals are variable, etc. Packaged, reusable, experiences require additional resources in the form of organization, processes, people, etc. There have been a variety of organizational frameworks proposed to improve quality for various businesses. The ones discussed in this presentation include: Plan-Do-Check-Act, a quality improvement process based upon a feedback cycle for optimizing a single process model/production line; the Experience Factory/Quality Improvement Paradigm, continuous improvements through the experimentation, packaging, and reuse of experiences based upon a business's needs; Total Quality Management, a management approach to long term success through customer satisfaction based on the participation of all members of an organization; the SEI capability maturity model, a staged process improvement based upon assessment with regard to a set of key process areas until you reach a level 5 which represents a continuous process improvement; and Lean (software) Development, a principle supporting the concentration of the production on 'value added' activities and the elimination of reduction of 'not value added' activities.

Basili, Victor R.↗
DOE OSTI2021

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1988

Markov chains for testing redundant software

A preliminary design for a validation experiment has been developed that addresses several problems unique to assuring the extremely high quality of multiple-version programs in process-control software. The procedure uses Markov chains to model the error states of the multiple version programs. The programs are observed during simulated process-control testing, and estimates are obtained for the transition probabilities between the states of the Markov chain. The experimental Markov chain model is then expanded into a reliability model that takes into account the inertia of the system being controlled. The reliability of the multiple version software is computed from this reliability model at a given confidence level using confidence intervals obtained for the transition probabilities during the experiment. An example demonstrating the method is provided.

White, Allan L.↗
NASA NTRS2008

Assessing Requirements Quality through Requirements Coverage

In model-based development, the development effort is centered around a formal description of the proposed software system the model. This model is derived from some high-level requirements describing the expected behavior of the software. For validation and verification purposes, this model can then be subjected to various types of analysis, for example, completeness and consistency analysis [6], model checking [3], theorem proving [1], and test-case generation [4, 7]. This development paradigm is making rapid inroads in certain industries, e.g., automotive, avionics, space applications, and medical technology. This shift towards model-based development naturally leads to changes in the verification and validation (V&V) process. The model validation problem determining that the model accurately captures the customer's high-level requirements has received little attention and the sufficiency of the validation activities has been largely determined through ad-hoc methods. Since the model serves as the central artifact, its correctness with respect to the users needs is absolutely crucial. In our investigation, we attempt to answer the following two questions with respect to validation (1) Are the requirements sufficiently defined for the system? and (2) How well does the model implement the behaviors specified by the requirements? The second question can be addressed using formal verification. Nevertheless, the size and complexity of many industrial systems make formal verification infeasible even if we have a formal model and formalized requirements. Thus, presently, there is no objective way of answering these two questions. To this end, we propose an approach based on testing that, when given a set of formal requirements, explores the relationship between requirements-based structural test-adequacy coverage and model-based structural test-adequacy coverage. The proposed technique uses requirements coverage metrics defined in [9] on formal high-level software requirements and existing model coverage metrics such as the Modified Condition and Decision Coverage (MC/DC) used when testing highly critical software in the avionics industry [8]. Our work is related to Chockler et al. [2], but we base our work on traditional testing techniques as opposed to verification techniques.

Rajan, Ajitha↗
NASA NTRS2020

NASA quality assurance in an MBSE world

We explore the impact and consequences of the MBSE Value items discussed above and how they impact the disciplines of quality assurance, reliability and maintainability, system safety, and software assurance. We provide insight into how the MBSE modeling tools can be used to define S&MA processes (ideally as a result of Use Case [1] elaboration of processes represented in MagicDraw®), produce S&MA products (ViewEditor output of various items), and represent S&MA disciplines (S&MA inside of MagicDraw). We also provide insight into the degree to which some elements can be directly integrated into a SysML® model and when, as often happens, an interface to some external source must be provided.

Evans, John W.↗
NASA NTRS2006

SmaggIce Version 1.8

SmaggIce version 1.8 is a set of software tools for geometrical modeling of, and generation of grids that conform to, both clean and iced airfoils. Ice shapes, especially those that include rough surfaces, pose difficulty in generating high-quality grids that are essential for predicting airflows by use of computational fluid dynamics. SmaggIce version 1.8 contains software tools needed to overcome this difficulty. For a given airfoil, it allows the user to define the flow domain, decompose the domain into blocks, generate grids, merge gridded blocks, and control the density and smoothness of each grid. Among the unique features of version 1.8 is a thin C-shaped block, called a "viscous sublayer block," which is wrapped around an iced airfoil and its wake line and serves as a means to generate highly controlled grids near the rough ice surface. Users can modify block boundary shapes using control points of non-uniform rational B-spline (NURBS) curves. Concave ice regions can be smoothed during geometrical modeling or creation of the viscous sublayer block.

Vickerman, Mary B.↗
NASA NTRS2003

Applying Reflective Middleware Techniques to Optimize a QoS-enabled CORBA Component Model Implementation

Although existing CORBA specifications, such as Real-time CORBA and CORBA Messaging, address many end-to-end quality-of service (QoS) properties, they do not define strategies for configuring these properties into applications flexibly, transparently, and adaptively. Therefore, application developers must make these configuration decisions manually and explicitly, which is tedious, error-prone, and open sub-optimal. Although the recently adopted CORBA Component Model (CCM) does define a standard configuration framework for packaging and deploying software components, conventional CCM implementations focus on functionality rather than adaptive quality-of-service, which makes them unsuitable for next-generation applications with demanding QoS requirements. This paper presents three contributions to the study of middleware for QoS-enabled component-based applications. It outlines rejective middleware techniques designed to adaptively (1) select optimal communication mechanisms, (2) manage QoS properties of CORBA components in their contain- ers, and (3) (re)con$gure selected component executors dynamically. Based on our ongoing research on CORBA and the CCM, we believe the application of rejective techniques to component middleware will provide a dynamically adaptive and (re)configurable framework for COTS software that is well-suited for the QoS demands of next-generation applications.

Wang, Nanbor↗
DOE OSTI2020

MASTODON: An Open-Source Software for Seismic Analysis and Risk Assessment of Critical Infrastructure

Seismic analysis and risk assessment of safety-critical infrastructure like hospitals, nuclear power plants, dams, and facilities handling radioactive materials involve computationally intensive numerical models and coupled multiphysics scenarios. They are also performed in a strict regulatory environment that requires high software quality assurance standards, and in the case of safety-related nuclear facilities, a conformance to the American Society of Mechanical Engineers Nuclear Quality Assurance (NQA-1) standard. This paper introduces the open-source finite-element software, MASTODON (Multi-hazard Analysis of Stochastic Time-Domain Phenomena), which implements state-of-the-art seismic analysis and risk assessment tools in a quality-controlled environment. MASTODON is built on MOOSE (Multi-physics Object-Oriented Simulation Environment), which is a highly parallelizable, NQA-1 conforming, coupled multiphysics, finite-element framework developed at Idaho National Laboratory. MASTODON is capable of fault rupture and source-to-site wave propagation using the domain reduction method, nonlinear site response, and soil-structure interaction analysis, implicit and explicit time integration, automated stochastic simulations, and seismic probabilistic risk assessment. When coupled with other MOOSE applications, MASTODON can also solve strongly and weakly coupled multiphysics problems. This paper presents a summary of the capabilities of MASTODON and some demonstrative examples.

42 ENGINEERING↗
NASA NTRS2003

Optimizing IV and V for Mature Organizations

NASA is intending for its future software development agencies to have at least a Level 3 rating in the Carnegie Mellon University Capability Maturity Model (CMM). The CMM has built-in Verification and Validation (V&V) processes that support higher software quality. Independent Verification and Validation (IV&V) of software developed by mature agencies can be therefore more effective than for software developed by less mature organizations. How is Independent V&V different with respect to the maturity of an organization? Knowing a priori the maturity of an organization's processes, how can IV&V planners better identify areas of need choose IV&V activities, etc? The objective of this research is to provide a complementary set of guidelines and criteria to assist the planning of IV&V activities on a project using a priori knowledge of the measurable levels of maturity of the organization developing the software.

Fuhman, Christopher↗
NASA NTRS1990

Reuse metrics and measurement: A framework

The lessons learned and experience gleaned are described by those who have started to implement the reuse metrics and measurement framework used in controlling the development of common avionics and software for its affiliated aircraft programs. The framework was developed to permit the measurement of the long term cost/benefits resulting from the creation and use of Reusable Software Objects (RSOs). The framework also monitors the efficiency and effectiveness of the Software Reuse Library (SRL). The metrics and measurement framework is defined which was established to allow some determinations and findings to be made relative to software reuse. Seven criteria are discussed which were used to guide the establishment of the proposed reuse framework. Object recapture and creation metrics are explained along with their normalized use in effort, productivity, and quality determination. A single and multiple reuse instance version of a popular cost model is presented which uses these metrics and the measurement scheme proposed to predict the software effort and duration under various reuse assumptions. Studies in using this model to predict actuals taken from the RCI data base of over 1000 completed projects is discussed.

Reifer, Donald J.↗
DOE OSTI2020

A Comparison of RESRAD and GoldSim Models for Assessing Radiological Dose for a RCRA Landfill - 20418

US Ecology Idaho (USEI) operates a Resource Conservation and Recovery Act (RCRA) Subtitle C, Hazardous Waste Treatment, Storage, and Disposal (TSD) Facility on a 640-acre property in Owyhee County, Idaho. USEI accepts a wide variety of RCRA-exempt low activity radioactive wastes, including naturally occurring radioactive material (NORM) and technologically enhanced NORM (TENORM) (USEI 2009). The performance of the landfill with regard to radiological operating permit requirements was previously assessed using a model constructed with the residual radioactivity (RESRAD) computer program, developed by Argonne National Laboratory for the U.S. Department of Energy (DOE). RESRAD supports the evaluation of several environmental transport pathways related to a radionuclide-contaminated soil source term, but it was not conceived as a model for the evaluation of landfill radiological performance. A more comprehensive and realistic model is desired in order to better support submissions to both the State of Idaho's Department of Environmental Quality as well as the U.S. Nuclear Regulatory Commission. A Performance Assessment (PA) computer model was developed using GoldSim software for the USEI RCRA Subtitle C landfill. The RESRAD computer model was specifically developed for calculating soil cleanup criteria and radiological dose and cancer risk from residual radioactive material in soil. To evaluate site-specific conditions, users may select from among a number of available environmental transport and exposure pathways and modify 'default' parameter values. In GoldSim, a user must construct the model 'from scratch.' However, this modeling is facilitated by a number of specialized elements available in GoldSim to support a radiological mass transport model. These include elements for defining radiological decay and ingrowth, container failure and radiological release, advective and diffusive transport, and other processes. Advantages afforded by the use of RESRAD for modeling radiological dose for a RCRA Subtitle C landfill include ease of use and reasonable flexibility in specifying site-specific conditions. GoldSim allows for considerably more flexibility and site-specificity than RESRAD, including evaluation of potentially relevant environmental transport processes not supported in RESRAD. The probabilistic modeling capabilities of GoldSim also far exceed those of RESRAD. The pros and cons of RESRAD and GoldSim for this modeling problem are explored with a focus on identifying approaches and critical factors in identifying the appropriate platform. The capabilities of RESRAD and GoldSim for mathematically modeling the disposal system will be contrasted and compared. For example, the existing RESRAD radiological safety assessment evaluated potentially complete exposure pathways related to infiltration to groundwater and upwards diffusion of radon. Additional transport pathways identified in the USEI Idaho facility Conceptual Site Model include deposition of radon decay products in cover material, root uptake of radionuclides in disposed wastes by native plants, and mixing of cover material by burrowing animals. Results of the two models and how the different transport and dose pathways affect results will be discussed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Position Papers for the ASCR Workshop on Reimagining Codesign

On behalf of the Advanced Scientific Computing Research (ASCR) program in the US Department of Energy (DOE) Office of Science, we are organizing a Workshop on Reimagining Codesign (ReCoDe). Codesign is the process of jointly designing interoperating components of a computing system—in particular: applications, algorithms, system software, programming models, and the hardware on which they run. The goal is to maximize the overall performance, efficiency, and other desirable qualities of the system as a whole. Codesign is a standard methodology in the embedded-systems community, where space, power, and cost constraints are commonly pitted against execution speed for a tightly constrained feature set. Over the last decade, the DOE has invested in codesign efforts to foster the development of exascale computing systems for broad classes of scientific and engineering applications. The ReCoDe workshop hopes to explore how scientific applications of interest to the DOE can be accelerated through close interactions with hardware designers and software-stack developers, in which all components adapt to each other’s requirements and constraints. We want to answer the question of what are the key tools and methodologies for accomplishing codesign in today’s computing landscape, and what will be the highest impact targets for meeting DOE’s emerging mission requirements. This workshop aims to bring together DOE, industry, and academia to identify opportunities to build on past codesign successes and identify new areas that are either emerging or that may need reimagining for the future. We want to continue to find opportunities that can be pursued as a joint effort and continue to break down the traditional customer/vendor dichotomy with true partnerships. From this work, DOE will benefit from increased application performance relative to what stock hardware or existing general-purpose roadmaps can provide, and vendors will benefit from expanding their hardware’s capabilities to address needs they might have not otherwise anticipated and thereby create more widespread interest in their products. The workshop will be structured around a set of breakout sessions, with every attendee expected to participate actively in the discussions. Afterward, workshop attendees—from DOE, industry, and academia—will produce a report for ASCR that summarizes the findings made during the workshop.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Survey of Multizone Airflow Simulation Software

H-Canyon simulates the building and process ventilation to ensure positive contamination control for any modifications as well as evaluating off-normal conditions. Simulations can also be used to identify air quality of personnel occupied areas. The models can be classified into two groups, single and multi-zone models. As the name states, a single zone model assumes that the building can be described by a single, well-mixed zone. Whereas large buildings have structures that must be described as multizone. Multizone airflow models deal with the difficulty of flows in a building by distinguishing the effects of internal flow restrictions. Several models have been developed that take internal partitions into account. CONTAM (currently used) is a multizone airflow program created by NIST to determine airflows including infiltration, exfiltration, wind pressures acting outside the building, buoyancy effects caused by the indoor and outdoor air temperature difference. COMIS is a multizone air infiltration, ventilation, and contaminant transport model that was developed at Lawrence Berkeley National Laboratory. COMIS deals with applied pressure distribution, airflow components, HVAC systems, schedules, and contaminant transport. EnergyPlus is designed by DOE. It supports flexible component level configuration of HVAC models and simulates sub-hourly time steps to control fast dynamic systems. The program features include providing accurate environmental performance data including energy consumption and carbon emissions, and reporting solar gains on surfaces. Heavent is used to model industrial ventilation systems to control airborne contaminants. It's designed based on the American Conference of Governmental Industrial Hygienists (ACGIH) Ventilation manual. DesignBuilder is the most recognized and advanced user interface to EnergyPlus. It gives access to all of the most frequently required simulation capabilities covering building fabric, thermal mass, glazing, shading renewables, and HVAC analysis. The objective of this study is to identify all relevant software available including commercially licensed, freely licensed, and open source, that can be used to simulate large, complex process facility ventilation systems. All discovered software tools are evaluated for salient features and compared to the software tool currently used to simulate the H-Canyon ventilation system. The design criteria of a ventilation system has two basic requirements: Supplying fresh air for the occupants and changing the air in the room sufficiently; therefore, the smells, fumes, and contaminants will be removed. In this study, first, whether the software simulates airflow (infiltration, natural ventilation, and interzonal) or considers them to be inputs is discussed. Second, if indoor contaminant levels are considered; and finally suggestions on how airflow analysis can be more appropriately accounted for when performing airflow simulation of a building. All of the airflow software reviewed for this study can account for constant infiltration and natural ventilation rates that are not affected by changes in indoor and outdoor conditions. Modelling infiltration in EnergyPlus or DesignBuilder are applicable for small buildings and not appropriate for larger buildings like the H-Canyon. The effect of wind on external pressures, infiltration, and natural and mechanical ventilation, can also be calculated using all of these software. These programs have control options to switch between natural to mechanical ventilation modes or both (hybrid). Interzonal airflow can be applied which means one zone can be specified to receive a fixed amount of air from another zone. The following ventilation modeling software is recommended for further testing: CONTAM, COMIS, Heavent. The next step in evaluating the software will consist of creating test facility simulations using evaluation copies of the software.

42 ENGINEERING↗
DOE OSTI2023

NEWTS Coal Mine Drainage Dataset from Cravotta Brady (2015)

Data from Cravotta, Brady, "Priority pollutants and associated constituents in untreated and treated discharges from coal mining or processing facilities in Pennsylvania, USA". Applied Geochemistry, 2015. https://doi.org/10.1016/j.apgeochem.2015.03.001 Dataset includes information on water quality composition including inorganic compounds from untreated and treated streams of coal-mine discharge from coal mining and coal processing locations. Data is provided in the original version as well as in a summarized version for easy input into aqueous chemistry modeling software.

Aqueous Chemistry↗