SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2022

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗

NASA NTRS1999

Prebiotic Evolution of Nitrogen Compounds

Support from this four year grant has funded our research on two general problems. One involves attempts to model the abiotic formation of simple source compounds for functional biomolecules, their concentration from dilute state in the hydrosphere and, in several cases, surface induced reactions to form precursor monomers for bioactive end products (refs. 1-5). Because of the pervasiveness and antiquity of phosphate based biochemistry and the catalytic activity of RNA we have exploring the hypothesis of an RNA World as an early stage in the emergence of life. This concept is now rather generally considered, but has been questioned due to the earlier lack of an experimentally demonstrated successful scheme for the spontaneous formation of ribose phosphate, the key backbone molecule in RNA. That impediment has now been removed. This has been achieved by demonstrating probable sources of activated (condensed) highly soluble and strongly sorbed phosphates in nature (Refs. 1,2) and effective condensation of aldehyde phosphates to form ribose phosphate in high yield (ref.6), thereby placing the RNA World concept on a somewhat safer experimental footing. Like all work in this field these experiments are oversimplifications that largely ignore competing side reactions with other compounds expected to be present. None the less our choice of experimental conditions aim at selective processes that eliminate interfering reactions. We have also sought to narrow the credibility gap by simulating geophysically and geochemically plausible conditions surrounding the putative prebiotic reactions.

Arrhenius, G.↗

NASA NTRS2001

Effect of Under-Resolved Grids on High Order Methods

There has been much discussion on verification and validation processes for establishing the credibility of CFD simulations. Since the early 1990s, many of the aeronautical and mechanical engineering related reference journals mandated that any accepted articles in numerical simulations (without known solutions to compared with) need to perform a minimum of one level of grid refinement and time step reduction. Due to the difficulty in analysis, the effect of under-resolved grids and the nonlinear behavior of available spatial discretizations, are scarcely discussed in the literature. Here, an under-resolved numerical simulation is one where the grid spacing being used is too coarse to resolve the smallest physically relevant scales of the chosen continuum governing equations that are of interest to the numerical modeler. With the advent of new developments in fourth-order or higher spatial schemes, it has become common to regard high order schemes as more accurate, reliable and require less grid points. The danger comes when one tries to perform computations with the coarsest grid possible while still hoping to maintain numerical results sufficiently accurate for complex flows, and especially, data-limited problems. On one hand, high order methods when applies to highly coupled multidimensional complex nonlinear problems might have different stability, convergence and reliability behavior than their well studied low order counterparts, especially for nonlinear schemes such as TVD, MUSCL with limiters, ENO, WENO and discrete Galerkin. On the other hand, high order methods involve more operation counts and systematic grid convergence study can be time consuming and prohibitively expansive. At the same time it is difficult to fully understand or categorize the different nonlinear behavior of finite discretizations, especially at the limits of under-resolution when different types of bifurcation phenomena might occur, depending on the combination of grid spacings, time steps, initial conditions and numerical treatments of boundary conditions.

Yee, H. C.↗

NASA NTRS2011

JPL Thermal Design Modeling Philosophy and NASA-STD-7009 Standard for Models and Simulations - A Case Study

The Standard JPL thermal engineering practice prescribes worst-case methodologies for design. In this process, environmental and key uncertain thermal parameters (e.g., thermal blanket performance, interface conductance, optical properties) are stacked in a worst case fashion to yield the most hot- or cold-biased temperature. Thus, these simulations would represent the upper and lower bounds. This, effectively, represents JPL thermal design margin philosophy. Uncertainty in the margins and the absolute temperatures is usually estimated by sensitivity analyses and/or by comparing the worst-case results with "expected" results. Applicability of the analytical model for specific design purposes along with any temperature requirement violations are documented in peer and project design review material. In 2008, NASA released NASA-STD-7009, Standard for Models and Simulations. The scope of this standard covers the development and maintenance of models, the operation of simulations, the analysis of the results, training, recommended practices, the assessment of the Modeling and Simulation (M&S) credibility, and the reporting of the M&S results. The Mars Exploration Rover (MER) project thermal control system M&S activity was chosen as a case study determining whether JPL practice is in line with the standard and to identify areas of non-compliance. This paper summarizes the results and makes recommendations regarding the application of this standard to JPL thermal M&S practices.

thermal blanket performance↗

NASA NTRS2008

Development of NASA's Models and Simulations Standard

From the Space Shuttle Columbia Accident Investigation, there were several NASA-wide actions that were initiated. One of these actions was to develop a standard for development, documentation, and operation of Models and Simulations. Over the course of two-and-a-half years, a team of NASA engineers, representing nine of the ten NASA Centers developed a Models and Simulation Standard to address this action. The standard consists of two parts. The first is the traditional requirements section addressing programmatics, development, documentation, verification, validation, and the reporting of results from both the M&S analysis and the examination of compliance with this standard. The second part is a scale for evaluating the credibility of model and simulation results using levels of merit associated with 8 key factors. This paper provides an historical account of the challenges faced by and the processes used in this committee-based development effort. This account provides insights into how other agencies might approach similar developments. Furthermore, we discuss some specific applications of models and simulations used to assess the impact of this standard on future model and simulation activities.

simulation↗

NASA NTRS2004

Stratospheric Impact of Varying Sea Surface Temperatures

The Finite-Volume General Circulation Model (FVGCM) has been run in 50 year simulations with the: 1) 1949-1999 Hadley Centre sea surface temperatures (SST), and 2) a fixed annual cycle of SSTs. In this presentation we first show that the 1949-1999 FVGCM simulation produces a very credible stratosphere in comparison to an NCEP/NCAR reanalysis climatology. In particular, the northern hemisphere has numerous major and minor stratospheric warming, while the southern hemisphere has only a few over the 50-year simulation. During the northern hemisphere winter, temperatures are both warmer in the lower stratosphere and the polar vortex is weaker than is found in the mid-winter southern hemisphere. Mean temperature differences in the lower stratosphere are shown to be small (less than 2 K), and planetary wave forcing is found to be very consistent with the climatology. We then will show the differences between our varying SST simulation and the fixed SST simulation in both the dynamics and in two parameterized trace gases (ozone and methane). In general, differences are found to be small, with subtle changes in planetary wave forcing that lead to reduced temperatures in the SH and increased temperatures in the NH.

Newman, Paul A.↗

NASA NTRS1978

A method motion simulator design based on modeling characteristics of the human operator

A design criteria is obtained to compare two simulators and evaluate their equivalence or credibility. In the subsequent analysis the comparison of two simulators can be considered as the same problem as the comparison of a real world situation and a simulation's representation of this real world situation. The design criteria developed involves modeling of the human operator and defining simple parameters to describe his behavior in the simulator and in the real world situation. In the process of obtaining human operator parameters to define characteristics to evaluate simulators, measures are also obtained on these human operator characteristics which can be used to describe the human as an information processor and controller. First, a study is conducted on the simulator design problem in such a manner that this modeling approach can be used to develop a criteria for the comparison of two simulators.

Repperger, D. W.↗

NASA NTRS2000

Towards a Comprehensive Dynamic-chemistry Assimilation for Eos-Chem: Plans and Status in NASA's Data Assimilation Office

In order to support the EOS-Chem project, a comprehensive assimilation package for the coupled chemical-dynamical system is being developed by the Data Assimilation Office at NASA GSFC. This involves development of a coupled chemistry/meteorology model and of data assimilation techniques for trace species and meteorology. The model is being developed using the flux-form semi-Lagrangian dynamical core of Lin and Rood, the physical parameterizations from the NCAR Community Climate Model, and atmospheric chemistry modules from the Atmospheric Chemistry and Dynamics branch at NASA GSFC. To date the following results have been obtained: (i) multi-annual simulations with the dynamics-radiation model show the credibility of the package for atmospheric simulations; (ii) initial simulations including a limited number of middle atmospheric trace gases reveal the realistic nature of transport mechanisms, although there is still a need for some improvements. Samples of these results will be shown. A meteorological assimilation system is currently being constructed using the model; this will form the basis for the proposed meteorological/chemical assimilation package. The latter part of the presentation will focus on areas targeted for development in the near and far terms, with the objective of Providing a comprehensive assimilation package for the EOS-Chem science experiment. The first stage will target ozone assimilation. The plans also encompass a reanalysis (ReSTS) for the 1991-1995 period, which includes the Mt. Pinatubo eruption and the time when a large number of UARS observations were available. One of the most challenging aspects of future developments will be to couple theoretical advances in tracer assimilation with the practical considerations of a real environment and eventually a near-real-time assimilation system.

Pawson, Steven↗

NASA NTRS2017

Simulation of the Ozone Monitoring Instrument Aerosol Index Using the NASA Goddard Earth Observing System Aerosol Reanalysis Products

We provide an analysis of the commonly used Ozone Monitoring Instrument (OMI) aerosol index (AI) product for qualitative detection of the presence and loading of absorbing aerosols. In our analysis, simulated top-of-atmosphere (TOA) radiances are produced at the OMI footprints from a model atmosphere and aerosol profile provided by the NASA Goddard Earth Observing System (GEOS-5) Modern-Era Retrospective Analysis for Research and Applications aerosol reanalysis (MERRAero). Having established the credibility of the MERRAero simulation of the OMI AI in a previous paper we describe updates in the approach and aerosol optical property assumptions. The OMI TOA radiances are computed in cloud-free conditions from the MERRAero atmospheric state, and the AI is calculated. The simulated TOA radiances are fed to the OMI aerosol retrieval algorithms, and its retrieved AI (OMAERUV AI) is compared to the MERRAero calculated AI. Two main sources of discrepancy are discussed: one pertaining the OMI algorithm assumptions of the surface pressure, which are generally different from what the actual surface pressure of an observation is, and the other related to simplifying assumptions in the molecular atmosphere radiative transfer used in the OMI algorithms. Surface pressure assumptions lead to systematic biases in the OMAERUV AI, particularly over the oceans. Simplifications in the molecular radiative transfer lead to biases particularly in regions of topography intermediate to surface pressures of 600hPa and 1013.25hPa. Generally, the errors in the OMI AI due to these considerations are less than 0.2 in magnitude, though larger errors are possible, particularly over land. We recommend that future versions of the OMI algorithms use surface pressures from readily available atmospheric analyses combined with high-spatial resolution topographic maps and include more surface pressure nodal points in their radiative transfer lookup tables.

remote sensing↗

NASA NTRSDate not supplied

Quantifying the Sensitivity of Condition Incidence Parameters in the Evidence Library

One approach to quantifying spaceflight risk at NASA makes use event driven probabilistic techniques. The Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) is such a tool that estimates medical risk metrics via simulation and enables optimization of medical resources subject to mission constraints [1]. Previous analyses have informed medical set composition, exercise countermeasures, and water intake, where each analysis quantifies the risk associated with proposed variations in system design. As future mission profiles extend beyond Low-Earth Orbit (LEO) and lengthen in duration, understanding these risks and contributing factors is critical. MEDPRAT employs Monte Carlo sampling techniques to simulate missions and track the occurrence of medical events. These events follow fault-tree-like progressions through levels of severity and mitigation via medical treatment to many possible outcomes and these are reported throughout the mission. Making this possible, are the medical databases that contain evidence gathered by the Human Research Program (HRP). Quantifying the impact of uncertainty or variability in the input data is an important step in evaluating the credibility of modeling and simulation results. In this work, we investigate the sensitivity of medical risk metrics with respect to the condition incidence parameters within the Evidence Library (EL) [2] as the medical database input for MEDPRAT. The medical conditions, contained in the EL, are equipped with incidence rates that describe the likelihood that the condition will occur. These incidence rates reflect historical spaceflight data or when appropriate, terrestrial data. In this presentation, we will explore how uncertainty in these rates propagate to the medical risk described by MEDPRAT. These results identify the conditions and parameters with the largest contribution to medical risks.

Ian Lim↗

NASA NTRS2014

HRP's Healthcare Spin-Offs Through Computational Modeling and Simulation Practice Methodologies

Spaceflight missions expose astronauts to novel operational and environmental conditions that pose health risks that are currently not well understood, and perhaps unanticipated. Furthermore, given the limited number of humans that have flown in long duration missions and beyond low Earth-orbit, the amount of research and clinical data necessary to predict and mitigate these health and performance risks are limited. Consequently, NASA's Human Research Program (HRP) conducts research and develops advanced methods and tools to predict, assess, and mitigate potential hazards to the health of astronauts. In this light, NASA has explored the possibility of leveraging computational modeling since the 1970s as a means to elucidate the physiologic risks of spaceflight and develop countermeasures. Since that time, substantial progress has been realized in this arena through a number of HRP funded activates such as the Digital Astronaut Project (DAP) and the Integrated Medical Model (IMM). Much of this success can be attributed to HRP's endeavor to establish rigorous verification, validation, and credibility (VV&C) processes that ensure computational models and simulations (M&S) are sufficiently credible to address issues within their intended scope. This presentation summarizes HRP's activities in credibility of modeling and simulation, in particular through its outreach to the community of modeling and simulation practitioners. METHODS: The HRP requires all M&S that can have moderate to high impact on crew health or mission success must be vetted in accordance to NASA Standard for Models and Simulations, NASA-STD-7009 (7009) [5]. As this standard mostly focuses on engineering systems, the IMM and DAP have invested substantial efforts to adapt the processes established in this standard for their application to biological M&S, which is more prevalent in human health and performance (HHP) and space biomedical research and operations [6,7]. These methods have also generated substantial interest by the broader medical community though institutions like the National Institutes of Health (NIH) and the Food and Drug Administration (FDA) to develop similar standards and guidelines applicable to the larger medical operations and research community. DISCUSSION: Similar to NASA, many leading government agencies, health institutions and medical product developers around the world are recognizing the potential of computational M&S to support clinical research and decision making. In this light, substantial investments are being made in computational medicine and notable discoveries are being realized [8]. However, there is a lack of broadly applicable practice guidance for the development and implementation of M&S in clinical care and research in a manner that instills confidence among medical practitioners and biological researchers [9,10]. In this presentation, we will give an overview on how HRP is working with the NIH's Interagency Modeling and Analysis Group (IMAG), the FDA and the American Society of Mechanical Engineers (ASME) to leverage NASA's biomedical VV&C processes to establish a new regulatory standard for Verification and Validation in Computational Modeling of Medical Devices, and Guidelines for Credible Practice of Computational Modeling and Simulation in Healthcare.

Mulugeta, Lealem↗

NASA NTRS2019

2018-2019 Mid-Term Credibility Plan Review

This presentation summarizes the Interagency Modeling and Analysis Group (IMAG) / Multiscale Modeling (MSM)'s Committee on Credible Practice in Modeling and Simulation in Healthcare's (CPMS) mid-term review of each MSM U01 project's progress toward fulfilling their Model Credibility plan. Generally, the model credibility reporting and update process utilized several pieces of information formatted to communicate to the uninformed reviewer/user an assessment of steps taken toward model credibility with respect to the intended use of each U01 model, as well as communicate where the more interested reviewer/user can go to find more information. The reviewers, consisting of the members of the CPMS Executive Committee, focused on the documentation and communication of each PI's credibility efforts and did not perform an assessment of the implemented credible practice given the evolving nature of the projects. In this inaugural activity, the CPMS members sought insight on how PIs may view the importance of communicating credibility, as well as how PIs interpret establishing evidence for credibility within the scope of CPMS Tens simple rules. To that end, reviewers provided feedback on documentation and communication adequacy, and, only in few rare cases, on the credible practice itself.

Myers, Jerry↗

NASA NTRS2013

NASA Handbook for Models and Simulations: An Implementation Guide for NASA-STD-7009

The purpose of this Handbook is to provide technical information, clarification, examples, processes, and techniques to help institute good modeling and simulation practices in the National Aeronautics and Space Administration (NASA). As a companion guide to NASA-STD- 7009, Standard for Models and Simulations, this Handbook provides a broader scope of information than may be included in a Standard and promotes good practices in the production, use, and consumption of NASA modeling and simulation products. NASA-STD-7009 specifies what a modeling and simulation activity shall or should do (in the requirements) but does not prescribe how the requirements are to be met, which varies with the specific engineering discipline, or who is responsible for complying with the requirements, which depends on the size and type of project. A guidance document, which is not constrained by the requirements of a Standard, is better suited to address these additional aspects and provide necessary clarification. This Handbook stems from the Space Shuttle Columbia Accident Investigation (2003), which called for Agency-wide improvements in the "development, documentation, and operation of models and simulations"' that subsequently elicited additional guidance from the NASA Office of the Chief Engineer to include "a standard method to assess the credibility of the models and simulations."2 General methods applicable across the broad spectrum of model and simulation (M&S) disciplines were sought to help guide the modeling and simulation processes within NASA and to provide for consistent reporting ofM&S activities and analysis results. From this, the standardized process for the M&S activity was developed. The major contents of this Handbook are the implementation details of the general M&S requirements ofNASA-STD-7009, including explanations, examples, and suggestions for improving the credibility assessment of an M&S-based analysis.

Steele, Martin J.↗

NASA NTRS2003

Rapid Prototyping of an Aircraft Model in an Object-Oriented Simulation

A team was created to participate in the Mars Scout Opportunity. Trade studies determined that an aircraft provided the best opportunity to complete the science objectives of the team. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The team created the simulation using the Langley Standard Real-Time Simulation in C++ (LaSRS++) application framework. A rapid prototyping approach was necessary because the team had only three months to both develop the aircraft simulation model and evaluate aircraft performance as the design and mission parameters matured. The design of LaSRS++ enabled rapid-prototyping in several ways. First, the framework allowed component models to be designed, implemented, unit-tested, and integrated quickly. Next, the framework provides a highly reusable infrastructure that allowed developers to maximize code reuse while concentrating on aircraft and mission specific features. Finally, the framework reduces risk by providing reusable components that allow developers to build a quality product with a compressed testing cycle that relies heavily on unit testing of new components.

Kenney, P. Sean↗

NASA NTRS2006

An Overview of NASA's Program of Future M&S VV&A Outreach and Training Activities

NASA's Exploration Systems Mission Directorate (ESMD) is implementing a management approach for modeling and simulation (M&S) that will provide decision-makers information on the model s fidelity, credibility, and quality. The Integrated Modeling & Simulation Verification, Validation and Accreditation (IM&S W&A) process will allow the decision-maker to understand the risks involved in using a model s results for mission-critical decisions. The W&A Technical Working Group (W&A TWG) has been identified to communicate this process throughout the agency. As the W&A experts, the W&A NVG will be the central resource for support of W&A policy, procedures, training and templates for documentation. This presentation will discuss the W&A Technical Working Group s outreach approach aimed at educating M&S program managers, developers, users and proponents on the W&A process, beginning at MSFC with the CLV program.

Caine, Lisa↗

NASA NTRS2003

Evaluating the Credibility of Transport Processes in the Global Modeling Initiative 3D Model Simulations of Ozone Recovery

The Global Modeling Initiative has integrated two 35-year simulations of an ozone recovery scenario with an offline chemistry and transport model using two different meteorological inputs. Physically based diagnostics, derived from satellite and aircraft data sets, are described and then used to evaluate the realism of temperature and transport processes in the simulations. Processes evaluated include barrier formation in the subtropics and polar regions, and extratropical wave-driven transport. Some diagnostics are especially relevant to simulation of lower stratospheric ozone, but most are applicable to any stratospheric simulation. The temperature evaluation, which is relevant to gas phase chemical reactions, showed that both sets of meteorological fields have near climatological values at all latitudes and seasons at 30 hPa and below. Both simulations showed weakness in upper stratospheric wave driving. The simulation using input from a general circulation model (GMI(sub GCM)) showed a very good residual circulation in the tropics and northern hemisphere. The simulation with input from a data assimilation system (GMI(sub DAS)) performed better in the midlatitudes than at high latitudes. Neither simulation forms a realistic barrier at the vortex edge, leading to uncertainty in the fate of ozone-depleted vortex air. Overall, tracer transport in the offline GMI(sub GCM) has greater fidelity throughout the stratosphere than the GMI(sub DAS).

Strahan, Susan E.↗

NASA NTRS1977

Method for obtaining aerodynamic data on hypersonic configurations with scramjet exhaust flow simulation

A hypersonic wind tunnel test method for obtaining credible aerodynamic data on a complete hypersonic vehicle (generic X-24c) with scramjet exhaust flow simulation is described. The general problems of simulating the scramjet exhaust as well as accounting for scramjet inlet flow and vehicle forces are analyzed, and candidate test methods are described and compared. The method selected as most useful makes use of a thrust-minus-drag flow-through balance with a completely metric model. Inlet flow is diverted by a fairing. The incremental effect of the fairing is determined in the testing of two reference models. The net thrust of the scramjet module is an input to be determined in large-scale module tests with scramjet combustion. Force accounting is described, and examples of force component levels are predicted. Compatibility of the test method with candidate wind tunnel facilities is described, and a preliminary model mechanical arrangement drawing is presented. The balance design and performance requirements are described in a detailed specification. Calibration procedures, model instrumentation, and a test plan for the model are outlined.

Hartill, W. R.↗

NASA NTRS2007

The Roles of Verification, Validation and Uncertainty Quantification in the NASA Standard for Models and Simulations

The National Aeronautics and Space Administration (NASA) recently issued an interim version of the Standard for Models and Simulations (M&S Standard) [1]. The action to develop the M&S Standard was identified in an internal assessment [2] of agency-wide changes needed in the wake of the Columbia Accident [3]. The primary goal of this standard is to ensure that the credibility of M&S results is properly conveyed to those making decisions affecting human safety or mission success criteria. The secondary goal is to assure that the credibility of the results from models and simulations meets the project requirements (for credibility). This presentation explains the motivation and key aspects of the M&S Standard, with a special focus on the requirements for verification, validation and uncertainty quantification. Some pilot applications of this standard to computational fluid dynamics applications will be provided as illustrations. The authors of this paper are the members of the team that developed the initial three drafts of the standard, the last of which benefited from extensive comments from most of the NASA Centers. The current version (number 4) incorporates modifications made by a team representing 9 of the 10 NASA Centers. A permanent version of the M&S Standard is expected by December 2007. The scope of the M&S Standard is confined to those uses of M&S that support program and project decisions that may affect human safety or mission success criteria. Such decisions occur, in decreasing order of importance, in the operations, the test & evaluation, and the design & analysis phases. Requirements are placed on (1) program and project management, (2) models, (3) simulations and analyses, (4) verification, validation and uncertainty quantification (VV&UQ), (5) recommended practices, (6) training, (7) credibility assessment, and (8) reporting results to decision makers. A key component of (7) and (8) is the use of a Credibility Assessment Scale, some of the details of which were developed in consultation with William Oberkampf, David Peercy and Timothy Trocano of Sandia National Laboratories. The focus of most of the requirements, including those for VV&UQ, is on the documentation of what was done and the reporting, using the Credibility Assessment Scale, of the level of rigor that was followed. The aspects of one option for the Credibilty Assessment Scale are (1) code verification, (2) solution verification, (3) validation, (4) predictive capability, (5) technical review, (6) process control, and (7) operator and analyst qualification.

Zang, Thomas A.↗