Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Simulation of Deuterium Oxidation in a Room with a Fire

A series of experiments where deuterium was released in trace amounts into a room with a fire were performed at Sandia National Laboratories. This report describes the corresponding effort to model the test series using SIERRA/FUEGO. The objective of this modeling effort was to produce a simulation test matrix that can be utilized to help interpret the corresponding experiments and be used to assess the credibility of using the SIERRA/FUEGO simulations as a surrogate for real tritium reaction data for mock fire and release studies. The simulations assessed multiple configurations of fire size and location and overall found that there was low conversion of deuterium to oxidized deuterium. There are some notable differences between the simulation predictions and the experimental results, such as the simulations generally predicting higher amounts of deuterium conversion compared to the experiment. A strategy to address modeling uncertainties and unknowns is also given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2014

HRP's Healthcare Spin-Offs Through Computational Modeling and Simulation Practice Methodologies

Spaceflight missions expose astronauts to novel operational and environmental conditions that pose health risks that are currently not well understood, and perhaps unanticipated. Furthermore, given the limited number of humans that have flown in long duration missions and beyond low Earth-orbit, the amount of research and clinical data necessary to predict and mitigate these health and performance risks are limited. Consequently, NASA's Human Research Program (HRP) conducts research and develops advanced methods and tools to predict, assess, and mitigate potential hazards to the health of astronauts. In this light, NASA has explored the possibility of leveraging computational modeling since the 1970s as a means to elucidate the physiologic risks of spaceflight and develop countermeasures. Since that time, substantial progress has been realized in this arena through a number of HRP funded activates such as the Digital Astronaut Project (DAP) and the Integrated Medical Model (IMM). Much of this success can be attributed to HRP's endeavor to establish rigorous verification, validation, and credibility (VV&C) processes that ensure computational models and simulations (M&S) are sufficiently credible to address issues within their intended scope. This presentation summarizes HRP's activities in credibility of modeling and simulation, in particular through its outreach to the community of modeling and simulation practitioners. METHODS: The HRP requires all M&S that can have moderate to high impact on crew health or mission success must be vetted in accordance to NASA Standard for Models and Simulations, NASA-STD-7009 (7009) [5]. As this standard mostly focuses on engineering systems, the IMM and DAP have invested substantial efforts to adapt the processes established in this standard for their application to biological M&S, which is more prevalent in human health and performance (HHP) and space biomedical research and operations [6,7]. These methods have also generated substantial interest by the broader medical community though institutions like the National Institutes of Health (NIH) and the Food and Drug Administration (FDA) to develop similar standards and guidelines applicable to the larger medical operations and research community. DISCUSSION: Similar to NASA, many leading government agencies, health institutions and medical product developers around the world are recognizing the potential of computational M&S to support clinical research and decision making. In this light, substantial investments are being made in computational medicine and notable discoveries are being realized [8]. However, there is a lack of broadly applicable practice guidance for the development and implementation of M&S in clinical care and research in a manner that instills confidence among medical practitioners and biological researchers [9,10]. In this presentation, we will give an overview on how HRP is working with the NIH's Interagency Modeling and Analysis Group (IMAG), the FDA and the American Society of Mechanical Engineers (ASME) to leverage NASA's biomedical VV&C processes to establish a new regulatory standard for Verification and Validation in Computational Modeling of Medical Devices, and Guidelines for Credible Practice of Computational Modeling and Simulation in Healthcare.

Mulugeta, Lealem↗
DOE OSTI2025

Physical Review Journal Club: Structural uncertainty assessment for fire-engulfed objects in crosswind: Establishing credibility for a multiphysics wall-modeled large-eddy simulation paradigm

This is an invited presentation for APS's monthly Journal Club where important papers that have recently been accepted for publication are highlighted in a seminar-like setting. The presentation will be "live" (May 1, 2025) and streamed across the world (including an archived recording).

Domino, Stefan Paul [Sandia National Laboratories ↗
NASA NTRS2019

2018-2019 Mid-Term Credibility Plan Review

This presentation summarizes the Interagency Modeling and Analysis Group (IMAG) / Multiscale Modeling (MSM)'s Committee on Credible Practice in Modeling and Simulation in Healthcare's (CPMS) mid-term review of each MSM U01 project's progress toward fulfilling their Model Credibility plan. Generally, the model credibility reporting and update process utilized several pieces of information formatted to communicate to the uninformed reviewer/user an assessment of steps taken toward model credibility with respect to the intended use of each U01 model, as well as communicate where the more interested reviewer/user can go to find more information. The reviewers, consisting of the members of the CPMS Executive Committee, focused on the documentation and communication of each PI's credibility efforts and did not perform an assessment of the implemented credible practice given the evolving nature of the projects. In this inaugural activity, the CPMS members sought insight on how PIs may view the importance of communicating credibility, as well as how PIs interpret establishing evidence for credibility within the scope of CPMS Tens simple rules. To that end, reviewers provided feedback on documentation and communication adequacy, and, only in few rare cases, on the credible practice itself.

Myers, Jerry↗
NASA NTRS2013

NASA Handbook for Models and Simulations: An Implementation Guide for NASA-STD-7009

The purpose of this Handbook is to provide technical information, clarification, examples, processes, and techniques to help institute good modeling and simulation practices in the National Aeronautics and Space Administration (NASA). As a companion guide to NASA-STD- 7009, Standard for Models and Simulations, this Handbook provides a broader scope of information than may be included in a Standard and promotes good practices in the production, use, and consumption of NASA modeling and simulation products. NASA-STD-7009 specifies what a modeling and simulation activity shall or should do (in the requirements) but does not prescribe how the requirements are to be met, which varies with the specific engineering discipline, or who is responsible for complying with the requirements, which depends on the size and type of project. A guidance document, which is not constrained by the requirements of a Standard, is better suited to address these additional aspects and provide necessary clarification. This Handbook stems from the Space Shuttle Columbia Accident Investigation (2003), which called for Agency-wide improvements in the "development, documentation, and operation of models and simulations"' that subsequently elicited additional guidance from the NASA Office of the Chief Engineer to include "a standard method to assess the credibility of the models and simulations."2 General methods applicable across the broad spectrum of model and simulation (M&S) disciplines were sought to help guide the modeling and simulation processes within NASA and to provide for consistent reporting ofM&S activities and analysis results. From this, the standardized process for the M&S activity was developed. The major contents of this Handbook are the implementation details of the general M&S requirements ofNASA-STD-7009, including explanations, examples, and suggestions for improving the credibility assessment of an M&S-based analysis.

Steele, Martin J.↗
NASA NTRS2003

Rapid Prototyping of an Aircraft Model in an Object-Oriented Simulation

A team was created to participate in the Mars Scout Opportunity. Trade studies determined that an aircraft provided the best opportunity to complete the science objectives of the team. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The team created the simulation using the Langley Standard Real-Time Simulation in C++ (LaSRS++) application framework. A rapid prototyping approach was necessary because the team had only three months to both develop the aircraft simulation model and evaluate aircraft performance as the design and mission parameters matured. The design of LaSRS++ enabled rapid-prototyping in several ways. First, the framework allowed component models to be designed, implemented, unit-tested, and integrated quickly. Next, the framework provides a highly reusable infrastructure that allowed developers to maximize code reuse while concentrating on aircraft and mission specific features. Finally, the framework reduces risk by providing reusable components that allow developers to build a quality product with a compressed testing cycle that relies heavily on unit testing of new components.

Kenney, P. Sean↗
NASA NTRS2006

An Overview of NASA's Program of Future M&S VV&A Outreach and Training Activities

NASA's Exploration Systems Mission Directorate (ESMD) is implementing a management approach for modeling and simulation (M&S) that will provide decision-makers information on the model s fidelity, credibility, and quality. The Integrated Modeling & Simulation Verification, Validation and Accreditation (IM&S W&A) process will allow the decision-maker to understand the risks involved in using a model s results for mission-critical decisions. The W&A Technical Working Group (W&A TWG) has been identified to communicate this process throughout the agency. As the W&A experts, the W&A NVG will be the central resource for support of W&A policy, procedures, training and templates for documentation. This presentation will discuss the W&A Technical Working Group s outreach approach aimed at educating M&S program managers, developers, users and proponents on the W&A process, beginning at MSFC with the CLV program.

Caine, Lisa↗
NASA NTRS2003

Evaluating the Credibility of Transport Processes in the Global Modeling Initiative 3D Model Simulations of Ozone Recovery

The Global Modeling Initiative has integrated two 35-year simulations of an ozone recovery scenario with an offline chemistry and transport model using two different meteorological inputs. Physically based diagnostics, derived from satellite and aircraft data sets, are described and then used to evaluate the realism of temperature and transport processes in the simulations. Processes evaluated include barrier formation in the subtropics and polar regions, and extratropical wave-driven transport. Some diagnostics are especially relevant to simulation of lower stratospheric ozone, but most are applicable to any stratospheric simulation. The temperature evaluation, which is relevant to gas phase chemical reactions, showed that both sets of meteorological fields have near climatological values at all latitudes and seasons at 30 hPa and below. Both simulations showed weakness in upper stratospheric wave driving. The simulation using input from a general circulation model (GMI(sub GCM)) showed a very good residual circulation in the tropics and northern hemisphere. The simulation with input from a data assimilation system (GMI(sub DAS)) performed better in the midlatitudes than at high latitudes. Neither simulation forms a realistic barrier at the vortex edge, leading to uncertainty in the fate of ozone-depleted vortex air. Overall, tracer transport in the offline GMI(sub GCM) has greater fidelity throughout the stratosphere than the GMI(sub DAS).

Strahan, Susan E.↗
NASA NTRS1977

Method for obtaining aerodynamic data on hypersonic configurations with scramjet exhaust flow simulation

A hypersonic wind tunnel test method for obtaining credible aerodynamic data on a complete hypersonic vehicle (generic X-24c) with scramjet exhaust flow simulation is described. The general problems of simulating the scramjet exhaust as well as accounting for scramjet inlet flow and vehicle forces are analyzed, and candidate test methods are described and compared. The method selected as most useful makes use of a thrust-minus-drag flow-through balance with a completely metric model. Inlet flow is diverted by a fairing. The incremental effect of the fairing is determined in the testing of two reference models. The net thrust of the scramjet module is an input to be determined in large-scale module tests with scramjet combustion. Force accounting is described, and examples of force component levels are predicted. Compatibility of the test method with candidate wind tunnel facilities is described, and a preliminary model mechanical arrangement drawing is presented. The balance design and performance requirements are described in a detailed specification. Calibration procedures, model instrumentation, and a test plan for the model are outlined.

Hartill, W. R.↗
DOE OSTI2025

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
NASA NTRS2007

The Roles of Verification, Validation and Uncertainty Quantification in the NASA Standard for Models and Simulations

The National Aeronautics and Space Administration (NASA) recently issued an interim version of the Standard for Models and Simulations (M&S Standard) [1]. The action to develop the M&S Standard was identified in an internal assessment [2] of agency-wide changes needed in the wake of the Columbia Accident [3]. The primary goal of this standard is to ensure that the credibility of M&S results is properly conveyed to those making decisions affecting human safety or mission success criteria. The secondary goal is to assure that the credibility of the results from models and simulations meets the project requirements (for credibility). This presentation explains the motivation and key aspects of the M&S Standard, with a special focus on the requirements for verification, validation and uncertainty quantification. Some pilot applications of this standard to computational fluid dynamics applications will be provided as illustrations. The authors of this paper are the members of the team that developed the initial three drafts of the standard, the last of which benefited from extensive comments from most of the NASA Centers. The current version (number 4) incorporates modifications made by a team representing 9 of the 10 NASA Centers. A permanent version of the M&S Standard is expected by December 2007. The scope of the M&S Standard is confined to those uses of M&S that support program and project decisions that may affect human safety or mission success criteria. Such decisions occur, in decreasing order of importance, in the operations, the test & evaluation, and the design & analysis phases. Requirements are placed on (1) program and project management, (2) models, (3) simulations and analyses, (4) verification, validation and uncertainty quantification (VV&UQ), (5) recommended practices, (6) training, (7) credibility assessment, and (8) reporting results to decision makers. A key component of (7) and (8) is the use of a Credibility Assessment Scale, some of the details of which were developed in consultation with William Oberkampf, David Peercy and Timothy Trocano of Sandia National Laboratories. The focus of most of the requirements, including those for VV&UQ, is on the documentation of what was done and the reporting, using the Credibility Assessment Scale, of the level of rigor that was followed. The aspects of one option for the Credibilty Assessment Scale are (1) code verification, (2) solution verification, (3) validation, (4) predictive capability, (5) technical review, (6) process control, and (7) operator and analyst qualification.

Zang, Thomas A.↗
NASA NTRS2003

Simulating the ARES Aircraft in the Mars Environment

NASA Langley proposed the Aerial Regional-scale Environmental Survey (ARES) of Mars science mission in response to the NASA Office of Space Science 2002 Mars Scout Opportunity. The science-driven mission proposal began with trade studies and determined that a rocket powered aircraft was the best suited platform to complete the ARES science objectives. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The aircraft was initially modeled using the aero, propulsion, and flight control system components of other aircraft models. As the proposed aircraft design evolved, the borrowed components were replaced with new models. This allowed performance evaluations to be performed as the design was maturing. Basic autopilot features were also developed for the ARES aircraft model. Altitude hold and track hold modes allowed different mission scenarios to be evaluated for both science merit and aircraft performance. Platform stability and data rate requirements were identified for each of the instruments and the aircraft performance was evaluated against those requirements. The results of the simulation evaluations indicate that the ARES design and mission profiles are sound and meet the science objectives.

Kenney, P. Sean↗
DOE OSTI2026

Polywell Revisited

The Polywell fusion concept, originally proposed by Robert W. Bussard in 1985, has been investigated for over four decades as a potential solution for achieving net fusion energy in a compact and economically viable reactor. It combines two distinct approaches: high-beta magnetic cusp confinement of electrons using polyhedral coil configurations and electrostatic ion confinement via a potential well formed by injected electron beams. While the hybrid nature of the Polywell system offers advantages in plasma stability and engineering simplicity, previous efforts have been limited by persistent challenges in achieving sufficient plasma confinement required to generate a net energy gain. Here, in this study, we examine previous works and identify limitations of several Polywell embodiments that have historically impeded progress. We present an updated Polywell physics model incorporating experimental findings and recent first-principles particle-in-cell simulations. This updated model outlines a credible path toward overcoming confinement losses and achieving net energy gain using deuterium-tritium (D-T) fuels. Our findings provide a renewed scientific basis for the continued development of the Polywell fusion concept as a practical and scalable approach to fusion energy.

Electrostatic potential well↗
NASA NTRSDate not supplied

Applying NASA-STD-7009 Standard for Models and Simulations to Surrogate and Other Statistical Models

NASA-STD-7009A, Standard for Models and Simulations, contains a worthy and insightfully-crafted credibility assessment. That set of metrics is intended to accumulate and communicate information that can be critical for users and their customers in evaluating findings due to a model or simulation. Was the model designed for the present use? Is it validated in the domain it’s being applied to? And so on. The standard was originally focused on physics-based models, but it can be applied more generally. It can – and should – be applied to high-impact statistical models, including surrogate models based on larger models and sims and regression models based directly on data. A key issue with many of such models is their relative simplicity compared to most M&S despite their use in high-risk engineering decisions. This report will make a case for using this Standard for a wider class of models, and how it might actually add value in excess of its cost for not only stakeholders, but modelers themselves. A rough example showing compliance for a statistical model is included.

K L Johnson↗
NASA NTRS1994

Magnetohydrodynamic Simulation of a Streamer Beside a Realistic Coronal Hole

Existing models of coronal streamers establish their credibility and act as the initial state for transients. The models have produced satisfactory streamer simulations, but unsatisfactory coronal hole simulations. This is a consequence of the character of the models and the boundary conditions. The models all have higher densities in the magnetically open regions than occur in coronal holes (Noci, et al., 1993).

Suess, S. T.↗
NASA NTRS2016

Standard for Models and Simulations

This NASA Technical Standard establishes uniform practices in modeling and simulation to ensure essential requirements are applied to the design, development, and use of models and simulations (MS), while ensuring acceptance criteria are defined by the program project and approved by the responsible Technical Authority. It also provides an approved set of requirements, recommendations, and criteria with which MS may be developed, accepted, and used in support of NASA activities. As the MS disciplines employed and application areas involved are broad, the common aspects of MS across all NASA activities are addressed. The discipline-specific details of a given MS should be obtained from relevant recommended practices. The primary purpose is to reduce the risks associated with MS-influenced decisions by ensuring the complete communication of the credibility of MS results.

verification↗
DOE OSTI2026

Comparing ICME simulations with scaled laboratory experiment

In stellar physics and astrophysics, numerical simulations and laboratory experiments are often compared to observational data to support their representation of the real world. However, there is also merit in comparing numerical simulations to properly scaled experiments, especially when the experiment and the simulation are both emulating the solar phenomena. Confirming the credibility of scaled experiments and their scaling with well-validated models is important to expand our knowledge of the associated physical phenomena. This is significant because experiments and simulations can be performed frequently, whereas observations may be limited by location, field of view, and missing data. In this work, we use the Alfvén Wave Solar atmosphere Model, a well-validated magnetohydrodynamic model, to simulate an interplanetary coronal mass ejection (ICME) and compare it to an experiment which provides a scaled analog to a physical ICME. The experiment was performed on the Big Red Ball facility and scaled using dimensionless parameters such as plasma β and magnetosonic Mach number to reproduce the main structure of an ICME. We compare the model-simulated temperature, density, and magnetic field to those from the experiment, as well as the scaling parameters used in the experiment, to those calculated from the simulation. This comparison is performed to further justify the scaling arguments made by the experiment. Additionally, the comparison would lead to the development of stronger scaling arguments for future experiments.

Bryant, K. [University of Michigan, Ann Arbor, MI ↗
NASA NTRS1991

Modeling personnel turnover in the parametric organization

A model is developed for simulating the dynamics of a newly formed organization, credible during all phases of organizational development. The model development process is broken down into the activities of determining the tasks required for parametric cost analysis (PCA), determining the skills required for each PCA task, determining the skills available in the applicant marketplace, determining the structure of the model, implementing the model, and testing it. The model, parameterized by the likelihood of job function transition, has demonstrated by the capability to represent the transition of personnel across functional boundaries within a parametric organization using a linear dynamical system, and the ability to predict required staffing profiles to meet functional needs at the desired time. The model can be extended by revisions of the state and transition structure to provide refinements in functional definition for the parametric and extended organization.

Dean, Edwin B.↗