Search NASA⌕ Search

SEARCH · Search NASA

Results for “Code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Partnership Center for High-Fidelity Boundary Plasma Simulation (Final Report)

Within the Partnership Center for High-Fidelity Boundary Plasma Simulation (HBPS), work at UT-Austin was aimed at improved verification, validation, and uncertainty quantification (VVUQ) for edge plasma simulations and on performing gyrokinetics simulations of pedestal instabilities and turbulence in order to expand foundational understanding of pedestal transport. Regarding VVUQ, the accomplishments can be summarized as follows. First, it was shown that the Moment Preserving Constrained Resampling technique, when applied periodically in particle-in-cell simulations in the XGC code, can dramatically improve the accuracy of the simulation at essentially equivalent computational cost. Second, a technique for estimating model correlations, which are required to solve the model selection and sample allocation problem in multifidelity UQ techniques, without sampling the highest fidelity, most computationally expensive model, was developed and demonstrated. Third, previously developed methods for estimating statistical and discretization errors were applied to numerical methods relevant to edge plasma simulations, namely in particle-in-cell-based approaches, and shown to work. Finally, benchmark studies for comparing gyrokinetic codes were developed and performed, leading to reasonable agreement between four commonly used codes. Regarding physics studies, gyrokinetic simulations to investigate microtearing modes in the DIII-D pedestal were performed using the GENE code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Derivation and verification of the direct-sampling method for simulating Monte Carlo flight paths in tetrahedral meshes with linear finite-element cross sections

This paper provides a derivation of a direct-sampling approach for modeling continuously varying cross sections in tetrahedral-mesh-based Monte Carlo codes. Specifically, cross sections are spatially approximated using linear nodal finite elements. A linearization strategy is provided for non-linearly varying cross sections. The method is verified against seven analytical pure-absorber test problems. These test problems also highlight the benefit of using linear finite elements over element-wise-constant cross sections.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Evaluating wind speed and power forecasts for wind energy applications using an open-source and systematic validation framework

Building on the verification and validation work developed under the Second Wind Forecast Improvement Project, this work exhibits the value of a consistent procedure to evaluate wind power forecasts. We established an open-source Python code base tailored for wind speed and wind power forecast validation, WE-Validate. The code base can evaluate model forecasts with observations in a coherent manner. To demonstrate the systematic validation framework of WE-Validate, we designed and hosted a forecast evaluation benchmark exercise. We invited forecast providers in industry and academia to participate and submit forecasts for two case studies. We then evaluated the submissions with WE-Validate. Our findings suggest that ensemble means have reasonable skills in time series forecasting, whereas they are often inferior to single ensemble members in wind ramp forecasting. Adopting a voting scheme in ramp forecasting that allows ensemble members to detect ramps independently leads to satisfactory skill scores. Throughout this document, we also emphasize the importance of using statistically robust and resistant metrics as well as equitable skill scores in forecast evaluation.

17 WIND ENERGY↗
DOE OSTI2023

Achieving Higher Fidelity Pulsed-Power Simulations Using Advanced Gap Closure Modeling

This project has progressed several physics models in the EMPIRE plasma simulation code to achieve higher fidelity simulations of high-current diode operation in pulsed-power accelerators. In this report, we present details for the following major work products: (1) a set of verification problems covering all key processes involved in gap closure physics has been designed; this suite has facilitated feature vetting and overall model maturation, (2) a new EMPIRE exemplar has been developed: the Radiographic Integrated Test Stand 6 (RITS-6) diode, and (3) An exemplar for the Saturn accelerator exemplar was enabled by the models matured under this work to self-consistently simulate further into the diode pulse than previously possible (bipolar flow regime). These developments have lead to the highest confidence EMPIRE power flow predictions of the Saturn accelerator to date. Additionally, three modeling approaches for simulating electrode plasmas have been investigated. We report on these results and provide recommendations.

43 PARTICLE ACCELERATORS↗
NASA NTRS2013

Estimated Probability of a Cervical Spine Injury During an ISS Mission

Introduction: The Integrated Medical Model (IMM) utilizes historical data, cohort data, and external simulations as input factors to provide estimates of crew health, resource utilization and mission outcomes. The Cervical Spine Injury Module (CSIM) is an external simulation designed to provide the IMM with parameter estimates for 1) a probability distribution function (PDF) of the incidence rate, 2) the mean incidence rate, and 3) the standard deviation associated with the mean resulting from injury/trauma of the neck. Methods: An injury mechanism based on an idealized low-velocity blunt impact to the superior posterior thorax of an ISS crewmember was used as the simulated mission environment. As a result of this impact, the cervical spine is inertially loaded from the mass of the head producing an extension-flexion motion deforming the soft tissues of the neck. A multibody biomechanical model was developed to estimate the kinematic and dynamic response of the head-neck system from a prescribed acceleration profile. Logistic regression was performed on a dataset containing AIS1 soft tissue neck injuries from rear-end automobile collisions with published Neck Injury Criterion values producing an injury transfer function (ITF). An injury event scenario (IES) was constructed such that crew 1 is moving through a primary or standard translation path transferring large volume equipment impacting stationary crew 2. The incidence rate for this IES was estimated from in-flight data and used to calculate the probability of occurrence. The uncertainty in the model input factors were estimated from representative datasets and expressed in terms of probability distributions. A Monte Carlo Method utilizing simple random sampling was employed to propagate both aleatory and epistemic uncertain factors. Scatterplots and partial correlation coefficients (PCC) were generated to determine input factor sensitivity. CSIM was developed in the SimMechanics/Simulink environment with a Monte Carlo wrapper (MATLAB) used to integrate the components of the module. Results: The probability of generating an AIS1 soft tissue neck injury from the extension/flexion motion induced by a low-velocity blunt impact to the superior posterior thorax was fitted with a lognormal PDF with mean 0.26409, standard deviation 0.11353, standard error of mean 0.00114, and 95% confidence interval [0.26186, 0.26631]. Combining the probability of an AIS1 injury with the probability of IES occurrence was fitted with a Johnson SI PDF with mean 0.02772, standard deviation 0.02012, standard error of mean 0.00020, and 95% confidence interval [0.02733, 0.02812]. The input factor sensitivity analysis in descending order was IES incidence rate, ITF regression coefficient 1, impactor initial velocity, ITF regression coefficient 2, and all others (equipment mass, crew 1 body mass, crew 2 body mass) insignificant. Verification and Validation (V&V): The IMM V&V, based upon NASA STD 7009, was implemented which included an assessment of the data sets used to build CSIM. The documentation maintained includes source code comments and a technical report. The software code and documentation is under Subversion configuration management. Kinematic validation was performed by comparing the biomechanical model output to established corridors.

Brooker, John E.↗
NASA NTRS2014

LADEE Multi-Domain Simulation

The Lunar Atmosphere Dust Environment Explorer (LADEE) was a small explorer class spacecraft that was launched on Sept 7, 2013 and that was de-orbited and successfully impacted the Moons surface on April 17, 2014 after completing all of the mission objectives. The low-cost rapidly prototyped hardware design used for the spacecraft was extend to the development of the software base. To achieve this goal, a Model Based Design approach was utilized to develop the onboard flight software, and out of this development a model based multipurpose simulator was created of the LADEE spacecraft and its mission environment. This simulator extended the traditional function of propagating the vehicle's kinematic and rotational states and included the electrical and thermal states propagation. Traditionally, these domains are handled by domain specific high fidelity simulations that use the states histories from other domains as input. By reducing the fidelity and abstracting the relevant features being monitored and controlled by the flight software, it was possible to model the coupling across these domains resulting in more accurate overall system behavior. A faster than real-time workstation (WSIM) version of the LADEE simulator was used to develop and test the software control algorithms in the Simulink environment. To maximize the performance of the simulation, modeling knobs were introduced to reduce the resolution of the some of the domains models when the effects of that domain were not significant for the scope of that simulation. The automatic code generation feature in Simulink was used to port the simulation to several real-time environments to support Processor-in-the-Loop (PIL) and Hardware-in-the-Loop (HIL) testing, verification and validation. The real-time environment required that the design of each of the domain models be deterministic as possible in the time required to perform all of the calculations to update its states. The simulation interface was designed to be compatible with the command interface employed by the LADEE mission operation team. The WSIM, PIL, and HIL simulators thus used a common interface and thus were used for flight software testing, for mission operations personnel training (nominal and off-nominal operations) prior to the mission and to perform command sequence verification during the mission. This presentation will look at the modeling strategies used to create a common interface to the simulator and to model and couple multiple domains within the simulation, the results of those strategies, and the lessons learned.

Multi-Domain↗
DOE OSTI2022

An arbitrary Lagrange-Eulerian investigation of HRAM shallow jet pre-spurt formation and time sensitivities to impact plate dynamics

With dry bay fires persisting as a significant contributor to aircraft vulnerability despite chronicled developments in survivability technologies, an accurate fire prediction capability remains paramount for credible vulnerability assessments. Physics based modeling of the hydrodynamic ram (HRAM) fluid deposition process is a key component of such capability, wherein capturing the first instance of fluid spurt, referred to herein as shallow jet spurts, is a core focus. Such pre-spurts as they have been formerly identified have only been witnessed sporadically in HRAM spurt experiments. In this work, ALE3D, a first-principles multi-physics code was employed to model the shallow jet spurt phenomenon with spherical projectiles impacting water-filled tanks faced with aluminum panels, such that the underlying physics and sensitivities could be explored. Development and verification of the 2D axisymmetric model is described relative to trends observed in a prior experimental campaign. Results from the verified model suggest shallow jet spurts have at least a quadratic sensitivity to the fundamental vibrational mode of the impact plate across impact velocities 610–1829 m/s (2000–6000 ft/s). It is further explained how shallow jet spurts are arrested for impacts at the two extremes of plate rigidity. This research constitutes the first fluid-structure modeling of shallow jet spurts which future three-dimensional analyses will expound upon.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

A Comparison of Monte Carlo and Deterministic Solvers for keff and Sensitivity Calculations

Verification and validation of our solutions for calculating the neutron reactivity for nuclear materials is a key issue to address for many applications, including criticality safety, research reactors, power reactors, and nuclear security. Neutronics codes solve variations of the Boltzmann transport equation. The two main variants are Monte Carlo versus deterministic solutions, e.g. the MCNP [1] versus PARTISN [2] codes, respectively. There have been many studies over the decades that examined the accuracy of such solvers and the general conclusion is that when the problems are well-posed, either solver can produce accurate results. However, the devil is always in the details. The current study examines the issue of self-shielding and the stress it puts on deterministic solvers. Most Monte Carlo neutronics codes use continuous-energy descriptions of the neutron interaction data that are not subject to this effect. The issue of self-shielding occurs because of the discretisation of data used by the deterministic solutions. Multigroup data used in these solvers are the average cross section and scattering parameters over an energy range. Resonances in cross sections can occur that change the likelihood of interaction by one to three orders of magnitude over a small energy range. Self-shielding is the numerical effect that the average cross section in groups with strong resonances can be strongly affected as neutrons within that material are preferentially absorbed or scattered out of the resonance energies. This affects both the average cross section and the scattering matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Multiphysics Coupling of PROTEUS-NODAL and SAM for Molten Salt Reactor Simulation

The purpose of this report is to document the new features and capabilities that have been implemented in the PROTEUS-NODAL code and the coupling procedure of PROTEUS-NODAL with SAM to analyze MSRs. This report is organized as follows. Section 2 presents the variational nodal P 1 solver for cylindrical geometries and its verification test results. Section 3 discusses the transient analysis capability implemented in the P 1 solvers of PROTEUS-NODAL. The solution methods for the coupled system of TFSP and precursor drift equations, the coarse mesh finite difference (CMFD) acceleration, the kinetics parameter evaluation method, and the thermal feedback are discussed. The verification test results against the SP 3 solutions are also discussed. Section 4 describes the coupling scheme of PROTEUS-NODAL and SAM under the MOOSE framework for MSR applications. The developed MOOSE applications named “TreeFrog” and “TreeKangaroo” are discussed. Verification test results for the coupled system are also discussed by comparing the MSFR steady state solution with that obtained from a manually coupled PROTEUS-NODAL and ANSYS CFX computational fluid dynamics (CFD) calculations and the MSFR transient analysis results with the open literature solutions and the PROTEUS-NODAL solutions obtained with the standalone thermal-hydraulics solver. Section 5 provides conclusions and future works.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2018

Model Evaluation Report for LNG Dispersion on Fire Dynamics Simulator Version 6.5.3

This report is an assessment of the computational fluid dynamics (CFD) code Fire Dynamics Simulator (FDS), version 6.5.3, using the Model Evaluation Protocol (MEP) for Liquefied Natural Gas (LNG). The MEP consists of model validation and a scientific assessment that encompasses model information and model verification activities. Model validation entails comparison against various field and wind-tunnel trials for LNG and other dense gases with and without obstructions. The results indicate that FDS is generally over-predictive for most of the field scale dense gas releases and cases involving obstructions without requiring a safety factor of 2, however, since there are uncertainties in extrapolating to accident scales a safety factor of 2 (1/2 LFL criteria) may be appropriate. The results of this scientific assessment and prior verification efforts demonstrate the soundness of the numerical techniques and robustness of FDS. The validation results indicate that FDS is suitable for modeling dense gas dispersion with and without obstructions.

03 NATURAL GAS↗
DOE OSTI2025

LAMP Project Facility and Space Requirements

The project will require significant space over the lifetime of the project to successfully execute design, technology maturation, component testing and verification, and final removal and installation. The types of space required falls into three general categories: office, storage, and laboratory. Figure 1 below summarizes the project space requirements by project lifecycle. The specific color coding indicates the availability (and potential risk to the project) of the particular type of space: green indicates space that is already allocated and in use by the LAMP project; yellow indicates space that is expected to be easily transitioned from its current use to the project; red indicates a space that is use by multiple users or other projects, and will most likely require high-level negotiations and planning to become available to the project. Figure 2 summarizes the LAMP Space Requirements by calendar year and type throughout the duration of the project. As can be seen in Fig. 2, the maximum space needed by the project exceeds 40,000 square feet, with an average space requirement over the lifetime of the project equal to approximately 25,000 square feet.

43 PARTICLE ACCELERATORS↗
DOE OSTI2019

L3:RTM.MCH.P19.06: Neutronics UQ

This report summarizes some of the work performed in the last year on the nuclear data uncertainty tasks using the multipole representation. This approach was proposed to provide a simple and integrated way of evaluating the nuclear data uncertainty in a Monte Carlo simulation and evaluating their impact on multigroup cross sections. As previously described, the windowed multipole format allows for a resonance based representation of the cross sections with direct Doppler broadening. This representation also lends itself nicely to the evaluation of sensitivities of resonance parameters and the direct perturbation of resonance parameters in the simulation environment. Both of these approaches rely on the need of conversion of the covariance data (File 32 of the ENDF library) into a pole and residues form: i.e. into a multipole covariance. Section 5 details the current pathways that have been used so far to achieve this. In order to verify the conversion process of the covariance data, the sensitivies to the resonance parameters and the sampling from these parameters, an analytical benchmark of the slowing process was developed. The benchmark provides a closed-form solution for the flux in the presence of Hydrogen and multiple resonant nuclides. Section 2 details the analytical benchmark and provides the closed-form solutions for the flux and its sensitivity to resonance parameters. A verification of the proposed methodology is performed and compared with the analytic solution to demonstrate the accuracy of the benchmark and the applicability of our embedded resonance perturbation approach in a small Monte Carlo code. Papers are currently being drafted documenting the benchmark and the generation of sensitivities. As paths to best generate multipole covariance matrices are being compared, we also explored new methods to propagate nuclear data uncertainty across the Monte Carlo neutron transport calculation. Section 4 studies the use of multipole covariance matrices to perform sensitivity analysis. Section 3.2 documents the results of our investigations into a new way of propagating nuclear data uncertainty across Monte Carlo transport simulations by sampling new epistemic cross sections for each new neutron.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2003

Flight Guidance System Requirements Specification

This report describes a requirements specification written in the RSML-e language for the mode logic of a Flight Guidance System of a typical regional jet aircraft. This model was created as one of the first steps in a five-year project sponsored by the NASA Langley Research Center, Rockwell Collins Inc., and the Critical Systems Research Group of the University of Minnesota to develop new methods and tools to improve the safety of avionics designs. This model will be used to demonstrate the application of a variety of methods and techniques, including safety analysis of system and subsystem requirements, verification of key properties using theorem provers and model checkers, identification of potential sources mode confusion in system designs, partitioning of applications based on the criticality of system hazards, and autogeneration of avionics quality code. While this model is representative of the mode logic of a typical regional jet aircraft, it does not describe an actual or planned product. Several aspects of a full Flight Guidance System, such as recovery from failed sensors, have been omitted, and no claims are made regarding the accuracy or completeness of this specification.

Miller, Steven P.↗
NASA NTRSDate not supplied

High-Fidelity CFD Verification Workshop 2024: Spalart-Allmaras QCR2000-R Turbulence Model

This is an invited paper for the SciTech 2023 special session, High-Fidelity CFD Verification Pre-Workshop. The paper presents three benchmark cases for verification of Reynolds-averaged Navier-Stokes solvers. The verification studies focus on a one-equation Spalart-Allmaras model, SA-neg-QCR2000-R. The benchmark cases are a two-dimensional subsonic flow around a Joukowski airfoil, a subsonic three-dimensional flow around an extruded NACA0012 wing in a tunnel, and a subsonic flow around a wing-body configuration developed by Boeing for verification of solvers participating in the High-Lift Prediction Workshop. The turbulence-model formulation, geometry, flow conditions, grids, and the desired submission data are described in detail. Reference solutions computed by established codes are shown.

CFD↗
NASA NTRS2012

A Change Impact Analysis to Characterize Evolving Program Behaviors

Change impact analysis techniques estimate the potential effects of changes made to software. Directed Incremental Symbolic Execution (DiSE) is an intraprocedural technique for characterizing the impact of software changes on program behaviors. DiSE first estimates the impact of the changes on the source code using program slicing techniques, and then uses the impact sets to guide symbolic execution to generate path conditions that characterize impacted program behaviors. DiSE, however, cannot reason about the flow of impact between methods and will fail to generate path conditions for certain impacted program behaviors. In this work, we present iDiSE, an extension to DiSE that performs an interprocedural analysis. iDiSE combines static and dynamic calling context information to efficiently generate impacted program behaviors across calling contexts. Information about impacted program behaviors is useful for testing, verification, and debugging of evolving programs. We present a case-study of our implementation of the iDiSE algorithm to demonstrate its efficiency at computing impacted program behaviors. Traditional notions of coverage are insufficient for characterizing the testing efforts used to validate evolving program behaviors because they do not take into account the impact of changes to the code. In this work we present novel definitions of impacted coverage metrics that are useful for evaluating the testing effort required to test evolving programs. We then describe how the notions of impacted coverage can be used to configure techniques such as DiSE and iDiSE in order to support regression testing related tasks. We also discuss how DiSE and iDiSE can be configured for debugging finding the root cause of errors introduced by changes made to the code. In our empirical evaluation we demonstrate that the configurations of DiSE and iDiSE can be used to support various software maintenance tasks

Rungta, Neha Shyam↗
DOE OSTI2023

Laser Diode Analysis and Verification (Professional Report)

The goal of this project at Lawrence Livermore National Laboratory (LLNL) was focused on analyzing and verifying laser diodes to ensure that the diodes meet requirements for LLNL mission applications. The different stages of this testing were documented in a process flow map which included location color coding so that each step was clearly defined in scope and location of appropriate testing facility. Data were collected and analyzed and compared to minimum acceptable values to see if requirements were met. The process map documents the initial receipt, inspection, and testing of the laser diodes. Initial inspections started with Keyence Microscope imaging and then moved on to High Potential, Ramp, and Burst Testing. Data from the diode testing were processed through MATLAB and Python codes to verify various metrics such as slope efficiency, threshold current, back irradiance, and beam divergence met requirements. These metrics were then recorded in Excel summary reports. Approximately 95% of the laser diodes passed all tests. Presentations were given to Lawrence Livermore’s internal leadership team, an external partner, and to a Lab-wide audience. The data released for this report was constrained by information protection considerations of LLNL’s national security missions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2005

Development of Advanced Verification and Validation Procedures and Tools for the Certification of Learning Systems in Aerospace Applications

Adaptive control technologies that incorporate learning algorithms have been proposed to enable automatic flight control and vehicle recovery, autonomous flight, and to maintain vehicle performance in the face of unknown, changing, or poorly defined operating environments. In order for adaptive control systems to be used in safety-critical aerospace applications, they must be proven to be highly safe and reliable. Rigorous methods for adaptive software verification and validation must be developed to ensure that control system software failures will not occur. Of central importance in this regard is the need to establish reliable methods that guarantee convergent learning, rapid convergence (learning) rate, and algorithm stability. This paper presents the major problems of adaptive control systems that use learning to improve performance. The paper then presents the major procedures and tools presently developed or currently being developed to enable the verification, validation, and ultimate certification of these adaptive control systems. These technologies include the application of automated program analysis methods, techniques to improve the learning process, analytical methods to verify stability, methods to automatically synthesize code, simulation and test methods, and tools to provide on-line software assurance.

Jacklin, Stephen↗
NASA NTRS2012

Pressure Ratio to Thermal Environments

A pressure ratio to thermal environments (PRatTlE.pl) program is a Perl language code that estimates heating at requested body point locations by scaling the heating at a reference location times a pressure ratio factor. The pressure ratio factor is the ratio of the local pressure at the reference point and the requested point from CFD (computational fluid dynamics) solutions. This innovation provides pressure ratio-based thermal environments in an automated and traceable method. Previously, the pressure ratio methodology was implemented via a Microsoft Excel spreadsheet and macro scripts. PRatTlE is able to calculate heating environments for 150 body points in less than two minutes. PRatTlE is coded in Perl programming language, is command-line-driven, and has been successfully executed on both the HP and Linux platforms. It supports multiple concurrent runs. PRatTlE contains error trapping and input file format verification, which allows clear visibility into the input data structure and intermediate calculations.

Lopez, Pedro↗