Search NASA⌕ Search

SEARCH · Search NASA

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Achieving Higher Fidelity Pulsed-Power Simulations Using Advanced Gap Closure Modeling

This project has progressed several physics models in the EMPIRE plasma simulation code to achieve higher fidelity simulations of high-current diode operation in pulsed-power accelerators. In this report, we present details for the following major work products: (1) a set of verification problems covering all key processes involved in gap closure physics has been designed; this suite has facilitated feature vetting and overall model maturation, (2) a new EMPIRE exemplar has been developed: the Radiographic Integrated Test Stand 6 (RITS-6) diode, and (3) An exemplar for the Saturn accelerator exemplar was enabled by the models matured under this work to self-consistently simulate further into the diode pulse than previously possible (bipolar flow regime). These developments have lead to the highest confidence EMPIRE power flow predictions of the Saturn accelerator to date. Additionally, three modeling approaches for simulating electrode plasmas have been investigated. We report on these results and provide recommendations.

43 PARTICLE ACCELERATORS↗

Estimated Probability of a Cervical Spine Injury During an ISS Mission

Introduction: The Integrated Medical Model (IMM) utilizes historical data, cohort data, and external simulations as input factors to provide estimates of crew health, resource utilization and mission outcomes. The Cervical Spine Injury Module (CSIM) is an external simulation designed to provide the IMM with parameter estimates for 1) a probability distribution function (PDF) of the incidence rate, 2) the mean incidence rate, and 3) the standard deviation associated with the mean resulting from injury/trauma of the neck. Methods: An injury mechanism based on an idealized low-velocity blunt impact to the superior posterior thorax of an ISS crewmember was used as the simulated mission environment. As a result of this impact, the cervical spine is inertially loaded from the mass of the head producing an extension-flexion motion deforming the soft tissues of the neck. A multibody biomechanical model was developed to estimate the kinematic and dynamic response of the head-neck system from a prescribed acceleration profile. Logistic regression was performed on a dataset containing AIS1 soft tissue neck injuries from rear-end automobile collisions with published Neck Injury Criterion values producing an injury transfer function (ITF). An injury event scenario (IES) was constructed such that crew 1 is moving through a primary or standard translation path transferring large volume equipment impacting stationary crew 2. The incidence rate for this IES was estimated from in-flight data and used to calculate the probability of occurrence. The uncertainty in the model input factors were estimated from representative datasets and expressed in terms of probability distributions. A Monte Carlo Method utilizing simple random sampling was employed to propagate both aleatory and epistemic uncertain factors. Scatterplots and partial correlation coefficients (PCC) were generated to determine input factor sensitivity. CSIM was developed in the SimMechanics/Simulink environment with a Monte Carlo wrapper (MATLAB) used to integrate the components of the module. Results: The probability of generating an AIS1 soft tissue neck injury from the extension/flexion motion induced by a low-velocity blunt impact to the superior posterior thorax was fitted with a lognormal PDF with mean 0.26409, standard deviation 0.11353, standard error of mean 0.00114, and 95% confidence interval [0.26186, 0.26631]. Combining the probability of an AIS1 injury with the probability of IES occurrence was fitted with a Johnson SI PDF with mean 0.02772, standard deviation 0.02012, standard error of mean 0.00020, and 95% confidence interval [0.02733, 0.02812]. The input factor sensitivity analysis in descending order was IES incidence rate, ITF regression coefficient 1, impactor initial velocity, ITF regression coefficient 2, and all others (equipment mass, crew 1 body mass, crew 2 body mass) insignificant. Verification and Validation (V&V): The IMM V&V, based upon NASA STD 7009, was implemented which included an assessment of the data sets used to build CSIM. The documentation maintained includes source code comments and a technical report. The software code and documentation is under Subversion configuration management. Kinematic validation was performed by comparing the biomechanical model output to established corridors.

Brooker, John E.↗

LADEE Multi-Domain Simulation

The Lunar Atmosphere Dust Environment Explorer (LADEE) was a small explorer class spacecraft that was launched on Sept 7, 2013 and that was de-orbited and successfully impacted the Moons surface on April 17, 2014 after completing all of the mission objectives. The low-cost rapidly prototyped hardware design used for the spacecraft was extend to the development of the software base. To achieve this goal, a Model Based Design approach was utilized to develop the onboard flight software, and out of this development a model based multipurpose simulator was created of the LADEE spacecraft and its mission environment. This simulator extended the traditional function of propagating the vehicle's kinematic and rotational states and included the electrical and thermal states propagation. Traditionally, these domains are handled by domain specific high fidelity simulations that use the states histories from other domains as input. By reducing the fidelity and abstracting the relevant features being monitored and controlled by the flight software, it was possible to model the coupling across these domains resulting in more accurate overall system behavior. A faster than real-time workstation (WSIM) version of the LADEE simulator was used to develop and test the software control algorithms in the Simulink environment. To maximize the performance of the simulation, modeling knobs were introduced to reduce the resolution of the some of the domains models when the effects of that domain were not significant for the scope of that simulation. The automatic code generation feature in Simulink was used to port the simulation to several real-time environments to support Processor-in-the-Loop (PIL) and Hardware-in-the-Loop (HIL) testing, verification and validation. The real-time environment required that the design of each of the domain models be deterministic as possible in the time required to perform all of the calculations to update its states. The simulation interface was designed to be compatible with the command interface employed by the LADEE mission operation team. The WSIM, PIL, and HIL simulators thus used a common interface and thus were used for flight software testing, for mission operations personnel training (nominal and off-nominal operations) prior to the mission and to perform command sequence verification during the mission. This presentation will look at the modeling strategies used to create a common interface to the simulator and to model and couple multiple domains within the simulation, the results of those strategies, and the lessons learned.

Multi-Domain↗

SU-E-T-148: Efficient Verification Method for Modulated Electron Radiotherapy Treatment Plans

Purpose: For shallow tumors, modulated electron radiotherapy (MERT) promises a reduction of dose to distal organs at risk. At our institution a framework was developed in order to create treatment plans for MERT employing both forward and inverse optimization. In this work, an efficient quality assurance (QA) process is established. Methods: Treatment plans for three different tumor sites were created using an inverse optimization. These plans consist of 6–12 segments and energies between 6 and 18 MeV. An already established QA process for photon IMRT plans is now extended to additionally handle MERT plans. First, the dose distributions are calculated in a homogenous water phantom. For this task a dedicated Monte Carlo (MC) framework for MERT is used. Second, the segments are applied on a stand-alone amorphous silicon electronic portal imaging device (EPID) using a source-to-surface distance of 70 cm. This device was calibrated for electron beams in a previous work. An in-house developed analysis software, is then utilized for comparisons and evaluation of the measured and calculated dose distributions. Results: For all three plans the calculated dose distributions agree well with the measured ones. Using a 2D gamma comparison (2% of dose max/2 mm and 10% dose threshold) passing rates >98% are achieved.The dose calculation for each plan on the water phantom, using voxels of 0.2×0.2×0.2 cm{sup 3}, takes at maximum 30 min on a single core Pentium 2.66 GHz system with 6 GB RAM, to reach a statistical uncertainty of 2% (1 std. dev.). Conclusion: An already established QA procedure for IMRT photon plans was applied for MERT. The dedicated MC framework and the use of EPID measurements allow an efficient QA procedure in a clinical environment. This work was supported by Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

Absolute calibration of the Gamma Knife{sup ®} Perfexion™ and delivered dose verification using EPR/alanine dosimetry

Purpose: Elekta Leksell Gamma Knife{sup ®} (LGK) is a radiotherapy beam machine whose features are not compliant with the international calibration protocols for radiotherapy. In this scope, the Laboratoire National Henri Becquerel and the Pitié-Salpêtrière Hospital decided to conceive a new LKG dose calibration method and to compare it with the currently used one. Furthermore, the accuracy of the dose delivered by the LGK machine was checked using an “end-to-end” test. This study also aims to compare doses delivered by the two latest software versions of the Gammaplan treatment planning system (TPS). Methods: The dosimetric method chosen is the electron paramagnetic resonance (EPR) of alanine. Dose rate (calibration) verification was done without TPS using a spherical phantom. Absolute calibration was done with factors calculated by Monte Carlo simulation (MCNP-X). For “end-to-end” test, irradiations in an anthropomorphic head phantom, close to real treatment conditions, are done using the TPS in order to verify the delivered dose. Results: The comparison of the currently used calibration method with the new one revealed a deviation of +0.8% between the dose rates measured by ion chamber and EPR/alanine. For simple fields configuration (less than 16 mm diameter), the “end-to-end” tests showed out average deviations of −1.7% and −0.9% between the measured dose and the calculated dose by Gammaplan v9 and v10, respectively. Conclusions: This paper shows there is a good agreement between the new calibration method and the currently used one. There is also a good agreement between the calculated and delivered doses especially for Gammaplan v10.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Testing of ENDF71x: A new ACE-formatted neutron data library based on ENDF/B-VII.1

The ENDF71x library [1] is the most thoroughly tested set of ACE-format data tables ever released by the Nuclear Data Team at Los Alamos National Laboratory (LANL). It is based on ENDF/B-VII. 1, the most recently released set of evaluated nuclear data files produced by the US Cross Section Evaluation Working Group (CSEWG). A variety of techniques were used to test and verify the ENDF7 1x library before its public release. These include the use of automated checking codes written by members of the Nuclear Data Team, visual inspections of key neutron data, MCNP6 calculations designed to test data for every included combination of isotope and temperature as comprehensively as possible, and direct comparisons between ENDF71x and previous ACE library releases. Visual inspection of some of the most important neutron data revealed energy balance problems and unphysical discontinuities in the cross sections for some nuclides. Doppler broadening of the total cross sections with increasing temperature was found to be qualitatively correct. Test calculations performed using MCNP prompted two modifications to the MCNP6 source code and also exposed bad secondary neutron yields for {sup 231,233}Pa that are present in both ENDF/B-VII.1 and ENDF/B-VII.0. A comparison of ENDF71x with its predecessor ACE library, ENDF70, showed that dramatic changes have been made in the neutron cross section data for a number of isotopes between ENDF/B-VII.0 and ENDF/B-VII.1. Based on the results of these verification tests and the validation tests performed by Kahler, et al. [2], the ENDF71x library is recommended for use in all Monte Carlo applications. (authors)

97 MATHEMATICS AND COMPUTING↗

3D DVH-based metric analysis versus per-beam planar analysis in IMRT pretreatment verification

Purpose: To evaluate methods of pretreatment IMRT analysis, using real measurements performed with a commercial 2D detector array, for clinical relevance and accuracy by comparing clinical DVH parameters. Methods: We divided the work into two parts. The first part consisted of six in-phantom tests aimed to study the sensitivity of the different analysis methods. Beam fluences, 3D dose distribution, and DVH of an unaltered original plan were compared to those of the delivered plan, in which an error had been intentionally introduced. The second part consisted of comparing gamma analysis with DVH metrics for 17 patient plans from various sites. Beam fluences were measured with the MapCHECK 2 detector, per-beam planar analysis was performed with the MapCHECK software, and 3D gamma analysis and the DVH evaluation were performed using 3DVH software. Results: In a per-beam gamma analysis some of the tests yielded false positives or false negatives. However, the 3DVH software correctly described the DVH of the plan which included the error. The measured DVH from the plan with controlled error agreed with the planned DVH within 2% dose or 2% volume. We also found that a gamma criterion of 3%/3 mm was too lax to detect some of the forced errors. Global analysis masked some problems, while local analysis magnified irrelevant errors at low doses. Small hotspots were missed for all metrics due to the spatial resolution of the detector panel. DVH analysis for patient plans revealed small differences between treatment plan calculations and 3DVH results, with the exception of very small volume structures such as the eyes and the lenses. Target coverage (D{sub 98} and D{sub 95}) of the measured plan was systematically lower than that predicted by the treatment planning system, while other DVH characteristics varied depending on the parameter and organ. Conclusions: We found no correlation between the gamma index and the clinical impact of a discrepancy for any of the gamma index evaluation possibilities (global, local, 2D, or 3D). Some of the tests yielded false positives or false negatives in a per-beam gamma analysis. However, they were correctly accounted for in a DVH analysis. We also showed that 3DVH software is reliable for our tests, and is a viable method for correlating planar discrepancies with clinical relevance by comparing the measured DVH of target and OAR's with clinical tolerance.

60 APPLIED LIFE SCIENCES↗

An arbitrary Lagrange-Eulerian investigation of HRAM shallow jet pre-spurt formation and time sensitivities to impact plate dynamics

With dry bay fires persisting as a significant contributor to aircraft vulnerability despite chronicled developments in survivability technologies, an accurate fire prediction capability remains paramount for credible vulnerability assessments. Physics based modeling of the hydrodynamic ram (HRAM) fluid deposition process is a key component of such capability, wherein capturing the first instance of fluid spurt, referred to herein as shallow jet spurts, is a core focus. Such pre-spurts as they have been formerly identified have only been witnessed sporadically in HRAM spurt experiments. In this work, ALE3D, a first-principles multi-physics code was employed to model the shallow jet spurt phenomenon with spherical projectiles impacting water-filled tanks faced with aluminum panels, such that the underlying physics and sensitivities could be explored. Development and verification of the 2D axisymmetric model is described relative to trends observed in a prior experimental campaign. Results from the verified model suggest shallow jet spurts have at least a quadratic sensitivity to the fundamental vibrational mode of the impact plate across impact velocities 610–1829 m/s (2000–6000 ft/s). It is further explained how shallow jet spurts are arrested for impacts at the two extremes of plate rigidity. This research constitutes the first fluid-structure modeling of shallow jet spurts which future three-dimensional analyses will expound upon.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Calculating infinite-medium α-eigenvalue spectra with Monte Carlo using a transition rate matrix method

The time-dependent behavior of the energy spectrum in neutron transport was investigated with a formulation, based on continuous-time Markov processes, for computing α eigenvalues and eigenvectors in an infinite medium. In this study, a research Monte Carlo code called “TORTE” (To Obtain Real Time Eigenvalues) was created and used to estimate elements of a transition rate matrix. TORTE is capable of using both multigroup and continuous-energy nuclear data, and verification was performed. Eigenvalue spectra for infinite homogeneous mixtures were obtained, and an eigenfunction expansion was used to investigate transient behavior of the neutron energy spectrum.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Compiler verification meets cross-language linking via data abstraction

Many real programs are written in multiple different programming languages, and supporting this pattern creates challenges for formal compiler verification. We describe our Coq verification of a compiler for a high-level language, such that the compiler correctness theorem allows us to derive partial-correctness Hoare-logic theorems for programs built by linking the assembly code output by our compiler and assembly code produced by other means. Our compiler supports such tricky features as storable cross-language function pointers, without giving up the usual benefits of being able to verify different compiler phases (including, in our case, two classic optimizations) independently. Here, the key technical innovation is a mixed operational and axiomatic semantics for the source language, with a built-in notion of abstract data types, such that compiled code interfaces with other languages only through axiomatically specified methods that mutate encapsulated private data, represented in whatever formats are most natural for those languages.

97 MATHEMATICS AND COMPUTING↗

A Comparison of Monte Carlo and Deterministic Solvers for keff and Sensitivity Calculations

Verification and validation of our solutions for calculating the neutron reactivity for nuclear materials is a key issue to address for many applications, including criticality safety, research reactors, power reactors, and nuclear security. Neutronics codes solve variations of the Boltzmann transport equation. The two main variants are Monte Carlo versus deterministic solutions, e.g. the MCNP [1] versus PARTISN [2] codes, respectively. There have been many studies over the decades that examined the accuracy of such solvers and the general conclusion is that when the problems are well-posed, either solver can produce accurate results. However, the devil is always in the details. The current study examines the issue of self-shielding and the stress it puts on deterministic solvers. Most Monte Carlo neutronics codes use continuous-energy descriptions of the neutron interaction data that are not subject to this effect. The issue of self-shielding occurs because of the discretisation of data used by the deterministic solutions. Multigroup data used in these solvers are the average cross section and scattering parameters over an energy range. Resonances in cross sections can occur that change the likelihood of interaction by one to three orders of magnitude over a small energy range. Self-shielding is the numerical effect that the average cross section in groups with strong resonances can be strongly affected as neutrons within that material are preferentially absorbed or scattered out of the resonance energies. This affects both the average cross section and the scattering matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multiphysics Coupling of PROTEUS-NODAL and SAM for Molten Salt Reactor Simulation

The purpose of this report is to document the new features and capabilities that have been implemented in the PROTEUS-NODAL code and the coupling procedure of PROTEUS-NODAL with SAM to analyze MSRs. This report is organized as follows. Section 2 presents the variational nodal P 1 solver for cylindrical geometries and its verification test results. Section 3 discusses the transient analysis capability implemented in the P 1 solvers of PROTEUS-NODAL. The solution methods for the coupled system of TFSP and precursor drift equations, the coarse mesh finite difference (CMFD) acceleration, the kinetics parameter evaluation method, and the thermal feedback are discussed. The verification test results against the SP 3 solutions are also discussed. Section 4 describes the coupling scheme of PROTEUS-NODAL and SAM under the MOOSE framework for MSR applications. The developed MOOSE applications named “TreeFrog” and “TreeKangaroo” are discussed. Verification test results for the coupled system are also discussed by comparing the MSFR steady state solution with that obtained from a manually coupled PROTEUS-NODAL and ANSYS CFX computational fluid dynamics (CFD) calculations and the MSFR transient analysis results with the open literature solutions and the PROTEUS-NODAL solutions obtained with the standalone thermal-hydraulics solver. Section 5 provides conclusions and future works.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Model Evaluation Report for LNG Dispersion on Fire Dynamics Simulator Version 6.5.3

This report is an assessment of the computational fluid dynamics (CFD) code Fire Dynamics Simulator (FDS), version 6.5.3, using the Model Evaluation Protocol (MEP) for Liquefied Natural Gas (LNG). The MEP consists of model validation and a scientific assessment that encompasses model information and model verification activities. Model validation entails comparison against various field and wind-tunnel trials for LNG and other dense gases with and without obstructions. The results indicate that FDS is generally over-predictive for most of the field scale dense gas releases and cases involving obstructions without requiring a safety factor of 2, however, since there are uncertainties in extrapolating to accident scales a safety factor of 2 (1/2 LFL criteria) may be appropriate. The results of this scientific assessment and prior verification efforts demonstrate the soundness of the numerical techniques and robustness of FDS. The validation results indicate that FDS is suitable for modeling dense gas dispersion with and without obstructions.

03 NATURAL GAS↗

LAMP Project Facility and Space Requirements

The project will require significant space over the lifetime of the project to successfully execute design, technology maturation, component testing and verification, and final removal and installation. The types of space required falls into three general categories: office, storage, and laboratory. Figure 1 below summarizes the project space requirements by project lifecycle. The specific color coding indicates the availability (and potential risk to the project) of the particular type of space: green indicates space that is already allocated and in use by the LAMP project; yellow indicates space that is expected to be easily transitioned from its current use to the project; red indicates a space that is use by multiple users or other projects, and will most likely require high-level negotiations and planning to become available to the project. Figure 2 summarizes the LAMP Space Requirements by calendar year and type throughout the duration of the project. As can be seen in Fig. 2, the maximum space needed by the project exceeds 40,000 square feet, with an average space requirement over the lifetime of the project equal to approximately 25,000 square feet.

43 PARTICLE ACCELERATORS↗

L3:RTM.MCH.P19.06: Neutronics UQ

This report summarizes some of the work performed in the last year on the nuclear data uncertainty tasks using the multipole representation. This approach was proposed to provide a simple and integrated way of evaluating the nuclear data uncertainty in a Monte Carlo simulation and evaluating their impact on multigroup cross sections. As previously described, the windowed multipole format allows for a resonance based representation of the cross sections with direct Doppler broadening. This representation also lends itself nicely to the evaluation of sensitivities of resonance parameters and the direct perturbation of resonance parameters in the simulation environment. Both of these approaches rely on the need of conversion of the covariance data (File 32 of the ENDF library) into a pole and residues form: i.e. into a multipole covariance. Section 5 details the current pathways that have been used so far to achieve this. In order to verify the conversion process of the covariance data, the sensitivies to the resonance parameters and the sampling from these parameters, an analytical benchmark of the slowing process was developed. The benchmark provides a closed-form solution for the flux in the presence of Hydrogen and multiple resonant nuclides. Section 2 details the analytical benchmark and provides the closed-form solutions for the flux and its sensitivity to resonance parameters. A verification of the proposed methodology is performed and compared with the analytic solution to demonstrate the accuracy of the benchmark and the applicability of our embedded resonance perturbation approach in a small Monte Carlo code. Papers are currently being drafted documenting the benchmark and the generation of sensitivities. As paths to best generate multipole covariance matrices are being compared, we also explored new methods to propagate nuclear data uncertainty across the Monte Carlo neutron transport calculation. Section 4 studies the use of multipole covariance matrices to perform sensitivity analysis. Section 3.2 documents the results of our investigations into a new way of propagating nuclear data uncertainty across Monte Carlo transport simulations by sampling new epistemic cross sections for each new neutron.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Flight Guidance System Requirements Specification

This report describes a requirements specification written in the RSML-e language for the mode logic of a Flight Guidance System of a typical regional jet aircraft. This model was created as one of the first steps in a five-year project sponsored by the NASA Langley Research Center, Rockwell Collins Inc., and the Critical Systems Research Group of the University of Minnesota to develop new methods and tools to improve the safety of avionics designs. This model will be used to demonstrate the application of a variety of methods and techniques, including safety analysis of system and subsystem requirements, verification of key properties using theorem provers and model checkers, identification of potential sources mode confusion in system designs, partitioning of applications based on the criticality of system hazards, and autogeneration of avionics quality code. While this model is representative of the mode logic of a typical regional jet aircraft, it does not describe an actual or planned product. Several aspects of a full Flight Guidance System, such as recovery from failed sensors, have been omitted, and no claims are made regarding the accuracy or completeness of this specification.

Miller, Steven P.↗

High-Fidelity CFD Verification Workshop 2024: Spalart-Allmaras QCR2000-R Turbulence Model

This is an invited paper for the SciTech 2023 special session, High-Fidelity CFD Verification Pre-Workshop. The paper presents three benchmark cases for verification of Reynolds-averaged Navier-Stokes solvers. The verification studies focus on a one-equation Spalart-Allmaras model, SA-neg-QCR2000-R. The benchmark cases are a two-dimensional subsonic flow around a Joukowski airfoil, a subsonic three-dimensional flow around an extruded NACA0012 wing in a tunnel, and a subsonic flow around a wing-body configuration developed by Boeing for verification of solvers participating in the High-Lift Prediction Workshop. The turbulence-model formulation, geometry, flow conditions, grids, and the desired submission data are described in detail. Reference solutions computed by established codes are shown.

CFD↗