Search NASA⌕ Search

SEARCH · Search NASA

Results for “Code Validation Plan”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Particle-in-cell modeling of plasma jet merging in the large-Hall-parameter regime

The merging process of magnetized plasma jets with parameters relevant to the plasma-jet-driven magneto-inertial fusion (PJMIF) design and the plasma liner experiment (PLX) is modeled by fully kinetic particle-in-cell (PIC) simulations in one and two spatial dimensions. Here, the modified two-stream instability is identified to be the main mechanism responsible for stopping the plasma jets and preventing species interpenetration. The electron and ion Hall parameters of the merged plasma are greater than unity, and the plasma β is close to unity, which is the desired characteristic of planned experiments at PLX. Our 2D PIC simulations validate the results of the radiation magneto-hydrodynamics code FLASH, which will be the primary tool for modeling various stages of future PJMIF experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Project for Intercomparison of Land-surface Parameterization Schemes

The Project for Intercomparison of Land-surface Parameterization Schemes (PILPS) is described and the first stage science plan outlined. PILPS is a project designed to improve the parameterization of the continental surface, especially the hydrological, energy, momentum, and carbon exchanges with the atmosphere. The PILPS Science Plan incorporates enhanced documentation, comparison, and validation of continental surface parameterization schemes by community participation. Potential participants include code developers, code users, and those who can provide datasets for validation and who have expertise of value in this exercise. PILPS is an important activity because existing intercomparisons, although piecemeal, demonstrate that there are significant differences in the formulation of individual processes in the available land surface schemes. These differences are comparable to other recognized differences among current global climate models such as cloud and convection parameterizations. It is also clear that too few sensitivity studies have been undertaken with the result that there is not yet enough information to indicate which simplifications or omissions are important for the near-surface continental climate, hydrology, and biogeochemistry. PILPS emphasizes sensitivity studies with and intercomparisons of existing land surface codes and the development of areally extensive datasets for their testing and validation.

Henderson-Sellers, A.↗

Supersonic Retropropulsion Test 1853 in NASA LaRC Unitary Plan Wind Tunnel Test Section 2

A supersonic retropropulsion experiment was conducted in the Langley Research Center Unitary Plan Wind Tunnel Test Section 2 at Mach numbers of 2.4, 3.5, and 4.6. Intended as a code validation effort, this study used pretest computations to size and refine the model such that tunnel blockage and internal flow separations were minimized. A 5-in diameter 70 degree sphere-cone forebody, which can accommodate up to four 4:1 area ratio nozzles, followed by a 9.55 inches long cylindrical aft body was selected for this test after computational maturation. The primary measurements for this experiment were high spatial-density surface pressures. In addition, high speed schlieren video and internal pressures and temperatures were acquired. The test included parametric variations in the number of nozzles utilized, thrust coefficients (roughly 0 to 4), and angles of attack (-8 to 20 degrees). The run matrix was developed to also allow quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and systematic errors due to flowfield or model misalignments. To accommodate the uncertainty assessment, many runs and replicates were conducted with the model at various locations within the tunnel and with model roll angles of 0, 60, 120, and 180 degrees. This test report provides operational details of the experiment, contains a review of trends, and provides all schlieren and pressure results within appendices.

Berry, Scott A.↗

Initial Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while capability refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Updated Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while credibility refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Updated Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while credibility refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SAS4A/SASSYS-1 Verification and Validation Plan for the Versatile Test Reactor

Software verification and validation (V&V) hold an important role in the safety analysis for nuclear facilities. Codes and models utilized in calculations that demonstrate the safety basis as part of a license application or authorization must demonstrate an acceptable pedigree with regard to key critical characteristics that are comprised of the functional and performance requirements of the software. This document describes the methodology for verification and validation of the SAS4A/SASSYS-1 systems-level liquid-metal safety analysis software in support of DOE authorization of the Versatile Test Reactor (VTR). The overall goal of this V&V effort is to demonstrate the suitability of SAS4A/SASSYS-1 for evaluation of safety performance and characterization of safety margins in VTR. To that end, the V&V methodology will be used to demonstrate the adequacy of the component and physical models of SAS4A/SASSYS-1 for the corresponding VTR design elements. This methodology, which has been derived as a generalized approach to the U.S. NRC’s evaluation model development and assessment process (EMDAP) of Regulatory Guide 1.203, entails four high-level activities: software requirements identification, assessment base development, determination of acceptance, and gap closure. The methodology has been generalized to be suitable for both verification and validation of the software for the VTR project. Several high-level engineering analysis quality assurance measures as well as supporting V&V methodology documentation are also described in this document to help support demonstration of software acceptance. To support initial development of the SAS4A/SASSYS-1 V&V basis, existing verification test problems and systems benchmarks are also identified and briefly described in this document.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Thermal hydraulic analysis of the AFIP-7 irradiation test in the Advanced test Reactor – Model correlation and performance evaluation

We report as a system level code, RELAP5 is widely used in the nuclear field for the reactor hydraulic analysis. In the component/experimental level, it is frequently employed as well. This paper demonstrates that the RELAP5 flow simulation of the AFIP-7 irradiation experiment which has a complicated 3D geometry/flow path deviates by ~28% from the flow evaluation through a computational fluid dynamics (CFD) simulation, which has been validated against a flow test performed at Oregon State University. Thermal safety compliance analysis of an experiment planned to be irradiated in the Advanced Test Reactor is usually performed using the finite element analysis code, Abaqus. This research reveals the disadvantages of the Abaqus simulation in the flow instability and departure from nucleate boiling evaluations via a conjugate heat transfer analysis of the AFIP-7 irradiation experiment. As a result, a detailed CFD simulation is suggested for irradiation experiments with complicated flow paths, rather than a simplified RELAP5 simulation or hand calculations. The validated simulation approach will be integrated with the Boehmite correlations to investigate the oxide growth prediction on the fuel cladding in Part II of this research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Blast-Wave Characteristics Near Site 300

We have developed a procedure for calculating the maximum high-explosive weight limit for use at Site 300 based on the analysis of the blast-wave propagation behavior in the atmosphere. Both analytical and experimental efforts have been involved in the present work, including a literature search, evaluation of other data, measurements of local weather conditions, and implementation of relevant computational programs. Major results of the present effort are • Comparison of the LLNL data with other data reveals discrepancies, suggesting that local effects, such as weather conditions in the downrange regions, may play a role in affecting the wave-propagation behavior. Our measurements of the local weather conditions indeed show that they differ from those at Site 300. • Analyses of other, newer models and data have resulted in the implementation of relevant computer codes, such as the BLASTO code, to be used at Site 300. • A new procedure for predicting the weight limit at Site 300 has been recommended. This new procedure consists of - Site 300 and local valley weather measurements. - The LAP code. - The BLASTO code. The LAP code is a modified SIPS code and computes the acoustic ray trajectories, including the focus ("caustic") locations, under varying local weather conditions. The BLASTO code calculates the peak overpressure vs distance relationship for a given charge weight and weather condition. Both the LAP code and the BLASTO code have been implemented and are operational at Site 300. Future plans include conducting selective tests to verify the validity of the predictive procedure recommended for Site 300.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Theoretical investigation of gas-surface interactions

The goal of this project was to develop computational tools for the calculation of the electronic structure of molecules containing heavy atoms, and to use these tools in the study of catalytic processes, with the overall objective of gaining an understanding of the catalytic process which could be used to design more efficient catalysts. The main catalytic system of interest was the combustion of hydrogen on platinum surfaces. Under this project, a flexible Dirac-Hartree-Fock (DHF) program has been developed, a code to calculate DHF correlation energies at the second-order Moeller-Plesset perturbation (PP2) level is almost complete, and code to include correlation at the MCSCF and MCSCF/MP2 level is planned. The tools so far developed have been validated and used to calibrate some more approximate methods, and applied to investigate the importance of relativistic effects in the bonding of hydrogen to platinum.

Dyall, Kenneth G.↗

Distributed Wind Aeroelastic Modeling (dWAM)

Aeroelastic modeling is the primary method for the structural and performance assessment of any wind turbine. Despite the advantages afforded by aeroelastic modeling tools, their use in the distributed wind energy industry is limited. dWAM started from the NREL Aeroelastic Modeling for Distributed Wind Turbines project with Damiani & Davis (2022) researching current needs, including input from an industry workshop. NREL's efforts will focus on OpenFAST code improvements, validation using research turbines at NREL's Flatirons Campus, code-to-code verification activities, and development of guidance documents and improved user manuals. Partner lab, Sandia National Laboratories, will focus their efforts on vertical axis wind turbine (VAWT) modeling including modeling code development, validation, and user-experience improvements.

aeroelastic↗

Integrated Medical Model (IMM) Project Verification, Validation, and Credibility (VVandC)

The Integrated Medical Model (IMM) Project supports end user requests by employing the Integrated Medical Evidence Database (iMED) and IMM tools as well as subject matter expertise within the Project. The iMED houses data used by the IMM. The IMM is designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic model based on historical data, cohort data, and subject matter expert opinion. A stochastic approach is taken because deterministic results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation, as well as lay the foundation for external review and application. METHODS: In 2008, the Project team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) [1] was published, the Project team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. Construction of these tools included meeting documentation and evidence requirements sufficient to meet external review success criteria. RESULTS: IMM Project VVC updates are compiled recurrently and include updates to the 7009 Compliance and Credibility matrices. Reporting tools have evolved over the lifetime of the IMM Project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the HRP NASA-STD-7009 Guidance Document working group and the NASA-HDBK-7009 [2]. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including operations, science and technology planning, and exploration planning. IMM v4.0 is slated for operational release in the FY015 and current VVC assessments illustrate the expected VVC status prior to the completion of customer lead external review efforts. CONCLUSIONS: The VVC approach established by the IMM Project of incorporating Project-specific recommended practices and guidelines for implementing the 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM Project represented a critical communication tool in providing clear and concise suitability assessments to IMM customers. These processes have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Walton, M.↗

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computation Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computational Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples are given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗

CFD activities at NASA. Marshall Space Flight Center (validation)

Computational fluid dynamics objectives are presented for Marshall Space Flight Center. Topics covered include: codes in use, applications to hardware development, and the Center's benchmark plan for the future. All results are presented in viewgraph format.

Schutzenhofer, Luke A.↗

Swept shock/boundary layer interaction experiments in support of CFD code validation

Research on the topic of shock wave/turbulent boundary layer interaction was carried out. Skin friction and surface pressure measurements in fin-induced, swept interactions were conducted, and heat transfer measurements in the same flows are planned. The skin friction data for a strong interaction case (Mach 4, fin-angles equal 16 and 20 degrees) were obtained, and their comparison with computational results was published. Surface pressure data for weak-to-strong fin interactions were also obtained.

Settles, G. S.↗

MARVEL 90% Final Design Report

This document provides documentation of the Microreactor Applications Research Validation and Evaluation Project’s (MARVEL) 90% Final Design, as required by U.S. Department of Energy (DOE) Standard-1189, “Integration of Safety into the Design Process." Per DOE-STD-1189-2016, the 90% Final Design documentation focuses on design completion, at a level capable of supporting procurement, construction, testing, and operation. At this phase, the design organization finalizes the hazards and accident analyses, Fire Hazard Analysis (FHA), security vulnerability assessments, and other supporting analyses for design completion. The objective of this report is to provide a high-level summary of the design thus far and provide references including, but not limited to, the following design deliverables: • Complete final drawings, specifications and commercial grade dedications that may be released for bid and/or construction. • Clearly defined testing plans for the safety and functionality of all subsystems. • Quality Assurance Program for Design, Testing and Procurement. • Software Quality Assurance Plan. • Code of Record (COR), applicable design requirements including codes and standards. • Final design that meets all the requirements stipulated in the COR. • Final design review, consisting of final validation of comment resolution from previous reviews, and a review of any additional developments since the last review. • Updated Safety Design Strategy. • Hazard Analysis. • Fire Hazard Analysis. • Accident analysis. • Security vulnerability assessment. • Current and detailed cost estimate. • Current construction schedule, and • Risk & Opportunities Assessment.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

LWR Aging Management for Life Beyond 80

While several decades of materials degradation research enabled the current US fleet of Light Water Reactors (LWR) to plan to produce electrical power through extended operations up to 80 years of plant life, it now seems appropriate to evaluate what issues, methods, and timelines need to be considered to meet the expected electric power demands for life beyond eighty (LBE) years. To address these questions, it will be necessary to review the electrical capacity and the projected LWR fleet capacity including new builds and advanced reactors. This effort should begin with a materials degradation assessment focused on known and possible unknown issues using a reduced Expanded Materials Degradation Assessment [1], which was employed to identify knowledge gaps for a second license renewal (60-80 yrs.). The focus of the LBE assessment should include: Establishing a timeline to initiate assessments of possible materials aging issues and to ensure sufficient time to evaluate materials degradation research gaps; assessing components and materials to be evaluated, e.g., metals (reactor pressure vessels and alloys within and outside the pressure boundary), concrete, cables, as well as mitigation methods, advanced monitoring, and validation with ex-service materials; initiating a LBE research plan focused on developing an expanded mechanistic understanding of materials degradation and refined models through Codes and Standards evaluation for use by the nuclear industry; and maintaining and strengthening the nuclear materials human knowledge base to address new and as yet unknown degradation modes.

Chen, Xiang↗