Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

EFFECT OF DISCRETIZATION ERROR ON THE QUANTIFICATION OF MODEL UNCERTAINTY IN TWO-PHASE FLOW SIMULATIONS

Verification, validation and uncertainty quantification (VVUQ) have become a common practice in thermal-hydraulics analysis. In general, these activities deal with propagations of uncertainties in computer code simulations, e.g., through system analysis codes. However, most existing such activities in thermal-hydraulics analysis have been primarily focused on input and model uncertainties, while numerical errors were largely overlooked. Numerical errors can appear in many different forms, e.g., round-off error, statistical sampling error, and discretization error. In thermal-hydraulics analysis, especially two-phase flow simulations commonly encountered in reactor safety analysis, the lack of consideration of discretization error is mainly due to the difficulty in estimating them. Accurate estimations of discretization error require continuous mesh refinement and/or implementation of high-order numerical schemes in system analysis code, both of which are difficult to achieve in existing codes. In this work, we will build a computer code that incorporates both first-order and second-order numerical methods to solve the two-phase flow problems. The first-order method resembles the one used in many existing system analysis codes; and the second-order method works as the reference to estimate numerical errors. Numerical verification of spatial discretization schemes will be presented in the form of mesh convergence study. It will also be demonstrated via case studies that, in practical scenarios, discretization errors can be as large as, or even larger than, model uncertainties.

42 ENGINEERING↗

Dual neutral particle transmutation in CINDER2008

A capability has been built for the CINDER2008 (beta) transmutation code that expands the capability from only neutron induced reactions to photon induced reactions. This allows for two incident neutral particles to cause nuclear transmutation in a given material simultaneously. The CINDER2008 code, a modular rewrite of the CINDER'90 transmutation code from Los Alamos National Laboratory, was modified to allow for the dual sets of physics. A photonuclear cross section and photofission product yield library was also created using ENDF-B/VII data and translated neutron fission product yields. The code and library have been combined to create a unique transmutation code. The scope of use is broad; it is capable of modeling the transmutation caused by photons released from the decay of daughter and fission products as well as transmutation in photon rich environments. A brief code description and a verification and validation of the contributions are given. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SU-E-J-245: Is Off-Line Adaptive Radiotherapy Sufficient for Head and Neck Cancer with IGRT?

Purpose: Radiation doses delivered to patients with head and neck cancer (HN) may deviate from the planned doses because of variations in patient setup and anatomy. This study was to evaluate whether off-line Adaptive Radiotherapy (ART) is sufficient. Methods: Ten HN patients, who received IMRT under daily imaging guidance using CT-on-rail/KV-CBCT, were randomly selected for this study. For each patient, the daily treatment setup was corrected with translational only directions. Sixty weekly verification CTs were retrospectively analyzed. On these weekly verification CTs, the tumor volumes and OAR contours were manually delineated by a physician. With the treatment iso-center placed on the verification CTs, according to the recorded clinical shifts, the treatment beams from the original IMRT plans were then applied to these CTs to calculate the delivered doses. The electron density of the planning CTs and weekly CTs were overridden to 1 g/cm3. Results: Among 60 fractions, D99 of the CTVs in 4 fractions decreased more than 5% of the planned doses. The maximum dose of the spinal cord exceeded 10% of the planned values in 2 fractions. A close examination indicated that the dose discrepancy in these 6 fractions was due to patient rotations, especially shoulder rotations. After registering these 6 CTs with the planning CT allowing six degree of freedoms, the maximum rotations around 3 axes were > 1.5° for these fractions. With rotation setup errors removed, 4 out of 10 patients still required off-line ART to accommodate anatomical changes. Conclusion: A significant shoulder rotations were observed in 10% fractions, requiring patient re-setup. Off-line ART alone is not sufficient to correct for random variations of patient position, although ART is effective to adapt to patients' gradual anatomic changes. Re-setup or on-line ART may be considered for patients with large deviations detected early by daily IGRT images. The study is supported in part by Siemens Medical Solutions.

60 APPLIED LIFE SCIENCES↗

DEVELOPMENT AND TESTING OF FAULT-DIAGNOSIS ALGORITHMS FOR REACTOR PLANT SYSTEMS

Argonne National Laboratory is further developing fault diagnosis algorithms for use by the operator of a nuclear plant to aid in improved monitoring of overall plant condition and performance. The objective is better management of plant upsets through more timely, informed decisions on control actions with the ultimate goal of improved plant safety, production, and cost management. Integration of these algorithms with visual aids for operators is taking place through a collaboration under the concept of an operator advisory system. This is a software entity whose purpose is to manage and distill the enormous amount of information an operator must process to understand the plant state, particularly in off-normal situations, and how the state trajectory will unfold in time. The fault diagnosis algorithms were exhaustively tested using computer simulations of twenty different faults introduced into the chemical and volume control system (CVCS) of a pressurized water reactor (PWR). The algorithms are unique in that each new application to a facility requires providing only the piping and instrumentation diagram (PID) and no other plant-specific information; a subject-matter expert is not needed to install and maintain each instance of an application. The testing approach followed accepted procedures for verifying and validating software. It was shown that the code satisfies its functional requirement which is to accept sensor information, identify process variable trends based on this sensor information, and then to return an accurate diagnosis based on chains of rules related to these trends. The validation and verification exercise made use of GPASS, a one-dimensional systems code, for simulating CVCS operation. Plant components were failed and the code generated the resulting plant response. Parametric studies with respect to the severity of the fault, the richness of the plant sensor set, and the accuracy of sensors were performed as part of the validation exercise. The background and overview of the software will be presented to give an overview of the approach. Following, the verification and validation effort using the GPASS code for simulation of plant transients including a sensitivity study on important parameters will be presented

Fault Diagnosis Algorithm↗

Automated radiotherapy treatment plan integrity verification

Purpose: In our clinic, physicists spend from 15 to 60 min to verify the physical and dosimetric integrity of radiotherapy plans before presentation to radiation oncology physicians for approval. The purpose of this study was to design and implement a framework to automate as many elements of this quality control (QC) step as possible. Methods: A comprehensive computer application was developed to carry out a majority of these verification tasks in the Philips PINNACLE treatment planning system (TPS). This QC tool functions based on both PINNACLE scripting elements and PERL sub-routines. The core of this technique is the method of dynamic scripting, which involves a PERL programming module that is flexible and powerful for treatment plan data handling. Run-time plan data are collected, saved into temporary files, and analyzed against standard values and predefined logical rules. The results were summarized in a hypertext markup language (HTML) report that is displayed to the user. Results: This tool has been in clinical use for over a year. The occurrence frequency of technical problems, which would cause delays and suboptimal plans, has been reduced since clinical implementation. Conclusions: In addition to drastically reducing the set of human-driven logical comparisons, this QC tool also accomplished some tasks that are otherwise either quite laborious or impractical for humans to verify, e.g., identifying conflicts amongst IMRT optimization objectives.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Numerical implementation, verification and validation of two-phase flow four-equation drift flux model with Jacobian-free Newton–Krylov method

This study presents a numerical investigation on using the Jacobian-free Newton–Krylov (JFNK) method to solve the two-phase flow four-equation drift flux model with realistic constitutive correlations (‘closure models’). The drift flux model is based on Isshi and his collaborators’ work. Additional constitutive correlations for vertical channel flow, such as two-phase flow pressure drop, flow regime map, wall boiling and interfacial heat transfer models, were taken from the RELAP5-3D Code Manual and included to complete the model. The staggered grid finite volume method and fully implicit backward Euler method was used for the spatial discretization and time integration schemes, respectively. The Jacobian-free Newton–Krylov method shows no difficulty in solving the two-phase flow drift flux model with a discrete flow regime map. In addition to the Jacobian-free approach, the preconditioning matrix is obtained by using the default finite differencing method provided in the PETSc package, and consequently the labor-intensive implementation of complex analytical Jacobian matrix is avoided. Extensive and successful numerical verification and validation have been performed to prove the correct implementation of the models and methods. Code-to-code comparison with RELAP5-3D has further demonstrated the successful implementation of the drift flux model.

42 ENGINEERING↗

Numerical optimization - An assessment of its role in transport aircraft aerodynamic design through a case study

An efficient transonic wing design procedure based upon numerical optimization together with three-dimensional transonic methods has been developed and used to design an advanced transport wing. The method development included an examination of the use of both full potential and extended small disturbance analysis codes and demonstrated that the former formulation was more reliable. In either case, the design procedure is economical and easy to use. Design verification in a unique semi-span test arrangement demonstrated that the design method produced a wing which satisfied the study design requirements. However, aeroelastic deformation of the wing occurred during the wind tunnel test. The computational methods used in the design procedure were employed to assess the effect of the aeroelastic deformation. The paper concludes with an evaluation of the design procedure and recommendation for its improvement.

Lores, M. E.↗

Evaluation of the 29-km Eta Model for Weather Support to the United States Space Program

The Applied Meteorology Unit (AMU) conducted a year-long evaluation of NCEP's 29-km mesoscale Eta (meso-eta) weather prediction model in order to identify added value to forecast operations in support of the United States space program. The evaluation was stratified over warm and cool seasons and considered both objective and subjective verification methodologies. Objective verification results generally indicate that meso-eta model point forecasts at selected stations exhibit minimal error growth in terms of RMS errors and are reasonably unbiased. Conversely, results from the subjective verification demonstrate that model forecasts of developing weather events such as thunderstorms, sea breezes, and cold fronts, are not always as accurate as implied by the seasonal error statistics. Sea-breeze case studies reveal that the model generates a dynamically-consistent thermally direct circulation over the Florida peninsula, although at a larger scale than observed. Thunderstorm verification reveals that the meso-eta model is capable of predicting areas of organized convection, particularly during the late afternoon hours but is not capable of forecasting individual thunderstorms. Verification of cold fronts during the cool season reveals that the model is capable of forecasting a majority of cold frontal passages through east central Florida to within +1-h of observed frontal passage.

Manobianco, John↗

Verification of sub-grid filtered drag models for gas-particle fluidized beds with immersed cylinder arrays

The accuracy of coarse-grid multiphase CFD simulations of fluidized beds may be improved via the inclusion of filtered constitutive models. In our previous study (Sarkar et al., Chem. Eng. Sci., 104, 399-412), we developed such a set of filtered drag relationships for beds with immersed arrays of cooling tubes. Verification of these filtered drag models is addressed in this work. Predictions from coarse-grid simulations with the sub-grid filtered corrections are compared against accurate, highly-resolved simulations of full-scale turbulent and bubbling fluidized beds. The filtered drag models offer a computationally efficient yet accurate alternative for obtaining macroscopic predictions, but the spatial resolution of meso-scale clustering heterogeneities is sacrificed.

42 ENGINEERING↗

Replacement Technologies for Precision Cleaning of Aerospace Hardware for Propellant Service

The NASA White Sands Test Facility (WSTF) is developing cleaning and verification processes to replace currently used chlorofluorocarbon-l13- (CFC-113-) based processes. The processes being evaluated include both aqueous- and solvent-based techniques. Replacement technologies are being investigated for aerospace hardware and for gauges and instrumentation. This paper includes the findings of investigations of aqueous cleaning and verification of aerospace hardware using known contaminants, such as hydraulic fluid and commonly used oils. The results correlate nonvolatile residue with CFC 113. The studies also include enhancements to aqueous sampling for organic and particulate contamination. Although aqueous alternatives have been identified for several processes, a need still exists for nonaqueous solvent cleaning, such as the cleaning and cleanliness verification of gauges used for oxygen service. The cleaning effectiveness of tetrachloroethylene (PCE), trichloroethylene (TCE), ethanol, hydrochlorofluorocarbon 225 (HCFC 225), HCFC 141b, HFE 7100(R), and Vertrel MCA(R) was evaluated using aerospace gauges and precision instruments and then compared to the cleaning effectiveness of CFC 113. Solvents considered for use in oxygen systems were also tested for oxygen compatibility using high-pressure oxygen autogenous ignition and liquid oxygen mechanical impact testing.

Harold Beeson↗

Verification and Validation of Systems in which AI is a Key Element

Many systems are being considered in which artificial intelligence (AI) will be a key element. Failure of an AI element can lead to system failure, hence the need for AI verification and validation (V&V). This article addresses V&V of such a system, focusing on the issues created by characteristics of AI that make V&V challenging. The element(s) containing AI capabilities is treated as a subsystem and V&V is conducted on that subsystem and its interfaces with other elements of the system under study, just as V&V would be conducted on other subsystems. That is, the high-level definitions of verification and of validation do not change for systems containing one or more AI elements. However, AI V&V challenges require approaches and solutions beyond those for conventional or traditional (those without AI elements) systems. This article provides an overview of how machine learning components/subsystems “fit” in the systems engineering framework (Section 1), identifies characteristics of AI subsystems that create challenges in their V&V (Section 2), describes those challenges (Section 3) and provides some potential solutions (Section 4).

Pullum, Laura↗

Performance and Safety Parameters for the High Flux Isotope Reactor

A Monte Carlo depletion model for the High Flux Isotope Reactor (HFIR) Cycle 400 and its use in calculating parameters of relevance to the reactor performance and safety during the reactor cycle are presented in this paper. This depletion model was developed to serve as a reference for the design of a low-enriched uranium (LEU) fuel for an ongoing study to convert HFIR from high-enriched uranium (HEU) to LEU fuel; both HEU and LEU depletion models use the same methodology and ENDV/B-VII nuclear data as discussed in this paper. The calculated HFIR Cycle 400 parameters, which are compared when available with measurement data from critical experiments performed at HFIR, data included in the HFIR Safety Analysis Report (SAR), or data reported by previous calculations, provide a basis for verification or updating of the corresponding SAR data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Large Payload Ground Transportation and Test Considerations

During test and verification planning for the Altair lunar lander project, a National Aeronautics and Space Administration (NASA) study team identified several ground transportation and test issues related to the large payload diameter. Although the entire Constellation Program-including Altair-has since been canceled, issues identified by the Altair project serve as important lessons learned for payloads greater than 7 m diameter being considered for NASA's new Space Launch System (SLS). A transportation feasibility study found that Altair's 8.97 m diameter Descent Module would not fit inside available aircraft. Although the Ascent Module cabin was only 2.35 m diameter, the long reaction control system booms extended nearly to the Descent Module diameter, making it equally unsuitable for air transportation without removing the booms and invalidating assembly workmanship screens or acceptance testing that had already been performed. Ground transportation of very large payloads over extended distances is not generally permitted by most states, so overland transportation alone would not be an option. Limited ground transportation to the nearest waterway may be possible, but water transportation could take as long as 66 days per production unit, depending on point of origin and acceptance test facility; transportation from the western United States would require transit through the Panama Canal to access the Kennedy Space Center launch site. Large payloads also pose acceptance test and ground processing challenges. Although propulsion, mechanical vibration, and reverberant acoustic test facilities at NASA's Plum Brook Station have been designed to accommodate large spacecraft, special handling and test work-arounds may be necessary, which could increase cost, schedule, and technical risk. Once at the launch site, there are no facilities currently capable of accommodating the combination of large payload size and hazardous processing such as hypergolic fuels, pyrotechnic devices, and high pressure gasses. Ironically, the limiting factor to a national heavy lift strategy may not be the rocket technology needed to throw a heavy payload, but rather the terrestrial infrastructure-roads, bridges, airframes, and buildings-necessary to transport, acceptance test, and process large spacecraft. Failure to carefully consider where and how large spacecraft are manufactured, tested, and launched could result in unforeseen cost to modify existing (or develop new) infrastructure, or incur additional risk due to increased handling operations or eliminating key verifications.

Rucker, Michelle A.↗

Verification of dose distribution for volumetric modulated arc therapy total marrow irradiation in a humanlike phantom

Purpose: Volumetric modulated arc therapy (VMAT) treatment planning studies have been reported to provide good target coverage and organs at risk (OARs) sparing in total marrow irradiation (TMI). A comprehensive dosimetric study simulating the clinical situation as close as possible is a norm in radiotherapy before a technique can be used to treat a patient. Without such a study, it would be difficult to make a reliable and safe clinical transition especially with a technique as complicated as VMAT-TMI. To this end, the dosimetric feasibility of VMAT-TMI technique in terms of treatment planning, delivery efficiency, and the most importantly three dimensional dose distribution accuracy was investigated in this study. The VMAT-TMI dose distribution inside a humanlike Rando phantom was measured and compared to the dose calculated using RapidArc especially in the field junctions and the inhomogeneous tissues including the lungs, which is the dose-limiting organ in TMI. Methods: Three subplans with a total of nine arcs were used to treat the planning target volume (PTV), which was determined as all the bones plus the 3 mm margin. Thermoluminescent detectors (TLDs) were placed at 39 positions throughout the phantom. The measured TLD doses were compared to the calculated plan doses. Planar dose for each arc was verified using mapcheck. Results: TLD readings demonstrated accurate dose delivery, with a median dose difference of 0.5% (range: -4.3% and 6.6%) from the calculated dose in the junctions and in the inhomogeneous medium including the lungs. Conclusions: The results from this study suggest that RapidArc VMAT technique is dosimetrically accurate, safe, and efficient in delivering TMI within clinically acceptable time frame.

61 RADIATION PROTECTION AND DOSIMETRY↗

Structural Deterministic Safety Factors Selection Criteria and Verification

Though current deterministic safety factors are arbitrarily and unaccountably specified, its ratio is rooted in resistive and applied stress probability distributions. This study approached the deterministic method from a probabilistic concept leading to a more systematic and coherent philosophy and criterion for designing more uniform and reliable high-performance structures. The deterministic method was noted to consist of three safety factors: a standard deviation multiplier of the applied stress distribution; a K-factor for the A- or B-basis material ultimate stress; and the conventional safety factor to ensure that the applied stress does not operate in the inelastic zone of metallic materials. The conventional safety factor is specifically defined as the ratio of ultimate-to-yield stresses. A deterministic safety index of the combined safety factors was derived from which the corresponding reliability proved the deterministic method is not reliability sensitive. The bases for selecting safety factors are presented and verification requirements are discussed. The suggested deterministic approach is applicable to all NASA, DOD, and commercial high-performance structures under static stresses.

Verderaime, V.↗

Two-Fluid and Resistive Nonlinear Simulations of Tokamak Equilibrium, Stability, and Reconnection

The NIMROD and M3D / M3D-C1 codes now each have both a resistive MHD and a two-fluid (2F) capability including gyroviscosity and Hall terms. We describe: (1) a nonlinear 3D verification test in the resistive MHD regime in which the two codes are in detailed agreement , (2) new studies that illuminate the effect of two-fluid physics on spontaneous rotation in tokamaks, (3) studies of nonlinear reconnection in regimes of relevance to fusion plasmas with peak nonlinear reconnection rates that are essentially independent of the resistivity, and (4) linear two-fluid tearing mode calculations including electron mass that agree with analytic studies over a wide range of parameter regimes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Verification & Validation of High-Order Short-Characteristics-Based Deterministic Transport Methodology on Unstructured Grids

The research team has developed a practical, high-order, discrete-ordinates, short characteristics neutron transport code for three-dimensional configurations represented on unstructured tetrahedral grids that can be used for realistic reactor physics applications at both the assembly and core levels. This project will perform a comprehensive verification and validation of this new computational tool against both a continuous-energy Monte Carlo simulation (e.g. MCNP) and experimentally measured data, an essential prerequisite for its deployment in reactor core modeling. Verification is divided into three phases. The team will first conduct spatial mesh and expansion order refinement studies to monitor convergence of the numerical solution to reference solutions. This is quantified by convergence rates that are based on integral error norms computed from the cell-by-cell difference between the code’s numerical solution and its reference counterpart. The latter is either analytic or very fine- mesh numerical solutions from independent computational tools. For the second phase, the team will create a suite of code-independent benchmark configurations to enable testing the theoretical order of accuracy of any particular discretization of the discrete ordinates approximation of the transport equation. For each tested case (i.e. mesh and spatial approximation order), researchers will execute the code and compare the resulting numerical solution to the exact solution on a per cell basis to determine the distribution of the numerical error. The final activity comprises a comparison to continuous-energy Monte Carlo solutions for zero-power critical configuration measurements at Idaho National Laboratory’s Advanced Test Reactor (ATR). Results of this comparison will allow the investigators to distinguish between modeling errors and the above-listed discretization errors introduced by the deterministic method, and to separate the sources of uncertainty.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗