Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Development of Detonation Modeling Capabilities for Rocket Test Facilities: Hydrogen-Oxygen-Nitrogen Mixtures

The objective of the presented work was to develop validated computational fluid dynamics (CFD) based methodologies for predicting propellant detonations and their associated blast environments. Applications of interest were scenarios relevant to rocket propulsion test and launch facilities. All model development was conducted within the framework of the Loci/CHEM CFD tool due to its reliability and robustness in predicting high-speed combusting flow-fields associated with rocket engines and plumes. During the course of the project, verification and validation studies were completed for hydrogen-fueled detonation phenomena such as shock-induced combustion, confined detonation waves, vapor cloud explosions, and deflagration-to-detonation transition (DDT) processes. The DDT validation cases included predicting flame acceleration mechanisms associated with turbulent flame-jets and flow-obstacles. Excellent comparison between test data and model predictions were observed. The proposed CFD methodology was then successfully applied to model a detonation event that occurred during liquid oxygen/gaseous hydrogen rocket diffuser testing at NASA Stennis Space Center.

Allgood, Daniel C.↗

Development of an Unstructured, Three-Dimensional Material Response Design Tool

A preliminary verification and validation of a new material response model is presented. This model, Icarus, is intended to serve as a design tool for the thermal protection systems of re-entry vehicles. Currently, the capability of the model is limited to simulating the pyrolysis of a material as a result of the radiative and convective surface heating imposed on the material from the surrounding high enthalpy gas. Since the major focus behind the development of Icarus has been model extensibility, the hope is that additional physics can be quickly added. The extensibility is critical since thermal protection systems are becoming increasing complex, e.g. woven carbon polymers. Additionally, as a three-dimensional, unstructured, finite-volume model, Icarus is capable of modeling complex geometries as well as multi-dimensional physics, which have been shown to be important in some scenarios and are not captured by one-dimensional models. In this paper, the mathematical and numerical formulation is presented followed by a discussion of the software architecture and some preliminary verification and validation studies.

Material Response Model↗

Development of a Three-Dimensional, Unstructured Material Response Design Tool

A preliminary verification and validation of a new material response model is presented. This model, Icarus, is intended to serve as a design tool for the thermal protection systems of re-entry vehicles. Currently, the capability of the model is limited to simulating the pyrolysis of a material as a result of the radiative and convective surface heating imposed on the material from the surrounding high enthalpy gas. Since the major focus behind the development of Icarus has been model extensibility, the hope is that additional physics can be quickly added. This extensibility is critical since thermal protection systems are becoming increasing complex, e.g. woven carbon polymers. Additionally, as a three-dimensional, unstructured, finite-volume model, Icarus is capable of modeling complex geometries. In this paper, the mathematical and numerical formulation is presented followed by a discussion of the software architecture and some preliminary verification and validation studies.

Thermal Protection System↗

NASA Engineering and Safety Center Technical Bulletin No. 14-02: Aerodynamic Reaction Control System (RCS) Orientation and Jet Interaction (JI) Model Validation

Careful consideration should be given to placement and orientation of RCS jet thrusters on hypersonic entry vehicles in order to minimize adverse RCS JI. Modern state-of-the-art computational fluid dynamics (CFD) tools should be able to predict the RCS effectiveness and JI accurately when coupled with verification and validation studies, including the use of appropriately designed experimental wind tunnel testing.

Aerodynamic Reaction Control System↗

Verification of Multiphysics software: Space and time convergence studies for nonlinearly coupled applications

High-fidelity modeling of nuclear reactors requires the solution of a nonlinear coupled multi-physics stiff problem with widely varying time and length scales that need to be resolved correctly. A numerical method that converges the implicit nonlinear terms to a small tolerance is often referred to as nonlinearly consistent (or tightly coupled). This nonlinear consistency is still lacking in the vast majority of coupling techniques today. We present a tightly coupled multiphysics framework that tackles this issue and present code-verification and convergence analyses in space and time for several models of nonlinear coupled physics.

97 MATHEMATICS AND COMPUTING↗

A scaling study of the natural circulation flow of the ex-vessel core catcher cooling system of EU-APR1400 for designing a scale-down test facility for design verification

In this paper a scaling study on the steady state natural circulation flow along the flow path of the ex vessel core catcher cooling system of EU-APR1400 is described, and the scaling criteria for reproducing the same steady state thermalhydraulic characteristics of the natural circulation flow as a prototype core catcher cooling system in the scale-down test facility are derived in terms of the down-comer pipe diameter and orifice resistance. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Climate studies from satellite observations - Special problems in the verification of earth radiation balance, cloud climatology, and related climate experiments

A body of techniques that have been developed and planned for use during the Earth Radiation Budget Experiment (ERBE), the International Satellite Cloud Climatology Project (ISCCP), and related climate experiments of the 1980's are reviewed. Validation and verification methods must apply for systems of satellites. They include: (1) use of a normalization or intercalibration satellite, (2) special intensive observation areas located over ground-truth sites, and (3) monitoring of sun and earth by several satellites and/or several instruments at the same time. Since each climate application area has a hierarchy of user communities, validation techniques vary from very detailed methods to those that simply assure high relative accuracy in detecting space and time variations for climate studies. It is shown that climate experiments generally require more emphasis on long-term stability and internal consistency of satellite data sets than high absolute accuracy.

Vonder Haar, T. H.↗

Initial experience of ArcCHECK and 3DVH software for RapidArc treatment plan verification

The purpose of this study was to perform delivery quality assurance with ArcCHECK and 3DVH system (Sun Nuclear, FL) and to evaluate the suitability of this system for volumetric-modulated arc therapy (VMAT) (RapidArc [RA]) verification. This software calculates the delivered dose distributions in patients by perturbing the calculated dose using errors detected in fluence or planar dose measurements. The device is tested to correlate the gamma passing rate (%GP) and the composite dose predicted by 3DVH software. A total of 28 patients with prostate cancer who were treated with RA were analyzed. RA treatments were delivered to a diode array phantom (ArcCHECK), which was used to create a planned dose perturbation (PDP) file. The 3DVH analysis used the dose differences derived from comparing the measured dose with the treatment planning system (TPS)-calculated doses to perturb the initial TPS-calculated dose. The 3DVH then overlays the resultant dose on the patient's structures using the resultant “PDP” beams. Measured dose distributions were compared with the calculated ones using the gamma index (GI) method by applying the global (Van Dyk) normalization and acceptance criteria, i.e., 3%/3 mm. Paired differences tests were used to estimate statistical significance of the differences between the composite dose calculated using 3DVH and %GP. Also, statistical correlation by means of logistic regression analysis has been analyzed. Dose-volume histogram (DVH) analysis for patient plans revealed small differences between treatment plan calculations and 3DVH results for organ at risk (OAR), whereas planning target volume (PTV) of the measured plan was systematically higher than that predicted by the TPS. The t-test results between the planned and the estimated DVH values showed that mean values were incomparable (p < 0.05). The quality assurance (QA) gamma analysis 3%/3 mm showed that in all cases there were only weak-to-moderate correlations (Pearson r: 0.12 to 0.74). Moreover, clinically relevant differences increased with increasing QA passing rate, indicating that some of the largest dose differences occurred in the cases of high QA passing rates, which may be called “false negatives.” The clinical importance of any disagreement between the measured and the calculated dose is often difficult to interpret; however, beam errors (either in delivery or in TPS calculation) can affect the effectiveness of the patient dose. Further research is needed to determinate the role of a PDP-type algorithm to accurately estimate patient dose effect.

61 RADIATION PROTECTION AND DOSIMETRY↗

Verification of statistical method CORN for modeling of microfuel in the case of high grain concentration

Two methods of modeling a double-heterogeneity fuel are studied: the deterministic positioning and the statistical method CORN of the MCU software package. The effect of distribution of microfuel in a pebble bed on the calculation results is studied. The results of verification of the statistical method CORN for the cases of the microfuel concentration up to 170 cm{sup –3} in a pebble bed are presented. The admissibility of homogenization of the microfuel coating with the graphite matrix is studied. The dependence of the reactivity on the relative location of fuel and graphite spheres in a pebble bed is found.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification of LANDSAT imagery for morphametric and topological studies of drainage basins in a section of the western plateau of Sao Paulo State: Tiete-Aguapei watershed

The potential of using LANDSAT MSS imagery for morphometric and topological studies of drainage basins was verified. Using Tiete and Aguapei watershed (Western Plateau) as the test site because of its homogeneous landscape. Morphometric variables collected for ten drainage basins include: circularity index; river density; drainage density; topographic texture; areal and index length; basin parameter; and main river length 1st order and 2nd order channel length. The topographical variables determined were: order; magnitude; bifuraction ratio; weighted bifuraction ratio; number of segments; number of linking; trajectory length; and topological diameter. Data were collected on topographical maps at the scale of 1:250,000 and 1:59,000 and on LANDSAT imagery at the scale of 1:250,000. The results which were summarized on tables for further analysis, show that LANDSAT imagery can supply the lack of topographic charts for drainage studies.

Parada, N. D. J.↗

Block 2 SRM conceptual design studies. Volume 1, Book 2: Preliminary development and verification plan

Activities that will be conducted in support of the development and verification of the Block 2 Solid Rocket Motor (SRM) are described. Development includes design, fabrication, processing, and testing activities in which the results are fed back into the project. Verification includes analytical and test activities which demonstrate SRM component/subassembly/assembly capability to perform its intended function. The management organization responsible for formulating and implementing the verification program is introduced. It also identifies the controls which will monitor and track the verification program. Integral with the design and certification of the SRM are other pieces of equipment used in transportation, handling, and testing which influence the reliability and maintainability of the SRM configuration. The certification of this equipment is also discussed.

Source record↗

Outcomes of the JNT 1955 Phase I Viability Study of Gamma Emission Tomography for Spent Fuel Verification

The potential for gamma emission tomography (GET) to detect partial defects within a spent nuclear fuel assembly has been assessed within the IAEA Support Program project JNT 1955, phase I, which was completed and reported to the IAEA in October 2016. Two safeguards verification objectives were identified in the project; (1) independent determination of the number of active pins that are present in a measured assembly, in the absence of a priori information about the assembly; and (2) quantitative assessment of pin-by-pin properties, for example the activity of key isotopes or pin attributes such as cooling time and relative burnup, under the assumption that basic fuel parameters (e.g., assembly type and nominal fuel composition) are known. The efficacy of GET to meet these two verification objectives was evaluated across a range of fuel types, burnups and cooling times, while targeting a total interrogation time of less than 60 minutes. The evaluations were founded on a modelling and analysis framework applied to existing and emerging GET instrument designs. Monte Carlo models of different fuel types were used to produce simulated tomographer responses to large populations of “virtual” fuel assemblies. The simulated instrument response data were then processed using a variety of tomographic-reconstruction and image-processing methods, and scoring metrics were defined and used to evaluate the performance of the methods.This paper describes the analysis framework and metrics used to predict tomographer performance. It also presents the design of a “universal” GET (UGET) instrument intended to support the full range of verification scenarios envisioned by the IAEA. Finally, it gives examples of the expected partial-defect detection capabilities for some fuels and diversion scenarios, and it provides a comparison of predicted performance for the notional UGET design and an optimized variant of an existing IAEA instrument.

Jacobsson-Svard, Staffan↗

A Comparison Between Electronic Portal Imaging Device and Cone Beam CT in Radiotherapy Verification of Nasopharyngeal Carcinoma

The demand of greater accuracy in intensity-modulated radiotherapy (IMRT) has driven the development of more advanced verification systems. The purpose of this study is to investigate the differences in verification accuracy in terms of the position error detected between cone-beam computed tomography (CBCT) and electronic portal imaging device (EPID) in the IMRT of nasopharyngeal carcinoma (NPC). Two groups of NPC patients (n = 22 and n = 28) verified by CBCT (G1-CB), EPID (G1-EP), and EPID (G2-EP) only, respectively, were recruited. The positional errors between the G1-CB group and the G2-EP group were compared. In addition, the magnitudes of the position errors of EPID taken in the same session of the CBCT, but after necessary corrections (G1-EP), were analyzed. In the CBCT group, 455 CBCT images (G1-CB) and 206 EPID images (G1-EP) were collected, whereas 319 EPID images (G2-EP) for the EPID group, were recorded. The median position errors detected in CBCT were between 0.80 and 0.90 mm in the antero-posterior (A-P), left-right (L-R), and supero-inferior (S-I) directions, whereas those of the EPID were all 0.50 mm. The magnitude of position deviation detected by the CBCT was higher than that of the EPID and their differences were extremely significant (p < 0.001). The frequencies in the G2-EP group with position errors greater than the tolerance (2 mm) were 32, 42, and 27 in the A-P, L-R, and S-I directions, respectively, which accounted for 16.5%, 21.6%, and 13.9% of the total number of EPID. There was difference in verification capability between the CBCT and EPID when applied to IMRT of NPC patients. Because an average of 1 of 6 verifications in EPID was inferior to that of the CBCT, verification by CBCT is recommended.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗

Final Technical Report on Quantifying Dependability Attributes of Software Based Safety Critical Instrumentation and Control Systems in Nuclear Power Plants

With the current transition from analog to digital instrumentation and control systems in nuclear power plants, the number and variety of software-based systems have significantly increased. The sophisticated nature and increasing complexity of software raises trust in these systems as a significant challenge. The trust placed in a software system is typically termed software dependability. Software dependability analysis faces uncommon challenges since software systems’ characteristics differ from those of hardware systems. The lack of systematic science-based methods for quantifying the dependability attributes in software-based instrumentation as well as control systems in safety critical applications has proved itself to be a significant inhibitor to the expanded use of modern digital technology in the nuclear industry. Dependability refers to the ability of a system to deliver a service that can be trusted. Dependability is commonly considered as a general concept that encompasses different attributes, e.g., reliability, safety, security, availability and maintainability. Dependability research has progressed significantly over the last few decades. For example, various assessment models and/or design approaches have been proposed for software reliability, software availability and software maintainability. Advances have also been made to integrate multiple dependability attributes, e.g., integrating security with other dependability attributes, measuring availability and maintainability, modeling reliability and availability, quantifying reliability and security, exploring the dependencies between security and safety and developing integrated analysis models. However, there is still a lack of understanding of the dependencies between various dependability attributes as a whole and of how such dependencies are formed. To address the need for quantification and give a more objective basis to the review process -- therefore reducing regulatory uncertainty -- measures and methods are needed to assess dependability attributes early on, as well as throughout the life-cycle process of software development. In this research, extensive expert opinion elicitation is used to identify the measures and methods for assessing software dependability. Semi-structured questionnaires were designed to elicit expert knowledge. A new notation system, Causal Mechanism Graphing, was developed to extract and represent such knowledge. The Causal Mechanism Graphs were merged, thus, obtaining the consensus knowledge shared by the domain experts. In this report, we focus on how software contributes to dependability. However, software dependability is not discussed separately from the context of systems or socio-technical systems. Specifically, this report focuses on software dependability, reliability, safety, security, availability, and maintainability. Our research was conducted in the sequence of stages found below. Each stage is further examined in its corresponding chapter. Stage 1 (Chapter 2): Elicitation of causal maps describing the dependencies between dependability attributes. These causal maps were constructed using expert opinion elicitation. This chapter describes the expert opinion elicitation process, the questionnaire design, the causal map construction method and the causal maps obtained. Stage 2 (Chapter 3): Elicitation of the causal map describing the occurrence of the event of interest for each dependability attribute. The causal mechanisms for the “event of interest” were extracted for each of the software dependability attributes. The “event of interest” for a dependability attribute is generally considered to be the “attribute failure”, e.g. security failure. The extraction was based on the analysis of expert elicitation results obtained in Stage 1. Stage 3 (Chapter 4): Identification of relevant measurements. Measures for the “events of interest” and their causal mechanisms were obtained from expert opinion elicitation for each of the software dependability attributes. The measures extracted are presented in this chapter. Stage 4 (Chapter 5): Assessment of the coverage of the causal maps via measures. Coverage was assessed to determine whether the measures obtained were sufficient to quantify software dependability, and what measures are further required. Stage 5 (Chapter 6): Identification of “missing” measures and measurement approaches for concepts not covered. New measures, for concepts that had not been covered sufficiently as determined in Stage 4, were identified using supplementary expert opinion elicitation as well as literature reviews. Stage 6 (Chapter 7): Building of a detailed quantification model based on the causal maps and measurements obtained. Ability to derive such a quantification model shows that the causal models and measurements derived from the previous stages (Stage 1 to Stage 5) can form the technical basis for developing dependability quantification models. Scope restrictions have led us to prioritize this demonstration effort. The demonstration was focused on a critical system, i.e. the reactor protection system. For this system, a ranking of the software dependability attributes by nuclear stakeholders was developed. As expected for this application, the stakeholder ranking identified safety as the most critical attribute to be quantified. A safety quantification model limited to the requirements phase of development was built. Two case studies were conducted for verification. A preliminary control gate for software safety for the requirements stage was proposed and applied to the first case study. The control gate allows a cost effective selection of the duration of the requirements phase.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

WE-D-BRF-03: Proton Beam Range Verification with a Single Prompt Gamma-Ray Detector

Purpose: To present an experimental study of a novel range verification method for scanned and scattered proton beams. Methods: A detection system consisting of an actively shielded lanthanum(III)bromide scintillator and a one-sided lead collimator was used to measure prompt gamma-rays emitted during the delivery of proton beams to a water phantom and an anthropomorphic head phantom. The residual proton range at the collimator position was determined by comparing gamma-ray intensities while the proton energy was modulated to the distal end of the target. We used a clinical field to deliver a 50 cGy dose to a 12 cm diameter target in the water phantom and to a 175 cc tumor-shaped target in the head phantom. The detector signals were acquired with a custom data acquisition system enabling energy and time-of-flight discrimination of prompt gamma-rays. Results: Range deviations were detected with a statistical accuracy of ± 0.2 mm and ± 1.4 mm at 90% confidence level, respectively for the water and head phantom. We obtained a time resolution of 1 ns FWHM and an energy resolution < 2% FWHM for the main gamma lines from proton-induced nuclear reactions with carbon and oxygen. This allowed for an accurate separation of the prompt gamma-rays from neutron-induced background. Conclusion: Proton range deviations can be detected with millimeter accuracy using a single prompt gamma-ray measurement point acquired during the delivery of a few proton energy layers to the distal part of the target. The method is also feasible in the presence of background radiation from passively scattered proton beam delivery.

60 APPLIED LIFE SCIENCES↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗

Rate of Para-Orthohydrogen Conversion in Cryogenic Vortex Tube

Raising efficiency of the cooling process for cryogenic hydrogen and minimizing hydrogen boil-off during storage and transportation of liquid hydrogen are critically important factors for widening implementation of hydrogen-based clean energy systems. One novel approach involves utilization of relatively simple catalyzed vortex tubes, where hydrogen in the primarily para- nuclear spin isomer form is converted into the ortho- form while consuming a significant amount of heat. To design such systems effectively, better understanding is required about catalyst-assisted para-orthohydrogen conversion rates in high-speed vortical flows. In this study, a computational fluid dynamics simulation has been set up to model an experimental system with cryogenic hydrogen vortex tubes. Mesh-verification and a validation study has been conducted first for a non-catalyzed tube. Then, the rate coefficient of the para-orthohydrogen conversion of cryogenic hydrogen has been determined by matching numerical results with experimental data available for a catalyzed vortex tube. Furthermore, the presented information can help design and optimize cryogenic hydrogen cooling within vortex tubes.

08 HYDROGEN↗