Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Design and validation of an MR-conditional robot for transcranial focused ultrasound surgery in infants

Purpose: Current treatment of intraventricular hemorrhage (IVH) involves cerebral shunt placement or an invasive brain surgery. Magnetic resonance-guided focused ultrasound (MRgFUS) applied to the brains of pediatric patients presents an opportunity to treat IVH in a noninvasive manner, termed “incision-less surgery.” Current clinical and research focused ultrasound systems lack the capability to perform neonatal transcranial surgeries due to either range of motion or dexterity requirements. A novel robotic system is proposed to position a focused ultrasound transducer accurately above the head of a neonatal patient inside an MRI machine to deliver the therapy. Methods: A clinical Philips Sonalleve MRgFUS system was expanded to perform transcranial treatment. A five degree-of-freedom MR-conditional robot was designed and manufactured using MR compatible materials. The robot electronics and control were integrated into existing Philips electronics and software interfaces. The user commands the position of the robot with a graphical user interface, and is presented with real-time MR imaging of the patient throughout the surgery. The robot is validated through a series of experiments that characterize accuracy, signal-to-noise ratio degeneration of an MR image as a result of the robot, MR imaging artifacts generated by the robot, and the robot’s ability to operate in a representative surgical environment inside an MR machine. Results: Experimental results show the robot responds reliably within an MR environment, has achieved 0.59 ± 0.25 mm accuracy, does not produce severe MR-imaging artifacts, has a workspace providing sufficient coverage of a neonatal brain, and can manipulate a 5 kg payload. A full system demonstration shows these characteristics apply in an application environment. Conclusions: This paper presents a comprehensive look at the process of designing and validating a new robot from concept to implementation for use in an MR environment. An MR conditional robot has been designed and manufactured to design specifications. The system has demonstrated its feasibility as a platform for MRgFUS interventions for neonatal patients. The success of the system in experimental trials suggests that it is ready to be used for validation of the transcranial intervention in animal studies.

60 APPLIED LIFE SCIENCES↗

SU-F-J-41: Experimental Validation of a Cascaded Linear System Model for MVCBCT with a Multi-Layer EPID

Purpose: The purpose of this study was to validate the use of a cascaded linear system model for MV cone-beam CT (CBCT) using a multi-layer (MLI) electronic portal imaging device (EPID) and provide experimental insight into image formation. A validated 3D model provides insight into salient factors affecting reconstructed image quality, allowing potential for optimizing detector design for CBCT applications. Methods: A cascaded linear system model was developed to investigate the potential improvement in reconstructed image quality for MV CBCT using an MLI EPID. Inputs to the three-dimensional (3D) model include projection space MTF and NPS. Experimental validation was performed on a prototype MLI detector installed on the portal imaging arm of a Varian TrueBeam radiotherapy system. CBCT scans of up to 898 projections over 360 degrees were acquired at exposures of 16 and 64 MU. Image volumes were reconstructed using a Feldkamp-type (FDK) filtered backprojection (FBP) algorithm. Flat field images and scans of a Catphan model 604 phantom were acquired. The effect of 2×2 and 4×4 detector binning was also examined. Results: Using projection flat fields as an input, examination of the modeled and measured NPS in the axial plane exhibits good agreement. Binning projection images was shown to improve axial slice SDNR by a factor of approximately 1.4. This improvement is largely driven by a decrease in image noise of roughly 20%. However, this effect is accompanied by a subsequent loss in image resolution. Conclusion: The measured axial NPS shows good agreement with the theoretical calculation using a linear system model. Binning of projection images improves SNR of large objects on the Catphan phantom by decreasing noise. Specific imaging tasks will dictate the implementation image binning to two-dimensional projection images. The project was partially supported by a grant from Varian Medical Systems, Inc. and grant No. R01CA188446-01 from the National Cancer Institute.

60 APPLIED LIFE SCIENCES↗

SU-F-J-193: Efficient Dose Extinction Method for Water Equivalent Path Length (WEPL) of Real Tissue Samples for Validation of CT HU to Stopping Power Conversion

Purpose: For proton therapy, an accurate model of CT HU to relative stopping power (RSP) conversion is essential. In current practice, validation of these models relies solely on measurements of tissue substitutes with standard compositions. Validation based on real tissue samples would be much more direct and can address variations between patients. This study intends to develop an efficient and accurate system based on the concept of dose extinction to measure WEPL and retrieve RSP in biological tissue in large number of types. Methods: A broad AP proton beam delivering a spread out Bragg peak (SOBP) is used to irradiate the samples with a Matrixx detector positioned immediately below. A water tank was placed on top of the samples, with the water level controllable in sub-millimeter by a remotely controlled dosing pump. While gradually lowering the water level with beam on, the transmission dose was recorded at 1 frame/sec. The WEPL were determined as the difference between the known beam range of the delivered SOBP (80%) and the water level corresponding to 80% of measured dose profiles in time. A Gammex 467 phantom was used to test the system and various types of biological tissue was measured. Results: RSP for all Gammex inserts, expect the one made with lung-450 material (<2% error), were determined within ±0.5% error. Depends on the WEPL of investigated phantom, a measurement takes around 10 min, which can be accelerated by a faster pump. Conclusion: Based on the concept of dose extinction, a system was explored to measure WEPL efficiently and accurately for a large number of samples. This allows the validation of CT HU to stopping power conversions based on large number of samples and real tissues. It also allows the assessment of beam uncertainties due to variations over patients, which issue has never been sufficiently studied before.

60 APPLIED LIFE SCIENCES↗

SU-F-T-369: Validation of Monte-Carlo Beam Model for a Range of Small Fields in Heterogeneous Medium - A Measurement Based Study

Purpose: To validate the Monaco montecorlo beam model for a range of small field in the heterogeneous medium. Methods: A in-house phantom with three different medium of Foam, PMMA and derlin resembling the densities of lung, soft tissue, and bone was used for the study. The field sizes of 8, 16, 24, 32 and 48mm were studied for the validation of montecarlo algorithm using 0.01cc volume ionchamber and gafchromic films. The 6MV photon beam from Elekta Beam modulator was used with 100cm SAD setup. The outputs were measured at the depth of 5, 10 and 20mm in every second medium with 3cm buildup of first medium for the interface of lung-bone, lung-soft tissue, soft tissue-bone, bone-lung and soft tissue-lung. Similarly, the 2D dose analysis with gamma criteria of 2%2mm were done at the same depths using gafchromic film. For all the measurements 10.4×10.4cm were taken as reference to which the other field sizes were compared. Monaco TPSv.3.20 was used to calculate the dose distribution for all the simulated measurement setups. Results: The average maximum difference among the field sizes of 8, 16, 24, 32 and 48mm at the depth of 5mm in second medium with the interface of lung-bone, lung-soft tissue, soft tissue-bone, bone-lung and soft tissue-lung were observed as 1.29±0.14%, 0.49±0.16%, 0.87±0.23%, 0.92±0.11%, 1.01±0.19% respectively. The minimum and maximum variation of dose among different materials for the smallest field size of 8mm were observed as 0.23% and 1.67% respectively. The 2D analysis showed the average gamma passing of 98.9±0.5%. The calculated two-tailed P-value were showed insignificance with values of 0.562 and 0.452 for both ionchamber and film measurements. Conclusion: The accuracy of dose calculation for the small fields in Monaco Montecarlo TPS algorithm was validated in different inhomogeneous medium and found the results were well correlated with measurement data.

60 APPLIED LIFE SCIENCES↗

SU-F-T-431: Dosimetric Validation of Acuros XB Algorithm for Photon Dose Calculation in Water

Purpose: To validate the Acuros XB algorithm implemented in Eclipse Treatment planning system version 11 (Varian Medical System, Inc., Palo Alto, CA, USA) for photon dose calculation. Methods: Acuros XB is a Linear Boltzmann transport equation (LBTE) solver that solves LBTE equation explicitly and gives result equivalent to Monte Carlo. 6MV photon beam from Varian Clinac-iX (2300CD) was used for dosimetric validation of Acuros XB. Percentage depth dose (PDD) and profiles (at dmax, 5, 10, 20 and 30 cm) measurements were performed in water for field size ranging from 2×2,4×4, 6×6, 10×10, 20×20, 30×30 and 40×40 cm{sup 2}. Acuros XB results were compared against measurements and anisotropic analytical algorithm (AAA) algorithm. Results: Acuros XB result shows good agreement with measurements, and were comparable to AAA algorithm. Result for PDD and profiles shows less than one percent difference from measurements, and from calculated PDD and profiles by AAA algorithm for all field size. TPS calculated Gamma error histogram values, average gamma errors in PDD curves before dmax and after dmax were 0.28, 0.15 for Acuros XB and 0.24, 0.17 for AAA respectively, average gamma error in profile curves in central region, penumbra region and outside field region were 0.17, 0.21, 0.42 for Acuros XB and 0.10, 0.22, 0.35 for AAA respectively. Conclusion: The dosimetric validation of Acuros XB algorithms in water medium was satisfactory. Acuros XB algorithm has potential to perform photon dose calculation with high accuracy, which is more desirable for modern radiotherapy environment.

60 APPLIED LIFE SCIENCES↗

MO-B-BRB-02: 3D Dosimetry in the Clinic: IMRT Technique Validation in Sweden

Full three-dimensional (3D) dosimetry using volumetric chemical dosimeters probed by 3D imaging systems has long been a promising technique for the radiation therapy clinic, since it provides a unique methodology for dose measurements in the volume irradiated using complex conformal delivery techniques such as IMRT and VMAT. To date true 3D dosimetry is still not widely practiced in the community; it has been confined to centres of specialized expertise especially for quality assurance or commissioning roles where other dosimetry techniques are difficult to implement. The potential for improved clinical applicability has been advanced considerably in the last decade by the development of improved 3D dosimeters (e.g., radiochromic plastics, radiochromic gel dosimeters and normoxic polymer gel systems) and by improved readout protocols using optical computed tomography or magnetic resonance imaging. In this session, established users of some current 3D chemical dosimeters will briefly review the current status of 3D dosimetry, describe several dosimeters and their appropriate imaging for dose readout, present workflow procedures required for good dosimetry, and analyze some limitations for applications in select settings. We will review the application of 3D dosimetry to various clinical situations describing how 3D approaches can complement other dose delivery validation approaches already available in the clinic. The applications presented will be selected to inform attendees of the unique features provided by full 3D techniques. Learning Objectives: L. John Schreiner: Background and Motivation Understand recent developments enabling clinically practical 3D dosimetry, Appreciate 3D dosimetry workflow and dosimetry procedures, and Observe select examples from the clinic. Sofie Ceberg: Application to dynamic radiotherapy Observe full dosimetry under dynamic radiotherapy during respiratory motion, and Understand how the measurement of high resolution dose data in an irradiated volume can help understand interplay effects during TomoTherapy or VMAT. Titania Juang: Special techniques in the clinic and research Understand the potential for 3D dosimetry in validating dose accumulation in deformable systems, and Observe the benefits of high resolution measurements for precision therapy in SRS and in MicroSBRT for small animal irradiators Geoffrey S. Ibbott: 3D Dosimetry in end-to-end dosimetry QA Understand the potential for 3D dosimetry for end-to-end radiation therapy process validation in the in-house and external credentialing setting. Canadian Institutes of Health Research; L. Schreiner, Modus QA, London, ON, Canada; T. Juang, NIH R01CA100835.

60 APPLIED LIFE SCIENCES↗

TH-CD-202-06: A Method for Characterizing and Validating Dynamic Lung Density Change During Quiet Respiration

Purpose: To obtain a functional relationship that calibrates the lung tissue density change under free breathing conditions through correlating Jacobian values to the Hounsfield units. Methods: Free-breathing lung computed tomography images were acquired using a fast helical CT protocol, where 25 scans were acquired per patient. Using a state-of-the-art deformable registration algorithm, a set of the deformation vector fields (DVF) was generated to provide spatial mapping from the reference image geometry to the other free-breathing scans. These DVFs were used to generate Jacobian maps, which estimate voxelwise volume change. Subsequently, the set of 25 corresponding Jacobian and voxel intensity in Hounsfield units (HU) were collected and linear regression was performed based on the mass conservation relationship to correlate the volume change to density change. Based on the resulting fitting coefficients, the tissues were classified into parenchymal (Type I), vascular (Type II), and soft tissue (Type III) types. These coefficients modeled the voxelwise density variation during quiet breathing. The accuracy of the proposed method was assessed using mean absolute difference in HU between the CT scan intensities and the model predicted values. In addition, validation experiments employing a leave-five-out method were performed to evaluate the model accuracy. Results: The computed mean model errors were 23.30±9.54 HU, 29.31±10.67 HU, and 35.56±20.56 HU, respectively, for regions I, II, and III, respectively. The cross validation experiments averaged over 100 trials had mean errors of 30.02 ± 1.67 HU over the entire lung. These mean values were comparable with the estimated CT image background noise. Conclusion: The reported validation experiment statistics confirmed the lung density modeling during free breathing. The proposed technique was general and could be applied to a wide range of problem scenarios where accurate dynamic lung density information is needed. This work was supported in part by NIH R01 CA0096679.

60 APPLIED LIFE SCIENCES↗

Nuclear Energy Advanced Modeling and Simulation Waste Integrated Performance and Safety Codes (NEAMS Waste IPSC) verification and validation plan. version 1.

The objective of the U.S. Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation Waste Integrated Performance and Safety Codes (NEAMS Waste IPSC) is to provide an integrated suite of computational modeling and simulation (M&S) capabilities to quantitatively assess the long-term performance of waste forms in the engineered and geologic environments of a radioactive-waste storage facility or disposal repository. To meet this objective, NEAMS Waste IPSC M&S capabilities will be applied to challenging spatial domains, temporal domains, multiphysics couplings, and multiscale couplings. A strategic verification and validation (V&V) goal is to establish evidence-based metrics for the level of confidence in M&S codes and capabilities. Because it is economically impractical to apply the maximum V&V rigor to each and every M&S capability, M&S capabilities will be ranked for their impact on the performance assessments of various components of the repository systems. Those M&S capabilities with greater impact will require a greater level of confidence and a correspondingly greater investment in V&V. This report includes five major components: (1) a background summary of the NEAMS Waste IPSC to emphasize M&S challenges; (2) the conceptual foundation for verification, validation, and confidence assessment of NEAMS Waste IPSC M&S capabilities; (3) specifications for the planned verification, validation, and confidence-assessment practices; (4) specifications for the planned evidence information management system; and (5) a path forward for the incremental implementation of this V&V plan.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation of New Process Models for Large Injection-Molded Long-Fiber Thermoplastic Composite Structures

This report describes the work conducted under the CRADA Nr. PNNL/304 between Battelle PNNL and Autodesk whose objective is to validate the new process models developed under the previous CRADA for large injection-molded LFT composite structures. To this end, the ARD-RSC and fiber length attrition models implemented in the 2013 research version of Moldflow was used to simulate the injection molding of 600-mm x 600-mm x 3-mm plaques from 40% glass/polypropylene (Dow Chemical DLGF9411.00) and 40% glass/polyamide 6,6 (DuPont Zytel 75LG40HSL BK031) materials. The injection molding was performed by Injection Technologies, Inc. at Windsor, Ontario (under a subcontract by Oak Ridge National Laboratory, ORNL) using the mold offered by the Automotive Composite Consortium (ACC). Two fill speeds under the same back pressure were used to produce plaques under slow-fill and fast-fill conditions. Also, two gating options were used to achieve the following desired flow patterns: flows in edge-gated plaques and in center-gated plaques. After molding, ORNL performed measurements of fiber orientation and length distributions for process model validations. The structure of this report is as follows. After the Introduction (Section 1), Section 2 provides a summary of the ARD-RSC and fiber length attrition models. A summary of model implementations in the latest research version of Moldflow is given in Section 3. Section 4 provides the key processing conditions and parameters for molding of the ACC plaques. The validations of the ARD-RSC and fiber length attrition models are presented and discussed in Section 5. The conclusions will be drawn in Section 6.

36 MATERIALS SCIENCE↗

Validation and Calibration of Nuclear Thermal Hydraulics Multiscale Multiphysics Models - Subcooled Flow Boiling Study

In addition to validation data plan, development of advanced techniques for calibration and validation of complex multiscale, multiphysics nuclear reactor simulation codes are a main objective of the CASL VUQ plan. Advanced modeling of LWR systems normally involves a range of physico-chemical models describing multiple interacting phenomena, such as thermal hydraulics, reactor physics, coolant chemistry, etc., which occur over a wide range of spatial and temporal scales. To a large extent, the accuracy of (and uncertainty in) overall model predictions is determined by the correctness of various sub-models, which are not conservation-laws based, but empirically derived from measurement data. Such sub-models normally require extensive calibration before the models can be applied to analysis of real reactor problems. This work demonstrates a case study of calibration of a common model of subcooled flow boiling, which is an important multiscale, multiphysics phenomenon in LWR thermal hydraulics. The calibration process is based on a new strategy of model-data integration, in which, all sub-models are simultaneously analyzed and calibrated using multiple sets of data of different types. Specifically, both data on large-scale distributions of void fraction and fluid temperature and data on small-scale physics of wall evaporation were simultaneously used in this work’s calibration. In a departure from traditional (or common-sense) practice of tuning/calibrating complex models, a modern calibration technique based on statistical modeling and Bayesian inference was employed, which allowed simultaneous calibration of multiple sub-models (and related parameters) using different datasets. Quality of data (relevancy, scalability, and uncertainty) could be taken into consideration in the calibration process. This work presents a step forward in the development and realization of the “CIPS Validation Data Plan” at the Consortium for Advanced Simulation of LWRs to enable quantitative assessment of the CASL modeling of Crud-Induced Power Shift (CIPS) phenomenon, in particular, and the CASL advanced predictive capabilities, in general. This report is prepared for the Department of Energy’s Consortium for Advanced Simulation of LWRs program’s VUQ Focus Area.

97 MATHEMATICS AND COMPUTING↗

Validation of a Hot Water Distribution Model Using Laboratory and Field Data

Characterizing the performance of hot water distribution systems is a critical step in developing best practice guidelines for the design and installation of high performance hot water systems. Developing and validating simulation models is critical to this effort, as well as collecting accurate input data to drive the models. In this project, the Building America research team ARBI validated the newly developed TRNSYS Type 604 pipe model against both detailed laboratory and field distribution system performance data. Validation efforts indicate that the model performs very well in handling different pipe materials, insulation cases, and varying hot water load conditions. Limitations of the model include the complexity of setting up the input file and long simulation run times. This project also looked at recent field hot water studies to better understand use patterns and potential behavioral changes as homeowners convert from conventional storage water heaters to gas tankless units. The team concluded that the current Energy Factor test procedure overestimates typical use and underestimates the number of hot water draws, which has implications for both equipment and distribution system performance. Gas tankless water heaters were found to impact how people use hot water, but the data does not necessarily suggest an increase in usage. Further study in hot water usage and patterns is needed to better define these characteristics in different climates and home vintages.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Verification and Validation of Digitally Upgraded Control Rooms

As nuclear power plants undertake main control room modernization, a challenge is the lack of a clearly defined human factors process to follow. Verification and validation (V&V) as applied in the nuclear power community has tended to involve efforts such as integrated system validation, which comes at the tail end of the design stage. To fill in guidance gaps and create a step-by-step process for control room modernization, we have developed the Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE). This approach builds on best practices in the software industry, which prescribe an iterative user-centered approach featuring multiple cycles of design and evaluation. Nuclear regulatory guidance for control room design emphasizes summative evaluation—which occurs after the design is complete. In the GONUKE approach, evaluation is also performed at the formative stage of design—early in the design cycle using mockups and prototypes for evaluation. The evaluation may involve expert review (e.g., software heuristic evaluation at the formative stage and design verification against human factors standards like NUREG-0700 at the summative stage). The evaluation may also involve user testing (e.g., usability testing at the formative stage and integrated system validation at the summative stage). An additional, often overlooked component of evaluation is knowledge elicitation, which captures operator insights into the system. In this report we outline these evaluation types across design phases that support the overall modernization process. The objective is to provide industry-suitable guidance for steps to be taken in support of the design and evaluation of a new human-machine interface (HMI) in the control room. We suggest the value of early-stage V&V and highlight how this early-stage V&V can help improve the design process for control room modernization. We argue that there is a need to overcome two shortcomings of V&V in current practice—the propensity for late-stage V&V and the use of increasingly complex psychological assessment measures for V&V.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation of a FAST Model of the SWAY Prototype Floating Wind Turbine

As part of a collaboration of the National Renewable Energy Laboratory (NREL) and SWAY AS, NREL installed scientific wind, wave, and motion measurement equipment on the spar-type 1/6.5th-scale prototype SWAY floating offshore wind system. The equipment enhanced SWAY's data collection and allowed SWAY to verify the concept and NREL to validate a FAST model of the SWAY design in an open-water condition. Nanyang Technological University (NTU), in collaboration with NREL, assisted with the validation. This final report gives an overview of the SWAY prototype and NREL and NTU's efforts to validate a model of the system. The report provides a summary of the different software tools used in the study, the modeling strategies, and the development of a FAST model of the SWAY prototype wind turbine, including justification of the modeling assumptions. Because of uncertainty in system parameters and modeling assumptions due to the complexity of the design, several system properties were tuned to better represent the system and improve the accuracy of the simulations. Calibration was performed using data from a static equilibrium test and free-decay tests.

17 WIND ENERGY↗

Shift Verification and Validation

This documentation outlines the verification and validation of Shift for the Consortium for Advanced Simulation of Light Water Reactors (CASL). Five main types of problems were used for validation: small criticality benchmark problems; full-core reactor benchmarks for light water reactors; fixed-source coupled neutron-photon dosimetry benchmarks; depletion/burnup benchmarks; and full-core reactor performance benchmarks. We compared Shift results to measured data and other simulated Monte Carlo radiation transport code results, and found very good agreement in a variety of comparison measures. These include prediction of critical eigenvalue, radial and axial pin power distributions, rod worth, leakage spectra, and nuclide inventories over a burn cycle. Based on this validation of Shift, we are confident in Shift to provide reference results for CASL benchmarking.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation of Material Models For Automotive Carbon Fiber Composite Structures Via Physical And Crash Testing (VMM Composites Project)

As automotive fuel economy requirements increase, the push for reducing overall vehicle weight will likely include the consideration of materials that have not previously been part of mainstream vehicle design and manufacturing, including carbon fiber composites. Vehicle manufacturers currently rely on computer-aided engineering (CAE) methods as part of the design and development process, so going forward, the ability to accurately and predictably model carbon fiber composites will be necessary. If composites are to be used for structural components, this need applies to both, crash and quasi-static modeling. This final report covers the results of a five-year, $6.89M, 50% cost-shared research project between Department of Energy (DOE) and the US Advanced Materials Partnership (USAMP) under Cooperative Agreement DE-EE-0005661 known as “Validation of Material Models for Automotive Carbon Fiber Composite Structures Via Physical and Crash Testing (VMM).” The objective of the VMM Composites Project was to validate and assess the ability of physics-based material models to predict crash performance of automotive primary load-carrying carbon fiber composite structures. Simulation material models that were evaluated included micro-mechanics based meso-scale models developed by the University of Michigan (UM) and micro-plane models by Northwestern University (NWU) under previous collaborations with the DOE and Automotive Composites Consortium/USAMP, as well as five commercial crash codes: LS-DYNA, RADIOSS, VPS/PAM-CRASH, Abaqus, and GENOA-MCQ. CAE predictions obtained from seven organizations were compared with experimental results from quasi-static testing and dynamic crash testing of a thermoset carbon fiber composite front-bumper and crush-can (FBCC) system gathered under multiple loading conditions. This FBCC design was developed to demonstrate progressive crush, virtual simulation, tooling, fabrication, assembly, non-destructive evaluation and crash testing advances in order to assess the correlation of the predicted results to the physical tests. The FBCC was developed to meet a goal of 30-35% mass reduction while aiming for equivalent energy absorption as a steel component for which baseline experimental results were obtained from testing in the same crash modes. The project also evaluated crash performance of thermoplastic composite structures fabricated from commercial prepreg materials and low cost carbon fiber sourced from Oak Ridge National Laboratory. The VMM Project determined that no set of predictions from a CAE supplier were found to be universally accurate among all the six crash modes evaluated. In general, crash modes that were most dependent on the properties of the prepreg were more accurate than those that were dependent on the behavior of the joints. The project found that current CAE modeling methods or best practices for carbon fiber composites have not achieved standardization, and accuracy of CAE is highly reliant on the experience of its users. Coupon tests alone are not sufficient to develop an accurate material model, but it is necessary to bridge the gap between the coupon data and performance of the actual structure with a series of subcomponent level tests. Much of the unreliability of the predictions can be attributed to shortcomings in our ability to mathematically link the effects of manufacturing and material variability into the material models. This is a subject of ongoing research in the industry. The final report is organized by key technical tasks to describe how the validation project developed, modeled and compared crash data obtained on the composite FBCC to the multiple sets of CAE predictions. Highlights of the report include a discussion of the quantitative comparison between predictions and experimental data, as well as an in-depth discussion of remaining technological gaps that exist in the industry, which are intended to spur innovations and improvements in CAE technology.

36 MATERIALS SCIENCE↗

CASL Verification and Validation Plan

This report documents the Consortium for Advanced Simulation of LWRs (CASL) verification and validation plan. The document builds upon input from CASL subject matter experts, most notably the CASL Challenge Problem Product Integrators, CASL Focus Area leaders, and CASL code development and assessment teams. This document will be a living document that will track progress on CASL to do verification and validation for both the CASL codes (including MPACT, CTF, BISON, MAMBA) and for the CASL challenge problems (CIPS, PCI, DNB). The CASL codes and the CASL challenge problems are at differing levels of maturity with respect to validation and verification. The gap analysis will summarize additional work that needs to be done. Additional VVUQ work will be done as resources permit. This report is prepared for the Department of Energy’s (DOE’s) CASL program in support of milestone CASL.P13.02.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Experimental Validation of MCNP Models for PINS Shadow Shield Mockups

MCNP has been regarded as an indispensable tool in development of radiation detection systems, and it is cost effective, thanks to advances in computing power, to simulate various conceptual designs without even fabricating them. Development of various PINS systems have also benefited from MCNP modeling and simulation. MCNP models of PINS systems have been frequently used to understand detector responses and to fill the gap in experimental data. Recently, a backpack version PINS system was announced to be developed. When the neutron generator and the HPGe detector are built by external vendors, the shadow shield is the component to be designed to maximize the performance while meeting the sponsor’s requirements. In order to utilize MCNP modeling and simulation to find the best specification of the shadow shield, a campaign of PINS lab measurements with a few shadow shield mockups has been conducted to validate MCNP simulation results. This study is intended to validate MCNP simulations and models in preparation of another more extensive simulation study. Validation of neutron flux is also discussed later in this report even though neutron counts were not measured experimentally.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SAM Code Validation on Frictional Pressure Drop through Pebble Beds

The System Analysis Module (SAM) is currently under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for safety analyses of advanced non-light water reactors. This report presents a recent effort to validate the capability of SAM to predict the frictional pressure drop through pebble beds. Selected experimental data were used for code validation, including data from test facilities at Texas A&M University, Missouri University of Science and Technology, and North-West University of South Africa. SAM implements three empirical correlations to predict frictional pressure drop: the classical Ergun correlation; the KTA correlation, which is widely used in high-temperature gas-cooled reactor applications; and the Eisfeld and Schnitzlein correlation, which explicitly considers wall effect. Code validation was performed using all three correlations. For all selected experimental data, the KTA correlation shows the best performance and agrees very well with experimental measurement; the Eisfeld and Schnitzlein correlation, explicitly considering wall effects, shows acceptable accuracy, while there is no evidence that it is better than the KTA correlation; the Ergun correlation, however, over-predicts frictional pressure drop for most selected data points.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗