Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Validation of a novel robot-assisted 3DUS system for real-time planning and guidance of breast interstitial HDR brachytherapy

Purpose: In current clinical practice, there is no integrated 3D ultrasound (3DUS) guidance system clinically available for breast brachytherapy. In this study, the authors present a novel robot-assisted 3DUS system for real-time planning and guidance of breast interstitial high dose rate (HDR) brachytherapy treatment. Methods: For this work, a new computer controlled robotic 3DUS system was built to perform a hybrid motion scan, which is a combination of a 6 cm linear translation with a 30° rotation at both ends. The new 3DUS scanner was designed to fit on a modified Kuske assembly, keeping the current template grid configuration but modifying the frame to allow the mounting of the 3DUS system at several positions. A finer grid was also tested. A user interface was developed to perform image reconstruction, semiautomatic segmentation of the surgical bed as well as catheter reconstruction and tracking. A 3D string phantom was used to validate the geometric accuracy of the reconstruction. The volumetric accuracy of the system was validated with phantoms using magnetic resonance imaging (MRI) and computed tomography (CT) images. In order to accurately determine whether 3DUS can effectively replace CT for treatment planning, the authors have compared the 3DUS catheter reconstruction to the one obtained from CT images. In addition, in agarose-based phantoms, an end-to-end procedure was performed by executing six independent complete procedures with both 14 and 16 catheters, and for both standard and finer Kuske grids. Finally, in phantoms, five end-to-end procedures were performed with the final CT planning for the validation of 3DUS preplanning. Results: The 3DUS acquisition time is approximately 10 s. A paired Student t-test showed that there was no statistical significant difference between known and measured values of string separations in each direction. Both MRI and CT volume measurements were not statistically different from 3DUS volume (Student t-test: p > 0.05) and they were significantly correlated to 3DUS measurement (Pearson test: MRI p < 0.05 and CT p < 0.001). The mean angular separation distance between catheter trajectories segmented from 3DUS and CT images was 0.42° ± 0.24°, while the maximum and mean trajectory separations were 0.51 ± 0.19 and 0.37 ± 0.17 mm, respectively. Overall, the new finer grid has performed significantly better in terms of dosimetric indices. The planning target volume dosimetric indices were not found statistically different between 3DUS and CT planning (Student t-test, p > 0.05). Both the skin and the pectoral muscle dosimetric indices were within ABS guidelines. Conclusions: A novel robot-assisted 3DUS system was designed and validated. To their knowledge, this is the first system capable of performing real-time guidance and planning of breast multicatheter HDR brachytherapy treatments. Future investigation will test the feasibility of using the system in the clinic and for permanent breast brachytherapy.

60 APPLIED LIFE SCIENCES↗

Validating the simulation of large-scale parallel applications using statistical characteristics

Simulation is a widely adopted method to analyze and predict the performance of large-scale parallel applications. Validating the hardware model is highly important for complex simulations with a large number of parameters. Common practice involves calculating the percent error between the projected and the real execution time of a benchmark program. However, in a high-dimensional parameter space, this coarse-grained approach often suffers from parameter insensitivity, which may not be known a priori. Moreover, the traditional approach cannot be applied to the validation of software models, such as application skeletons used in online simulations. In this work, we present a methodology and a toolset for validating both hardware and software models by quantitatively comparing fine-grained statistical characteristics obtained from execution traces. Although statistical information has been used in tasks like performance optimization, this is the first attempt to apply it to simulation validation. Lastly, our experimental results show that the proposed evaluation approach offers significant improvement in fidelity when compared to evaluation using total execution time, and the proposed metrics serve as reliable criteria that progress toward automating the simulation tuning process.

97 MATHEMATICS AND COMPUTING↗

Development and validation of a next-generation sequencing-based multigene assay to predict the prognosis of estrogen receptor-positive, HER2-negative breast cancer

Purpose: Multigene assays provide useful prognostic information regarding hormone receptor (HR)-positive breast cancer. Next-generation sequencing (NGS)-based platforms have numerous advantages including reproducibility and adaptability in local laboratories. Here we aimed to develop and validate an NGS-based multigene assay to predict the distant recurrence risk. Experimental Design: In total, 179 genes including 30 reference genes highly correlated with the 21-gene recurrence score (RS) algorithm were selected from public databases. Targeted RNA-sequencing was performed using 250 and 93 archived breast cancer samples with a known RS in the training and verification sets, respectively, to develop the algorithm and NGS–Prognostic Score (NGS-PS). The assay was validated in 413 independent samples with long-term follow-up data on distant metastasis. Results: In the verification set, the NGS-PS and 21-gene RS displayed 91.4% concurrence (85/93 samples). In the validation cohort of 413 samples, area under the receiver operating characteristic curve plotted using NGS-PS values classified for distant recurrence was 0.76. The best NGS-PS cut-off value predicting distant metastasis was 20. Furthermore, 269 and 144 patients were classified as low- and high-risk patients in accordance with the cut-off. Five- and 10-year estimates of distant metastasis–free survival (DMFS) for low- versus high-risk groups were 97.0% versus 77.8% and 93.2% versus 64.4%, respectively. The age-related HR for distant recurrence without chemotherapy was 9.73 (95% CI, 3.59–26.40) and 3.19 (95% CI, 1.40–7.29) for patients aged ≤50 and >50 years, respectively. Conclusions: The newly developed and validated NGS-based multigene assay can predict the distant recurrence risk in ER-positive, HER2-negative breast cancer.

60 APPLIED LIFE SCIENCES↗

Criterion validity of wrist accelerometry for assessing energy intake via the intake-balance technique

Background: Intake-balance assessments measure energy intake (EI) by summing energy expenditure (EE) with concurrent change in energy storage (ΔES). Prior work has not examined the validity of such calculations when EE is estimated via open-source techniques for research-grade accelerometry devices. The purpose of this study was to test the criterion validity of accelerometry-based intake-balance methods for a wrist-worn ActiGraph device. Methods: Healthy adults (n = 24) completed two 14-day measurement periods while wearing an ActiGraph accelerometer on the non-dominant wrist. During each period, criterion values of EI were determined based on ΔES measured by dual X-ray absorptiometry and EE measured by doubly labeled water. A total of 11 prediction methods were tested, 8 derived from the accelerometer and 3 from non-accelerometry methods (e.g., diet recall; included for comparison). Group-level validity was assessed through mean bias, while individual-level validity was assessed through mean absolute error, mean absolute percentage error, and Bland–Altman analysis. Results: Mean bias for the three best accelerometry-based methods ranged from -167 to 124 kcal/day, versus -104 to 134 kcal/day for the non-accelerometry-based methods. The same three accelerometry-based methods had mean absolute error of 323–362 kcal/day and mean absolute percentage error of 18.1-19.3%, versus 353–464 kcal/day and 19.5-24.4% for the non-accelerometry-based methods. All 11 methods demonstrated systematic bias in the Bland–Altman analysis. Conclusions: Accelerometry-based intake-balance methods have promise for advancing EI assessment, but ongoing refinement is necessary. We provide an R package to facilitate implementation and refinement of accelerometry-based methods in future research (see paulhibbing.com/IntakeBalance).

60 APPLIED LIFE SCIENCES↗

Phenopacket-tools: Building and validating GA4GH Phenopackets

The Global Alliance for Genomics and Health (GA4GH) is a standards-setting organization that is developing a suite of coordinated standards for genomics. The GA4GH Phenopacket Schema is a standard for sharing disease and phenotype information that characterizes an individual person or biosample. The Phenopacket Schema is flexible and can represent clinical data for any kind of human disease including rare disease, complex disease, and cancer. It also allows consortia or databases to apply additional constraints to ensure uniform data collection for specific goals. We present phenopacket-tools, an open-source Java library and command-line application for construction, conversion, and validation of phenopackets. Phenopacket-tools simplifies construction of phenopackets by providing concise builders, programmatic shortcuts, and predefined building blocks (ontology classes) for concepts such as anatomical organs, age of onset, biospecimen type, and clinical modifiers. Phenopacket-tools can be used to validate the syntax and semantics of phenopackets as well as to assess adherence to additional user-defined requirements. The documentation includes examples showing how to use the Java library and the command-line tool to create and validate phenopackets. We demonstrate how to create, convert, and validate phenopackets using the library or the command-line application. Source code, API documentation, comprehensive user guide and a tutorial can be found at https://github.com/phenopackets/phenopacket-tools. The library can be installed from the public Maven Central artifact repository and the application is available as a standalone archive. The phenopacket-tools library helps developers implement and standardize the collection and exchange of phenotypic and other clinical data for use in phenotype-driven genomic diagnostics, translational research, and precision medicine applications.

59 BASIC BIOLOGICAL SCIENCES↗

SCEC/USGS Community Stress-Drop Validation Study: How Spectral Fitting Approaches Influence Measured Source Parameters

Spectral source parameters used to estimate an earthquake’s stress drop (⁠Δσ⁠) can vary significantly across measurement approaches. The Statewide California Earthquake Center/U.S. Geological Survey Community Stress‐Drop Validation Study was initiated to compare source parameter estimates, focusing initially on a dataset from the 2019 Ridgecrest earthquake sequence. As part of that validation effort, here we focus on one potential source of uncertainty: whether spectral fitting approaches alone, applied to a common set of spectra from the 2019 Ridgecrest sequence result in different source parameter estimates. By using a common set of benchmark spectra analyzed across a consistent frequency band of 1–40 Hz, we eliminate many sources of variability. A subgroup of validation study participants volunteered to estimate the low‐frequency displacement (⁠Ω 0 ⁠) and corner frequency (⁠ƒ c ⁠) by fitting a smooth function to benchmark displacement spectra. Participants used linear‐ or log‐sampled spectra, assumed a Brune or Boatwright spectral model, and applied different misfit criteria. We compare 17 approaches used to estimate ⁠Ω 0 ⁠, ƒ c ⁠, and Δσ for 54 earthquake spectra. Our results reveal that 35% of events have Δσ estimates within a factor of two, whereas others exhibit variations exceeding an order of magnitude. The variability in and can largely be attributed to whether a spectrum is consistent with the smooth function of an idealized simple crack model. The trade‐off between Ω 0 and ƒ c may be more pronounced when using linearly sampled spectra, as higher frequency spectral bumps control the fits. As expected, methods that assumed a Boatwright model tended to have lower Ω 0 and somewhat higher ƒ c compared to those assuming a Brune model, although resulting Δσ estimates are similar. Finally, when compared to the overall validation study results, the fitting approach alone may account for between 5% and 90% (25% on average) of the total variability in spectral Δσ⁠.

58 GEOSCIENCES↗

Use of an Accurate DNS Particulate Flow Method to Supply and Validate Boundary Conditions for the MFIX Code (Final Report)

The simulation of particulate flows for industrial applications often requires the use of two-fluid models, where the solid particles are considered as a separate continuous phase. One of the underlining uncertainties in the use of the two-fluid models in multiphase computations comes from the boundary condition of the solid phase. Typically, the gas or liquid fluid boundary condition at a solid wall is the so called no-slip condition, which has been widely accepted to be valid for single-phase fluid dynamics provided that the Knudsen number is low. However, the boundary condition for the solid phase is not well understood. The no-slip condition at a solid boundary is not a valid assumption for the solid phase. Instead, several researchers advocate a slip condition as a more appropriate boundary condition. However, the question on the selection of an exact slip length or a slip velocity coefficient is still unanswered. Experimental or numerical simulation data are needed in order to determinate the slip boundary condition that is applicable to a two-fluid model. The goal of this project is to improve the performance and accuracy of the boundary conditions used in two-fluid models such as the MFIX code, which is frequently used in multiphase flow simulations. The specific objectives of the project are to use first principles embedded in a validated Direct Numerical Simulation particulate flow numerical program, which uses the Immersed Boundary method (DNS-IB) and the Direct Forcing scheme in order to establish, modify and validate needed energy and momentum boundary conditions for the MFIX code. To achieve these objectives, we have developed a highly efficient DNS code and conducted numerical simulations to investigate the particle-wall and particle-particle interactions in particulate flows. Most of our research findings have been reported in major conferences and archived journals, which are listed in Section 7 of this report. In this report, we will present a brief description of these results.

42 ENGINEERING↗

An Initial Review of NE-KAMS Validation Data Quality Standards

To meet the increasingly high expectations of fidelity and predictive capability of physics and engineering simulation tools, more stringent validation testing of such tools is required. One ubiquitous impediment to more rigorous testing is the lack of sufficiently detailed information on physical experiments. When experiments are not well characterized, the experimental data do not sufficiently constrain the numerical model and validation studies are inconclusive. The NE-KAMS validation data standards and requirements provide a framework to identify the information about an experiment that a computationalist will need in order to perform a definitive validation of a model of interest. In this work, the first assessments using the NEKAMS standards and requirements are conducted. The objectives are to improve the standards and requirements and to identify the elements of an optimal assessment process.

97 MATHEMATICS AND COMPUTING↗

Verification and validation of the PLTEMP/ANL code for thermal hydraulic analysis of experimental and test reactors

The document compiles in a single volume several verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. Some works that are available in the open literature are simply referenced at the outset, and are not included in the document. PLTEMP has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given. Each chapter of the document deals with the verification or validation of a specific model. The model verification is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The model validation is done by comparing the code with experimental data or a more validated code like the RELAP5 code.

Kalimullah, M.↗

Integral and Separate Effects Tests for Thermal Hydraulics Code Validation for Liquid-Salt Cooled Nuclear Reactors

The objective of the 3-year project was to collect integral effects test (IET) data to validate the RELAP5-3D code and other thermal hydraulics codes for use in predicting the transient thermal hydraulics response of liquid salt cooled reactor systems, including integral transient response for forced and natural circulation operation. The reference system for the project is a modular, 900-MWth Pebble Bed Advanced High Temperature Reactor (PB-AHTR), a specific type of Fluoride salt-cooled High temperature Reactor (FHR). Two experimental facilities were developed for thermal-hydraulic integral effects tests (IETs) and separate effects tests (SETs). The facilities use simulant fluids for the liquid fluoride salts, with very little distortion to the heat transfer and fluid dynamics behavior. The CIET Test Bay facility was designed, built, and operated. IET data for steady state and transient natural circulation was collected. SET data for convective heat transfer in pebble beds and straight channel geometries was collected. The facility continues to be operational and will be used for future experiments, and for component development. The CIET 2 facility is larger in scope, and its construction and operation has a longer timeline than the duration of this grant. The design for the CIET 2 facility has drawn heavily on the experience and data collected on the CIET Test Bay, and it was completed in parallel with operation of the CIET Test Bay. CIET 2 will demonstrate start-up and shut-down transients and control logic, in addition to LOFC and LOHS transients, and buoyant shut down rod operation during transients. Design of the CIET 2 Facility is complete, and engineering drawings have been submitted to an external vendor for outsourced quality controlled construction. CIET 2 construction and operation continue under another NEUP grant. IET data from both CIET facilities is to be used for validation of system codes used for FHR modeling, such as RELAP5-3D. A set of numerical models were developed in parallel to the experimental work. RELAP5-3D models were developed for the salt-cooled PB-AHTR, and for the simulat fluid CIET natural circulation experimental loop. These models are to be validated by the data collected from CIET. COMSOL finite element models were used to predict the temperature and fluid flow distribution in the annular pebble bed core; they were instrumental for design of SETs, and they can be used for code-to-code comparisons with RELAP5-3D. A number of other small SETs, and numerical models were constructed, as needed, in support of this work. The experiments were designed, constructed and performed to meet CAES quality assurance requirements for test planning, implementation, and documentation; equipment calibration and documentation, procurement document control; training and personnel qualification; analysis/modeling software verification and validation; data acquisition/collection and analysis; and peer review.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Guide to Using the WIND Toolkit Validation Code

In response to the U.S. Department of Energy's goal of using 20% wind energy by 2030, the Wind Integration National Dataset (WIND) Toolkit was created to provide information on wind speed, wind direction, temperature, surface air pressure, and air density on more than 126,000 locations across the United States from 2007 to 2013. The numerical weather prediction model output, gridded at 2-km and at a 5-minute resolution, was further converted to detail the wind power production time series of existing and potential wind facility sites. For users of the dataset it is important that the information presented in the WIND Toolkit is accurate and that errors are known, as then corrective steps can be taken. Therefore, we provide validation code written in R that will be made public to provide users with tools to validate data of their own locations. Validation is based on statistical analyses of wind speed, using error metrics such as bias, root-mean-square error, centered root-mean-square error, mean absolute error, and percent error. Plots of diurnal cycles, annual cycles, wind roses, histograms of wind speed, and quantile-quantile plots are created to visualize how well observational data compares to model data. Ideally, validation will confirm beneficial locations to utilize wind energy and encourage regional wind integration studies using the WIND Toolkit.

17 WIND ENERGY↗

Development and Validation of a Polarimetric-MCScene 3D Atmospheric Radiation Model

Polarimetric measurements can substantially enhance the ability of both spectrally resolved and single band imagery to detect the proliferation of weapons of mass destruction, providing data for locating and identifying facilities, materials, and processes of undeclared and proliferant nuclear weapons programs worldwide. Unfortunately, models do not exist that efficiently and accurately predict spectral polarized signatures for the materials of interest embedded in complex 3D environments. Having such a model would enable one to test hypotheses and optimize both the enhancement of scene contrast and the signal processing for spectral signature extraction. The Phase I set the groundwork for development of fully validated polarimetric spectral signature and scene simulation models. This has been accomplished 1. by (a) identifying and downloading state-of-the-art surface and atmospheric polarimetric data sources, (b) implementing tools for generating custom polarimetric data, and (c) identifying and requesting US Government funded field measurement data for use in validation; 2. by formulating an approach for upgrading the radiometric spectral signature model MODTRAN to generate polarimetric intensities through (a) ingestion of the polarimetric data, (b) polarimetric vectorization of existing MODTRAN modules, and (c) integration of a newly developed algorithm for computing polarimetric multiple scattering contributions; 3. by generating an initial polarimetric model that demonstrates calculation of polarimetric solar and lunar single scatter intensities arising from the interaction of incoming irradiances with molecules and aerosols; 4. by developing a design and implementation plan to (a) automate polarimetric scene construction and (b) efficiently sample polarimetric scattering and reflection events, for use in a to be developed polarimetric version of the existing first-principles synthetic scene simulation model, MCScene; and 5. by planning a validation field measurement program in collaboration with the Remote Sensing and Exploitation group at Sandia National Laboratories (SNL) in which data from their ongoing polarimetric field and laboratory measurement program will be shared and, to the extent allowed, tailored for model validation in exchange for model predictions under conditions and for geometries outside of their measurement domain.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Large Eddy Simulation Modeling of Flashback and Flame Stabilization in Hydrogen-Rich Gas Turbines Using a Hierarchical Validation Approach

This project was a combined computational and experimental effort to improve predictive capability for boundary layer flashback of premixed swirl flames relevant to gas-turbine power plants operating with high-hydrogen-content fuels. During the course of this project, significant progress in modeling was made on four major fronts: 1) use of direct numerical simulation of turbulent flames to understand the coupling between the flame and the turbulent boundary layer; 2) improved modeling capability for flame propagation in stratified pre-mixtures; 3) improved portability of computer codes using the OpenFOAM platform to facilitate transfer to industry and other researchers; and 4) application of LES to flashback in swirl combustors, and a detailed assessment of its capabilities and limitations for predictive purposes. A major component of the project was an experimental program that focused on developing a rich experimental database of boundary layer flashback in swirl flames. Both methane and high-hydrogen fuels, including effects of elevated pressure (1 to 5 atm), were explored. For this project, a new model swirl combustor was developed. Kilohertz-rate stereoscopic PIV and chemiluminescence imaging were used to investigate the flame propagation dynamics. In addition to the planar measurements, a technique capable of detecting the instantaneous, time-resolved 3D flame front topography was developed and applied successfully to investigate the flow-flame interaction. The UT measurements and legacy data were used in a hierarchical validation approach where flows with increasingly complex physics were used for validation. First component models were validated with DNS and literature data in simplified configurations, and this was followed by validation with the UT 1-atm flashback cases, and then the UT high-pressure flashback cases. The new models and portable code represent a major improvement over what was available before this project was initiated.

42 ENGINEERING↗

Integral Reactor Containment Condensation Model and Experimental Validation

This NEUP funded project, NEUP 12-3630, is for experimental, numerical and analytical studies on high-pressure steam condensation phenomena in a steel containment vessel connected to a water cooling tank, carried out at Oregon State University (OrSU) and the University of Wisconsin at Madison (UW-Madison). In the three years of investigation duration, following the original proposal, the planned tasks have been completed: (1) Performed a scaling study for the full pressure test facility applicable to the reference design for the condensation heat transfer process during design basis accidents (DBAs), modified the existing test facility to route the steady-state secondary steam flow into the high pressure containment for controllable condensation tests, and extended the operations at negative gage pressure conditions (OrSU). (2) Conducted a series of DBA and quasi-steady experiments using the full pressure test facility to provide a reliable high pressure condensation database (OrSU). (3) Analyzed experimental data and evaluated condensation model for the experimental conditions, and predicted the prototypic containment performance under accidental conditions (UW-Madison). A film flow model was developed for the scaling analysis, and the results suggest that the 1/3 scaled test facility covers large portion of laminar film flow, leading to a lower average heat transfer coefficient comparing to the prototypic value. Although it is conservative in reactor safety analysis, the significant reduction of heat transfer coefficient (50%) could under estimate the prototypic condensation heat transfer rate, resulting in inaccurate prediction of the decay heat removal capability. Further investigation is thus needed to quantify the scaling distortion for safety analysis code validation. Experimental investigations were performed in the existing MASLWR test facility at OrST with minor modifications. A total of 13 containment condensation tests were conducted for pressure ranging from 4 to 21 bar with three different static inventories of non-condensable gas. Condensation and heat transfer rates were evaluated employing several methods, notably from measured temperature gradients in the HTP as well as measured condensate formation rates. A detailed mass and energy accounting was used to assess the various measurement methods and to support simplifying assumptions required for the analysis. Condensation heat fluxes and heat transfer coefficients are calculated and presented as a function of pressure to satisfy the objectives of this investigation. The major conclusions for those tests are summarized below: (1) In the steam blow-down tests, the initial condensation heat transfer process involves the heating-up of the containment heat transfer plate. An inverse heat conduction model was developed to capture the rapid transient transfer characteristics, and the analysis method is applicable to SMR safety analysis. (2) The average condensation heat transfer coefficients for different pressure conditions and non-condensable gas mass fractions were obtained from the integral test facility, through the measurements of the heat conduction rate across the containment heat transfer plate, and from the water condensation rates measurement based on the total energy balance equation. 15 (3) The test results using the measured HTP wall temperatures are considerably lower than popular condensation models would predict mainly due to the side wall conduction effects in the existing MASLWR integral test facility. The data revealed the detailed heat transfer characteristics of the model containment, important to the SMR safety analysis and the validation of associated evaluation model. However this approach, unlike separate effect tests, cannot isolate the condensation heat transfer coefficient over the containment wall, and therefore is not suitable for the assessment of the condensation heat transfer coefficient against system pressure and noncondensable gas mass fraction. (4) The average condensation heat transfer coefficients measured from the water condensation rates through energy balance analysis are appropriate, however, with considerable uncertainties due to the heat loss and temperature distribution on the containment wall. With the consideration of the side wall conduction effects, the results indicate that the measured heat transfer coefficients in the tests is about 20% lower than the prediction of Dehbi’s correlation, mainly due to the side wall conduction effects. The investigation also indicates an increase in the condensation heat transfer coefficient at high containment pressure conditions, but the uncertainties invoked with this method appear to be substantial. (5) Non-condensable gas in the tests has little effects on the condensation heat transfer at high elevation measurement ports. It does affect the bottom measurements near the water level position. The results suggest that the heavier non-condensable gas is accumulated in the lower portion of the containment due to stratification in the narrow containment space. The overall effects of the non-condensable gas on the heat transfer process should thus be negligible for tall containments of narrow condensation spaces in most SMR designs. Therefore, the previous correlations with noncondensable gas effects are not appropriate to those small SMR containments due to the very poor mixing of steam and non-condensable gas. The MELCOR simulation results agree with the experimental data reasonably well. However, it is observed that the MELCOR overpredicts the heat flux for all analyzed tests. The MELCOR predicts that the heat fluxes for CCT’s approximately range from 30 to 45 kW/m2 whereas the experimental data (averaged) ranges from about 25 to 40 kW/m2. This may be due to the limited availability of liquid film models included in MELCOR. Also, it is believed that due to complex test geometry, measured temperature gradients across the heat transfer plate may have been underestimated and thus the heat flux had been underestimated. The MELCOR model predicts a film thickness on the order of 100 microns, which agrees very well with film flow model developed in this study for scaling analysis. However, the expected differences in film thicknesses for near vacuum and near atmospheric test conditions are not significant. Further study on the behavior of condensate film is expected to refine the simulation results. Possible refinements include but are not limited to, the followings: CFD simulation focusing on the liquid film behavior and benchmarking with experimental analyses for simpler geometries. 16 1 INTRODUCTION This NEUP funded project, NEUP 12-3630, is for experimental, numerical and analytical studies on high-pressure steam condensation phenomena in a steel containment vessel connected to a water cooling tank, carried out at Oregon State University (OrSU) and the University of Wisconsin at Madison (UW-Madison). The experimental results are employed to validate the containment condensation model in reactor containment system safety analysis code for integral SMRs. Such a containment condensation model is important to demonstrate the adequate cooling. In the three years of investigation, following the original proposal, the following planned tasks have been completed: (1) Performed a scaling study for the full pressure test facility applicable to the reference design for the condensation heat transfer process during design basis accidents (DBAs), modified the existing test facility to route the steady-state secondary steam flow into the high pressure containment for controllable condensation tests, and extended the operations at negative gage pressure conditions (OrSU). (2) Conducted a series of DBA and quasi-steady experiments using the full pressure test facility to provide a reliable high pressure condensation database (OrSU). (3) Analyzed experimental data and evaluated condensation model for the experimental conditions, and predicted the prototypic containment performance under accidental conditions (UW-Madison). The results are applicable to integral Small Modular Reactor (SMR) designs, including NuScale, mPower, Westinghouse SMR, Holtec-160 and other integral reactors with small containments of relatively high pressures under accidental conditions. Testing has been conducted at the OrSU laboratory in the existing MASLWR (Multi-Application Small Light Water Reactor) integral test facility sponsored by the US Department of Energy. Its highpressure stainless steel containment model (~2 MPa) is scaled to the NuScale SMR currently under development at NuScale Power, Inc.. Minor modifications to the model containment have been made to control the non-condensable gas fraction and to utilize the secondary loop stable steam flow for condensation testing. UW-Madison has developed a containment condensation model, which leveraged previous validated containment heat transfer work carried out at UW-Madison, and extended the range of applicability of the model to integral SMR designs that utilize containment vessels of high heat transfer efficiencies. In this final report, the research background and literature survey are presented in Chapter 2 and 3, respectively. The test facility description and modifications are summarized in Chapter 4, and the scaling analysis is introduced in Chapter 5. The tests description, procedures, and data analysis are presented in Chapter 6, while the numerical modeling is presented in Chapter 7, followed by a conclusion section in Chapter 8.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Systematic Method for Verification and Validation of Gyrokinetic Microstability Codes

My original proposal for the period Feb. 15, 2014 through Feb. 14, 2017 called for an integrated validation and verification effort carried out by myself with collaborators. The validation component would require experimental profile and power-balance analysis. In addition, it would require running the gyrokinetic codes varying the input profiles within experimental uncertainties to seek agreement with experiment before discounting a code as invalidated. Therefore, validation would require a major increase of effort over my previous grant periods which covered only code verification (code benchmarking). Consequently, I had requested full-time funding. Instead, I am being funded at somewhat less than half time (5 calendar months per year). As a consequence, I decided to forego the validation component and to only continue the verification efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Hyundai FCEV Testing, Data Collection and Validation Fleet

This report summarizes the work conducted under Award Number DE-EE0005970 by Hyundai America Technical Center, Inc. (HATCI) to demonstrate and validate Hyundai Tucson Fuel Cell Electric Vehicles (FCEV) reliability in real world applications. HATCI operated 10 light-duty FCEVs throughout various geographical regions in United States to collect and submit vehicle performance durability data over 5 years. HATCI introduced FCEVs in two phases. First phase deployed 5 vehicles in Southern California to study customer real world usage and prove its reliability under commute and fleet driving pattern from 2013 to 2015. As the hydrogen station infrastructure expanded its network, second phase deployed and operated 5 additional vehicles under various climate zones (hot, cold, high altitude) and validated fuel cell performance from 2016 to 2017. California Air Resources Board (Sacramento, CA), California Fuel Cell Partnership, US Department of Energy (Washington DC), Hyundai Motor America, HATCI (Ann Arbor, Michigan), National Renewable Energy Laboratory (Golden, CO), and South Coast Air Quality Management District were the fleet operators. Four different stack degradation mechanism issues were addressed through validation project: fuel cell stack dry-out, flooding, cathode oxidation, and platinum dissolution. By developing counter-measures to each fuel cell stack degradation mechanism through performance validation fleet, Hyundai was able to successfully develop the next generation fuel cell vehicle NEXO, with longest range, large cost reduction, and best fuel cell powertrain warranty in its class (100,000 miles, 10 years warranty).

08 HYDROGEN↗

WEC-SIM Validation Testing Plan FY14 Q4.

The WEC-Sim project is currently on track, having met both the SNL and NREL FY14 Milestones, as shown in Table 1 and Table 2. This is also reflected in the Gantt chart uploaded to the WEC-Sim SharePoint site in the FY14 Q4 Deliverables folder. The work completed in FY14 includes code verification through code-to-code comparison (FY14 Q1 and Q2), preliminary code validation through comparison to experimental data (FY14 Q2 and Q3), presentation and publication of the WEC-Sim project at OMAE 2014 [1], [2], [3] and GMREC/METS 2014 [4] (FY14 Q3), WEC-Sim code development and public open-source release (FY14 Q3), and development of a preliminary WEC-Sim validation test plan (FY14 Q4). This report presents the preliminary Validation Testing Plan developed in FY14 Q4. The validation test effort started in FY14 Q4 and will go on through FY15. Thus far the team has developed a device selection method, selected a device, and placed a contract with the testing facility, established several collaborations including industry contacts, and have working ideas on the testing details such as scaling, device design, and test conditions.

47 OTHER INSTRUMENTATION↗

Excluding Benchmark Statistical Outliers in Nuclear Criticality Safety Validation: A Comparison Study of Upper Subcritical Limits for Plutonium Systems using Whisper-1.1

Neutron transport methods used to establish subcriticality require validation by comparison to critical experiments considered to be benchmarks. Whisper is a sensitivity/uncertainty analysis tool developed to assist with the task of validation in nuclear criticality safety. Details on the Whisper methodology can be found in References 1-3 on the MCNP® reference collection website at https://mcnp.lanl.gov. During the process of validation there can be cases where a benchmark experiment may be found to be a statistical outlier, in which the calculated k-effective value and the experiment k-effective value differ by an amount atypical for similar experiments. A methodology optionally employed by Whisper is the exclusion of statistical outliers based upon the iterative diagonal chi-squared statistical rejection technique. Alternatively, there is an option to include all benchmarks in the Whisper library collection, even those benchmarks found to be statistical outliers, when computing the bias, bias uncertainty and margin of subcriticality (MOS) leading to establishment of the baseline upper subcritical limit (USL). A comparison study has been done to compute USLs with and without statistical outliers in the Whisper benchmark collection to determine what effect rejection of statistical outliers has on the recommended USL. The results show little overall difference in the recommended baseline USLs developed by Whisper when excluding statistical outliers. Additionally, there does not appear to be a clear trend in predicting whether the baseline USL will be higher or lower when rejecting statistical outliers from the benchmark critical experiment collection used for validation.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗