Maintaining Soundness in Hybrid Verification Approaches for Stateful Models: A Case Study.
Abstract Not Provided
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract Not Provided
Abstract not provided.
Abstract not provided.
The neutron transport code PROTEUS has been used to perform preliminary simulations of the Transient Reactor Test Facility (TREAT). TREAT is an experimental reactor designed for the testing of nuclear fuels and other materials under transient conditions. It operated from 1959 to 1994, when it was placed on non-operational standby. The restart of TREAT to support the U.S. Department of Energy’s resumption of transient testing is currently underway. Both single assembly and assembly-homogenized full core models have been evaluated. Simulations were performed using a historic set of WIMS-ANL-generated cross-sections as well as a new set of Serpent-generated cross-sections. To support this work, further analyses were also performed using additional codes in order to investigate particular aspects of TREAT modeling. DIF3D and the Monte-Carlo codes MCNP and Serpent were utilized in these studies. MCNP and Serpent were used to evaluate the effect of geometry homogenization on the simulation results and to support code-to-code comparisons. New meshes for the PROTEUS simulations were created using the CUBIT toolkit, with additional meshes generated via conversion of selected DIF3D models to support code-to-code verifications. All current analyses have focused on code-to-code verifications, with additional verification and validation studies planned. The analysis of TREAT with PROTEUS-SN is an ongoing project. This report documents the studies that have been performed thus far, and highlights key challenges to address in future work.
We describe a visualization-assisted process for the verification of cosmological simulation codes. The need for code verification stems from the requirement for very accurate predictions in order to interpret observational data confidently. We compare different simulation algorithms in order to reliably predict differences in simulation results and understand their dependence on input parameter settings. Our verification process consists of the integration of iterative hypothesis-verification with comparative, feature and quantitative visualization. We validate this process by verifying the time evolution results of three different cosmology simulation codes. The purpose of this verification is to study the accuracy of AMR methods versus other N-body simulation methods for cosmological simulations.
SCALE 6 includes several problem-independent multigroup (MG) libraries that were processed from the evaluated nuclear data file ENDF/B using a generic flux spectrum. The library data must be self-shielded and corrected for problem-specific spectral effects for use in MG neutron transport calculations. SCALE 6 computes problem-dependent MG cross sections through a combination of the conventional Bondarenko shielding-factor method and a deterministic continuous-energy (CE) calculation of the fine-structure spectra in the resolved resonance and thermal energy ranges. The CE calculation can be performed using an infinite medium approximation, a simplified two-region method for lattices, or a one-dimensional discrete ordinates transport calculation with pointwise (PW) cross-section data. This paper describes the SCALE-resonance self-shielding methodologies, including the deterministic calculation of the CE flux spectra using PW nuclear data and the method for using CE spectra to produce problem-specific MG cross sections for various configurations (including doubly heterogeneous lattices). It also presents results of verification and validation studies.
This paper presents the improvement of an automated-reasoning computer program for nuclear power plant diagnosis, namely PRODIAG. PRODIAG, first developed at the Argonne National Laboratory, uses confluence-based reasoning to perform fault diagnosis in engineering systems that can be described by the conservation laws for mass, energy, and momentum. Therefore, unlike other plant configuration-dependent rule-based diagnosis algorithms, the code is generally applicable to a wide variety of plant configurations by simply replacing the plant instrumentation diagram (PID) database. The need for improvement was raised when the original PRODIAG failed to provide the requisite degree of extensibility and maintainability for new applications. These shortcomings have been addressed through a new code architecture that uses an objected-oriented logic-programming language in place of the original Prolog language and uses an open-source automated reasoning engine in place of the original hardwired rule-evaluation sequence. This paper presents the architecture and implementation details of the code transition. Verification and validation studies were performed for the new PRODIAG, which involved re-running the distinct fault cases defined at the time the code was originally developed. (authors)
Purpose: Raven QA (JPLC, MD) is a unified and comprehensive quality assurance system for QA of TG-142, which use a phosphor screen, a mirror system and a camera. It is to test if this device can be used for IMRT QA dosimetry. Methods: A lung IMRT case is used deliver dose to Raven QA. Accuracy of dose distribution of 5cm slab phantom using Eclipse planning system (Varian) has been confirmed both from a Monte Carlo Simulation and from a MapCheck (SunNuclear) measurement. Geometric distortion and variation of spatial dose response are corrected after background subtraction. A pin-hole grid plate is designed and used to determine the light scatter in the Raven QA box and the spatial dose response. Optic scatter model was not applied in this preliminary study. Dose is normalized to the response of the 10×10 field and the TMR of 5cm depth was considered. Results: Time to setup the device for IMRT QA takes less than 5 minutes as other commercially available devices. It shows excellent dose linearity and dose rate independent, less than 1 %. Background signal, however, changes for different field sizes. It is believed to be due to inaccurate correction of optic scatter. Absolute gamma (5%, 5mm) passing rate was higher than 95%. Conclusion: This study proves that the Raven QA can be used for a patient specific IMRT verification. Part of this study is supported by the Maryland Industrial Partnership Grant.
Purpose: To assess the preliminary feasibility of automated treatment planning verification system in cervical cancer IMRT pre-treatment dose verification. Methods: The study selected randomly clinical IMRT treatment planning data for twenty patients with cervical cancer, all IMRT plans were divided into 7 fields to meet the dosimetric goals using a commercial treatment planning system(PianncleVersion 9.2and the EclipseVersion 13.5). The plans were exported to the Mobius 3D (M3D)server percentage differences of volume of a region of interest (ROI) and dose calculation of target region and organ at risk were evaluated, in order to validate the accuracy automated treatment planning verification system. Results: The difference of volume for Pinnacle to M3D was less than results for Eclipse to M3D in ROI, the biggest difference was 0.22± 0.69%, 3.5±1.89% for Pinnacle and Eclipse respectively. M3D showed slightly better agreement in dose of target and organ at risk compared with TPS. But after recalculating plans by M3D, dose difference for Pinnacle was less than Eclipse on average, results were within 3%. Conclusion: The method of utilizing the automated treatment planning system to validate the accuracy of plans is convenientbut the scope of differences still need more clinical patient cases to determine. At present, it should be used as a secondary check tool to improve safety in the clinical treatment planning.
Liquid scintillating phantoms have been proposed as a means to perform real-time 3D dosimetry for proton therapy treatment plan verification. We have studied what effect radiation damage to the scintillator will have upon this application. We have performed measurements of the degradation of the light yield and optical attenuation length of liquid scintillator and water-based liquid scintillator after irradiation by 201 MeV proton beams that deposited doses of approximately 52 Gy, 300 Gy, and 800 Gy in the scintillator. Liquid scintillator and water-based liquid scintillator (composed of 5% scintillating phase) exhibit light yield reductions of 1.74 ± 0.55 % and 1.31 ± 0.59 % after ≈ 800 Gy of proton dose, respectively. Some increased optical attenuation was observed in the irradiated samples, the measured reduction to the light yield is also due to damage to the scintillation light production. Based on our results and conservative estimates of the expected dose in a clinical context, a scintillating phantom used for proton therapy treatment plan verification would exhibit a systematic light yield reduction of approximately 0.1% after a year of operation.
This manuscript presents verification cases that are developed to study the electrothermal instability (ETI). Specific verification cases are included to ensure that the unit physics components necessary to model the ETI are accurate, providing a path for fluid-based codes to effectively simulate ETI in the linear and nonlinear growth regimes. Two software frameworks with different algorithmic approaches are compared for accuracy in their ability to simulate diffusion of a magnetic field, linear growth of the ETI, and a fully nonlinear ETI evolution. The nonlinear ETI simulations show early time agreement, with some differences emerging, as noted in the wavenumber spectrum, late into the nonlinear development of ETI. Here, a sensitivity study explores the role of equation-of-state (EOS), vacuum density, and vacuum resistivity. EOS and vacuum resistivity are found to be the most critical factors in the modeling of nonlinear ETI development.
The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.
The $k - ω$ Reynolds Averaged Navier Stokes (RANS) model is one of the industry standard approaches for modeling of turbulent flows. It performs better than the $k - ϵ$ model for low Reynolds number flows and is also more suitable for boundary layers with adverse pressure gradients. Major drawback of the model, however, is that the asymptotic value of $ω$ at the walls is singular, necessitating the use of a contrived “sufficiently” large value for $ω$ as the boundary condition for its transport equation. Here, this invariably leads to the solution being sensitive to near wall grid spacing. While an acceptable solution for low order (finite volume) methods, the excessive near wall gradients lead to persistent numerical stability issues in high order codes. To alleviate the problem, specifically in the context of the high order spectral element code Nek5000, a regularized $k - ω$ approach was formulated in our prior work (Tomboulides et al., 2018). The formulation, however, relies on the use of wall distance and its gradients for modeling the closure terms and can pose problems for simulations in complex geometries. This work presents a novel implementation of the $k - τ$ RANS model in Nek5000, where $τ = 1/ω$, eliminating the need for regularization, owing to the asymptotically bounded behavior of the source terms in the $τ$ transport equation, and also eliminating dependence on wall distance. Robustness and stability of the $k - τ$ model is ensured through implicit treatment of the source terms and their careful numerical implementation and demonstrated through several cases aimed at verification and validation. Studies include both canonical and engineering relevant problems, viz., turbulent channel flow, pipe flow, backward facing step, flow over NACA 0012 airfoil and flow in a T-junction. Results from the $k - τ$ model are shown to be consistent with regularized $k - ω$ model and also with the $k - ω$ SST model in OpenFOAM (for select studies). Comparison with experimental data is also shown, where available, to bolster validation efforts for the $k - τ$ model implementation through prediction of key turbulent quantities of interest.
This article examines the use of computational fluid dynamics (CFD) simulations to predict the response of a floating wind platform to irregular-wave excitation. This work was conducted as part of the Reproducible CFD Joint Industry Project for Floating Offshore Wind Applications and involved verification across several participants and modeling tools and validation against experiments. The authors pay special attention to the uncertainties in both CFD results and experimental measurements. In this work, we perform detailed comparisons of the incident waves and the motion of a moored structure. The nonlinear, low-frequency resonance motion is of particular interest because it potentially drives the mooring and tower-base loads. The verification and validation study is partially successful in that the CFD simulations capture the low-frequency slow-drift motion well but underpredict the low-frequency pitch resonance. This underprediction can be attributed in part to the CFD incident waves, which showed some discrepancies with the experimental waves, especially around extreme events. The effects of the wave discrepancies are also estimated and investigated using a mid-fidelity OpenFAST model. Overall, the present study increases our confidence in using CFD simulations to predict the global performance of offshore wind platforms in irregular waves and to produce data for the calibration of lower-fidelity models.
As the power grid continues to evolve with advanced wide-area monitoring, protection, and control (WAMPAC) algorithms, there is an increasing need for realistic testbed environments with industry-grade software and hardware-in-the-loop (HIL) to perform verification and validation studies. Such testbed environments serve as ideal platforms to perform WAMPAC prototyping, operator training, and also to study the impacts of different types of cyberattack scenarios on the operation of the grid. In this paper, we introduce PRIME (PNNL cybeR physIcal systeMs tEstbed): the testbed that integrates real-time transmission system simulator with commercial industry grade energy management system (EMS) software and remote hardware-in-the-loop (RHIL). PRIME is an end-to-end, modular testbed that allows high-fidelity RHIL experimentation of a power system. We present two detailed case studies (fault location and clearing in transmission system, and operator training) to showcase the capabilities of our PRIME testbed. Finally, we briefly discuss some of the potential limitations of our testbed in terms of scalability and flexibility to setup larger test systems and identify directions for future work to address those limitations.
The dynamics of energetic particle destabilized Alfve n frequency sweeping modes in tokamak reversed-shear safety factor discharges are modelled using a new Landau-closure model that includes coupling to geodesic acoustic wave dynamics and closure relations optimized for energetic particle Alfve n mode resonances. Profiles and equilibria are based upon reconstructions of a DIII-D discharge (#142111) in which a long sequence of frequency sweeping modes were observed. This model (TAEFL) has recently been included in a verification and validation study of n = 3 frequency sweeping modes for this case along with two gyrokinetic codes, GTC and GYRO. This paper provides a more detailed documentation of the equations and methods used in the TAEFL model and extends the earlier calculation to a range of toroidal mode numbers: n = 2 to 6. By considering a range of toroidal mode numbers and scanning over a range of safety factor profiles with varying qmin, both up-sweeping frequency (reversed-shear Alfve n eigenmode) and down-sweeping frequency (toriodal Alfve n eigenmode) modes are present in the results and show qualitative similarity with the frequency variations observed in the experimental spectrograms.
The effects of local inhomogeneities on low redshift H{sub 0} determinations are studied by estimating the redshift-distance relation of mock sources in N-body simulations. The results are compared to those obtained using the standard approach based on Hubble's law. The comparison shows a clear tendency for the standard approach to yield lower values of H{sub 0} than the approach based on the scheme using light rays. The difference is, however, small. More precisely, it is found that the overall effect of inhomogeneities on the determination of H{sub 0} is a small increase in the local estimates of about 0.3% compared to the results obtained with Hubble's law, when based on a typical distribution of supernovae in the redshift range 0.01 < z < 0.1. The overall conclusion of the study is a verification of the results that have earlier been obtained by using Hubble's law: the effects of inhomogeneities on local H{sub 0} estimates are not significant enough to make it plausible that differences in high- and low-redshift estimates of H{sub 0} are due to small inhomogeneities within the setting of standard cosmology.
Solar flares occur in complex sunspot groups, but it remains unclear how the probability of producing a flare of a given magnitude relates to the characteristics of the sunspot group. Here, we use Geostationary Operational Environmental Satellite X-ray flares and McIntosh group classifications from solar cycles 21 and 22 to calculate average flare rates for each McIntosh class and use these to determine Poisson probabilities for different flare magnitudes. Forecast verification measures are studied to find optimum thresholds to convert Poisson flare probabilities into yes/no predictions of cycle 23 flares. A case is presented to adopt the true skill statistic (TSS) as a standard for forecast comparison over the commonly used Heidke skill score (HSS). In predicting flares over 24 hr, the maximum values of TSS achieved are 0.44 (C-class), 0.53 (M-class), 0.74 (X-class), 0.54 ({>=}M1.0), and 0.46 ({>=}C1.0). The maximum values of HSS are 0.38 (C-class), 0.27 (M-class), 0.14 (X-class), 0.28 ({>=}M1.0), and 0.41 ({>=}C1.0). These show that Poisson probabilities perform comparably to some more complex prediction systems, but the overall inaccuracy highlights the problem with using average values to represent flaring rate distributions.