SEARCH · Search NASA
Results for “Benchmark testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The Phenix ultimate natural convection test
The French sodium cooled fast reactor Phenix was shut down in 2009 after 35 years of operation. Before decommissioning, a final set of tests were performed by the CEA during 9 months. Several topics were involved such as thermal hydraulics, core physics and fuel behaviour. Among these ultimate experiments, two thermal hydraulic tests were performed: an asymmetrical test consisting in a trip of one secondary pump and a natural convection test in the primary circuit. Recognizing the unique opportunity offered by these Phenix ultimate tests, IAEA decided in 2007 to launch a Coordinated Research Project (CRP) devoted to benchmarking analyses with system codes on the Phenix natural convection test. One objective of the natural convection test in Phenix reactor is the assessment of the CATHARE system code for safety studies on future and advanced sodium cooled fast reactors. The aim of this paper is to describe this test, which was performed on June 22-23, 2009, and the associated benchmark specifications for the CRP work. The paper reminds briefly the Phenix reactor with the main physical parameters and the instrumentation used during the natural convection test. After that, the test scenario is described: - initial state at a power of 120 MWth, - test beginning resulting from a manual dry out of the two steam generators, - manual scram, - manual trip on the three primary pumps without back-up by pony motors, - setting and development of natural convection in the primary circuit, in a first phase without significant heat sink in the secondary circuits and in a second phase with significant heat sink in the secondary circuits, by opening the casing of steam generators to create an efficient heat sink, by air natural circulation in the steam generators casing. The benchmark case ends after this second phase, which corresponds to the experimental test duration of nearly 7 hours. The paper presents also the benchmark specifications data supplied by the CEA to all participants of this CRP in order to perform calculations (core, primary circuit, primary pumps, IHX, shutdown system, operating parameters, test scenario and real test conditions). Finally, main test results and analyses are presented including the evolution of the core and of the heat exchangers inlet and outlet temperatures, and some local temperature measurements. The natural convection has been easily set up in the pool type reactor Phenix with different boundary conditions at the secondary side, with or without heat sink. The data obtained during this unique test represent some very useful and precious results for the development of SFR in a wide range of thematic such as numerical methods dedicated to thermal-hydraulics safety analyses (system codes, CFD codes and coupling system and CFD codes) and instrumentation. (authors)
Final Design for Thermal/Epithermal eXperiments (TEX) with Lithium Absorbers to Provide Validation Benchmarks for Y-12 Electrorefining Facility (IER 575, CED-2 Report)
One of the main goals of the Thermal/Epithermal eXperiments (TEX) project is to use existing Nuclear Criticality Safety Program (NCSP) assets to create critical experiment plutonium and uranium test beds for materials important to criticality safety that have insufficient benchmark evaluations. The plutonium test bed experiments were completed in 2018 and are published in the 2020 edition of the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The uranium test bed assemblies were completed in 2023 and accepted in the 2024 edition of the ICSBEP Handbook.
Linear source method of characteristics in HELIOS2
The Studsvik Scandpower code HELIOS2 is a fast lattice transport code that has gained wide use for reactor fuel cycle analysis in commercial, regulatory, and research environments. It contains two transport solvers - Collision Probabilities (CP) and Method of Characteristics (MoC) - with a general geometry ability and generalized depletion for a variety of fuel types, experimental facilities, and isotope production applications. The HELIOS2 lattice code has been extended with the development of a linear source MoC option. The linear source equations are derived within the scope of the HELIOS2 general geometry and non-cyclic ray tracing. The implementation was tested for fine and coarse spatial mesh models of the 2D C5G7 MOX computational benchmark, which provides a pure and extreme test of a transport solver. The linear source yields at least comparable accuracy with reduced computational resource requirements relative to the flat-source approximation.
MODELING AND SIMULATION OF SOLID FLUIDIZATION IN A RESIN COLUMN
The objective of the present work is to model the resin particles within the column during fluidization and sedimentation processes using computation fluid dynamics (CFD) approach. The calculated results will help interpret experimental results, and they will assist in providing guidance on specific details of testing design and establishing a basic understanding of particle’s hydraulic characteristics within the column. The model is benchmarked against the literature data and the test data (2003) conducted at Savannah River Site (SRS). The paper presents the benchmarking results and the modeling predictions of the SRS resin column using the improved literature correlations applicable for liquid-solid granular flow.
The HTR-Proteus Benchmark: Analysis and Use as a Verification and Validation Case
This presentation outlines the evaluation and application of the HTR-Proteus benchmark as a verification and validation (V&V) case for advanced reactor modeling tools. The work supports the U.S. Department of Energy’s HALEU Availability Program (HAP) and the joint DOE/NRC DNCSH project, which aims to reduce criticality safety uncertainties in commercial-scale HALEU fuel cycle and transportation systems. The HTR-Proteus experiments, conducted at the Paul Scherrer Institute, provide high-fidelity data for TRISO-fueled, graphite-moderated pebble bed reactors with high neutron leakage—conditions relevant to HALEU transport scenarios. This study focuses on Cores 4.2 and 4.3 of the HTR-Proteus benchmark, analyzing key sources of uncertainty including pebble packing, TRISO particle positioning, and core height. Using Project Chrono for realistic pebble geometries and Serpent, SHIFT, and MCNP for neutronics simulations, the study quantifies the impact of these uncertainties on the effective multiplication factor (keff). Results show that a sample size of 110 pebble configurations is sufficient to converge keff, with ±30 pcm uncertainty due to packing randomness. TRISO positioning and core height variations also significantly influence keff, highlighting the importance of detailed modeling in V&V efforts. The benchmark serves as a valuable test case for validating the Griffin reactor physics code and improving confidence in HALEU system simulations.
Convergent Concordant Mode Approach for Molecular Vibrations: CMA-2
The concordant mode approach (CMA) is a promising new scheme for dramatically increasing the system size and level of theory achievable in quantum chemical computations of molecular vibrational frequencies. Here, we achieve advances in the CMA hierarchy by computations targeting CCSD(T)/cc-pVTZ (coupled cluster singles and doubles with perturbative triples using a correlation-consistent polarized-valence triple-ζ basis set) benchmarks within the G2 molecular test set, executing a statistical analysis for 1501 frequencies from 111 compounds and then separately solving the refractory case of pyridine. First, MP2/cc-pVTZ (second-order Møller–Plesset perturbation theory with the same basis set) proves to be an excellent and preferred choice for generating the underlying (Level B) normal modes of the CMA scheme. Utilizing this Level B within the CMA-0A method reproduces the 1501 benchmark frequencies with a mean absolute error (MAE) of only 0.11 cm –1 and an attendant standard deviation of 0.49 cm –1 . Second, a convergent CMA-2 method is constituted that allows efficient computation of higher level (Level A) frequencies to any reasonable accuracy threshold by using only Hartree–Fock (HF) and MP2 or density functional theory (DFT) data to generate ξ parameters, which select the sparse off-diagonal force field elements for explicit evaluation at Level A. When Level B = MP2/cc-pVTZ, a cutoff of ξ = 0.02 provides an average maximum absolute error per molecule of only 0.17 cm –1 by incurring merely a 33% increase in average cost over CMA-0A. This CMA-2 method also eradicates the 4 problematic CMA-0A outliers of pyridine with even less effort (ξ = 0.04, 22% increase). Finally, the newly developed CMA procedures are shown to be highly successful when applied to 1-(1H-pyrrol-3-yl)ethanol, a new test molecule with diverse types of vibration.
Comment on: “Solving many-body Schrödinger equations with kinetic energy partition method”, Ann. Phys. 388 (2018) 54–68 by Y-H. Chen and S.D. Chao
We discuss a recent test of the performance of the kinetic energy partition method (KEP) through its application to two separable quantum-mechanical models. We argue that one of the benchmark models is exceedingly simple for testing any realistic approximate method and that almost any reasonable approach yields better results. In the second example our exact benchmark eigenvalues disagree considerably with those chosen by the authors for comparison, which casts doubts on the accuracy of their KEP approach.
Implementation, capabilities, and benchmarking of Shift, a massively parallel Monte Carlo radiation transport code
This paper discusses the implementation, capabilities, and validation of Shift, a massively parallel Monte Carlo radiation transport package developed and maintained at Oak Ridge National Laboratory. It has been developed to scale well from laptop to small computing clusters to advanced supercomputers. Special features of Shift include hybrid capabilities for variance reduction such as CADIS and FW-CADIS, and advanced parallel decomposition and tally methods optimized for scalability on supercomputing architectures. Shift has been validated and verified against various reactor physics benchmarks and compares well to other state-of-the-art Monte Carlo radiation transport codes such as MCNP5, CE KENO-VI, and OpenMC. Some specific benchmarks used for verification and validation include the CASL VERA criticality test suite and several Westinghouse AP1000 ® problems. These benchmark and scaling studies show promising results.
THE TRENDS HIGH-CONTRAST IMAGING SURVEY. I. THREE BENCHMARK M DWARFS ORBITING SOLAR-TYPE STARS
We present initial results from a new high-contrast imaging program dedicated to stars that exhibit long-term Doppler radial velocity accelerations (or ''trends''). The goal of the TRENDS (TaRgetting bENchmark-objects with Doppler Spectroscopy) imaging survey is to directly detect and study the companions responsible for accelerating their host star. In this first paper of the series, we report the discovery of low-mass stellar companions orbiting HD 53665, HD 68017, and HD 71881 using NIRC2 adaptive optics (AO) observations at Keck. Follow-up imaging demonstrates association through common proper motion. These comoving companions have red colors with estimated spectral types of K7-M0, M5, and M3-M4, respectively. We determine a firm lower limit to their mass from Doppler and astrometric measurements. In the near future, it will be possible to construct three-dimensional orbits and calculate the dynamical mass of HD 68017 B and possibly HD 71881 B. We already detect astrometric orbital motion of HD 68017 B, which has a projected separation of 13.0 AU. Each companion is amenable to AO-assisted direct spectroscopy. Further, each companion orbits a solar-type star, making it possible to infer metallicity and age from the primary. Such benchmark objects are essential for testing theoretical models of cool dwarf atmospheres.
RELAP5-3D validation studies based on the High Temperature Test facility
In the spring and summer of 2019, experiments were conducted at the High Temperature Test Facility (HTTF) that form the basis of an upcoming high-temperature gas-cooled reactor (HTGR) thermal hydraulics (T/H) benchmark. HTTF is an integral effects test facility for HTGR T/H modeling validation. This paper presents RELAP5-3D models of two of those experiments: PG-27, a pressurized conduction cooldown (PCC); and PG-29, a depressurized conduction cooldown (DCC). These models used the RELAP5-3D model of HTTF originally developed by Paul Bayless as a starting point. The sensitivity analysis and uncertainty quantification code, RAVEN was used to perform calibration studies for the steady-state portion of PG-27. Here we developed four PG-27 calibrations based on steady-state conditions. These calibrations all used an effective thermal conductivity equal to 36 % of the measured thermal conductivity, but they differed with respect to the frictional pressure drops and radial conduction models. These models all captured the trends in steady-state temperature distributions and transient temperature behavior well. All four calibrations show room for improvement in predicting the transient temperature rise. The smallest error in temperature rise during the transient was a 21 % underprediction, and the largest was a 48 % underprediction. The errors in transient temperature rise are largely a result of a mismatch in power density between the RELAP5-3D model and the experiment due to the location of active heater rods along the boundary between heat structures in the model. The best of these calibrations was applied to PG-29 to model the DCC. Once again, temperatures during the transient were underpredicted but trends in temperature were captured. The RELAP5-3D model captured trends in the data but could not reproduce measured temperatures exactly. This result is not attributed to deficiencies in the experimental data or to RELAP5–3D itself. Rather, this result likely arises due to the some of the assumptions and decisions made when the RELAP5-3D model was first developed, prior to the execution of HTTF experiments. An agreement in prediction of temperature trends but challenges reproducing HTTF temperatures within measurement uncertainty is consistent with previous analyses of HTTF in the literature. Future RELAP5-3D validation activities centered around HTTF may be able to provide greater insight into the code’s capabilities for HTGR modeling with a more finely nodalized model.
Implementation of CMFD Acceleration Scheme in PROTEUS-MOC
The PROTEUS-MOC code is a three-dimensional (3D) transport code, which is being developed at Argonne National Laboratory under the DOE-NE's Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. It provides a fully consistent 3D discretization of the transport equation by combining the two-dimensional (2D) method of characteristics (MOC) for the planar direction with the discontinuous Galerkin method for the treatment of the axial variable. PROTEUS-MOC uses the unstructured finite element method (FEM) and thus allows the explicit representation of any extruded geometries. It also has a capability of massively parallel computation in energy group, angle, plane, and space using a top-level GMRES linear algebra solver. For parallel computation in space, it uses an unstructured domain decomposition by adapting METIS. The computational burden for direct heterogeneous core calculations based on unstructured geometries is excessive for practical reactor problems, and hence it is essential to implement an efficient acceleration scheme in PROTEUS-MOC. Recently, the coarse mesh finite difference (CMFD) method, which was originally applied to the nodal diffusion methods, has been successfully applied to the MOC transport solvers, resulting in a remarkable reduction in the number of fission source iterations. In addition, a modified CMFD method has been developed to overcome the limitation of the conventional CMFD that is applicable only to neutronics solvers with a conservative discretization. This CMFD method was derived to be consistent with the FEM, which is based on a nonconservative discretization. In this method, the neutron balance in each coarse mesh is enforced by introducing a pseudo absorption cross section (PAXS), and the well-established alternating solution process of CMFD and transport calculations is employed to accelerate source convergence. This modified CMFD acceleration scheme was adopted in PROTEUS-MOC to accelerate the fission source iteration. Pin-cell and assembly based CMFD schemes have been implemented by defining individual pin cells or assemblies as a coarse mesh. For this, an algorithm to map the finite elements to coarse meshes was developed, and the routines were developed to determine the coupling coefficients and PAXS of the CMFD equations from the transport solution. Preliminary performance tests were carried out using the C5G7 benchmark problem. This paper presents the main features of this CMFD acceleration scheme and the preliminary test results.
ORNL Neutron Cross Section Measurements of 90 Zr
Nuclear criticality modeling and simulations rely on the quality of the existing evaluated nuclear data libraries such as Evaluated Nuclear Data File (ENDF)/B, the Joint Evaluated Fission and Fusion (JEFF) nuclear data library, or the Japanese Evaluated Nuclear Data Library (JENDL). In some cases, the cross-section evaluations of those libraries were found to be deficient in describing criticality benchmarks accurately. More than two decades ago, the US Nuclear Criticality Safety Program (NCSP) established a Nuclear Data (ND) task which encompassed experiments and evaluations. In response to this, the Oak Ridge National Laboratory (ORNL) formed a Nuclear Criticality and Data group which performed ND experiments, data analysis, and evaluations to produce ENDF files for the ND libraries as identified in the NCSP Five-Year Plan. Before being submitted to the ENDF library, files were processed and tested for performance by running benchmark calculations. This procedure was centralized in the ORNL group and is now often referred to as the ND pipeline. NCSP collaborates with the Joint Research Center (JRC) of the European Commission in Geel, Belgium, to perform high-resolution neutron-induced cross section measurements at the Geel Linear Accelerator (GELINA). The objective is to address emerging ND problems in criticality calculations. Difficulties with ND include insufficient neutron energy range, missing covariances, and previously unrecognized inaccuracies with experiments. New neutron total and capture cross sections of 90 Zr in the neutron energy range from 100 eV to several hundred keV were recently performed. These measured data will be used, together with existing high-resolution transmission data from a metallic 90 Zr sample, to improve representation of the cross sections.
Comparative Density Functional Theory Study of Magnetic Exchange Couplings in Dinuclear Transition-Metal Complexes
Multicenter transition-metal complexes (MCTMs) with magnetically interacting ions have been proposed as components for information-processing devices and storage units. For any practical application of MCTMs as magnetic units, it is crucial to characterize their magnetic behavior, and in particular, the isotropic magnetic exchange coupling, J, between its magnetic centers. Due to the large size of typical MCTMs, density functional theory is the only practical electronic structure method for evaluating the J coupling. Here, we assess the accuracy of different density functional approximations for predicting the magnetic couplings of eight dinuclear transition-metal complexes, including five dimanganese, two dicopper, and one divanadium with known reliable experimental J couplings spanning from ferromagnetic to strong antiferromagnetic. The density functionals considered include global hybrid functionals which mix semilocal density functional approximations and exact exchange with a fixed admixing parameter, six local hybrid functionals where the admixing parameters are extended to be spatially dependent, the SCAN and r 2 SCAN meta-generalized gradient approximations (GGAs), and two widely used GGAs. We found that global hybrids tested in this work have a tendency to over-correct the error in magnetic coupling parameters from the Perdew–Burke–Ernzerhof (PBE) GGA as seen for manganese complexes. The performance of local hybrid density functionals shows no improvement in terms of bias and is scattered without a clear trend, suggesting that more efforts are needed for the extension from global to local hybrid density functionals for this particular property. The SCAN and r 2 SCAN meta-GGAs are found to perform as well as benchmark global hybrids on most tested complexes. We further analyze the charge density redistribution of meta-GGAs as well as global and local hybrid density functionals with respect to that of PBE, in connection to the self-interaction error or delocalization error.
A Framework for Benchmarking Land Models
Explore the source record for details and available documents.
A framework for benchmarking land models
Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.
Progress on Computational Modeling of Water-Based NSTF (FY2021)
This report documents the FY21 progress and achievements made in the computational analyses of the water-based NSTF. Both system-level and high-fidelity Computational Fluid Dynamics (CFD) analyses were performed to gain a complete understanding of the complex flow and heat transfer phenomena in natural convection systems. The progress on the waterbased NSTF experimental testing is summarized in a companion report (ANL-ART-230). As a continuation of progress from previous years, in FY21 the RELAP5 model of the NSTF was first updated to include a representative heated cavity that incorporated convection and conduction means of heat transfer. Two different cavity models were developed, one that models the radiation heat exchange among all surfaces in one enclosure (Cavity Model 1), and another that employs multiple radiation enclosures with each considering the surfaces at one axial level (Cavity Model 2). This updated RELAP5 deck was benchmarked with single-phase test data to tune form loss coefficients of the elbows and tees, along with heat transfer coefficients within the cavity and off the external insulation panels. This tuned model was then found to accurately predict fluid temperatures within 2.5% and both system and riser flow rates within 6% during single-phase, steady-state simulations. For transient simulations, there is a slight over prediction of the flow rate, fluid temperatures, and heater temperatures during the heat-up period, which indicate that the transient heat loss may be underestimated. Following, the capabilities of RELAP5-3D were examined, which feature a conduction enclosure model that is not present in the current version of RELAP5-MOD3.3 used for all previous NSTF simulations. As an initial comparison of the two codes, single-phase simulations were run that used similar input decks. The results indicate that the single-phase flow predicted by the two codes was very similar, however RELAP5-3D appears to predict a higher system flow during the two-phase transient when compared to the flow rates predicted by RELAP5-MOD3.3. Furthermore, RELAP5-3D run did not capture the density wave oscillations or geysering phenomena, which are large oscillation flow instabilities observed in the experimental facility. To further the prediction capabilities for capturing two-phase instabilities, Options 55, 57, 58, 61, which are implemented by default in RELAP5-MOD3.3 but not in RELAP5-3D, were investigated. When enabling Option 61, RELAP5-3D agrees well with MOD3.3 in predicting the total system flow, while other options have negligible effect on the predicted total system flow by RELAP5-3D. However, none of these options enables RELAP5-3D to produce the same flow instabilities. For future steps, efforts are currently underway to investigate RELAP5-3D’s different behavior in predicting low-pressure two-phase instabilities. STAR-CCM+ was used to perform CFD analysis of the water-based test facility and provide simulation results for comparisons to experimental data. Efforts first focused on describing the characteristics of flow within the heated cavity. A study was performed on whether possible leakage flow between the two sides of the cavity could substantially impact and explain the results. An additional second assumption was examined which defined adiabatic side walls, so physical insulation structures were added to the models to allow conduction across this outer insulation. The results suggest that potential porosity of the insulation could be a major factor in the temperature distribution within the cavity and should be considered in any studies where it is desirable to know the cavity wall temperatures to higher accuracy.
Simulation of mineral dissolution at the pore scale with evolving fluid-solid interfaces: review of approaches and benchmark problem set
This manuscript presents a benchmark problem for the simulation of single-phase flow, reactive transport, and solid geometry evolution at the pore scale. The problem is organized in three parts that focus on specific aspects: flow and reactive transport (part I), dissolution-driven geometry evolution in two dimensions (part II), and an experimental validation of three-dimensional dissolution-driven geometry evolution (part III). Five codes are used to obtain the solution to this benchmark problem, including Chombo-Crunch, OpenFOAM-DBS, a lattice Boltzman code, Vortex, and dissolFoam. These codes cover a good portion of the wide range of approaches typically employed for solving pore-scale problems in the literature, including discretization methods, characterization of the fluid-solid interfaces, and methods to move these interfaces as a result of fluid-solid reactions. A short review of these approaches is given in relation to selected published studies. Results from the simulations performed by the five codes show remarkable agreement both quantitatively--based on upscaled parameters such as surface area, solid volume, and effective reaction rate--and qualitatively--based on comparisons of shape evolution. This outcome is especially notable given the disparity of approaches used by the codes. Therefore, these results establish a strong benchmark for the validation and testing of pore-scale codes developed for the simulation of flow and reactive transport with evolving geometries. They also underscore the significant advances seen in the last decade in tools and approaches for simulating this type of problem.