Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Interdisciplinary Clinical Target Volume Generation for Cardiac Radioablation: Multicenter Benchmarking for the RAdiosurgery for VENtricular TAchycardia (RAVENTA) Trial

Cardiac radioablation is a novel treatment option for therapy-refractory ventricular tachycardia (VT) ineligible for catheter ablation. Three-dimensional clinical target volume (CTV) definition is a key step, and this complex interdisciplinary procedure includes VT-substrate identification based on electroanatomical mapping (EAM) and its transfer to the planning computed tomography (PCT). Benchmarking of this process is necessary for multicenter clinical studies such as the RAVENTA trial.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comprehensive review of photophysical parameters (ε, Φ f , τ s ) of tetraphenylporphyrin (H 2 TPP) and zinc tetraphenylporphyrin (ZnTPP) – Critical benchmark molecules in photochemistry and photosynthesis

Tetraphenylporphyrin (H 2 TPP) and zinc tetraphenylporphyrin (ZnTPP) are widely used benchmark molecules in diverse photochemical studies given facile synthetic access, rich visible-region spectra, and broad structural analogy to chlorophylls. Yet the literature values for each key photophysical parameter – the molar absorption coefficient (ε), fluorescence quantum yield (Φ f ), and also singlet excited-state lifetime (τ S ) – vary over an astonishing range. Here, a comprehensive literature review (~1940–September 2020) encompassing 871 publications is reported for these essential parameters. Each parameter is determined by measurement with distinct instrumentation and suffers idiosyncratic sources of error. The best values for H 2 TPP are ε = 460,000 cm -1 ·M -1 , Φ f = 0.090, and τ S = 12.8 ns in Ar- purged toluene (Φf = 0.070, τS = 9.9 ns in toluene in air); the best values for ZnTPP are ε = 560,000 cm -1 ·M -1 , Φf = 0.030, and τ S = 2.1 ns in Ar-purged toluene (Φ f = 0.029, τ S = 2.0 ns in toluene in air). The choice of values for such parameters has far-reaching consequences in photochemistry ranging from fluorescence (or Förster) resonance energy transfer (FRET) processes to assessments of molecular brightness.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

First benchmarked electron cooling simulations from first principles

We present the first microscopic electron cooling simulations from first principles with accurate prediction of cooling time. These simulations were performed using our previously developed numerical method, PHAD, which is the first efficient large-scale collisional numerical method in beam physics. The simulation results are benchmarked with the experimental data of the low energy bunched electron cooling of ion beams at the storage ring CSRm at the IMP facility in China. Here, we have accurately considered the nonlinear dynamics in the whole accelerator system in addition to the electron cooling section. As a result, our simulations correctly reproduced cooling times of the experiments from first principles and without any tuning or fitting parameters in the code.

43 PARTICLE ACCELERATORS↗

Benchmarking fast-neutron response of 7 Li-enriched C 7 LYC scintillators: Simulations and experiment

New insights into the fast neutron response of 7 Li-enriched C 7 LYC scintillators have been obtained through detailed Geant4 simulations of 35 Cl(n,p) and 35 Cl(n, α) reactions that are primarily responsible for the fast neutron response of C 7 LYC. The light output of a 1” x1” C 7 LYC detector was simulated using the Birks equation for light quenching in scintillators. The simulations were benchmarked against neutron scattering data from a 12 C target obtained with a white neutron beam at the Los Alamos LANSCE facility and fourteen 1”x1” C 7 LYC detectors. Incident neutron energies extracted from time-of-flight measurements, and appropriate recoil corrections for the different detector angles were used to map the response of C 7 LYC to mono-energetic neutrons. Resonances in the 35 Cl(n,p) reaction cross-section below 3 MeV incident neutron energy were directly observed in C 7 LYC. The experimental data and simulations are compared with ENDF databases, as well as recent direct cross-section measurements of neutrons scattered from a 35 Cl target. In conclusion, the results suggest a scrutiny of the 35 Cl(n,p) and 35 Cl(n, α) cross sections at low energy in the ENDF library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Numerical benchmark of transient pressure-driven metallic melt flows

Fluid dynamics simulations of melting and crater formation at the surface of a copper cathode exposed to high plasma heat fluxes and pressure gradients are presented. The predicted deformations of the free surface and the temperature evolution inside the metal are benchmarked against previously published simulations. Despite the physical model being entirely hydrodynamic and ignoring a variety of plasma–surface interaction processes, the results are also shown to be remarkably consistent with the predictions of more advanced models, as well as experimental data. This provides a sound basis for future applications of similar models to studies of transient surface melting and droplet ejection from metallic plasma-facing components after disruptions.

36 MATERIALS SCIENCE↗

Application of Jacobian-free Newton–Krylov method in implicitly solving two-fluid six-equation two-phase flow problems: Implementation, validation and benchmark

This work represents a first-of-its-kind successful application to employ advanced numerical methods in solving realistic two-phase flow problems with two-fluid six-equation two-phase flow model. These advanced numerical methods include high-resolution spatial discretization scheme with staggered grids (high-order) fully implicit time integration schemes, and Jacobian-free Newton–Krylov (JFNK) method as the nonlinear solver. The computer code developed in this work has been extensively validated with existing experimental flow boiling data in vertical pipes and rod bundles, which cover wide ranges of experimental conditions, such as pressure, inlet mass flux, wall heat flux and exit void fraction. Additional code-to-code benchmark with the RELAP5-3D code further verifies the correct code implementation. The combined methods employed in this work exhibit strong robustness in solving two-phase flow problems even when phase appearance (boiling) and realistic discrete flow regimes are considered. Transitional flow regimes used in existing system analysis codes, normally introduced to overcome numerical difficulty, were completely removed in this work. As a result, this in turn provides the possibility to utilize more sophisticated flow regime maps in the future to further improve simulation accuracy.

42 ENGINEERING↗

System thermal-hydraulic modelling of the phénix dissymmetric test benchmark

Phénix is a French pool-type sodium-cooled prototype reactor; before the definitive shutdown, occurred in 2009, a final set of experimental tests are carried out in order to increase the knowledge on the operation and the safety aspect of the pool-type liquid metal-cooled reactors. One of the experiments was the Dissymmetric End-of-Life Test which was selected for the validation benchmark activity in the frame of SESAME project. The computer code validation plays a key role in the safety assessment of the innovative nuclear reactors and the Phénix dissymmetric test provides useful experimental data to verify the computer codes capability in the asymmetric thermal-hydraulic behaviour into a pool-type liquid metal-cooled reactor. This paper shows the comparison of the outcomes obtained with six different System Thermal-Hydraulic (STH) codes: RELAP5-3D©, SPECTRA, ATHLET, SAS4A/SASSYS-1, ASTEC-Na and CATHARE. The nodalization scheme of the reactor was individually achieved by the participants; during the development of the thermal-hydraulic model, the pool nodalization methodology had a special attention in order to investigate the capability of the STH codes to reproduce the dissymmetric effects which occur in each loop and into pools, caused by the azimuthal asymmetry of the boundary conditions. The modelling methodology of the participants is discussed and the main results are compared in this paper to obtain useful guide lines for the future modelling of innovative liquid metal pool-type reactors.

42 ENGINEERING↗

Multiscale modelling of the phénix dissymmetric test benchmark

The Phenix sodium-cooled fast reactor contains two pools in which characteristic 3D effects like thermal stratification and jets play a significant role. One of the two active heat exchanger sets fails in the dissymmetric test, leading to changes in the thermal stratification and asymmetric conditions in the reactor. Therefore 3D modelling using Computational Fluid Dynamics codes (CFD) is required to model this transient in sufficient detail. However, several aspects of the reactor, like the core and the secondary side of the heat exchanger, can be modelled more efficiently by System Thermal-Hydraulics codes (STH). Therefore multiscale models are developed by coupling CFD and STH codes, exploiting the strengths of both codes in terms of modelling options and computational costs. The results provide insight in the local flow patterns and the temperature distribution during the dissymmetric transient. The results and modelling choices of the participants are compared in this paper and the main findings are discussed in the light of lessons learned from the blind phase of the benchmark and providing recommendations for future modelling of pool-type liquid metal-cooled reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessing the capability of continuum and discrete particle methods to simulate gas-solids flow using DNS predictions as a benchmark

For this study, gas–solids flow in a three-dimension periodic domain was numerically investigated by direct numerical simulation (DNS), computational fluid dynamic-discrete element method (CFD-DEM) and two-fluid model (TFM). DNS data obtained by finely resolving the flow around every particle are used as a benchmark to assess the validity of coarser DEM and TFM approaches. The CFD-DEM predicts the correct cluster size distribution and under-predicts the macro-scale slip velocity even with a grid size as small as twice the particle diameter. The TFM approach predicts larger cluster size and lower slip velocity with a homogeneous drag correlation. Although the slip velocity can be matched by a simple modification to the drag model, the predicted voidage distribution is still different from DNS: Both CFD-DEM and TFM over-predict the fraction of particles in dense regions and under-predict the fraction of particles in regions of intermediate void fractions. Also, the cluster aspect ratio of DNS is smaller than CFD-DEM and TFM. Since a simple correction to the drag model can predict a correct slip velocity, it is hopeful that drag corrections based on more elaborate theories that consider voidage gradient and particle fluctuations may be able to improve the current predictions of cluster distribution.

42 ENGINEERING↗

Wind turbine response in waked inflow: A modelling benchmark against full-scale measurements

Predicting the power and loads of wind turbines in waked inflow conditions still presents a major modelling challenge. It requires the accurate modelling of the atmospheric flow conditions, wakes of upstream turbines and the response of the turbine of interest. Rigorous validations of model frameworks against measurements of utility-scale wind turbines in such scenarios remain limited to date. In this study, six models of different fidelity are compared against measurements from the DanAero experiment. The two benchmark cases feature a full-wake and partial-wake scenario, respectively. The simulations are compared against local pressure forces and inflow velocities measured on several blade sections of the downstream turbine, as well as met mast measurements and standard SCADA data. Regardless of the model fidelity, reasonable agreements are found in terms of the wake characteristics and turbine response. For instance, the azimuth variation of the mean aerodynamic forces acting on the blade was captured with a mean relative error of 15-20%. Additionally, while various model-specific deficiencies could be identified, the study highlights the need for further full-scale measurement campaigns with even more extensive instrumentation. Furthermore, it is concluded that validations should not be limited to integrated and/or time-averaged quantities that conceal characteristic spatial or temporal variations.

17 WIND ENERGY↗

Modeling of thermal pressurization in tight claystone using sequential THM coupling: Benchmarking and validation against in-situ heating experiments in COx claystone

We apply thermoporoelasticity and a sequentially coupling technique for modeling thermally-driven coupled Thermo-Hydro-Mechanical (THM) processes in tight claystone. A THM benchmark case with a corresponding analytic solution for thermoporoelasticity under a constant heat loading verifies the model. Thereafter, two in situ heating experiments are simulated for model validation: a smaller-scale heating experiment (TED experiment) and a larger-scale experiment (ALC experiment) in Callovo-Oxfordian (COx) claystone at the Meuse/Haute-Marne underground research laboratory in France. The model exhibits good performance to match the observed temperature and pore pressure evolution for the smaller-scale TED experiment. For the larger-scale ALC experiment, general trends of thermal-pressurization are captured in the modeling, but pressure is underestimated at some monitoring points during cool-down. This indicates that the THM response in the field may be affected by the variability of rock's properties or irreversible or time-dependent mechanical processes that are not included in the current thermoporoelastic model. The main contributions of this work are as follows: (1) we verify and validate the numerical simulator, TOUGH-FLAC, to be a valuable coupled THM modeling tool; (2) prove that the laboratory determined material parameters can be used as reference values for upscaling experiments. However, to better identify and quantify THM processes with modeling of in situ tests, more emphasize should be dedicated to obtaining high-quality mechanical deformation data.

58 GEOSCIENCES↗

Benchmarking magnetised three-wave coupling for laser backscattering: analytic solutions and kinetic simulations

Understanding magnetised laser–plasma interactions is important for controlling magneto-inertial fusion experiments and developing magnetically assisted radiation and particle sources. For nanosecond pulses at non-relativistic intensities, interactions are dominated by coherent three-wave interactions, whose nonlinear coupling coefficients became known only recently when waves propagate at oblique angles with the magnetic field. In this paper, backscattering coupling coefficients predicted by warm-fluid theory are benchmarked using particle-in-cell simulations in one spatial dimension, and excellent agreements are found for a wide range of plasma temperatures, magnetic field strengths and laser propagation angles, when the interactions are mediated by electron-dominant hybrid waves. Systematic comparisons between theory and simulations are made possible by a rigorous protocol. On the theory side, the initial boundary value problem of linearised three-wave equations is solved, and the transient-time solutions allow the effects of growth and damping to be distinguished. On the simulation side, parameters are carefully chosen and calibration runs are performed to ensure that comparisons are well controlled. Fitting simulation data to analytical solutions yields numerical growth rates that match theory predictions within error bars. Although warm-fluid theory is found to be valid for a wide parameter range, genuine kinetic effects have also been observed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Introduction to the Benchmarking and Publications for Non-Targeted Analysis Working Group

Non-targeted analysis (NTA) encompasses a rapidly evolving set of mass spectrometry techniques aimed at characterizing the chemical composition of complex samples, identifying unknown compounds, and/or classifying samples, without prior knowledge regarding the chemical content of the samples. Recent advances in NTA are the result of improved and more accessible instrumentation for data generation, and analysis tools for data evaluation and interpretation. As researchers continue to develop NTA approaches in various scientific fields, there is a growing need to identify, disseminate, and adopt community-wide method reporting guidelines. In 2018, NTA researchers formed the Benchmarking and Publications for Non-Targeted Analysis Working Group (BP4NTA) to address this need. Consisting of participants from around the world and representing fields ranging from environmental science and food chemistry to ‘omics and toxicology, BP4NTA provides resources addressing a variety of challenges associated with NTA. Furthermore, thus far, BP4NTA group members have aimed to establish consensus on NTA-related terms and concepts, and to create consistency in reporting practices by providing resources on a public website, including consensus definitions, reference content, and lists of available tools. Moving forward, BP4NTA will provide a setting for NTA researchers to continue discussing emerging challenges and contribute to additional harmonization efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmarking Soft Sensors for Remote Monitoring of On-Site Wastewater Treatment Plants

On-site wastewater treatment plants (OSTs) are usually unattended, so failures often remain undetected and lead to prolonged periods of reduced performance. To stabilize the performance of unattended plants, soft sensors could expose faults and failures to the operator. In a previous study, we developed soft sensors and showed that soft sensors with data from unmaintained physical sensors can be as accurate as soft sensors with data from maintained ones. The monitored variables were pH and dissolved oxygen (DO), and soft sensors were used to predict nitrification performance. In the present study, we use synthetic data and monitor three plants to test these soft sensors. We find that a long solids retention time and a moderate aeration rate improve the pH soft-sensor accuracy and that the aeration regime is the main operational parameter affecting the accuracy of the DO soft sensor. We demonstrate that integrated design of monitoring and control is necessary to achieve robustness when extrapolating from one OST to another in the absence of plant-specific fine-tuning. Additionally, we provide a unique labeled dataset for further feature and data-driven soft-sensor development. Our benchmarking results indicate that it is feasible to monitor OSTs with unmaintained sensors and without plant-specific tuning of the developed soft sensors. This is expected to drastically reduce monitoring costs for OST-based sanitation systems.

54 ENVIRONMENTAL SCIENCES↗

Benchmarking an Embedded Adaptive Sampling Configuration Interaction Method for Surface Reactions: H 2 Desorption from and CH 4 Dissociation on Cu(111)

Embedded (emb-) correlated wavefunction (CW) theory enables accurate assessments of both ground- and excited-state reaction mechanisms involved in heterogeneous catalysis. Embedded multireference second-order perturbation theory (emb-MRPT2) based on reference wavefunctions generated via embedded complete active space self-consistent field (emb-CASSCF) theory is currently state-of-the-art. However, the factorial scaling of CASSCF limits the size of active space and the complexity of systems that can be studied. In this work, we assess the efficacy of an alternative CW method, adaptive sampling configuration interaction (ASCI)–which enables large active spaces to be used–for studying surface reactions. We couple ASCI with density functional embedding theory (DFET) and benchmark its performance for two reactions: H 2 desorption from and CH 4 dissociation on the Cu(111) surface. Unlike embedded complete active space second-order perturbation theory (emb-CASPT2) that accurately reproduces a measured H 2 desorption barrier, embedded ASCI, using a very large active space (though one that still comprises a small portion of the full set of orbitals) fails to do so. Adding an extra correlation term from embedded Møller–Plesset second-order perturbation theory (emb-MP2) improves the desorption barrier and endothermicity predictions. Thus, the inaccuracy of embedded ASCI comes from the missing dynamic correlation from the many other electrons and orbitals not included in the active space. For CH 4 dissociation, again embedded ASCI overestimates the dissociation barrier compared to emb-CASPT2 predictions. Adding dynamic correlation from emb-MP2 helps correct the barrier. However, this composite approach suffers from double counting of correlation within embedded ASCI followed by emb-MP2 calculations. We therefore conclude that the state-of-the-art emb-MRPT2 based on reference wavefunctions generated via emb-CASSCF remains the method of choice for studying surface reactions. emb-ASCI is useful when large active spaces beyond the limit of emb-CASSCF are essential, such as to study complex surface reactions with significant multiconfigurational character (static correlation) but weak dynamic correlation.

08 HYDROGEN↗

Quadratic Unitary Coupled-Cluster Singles and Doubles Scheme: Efficient Implementation, Benchmark Study, and Formulation of an Extended Version

An efficient implementation of the quadratic unitary coupled-cluster singles and doubles (qUCCSD) scheme for calculations of electronic ground and excited states using an unrestricted molecular spin–orbital formulation and an efficient tensor contraction library is reported. The accuracy of the qUCCSD scheme and the efficiency of the present implementation are demonstrated using extensive benchmark calculations of excitation energies and an application to S o → S 1 vertical excitation energies for cis- and trans-4a,4b-dihydrotriphenylene. The qUCCSD scheme has been shown to provide improved excitation energies compared with the UCC3 scheme formulated based on perturbation theory. Here, a UCC truncation scheme that can provide excitation energies correct through the fourth order is also presented to further improve the accuracy of the qUCCSD scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗