Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Validating Intra-Plate Power Distributions in the Advanced Test Reactor

We report that the neutronics software, HELIOS, was validated in 2015 for performing core reload design and safety analysis of the Advanced Test Reactor. However, when HELIOS was benchmarked against historic fission-wire measurements (i.e., zero-power full-core measurements) a statistically resolved calculation-to-measurement bias was discovered. The azimuthal power along each fuel plate computed by HELIOS has consistently shown to under-predict measurements made by fission-wires in historic zero-power tests near the fuel element side-plates. It was hypothesized during the HELIOS software validation work, that this bias is attributable to local moderation in coolant vents in the side-plates axially just above and below the fission-wires on the fuel-plate edges. This work used detailed MCNP and MC21 models of the side-plate vents to test this hypothesis. By comparing the average azimuthal biases between HELIOS, and 2D and 3D MCNP models, and a 3D MC21 model, it was found that the HELIOS azimuthal bias is not due to the measurement.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Generation and Radiation of Acoustic Waves from a 2-D Shear Layer

A parallel numerical simulation of the radiation of sound from an acoustic source inside a 2-D jet is presented in this paper. This basic benchmark problem is used as a test case for scattering problems that are presently being solved by using the Impedance Mismatch Method (IMM). In this technique, a solid body in the domain is represented by setting the acoustic impedance of each medium, encountered by a wave, to a different value. This impedance discrepancy results in reflected and scattered waves with appropriate amplitudes. The great advantage of the use of this method is that no modifications to a simple Cartesian grid need to be made for complicated geometry bodies. Thus, high order finite difference schemes may be applied simply to all parts of the domain. In the IMM, the total perturbation field is split into incident and scattered fields. The incident pressure is assumed to be known and the equivalent sources for the scattered field are associated with the presence of the scattering body (through the impedance mismatch) and the propagation of the incident field through a non-uniform flow. An earlier version of the technique could only handle uniform flow in the vicinity of the source and at the outflow boundary. Scattering problems in non-uniform mean flow are of great practical importance (for example, scattering from a high lift device in a non-uniform mean flow or the effects of a fuselage boundary layer). The solution to this benchmark problem, which has an acoustic wave propagating through a non-uniform mean flow, serves as a test case for the extensions of the IMM technique.

Agarwal, Anurag↗

Modeling of transport phenomena in tokamak plasmas with neural networks

A new transport model that uses neural networks (NNs) to yield electron and ion heat ux pro les has been developed. Given a set of local dimensionless plasma parameters similar to the ones that the highest delity models use, the NN model is able to efficiently and accurately predict the ion and electron heat transport pro les. As a benchmark, a NN was built, trained, and tested on data from the 2012 and 2013 DIII-D experimental campaigns. It is found that NN can capture the experimental behavior over the majority of the plasma radius and across a broad range of plasma regimes. Although each radial location is calculated independently from the others, the heat ux pro les are smooth, suggesting that the solution found by the NN is a smooth function of the local input parameters. This result supports the evidence of a well-de ned, non-stochastic relationship between the input parameters and the experimentally measured transport uxes. Finally, the numerical efficiency of this method, requiring only a few CPU-μs per data point, makes it ideal for scenario development simulations and real-time plasma control.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance of three-dimensional printed nasopharyngeal swabs for COVID-19 testing

At the start of the COVID-19 pandemic, the US faced nationwide shortages of nasopharyngeal swabs due to both overwhelmed supply chains and an increase in demand. To address this shortfall, multiple 3D printed swabs were ultimately produced and sold for COVID-19 testing. In this work, we present a framework for mechanical and functional bench-testing of nasopharyngeal swabs using standard and widely available material testing equipment. Using this framework, we offer a comprehensive, quantitative comparison of the 3D printed swabs to benchmark their performance against traditional flocked swabs. The test protocols were designed to emulate the clinical use of the nasopharyngeal swabs and to evaluate potential failure modes. Overall, the 3D printed swabs performed comparably to, or outperformed, the traditional swabs in all mechanical tests. While traditional swabs outperformed some of the new 3D printed swabs in terms of sample uptake and retention, similar amounts of RNA were recovered from both 3D printed and traditional swabs.

3D printing↗

Benchmark On Sensitivity Calculation (Phase III)

The sensitivities of the keff eigenvalue to neutron cross sections have become commonly used in similarity studies and as part of the validation algorithm for criticality safety assessments. To test calculations of the sensitivity coefficients, a benchmark study (Phase III) has been established by the OECD-NEA/WPNCS/EG UACSA (Expert Group on Uncertainty Analysis for Criticality Safety Assessment). This paper presents some sensitivity results generated by the benchmark participants using various computational tools based upon different computational methods: SCALE/TSUNAMI-3D and -1D, MONK, APOLLO2-MORET 5, DRAGON-SUSD3D and MMKKENO. The study demonstrates the performance of the tools. It also illustrates how model simplifications impact the sensitivity results and demonstrates the importance of 'implicit' (self-shielding) sensitivities. This work has been a useful step towards verification of the existing and developed sensitivity analysis methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scaled Testing to Evaluate Pulse Jet Mixer Performance in Waste Treatment Plant Mixing Vessels

The Waste Treatment and Immobilization Plant (WTP) at Hanford is being designed and built to pre-treat and vitrify the waste in Hanford’s 177 underground waste storage tanks. Numerous process vessels will hold waste at various stages in the WTP. These vessels have pulse jet mixer (PJM) systems. A test program was developed to evaluate the adequacy of mixing system designs in the solids-containing vessels in the WTP. The program focused mainly on non-cohesive solids behavior. Specifically, the program addressed the effectiveness of the mixing systems to suspend settled solids off the vessel bottom, and distribute the solids vertically. Experiments were conducted at three scales using various particulate simulants. A range of solids loadings and operational parameters were evaluated, including jet velocity, pulse volume, and duty cycle. In place of actual PJMs, the tests used direct injection from tubes with suction at the top of the tank fluid. This gave better control over the discharge duration and duty cycle and simplified the facility requirements. The mixing system configurations represented in testing varied from 4 to 12 PJMs with various jet nozzle sizes. In this way the results collected could be applied to the broad range of WTP vessels with varying geometrical configurations and planned operating conditions. Data for “just-suspended velocity”, solids cloud height, and solids concentration vertical profile were collected, analyzed, and correlated. The correlations were successfully benchmarked against previous large-scale test results, then applied to the WTP vessels using reasonable assumptions of anticipated waste properties to evaluate adequacy of the existing mixing system designs.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Software Developer’s Guide to Informal Evaluation of Visual Analytics Environments Using VAST Challenge Information

The VAST Challenge has been a popular venue for academic and industry participants for over ten years. Many participants comment that the majority of their time in preparing VAST Challenge entries is discovering elements in their software environments that need to be redesigned in order to solve the given task. Fortunately, there is no need to wait until the VAST Challenge is announced to test out software systems. The Visual Analytics Benchmark Repository contains all past VAST Challenge tasks, data, solutions and submissions. This paper details the various types of evaluations that may be conducted using the Repository information. In this paper we describe how developers can do informal evaluations of various aspects of their visual analytics environments using VAST Challenge information. Aspects that can be evaluated include the appropriateness of the software for various tasks, the various data types and formats that can be accommodated, the effectiveness and efficiency of the process supported by the software, and the intuitiveness of the visualizations and interactions. Researchers can compare their visualizations and interactions to those submitted to determine novelty. In addition, the paper provides pointers to various guidelines that software teams can use to evaluate the usability of their software. While these evaluations are not a replacement for formal evaluation methods, this information can be extremely useful during the development of visual analytics environments.

evaluation↗

Verifying MCNP Models of the TEX High 240 Plutonium Benchmark

Computational modeling programs are invaluable tools that allow us to understand systems, safely develop new processes, and make reliable predictions about future designs. However, the effectiveness of these codes is limited by the degree to which their parameters match the real world. In the field of nuclear engineering, cross section data is one of these vital parameters. Accurate cross section data on important fissile and fissionable isotopes promotes the design of safer and more efficient fabrication, transportation, storage, and stockpiling of nuclear fuel. Unfortunately, there are knowledge gaps in data on key isotopes. In 2011, a multinational meeting hosted by the US Department of Energy Nuclear Criticality Safety Program ranked the priority of certain cross section data needs. In response, Lawrence Livermore National Lab (LLNL) designed the Thermal and Epithermal eXperiment (TEX) series of benchmark experiments. Benchmark experiments are used to validate current cross section data. They validate data by comparing the results of an actual experiment to the predicted results from a computational model. The data a benchmark applies to depends on the isotope and energy range the experiment’s neutron multiplication factor ( k eff ) is most sensitive to. The development and testing of the TEX High 240 Plutonium Benchmark will help validate 240 Pu cross section data. The configuration and materials of this benchmark are designed to be most sensitive to 240 Pu's intermediate energy range (from 0.625 ev to 100 keV ). MCNP® models of the assembly have been developed by LLNL and the results have been written in the final design report. In order for the discrepancies between benchmark models and experiments to be attributed to cross section inaccuracies, the accuracy of the models needs to be verified. The goal of this project is to verify of the results of LLNL's modeling by creating a new set of MCNP models and comparing the results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Benchmark Analysis

Tremendous progress has been achieved in the development of land models and their inclusion in Earth system models (ESMs). However, we still have very limited knowledge on the performance skills of these land models. This chapter introduces benchmark analysis, which is a procedure to measure performance of models against a set of defined standards. The benchmark analysis includes: (1) defining targeted aspects of model performance to be evaluated; (2) testing model performance in comparison with a set of benchmarks; (3) measuring model performance skill through quantitative metrics; and (4) evaluating model performance and offering suggestions for future model improvement.

Luo, Yiqi↗

VASIMR{sup R} Interfaced High Temperature Gas-Cooled Fast Reactor for Space Applications

This project was undertaken to assess the feasibility and advantages of utilizing a gas-cooled fast reactor to supply power to an electric propulsion system for deep space exploration to Europa, one of Jupiter's moons. Specifically, the primary objective of this project was to design a 9 MWe gas cooled fast reactor with an accompanying power conversion system to supply electricity to multiple electrically-powered thrusters for a four year mission duration. The thruster design chosen for this analysis is the Variable Specific Impulse Magnetoplasma Rocket (VASIMR). The VASIMR propulsion system, currently being developed by Ad Astra Rocket Company (AARC), is an electric propulsion rocket that uses electric power to accelerate neutral plasma propellant. Advanced electric space propulsion systems such as the VASIMR offer unique capabilities that allow for higher exhaust velocities that are up to ten times that of traditional chemical rockets. Furthermore, the thrust and specific impulse of the VASIMR system can be varied in order to achieve optimal travel times to given destinations for a desired payload. As a result, electric propulsion systems characteristically have lower ratios of system mass to power output than chemical rockets. This ratio is commonly known as the alpha parameter. Alpha parameters of approximately 10 kg/kWe or less make electric propulsion more attractive for deep space exploration missions in terms of resource efficiency and cost. However, the primary challenge with electric propulsion is to develop a high power density source of electricity in order to minimize the total system mass. The alpha parameter is the main benchmark used in this project to test whether or not the proposed coupled gas cooled reactor and power conversion system design is more competitive than other proposed systems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Simulation of Enhanced Geothermal Systems: A Benchmarking and Code Intercomparison Study

Numerical simulation codes have become critical tools for understanding complex geologic processes, as applied to technology assessment, system design, monitoring, and operational guidance. Recently the need for quantitatively evaluating coupled Thermodynamic, Hydrologic, geoMechanical, and geoChemical (THMC) processes has grown, driven by new applications such as geologic sequestration of greenhouse gases and development of unconventional energy sources. Here we focus on Enhanced Geothermal Systems (EGS), which are man-made geothermal reservoirs created where hot rock exists but there is insufficient natural permeability and/or pore fluids to allow efficient energy extraction. In an EGS, carefully controlled subsurface fluid injection is performed to enhance the permeability of pre-existing fractures, which facilitates fluid circulation and heat transport. EGS technologies are relatively new, and pose significant simulation challenges. To become a trusted analytical tool for EGS, numerical simulation codes must be tested to demonstrate that they adequately represent the coupled THMC processes of concern. This presentation describes the approach and status of a benchmarking and code intercomparison effort currently underway, supported by the U. S. Department of Energy’s Geothermal Technologies Program. This study is being closely coordinated with a parallel international effort sponsored by the International Partnership for Geothermal Technology (IPGT). We have defined an extensive suite of benchmark problems, test cases, and challenge problems, ranging in complexity and difficulty, and a number of modeling teams are applying various simulation tools to these problems. The descriptions of the problems and modeling results are being compiled using the Velo framework, a scientific workflow and data management environment accessible through a simple web-based interface.

benchmark↗

Hover and Forward Flight Performance Modeling of the Ingenuity Mars Helicopter

In 2015, NASA’s Jet Propulsion Laboratory partnered with Ames Research Center, Langley Research Center, and AeroVironment to develop Ingenuity, a small coaxial helicopter capable of flying within Mars’ unique atmospheric conditions. Ingenuity was successfully deployed from its protective shroud on the underside of the Mars 2020 Perseverance Rover and has flown 17 flights on Mars as of December 2021. A number of rotorcraft analysis tools were utilized, and a series of experimental tests were performed to ready Ingenuity for its launch with the Perseverance Rover in July 2020. In this paper, RotCFD, a Reynolds-averaged Navier-Stokes flow solver, is used to model Ingenuity in hover and forward flight for the purposes of validating tools to aid in the development of a future generation of Mars rotorcraft. The results from the RotCFD modeling are benchmarked against results from hover performance tests of the Ingenuity prototype in the 25-Foot Space Simulator at the Jet Propulsion Laboratory and are also compared to hover and forward flight predictions made by CAMRAD II, a well-known comprehensive rotorcraft analysis code. Surrogate performance models are trained to obtain a set of trimmed rotor settings for Ingenuity at different forward flight speeds, which are then used as inputs for the RotCFD forward flight simulations. Additionally, a study of the airframe-rotor interaction and a study of the aerodynamics of the individual airframe components of Ingenuity in forward flight are performed. Finally, to better understand performance predictions by RotCFD and CAMRAD II, a study is conducted on how sectional angles of attack in each code vary with radial station and azimuth.

Hover↗

An overview of the activities carried out by the IAEA Technical Working Group on Fast Reactors

The Technical Working Group on Fast Reactors (TWG-FR) of the International Atomic Energy Agency (IAEA) is a group of experts to provide advice and support programme implementation, reflecting a global network of excellence and expertise in the area of advanced technologies and R and O for fast reactors and sub-critical hybrid systems. Consistent with its mandate, the TWG-FR assists in defining and carrying out the Agency's activities in the field of nuclear power technology development for fast reactors and sub-critical hybrid systems. It promotes the exchange of information on national and multi-national programmes and new developments and experience, with the goal to identify and review problems of importance and to stimulate and facilitate cooperation, development and practical application of fast reactors and sub-critical hybrid systems. Finally, the TWG-FR provides Member States with information about the current status and development trends of advanced technologies for fast reactors and sub-critical hybrid systems. The TWG-FR coordinates its activities with other IAEA projects and initiatives, especially those of the Technical Working Group on Nuclear Fuel Cycle Options (TWG-NFCO), the Dept. of Nuclear Safety and Security and, last but not least, the International Project on Innovative Nuclear Reactors and the Fuel Cycle INPRO. It also cooperates with FR-related initiatives implemented within the framework of other international programmes (e.g. GIF, OECD/NEA, ESNII, etc.). The paper presents the recent relevant activities of the TWG-FR as well as the status of the current Coordinated Research Projects jointly carried out by a number of organizations representing the various Member States within the TWG-FR. In particular they concern benchmark analyses of: - the sodium natural circulation tests performed during Phenix End-of-Life experiments; - the sodium natural convection in the upper plenum of the Monju reactor vessel; - an EBR-II Shutdown Heat Removal Test. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

OECD/NEA expert group on uncertainty analysis for criticality safety assessment: Results of benchmark on sensitivity calculation (phase III)

The sensitivities of the k{sub eff} eigenvalue to neutron cross sections have become commonly used in similarity studies and as part of the validation algorithm for criticality safety assessments. To test calculations of the sensitivity coefficients, a benchmark study (Phase III) has been established by the OECD-NEA/WPNCS/EG UACSA (Expert Group on Uncertainty Analysis for Criticality Safety Assessment). This paper presents some sensitivity results generated by the benchmark participants using various computational tools based upon different computational methods: SCALE/TSUNAMI-3D and -1D, MONK, APOLLO2-MORET 5, DRAGON-SUSD3D and MMKKENO. The study demonstrates the performance of the tools. It also illustrates how model simplifications impact the sensitivity results and demonstrates the importance of 'implicit' (self-shielding) sensitivities. This work has been a useful step towards verification of the existing and developed sensitivity analysis methods. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Compaction of crushed salt for safe containment – a summary of the KOMPASS projects

Abstract. For the underground disposal of high-level nuclear waste in rock salt formations, the safety concept includes the backfilling of open cavities with crushed salt. For the prognosis of the sealing function of the backfill for the safe containment of the radioactive waste, it is crucial to have a comprehensive process understanding of the crushed-salt compaction behavior. The crushed-salt compaction process is influenced by internal properties (e.g., grain size, mineralogy, and moisture content) and boundary conditions (e.g., temperature, stress state, and compaction rate) and, therefore, involves several coupled thermal–hydro–mechanical (THM) processes (Hansen et al., 2014; Kröhn et al., 2017). With the paradigm shift from the limited release of radionuclides to safe containment due to the German Repository Site Selection Act passed in 2017, the importance of crushed salt as geotechnical barrier has increased, with a focus on the evolution of its hydraulic properties. Based on the knowledge gaps in the current process understanding, the “Compaction of crushed salt for safe containment” (KOMPASS) projects were initiated to improve the scientific basis behind using crushed salt for the long-term isolation of high-level nuclear waste within rock salt repositories. The efforts to improve the prediction of crushed-salt compaction begun during the first phase of the KOMPASS projects (Czaikowski et al., 2020) and were followed up in a second phase ending in June 2023. The primary achievements of the projects are as follows (Czaikowski et al., 2020; Friedenberg et al., 2022): specification of the KOMPASS reference material, an easily available and reproducible synthetic crushed-salt material, for generic investigations; development of pre-compaction methods and successful production of samples in the short term and under in situ loading conditions; formulation of an extended laboratory program addressing the isolated investigation of known relevant factors influencing the compaction behavior of crushed salt (Düsterloh et al., 2022); execution of long-term compaction tests addressing isotropic and deviatoric load changes, temperature, and compaction state; construction of a backfill body using the KOMPASS reference material in the Sondershausen mine through collaboration with the SAVER (Entwicklung eines salzgrusbasierten Versatzkonzepts unter der Option Rückholbarkeit) project (Schaarschmidt and Friedenberg, 2022); advancement of the tools for microstructure investigation methods (Svensson and Laurich, 2022); generation (first stages) of a microphysical process list combining literature research with our own findings; benchmarking of long-term compaction test for model development and optimization of various existing models as well as the development of new models; application of a virtual demonstrator (2D model representing a backfilled drift in rock salt) for the visualization of developments and the quantification of the models (Rabbel, 2022). In summary, the KOMPASS projects contributed to the reduction of uncertainties and the strengthening of the safety case for using crushed salt within rock salt repositories.

Friedenberg, Larissa↗

Design of a versatile multiaperture negative ion source

Negative ion sources are a key component of the neutral beam injector to be installed in the International Thermonuclear Experimental Reactor. At present research and development activities address several important issues related to beam extraction, optics, and optimization. Together with the design of real size devices and the accumulation of atomic cross section databases, a relatively small negative ion source [130 mA of H{sup -} at 60 kV, named Negative Ion Optimization phase 1 (NIO1)] is under construction at Consorzio RFX to contribute to benchmark numerical simulation tools and to test components, such as emittance scanners, beam dumps, and cesium ovens. NIO1 design, magnet configuration, and rf coupling simulations are described.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Data Testing with Zero Power Reactor (ZPR), Zero Power Physics Reactor (ZPPR), and New Thermal Epithermal eXperiments (TEX) Plutonium Benchmarks [Slides]

This presentation states that new TSLs in ENDF/B-VIII.0 will reduce the overprediction of the library for the most moderated cases. The differences between VII.1 and VIII.0 are driven by the 239 Pu changes and are consistently higher for all configurations. The VIII.0 239 Pu thermal cross sections were specifically adjusted lower to better predict plutonium thermal solutions criticality benchmarks, yet they overpredict the TEX thermal configurations, moderated by PE. Other, smaller differences have been seen for 240 Pu and 56 Fe. PMM-002 has shown utility in testing cross sections over a wide range of neutron energies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Order and correlation contributions to the entropy of hydrophobic solvation

The entropy of hydrophobic solvation has been explained as the result of ordered solvation structures, of hydrogen bonds, of the small size of the water molecule, of dispersion forces, and of solvent density fluctuations. We report a new approach to the calculation of the entropy of hydrophobic solvation, along with tests of and comparisons to several other methods. The methods are assessed in the light of the available thermodynamic and spectroscopic information on the effects of temperature on hydrophobic solvation. Five model hydrophobes in SPC/E water give benchmark solvation entropies via Widom’s test-particle insertion method, and other methods and models are tested against these particle-insertion results. Entropies associated with distributions of tetrahedral order, of electric field, and of solvent dipole orientations are examined. We find these contributions are small compared to the benchmark particle-insertion entropy. Competitive with or better than other theories in accuracy, but with no free parameters, is the new estimate of the entropy contributed by correlations between dipole moments. Dipole correlations account for most of the hydrophobic solvation entropy for all models studied and capture the distinctive temperature dependence seen in thermodynamic and spectroscopic experiments. Entropies based on pair and many-body correlations in number density approach the correct magnitudes but fail to describe temperature and size dependences, respectively. Hydrogen-bond definitions and free energies that best reproduce entropies from simulations are reported, but it is difficult to choose one hydrogen bond model that fits a variety of experiments. The use of information theory, scaled-particle theory, and related methods is discussed briefly. Our results provide a test of the Frank-Evans hypothesis that the negative solvation entropy is due to structured water near the solute, complement the spectroscopic detection of that solvation structure by identifying the structural feature responsible for the entropy change, and point to a possible explanation for the observed dependence on length scale. Our key results are that the hydrophobic effect, i.e. the signature, temperature-dependent, solvation entropy of nonpolar molecules in water, is largely due to a dispersion force arising from correlations between rotating permanent dipole moments, that the strength of this force depends on the Kirkwood g-factor, and that the strength of this force may be obtained exactly without simulation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗