Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Numerical Implementation of Time-Dependent Density Functional Theory for Extended Systems in Extreme Environments

In recent years, DFT-MD has been shown to be a useful computational tool for exploring the properties of WDM. These calculations achieve excellent agreement with shock compression experiments, which probe the thermodynamic parameters of the Hugoniot state. New X-ray Thomson Scattering diagnostics promise to deliver independent measurements of electronic density and temperature, as well as structural information in shocked systems. However, they require the development of new levels of theory for computing the associated observables within a DFT framework. The experimentally observable x-ray scattering cross section is related to the electronic density-density response function, which is obtainable using TDDFT - a formally exact extension of conventional DFT that describes electron dynamics and excited states. In order to develop a capability for modeling XRTS data and, more generally, to establish a predictive capability for first principles simulations of matter in extreme conditions, real-time TDDFT with Ehrenfest dynamics has been implemented in an existing PAW code for DFT-MD calculations. The purpose of this report is to record implementation details and benchmarks as the project advances from software development to delivering novel scientific results. Results range from tests that establish the accuracy, efficiency, and scalability of our implementation, to calculations that are verified against accepted results in the literature. Aside from the primary XRTS goal, we identify other more general areas where this new capability will be useful, including stopping power calculations and electron-ion equilibration.

97 MATHEMATICS AND COMPUTING↗

When to use rsync

We have endeavored to show, using a series of data transfer results obtained from two testbeds, when to use the popular data copying tool rsync and related tools. Tests have been conducted in local area network (LAN) and wide area network (WAN) environments. We conclude that for files in a certain size range and network latency ≦ 10 ms round trip time (RTT), rsync is still useful for data moving tasks in the category 4 of the U.S. DOE Technical Report “Data Movement Categories”. For more demanding data movement requirements, tools of different classes are suggested. Sample histograms from two DOE user facilities are provided to further support our conclusions.

97 MATHEMATICS AND COMPUTING↗

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗

An Evaluation of Co-Simulation for Modeling Coupled Natural Gas and Electricity Networks

Reliance on natural gas for power generation has increased the coupling between gas and power networks. While this coupling can bring operational and economic benefits, it can also yield challenges, as the constraints in one system can impact the other. Co-simulation can capture the constraints and interactions between these systems, but so far, there has been limited comparison of co-simulation results to those of an integrated model. In this work, we develop a new co-simulation framework using the HELICS platform and the SAInt tool for modeling transient gas and AC optimal power flow. We evaluate this co-simulation framework against a fully integrated version of the SAInt power and gas simulators, thus providing a benchmarking of the co-simulation approach. We compare results across the two approaches for two test networks and a network representing the Belgian power and gas networks, testing both normal operating conditions and cases with compressor disruptions. In each of the cases tested, we find nearly identical results from the two approaches across various metrics of interest, such as nodal pressure, gas flow rates, and active power generation. This alignment suggests that co-simulation can yield comparable results to fully integrated models for modeling coupled gas and electricity networks.

03 NATURAL GAS↗

Image-Driven Hybrid Structural Analysis Based on Continuum Point Cloud Method with Boundary Capturing Technique

Conventional approaches for the structural health monitoring of infrastructures often rely on physical sensors or targets attached to structural members, which require considerable preparation, maintenance, and operational effort, including continuous on-site adjustments. This paper presents an image-driven hybrid structural analysis technique that combines digital image processing (DIP) and regression analysis with a continuum point cloud method (CPCM) built on a particle-based strong formulation. Polynomial regressions capture the boundary shape change due to the structural loading and precisely identify the edge and corner coordinates of the deformed structure. The captured edge profiles are transformed into essential boundary conditions. This allows the construction of a strongly formulated boundary value problem (BVP), classified as the Dirichlet problem. Capturing boundary conditions from the digital image is novel, although a similar approach was applied to the point cloud data. It was shown that the CPCM is more efficient in this hybrid simulation framework than the weak-form-based numerical schemes. Unlike the finite element method (FEM), it can avoid aligning boundary nodes with regression points. A three-point bending test of a rubber beam was simulated to validate the developed technique. The simulation results were benchmarked against numerical results by ANSYS and various relevant numerical schemes. The technique can effectively solve the Dirichlet-type BVP, yielding accurate deformation, stress, and strain values across the entire problem domain when employing a linear strain model and increasing the number of CPCM nodes. In addition, comparative analysis with conventional displacement tracking techniques verifies the developed technique’s robustness. The proposed technique effectively circumvents the inherent limitations of traditional monitoring methods resulting from the reliance on physical gauges or target markers so that a robust and non-contact solution for remote structural health monitoring in real-scale infrastructures can be provided, even in unfavorable experimental environments.

Chemistry↗

The MAX facility for CFD code validation

ANL has recently completed construction of a fluid dynamics test facility devised to provide validation data for CFD simulation tools used to evaluate various aspects of nuclear power plant design and safety. Experiments with the facility involve mixing air jets within a 1x1x1.7m long glass tank at atmospheric pressure. A particle image velocimetry system measures flow velocity and turbulence quantities within the tank while a high-speed infrared camera records temperatures across the tank lid. The tandem of high fidelity thermal and turbulence data is particularly useful for benchmarking transient heat transfer phenomena such as thermal striping. This paper describes the MAX facility, preliminary data obtained during shakedown tests, and the results of companion CFD calculations employing RANS-based Star-CCM+ and large eddy simulations with Nek 5000. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

Evaluation of the Start-Up Core Physics Tests at Japan's High Temperature Engineering Test Reactor (Annular Core Loadings)

The High Temperature Engineering Test Reactor (HTTR) of the Japan Atomic Energy Agency (JAEA) is a 30 MWth, graphite-moderated, helium-cooled reactor that was constructed with the objectives to establish and upgrade the technological basis for advanced high-temperature gas-cooled reactors (HTGRs) as well as to conduct various irradiation tests for innovative high-temperature research. The core size of the HTTR represents about one-half of that of future HTGRs, and the high excess reactivity of the HTTR, necessary for compensation of temperature, xenon, and burnup effects during power operations, is similar to that of future HTGRs. During the start-up core physics tests of the HTTR, various annular cores were formed to provide experimental data for verification of design codes for future HTGRs. The Japanese government approved construction of the HTTR in the 1989 fiscal year budget; construction began at the Oarai Research and Development Center in March 1991 and was completed May 1996. Fuel loading began July 1, 1998, from the core periphery. The first criticality was attained with an annular core on November 10, 1998 at 14:18, followed by a series of start-up core physics tests until a fully-loaded core was developed on December 16, 1998. Criticality tests were carried out into January 1999. The first full power operation with an average core outlet temperature of 850ºC was completed on December 7, 2001, and operational licensing of the HTTR was approved on March 6, 2002. The HTTR attained high temperature operation at 950 ºC in April 19, 2004. After a series of safety demonstration tests, it will be used as the heat source in a hydrogen production system by 2015. Hot zero-power critical, rise-to-power, irradiation, and safety demonstration testing , have also been performed with the HTTR, representing additional means for computational validation efforts. Power tests were performed in steps from 0 to 30 MW, with various tests performed at each step to confirm core characteristics, thermal-hydraulic properties, and radiation shielding. The high-temperature test operation at 950 ºC represented the fifth and final phase of the rise-to-power tests. The safety tests demonstrated inherent safety features of the HTTR such as slow temperature response during abnormal events due to the large heat capacity of the core and the negative reactivity feedback. The experimental benchmark performed and currently evaluated in this report pertains to the data available for the annular core criticals from the initial six isothermal, annular and fully-loaded, core critical measurements performed at the HTTR. Evaluation of the start-up core physics tests specific to the fully-loaded core is compiled elsewhere (HTTR-GCR-RESR-001).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Synthetic, Realistic Transmission and Distribution Co-Simulation for Voltage Control Benchmarking

As distributed energy resources (DERs) play an increasing role in generation and grid services, control and market paradigms will need to be tested with models that incorporate transmission and distribution systems. The test systems will need to be realistic and accessible for researchers to form conclusions about realistic behaviors and maintain comparability and repeatability of results. These test systems also must have high resolution models of sufficient size for realistic distribution and transmission interaction. This paper demonstrates the tightly coupled HELICS-based co-simulation of realistic synthetic distribution and transmission models for the Austin metropolitan area and how this framework can be used to analyze resultant behaviors from distributed resources and their controls. These results are compared to the same distribution system run without co-simulation using a fixed feed-in voltage. Results show that even without advanced voltage controls, the feed-in voltage response when coupled to the transmission system results a lower level of voltage excursions, suggesting the importance of using this type of realistic, tightly coupled, transmission and distribution cosimulation when assessing DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

Synthetic, Realistic Transmission and Distribution Co-Simulation for Voltage Control Benchmarking

As distributed energy resources (DERs) play an increasing role in generation and grid services, control and market paradigms will need to be tested with models that incorporate transmission and distribution systems. The test systems will need to be realistic and accessible for researchers to form conclusions about realistic behaviors and maintain comparability and repeatability of results. These test systems also must have high resolution models of sufficient size for realistic distribution and transmission interaction. This paper demonstrates the tightly coupled HELICS-based co-simulation of realistic synthetic distribution and transmission models for the Austin metropolitan area and how this framework can be used to analyze resultant behaviors from distributed resources and their controls. These results are compared to the same distribution system run without co-simulation using a fixed feed-in voltage. Results show that even without advanced voltage controls, the feed-in voltage response when coupled to the transmission system results a lower level of voltage excursions, suggesting the importance of using this type of realistic, tightly coupled, transmission and distribution co-simulation when assessing DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗

Verification benchmarks for single-phase flow in three-dimensional fractured porous media

Flow in fractured porous media occurs in the earth’s subsurface, in biological tissues, and in man-made materials. Fractures have a dominating influence on flow processes, and the last decade has seen an extensive development of models and numerical methods that explicitly account for their presence. To support these developments, four benchmark cases for single-phase flow in three-dimensional fractured porous media are presented. Furthermore, the cases are specifically designed to test the methods’ capabilities in handling various complexities common to the geometrical structures of fracture networks. Based on an open call for participation, results obtained with 17 numerical methods were collected. This paper presents the underlying mathematical model, an overview of the features of the participating numerical methods, and their performance in solving the benchmark cases.

97 MATHEMATICS AND COMPUTING↗

A New Era of Nuclear Criticality Experiments: The First 10 Years of Radiation Test Object Operations at NCERC

The work presented in this paper focuses on the first 10 years (2011–2020) of radiation test object (RTO) operations at the National Criticality Experiments Research Center. RTOs are subcritical configurations of special nuclear material that are built by hand. These configurations are utilized for benchmark experiments, detector testing/characterization, and training. An overview of the types of measurements used in RTO operations is given as well as a history of RTO operations at Los Alamos National Laboratory from 1944–2011.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Enhanced geometric capabilities for the transient analysis code T-ReX and its application to simulating TREAT experiments

Here, advances in computational architecture have prompted a resurgence in the simulation of reactor transients from first principles. Most codes are unable to simulate transient events with complex models, and require numerous approximations. The code T-ReX (Transient-Reactor eXperiment simulator), an extensive update to TDKENO, has been developed as a transient analysis tool with few geometric limitations and minimal theoretical approximations. T-ReX achieves this by employing the Improved Quasi-Static (IQS) method to solve the time dependent Boltzmann transport equation with explicit representation of delayed neutrons. The primary change in T-ReX relative to TDKENO is the incorporation of a modified version of the Monte Carlo code KENO-VI to calculate the flux shape and model the geometry of a problem. Using KENO-VI to model systems allows exact representation of the geometry. The changes to T-ReX are verified by comparison of solutions to computational benchmark problems found with a previous version of TDKENO that made use of KENO V.a, and several other codes with time-dependent capabilities. In addition, a three-dimensional model of the Transient Reactor Test Facility (TREAT) core at the Idaho National Laboratory (INL) is constructed with KENO-VI, and used to validate T ReX. T-ReX produces results that agree with benchmark problems, and are in better agreement with TREAT experimental data than TDKENO.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmark Study of Infinite Lattice of Pebble Fuel within FLiBe Coolant for TMSR-SF1 Design

Solid Fueled Thorium Molten Salt Reactor (TMSR-SF1) is Chinese Fluoride-salt-cooled High Temperature Reactor (FHR) designed by the TMSR group. The construction of this test reactor is expected in the near years. Using TRISO particle based pebble fuel leads to various challenges in neutronics modeling, such as double heterogeneity effect, preserving exact number of particles, their random distributions in pebble, and etc. For the purpose of verifying the calculations, benchmark study of infinite lattice of pebble fuel within FLiBe coolant for the TMSR-SF1 design has been performed. Back-to-back comparisons have been made between TMSR and MIT researchers using different Monte-Carlo based codes. Very good agreements have been found and the results quantitatively evaluate the neutronic effect of various modeling approaches. In addition, sensitivity study has been carried out for the reference pebble-bed fuel lattice. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmark Development in Support of Generation-IV Reactor Validation (IRPhEP 2010 Handbook)

The March 2010 edition of the International Reactor Physics Experiment Evaluation Project (IRPhEP) Handbook includes additional benchmark data that can be implemented in the validation of data and methods for Generation IV (GEN-IV) reactor designs. Evaluations supporting sodium-cooled fast reactor (SFR) efforts include the initial isothermal tests of the Fast Flux Test Facility (FFTF) at the Hanford Site, the Zero Power Physics Reactor (ZPPR) 10B and 10C experiments at the Idaho National Laboratory (INL), and the burn-up reactivity coefficient of Japan’s JOYO reactor. An assessment of Russia’s BFS-61 assemblies at the Institute of Physics and Power Engineering (IPPE) provides additional information for lead-cooled fast reactor (LFR) systems. Benchmarks in support of the very high temperature reactor (VHTR) project include evaluations of the HTR-PROTEUS experiments performed at the Paul Scherrer Institut (PSI) in Switzerland and the start-up core physics tests of Japan’s High Temperature Engineering Test Reactor. The critical configuration of the Power Burst Facility (PBF) at the INL which used ternary ceramic fuel, U(18)O2-CaO-ZrO2, is of interest for fuel cycle research and development (FCR&D) and has some similarities to “inert-matrix” fuels that are of interest in GEN-IV advanced reactor design. Two additional evaluations were revised to include additional evaluated experimental data, in support of light water reactor (LWR) and heavy water reactor (HWR) research; these include reactor physics experiments at Brazil’s IPEN/MB-01 Research Reactor Facility and the French High Flux Reactor (RHF), respectively. The IRPhEP Handbook now includes data from 45 experimental series (representing 24 reactor facilities) and represents contributions from 15 countries. These experimental measurements represent large investments of infrastructure, experience, and cost that have been evaluated and preserved as benchmarks for the validation of methods and collection of data in support of current and future reactor design and development.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Advancements in NEAMS Tool Capabilities for Multiphysics Simulation of Fast Reactor Core Bowing and Identification of Validation Test Data

Under the U.S. Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program, an integrated multiphysics approach is being developed to model the core bowing phenomena important to liquid metal-cooled fast reactors. Core bowing is an important passive safety mechanism in liquid metal-cooled fast reactors and involves Multiphysics effects including radiation transport, fluid flow, heat transfer, and mechanical response to temperature and flux gradients. This report summarizes recent progress on developing a multiphysics, MOOSE-based workflow to predict core bowing and associated reactivity feedback. Last year, thermal fluids and mechanics were coupled on a multi-assembly benchmark problem based on ABR-1000 design. This year, the reactor physics code Griffin was assessed for readiness of core bowing calculations. Preliminary integration of Griffin’s ring-heterogeneous model with thermal fluids and thermal mechanics solvers was performed. Specifically, thermal-mechanics and reactor physics were coupled for single- and multi-assembly problems, and reactor physics and subchannel methods were coupled for a single assembly model. Finally, the workflow of all three physics was preliminarily demonstrated on a single assembly model. Caveats and future development needed have been identified. To supplement the multiphysics demonstration, verification and assessment efforts of thermos-mechanical capabilities for modeling thermo-mechanical core bowing behavior were continued by analyzing IAEA Verification Problem 5 which includes radiation swelling and creep. Additionally, a small core reactor physics benchmark defined by Japan Atomic Energy Agency (JAEA) was performed to assess neutronics models for estimating reactivity feedback. Finally, Fast Flux Test Facility (FFTF) validation test data for core bowing phenomena has been identified and summarized, with a recommended path forward for validation once this capability is mature.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Chapter 2: Evaluating a Concentrating Solar Power Plantas an Extended-Duration Peaking Resource

We explore the ability of a concentrating solar power (CSP) plant with thermal energy storage (TES) to provide peaking capacity. We focus on future power systems, wherein net load patterns may be significantly different than they are today (e.g., due to higher renewable-energy penetrations). We examine 28 locations in the southwestern United States over an 18-year period. The hourly operation of the CSP plants are simulated to determine their potential to provide energy during an eight-hour peak-load window for each day up to 365 days per year. Our result shows that for the large majority of locations and years, CSP plants with certain configurations (i.e., in terms of solar field and TES sizes) can provide nearly 100% peak-load capacity. We examine also the amount of supplemental energy (e.g.,by using natural gas as a supplemental thermal-energy source) that would be required to ensure that a CSP plant could serve the eight highest-load hours of every day of the year. We find that in most cases, a CSP plant supplemented with natural gas would require less than 5% of the fuel that is used by a natural-gas fired power plant providing the same level of reliable capacity. A series of sensitivity analyses show that these results are robust to the number of peak-load hours and days that are considered and the configuration of the CSP plant.

capacity value↗