Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Tests”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Modeling Multi-Step Organic Reactions: Can Density Functional Theory Deliver Misleading Chemistry?

Many organic reactions are characterized by a complex mechanism with a variety of transition states and intermediates of different chemical natures. Their correct and accurate theoretical characterization critically depends on the accuracy of the computational method used. In this work, we study a complex ambimodal cycloaddition with five transition states, two intermediates, and three products, and we ask whether density functional theory (DFT) can provide a correct description of this type of complex and multifaceted reaction. Our work fills a gap in that most systematic benchmarks of DFT for chemical reactions have considered much simpler reactions. Our results show that many density functionals not only lead to seriously large errors but also differ from one another in predicting whether the reaction is ambimodal. Only a few of the available functionals provide a balanced description of the complex and multifaceted reactions. The parameters varied in the tested functionals are the ingredients, the treatment of medium-range and nonlocal correlation energy, and the inclusion of Hartree–Fock exchange. Furthermore, these results show a clear need for more benchmarks on the mechanisms of large molecules in complex reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Disentangling the gap between pure and mixed-gas performance of thin film composite membranes through improved cell design and testing methods

Testing thin film composite (TFC) membrane coupons at low stage-cuts (≤5%) in a sweep-gas permeation system is a common practice to obtain mixed-gas separation properties for benchmarking performance and making scale-up decisions. However, even under these idealized conditions, mixed-gas permeance and selectivity can be more than 30% lower than their pure-gas values, partially due to concentration polarization, an effect that typically intensifies with increased membrane permeance. This study investigates the effect of cell design on mixed-gas testing using PolyActive TM TFC membranes with pure-gas CO 2 permeance of 1700 – 3100 gas permeance unit (GPU), covering the permeance range of most state-of-the-art CO 2 /N 2 separation membranes. Here, we designed and 3D-printed a counter-current permeation cell with enhanced feed and sweep flow efficiency, resulting in a 33 – 41% increase in mixed-gas CO 2 permeance compared to traditional permeation cells. Furthermore, we compared sweep-gas and vacuum permeation methods using traditional permeation cells, revealing that the latter delivers 41% higher mixed-gas CO 2 permeance, because vacuuming effectively minimizes the downstream concentration polarization. These findings highlight the importance of cell design and permeation apparatus selection in lab-scale mixed-gas testing, with strong implications for module design and process optimization at the industrial scale.

mixed gas performance↗
DOE OSTI2020

Leveraging operational information from wastewater injection wells to evaluate CO 2 injection performance for carbon storage applications in the Appalachian Basin

Abstract Geologic parameters, geophysical logging, injection testing, and operational metrics from wastewater injection wells were integrated to develop a preliminary design of a carbon storage facility in the Appalachian Basin. A scattered group of 10–20 commercial wastewater injection wells dispose off produced water from oil and gas wells in the region, utilizing a sequence of stacked deep saline formations for injection zones. These wastewater injection wells provide practical benchmarks for understanding the feasibility of carbon dioxide (CO 2 ) storage. Geologic models were developed based on characterization data from the wastewater injection wells. Reservoir simulations were calibrated according to injection testing and operational data from the wastewater injection wells. Long‐term operational data on injection flow rates and pressures measured in the wastewater injection wells were especially useful to evaluate the performance of carbon storage applications. The simulations were used to estimate injection pressures, radius of CO 2 saturation, and pressure response for industrial scale CO 2 storage applications. Results were also used to provide a design basis in terms of number of injection wells, well spacing, area of review, injection system components, monitoring plan, and CO 2 pipeline distribution system. The analysis demonstrates that there is sufficient injectivity in the deep saline formations in the west‐central Appalachian Basin to store commercial volumes of anthropogenic CO 2 . The geologic system appears suitable for supporting CO 2 injection rates of 0.5–1.0 million metric tons per year at injection pressures below formation fracture pressure in a single well. The long‐term operational data of wastewater injection wells within the study area suggested a lower permeability‐thickness values than indicated by initial reservoir tests. A workflow for developing realistic permeability values for input into reservoir simulations is presented. © 2020 Society of Chemical Industry and John Wiley & Sons, Ltd.

Valluri, Manoj↗
DOE OSTI2025

Adiabatic quantum support vector machines

Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with an increasing number of features and an increasing number of data points in the training dataset. In conclusion, our scalability results show that the quantum approach obtains a 3.5–4.5x speedup over the classical approach on datasets with many (millions of) features.

Computational Complexity↗
DOE OSTI2022

Dynamic signatures of electronically nonadiabatic coupling in sodium hydride: a rigorous test for the symmetric quasi-classical model applied to realistic, ab initio electronic states in the adiabatic representation

Sodium hydride (NaH) in the gas phase presents a seemingly simple electronic structure making it a potentially tractable system for the detailed investigation of nonadiabatic molecular dynamics from both computational and experimental standpoints. The single vibrational degree of freedom, as well as the strong nonadiabatic coupling that arises from the excited electronic states taking on considerable ionic character, provides a realistic chemical system to test the accuracy of quasi-classical methods to model population dynamics where the results are directly comparable against quantum mechanical benchmarks. Here, using a simulated pump–probe type experiment, this work presents computational predictions of population transfer through the avoided crossings of NaH via symmetric quasi-classical Meyer–Miller (SQC/MM), Ehrenfest, and exact quantum dynamics on realistic, ab initio potential energy surfaces. The main driving force for population transfer arises from the ground vibrational level of the D 1 Σ + adiabatic state that is embedded in the manifold of near-dissociation C 1 Σ + vibrational states. When coupled through a sharply localized first-order derivative coupling most of the population transfers between t = 15 and t = 30 fs depending on the initially excited vibronic wavepacket. While quantum mechanical effects are expected due to the reduced mass of NaH, predictions of the population dynamics from both the SQC/MM and Ehrenfest models perform remarkably well against the quantum dynamics benchmark. Additionally, an analysis of the vibronic structure in the nonadiabatically coupled regime is presented using a variational eigensolver methodology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Superconducting Qubits Underground

Superconducting qubit devices are highly sensitive to cosmic ray induced quasiparticle poisoning—a challenge for quantum computing. At Fermilab, we utilize an underground testbed called QUIET that significantly decreases the rate of such events. We employ an open-source toolchain, including Qiskit Metal and the SQuADDs library, for device design and simulation prior to fabrication. We then test these chips in QUIET, which is capable of housing many chips, enabling tests of scalability. This presentation will cover our qubit design approach, fabrication capabilities, and first measurements from qubits deployed in QUIET, benchmarking the new facility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗
DOE OSTI2021

EXPERIMENTAL STUDIES OF NONLINEAR INTEGRABLE OPTICS

State-of-the-art accelerators at energy and intensity frontiers require increasingly bright and powerful particle beams. In conventional linear lattices, intense beams suffer from collective instabilities, resulting in beam losses and maximum beam intensity limits. This thesis presents experimental studies of a novel lattice design concept, the nonlinear integrable optics (NIO), aimed at enhancing beam stability limits with little to no beam dynamics degradation. Single-particle beam dynamics measurements of two NIO devices, the quasi-integrable octupole system and the fully integrable Danilov-Nagaitsev system, were carried out at the purpose-built Integrable Optics Test Accelerator (IOTA) at Fermilab. Their simulation, hardware design, and commissioning process are presented. Extensive model and analysis algorithm development and benchmarking is described. Electron beam data from two scientific runs is analyzed, yielding frequency and phase space dynamics consisten t with m odels. These results demonstrate viability and advantages of the NIO design, providing the groundwork for proton studies in the strong space-charge regime and future integrable accelerators.

Kuklev, Nikita↗
DOE OSTI2024

Assessment of the CTF subchannel code for modeling a large-break loss-of-coolant accident reflood transient

With increased industry interest in extending reactor operating cycles, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program has been investigating the behavior of high-burnup fuel during design basis accidents such as the large-break loss-of-coolant accident (LBLOCA) with consideration for risk of fuel fragmentation, relocation, and dispersal (FFRD). As part of that activity, the NEAMS subchannel thermal/ hydraulics (T/H) code, CTF, is being used for modeling of LBLOCA and to determine the impact of subchannel resolution on results. Although CTF includes a wide range of models for LBLOCA conditions, the code has not been used for this application while maintained at Oak Ridge National Laboratory (ORNL) until now. Therefore, here, in this work, a preliminary assessment of several of these models was performed using openly available reflood experimental data from the Flooding Experiments in Blocked Arrays (FEBA) tests. One coarse mesh and one fine mesh model were set up in CTF for high and low flooding rate tests performed in the unblocked FEBA facility. A coarse TRACE model was set up to be as consistent as possible with the coarse CTF model to allow for code-to-code benchmarking. The assessment shows a tendency of the codes to over-predict peak cladding temperature (PCT) near the top of the bundle and to quench early. Advanced spacer grid models were shown to improve upper bundle predictions in CTF. The resolved CTF model over-predicted PCT by a larger degree in the center channels in the low-flooding rate test, and it is believed that the radiative heat transfer model, which was not used in this study, may be needed to correct this over-prediction. Finally, this work demonstrates the importance of the droplet model in determining quench time and vapor temperature and PCT prediction, which necessitates a more in-depth validation of these models in the future.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Simulation of the BEAVRS benchmark using VERA

The Virtual Environment for Reactor Applications (VERA) is being developed by the Consortium for the Advanced Simulation of Light Water Reactors (CASL). Here, VERA is used to perform the Benchmark for Evaluation and Validation of Reactor Simulations (BEAVRS), which provides two cycles’ worth of operating power history, along with a full, detailed description of the geometry, and measured data. Cycle 1 and 2 are simulated with VERA and the results are compared to the measured zero power physics tests, critical boron concentration, and flux maps.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

IER 516 - Zirconium Test Assembly (ZTA) Preliminary Experimental Design [Slides]

Zirconium present in large quantities in criticality safety applications such as fuel manufacturing and processing facilities, and in commercial thermal nuclear reactors. ICSBEP lacks benchmarks optimized for zirconium sensitivity to validate zirconium evaluations. Evaluators lack isotopic differential nuclear data in regions of high importance to fission systems.

K-PSO 2.0↗
DOE OSTI2023

HamLib: A Library of Hamiltonians for Benchmarking Quantum Algorithms and Hardware

For a considerable time, large datasets containing problem instances have proven valuable for analyzing computer hardware, software, and algorithms. One notable example of the value of large datasets is ImageNet [1], a vast repository of images that has been instrumental in testing numerous deep learning packages. Similarly, in the domain of computational chemistry and materials science, the availability of extensive datasets such as the Protein Data Bank [2], the Materials Project [3], and QM9 [4] has greatly facilitated the evaluation of new algorithms and software approaches, while also promoting standardization within the field. These well-defined datasets and problem instances, in turn, serve as the foundation for creating benchmarking suites like MLPerf [5] and LINPACK [6], [7]. These suites enable fair and rigorous comparisons of different methodologies and solutions, fostering continuous advancements in various areas of computer science and beyond.

Sawaya, Nicolas PD↗
DOE OSTI2021

MULTIPHYSICS-MODELING OF FIRE-INDUCED URANIUM AEROSOL FORMATION – A-POSTERIORI BENCHMARKING OF EXPERIMENTS

The formulation and solution of a model that properly described the temperature profiles of uranium in fire conditions was prepared, verified and validated, to support a-posteriori benchmarking of historical experiments. Data from the multi-physics model combined with data regression from the experiments provides a useful tool for exploring sources of potential bias in historical experiments. The approaches used are augmented by visual observations and photographic evidence allowing for correlations between various phenomena, independent of whether or not that specific phenomena are part of the validated model. In this manner, the validated model is a tool for a-posteriori benchmarking, and not a model designed to replicate the experimental output exactly for any specific experiment. For experiments like the Clark (2015) experiments, this integrated model (including chemistry) demonstrated that the largest bias was associated in the metallurgy of the coupons. The model developed does serve as a basis for defending which of the historical alloys tested are the most appropriate for any other alloy being considered (e.g., one that has not yet been tested). The model identifies key reactions that impact uranium chemistry and can significantly bias experimental results. Through use of the model and energy balances, data from historical experiments by Elder and Tinkle (1980) were regressed and benchmarked. This study identifies that all uranium alloys are not equal and that there are distinct differences between the dominant alloys representing distinct metallurgical phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

SMR safety through HTTF modeling and benchmark efforts for code validation for gas-cooled reactor applications

Accurate modeling and simulation tools for thermal-hydraulics calculations are a key element needed to design and license new advanced reactors including Small Modular Reactors (SMR) and Microreactors. Uncertainties in modeling and simulation can have significant safety and economic implications. The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is a scaled integral effects experiment designed to investigate transient behavior in high-temperature gas-cooled prismatic-block nuclear reactors. High-quality measurement data is available from the HTTF that is suitable for a thermal-hydraulics code validation benchmark for gas-cooled reactor simulations. Here, this paper summarizes individual HTTF modeling efforts to date for tool validation at Idaho National Laboratory (INL), Argonne National Laboratory (ANL), Oregon State University (OSU) and Canadian Nuclear Laboratories (CNL) using system thermal-hydraulics codes, Computational Fluid Dynamics (CFD) codes and system-CFD code couplings. Also, the paper introduces the ongoing OECD Nuclear Energy Agency (NEA) High Temperature Gas Reactor Thermal-Hydraulics (HTGR T/H) benchmark that allows for better comparisons of results between different international modeling teams. The benchmark provides well defined computational problems that include code-to-code comparisons and comparisons to measured data. These problems provide an avenue for quantifying accuracy and identifying sources of uncertainty in thermal-hydraulics calculations, including in measured thermophysical properties, as part of validation for gas-cooled reactor simulation tools.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2020

Fracture Strength Determination Methods for Ceramic Materials Applied to Uranium Dioxide

The Advanced Fuels Campaign is currently focusing on development of accident-tolerant fuels that possess a range of property modifications intended to improve fuel performance during accident and transient conditions as well as extend license limits to burnups beyond 62 MWd/kgU. Both of these drivers have identified understanding and mitigating fuel cracking as a key performance criterion. Small-scale cantilever beam testing has been identified as a plausible method by which to collect fracture data for UO 2 as a function of chemical and structural evolutions introduced either during fabrication or irradiation. While this method has been found to be capable of providing data that are in reasonable agreement with literature for unirradiated UO 2 , the inherently small sample volumes that can be sampled limit its ability to capture the statistical nature of mechanisms that govern the fracture of brittle ceramics. A biaxial flexure strength test was developed to be used for unirradiated UO 2 . This method is standard in the community, but no systems presently in use at national laboratories, universities, or private companies are available to be used for nuclear fuel materials. This report describes the operation and benchmarking of this system, which has been validated for a number of common oxides. Future work will extend this system to characterization of both doped UO 2 and other relevant microstructural modifications that can also be measured using small-scale cantilever beam testing. Comparison of datasets collected using both methods will allow the overall applicability of small-scale techniques to be assessed and provide confidence or bounds on their use for irradiated fuels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Asynchronous GPU-based DEM solver embedded in commercial CFD software with polyhedral mesh support

A novel graphical processing unit-based discrete element method solver is introduced to improve stability, performance, and provide seamless integration into commercial or open-source computational fluid dynamics software. A key innovation is eliminating a need for network communication between solvers, which was previously required for cross-platform coupling. This is accomplished by a direct coupling method that employs dynamic-linked libraries. Furthermore, the solver optimizes memory usage by streamlining the particle-cell search algorithm by eliminating the cells' searching grid. This ensures the solver is compatible with a wide range of mesh types, providing high geometric flexibility. The approach simplifies the simulation process by directly incorporating computational fluid dynamics mesh information into the discrete element method solver. The performance analysis indicates about sixteen times boost in computational speed compared to benchmark central processing unit-based solvers. Finally, the solver's compatibility with polyhedral meshes, a vital advantage for complex geometries, is tested against a referenced study regarding the simulation of an immersed-tube fluidized bed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗