Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

A curated benchmark for cofolding models on kinase conformational states

Abstract Protein kinases are critical drug targets, requiring therapeutics that can modulate their active and inactive conformational states. While cofolding models can generate global folds directly from kinase sequences and ligand SMILES strings, these models have not yet been tested on their ability to recover ligand-induced-fit conformational states of the kinase proteins. Here, we introduce KinConfBench, a curated benchmark of 2225 high-quality human kinase chains to evaluate the ability of four state-of-the-art cofolding models—Boltz-2, Chai-1, Protenix, and RoseTTAFold-All-Atom—to recover both canonical and rare conformational states. We show that geometric success metrics of a ligand pose in the active site do not correlate strongly with the correct kinase conformational state, motivating a new set of dynamical benchmarks for assessing cofolding models. While all four cofolding models achieve ~60–80% prediction accuracy for kinase conformational classification, they exhibit severe mode collapse when performing multiple inferences, show negligible structural diversity in sampling induced-fit motions, and display a prevalent “apo-drift” in which most cofolding models predominantly predict the kinase to be in its ligand-free state. Our results highlight that capturing ligand-induced protein conformational diversity, not just geometric fit, is critical for next-generation structure-based drug discovery.

Sun, Kunyang↗

Dosimetric validation of Acuros XB with Monte Carlo methods for photon dose calculations

Purpose: The dosimetric accuracy of the recently released Acuros XB advanced dose calculation algorithm (Varian Medical Systems, Palo Alto, CA) is investigated for single radiation fields incident on homogeneous and heterogeneous geometries, and a comparison is made to the analytical anisotropic algorithm (AAA). Methods: Ion chamber measurements for the 6 and 18 MV beams within a range of field sizes (from 4.0x4.0 to 30.0x30.0 cm{sup 2}) are used to validate Acuros XB dose calculations within a unit density phantom. The dosimetric accuracy of Acuros XB in the presence of lung, low-density lung, air, and bone is determined using BEAMnrc/DOSXYZnrc calculations as a benchmark. Calculations using the AAA are included for reference to a current superposition/convolution standard. Results: Basic open field tests in a homogeneous phantom reveal an Acuros XB agreement with measurement to within {+-}1.9% in the inner field region for all field sizes and energies. Calculations on a heterogeneous interface phantom were found to agree with Monte Carlo calculations to within {+-}2.0%({sigma}{sub MC}=0.8%) in lung ({rho}=0.24 g cm{sup -3}) and within {+-}2.9%({sigma}{sub MC}=0.8%) in low-density lung ({rho}=0.1 g cm{sup -3}). In comparison, differences of up to 10.2% and 17.5% in lung and low-density lung were observed in the equivalent AAA calculations. Acuros XB dose calculations performed on a phantom containing an air cavity ({rho}=0.001 g cm{sup -3}) were found to be within the range of {+-}1.5% to {+-}4.5% of the BEAMnrc/DOSXYZnrc calculated benchmark ({sigma}{sub MC}=0.8%) in the tissue above and below the air cavity. A comparison of Acuros XB dose calculations performed on a lung CT dataset with a BEAMnrc/DOSXYZnrc benchmark shows agreement within {+-}2%/2mm and indicates that the remaining differences are primarily a result of differences in physical material assignments within a CT dataset. Conclusions: By considering the fundamental particle interactions in matter based on theoretical interaction cross sections, the Acuros XB algorithm is capable of modeling radiotherapy dose deposition with accuracy only previously achievable with Monte Carlo techniques.

60 APPLIED LIFE SCIENCES↗

Further Investigation of Surface Velocity Measurements for Material Characterization in Laser Shockwave Experiments

Further investigation of surface velocity measurements for material characterization in laser shockwave experiments James A. Smith, Jeffrey M. Lacy, Clark L. Scott, Bradley C. Benefiel Idaho National Laboratory, Idaho Falls ID Daniel Levesque, Jean-Pierre Monchalin and Martin Lord, National Research Council Canada, Boucherville, QC, Canada ---As part of the US High Performance Research Reactor program, a laser shockwave system is being developed by the Idaho National Laboratory (INL) to characterize interface strength in innovative plate fuel for research reactors around the world. The INL has been working with National Research Council Canada (NRC) on this project for the last five years. One of the concerns is the difficulty of calibrating and standardizing the laser shock technique. The generation of a stress wave by the laser impinging on the plate surface is dependent on the surface preparation, temporal and spatial power distribution of the laser spot, and material properties of the plate. Thus the resulting back surface velocity used to measure the time-varying stress field within the plate is difficult to reproduce across different measurement systems. ---A recent analytical study and testing support the use of the Hugoniot Elastic Limit (HEL) in materials as a robust and simple benchmark to compare stresses generated by different laser shock systems [1]. Using a non-contact laser velocimeter based on a solid Fabry-Perot etalon, the systems at NRC and INL showed that the velocity reached at the HEL is consistent, independent of the laser power used. In this work, the laser velocimeter of the NRC system is tested against a fast rotating wheel to verify accuracy and determine best operating conditions. A round robin test between the two laser shock systems on plates of different Al alloys is presented that shows the correct classification of the Al alloys based on the HEL as well as determining the bias between the systems. Also the effects of some setup parameters on other characteristics of the surface velocity and corresponding stress wave are discussed. 1. J.A. Smith, J.M. Lacy, D. Levesque, J.-P. Monchalin and M. Lord, "Use of the Hugoniot elastic limit in laser shockwave experiments to relate velocity measurements, 42nd Annual Review of Progress in Quantitative Nondestructive Evaluation, AIP Conf. Proc. 1706, pp. 080005-1-080005-10, 2016.

36 MATERIALS SCIENCE↗

Development and Testing of an UltraBattery-Equipped Honda Civic Hybrid

The UltraBattery Retrofit Project DP1.8 and Carbon Enriched Project C3, performed by ECOtality North America (ECOtality) and funded by the U.S. Department of Energy and the Advanced Lead Acid Battery Consortium (ALABC), are established to demonstrate the suitability of advanced lead battery technology in hybrid electrical vehicles (HEVs). A profile, termed the “Simulated Honda Civic HEV Profile” (SHCHEVP) has been developed in Project DP1.8 in order to provide reproducible laboratory evaluations of different battery types under real-world HEV conditions. The cycle is based on the Urban Dynamometer Driving Schedule and Highway Fuel Economy Test cycles and simulates operation of a battery pack in a Honda Civic HEV. One pass through the SHCHEVP takes 2,140 seconds and simulates 17.7 miles of driving. A complete nickel metal hydride (NiMH) battery pack was removed from a Honda Civic HEV and operated under SHCHEVP to validate the profile. The voltage behavior and energy balance of the battery during this operation was virtually the same as that displayed by the battery when in the Honda Civic operating on the dynamometer under the Urban Dynamometer Driving Schedule and Highway Fuel Economy Test cycles, thus confirming the efficacy of the simulated profile. An important objective of the project has been to benchmark the performance of the UltraBatteries manufactured by both Furukawa Battery Co., Ltd., Japan (Furakawa) and East Penn Manufacturing Co., Inc. (East Penn). Accordingly, UltraBattery packs from both Furakawa and East Penn have been characterized under a range of conditions. Resistance measurements and capacity tests at various rates show that both battery types are very similar in performance. Both technologies, as well as a standard lead-acid module (included for baseline data), were evaluated under a simple HEV screening test. Both Furakawa and East Penn UltraBattery packs operated for over 32,000 HEV cycles, with minimal loss in performance; whereas the standard lead-acid unit experienced significant degradation after only 6,273 cycles. The high-carbon, ALABC battery manufactured in Project C3 also was tested under the advanced HEV schedule. Its performance was significantly better than the standard lead-acid unit, but was still inferior compared with the UltraBattery. The batteries supplied by Exide as part of the C3 Project performed well under the HEV screening test, especially at high temperatures. The results suggest that higher operating temperatures may improve the performance of lead-acid-based technologies operated under HEV conditions—it is recommended that life studies be conducted on these technologies under such conditions.

25 ENERGY STORAGE↗

Temperature effects of resonance scattering for epithermal neutrons in MCNP

Epithermal neutron elastic scattering can be significantly affected by the thermal motion of target nuclides. Since the 1950's continuous-energy Monte Carlo codes have generally accounted for the target motion using a free gas scattering model, with the assumption that the scattering cross-section is constant in energy. Recent work has shown the importance of resonance scattering, and several methods for an improved free-gas treatment have been developed. We have implemented a rejection-based sampling scheme in the MCNP free-gas treatment to account for cross-section variation. The modified MCNP code was used to investigate a number of practical concerns: results for an LWR Doppler defect benchmark; computational costs; and energy limits for the free-gas treatment. Additionally, the impact on a suite of ICSBEP criticality benchmark problems (at room temperature) was determined to be negligible, an important result since such problems are used extensively in testing and evaluating revisions to ENDF/B-VII nuclear data. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking the completely renormalised equation-of-motion coupled-cluster approaches for vertical excitation energies

When vertical energies are excited for a comprehensive test set of about 150 singlet excited states of 28 medium-sized organic molecules computed using two variants of the completely renormalised (CR) equation-of-motion (EOM) coupled-cluster (CC) method with singles, doubles, and non-iterative triples, abbreviated as δ-CR-EOMCCSD(T), and the analogous two variants of the newer, left-eigenstate δ-CR-EOMCC(2,3) approach are benchmarked against the previously published CASPT2, CC3, and EOMCCSDT-3 results, as well as the suggested theoretical best estimate (TBE) values. The δ-CR-EOMCC approaches are also used to identify and characterise about 50 additional excited states, including several states having substantial two-electron excitation components, which have not been found in the previous work and which can be used in future benchmark studies. We demonstrated that the non-iterative triples corrections to the EOMCCSD excitation energies defining the relatively inexpensive, single-reference, black-box δ-CR-EOMCC approaches provide significant improvements in the EOMCCSD data, while closely matching the results of the iterative and considerably more expensive CC3 and EOMCCSDT-3 calculations and their CASPT2 and TBE counterparts. It is also shown that the δ-CR-EOMCC methods, especially δ-CR-EOMCC(2,3), are capable of bringing the results of the CC3 and EOMCCSDT-3 calculations to a closer agreement with the CASPT2 and TBE data, demonstrating the utility of the cost-effective δ-CR-EOMCC methods in applications involving molecular electronic spectra. Finally, we show that there may exist a relationship between the magnitude of the triples corrections defining δ-CR-EOMCC approaches and the reduced excitation level diagnostic resulting from EOMCCSD.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

High-accuracy Geant4 simulation and semi-analytical modeling of nuclear resonance fluorescence

Nuclear resonance fluorescence (NRF) is a photonuclear interaction that enables highly isotope-specific measurements in both pure and applied physics scenarios. High-accuracy design and analysis of NRF measurements in complex geometries is aided by Monte Carlo simulations of photon physics and transport, motivating Jordan and Warren (2007) to develop the G4NRF codebase for NRF simulation in Geant4. In this work, we enhance the physics accuracy of the G4NRF code and perform improved benchmarking simulations. The NRF cross section calculation in G4NRF, previously a Gaussian approximation, has been replaced with a full numerical integration for improved accuracy in thick-target scenarios. A high-accuracy semi-analytical model of expected NRF count rates in a typical NRF measurement is then constructed and compared against G4NRF simulations for both simple homogeneous and more complex heterogeneous geometries. Furthermore, agreement between rates predicted by the semi-analytical model and G4NRF simulation is found at a level of ~1% in simple test cases and ~3% in more realistic scenarios, improving upon the ~20% level of the initial benchmarking study and establishing a highly-accurate NRF framework for Geant4.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MUSiC: Critical Experiment with Bare Highly Enriched Uranium Shells Benchmark

The measurements of the Uranium Subcritical and Critical (MUSiC) experiment were performed from December 2020 through April 2021. The purpose of the experiment was to test a variety of multiplicity detection systems for a large range of multiplication values and to see how well they perform as the k eff of the MUSiC series of experiments approached the delayed critical window. Out of the ten configurations that were studied, two of them were super critical and were recently approved as benchmarks and they will be included in the International Criticality Safety Benchmark Evaluation Project (ICBESP) handbook. For each of the two experiments, uncertainties were evaluated six categories: (1) critical measurement, (2) mass, (3) composition, (4) positioning, (5) dimensions, and (6) temperature. The largest contribution to the overall uncertainty in each of the cases was due to the uncertainties in the dimensions of the HEU Rocky Flats shells. Simplified detailed models were created with an average bias of -130.5 pcm due to the removal various components surrounding the experiment. For MCNP6.2 models using ENDF-VIII.0 neutron cross section data, the average difference between the calculated and benchmark k effs was -54 pcm for the detailed model and -102 pcm for the simplified model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Semiclassical propagation of Wigner functions

We present a comprehensive study of semiclassical phase-space propagation in the Wigner representation, emphasizing numerical applications, in particular as an initial-value representation. Two semiclassical approximation schemes are discussed. The propagator of the Wigner function based on van Vleck's approximation replaces the Liouville propagator by a quantum spot with an oscillatory pattern reflecting the interference between pairs of classical trajectories. Employing phase-space path integration instead, caustics in the quantum spot are resolved in terms of Airy functions. We apply both to two benchmark models of nonlinear molecular potentials, the Morse oscillator and the quartic double well, to test them in standard tasks such as computing autocorrelation functions and propagating coherent states. The performance of semiclassical Wigner propagation is very good even in the presence of marked quantum effects, e.g., in coherent tunneling and in propagating Schroedinger cat states, and of classical chaos in four-dimensional phase space. We suggest options for an effective numerical implementation of our method and for integrating it in Monte-Carlo-Metropolis algorithms suitable for high-dimensional systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Rocky Flats Neutron Detector Testing at Valduc, France

Recent program requirements of the US Department of Energy/NNSA have led to a need for a criticality accident alarm system to be installed at a newly activated facility. The Criticality Safety Group of the Lawrence Livermore National Laboratory (LLNL) was able to recover and store for possible future use approximately 200 neutron criticality detectors and 20 master alarm panels from the former Rocky Flats Plant in Golden, Colorado when the plant was closed. The Criticality Safety Group participated in a facility analysis and evaluation, the engineering design and review process, as well as the refurbishment, testing, and recalibration of the Rocky Flats criticality alarm system equipment to be used in the new facility. In order to demonstrate the functionality and survivability of the neutron detectors to the effects of an actual criticality accident, neutron detector testing was performed at the French CEA Valduc SILENE reactor from October 7 to October 19, 2010. The neutron detectors were exposed to three criticality events or pulses generated by the SILENE reactor. The first excursion was performed with a bare or unshielded reactor, and the second excursion was made with a lead shielded/reflected reactor, and the third excursion with a polyethylene reflected core. These tests of the Rocky Flats neutron detectors were performed as a part of the 2010 Criticality Accident Alarm System Benchmark Measurements at the SILENE Reactor. The principal investigators for this series of experiments were Thomas M. Miller and John C. Wagner of the Oak Ridge National Laboratory, with Nicolas Authier and Nathalie Baclet of CEA Valduc. Several other organizations were also represented, including the Y-12 National Security Complex, Lawrence Livermore National Laboratory, Los Alamos National Laboratory, CEA Saclay, and Babcock International Group.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Computational Fluid Dynamics Analysis of Very High Temperature Gas-Cooled Reactor Cavity Cooling System

The design of passive heat removal systems is one of the main concerns for the modular very high temperature gas-cooled reactors (VHTR) vessel cavity. The reactor cavity cooling system (RCCS) is a key heat removal system during normal and off-normal conditions. The design and validation of the RCCS is necessary to demonstrate that VHTRs can survive to the postulated accidents. The computational fluid dynamics (CFD) STAR-CCM+/V3.06.006 code was used for three-dimensional system modeling and analysis of the RCCS. A CFD model was developed to analyze heat exchange in the RCCS. The model incorporates a 180-deg section resembling the VHTR RCCS experimentally reproduced in a laboratory-scale test facility at Texas A&M University. All the key features of the experimental facility were taken into account during the numerical simulations. The objective of the present work was to benchmark CFD tools against experimental data addressing the behavior of the RCCS following accident conditions. Two cooling fluids (i.e., water and air) were considered to test the capability of maintaining the RCCS concrete walls' temperature below design limits. Different temperature profiles at the reactor pressure vessel (RPV) wall obtained from the experimental facility were used as boundary conditions in the numerical analyses to simulate VHTR transient evolution during accident scenarios. Mesh convergence was achieved with an intensive parametric study of the two different cooling configurations and selected boundary conditions. To test the effect of turbulence modeling on the RCCS heat exchange, predictions using several different turbulence models and near-wall treatments were evaluated and compared. The comparison among the different turbulence models analyzed showed satisfactory agreement for the temperature distribution inside the RCCS cavity medium and at the standpipes walls. For such a complicated geometry and flow conditions, the tested turbulence models demonstrated that the realizable k-epsilon model with two-layer all y+ wall treatment performs better than the other k-epsilon and k-omega turbulence models when compared to the experimental results and the Reynolds stress transport turbulence model results. A scaling analysis was developed to address the distortions introduced by the CFD model in simulating the physical phenomena inside the RCCS system with respect to the full plant configuration. The scaling analysis demonstrated that both the experimental facility and the CFD model achieve a satisfactory resemblance of the main flow characteristics inside the RCCS cavity region, and convection and radiation heat exchange phenomena are properly scaled from the actual plant.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantum-Hardware Focused Application Performance Benchmarks (Final Technical Report)

Quantum computers promise to transform how we do scientific calculations. In this project, we benchmark different current quantum computers for solving chemistry problems and find ways to build noise-resilient implementations. We also use the characterization techniques developed to test ion trap quantum computers.

74 ATOMIC AND MOLECULAR PHYSICS↗

The PAC-MAN model: Benchmark case for linear acoustics in computational physics

Benchmark cases in the field of computational physics, on the one hand, have to contain a certain complexity to test numerical edge cases and, on the other hand, require the existence of an analytical solution, because an analytical solution allows the exact quantification of the accuracy of a numerical simulation method. This dilemma causes a need for analytical sound field formulations of complex acoustic problems. A well known example for such a benchmark case for harmonic linear acoustics is the “Cat's Eye model”, which describes the three-dimensional sound field radiated from a sphere with a missing octant analytically. In this paper, a benchmark case for two-dimensional (2D) harmonic linear acoustic problems, viz., the “PAC-MAN model”, is proposed. The PAC-MAN model describes the radiated and scattered sound field around an infinitely long cylinder with a cut out sector of variable angular width. While the analytical calculation of the 2D sound field allows different angular cut-out widths and arbitrarily positioned line sources, the computational cost associated with the solution of this problem is similar to a 1D problem because of a modal formulation of the sound field in the PAC-MAN model. - Highlights: • A benchmark case for 2D harmonic linear acoustic problems is proposed. • The PAC-MAN geometry is used as emitter/scatterer in this benchmark. • An analytic formulation of radiated and scattered sound is derived. • Line and disk sources, plane waves, and surface vibrations are considered.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Drive Cycles, Battery Pack Scaling, and Usage Considerations for Long-Haul and Regional-Haul Electric Trucks

Electrifying Class-8 heavy-duty trucks presents a promising opportunity to enhance energy efficiency and reduce freight transport costs. Battery electric trucks (BETs), once considered niche, are gaining traction due to advancements in battery technology and cost reductions. However, accurately predicting battery lifespan under realistic usage conditions remains a key challenge. Understanding battery failure mechanisms and their links to design, operation, and management is essential for developers and fleet operators. This study introduces a method to develop simplified, lab-testable dynamic stress test (DST) cycles for regional and long-haul Class-8 BETs, derived from real-world diesel truck usage. These DSTs enable benchmarking of battery technologies, identification of aging stressors, and optimization of battery design, life, and cost. The approach supports evaluation of key metrics such as levelized cost of driving and total cost of ownership, aiding fair comparisons and adoption decisions. We also propose feasible battery pack sizes that meet current driving demands with strategic charging, and a method to scale pack-level DSTs to cell-level cycles for lab-based testing. These tools facilitate tradeoff analysis across battery chemistries, pack sizing, and charging strategies, while offering means to get insights into battery aging under realistic conditions-ultimately supporting informed BET deployment decisions.

25 ENERGY STORAGE↗

Benchmark estimate of the effect of anthropogenic emissions on the ocean surface

Abstract Investigations into the role of anthropogenic emissions in the occurrence of extreme weather often use a method that compares simulations of atmospheric climate models run under a factual scenario of historical boundary conditions observed during the period of the event against simulations run under a counterfactual scenario of what those boundary conditions might naturally have been over that same period in the absence of anthropogenic emissions. A particular requirement for this experiment design is an accurate estimation of ocean surface boundary conditions for use by the counterfactual natural simulations. Here we use output from the CMIP5 multi‐climate‐model archive to develop a robust estimate of sea surface temperatures and sea ice conditions for use in counterfactual natural simulations, intended as a benchmark estimate to facilitate comparison across climate models and across studies. This development includes tests to ensure that the final estimate is stable from year‐to‐year and stable against other perturbations to the methodology, as well as consideration of the strengths and weaknesses in comparison to other available attributable warming estimates. While this estimate is tailored specifically for the International CLIVAR C20C+ Detection and Attribution Project, it can be used by related projects as well.

Stone, Dáithí A.↗

Reactive Transport Modeling with Physics-Informed Machine Learning for Critical Minerals Applications

This study presents a physics-informed neural network (PINN) framework for reactive transport modeling for simulating fast bimolecular reactions in porous media. Accurate characterization of cAhemical interactions and product formation in surface and subsurface environments is essential for advancing critical mineral extraction and related geoscience applications. The proposed methodology sequentially addresses the flow and diffusion–reaction subproblems. The flow field is computed using a mixed formulation, while the diffusion–reaction system is modeled via two uncoupled tensorial diffusion equations reformulated in terms of chemical invariants. PINNs are employed to solve the governing equations, enabling data-efficient, mesh-free prediction of chemical concentration fields. The framework is validated through a series of benchmark problems involving flow in heterogeneous porous media. Initial verification is conducted using patch tests for the flow field, followed by validation of the transport problem with emphasis on preserving non-negativity of concentrations. The complete fast bimolecular reaction scenario is then solved, yielding spatial distributions of reactants and product species. Results demonstrate that the PINNs-based approach effectively captures sharp, mixing-limited reaction fronts and dispersive mixing behavior, offering reliable predictions of reactive plume evolution. These capabilities are crucial for evaluating long-term subsurface behavior in applications such as fluid storage, energy extraction, and efficient extraction of critical minerals.

42 ENGINEERING↗

ENDF/B-VIII.0: The 8 th Major Release of the Nuclear Reaction Data Library with CIELO-project Cross Sections, New Standards and Thermal Scattering Data

We describe the new ENDF/B-VIII.0 evaluated nuclear reaction data library. ENDF/B-VIII.0 fully incorporates the new IAEA standards, includes improved thermal neutron scattering data and uses new evaluated data from the CIELO project for neutron reactions on 1 H, 16 O, 56 Fe, 235 U, 238 U and 239 Pu described in companion papers in the present issue of Nuclear Data Sheets. The evaluations benefit from recent experimental data obtained in the U.S. and Europe, and improvements in theory and simulation. Notable advances include updated evaluated data for light nuclei, structural materials, actinides, fission energy release, prompt fission neutron and γ-ray spectra, thermal neutron scattering data, and charged-particle reactions. Integral validation testing is shown for a wide range of criticality, reaction rate, and neutron transmission benchmarks. In general, integral validation performance of the library is improved relative to the previous ENDF/B-VII.1 library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗