Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Development of cone-wedge-ring-expansion test to evaluate the tensile HOOP properties of nuclear fuel cladding

Here, we report the development of a cone wedge ring expansion test method to determine the tensile hoop properties of irradiated nuclear fuel cladding in a hot cell. A closed-form solution was developed to explicitly relate the hoop stress σ θ to the axial piston loading using the scale factor χ and the shear stress correction factor α, where the χ and α factors are used to convert the applied piston load and the radial dilatation of the ring into the tensile hoop stress-strain curve. The applicability of this new test method was demonstrated by successfully evaluating ring specimens of Zr-4 alloy to failure. The ring specimens deformed uniformly in the axial and circumferential directions until onset of necking. The χ and α factors were successfully determined by using a finite-element stress analysis that benchmarked with applied test load and total work to account for frictional forces and the associated energies dissipation between the different sliding components of the testing system. The tensile hoop strength values obtained using the proposed cone-wedge-ring-expansion test method were 10% higher than values obtained from the tensile evaluation of the cladding material along the axial direction. In conclusion, the variability in results was found to be within the range reported in the literature.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

MS25: Materials Science-Focused Benchmark Data Set for Machine Learning Interatomic Potentials

Here, we present MS25, a benchmark data set for evaluating machine learning interatomic potentials (MLIPs) across diverse materials-relevant systems including MgO surfaces, liquid water, zeolites, a catalytic Pt surface reaction, high-entropy alloys (HEAs), and disordered Zr-oxides. Five MLIP architectures (MACE, NequIP, Allegro, MTP, and Torch-ANI) are trained and tested, focusing not only on traditional metrics (energies, forces, and stresses) but also explicitly validating derived physical observables such as lattice constants, volumes, and reaction barriers. We find that most models reach comparable accuracy on standard error metrics across the simple systems, although equivariant MLIPs offer 1.5–2× improvements over nonequivariant MLIPs in energy and force error for structurally complex or compositionally disordered environments such as HEAs and Zr–O systems. Our analysis highlights that low errors in energy and force predictions do not guarantee reliable observables, emphasizing the necessity of explicit validation. We demonstrate limitations in cross-framework transferability, as models trained on one zeolite framework (CHA) fail to reliably generalize to predictions of structurally distinct frameworks (e.g., MFI). Size-extensive tests show some dependence on system size for MgO, resulting from forced periodicity. The HEA and Zr–O data sets are identified as challenging tests for future benchmarks and MLIP model architecture developments as they show significant differentiation in error between MLIP architectures and are still relatively difficult at 1000 training images. Moving forward, we recommend that benchmarking efforts shift their focus from marginal accuracy improvements in energy and force errors toward identifying and understanding model failure modes, rigorously assessing transferability, and evaluating how their errors affect observable predictions. For researchers looking to choose an MLIP architecture, we suggest selecting equivariant MLIP architectures if the complexity of the system is a challenge. For simple materials problems, auxiliary features such as integration with molecular dynamics engines, trade-offs between computational data set generation cost vs MLIP inference speed, and framework integration may play a more important decision factor than small differences in error metrics that are unlikely to matter for production-level research.

chemical structure↗

Assessment of four strain energy decomposition methods for phase field fracture models using quasi-static and dynamic benchmark cases

Abstract Strain energy decomposition methods in phase field fracture models separate strain energy that contributes to fracture from that which does not. However, various decomposition methods have been proposed in the literature, and it can be difficult to determine an appropriate method for a given problem. The goal of this work is to facilitate the choice of strain decomposition method by assessing the performance of three existing methods (spectral decomposition of the stress or the strain and deviatoric decomposition of the strain) and one new method (deviatoric decomposition of the stress) with several benchmark problems. In each benchmark problem, we compare the performance of the four methods using both qualitative and quantitative metrics. In the first benchmark, we compare the predicted mechanical behavior of cracked material. We then use four quasi-static benchmark cases: a single edge notched tension test, a single edge notched shear test, a three-point bending test, and a L-shaped panel test. Finally, we use two dynamic benchmark cases: a dynamic tensile fracture test and a dynamic shear fracture test. All four methods perform well in tension, the two spectral methods perform better in compression and with mixed mode (though the stress spectral method performs the best), and all the methods show minor issues in at least one of the shear cases. In general, whether the strain or the stress is decomposed does not have a significant impact on the predicted behavior.

Zhang, Shuaifang↗

Combination of searches for heavy resonances decaying into bosonic and leptonic final states using 36 fb - 1 of proton-proton collision data at s = 13 TeV with the ATLAS detector

Searches for new heavy resonances decaying into different pairings of W, Z, or Higgs bosons, as well as directly into leptons, are presented using a data sample corresponding to 36.1 fb -1 of pp collisions at $ \sqrt{s}=13 $ TeV collected during 2015 and 2016 with the ATLAS detector at the CERN Large Hadron Collider. Analyses selecting bosonic decay modes in the qqqq, ννqq, ℓνqq, ℓℓqq, ℓνℓν, ℓℓνν, ℓνℓℓ, ℓℓℓℓ, qqbb, ννbb, ℓνbb, and ℓℓbb final states are combined, searching for a narrow-width resonance. Likewise, analyses selecting the leptonic ℓν and ℓℓ final states are also combined. These two sets of analyses are then further combined. No significant deviation from the Standard Model predictions is observed. Three benchmark models are tested: a model predicting the existence of a new heavy scalar singlet, a simplified model predicting a heavy vector-boson triplet, and a bulk Randall-Sundrum model with a heavy spin-2 Kaluza-Klein excitation of the graviton. Cross section limits are set at the 95% confidence level using an asymptotic approximation and are compared with predictions for the benchmark models. These limits are also expressed in terms of constraints on couplings of the heavy vector-boson triplet to quarks, leptons, and the Higgs boson. The data exclude a heavy vector-boson triplet with mass below 5.5 TeV in a weakly coupled scenario and 4.5 TeV in a strongly coupled scenario, as well as a Kaluza-Klein graviton with mass below 2.3 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Balance of Attraction and Repulsion in Nucleic-Acid Base Stacking: CCSD(T)/Complete-Basis-Set-Limit Calculations on Uracil Dimer and a Comparison with the Force-Field Description

We have carried out reference quantum-chemical calculations for about 100 geometries of the uracil dimer in stacked conformations. The calculations have been specifically aimed at geometries with unoptimized distances between the monomers including geometries with mutually tilted monomers. Such geometries are characterized by a delicate balance between local steric clashes and local unstacking and had until now not been investigated using reference quantummechanics (QM) methods. Nonparallel stacking geometries often occur in nucleic acids and are of decisive importance, for example, for local conformational variations in B-DNA. Errors in the shortrange repulsion region would have a major impact on potential energy scans which were often used in the past to investigate local geometry variations in DNA. An incorrect description of such geometries may also partially affect molecular dynamics (MD) simulations in applications when quantitative accuracy is required. The reference QM calculations have been carried out using the MP2 method extrapolated to the complete basis-set limit and corrected for higher-order electron-correlation contributions using CCSD(T) calculations with a medium-sized basis set. These reference calculations have been used as benchmark data to test the performance of the DFT-D, SCS(MI)-MP2, and DFTSAPT QM methods and of the AMBER molecular-mechanics (MM) force field. The QM methods show close to quantitative agreement with the reference data, albeit the DFT-D method tends to modestly exaggerate the repulsion of steric clashes. The force field in general also provides a good description of base stacking for the systems studied here. However, for geometries with close interatomic contacts and clashes, the repulsion effects are rather severely exaggerated. The discrepancy reported here should not affect the overall stability of MD simulations and qualitative applications of the force field. However, it may affect the description of subtle quantitative effects such as the local conformational variations in B-DNA. Preliminary calculations for two H-bonded uracil base pairs, including one with a C-H· · ·O H-bond, indicate excellent performance of the tested QM methods for all intermonomer distances. The force field, on the other hand, is less satisfactory, especially in the repulsive regions.

59 BASIC BIOLOGICAL SCIENCES↗

Call for Participation: Collaborative Benchmarking of Functional-Structural Root Architecture Models. The Case of Root Water Uptake

Three-dimensional models of root growth, architecture and function are becoming important tools that aid the design of agricultural management schemes and the selection of beneficial root traits. However, while benchmarking is common in many disciplines that use numerical models, such as natural and engineering sciences, functional-structural root architecture models have never been systematically compared. The following reasons might induce disagreement between the simulation results of different models: different representation of root growth, sink term of root water and solute uptake and representation of the rhizosphere. Presently, the extent of discrepancies is unknown, and a framework for quantitatively comparing functional-structural root architecture models is required. We propose, in a first step, to define benchmarking scenarios that test individual components of complex models: root architecture, water flow in soil and water flow in roots. While the latter two will focus mainly on comparing numerical aspects, the root architectural models have to be compared at a conceptual level as they generally differ in process representation. Therefore, defining common inputs that allow recreating reference root systems in all models will be a key challenge. In a second step, benchmarking scenarios for the coupled problems are defined. We expect that the results of step 1 will enable us to better interpret differences found in step 2. This benchmarking will result in a better understanding of the different models and contribute toward improving them. Improved models will allow us to simulate various scenarios with greater confidence and avoid bugs, numerical errors or conceptual misunderstandings. This work will set a standard for future model development.

Plant Sciences↗

SYNCA: A Synthetic Cyclotron Antenna for the Project 8 Collaboration

Cyclotron Radiation Emission Spectroscopy (CRES) is a technique for measuring the kinetic energy of charged particles through a precision measurement of the frequency of the cyclotron radiation generated by the particle's motion in a magnetic field. The Project 8 collaboration is developing a next-generation neutrino mass measurement experiment based on CRES. One approach is to use a phased antenna array, which surrounds a volume of tritium gas, to detect and measure the cyclotron radiation of the resulting β-decay electrons. To validate the feasibility of this method, Project 8 has designed a test stand to benchmark the performance of an antenna array at reconstructing signals that mimic those of genuine CRES events. To generate synthetic CRES events, a novel probe antenna has been developed, which emits radiation with characteristics similar to the cyclotron radiation produced by charged particles in magnetic fields. This paper outlines the design, construction, and characterization of this Synthetic Cyclotron Antenna (SYNCA). Furthermore, we perform a series of measurements that use the SYNCA to test the position reconstruction capabilities of the digital beamforming reconstruction technique. Finally, we find that the SYNCA produces radiation with characteristics closely matching those expected for cyclotron radiation and reproduces experimentally the phenomenology of digital beamforming simulations of true CRES signals.

47 OTHER INSTRUMENTATION↗

Building fault detection data to aid diagnostic algorithm creation and performance testing

It is estimated that approximately 4-5% of national energy consumption can be saved through corrections to existing commercial building controls infrastructure and resulting improvements to efficiency. Correspondingly, automated fault detection and diagnostics (FDD) algorithms are designed to identify the presence of operational faults and their root causes. A diversity of techniques is used for FDD spanning physical models, black box, and rule-based approaches. A persistent challenge has been the lack of common datasets and test methods to benchmark their performance accuracy. This article presents a first of its kind public dataset with ground-truth data on the presence and absence of building faults. This dataset spans a range of seasons and operational conditions and encompasses multiple building system types. It contains information on fault severity, as well as data points reflective of the measurements in building control systems that FDD algorithms typically have access to. The data were created using simulation models as well as experimental test facilities, and will be expanded over time.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development and evaluation of a variably saturated flow model in the global E3SM Land Model (ELM) version 1.0

Abstract. Improving global-scale model representations of near-surface soil moisture and groundwater hydrology is important for accurately simulating terrestrial processes and predicting climate change effects on water resources. Most existing land surface models, including the default E3SM Land Model (ELMv0), which we modify here, routinely employ different formulations for water transport in the vadose and phreatic zones. Clark et al. (2015) identified a variably saturated Richards equation flow model as an important capability for improving simulation of coupled soil moisture and shallow groundwater dynamics. In this work, we developed the Variably Saturated Flow Model (VSFM) in ELMv1 to unify the treatment of soil hydrologic processes in the unsaturated and saturated zones. VSFM was tested on three benchmark problems and results were evaluated against observations and an existing benchmark model (PFLOTRAN). The ELMv1-VSFM's subsurface drainage parameter, fd, was calibrated to match an observationally constrained and spatially explicit global water table depth (WTD) product. Optimal spatially explicit fd values were obtained for 79 % of global 1.9∘ × 2.5∘ grid cells, while the remaining 21 % of global grid cells had predicted WTD deeper than the observationally constrained estimate. Comparison with predictions using the default fd value demonstrated that calibration significantly improved predictions, primarily by allowing much deeper WTDs. Model evaluation using the International Land Model Benchmarking package (ILAMB) showed that improvements in WTD predictions did not degrade model skill for any other metrics. We evaluated the computational performance of the VSFM model and found that the model is about 30 % more expensive than the default ELMv0 with an optimal processor layout. The modular software design of VSFM not only provides flexibility to configure the model for a range of problem setups but also allows for building the model independently of the ELM code, thus enabling straightforward testing of the model's physics against other models.

58 GEOSCIENCES↗

Exactly energy conserving semi-implicit particle in cell formulation

We report a new particle in cell (PIC) method based on the semi-implicit approach. The novelty of the new method is that unlike any of its semi-implicit predecessors at the same time it retains the explicit computational cycle and conserves energy exactly. Recent research has presented fully implicit methods where energy conservation is obtained as part of a non-linear iteration procedure. The new method (referred to as Energy Conserving Semi-Implicit Method, ECSIM), instead, does not require any non-linear iteration and its computational cycle is similar to that of explicit PIC. The properties of the new method are: i) it conserves energy exactly to round-off for any time step or grid spacing; ii) it is unconditionally stable in time, freeing the user from the need to resolve the electron plasma frequency and allowing the user to select any desired time step; iii) it eliminates the constraint of the finite grid instability, allowing the user to select any desired resolution without being forced to resolve the Debye length; iv) the particle mover has a computational complexity identical to that of the explicit PIC, only the field solver has an increased computational cost. The new ECSIM is tested in a number of benchmarks where accuracy and computational performance are tested. - Highlights: • We present a new fully energy conserving semi-implicit particle in cell (PIC) method based on the implicit moment method (IMM). The new method is called Energy Conserving Implicit Moment Method (ECIMM). • The novelty of the new method is that unlike any of its predecessors at the same time it retains the explicit computational cycle and conserves energy exactly. • The new method is unconditionally stable in time, freeing the user from the need to resolve the electron plasma frequency. • The new method eliminates the constraint of the finite grid instability, allowing the user to select any desired resolution without being forced to resolve the Debye length. • These features are achieved at a reduced cost compared with either previous IMM or fully implicit implementation of PIC.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cryogenic Carbon Capture Development (Final Report)

This project extends and leverages the work completed under funding from ARPA-E and other sources by exploring aspects of the Cryogenic Carbon Capture™ (CCC) process and issues discovered during those projects, but that were not within the scope or budget of previous projects or that became apparent during field tests. Our successful completion of the tasks outlined in this project has increased the reliability, efficiency, and scalability of the CCC process and we are better prepared for pilot-scale testing. The first phase of this project improved key areas of the process through iterative design and experiment, culminating with recommendations for improvements to the existing skid-scale system developed under non-federal funding. The second phase of this project implemented the improved unit operations into the Cryogenic Carbon Capture External Cooling Loop (CCC ECL™) skid and field tests the improved system at a coal-fired power plant. The specific areas of work in this project are: Budget Period 1: 1) Selection of the most energy-efficient drying system for ambient-pressure flue gas. Sustainable Energy Solutions, LLC (SES) has successfully demonstrated a dryer that removes bulk water using a low-temperature brine to remove about 99% of the water followed by a mol sieve 3A desiccant dryer to remove the remaining 1% water; 2) Selection and demonstration of efficient solution to fouling due to dissolved CO 2 . SES has tested several commercial heat exchangers that purport to be able to handle fouling issues similar to those experienced in the contact liquid chiller. Replicated tests using the CCC ECL™ skid and dimpled brazed plate heat exchangers demonstrate that quick throttling of refrigerant combined with a burst of clean gas mitigate the fouling caused by CO 2 solubility in contact liquid with only minor increases in parasitic load. SES models indicate that parasitic load would increase by approximately 0.0125 GJ/tonne, an order of magnitude less than what was determined to be the maximum allowable additional parasitic load caused by this system; 3) Selection and demonstration of efficient and scalable solid–liquid separation system. The screw press technology met or exceeded the 70% solids loading benchmark during several test runs exceeding 24 hours on the CCC ECL™ skid. The average solids loading during the entire 50-hour run was 67%. The energy demand for this system is less than 0.1 GJ e /tonne of CO 2 processed; 4) Optimize design and demonstration of patented desublimating heat exchangers. We designed and built a hybrid spray tower that was tested over many hundreds of hours and a 50-hour continuous test run was completed capturing over 0.5 tonne CO 2 /day at >90% capture; (5) Plan for safe dilution of oxygen-depleted, cleaned flue-gas stream. The AERSCREEN simulator developed by the EPA modeled the dispersion of oxygen-depleted flue gas from the CCC process at a commercial plant. The results indicate that this plan effectively mitigates the flue gas hazards; (6) Simulation of and experimental work related to multi-pollutant capture. SES programmed an upgrade to its solid/vapor/liquid equilibrium (SVLE) algorithm. This enables simultaneous modeling of multiple pollutants (i.e., CO 2 , SO x , NO x , Hg, HCl). Budget Period 2; (7) Modify the CCC ECL™ skid for field testing and complete shakedown testing. The plans for modifying the CCC ECL™ skid were finalized and put into place. Shakedown testing of the updated CCC ECL™ skid occurred at SES using closed-loop mode (i.e., using a synthetic flue gas consisting of only N 2 and CO 2 ) and at the Hunter Power Plant using flue gas from the coal-fired boiler. Shakedown testing took longer than expected due to delays in receiving equipment and unexpected equipment performance in the field; (8) Operate the CCC ECL™ skid in the field. Longer testing of the CCC ECL™ skid occurred at the Hunter Power Plant. Multiple tests exceeding 35 hours were completed, with a total of over 600 hours of CO 2 capture completed using flue gas at the Hunter Power Plant with an average CO 2 capture rate of over 91% during those hours. Extensive notes and documentation were acquired informing improved methods for controls, startup, operation, and shut down; (9) Determine figures of merit and quantify process improvement. SES defined figures of merit for unit operation performance and overall CCC ECL™ process performance. All figures of merit were achieved or surpassed, except for 500 continuous hours of demonstration at the Hunter Power Plant; (10) Complete an Environmental Health and Safety Risk assessment by a third party. Tri-State completed an Environmental Health and Safety Risk assessment; (11) Update techno-economic analysis with third-party validation. The techno-economic analysis has been completed. It confirms the potential large reduction in energy and cost of the CCC process compared with leading alternatives and that the estimates and estimation techniques are reliable.

20 FOSSIL-FUELED POWER PLANTS↗

Development of Ultra-Fine Multigroup Cross Section Library of the AMPX/SCALE Code Packages

The Consortium for Advanced Simulation of Light Water Reactors Virtual Environment for Reactor Applications (VERA) neutronic simulator MPACT is being developed by Oak Ridge National Laboratory and the University of Michigan for various reactor applications. The MPACT and simplified MPACT 51- and 252-group cross section libraries have been developed for the MPACT neutron transport calculations by using the AMPX and Standardized Computer Analyses for Licensing Evaluations (SCALE) code packages developed at Oak Ridge National Laboratory. It has been noted that the conventional AMPX/SCALE procedure has limited applications for fast-spectrum systems such as boiling water reactor (BWR) fuels with very high void fractions and fast reactor fuels because of its poor accuracy in unresolved and fast energy regions. This lack of accuracy can introduce additional error sources to MPACT calculations, which is already limited by the Bondarenko approach for resolved resonance self-shielding calculation. To enhance the prediction accuracy of MPACT for fast-spectrum reactor analyses, the accuracy of the AMPX/SCALE code packages should be improved first. The purpose of this study is to identify the major problems of the AMPX/SCALE procedure in generating fast-spectrum cross sections and to devise ways to improve the accuracy. For this, various benchmark problems including a typical pressurized water reactor fuel, BWR fuels with various void fractions, and several fast reactor fuels were analyzed using the AMPX 252-group libraries. Isotopic reaction rates were determined by SCALE multigroup (MG) calculations and compared with continuous energy (CE) Monte Carlo calculation results. This reaction rate analysis revealed three main contributors to the observed differences in reactivity and reaction rates: (1) the limitation of the Bondarenko approach in coarse energy group structure, (2) the normalization issue of probability tables, and (3) neglect of the self-shielding effect of resonance-like cross sections at high energy range such as (n,p) cross section of Cl35. The first error source can be eliminated by an ultra-fine group (UFG) structure in which the broad scattering resonances of intermediate-weight nuclides can be represented accurately by a piecewise constant function. A UFG AMPX library was generated with modified probability tables and tested against various benchmark problems. The reactivity and reaction rates determined with the new UFG AMPX library agreed very well with respect to Monte Carlo Neutral Particle (MCNP) results. To enhance the lattice calculation accuracy without significantly increasing the computational time, performing the UFG lattice calculation in two steps was proposed. In the first step, a UFG slowing-down calculation is performed for the corresponding homogenized composition, and UFG cross sections are collapsed into an intermediate group structure. In the second step, the lattice calculation is performed for the intermediate group level using the condensed group cross sections. A preliminary test showed that the condensed library reproduces the results obtained with the UFG cross section library. This result suggests that the proposed two-step lattice calculation approach is a promising option to enhance the applicability of the AMPX/SCALE system to fast system analysis.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Discrete fracture network model benchmarks developed and applied in a DECOVALEX-2023 repository performance assessment study

This study presents newly developed benchmarks for modeling flow and transport within discrete fracture networks (DFNs) and useful methods for analyzing the results. The new benchmarks are designed to test modeling approaches for use in probabilistic performance assessment models of deep geologic repositories in fractured rock. The benchmarks simulate flow and transport through a 1 km 3 block of fractured rock. The first simulates migration of a short pulse of tracer through a simple network of four intersecting fractures. The second adds 1089 stochastically generated fractures. The third changes the pulse to a continuous point source. Evaluation of model performance relies on moment analysis and comparison of the results of different models. The expected nondimensional first moment of the conservative tracer for each benchmark is 1. The benchmarks were simulated by teams from Canada, Czechia, Germany, Korea, Sweden, Taiwan, and the United States as part of a DECOVALEX-2023 study (decovalex.org). The teams used various approaches, including explicit DFN modeling, DFN upscaling to an equivalent continuous porous medium (ECPM), and a combination of both methods. Transport mechanisms are modeled using either the advection-dispersion equation or particle tracking. Results demonstrate strong agreement among the models in breakthrough behavior up to the 75th percentile. Significant deviations in first moments and well-clustered outputs led to the identification of inaccuracies in several models. Such findings exemplify the benefit of exercising these benchmarks and using the presented methods to test DFN flow and transport models.

Benchmark↗

Advanced Data Structures for Improved Cyber Resilience and Awareness in Untrusted Environments: LDRD Report

This report summarizes the work performed under the project "Advanced Data Structures for Improved Cyber Resilience and Awareness in Untrusted Environments." The goal of the project was to design, analyze, and test new data structures for cybersecurity applications. We had two major thrusts: 1) using new/improved write-optimized data structures and/or algorithms to better man- age and analyze high-speed massive-volume cyberstreams, and 2) adding security features to data structures at minimum cost. Write optimization allows data structures to better use secondary memory to store and search a larger amount of useful information. Secondary memory is large compared to main memory, but data movement to and from secondary memory must be carefully managed to run quickly enough to keep up with fast streams. The first thrust included managing cyberstreams in parallel, both multi-threaded and distributed, and improving the benchmarking infrastructure for testing new streaming data structures. We considered both (near) real-time discovery of particular patterns, and improved logging for improved forensics. We considered two kinds of security-feature problem. The first was high-performance history- independent external-memory data structures. These provide certain protections to data if a disk is stolen. We also prove some trade-offs between speed and security in this setting. The second data-security problem is more secure data look-up in secret-shared data bases. This report summarizes the project's major accomplishments, with the background to under- stand these accomplishments. It gathers the abstracts and references for the six refereed publications that have appeared as part of this work. We summarize several accomplishments that will be submitted for publication. We then archive one piece of partial work that is not likely to be published in the near future: validation of history-independent data structure implementations.

97 MATHEMATICS AND COMPUTING↗

miniVite: A Graph Analytics Benchmarking Tool for Massively Parallel Systems

Benchmarking of high performance computing sys-tems can help provide critical insights for ef?cient design of computing systems and software applications. Although a large number of tools for benchmarking exist, there is a lack of rep-resentative benchmarks for the class of irregular computations as exempli?ed by graph analytics. In this paper, we propose miniVite as a representative graph analytics benchmark tool to test a variety of distributed-memory systems. Graph clustering, popularly known as community detection, is a prototypical graph operation used in numerous scienti?c computing and analytics applications. The goal of clustering is to partition a graph into clusters (or communities) such that each cluster consists of vertices that are densely connected within the cluster and sparsely connected to the rest of the graph. Modu-larity optimization is a popular technique for identifying clusters in a graph. Ef?cient parallelization of modularity optimization-based algorithms is challenging. One successful approach was conceived in Vite, a distributed-memory implementation of the Louvain algorithm that incorporates several heuristics. We introduce miniVite as a representative but simpli?ed variant of Vite, to serve as a prototypical graph analytics benchmarking tool. Unlike other graph-based methods such as breadth-?rst search and betweenness centrality, miniVite represents highly complex computational patterns stressing a variety of system features, which can provide crucial insight for co-design of future computing systems.

community detection, parallel, MPI↗

Note: The performance of new density functionals for a recent blind test of non-covalent interactions

Benchmark datasets of non-covalent interactions are essential for assessing the performance of density functionals and other quantum chemistry approaches. In a recent blind test, Taylor et al. benchmarked 14 methods on a new dataset consisting of 10 dimer potential energy curves calculated using coupled cluster with singles, doubles, and perturbative triples (CCSD(T)) at the complete basis set (CBS) limit (80 data points in total). Finally, the dataset is particularly interesting because compressed, near-equilibrium, and stretched regions of the potential energy surface are extensively sampled.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.

42 ENGINEERING↗