Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer system benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Performance Evaluation of Three Distributed Computing Environments for Scientific Applications

We present performance results for three distributed computing environments using the three simulated CFD applications in the NAS Parallel Benchmark suite. These environments are the DCF cluster, the LACE cluster, and an Intel iPSC/860 machine. The DCF is a prototypic cluster of loosely coupled SGI R3000 machines connected by Ethernet. The LACE cluster is a tightly coupled cluster of 32 IBM RS6000/560 machines connected by Ethernet as well as by either FDDI or an IBM Allnode switch. Results of several parallel algorithms for the three simulated applications are presented and analyzed based on the interplay between the communication requirements of an algorithm and the characteristics of the communication network of a distributed system.

Fatoohi, Rod↗

Bayesian Symbolic Regression: Addressing Challenges in Estimating Fractional Bayes Factors and Application to Fatigue Crack Growth Modeling

This research pioneers advancements in computational mechanics by integrating Bayesian-based uncertainty quantification into symbolic regression, specifically focusing on the critical task of accurately estimating the fractional Bayes factor for selecting arbitrary equations. In our exploration, we rigorously study two prominent methods—sequential Monte Carlo and the Laplace approximation—employed for computing the fractional Bayes factor. Our findings underscore the limitations of the Laplace approximation, revealing its diminished accuracy in nonlinear and multimodal scenarios. Specifically, the Laplace approximation is shown to underpredict fractional Bayes factor on a wide set of equations associated with a symbolic regression benchmark. This comparative analysis sheds light on the nuanced performance of these techniques, guiding researchers toward more informed choices in uncertainty quantification within symbolic regression. Furthermore, we showcase the practical utility of these enhanced symbolic regression tools through their application to a real-world problem in fatigue crack growth modeling, emphasizing their efficacy in capturing the complexities of mechanical systems.

Geoffrey Bomarito↗

Testing the Delayed Gamma Capability in MCNP6 - Paper 86

The mission of the Domestic Nuclear Detection Office (DNDO) is to quickly and reliably detect unauthorized attempts to import or transport special nuclear material (SNM) for use against the United States. Developing detection equipment to meet this objective requires accurate simulation of both the detectable signature and detection mechanism. MCNP6 is capable of transporting the various types of radiation encountered in these scenarios; however, the accuracy of MCNP6 must be quantified such that we can be confident in the results of the simulations. Delayed gamma transport is one important component of these detection scenarios. Delayed gamma transport is defined as the combination of gamma emission from radioactive and subsequent transport through matter. MCNP always possessed the ability to emit delayed neutrons from fission; however, these delayed neutron spectra and intensity were functional fits and not directly sampled from the created fission products. Furthermore, there existed no method to emit the decay photons from radioactive fission products (or any radioactive nucleus) A delayed particle capability was initially added to MCNPX 2.6.A in 2005 to sample the radioactive fission product parents and emit decay particles resulting from the decay chain. At the point of capture, a residual nucleus is created and decayed using the CINDER90 depletion code. MCNP only sends CINDER90 a residual radioactive nucleus and not a flux (i.e. capture rate). As a result, the Bateman equations for the solution are coupled first order differential equations with constant coefficients. Theoretically, these equations could be solved analytically; however, CINDER90 employs a numerical Markov linear chain scheme to solve these equations. This paper addresses a more simplified approach to benchmarking in order to best assess: (1) whether or not deficiencies exist in the current methodology for certain types of decay chains; and (2) paths forward for improving the delayed particle emission capability. We utilize closed form analytic solutions to the granddaughter equations for particular sets of isotope systems to compare the accuracy of the delayed gamma capability in MCNP6. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Liquid Water: Obtaining the right answer for the right reasons

Water is ubiquitous on our planet and plays an essential role in many chemical and biological processes. Accurate models for water are crucial in understanding, controlling and predicting the physical and chemical properties of complex aqueous systems. Over the last few years we have been developing a molecular-level based approach for a macroscopic model for water that is based on the explicit description of the underlying intermolecular interactions between molecules in water clusters. In the absence of detailed experimental data for small water clusters, highly-accurate theoretical results are required to validate and parameterize model potentials. As an example of the benchmarks needed for the development of accurate models for the interaction between water molecules, for the most stable structure of (H$_2$O)$_{20}$ we ran a coupled-cluster calculation on the ORNL's Jaguar petaflop computer that used over 100 TB of memory for a sustained performance of 487 TFLOP/s (double precision) on 96,000 processors, lasting for 2 hours. By this summer we will have studied multiple structures of both (H$_2$O)$_{20}$ and (H$_2$O)$_{30}$ and completed basis set and other convergence studies and anticipate the sustained performance rising close to 1 PFLOP/s.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

2D numerical simulation of unsteady flows for large scale floods prediction in real time

The challenge of finding a compromise between computational time and level of accuracy and robustness has traditionally expanded the use simplified models rather than full two-dimensional (2D) models for flood simulation. This work presents a GPU accelerated 2D shallow water model for the simulation of flood events in real time. In particular, an explicit first-order finite volume scheme is detailed to control the numerical instabilities that are likely to appear when used in complex topography. The model is first validated with the benchmark test case of the Toce River (Italy) and numerical fixes are demonstrated to be necessary. The model is next applied to reproduce real events in a reach of the Ebro River (Spain) in order to compare simulation results with field data. The second case deals with a large domain (744 km 2 ) and long flood duration (up to 20 days) allowing an analysis of the performance and speed-up achieved by different GPU devices. We report the high values of fit between observed and simulated results as well as the computational times achieved are encouraging to propose the use of the model as forecasting system.

54 ENVIRONMENTAL SCIENCES↗

Multiresolution Quantum Chemistry: Nonlinear Response Properties at the Basis Set Limit

We benchmark the accuracy of Dunning correlation-consistent Gaussian basis sets for computing frequencydependent second-order hyperpolarizabilities relevant to second-harmonic generation (SHG), using multiresolution analysis (MRA) as a reference. Basis set errors are analyzed using a unit-sphere representation of the effective hyperpolarizability vector, enabling direct assessment of directional error structure. We introduce a relative RMS total error metric that integrates directional deviations over the unit sphere and complement it with signed projection errors that distinguish over- and underestimation. Unsupervised clustering based on these signed directional metrics reveals four distinct convergence behaviors across a set of 68 molecules. Unitsphere visualizations of representative systems show that basis set errors are often highly anisotropic and localized along specific bond directions, even when global error measures appear small. Doubly augmented basis sets consistently outperform singly augmented ones, and core-polarization functions are required for uniform convergence in second-row systems. Overall, this work demonstrates that directional analysis combined with clustering provides a robust framework for understanding basis set convergence in nonlinear optical response properties.

Basis sets↗

MLCommons Science Benchmarks

Benchmarks are a cornerstone of modern machine learning practice, providing standardized eval- uations that enable reproducibility, comparison, and scientific progress. Yet, as AI systems particularly deep learning models become increasingly dynamic, traditional static benchmarking approaches are losing their relevance. Models rapidly evolve in architecture, scale, and capability; datasets shift; and deployment contexts continuously change, creating a moving target for evaluation. Without adaptive benchmarking frame- works, both scientific assessment and real-world de- ployment risk becoming misaligned with actual system behavior. Drawing on our experience from MLCommons, educa- tional initiatives, and government programs such as the DOE s Million Parameter Consortium, we identify key barriers that hinder the broader adoption and utility of benchmarking in AI. These include substantial resource demands, limited access to specialized hardware, lack of expertise in benchmark design, and uncertainty among practitioners about how to relate benchmark results to their own application domains. Moreover, current benchmarks often emphasize peak performance on leadership-class hardware, offering limited guidance for more diverse, real-world deployment scenarios. We argue that benchmarking itself must become dy- namic in order to incorporate evolving models, updated data, and heterogeneous computational platforms while maintaining transparency, reproducibility, and inter- pretability. Democratizing this process requires not only technical innovation, but also systematic educational efforts spanning undergraduate to professional levels to develop sustained expertise in benchmark design and use. Finally, benchmarks should be framed and com- municated to support application-relevant comparisons, enabling both developers and users to make informed, context-sensitive decisions. Advancing dynamic and inclusive benchmarking practices will be essential to ensure that evaluation keeps pace with the evolving AI landscape and supports responsible, reproducible, and accessible AI deployment.

Hawks, Benjamin G. [Fermilab]↗

Investigation into the Performance Benefits of Exposing Network Backpressure in UPC++ and GASNet-EX

This document is a brief summary of the research, and supporting development efforts, conducted by the project "Investigation into Improving Dynamic Adaptivity to System-Level Asynchrony in UPC++". We tested the hypothesis "The UPC++ and GASNet-EX runtimes can expose information from the network stack that enables applications to dynamically adapt to congestion, improving total throughput". We present experimental results from both a microbenchmark and an application benchmark that support this hypothesis.

97 MATHEMATICS AND COMPUTING↗

Finite Volume Method Based Neutronic Solvers for Steady and Transient Analysis of Molten Salt Reactors

In recent years, the coupled neutronics and thermal hydraulics analysis becomes more and more important, because it helps to identify the most relevant safety issues without conservative assumptions. In addition, such coupled simulations are essential for the generation IV advanced nuclear power systems such as molten salt reactor (MSR), because the presence of strong coupling between different phenomena, like the transport of delayed neutron precursors by the fluid flow?. Due to the different discretization methods used in reactor physics analysis and thermal-hydraulics analysis, it is hard to couple different kinds of codes. This work presents an attempt to solve the multigroup neutron diffusion equation with the finite volume method which is quite widely used for the numerical simulation of a variety of applications involving fluid flow and heat and mass transfer. The unstructured finite volume method (FVM) based on open source C++ library OpenFOAM was chosen as the development platform?. The objective of this paper is to concisely present the main features of the developed codes in terms of the theoretical background and numerical approach and as can be seen in the following sections, the calculation results obtained by the NDSFoam which solves the steady-state neutron diffusion equation and NDTFoam which solves the transient-state neutron diffusion equation are discussed and compared to the benchmark problems. In this paper, two new neutronic solvers using finite volume method have been developed to perform the neutron physics analysis. The solvers are based on OpenFOAM, and have been tested with several steady state and transient-state benchmark problems. By verifications of the codes, it is proved that the development of NDSFoam and NDTFoam are correct. In our future work, both of these two solvers will be coupled with the precompiled CFD solvers in OpenFOAM to analyze the molten salt fast reactors. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of a Novel Gas Pressurized Stripping Process-Based Technology for CO₂ Capture from Post-Combustion Flue Gases

A novel Gas Pressurized Stripping (GPS) post-combustion carbon capture (PCC) process has been developed by Carbon Capture Scientific, LLC, CONSOL Energy Inc., Nexant Inc., and Western Kentucky University in this bench-scale project. The GPS-based process presents a unique approach that uses a gas pressurized technology for CO₂ stripping at an elevated pressure to overcome the energy use and other disadvantages associated with the benchmark monoethanolamine (MEA) process. The project was aimed at performing laboratory- and bench-scale experiments to prove its technical feasibility and generate process engineering and scale-up data, and conducting a techno-economic analysis (TEA) to demonstrate its energy use and cost competitiveness over the MEA process. To meet project goals and objectives, a combination of experimental work, process simulation, and technical and economic analysis studies were applied. The project conducted individual unit lab-scale tests for major process components, including a first absorption column, a GPS column, a second absorption column, and a flasher. Computer simulations were carried out to study the GPS column behavior under different operating conditions, to optimize the column design and operation, and to optimize the GPS process for an existing and a new power plant. The vapor-liquid equilibrium data under high loading and high temperature for the selected amines were also measured. The thermal and oxidative stability of the selected solvents were also tested experimentally and presented. A bench-scale column-based unit capable of achieving at least 90% CO₂ capture from a nominal 500 SLPM coal-derived flue gas slipstream was designed and built. This integrated, continuous, skid-mounted GPS system was tested using real flue gas from a coal-fired boiler at the National Carbon Capture Center (NCCC). The technical challenges of the GPS technology in stability, corrosion, and foaming of selected solvents, and environmental, health and safety risks have been addressed through experimental tests, consultation with vendors and engineering analysis. Multiple rounds of TEA were performed to improve the GPS-based PCC process design and operation, and to compare the energy use and cost performance of a nominal 550-MWe supercritical pulverized coal (PC) plant among the DOE/NETL report Case 11 (the PC plant without CO₂ capture), the DOE/NETL report Case 12 (the PC plant with benchmark MEA-based PCC), and the PC plant using GPS-based PCC. The results reveal that the net power produced in the PC plant with GPS-based PCC is 647 MWe, greater than that of the Case 12 (550 MWe). The 20-year LCOE for the PC plant with GPS-based PCC is 97.4 mills/kWh, or 152% of that of the Case 11, which is also 23% less than that of the Case 12. These results demonstrate that the GPS-based PCC process is energy-efficient and cost-effective compared with the benchmark MEA process.

Chen, Shiaoguo↗

The adaptive buffered force QM/MM method in the CP2K and AMBER software packages

The implementation and validation of the adaptive buffered force (AdBF) quantum‐mechanics/molecular‐mechanics (QM/MM) method in two popular packages, CP2K and AMBER are presented. The implementations build on the existing QM/MM functionality in each code, extending it to allow for redefinition of the QM and MM regions during the simulation and reducing QM‐MM interface errors by discarding forces near the boundary according to the buffered force‐mixing approach. New adaptive thermostats, needed by force‐mixing methods, are also implemented. Different variants of the method are benchmarked by simulating the structure of bulk water, water autoprotolysis in the presence of zinc and dimethyl‐phosphate hydrolysis using various semiempirical Hamiltonians and density functional theory as the QM model. It is shown that with suitable parameters, based on force convergence tests, the AdBF QM/MM scheme can provide an accurate approximation of the structure in the dynamical QM region matching the corresponding fully QM simulations, as well as reproducing the correct energetics in all cases. Adaptive unbuffered force‐mixing and adaptive conventional QM/MM methods also provide reasonable results for some systems, but are more likely to suffer from instabilities and inaccuracies. © 2015 The Authors. Journal of Computational Chemistry Published by Wiley Periodicals, Inc.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Interaction between water and carbon nanostructures: How good are current density functional approximations?

Due to their current and future technological applications, including realization of water filters and desalination membranes, water adsorption on graphitic sp2-bonded carbon is of overwhelming interest. However, these systems are notoriously challenging to model, even for electronic structure methods such as density functional theory (DFT), because of the crucial role played by London dispersion forces and noncovalent interactions, in general. Recent efforts have established reference quality interactions of several carbon nanostructures interacting with water. Here, we compile a new benchmark set (dubbed WaC18), which includes a single water molecule interacting with a broad range of carbon structures and various bulk (3D) and two-dimensional (2D) ice polymorphs. The performance of 28 approaches, including semilocal exchange-correlation functionals, nonlocal (Fock) exchange contributions, and long-range van der Waals (vdW) treatments, is tested by computing the deviations from the reference interaction energies. The calculated mean absolute deviations on the WaC18 set depend crucially on the DFT approach, ranging from 135 meV for local density approximation (LDA) to 12 meV for PBE0-D4. We find that modern vdW corrections to DFT significantly improve over their precursors. Within the 28 tested approaches, we identify the best performing within the functional classes of generalized gradient approximated (GGA), meta-GGA, vdW-DF, and hybrid DF, which are BLYP-D4, TPSS-D4, rev-vdW-DF2, and PBE0-D4, respectively.

Brandenburg, Jan Gerit (ORCID:0000000292192948)↗

Multi-Core Microcontroller Hardware In the Loop System for Electric Machine Control

Hardware in the Loop (HIL) is a simulation technique used to reduce the software development cycle and test control systems in a non-destructive environment. This work describes a cost effective HIL simulator on a dual core microcontroller in which one core acts as a controller and the other emulates the system under control. The emulator runs one step per Pulse Width Modulation (PWM) period in real time. To handle the computational burden and prioritize execution of simulation and control tasks, an interrupt-based software architecture with task prioritization has been developed. As a demonstration, the HIL has been implemented on a Texas Instruments TMS320F28379D dual core microcontroller, which emulates a Permanent Magnet Synchronous Machine (PMSM) with resolver feedback. Hardware peripherals are developed and tested concurrently with the control system, providing higher confidence in the software. By using the peripherals in the HIL development, the controller exercises either the HIL emulation or a pin compatible PMSM testbench. To quantify performance and validate the processor based emulator, the HIL results are compared to the preexisting testbench for accuracy benchmarking at no-load and under load for a range of operating points.

33 ADVANCED PROPULSION SYSTEMS↗

AMD Radeon e9173 Low Power PCIE GPU Single Event Effects Test Report

The AMD Radeon Embedded e9170 Graphics Processing Unit (GPU), notably the e9173 Peripheral Component Interconnect Express (PCIE) variant, is of interest to Artemis generation programs with requirements for graphics rendering, compute, artificial intelligence (Ai) with a constraints-requiring piece-part procurement and power consumption of less than 50W. In addition to collecting heavy ion data on this device, a secondary purpose of this test campaign was to validate video capture hardware and software workflows used with GPU, microprocessor and system-on-chip device testing. Five (5) test patterns from the NEPP Processor Enclave (NPE) test suite were used with the e9173. The test patterns covered the operating system’s (OS) idle contribution towards the cross section, matrix math using tensorflow-rocm, two artificial intelligence models developed at NASA GSFC, and an industry standard GPU benchmarking application called Mesa GLXGears.

NASA Technical Memorandum (TM) test report for pos↗

SCALE Code Validation for Prismatic High-Temperature Gas-Cooled Reactors

Using experimental data published in the International Handbook of Evaluated Reactor Physics Benchmark Experiments for the fresh cold core of the High Temperature Engineering Test Reactor, a comprehensive validation study has been carried out to assess the performance of the SCALE code system for analysis of High Temperature Gas-Cooled Reactor (HTGR) configurations. This paper describes part of the results of this effort. The studies performed included criticality evaluations for the full core and for the annular cores realized during the fuel loading, as well as calculations and comparisons for excess reactivity, shutdown margin, control rod worths, temperature coefficient of reactivity, and reaction rate distributions. Comparisons of the SCALE results with both the experimental values and MCNP-calculated values are presented. The comparisons show that the SCALE calculated results, obtained with both multigroup and continuous energy cross sections, are in reasonable agreement with the experimental data. The agreement with the MCNP predictions is, in general, very good.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Parallel replica dynamics method for bistable stochastic reaction networks: Simulation and sensitivity analysis

Stochastic reaction networks that exhibit bistable behavior are common in systems biology, materials science, and catalysis. Sampling of stationary distributions is crucial for understanding and characterizing the long-time dynamics of bistable stochastic dynamical systems. However, simulations are often hindered by the insufficient sampling of rare transitions between the two metastable regions. In this paper, we apply the parallel replica method for a continuous time Markov chain in order to improve sampling of the stationary distribution in bistable stochastic reaction networks. The proposed method uses parallel computing to accelerate the sampling of rare transitions. Furthermore, it can be combined with the path-space information bounds for parametric sensitivity analysis. With the proposed methodology, we study three bistable biological networks: the Schlögl model, the genetic switch network, and the enzymatic futile cycle network. We demonstrate the algorithmic speedup achieved in these numerical benchmarks. More significant acceleration is expected when multi-core or graphics processing unit computer architectures and programming tools such as CUDA are employed

97 MATHEMATICS AND COMPUTING↗

Steepest-descent algorithm for simulating plasma-wave caustics via metaplectic geometrical optics

The design and optimization of radiofrequency-wave systems for fusion applications is often performed using ray-tracing codes, which rely on the geometrical-optics (GO) approximation. However, GO fails at wave cutoffs and caustics. To accurately model the wave behavior in these regions, more advanced and computationally expensive “full-wave” simulations are typically used, but this is not strictly necessary. A new generalized formulation called metaplectic geometrical optics (MGO) has been proposed that reinstates GO near caustics. The MGO framework yields an integral representation of the wavefield that must be evaluated numerically in general. We present an algorithm for computing these integrals using Gauss-Freud quadrature along the steepest-descent contours. Benchmarking is performed on the standard Airy problem, for which the exact solution is known analytically. Furthermore, the numerical MGO solution provided by the new algorithm agrees remarkably well with the exact solution and significantly improves on previously derived analytical approximations of the MGO integral.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

GenASiS: General Astrophysical Simulation System. II. Self-gravitating Baryonic Matter*

GenASiS (General Astrophysical Simulation System) is a code being developed initially and primarily, though not exclusively, for the simulation of core-collapse supernovae on the world's leading capability supercomputers. This paper---the second in a series---documents capabilities for Newtonian self-gravitating fluid dynamics, including tabulated microphysical equations of state treating nuclei and nuclear matter (`baryonic matter'). Computation of the gravitational potential of a spheroid, and simulation of the gravitational collapse of dust and of an ideal fluid, provide tests of self-gravitation against known solutions. In multidimensional computations of the adiabatic collapse, bounce, and explosion of spherically symmetric pre-supernova progenitors---which we propose become a standard benchmark for code comparisons---we find that the explosions are prompt and remain spherically symmetric (as expected), with an average shock expansion speed and total kinetic energy that are inversely correlated with the progenitor mass at the onset of collapse and the compactness parameter.

Cardall, Christian [ORNL] (ORCID:000000020086105X)↗