Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer system benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

STEPS: A Portable Numerical Simulation Toolkit for Electrical Power System Dynamic Studies

Numerical simulation is the key technique for large scale power system analysis. Redistribution of global renewable power via international interconnections requires new simulation tools to study the interconnected systems with different nominal frequencies as a whole. In this paper we introduce an open source simulation toolkit for electrical power systems (STEPS) which is hosted at Github. Its kernel is coded in C++ with major functions of power flow and electro-mechanical dynamic simulation. Flexible options are provided and configurable to improve power flow solution and dynamic simulation. Common devices and models are supported in STEPS for AC/DC hybrid system studies. Studies of interconnected systems with different nominal frequencies is supported in STEPS for research of international interconnection. Application program interfaces are provided and wrapped with Python to enable high-level interfaces for general applications. STEPS is thread safe and parallel computation is supported in both kernel and script levels to accelerate simulation. It is portable and works on Windows and GNU/Linux platforms. Cases from small to large scale systems are thoroughly tested to validate the toolkit with commercial packages as benchmarks.

42 ENGINEERING↗

The NAS parallel benchmarks

A new set of benchmarks has been developed for the performance evaluation of highly parallel supercomputers in the framework of the NASA Ames Numerical Aerodynamic Simulation (NAS) Program. These consist of five 'parallel kernel' benchmarks and three 'simulated application' benchmarks. Together they mimic the computation and data movement characteristics of large-scale computational fluid dynamics applications. The principal distinguishing feature of these benchmarks is their 'pencil and paper' specification-all details of these benchmarks are specified only algorithmically. In this way many of the difficulties associated with conventional benchmarking approaches on highly parallel systems are avoided.

Bailey, D. H.↗

The NAS parallel benchmarks

A new set of benchmarks was developed for the performance evaluation of highly parallel supercomputers. These benchmarks consist of a set of kernels, the 'Parallel Kernels,' and a simulated application benchmark. Together they mimic the computation and data movement characteristics of large scale computational fluid dynamics (CFD) applications. The principal distinguishing feature of these benchmarks is their 'pencil and paper' specification - all details of these benchmarks are specified only algorithmically. In this way many of the difficulties associated with conventional benchmarking approaches on highly parallel systems are avoided.

Bailey, David↗

Model Checking Degrees of Belief in a System of Agents

Reasoning about degrees of belief has been investigated in the past by a number of authors and has a number of practical applications in real life. In this paper we present a unified framework to model and verify degrees of belief in a system of agents. In particular, we describe an extension of the temporal-epistemic logic CTLK and we introduce a semantics based on interpreted systems for this extension. In this way, degrees of beliefs do not need to be provided externally, but can be derived automatically from the possible executions of the system, thereby providing a computationally grounded formalism. We leverage the semantics to (a) construct a model checking algorithm, (b) investigate its complexity, (c) provide a Java implementation of the model checking algorithm, and (d) evaluate our approach using the standard benchmark of the dining cryptographers. Finally, we provide a detailed case study: using our framework and our implementation, we assess and verify the situational awareness of the pilot of Air France 447 flying in off-nominal conditions.

MAS Verification↗

Roof and Attic Design Guidelines for new and retrofit Construction of Homes in Hot and Coild Climates

Some guidelines for improving the energy efficiency of roofs and attics are presented and are based on the research of the DOE Building Technology. The results of combined analytical and experimental studies were used to benchmark computer tools, which in turn, were used to simulate homes in hot and cold climates. Adding floor and roof insulation, above deck ventilation, radiant barriers, cool color shingle, metal or tile roofs, sealing the attic floor, sealing the duct system and sealing the attic were simulated to compute the cost of energy savings. Results are prioritized to help building owners make an informed economic decision when contemplating roof and attic retrofits. Sealing the attic floor is a top retrofit option. The sealed attic approach and a new prototype roof assembly an insulated and ventilated roof are good options for retrofit work but have paybacks ranging from 15 to 25 years. A new sealed attic concept was simulated and computations show its simple payback is about 10 to 12 years in hot and cold climates; its first cost is significantly reduced from that of a spray foam approach. For new construction the best option is to keep the ducts out of the attic, make sure the attic floor is sealed and add at least code level of insulation to the ceiling.

attic↗

Sub-microsecond Transformers for Jet Tagging on FPGAs

We present the first sub-microsecond transformer implementation on an FPGA achieving competitive performance for state-of-the-art high-energy physics benchmarks. Transformers have shown exceptional performance on multiple tasks in modern machine learning applications, including jet tagging at the CERN Large Hadron Collider (LHC). However, their computational complexity prohibits use in real-time applications, such as the hardware trigger system of the collider experiments up until now. In this work, we demonstrate the first application of transformers for jet tagging on FPGAs, achieving $\mathcal{O}(100)$ nanosecond latency with superior performance compared to alternative baseline models. We leverage high-granularity quantization and distributed arithmetic optimization to fit the entire transformer model on a single FPGA, achieving the required throughput and latency. Furthermore, we add multi-head attention and linear attention support to hls4ml, making our work accessible to the broader fast machine learning community. This work advances the next-generation trigger systems for the High Luminosity LHC, enabling the use of transformers for real-time applications in high-energy physics and beyond.

Laatu, Lauri [Imperial Coll., London]↗

Benchmark Analysis of Subcritical Noise Measurements on a Nickel-Reflected Plutonium Metal Sphere

Subcritical experiments using californium source-driven noise analysis (CSDNA) and Feynman variance-to-mean methods were performed with an alpha-phase plutonium sphere reflected by nickel shells, up to a maximum thickness of 7.62 cm. Both methods provide means of determining the subcritical multiplication of a system containing nuclear material. A benchmark analysis of the experiments was performed for inclusion in the 2010 edition of the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Benchmark models have been developed that represent these subcritical experiments. An analysis of the computed eigenvalues and the uncertainty in the experiment and methods was performed. The eigenvalues computed using the CSDNA method were very close to those calculated using MCNP5; however, computed eigenvalues are used in the analysis of the CSDNA method. Independent calculations using KENO-VI provided similar eigenvalues to those determined using the CSDNA method and MCNP5. A slight trend with increasing nickel-reflector thickness was seen when comparing MCNP5 and KENO-VI results. For the 1.27-cm-thick configuration the MCNP eigenvalue was approximately 300 pcm greater. The calculated KENO eigenvalue was about 300 pcm greater for the 7.62-cm-thick configuration. The calculated results were approximately the same for a 5-cm-thick shell. The eigenvalues determined using the Feynman method are up to approximately 2.5% lower than those determined using either the CSDNA method or the Monte Carlo codes. The uncertainty in the results from either method was not large enough to account for the bias between the two experimental methods. An ongoing investigation is being performed to assess what potential uncertainties and/or biases exist that have yet to be properly accounted for. The dominant uncertainty in the CSDNA analysis was the uncertainty in selecting a neutron cross-section library for performing the analysis of the data. The uncertainty in the Feynman method was equally shared between the uncertainties in fitting the data to the Feynman equations and the neutron multiplicity of 239 Pu. Material and geometry uncertainties in the benchmark experiment were generally much smaller than uncertainties in the analysis methods.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of Numerical Tools for Calculating Reactivity Feedback in Sodium Fast Reactors Using SEFOR Experimental Data

The Southwest Experimental Fast Oxide Reactor (SEFOR) was an experimental sodium-cooled fast breeder reactor operated from 1969 to 1972 with experiments designed to measure Doppler reactivity feedback in a wide temperature range from around 350 °F to temperatures approaching the melting point of mixed oxide fuel of around 5000 °F, providing valuable data for code validations. Co-supported by the Department of Energy (DOE) Fast Reactor Program (FRP) and the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the SEFOR benchmark project focused on using the experimental data to validate numerical tools that are used in industry and academia to design and license sodium-cooled fast reactors (SFRs). By the end of FY-25, substantial progress was achieved in the SEFOR benchmark study. A variety of numerical tools commonly used for modeling SFRs were applied to develop models for SEFOR core configurations I-D, I-E, I-I, and I-J. These included Monte Carlo codes such as MCNP, Serpent, and Shift; deterministic codes such as the legacy Argonne Reactor Computation (ARC) suite and the high-fidelity NEAMS code Griffin; and the system analysis code SAS4A/SASSYS-1 (SAS). Using these models, both SEFOR zero-power experiments and power-ascending tests were successfully simulated. Comparisons were performed against experimental measurements of core criticalities, reflector worth, kinetics parameters (Λ/βeff), isothermal reactivity feedback (from 350 °F to 760 °F at zero power), and power-ascending reactivity feedback (as power increased from 0.4 MW to 17 MW). In general, these comparisons demonstrated very good agreement between numerical results and experimental data. In Fiscal Year 26 (FY-26), the SEFOR benchmark project will continue to address the modeling issues identified in FY-25. Effort will focus on the simulation of reactivity insertion transients in SEFOR core II using the ARC/SAS model. Future work will also focus on incorporating BISON into the SEFOR core modeling process to enable the first Multiphysics simulations of the isothermal tests based on the MOOSE framework.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Issues in ATM Support of High-Performance, Geographically Distributed Computing

This report experimentally assesses the effect of the underlying network in a cluster-based computing environment. The assessment is quantified by application-level benchmarking, process-level communication, and network file input/output. Two testbeds were considered, one small cluster of Sun workstations and another large cluster composed of 32 high-end IBM RS/6000 platforms. The clusters had Ethernet, fiber distributed data interface (FDDI), Fibre Channel, and asynchronous transfer mode (ATM) network interface cards installed, providing the same processors and operating system for the entire suite of experiments. The primary goal of this report is to assess the suitability of an ATM-based, local-area network to support interprocess communication and remote file input/output systems for distributed computing.

Claus, Russell W.↗

Experiences using OpenMP based on Computer Directed Software DSM on a PC Cluster

In this work we report on our experiences running OpenMP programs on a commodity cluster of PCs running a software distributed shared memory (DSM) system. We describe our test environment and report on the performance of a subset of the NAS Parallel Benchmarks that have been automaticaly parallelized for OpenMP. We compare the performance of the OpenMP implementations with that of their message passing counterparts and discuss performance differences.

Hess, Matthias↗

Gas Gun Model and Comparison to Experimental Performance of Pipe Guns Operating with Light Propellant Gases and Large Cryogenic Pellets

Injection of multiple large (~10 to 30 mm diameter) shattered pellets into ITER plasmas is presently part of the scheme planned to mitigate the deleterious effects of disruptions on the vessel components. To help in the design and optimize performance of the pellet injectors for this application, a model referred to as “the gas gun simulator” has been developed and benchmarked against experimental data. The computer code simulator is a Java program that models the gas-dynamics characteristics of a single-stage gas gun. Following a stepwise approach, the code utilizes a variety of input parameters to incrementally simulate and analyze the dynamics of the gun as the projectile is launched down the barrel. Using input data, the model can calculate gun performance based on physical characteristics, such as propellant-gas and fast-valve properties, barrel geometry, and pellet mass. Although the model is fundamentally generic, the present version is configured to accommodate cryogenic pellets composed of H2, D2, Ne, Ar, and mixtures of them and light propellant gases (H2, D2, and He). The pellets are solidified in situ in pipe guns that consist of stainless steel tubes and fast-acting valves that provide the propellant gas for pellet acceleration (to speeds ~200 to 700 m/s). The pellet speed is the key parameter in determining the response time of a shattered pellet system to a plasma disruption event. The calculated speeds from the code simulations of experiments were typically in excellent agreement with the measured values. With the gas gun simulator validated for many test shots and over a wide range of physical and operating parameters, it is a valuable tool for optimization of the injector design, including the fast valve design (orifice size and volume) for any operating pressure (~40 bar expected for the ITER application) and barrel length for any pellet size (mass, diameter, and length). Key design parameters and proposed values for the pellet injectors for the ITER disruption mitigation systems are discussed.

Combs, Stephen Kirk↗

P4: Portable Parallel Processing Pipelines for Interactive Information Visualization

We present P4, an information visualization toolkit that combines declarative design specification and GPU computing for building high-performance interactive systems. Most of the existing information visualization toolkits do not harness the power of parallel processors in today's mainstream computers. P4 leverages GPU computing to accelerate both data processing and visualization rendering for interactive visualization applications. P4's programming interface offers a declarative visualization grammar for rapid specifications of data transformations, visual encodings, and interactions. By simplifying the development of GPU-accelerated visualization systems while supporting a high degree of flexibility and customization for design specification, P4 narrows the gap between expressiveness and scalability in information visualization toolkits. Through a range of examples and benchmark tests, we demonstrate that P4 provides high efficiency for creating interactive visualizations and offers drastic performance improvement over current state-of-the-art toolkits.

97 MATHEMATICS AND COMPUTING↗

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

ABSTRACT Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗

Efficient Berry phase calculation via adaptive variational quantum computing approach

We present an adaptive variational quantum algorithm to estimate the Berry phase accumulated by a nondegenerate ground state under cyclic, adiabatic evolution of a time-dependent Hamiltonian. Our method leverages cyclic adiabatic evolution of the Hamiltonian and employs adaptive variational quantum algorithms for state preparation and evolution, optimizing circuit efficiency while maintaining high accuracy. We benchmark our approach on dimerized Fermi–Hubbard chains with four sites, demonstrating precise Berry phase simulations in both noninteracting and interacting regimes. Our results show that circuit depths reach up to 106 layers for noninteracting systems and increase to 279 layers for interacting systems due to added complexity. In addition, we demonstrate the robustness of our scheme across a wide range of parameters governing adiabatic evolution and variational algorithms. These findings highlight the potential of adaptive variational quantum algorithms for advancing quantum simulations of topological materials and computing geometric phases in strongly correlated systems.

Mootz, Martin [Ames Laboratory (AMES), Ames, IA (U↗

ENDF/B-VIII.0 Augmented Covariance Data The first iteration [Slides]

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ENDF/B-VIII.0 Augmented Covariance Data The first iteration [Slides]

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ENDF/B-VIII.0 Augmented Covariance Data: The first iteration

Nuclear data are necessary for reliable modeling and simulation of the next generation of nuclear reactors. However, the variation in the ratio of the computed to experimental values (C/E) for certain types of nuclear systems is much less than predicted by evaluated nuclear data file (ENDF)/B covariances. Figure 1 provides an example of a set of metal-plutonium-fueled, fast-spectrum (PU-MET-FAST) integral experiments from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) in the Oak Ridge National Laboratory (ORNL) VALID database. The variation in the C/E values, shown with one standard deviation error bars, is 100% covered by both the SCALE and ENDB/VIII.0 covariance data. This is due to the comparisons to integral data that are essential during the evaluation process. However, the ENDF evaluations represent uncertainties and correlations in differential data only; they do not reflect the impact of the comparison to integral data in the covariance evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

FINETUNA: fine-tuning accelerated molecular simulations

Abstract Progress towards the energy breakthroughs needed to combat climate change can be significantly accelerated through the efficient simulation of atomistic systems. However, simulation techniques based on first principles, such as density functional theory (DFT), are limited in their practical use due to their high computational expense. Machine learning approaches have the potential to approximate DFT in a computationally efficient manner, which could dramatically increase the impact of computational simulations on real-world problems. However, they are limited by their accuracy and the cost of generating labeled data. Here, we present an online active learning framework for accelerating the simulation of atomic systems efficiently and accurately by incorporating prior physical information learned by large-scale pre-trained graph neural network models from the Open Catalyst Project. Accelerating these simulations enables useful data to be generated more cheaply, allowing better models to be trained and more atomistic systems to be screened. We also present a method of comparing local optimization techniques on the basis of both their speed and accuracy. Experiments on 30 benchmark adsorbate-catalyst systems show that our method of transfer learning to incorporate prior information from pre-trained models accelerates simulations by reducing the number of DFT calculations by 91%, while meeting an accuracy threshold of 0.02 eV 93% of the time. Finally, we demonstrate a technique for leveraging the interactive functionality built in to Vienna ab initio Simulation Package (VASP) to efficiently compute single point calculations within our online active learning framework without the significant startup costs. This allows VASP to work in tandem with our framework while requiring 75% fewer self-consistent cycles than conventional single point calculations. The online active learning implementation, and examples using the VASP interactive code, are available in the open source FINETUNA package on Github.

97 MATHEMATICS AND COMPUTING↗