Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

CLOMP v1.5

CLOMP is the C version of the Livermore OpenMP benchmark developed to measure OpenMP overheads and other performance impacts due to threading. For simplicity, it does not use MPI by default but it is expected to be run on the resources a threaded MPI task would use (e.g., a portion of a shared memory compute node). Compiling with -DWITH_MPI allows packing one or more nodes with CLOMP tasks and having CLOMP report OpenMP performance for the slowest MPI task. On current systems, the strong scaling performance results for 4, 8, or 16 threads are of the most interest. Suggested weak scaling inputs are provided for evaluating future systems. Since MPI is often used to place at least one MPI task per coherence or NUMA domain, it is recommended to focus OpenMP runtime measurements on a subset of node hardware where it is most possible to have low OpenMP overheads (e.g., within one coherence domain or NUMA domain).

97 MATHEMATICS AND COMPUTING↗

Bay Area Regional Energy: Network Integrated Commercial Retrofits (BRICR) Project. Final Report

The BRICR project applied large-scale building energy modeling concepts with the aim of reducing the cost of energy efficiency targeting, design, and project development, and measurement of energy savings for energy efficiency programs implemented by local governments that serve small and medium commercial buildings (SMB). The project leveraged the services and resources of existing local government energy programs serving disadvantaged and hard-to-reach SMB customers. In contrast to programs run by utilities, local government programs generally do not have direct access to energy billing records for an entire class of customers in a geographic area, which prior research demonstrated useful for large-scale building energy model baseline development and calibration. , However, local governments are rich in public records that offer important clues about physical attributes and uses that, along with behavior, determine energy use. Relying only on public records, BRICR demonstrated development of credible baseline energy models for 3,792 office, retail, and hotel buildings. Publicly disclosed annual energy use data from a local energy benchmarking program and anonymized data from the Building Performance Database, the nation’s largest dataset about energy-related characteristics of buildings, were utilized to validate and calibrate energy models via an innovative method comparing distributions of energy intensity by fuel type for portfolios of buildings of similar size, vintage, and use. Portfolio calibration does not provide certainty that an energy model fits an individual building; the method is useful when billing data is not accessible – a common situation for researchers, energy service providers and ESCOs, local governments, and any party other than a utility. A software component was developed, the BRICR gem, which automates simulation when relevant data is added or edited by the user to a file saved in the standardized BuildingSync XML schema for energy audit data. The component was demonstrated as a simplified means to generate a mass of energy models corresponding to public records containing basic attributes such as building scale, location, use, year built, and aspect ratio in combination with building energy code prototype data corresponding to use and vintage. The component was also demonstrated as a simplified means to automate energy simulation when attributes are revised; the intention was to enable iterative improvement of the baseline model and energy savings estimates for common energy conservation measures as users revise relevant attributes based on their observations. In the context of institutional change and uncertainty for the participating local government energy programs, 13 whole building retrofits were completed. Impacts were measured by applying the CalTRACK2.0 methods to standardize measurement of normalized metered energy consumption. The GRIDMeter methods of stratified sampling and individual load shape analysis were applied to adjust for impacts of the effect of COVID-19 on retrofitted buildings in the context of all local buildings of similar size and use. Excluding impacts of the pandemic, retrofitted buildings demonstrated between 1.6% and 25.1% reduction in energy use. The project contributed use cases and feedback that helped inform evolution of the software tools and data formats that were combined for the first time in the BRICR project.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

INDEN Fissile Actinide Issues [Slides]

This presentation addresses the outlook for the International Nuclear Data Evaluation Network (INDEN), specifically regarding general issues that have been solved, including Thermal Neutron Constants (TNC) and Prompt Fission Neutron Spectra (PFNS). Other topics discussed include outstanding issues in fissile evaluations, comments on the RPI quasi-differential experiment, and reaction rate testing of trial evaluations in fast assemblies. The presentation concludes by discussing how INDEN interactions strongly helped to find deficiencies in existing evaluations and highlighted potential solutions to existing challenges, that updated trial evaluations for U-235, U-233, Pu-239 are available for testing, that further work is expected on U-235, Pu-239, and U-233, and that performance was tested on the ICSBEP and/or SINBAD benchmarks, during which significant improvement was demonstrated. The INDEN scheme of international collaboration on nuclear data evaluation is working well.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Improvements of Nuclear Data Evaluations for Lead Isotopes in Support of Next Generation Lead-Cooled Fast Systems

The neutron evaluation of the isotopes that comprise natural lead were undertaken as a part of DOE-NEUP Project #19-16739. The goal of the project was to update the neutron cross sections to account for new differential measurements and incorporate the most up-to-date physics. Shortcomings in the lead cross sections was made known by several independent reports. The work performed here repeated the simulation of all the “benchmark” validation systems and concluded that the major issue is the scattering cross sections in the major lead isotopes above 100 keV. Re-evaluation of 206,207,208 Pb included both the resolved resonance region and fast region evaluations of the cross sections. Combined these regions cover energies from thermal to 20 MeV. The most drastic improvement is the resolved resonance region evaluation of 208 Pb which is now extended from 1.0 to 1.5 MeV. Parameterization of these resonances in the R-matrix provides a superior reconstruction of not only the experimental cross section but also the scattering distributions via the Blatt-Biedenharn formalism. Fast region evaluations of the three major isotopes were done to include new inelastic experimental data from the neutron Time-of-Flight facility at CERN. The culmination of all the changes to the cross section is a drastic improvement in the scattering kernel as shown in Rensselaer Polytechnic Institute (RPI) Quasi-Differential scattering measurements and improved prediction of keff for fast integral experiments. Alongside the new cross sections, new nuclear data covariance (uncertainties) have been computed and are included in the evaluation. Little is changed in the magnitude of the uncertainties but the correlations within the covariance display non-trivial changes. The new evaluations of 206,207,208 Pb have been submitted to the National Nuclear Data Center to be included in the ENDF/B-VIII.1 library. While the cross sections have been updated extensively, knowledge and modeling of the cross sections between 1.0 and 3.0 MeV for the isotopes remain a challenge. Most notably is the double differential elastic cross section for 208 Pb and 206 Pb. New quasi-differential measurements for pure samples of these two nuclei would go a long way in reducing compensating errors in the evaluations. Qualitatively, the project has produced a prosperous collaboration between the nuclear data group at RPI with staff scientists at Brookhaven National Laboratory, Naval Nuclear Laboratory, Oak Ridge National Laboratory, Los Alamos National Laboratory, Lawrence Livermore National Laboratory, and Sandia National Laboratories. Quantitatively this is reflected in seven conference presentations, at least one journal submission, and one doctoral thesis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

5G-TSN Architecture Capable of Providing Real-time Situational Awareness to Fossil-Energy (FE) Generation Systems (Final Technical Report)

This final report highlights the comprehensive achievements of the project focused on developing and validating a 5G-Time Sensitive Networking (TSN) architecture tailored for real-time operational awareness in fossil energy systems. The initiative successfully advanced through a series of technical milestones, including the integration of EMI-aware network models, deployment of advanced simulation frameworks, and real-world performance characterization at key sites such as UTEP and Fabens. Through the strategic use of NetSim® software, the team created and validated network configurations for wired and wireless environments, tested under varying congestion conditions, and verified network slicing implementations for URLLC-specific applications. Major accomplishments include the migration of simulation tools to the latest NetSim® version to support accurate modeling of TSN and network slicing, extensive EMI measurement campaigns, and the development of a robust simulation model for end-to-end SCADA system integration. Simulations compared both TDD and FDD duplexing modes, revealing insights into their performance under congested conditions. The wireless network was benchmarked for throughput, jitter, and delay metrics, aligning with 3GPP Release 15/16 and IEEE 802.1-TSN standards. A peer-reviewed conference paper was accepted and published, contributing to the broader academic and industrial discourse on 5G-TSN integration in energy systems, in addition to a journal article. Despite minor delays due to software limitations, the project achieved its objectives and delivered validated architecture ready for deployment in advanced energy network environments.

01 COAL, LIGNITE, AND PEAT↗

Adapting ORAP to wind plants : industry value and functional requirements.

Strategic Power Systems (SPS) was contracted by Sandia National Laboratories to assess the feasibility of adapting their ORAP (Operational Reliability Analysis Program) tool for deployment to the wind industry. ORAP for Wind is proposed for use as the primary data source for the CREW (Continuous Reliability Enhancement for Wind) database which will be maintained by Sandia to enable reliability analysis of US wind fleet operations. The report primarily addresses the functional requirements of the wind-based system. The SPS ORAP reliability monitoring system has been used successfully for over twenty years to collect RAM (Reliability, Availability, Maintainability) and operations data for benchmarking and analysis of gas and steam turbine performance. This report documents the requirements to adapt the ORAP system for the wind industry. It specifies which existing ORAP design features should be retained, as well as key new requirements for wind. The latter includes alignment with existing and emerging wind industry standards (IEEE 762, ISO 3977 and IEC 61400). There is also a comprehensive list of thirty critical-to-quality (CTQ) functional requirements which must be considered and addressed to establish the optimum design for wind.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Efficient Ensemble-Based Stochastic Gradient Methods for Optimization Under Geological Uncertainty

Ensemble-based stochastic gradient methods, such as the ensemble optimization (EnOpt) method, the simplex gradient (SG) method, and the stochastic simplex approximate gradient (StoSAG) method, approximate the gradient of an objective function using an ensemble of perturbed control vectors. These methods are increasingly used in solving reservoir optimization problems because they are not only easy to parallelize and couple with any simulator but also computationally more efficient than the conventional finite-difference method for gradient calculations. In this work, we show that EnOpt may fail to achieve sufficient improvement of the objective function when the differences between the objective function values of perturbed control variables and their ensemble mean are large. On the basis of the comparison of EnOpt and SG, we propose a hybrid gradient of EnOpt and SG to save on the computational cost of SG. We also suggest practical ways to reduce the computational cost of EnOpt and StoSAG by approximating the objective function values of unperturbed control variables using the values of perturbed ones. We first demonstrate the performance of our improved ensemble schemes using a benchmark problem. Results show that the proposed gradients saved about 30–50% of the computational cost of the same optimization by using EnOpt, SG, and StoSAG. As a real application, we consider pressure management in carbon storage reservoirs, for which brine extraction wells need to be optimally placed to reduce reservoir pressure buildup while maximizing the net present value. Results show that our improved schemes reduce the computational cost significantly.

58 GEOSCIENCES↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models

We present a new atmospheric river (AR) analysis and benchmarking tool, namely Atmospheric River Metrics Package (ARMP). It includes a suite of new AR metrics that are designed for quick analysis of AR characteristics via statistics in gridded climate datasets such as model output and reanalysis. This package can be used for climate model evaluation in comparison with reanalysis and observational products. Integrated metrics such as mean bias and spatial pattern correlation are efficient for diagnosing systematic AR biases in climate models. For example, the package identifies the fact that, in CMIP5 and CMIP6 (Coupled Model Intercomparison Project Phases 5 and 6) models, AR tracks in the South Atlantic are positioned farther poleward compared to ERA5 reanalysis, while in the South Pacific, tracks are generally biased towards the Equator. For the landfalling AR peak season, we find that most climate models simulate a completely opposite seasonal cycle over western Africa. This tool can also be used for identifying and characterizing structural differences among different AR detectors (ARDTs). For example, ARs detected with the Mundhenk algorithm exhibit systematically larger size, width, and length compared to the TempestExtremes (TE) method. The AR metrics developed from this work can be routinely applied for model benchmarking and during the development cycle to trace performance evolution across model versions or generations and set objective targets for the improvement of models. They can also be used by operational centers to perform near-real-time climate and extreme event impact assessments as part of their forecast cycle.

58 GEOSCIENCES↗

Multi-Level Bitmap Indexes for Flash Memory Storage

Due to their low access latency, high read speed, and power-efficient operation, flash memory storage devices are rapidly emerging as an attractive alternative to traditional magnetic storage devices. However, tests show that the most efficient indexing methods are not able to take advantage of the flash memory storage devices. In this paper, we present a set of multi-level bitmap indexes that can effectively take advantage of flash storage devices. These indexing methods use coarsely binned indexes to answer queries approximately, and then use finely binned indexes to refine the answers. Our new methods read significantly lower volumes of data at the expense of an increased disk access count, thus taking full advantage of the improved read speed and low access latency of flash devices. To demonstrate the advantage of these new indexes, we measure their performance on a number of storage systems using a standard data warehousing benchmark called the Set Query Benchmark. We observe that multi-level strategies on flash drives are up to 3 times faster than traditional indexing strategies on magnetic disk drives.

97 MATHEMATICS AND COMPUTING↗

Power Signature Analysis of the SPECpower_ssj2008 Benchmark

As the power consumption of a server system becomes a mainstream concern in enterprise environments, understanding the system's power behavior at varying utilization levels provides us a key to select appropriate energy-efficiency optimizations. In this work, we present an in-depth analysis of 177 SPECpower_ssj2008 results published between 2007--2010 to understand the changes of server's power behavior over time. In particular, we identified simple nonlinear functions appropriate for modeling the power behavior of today's, aggressively power-managed, machines. We consider this work as an important first step towards developing capability for power signature analysis of a high-end computer system.

99 GENERAL AND MISCELLANEOUS↗

OVERVIEW OF A RECONFIGURABLE SIMULATOR FOR MAIN CONTROL ROOM UPGRADES IN NUCLEAR POWER PLANTS

This paper provides background on a reconfigurable control room simulator for nuclear power plants. The main control rooms in current nuclear power plants feature analog technology that is growing obsolete. The need to upgrade control rooms serves the practical need of maintainability as well as the opportunity to implement newer digital technologies with added functionality. There currently exists no dedicated research simulator for use in human factors design and evaluation activities for nuclear power plant modernization in the U.S. The new research simulator discussed in this paper provides a test bed in which operator performance on new control room concepts can be benchmarked against existing control rooms and in which new technologies can be validated for safety and usability prior to deployment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

BEYOND INTEGRATED SYSTEM VALIDATION: USE OF A CONTROL ROOM TRAINING SIMULATOR FOR PROOF-OF-CONCEPT INTERFACE DEVELOPMENT

This paper provides background on a reconfigurable control room simulator for nuclear power plants. The main control rooms in current nuclear power plants feature analog technology that is growing obsolete. The need to upgrade control rooms serves the practical need of maintainability as well as the opportunity to implement newer digital technologies with added functionality. There currently exists no dedicated research simulator for use in human factors design and evaluation activities for nuclear power plants in the US. The new research simulator discussed in this paper provides a test bed in which operator performance on new control room concepts can be benchmarked against existing control rooms and in which new technologies can be validated for safety and usability prior to deployment.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Monte Carlo Benchmark

The "Monte Carlo Benchmark" (MCB) is intended to model the computatiional performance of Monte Carlo algorithms on parallel architectures. It models the solution of a simple heuristic transport equation using a Monte Carlo technique. The MCB employs typical features of Monte Carlo algorithms such as particle creation, particle tracking, tallying particle information, and particle destruction. Particles are also traded among processors using MPI calls.

Source record↗

Uncertainty Quantification on SAM Simulations of EBR-II Loss-of-Flow Tests

The System Analysis Module (SAM) is a modern system analysis tool being developed at Argonne National Laboratory for advanced non-LWR safety analysis. It aims to provide fast-running, whole-plant transient analyses capability with improved-fidelity for SFR, LFR, and MSR/FHR. In prior work, SAM has performed well in modeling the EBR-II benchmark based on the SHRT-17 and SHRT-45R protected and unprotected loss-of-flow experiments. However, underlying uncertainties in the modeling parameters need to be quantified to gain confidence in any best-estimate simulations. In this work, a Python coupling framework between Dakota and SAM has been developed to investigate these uncertainties, alongside code enhancements in SAM for user-flexibility in perturbing physical closure models and fluid equations of state. 25 significant input parameters covering boundary conditions, geometry, physical closure models, and equations of state were identified with their uncertainties defined from literature. Two SAM transient models for SHRT-17 and SHRT-45R were perturbed on these input parameters using Latin Hypercube Sampling and the uncertainties in predicted maximum fuel, cladding, and coolant temperatures were quantified as the output responses. Spearman rank correlation of input parameters to the predicted temperatures indicated that the most sensitive parameters include the initial core power, pipe wall drag, fuel & coolant conductivity, and peak channel flow area. Sensitivity of input parameters was found to differ between the two transients and core channel modeling strategies. The overall perturbations did not result in large uncertainties in the predicted temperatures, despite the efforts made to obtain accurate yet conservative input uncertainties.

Mui, Travis↗

Accelerating the Inference of the Exa.TrkX Pipeline

Recently, graph neural networks (GNNs) have been successfully used for a variety of particle reconstruction problems in high energy physics, including particle tracking. The Exa.TrkX pipeline based on GNNs demonstrated promising performance in reconstructing particle tracks in dense environments. It includes five discrete steps: data encoding, graph building, edge filtering, GNN, and track labeling. All steps were written in Python and run on both GPUs and CPUs. In this work, we accelerate the Python implementation of the pipeline through customized and commercial GPU-enabled software libraries, and develop a C++ implementation for inferencing the pipeline. The implementation features an improved, CUDA-enabled fixed-radius nearest neighbor search for graph building and a weakly connected component graph algorithm for track labeling. GNNs and other trained deep learning models are converted to ONNX and inferenced via the ONNX Runtime C++ API. The complete C++ implementation of the pipeline allows integration with existing tracking software. We report the memory usage and average event latency tracking performance of our implementation applied to the TrackML benchmark dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Advancing the Theory of Nuclear Data Evaluations [Abstract]

We present recent advances in the R-matrix formalism as well as the Bayesian evaluation framework for improved nuclear data evaluations. The advances in the R matrix formalism include: 1) direct processes, 2) doorway, as well as multistep, processes, and 3) various forms of the Reich-Moore approximation for eliminated capture channels. Furthermore, to address unreasonably small posterior uncertainties often encountered in nuclear data evaluations of large data sets using the conventional form of the Bayes’ theorem, we introduce imperfections (of the data or the model) as a formal evaluation tool for taming the evaluated uncertainties in harmony with Bayes’ theorem. These theoretical advances were motivated by the nuclear data evaluations of differential resolved resonance cross section data using the code SAMMY, as well as the integral benchmark experiments using the SCALE code system, being performed at Oak Ridge National Laboratory for the Nuclear Criticality Safety Program. Some pedagogical applications of the new formalism, as well as a snapshot of the SAMMY modernization efforts, will be presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary Results for Uncertainty Quantification on Asymptotic Hydrogen Redistribution in a Prototypical Yttrium-Hydride Moderated Heat-Pipe-Cooled Microreactor

Yttrium hydride is one of the most promising materials for moderating nuclear microreactors. This is due to its high hydrogen concentration at high operating conditions, high value of thermal conductivity, and chemical stability. However, when subject to thermal and concentration spatial gradients, the hydrogen tends to migrate within the yttrium matrix, potentially leading to power swings and reactivity changes. This paper aims to present selected results concerning the sensitivity of the thermal and hydrogen redistribution response for a prototypical heat-pipe-cooled yttrium-hydride moderated microreactor to thermal properties uncertainty and selected design characteristics. To the best knowledge of the authors, this is the first study examining the impact of uncertainties on microreactor hydrogen redistribution response. To achieve this goal, Bison was used in conjunction with Dakota to create a framework able to perform Uncertainty Quantification (UQ) for the Simplified Microreactor Benchmark Assessment (SiMBA) problem.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗