Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

High-Fidelity CFD Assessments of Flow Resistance in a 61-Pin Wire-Wrapped Assembly with Partially Blocked Channels

The examination of thermal-hydraulic behaviors in wire-wrapped rod bundles continues to be an active area of research. The sodium fast reactor, a prominent candidate in next-generation nuclear designs, utilizes a hexagonal configuration of wire-wrapped fuel pins. Here, the potential for channel blockage within this compact arrangement poses a significant safety challenge, spurring a number of recent experimental and computational investigations to evaluate its impact on flow and heat transfer. The present work aims to benchmark the high-fidelity NekRS computational fluid dynamics (CFD) solver in predicting the pressure drops associated with substantial blockages, using available experimental data as a reference. A 61-pin wire-wrapped fuel assembly with two flow blockage configurations has been simulated and investigated at a range of low to moderate Reynolds numbers (487 ≤ Re ≤ 14 600). The NekRS solver demonstrates an exponential reduction of spatial discretization error with increasing polynomial order. The high level of agreement between the numerical results and measured data confirms the accuracy and consistency of the present numerical approach. This benchmark study establishes the capability of NekRS to perform reliable hydrodynamic simulations for sodium fast reactor applications and supports its use in design, licensing, and safety analyses.

CFD Benchmarking↗

Higher representations on the lattice: Numerical simulations, SU(2) with adjoint fermions

We discuss the lattice formulation of gauge theories with fermions in arbitrary representations of the color group and present in detail the implementation of the hybrid Monte Carlo (HMC)/rational HMC algorithm for simulating dynamical fermions. We discuss the validation of the implementation through an extensive set of tests and the stability of simulations by monitoring the distribution of the lowest eigenvalue of the Wilson-Dirac operator. Working with two flavors of Wilson fermions in the adjoint representation, benchmark results for realistic lattice simulations are presented. Runs are performed on different lattice sizes ranging from 4{sup 3}x8 to 24{sup 3}x64 sites. For the two smallest lattices we also report the measured values of benchmark mesonic observables. These results can be used as a baseline for rapid cross-checks of simulations in higher representations. The results presented here are the first steps toward more extensive investigations with controlled systematic errors, aiming at a detailed understanding of the phase structure of these theories, and of their viability as candidates for strong dynamics beyond the standard model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Additions to the ICSBEP and IRPHEP handbooks since NCSD 2013

Innumerable experiments have been performed worldwide to support criticality safety activities. Those experiments represent significant investments in cost, expertise, and infrastructure; as such, they represent valuable assets as the basis for recording, development, and validation of methods and nuclear data vital for modern and future criticality safety needs. Preservation and evaluation of these experimental data as benchmarks serves to provide for the best interest of the nuclear criticality safety community. High-quality integral benchmark experiments have always been a priority. There is ever growing interest in developing integral benchmark data to increasingly quantify and reduce calculational uncertainties to meet the demands of future criticality safety needs supporting next generation reactors and advanced fuel cycle concepts. The importance of drawing upon existing benchmark data is becoming more apparent because of dwindling availability of critical facilities worldwide and the high cost of performing new experiments. Integral benchmark data from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) and the International Handbook of Reactor Physics Benchmark Experiments (IRPhEP Handbook) are widely utilized. Significant benchmark data have been added to those two handbooks since the last Nuclear Criticality Safety Division Topical Meeting in Wilmington, North Carolina (September-October 2013). This paper highlights those additions. The 2016 edition of the ICSBEP Handbook now includes data for 570 evaluations containing benchmark specifications for 4913 critical, subcritical, or near-critical configurations, representing contributions from over 20 countries. There are a total of seven criticality-alarm-placement/shielding evaluations containing a total of 45 benchmark configurations, and eight fundamental physics benchmark evaluations containing a total of 215 measurements relevant to criticality safety applications. The IRPhEP Handbook now includes data from 151 experimental series (representing 50 reactor facilities) and also represents contributions from over 20 countries. Of the 151 benchmarks, five are draft contributions. Both the ICSBEP and IRPhEP are collaborative efforts that involve numerous scientists, engineers, and administrative support personnel worldwide. Continued contribution to these handbooks is expected to further provide the high-quality benchmark data necessary to compliment criticality safety activities going forward. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

An Efficient Hardware-Software Approach to Network Fault Tolerance with InfiniBand

In the last decade or so, clusters have observed a tremendous rise in popularity due to excellent price to performance ratio. A variety of Interconnects have been proposed during this period, with InfiniBand leading the way due to its high performance and open standard. Increasing size of the InfiniBand clusters has reduced the mean time between failures of various components of these clusters tremendously. In this paper, we specifically focus on the network component failure and propose a hybrid hardware-software approach to handling network faults. The hybrid approach leverages the user-transparent network fault detection and recovery using Automatic Path Migration (APM), and the software approach is used in the wake of APM failure. Using Global Arrays as the programming model, we implement this approach with Aggregate Remote Memory Copy Interface (ARMCI), the runtime system of Global Arrays. We evaluate our approach using various benchmarks (siosi7, pentane, h2o7 and siosi3) with NWChem, a very popular {\em ab initio} quantum chemistry application. Using the proposed approach, the applications run to completion without restart on emulated network faults and acceptable overhead for benchmarks executing for a longer period of time.

99 GENERAL AND MISCELLANEOUS↗

Evaluation and comparison of benchmark QSAR models to predict a relevant REACH endpoint: The bioconcentration factor (BCF)

The bioconcentration factor (BCF) is an important bioaccumulation hazard assessment metric in many regulatory contexts. Its assessment is required by the REACH regulation (Registration, Evaluation, Authorization and Restriction of Chemicals) and by CLP (Classification, Labeling and Packaging). We challenged nine well-known and widely used BCF QSAR models against 851 compounds stored in an ad-hoc created database. The goodness of the regression analysis was assessed by considering the determination coefficient (R{sup 2}) and the Root Mean Square Error (RMSE); Cooper's statistics and Matthew's Correlation Coefficient (MCC) were calculated for all the thresholds relevant for regulatory purposes (i.e. 100 L/kg for Chemical Safety Assessment; 500 L/kg for Classification and Labeling; 2000 and 5000 L/kg for Persistent, Bioaccumulative and Toxic (PBT) and very Persistent, very Bioaccumulative (vPvB) assessment) to assess the classification, with particular attention to the models' ability to control the occurrence of false negatives. As a first step, statistical analysis was performed for the predictions of the entire dataset; R{sup 2}>0.70 was obtained using CORAL, T.E.S.T. and EPISuite Arnot–Gobas models. As classifiers, ACD and log P-based equations were the best in terms of sensitivity, ranging from 0.75 to 0.94. External compound predictions were carried out for the models that had their own training sets. CORAL model returned the best performance (R{sup 2}{sub ext}=0.59), followed by the EPISuite Meylan model (R{sup 2}{sub ext}=0.58). The latter gave also the highest sensitivity on external compounds with values from 0.55 to 0.85, depending on the thresholds. Statistics were also compiled for compounds falling into the models Applicability Domain (AD), giving better performances. In this respect, VEGA CAESAR was the best model in terms of regression (R{sup 2}=0.94) and classification (average sensitivity>0.80). This model also showed the best regression (R{sup 2}=0.85) and sensitivity (average>0.70) for new compounds in the AD but not present in the training set. However, no single optimal model exists and, thus, it would be wise a case-by-case assessment. Yet, integrating the wealth of information from multiple models remains the winner approach. - Highlights: • REACH encourages the use of in silico methods in the assessment of chemicals safety. • The performances of nine BCF models were evaluated on a benchmark database of 851 chemicals. • We compared the models on the basis of both regression and classification performance. • Statistics on chemicals out of the training set and/or within the applicability domain were compiled. • The results show that QSAR models are useful as weight-of-evidence in support to other methods.

54 ENVIRONMENTAL SCIENCES↗

Benchmark probabilistic solar forecasts: Characteristics and recommendations

We illustrate and compare commonly used benchmark, or reference, methods for probabilistic solar forecasting that researchers use to measure the performance of their proposed techniques. A thorough review of the literature indicates wide variation in the benchmarks implemented in probabilistic solar forecast studies. To promote consistent and sensible methodological comparisons, we implement and compare ten variants from six common benchmark classes at two temporal scales: intra-hourly forecasts and hourly resolution forecasts. Using open-source Surface Radiation Budget Network (SURFRAD) data from 2018, these benchmark methods are compared using proper probabilistic metrics and common diagnostic tools. Practical implementation issues, such as the impact of missing data and applicability for operational forecasting, are also discussed. Furthermore, we make recommendations for practitioners on the appropriate selection of benchmark methods to properly showcase state-of-the-art improvements in forecast reliability and sharpness. All code and open-source data are available on Github for reproducibility and for other researchers to apply the same benchmark methods to their own data.

14 SOLAR ENERGY↗

Performance Analysis of and Tool Support for Transactional Memory on BG/Q

Martin Schindewolf worked during his internship at the Lawrence Livermore National Laboratory (LLNL) under the guidance of Martin Schulz at the Computer Science Group of the Center for Applied Scientific Computing. We studied the performance of the TM subsystem of BG/Q as well as researched the possibilities for tool support for TM. To study the performance, we run CLOMP-TM. CLOMP-TM is a benchmark designed for the purpose to quantify the overhead of OpenMP and compare different synchronization primitives. To advance CLOMP-TM, we added Message Passing Interface (MPI) routines for a hybrid parallelization. This enables to run multiple MPI tasks, each running OpenMP, on one node. With these enhancements, a beneficial MPI task to OpenMP thread ratio is determined. Further, the synchronization primitives are ranked as a function of the application characteristics. To demonstrate the usefulness of these results, we investigate a real Monte Carlo simulation called Monte Carlo Benchmark (MCB). Applying the lessons learned yields the best task to thread ratio. Further, we were able to tune the synchronization by transactifying the MCB. Further, we develop tools that capture the performance of the TM run time system and present it to the application's developer. The performance of the TM run time system relies on the built-in statistics. These tools use the Blue Gene Performance Monitoring (BGPM) interface to correlate the statistics from the TM run time system with performance counter values. This combination provides detailed insights in the run time behavior of the application and enables to track down the cause of degraded performance. Further, one tool has been implemented that separates the performance counters in three categories: Successful Speculation, Unsuccessful Speculation and No Speculation . All of the tools are crafted around IBM's xlc compiler for C and C++ and have been run and tested on a Q32 early access system.

97 MATHEMATICS AND COMPUTING↗

A performance comparison of current HPC systems: Blue Gene/Q, Cray XE6 and InfiniBand systems

We present here a performance analysis of three of current architectures that have become commonplace in the High Performance Computing world. Blue Gene/Q is the third generation of systems from IBM that use modestly performing cores but at large-scale in order to achieve high performance. The XE6 is the latest in a long line of Cray systems that use a 3-D topology but the first to use its Gemini interconnection network. InfiniBand provides the flexibility of using compute nodes from many vendors that can be connected in many possible topologies. The performance characteristics of each vary vastly, and the way in which nodes are allocated in each type of system can significantly impact on achieved performance. In this work we compare these three systems using a combination of micro-benchmarks and a set of production applications. In addition we also examine the differences in performance variability observed on each system and quantify the lost performance using a combination of both empirical measurements and performance models. Our results show that significant performance can be lost in normal production operation of the Cray XE6 and InfiniBand Clusters in comparison to Blue Gene/Q.

Application analysis↗

MICADO: Parallel implementation of a 2D-1D iterative algorithm for the 3D neutron transport problem in prismatic geometries

The large increase in computing power over the past few years now makes it possible to consider developing 3D full-core heterogeneous deterministic neutron transport solvers for reference calculations. Among all approaches presented in the literature, the method first introduced in [1] seems very promising. It consists in iterating over resolutions of 2D and ID MOC problems by taking advantage of prismatic geometries without introducing approximations of a low order operator such as diffusion. However, before developing a solver with all industrial options at EDF, several points needed to be clarified. In this work, we first prove the convergence of this iterative process, under some assumptions. We then present our high-performance, parallel implementation of this algorithm in the MICADO solver. Benchmarking the solver against the Takeda case shows that the 2D-1D coupling algorithm does not seem to affect the spatial convergence order of the MOC solver. As for performance issues, our study shows that even though the data distribution is suited to the 2D solver part, the efficiency of the ID part is sufficient to ensure a good parallel efficiency of the global algorithm. After this study, the main remaining difficulty implementation-wise is about the memory requirement of a vector used for initialization. An efficient acceleration operator will also need to be developed. (authors)

97 MATHEMATICS AND COMPUTING↗

Parallel, Multigrid Finite Element Simulator for Fractured/Faulted and Other Complex Reservoirs based on Common Component Architecture (CCA)

Black-oil, compositional and thermal simulators have been developed to address different physical processes in reservoir simulation. A number of different types of discretization methods have also been proposed to address issues related to representing the complex reservoir geometry. These methods are more significant for fractured reservoirs where the geometry can be particularly challenging. In this project, a general modular framework for reservoir simulation was developed, wherein the physical models were efficiently decoupled from the discretization methods. This made it possible to couple any discretization method with different physical models. Oil characterization methods are becoming increasingly sophisticated, and it is possible to construct geologically constrained models of faulted/fractured reservoirs. Discrete Fracture Network (DFN) simulation provides the option of performing multiphase calculations on spatially explicit, geologically feasible fracture sets. Multiphase DFN simulations of and sensitivity studies on a wide variety of fracture networks created using fracture creation/simulation programs was undertaken in the first part of this project. This involved creating interfaces to seamlessly convert the fracture characterization information into simulator input, grid the complex geometry, perform the simulations, and analyze and visualize results. Benchmarking and comparison with conventional simulators was also a component of this work. After demonstration of the fact that multiphase simulations can be carried out on complex fracture networks, quantitative effects of the heterogeneity of fracture properties were evaluated. Reservoirs are populated with fractures of several different scales and properties. A multiscale fracture modeling study was undertaken and the effects of heterogeneity and storage on water displacement dynamics in fractured basements were investigated. In gravity-dominated systems, more oil could be recovered at a given pore volume of injection at lower rates. However, if oil production can be continued at high water cuts, the discounted cumulative production usually favors higher production rates. The workflow developed during the project was also used to perform multiphase simulations in heterogeneous, fracture-matrix systems. Compositional and thermal-compositional simulators were developed for fractured reservoirs using the generalized framework. The thermal-compositional simulator was based on a novel 'equation-alignment' approach that helped choose the correct variables to solve depending on the number of phases present and the prescribed component partitioning. The simulators were used in steamflooding and in insitu combustion applications. The framework was constructed to be inherently parallel. The partitioning routines employed in the framework allowed generalized partitioning on highly complex fractured reservoirs and in instances when wells (incorporated in these models as line sources) were divided between two or more processors.

02 PETROLEUM↗

IER-501 CED-3b: Experiment Execution Summary for the Pulsed-Neutron Die-Away Experimental Testbed for Thermal Scattering Law Benchmarks (PNDA)

This report summarizes the experiments done for IER-501, a testbed for pulsed-neutron die-away (PNDA) experiments at Lawrence Livermore National Laboratory (LLNL). The PNDA experiments were conducted in two separate two-day campaigns: one campaign for high-density polyethylene and another for Lucite. All experiments were performed at Lawrence Livermore Laboratory. They will become high-quality benchmarks that serve to optimize and validate thermal neutron scattering laws (TSLs), which are high priority nuclear data for the Department of Energy’s Nuclear Criticality Safety Program (NCSP). The report presents the PNDA design and its equipment, and it documents the experimental die-away curves. It presents the characterization measurements that have been performed to-date. Importantly, mass spectrometry measurements to determine sample impurities were not yet completed. These will be included in the final benchmark. The report gives the fitted decay constants for the die-away curves of each target sample. It also provides the data for the die-away curves in the appendices. The HDPE experiments examined twelve targets of varying size. The Lucite measurements included ten targets of varying size. Experimenters in the campaign were Daniel Siefman, William Zywiec, and Ruby Araj.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation

Parallel application benchmarks are indispensable for evaluating/optimizing HPC software and hardware. However, it is very challenging and costly to obtain high-fidelity benchmarks reflecting the scale and complexity of state-of-the-art parallel applications. Hand-extracted synthetic benchmarks are time-and labor-intensive to create. Real applications themselves, while offering most accurate performance evaluation, are expensive to compile, port, reconfigure, and often plainly inaccessible due to security or ownership concerns. This work contributes APPRIME, a novel tool for trace-based automatic parallel benchmark generation. Taking as input standard communication-I/O traces of an application's execution, it couples accurate automatic phase identification with statistical regeneration of event parameters to create compact, portable, and to some degree reconfigurable parallel application benchmarks. Experiments with four NAS Parallel Benchmarks (NPB) and three real scientific simulation codes confirm the fidelity of APPRIME benchmarks. They retain the original applications' performance characteristics, in particular the relative performance across platforms.

Jin, Ye↗

SiD Letter of Intent

This document presents the current status of the Silicon Detector (SiD) effort to develop an optimized design for an experiment at the International Linear Collider. It presents detailed discussions of each of SiD's various subsystems, an overview of the full GEANT4 description of SiD, the status of newly developed tracking and calorimeter reconstruction algorithms, studies of subsystem performance based on these tools, results of physics benchmarking analyses, an estimate of the cost of the detector, and an assessment of the detector R and D needed to provide the technical basis for an optimised SiD.

43 PARTICLE ACCELERATORS↗

Lensing simulations by Taylor expansion — not so inefficient after all

Cosmic Microwave Background lensing simulation by Taylor expansion has long been considered impractical due to slow convergence, but a recent flat-sky implementation shows that a simple trick eliminates this problem, making Taylor lensing a fast and simple lensing algorithm for the flat sky. Here we generalize the method to the full sky, and study its convergence and performance relative to a commonly used numerical code, Lenspix, with extensive benchmarks of both. Compared to the flat sky case, the method takes a speed hit due to the slow speed of spherical harmonic transforms compared to fast Fourier transforms, resulting in speeds of 1/3 to 2/3 of Lenspix for similar accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

A quantitative figure of merit for battery SEI films and their use as functional solid-state electrolytes

As a key passivation film that governs battery operation, the solid electrolyte interphase (SEI) has long been credited for enabling high-performance batteries or blamed for their eventual death. However, qualitative descriptions of the SEI often found in the literature (e.g., “conductive,” “passivating”) highlight our incomplete understanding of this layer, where even the most basic properties foundational to SEI function remain difficult to measure. Here, we quantify SEI conductivities and SEI transference numbers using a separator-free Cu|SEI|Li architecture that treats the SEI as a functional solid-state electrolyte (SSE). We find that while any SEI property alone (e.g., electronic conductivity) is weakly correlated (R 2 < 0.67) with battery performance (e.g., Coulombic efficiency), a strong correlation (R 2 > 0.99) can be achieved by defining the “SEI cT number” as a product between the SEI transference number (T) and the ratio of SEI conductivities (c). Analogous to the thermoelectric figure of merit (i.e., zT ), SEI cT quantitatively benchmarks the holistic impact of SEI properties on battery performance and underscores the pitfalls of citing such properties in isolation. Perhaps most strikingly, we demonstrate that Li metal deposition and stripping at room temperature is possible in our separator-free Cu|SEI|Li cell, confirming that the SEI can function precisely as an SSE. Together, these results enrich our understanding of the SEI, not just as a passivation layer but as a functional structure that can potentially have important implications for solid-state batteries.

Science & Technology - Other Topics↗

Runtime Systems for Energy Efficiency in Advanced Computing Systems

As heterogeneous systems become increasingly popular for both mobile and high-performance computing, conventional efficiency techniques such as dynamic voltage and frequency scaling (DVFS) fail to account for the tightly coupled and varied nature of systems on a chip (SoCs). In this work, we explore the impact of system unaware DVFS techniques on a mobile SoC under three benchmark suites: Chai, Rodinia, and Antutu. We then analyze performance trends across the suites to identify a set of consistent operating points that optimally balance power and performance across the system. The consistent operating points are then constructed into a dependency graph which can be leveraged to produce a more effective, SoC-wide governor.

97 MATHEMATICS AND COMPUTING↗

Effectively Using Remote I/O For Work Composition in Distributed Workflows

Distributed scientific workflows are becoming more important with the interest in incorporating AI into their loops. A critical programming and performance question is how to compose workflow tasks when data is produced on one system but must be consumed on another. Since the dominant technique is composition with remote I/O, this paper explores its performance expectations. We describe BigFlowSim, a workflow I/O simulator that captures key implementation choices for remote I/O, including intensity, reuse, locality, access pattern, and data movement.With BigFlowSim, we generate a synthetic benchmark. We quantify the effects of each parameter with a performance sensitivity study. We explain trends in terms of data movement reduction and show that, under certain conditions, it is possible to establish a total order among most parameters. We apply these insights to a high energy physics workflow, Belle II Monte Carlo and simulate several I/O optimizations. Speedups range from 5% to 2×, without changing compute time.

Friese, Ryan D.↗

Maxine Onsite: Estimating Dose from Chronic Atmospheric Radioactive Releases

Maxine Onsite: Developed to estimate dose to individuals who are working onsite but are not site employees. Follows the methodologies discussed in US NRC Regulatory Guides 1.109 and 1.111 to determine dose from a chronic atmospheric release. Determines the dose given relative air concentrations and deposition concentrations as input. We look at four locations onsite that may be accessed by members of the public. To show compliance with the EPA and DOE public dose limit of 10 mrem/yr, determining who is a member of the public or a worker onsite is necessary. SRS has defined a member of the public for NESHAPS and DOE O 458.1. Maxine Onsite runs on Microsoft Windows Operating System through a Microsoft Excel spreadsheet. Input from the user includes parameters that are variable such as air concentrations, and fixed, such as distance to the receptor and elemental iodine fraction. Maxine Onsite was developed from Maxine which is a program meant to calculate dose to the MEI via three pathways, external, inhalation, and ingestion. Maxine Onsite is meant for looking at the exposure through the external and inhalation pathways only, no local food production onsite. The ways that Maxine Onsite is used to calculate the dose to the MEI includes the following: - Determining the respective air concentration values at each location using distances from the release stack; - Breathing rates for the MEI; - Determining the amount of time the MEI is outside; - Determining the plume travel time. The following relative air and ground deposition values for proper execution of the spreadsheet come from MAXDOSE-SR and are needed to accurately determine the dose to the MEI: relative air concentration, relative air concentration decayed by 2.26 days, relative air concentration decayed and depleted for 8 days, and relative deposition. Test cases were designed, developed, and executed to determine the accuracy of Maxine Onsite, which were verified additionally through hand calculations. Several changes were made for testing, including varying air concentrations, distances, breathing rates, and shielding factors. Each test case was then verified through hand calculations to assure the accuracy of the calculated doses. The results from the test cases, as well as the default parameters, can be used for benchmarking Maxine Onsite in the future. Maxine Onsite performs as expected and produces correct and accurate results at each of the different locations onsite (TRL, B-Area Barracks, SRELCC, and Gunsite 51) for varying test cases. The input required by the user is minimal and includes the results of the dose to the MEI on the first page for ease of access. Future plans for Maxine Onsite include adding in the ingestion pathway and adding in atmospheric dispersion estimates to the spreadsheet.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗