Search NASA⌕ Search

SEARCH · Search NASA

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Comparison of Fully-Compressible Equation Sets for Atmospheric Dynamics

Traditionally, the equation for the conservation of energy used in atmospheric models is based on potential temperature and is used in place of the total energy conservation. This paper compares the application of the two equations sets for both the Euler and the Navier-Stokes solutions using several benchmark test cases. A high-resolution wave-propagation method which accurately takes into account the source term due to gravity is used for computing the non-hydrostatic atmospheric flows. It is demonstrated that there is little to no difference between the results obtained using the two different equation sets for Euler as well as Navier-Stokes solutions.

Ahmad, Nashat N.↗

INCORPORATION OF MONO SODIUM TITANATE AND CRYSTALLINE SILICOTITANATE FEEDS IN HIGH LEVEL NUCLEAR WASTE GLASS

Four series of glass compositions were selected, fabricated, and characterized as part of a study to determine the impacts of the addition of Crystalline Silicotitanate (CST) and Monosodium Titanate (MST) from the Small Column Ion Exchange (SCIX) process on the Defense Waste Processing Facility (DWPF) glass waste form and the applicability of the DWPF process control models. All of the glasses studied were considerably more durable than the benchmark Environmental Assessment (EA) glass. The measured Product Consistency Test (PCT) responses were compared with the predicted values from the current DWPF durability model. One of the KT01-series and two of the KT03-series glasses had measured PCT responses that were outside the lower bound of the durability model. All of the KT04 glasses had durabilities that were predictable regardless of heat treatment or compositional view. In general, the measured viscosity values of the KT01, KT03, and KT04-series glasses are well predicted by the current DWPF viscosity model. The results of liquidus temperature (T{sub L}) measurements for the KT01-series glasses were mixed with regard to the predictability of the T{sub L} for each glass. All of the measured T{sub L} values were higher than the model predicted values, although most fell within the 95% confidence intervals. Overall, the results of this study show a reasonable ability to incorporate the anticipated SCIX streams into DWPF-type glass compositions with TiO{sub 2} concentrations of 4-5 wt % in glass.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Monte Carlo Criticality Methods and Analysis Capabilities in SCALE

This paper describes the Monte Carlo codes KENO V.a and KENO-VI in SCALE that are primarily used to calculate multiplication factors and flux distributions of fissile systems. Both codes allow explicit geometric representation of the target systems and are used internationally for safety analyses involving fissile materials. KENO V.a has limiting geometric rules such as no intersections and no rotations. These limitations make KENO V.a execute very efficiently and run very fast. On the other hand, KENO-VI allows very complex geometric modeling. Both KENO codes can utilize either continuous-energy or multigroup cross-section data and have been thoroughly verified and validated with ENDF libraries through ENDF/B-VII.0, which has been first distributed with SCALE 6. Development of the Monte Carlo solution technique and solution methodology as applied in both KENO codes is explained in this paper. Available options and proper application of the options and techniques are also discussed. Finally, performance of the codes is demonstrated using published benchmark problems.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Tunable, Software-based DRAM Error Detection and Correction Library for HPC

Proposed exascale systems will present a number of considerable resiliency challenges. In particular, DRAM soft-errors, or bit-flips, are expected to greatly increase due to the increased memory density of these systems. Current hardware-based fault-tolerance methods will be unsuitable for addressing the expected soft error frequency rate. As a result, additional software will be needed to address this challenge. In this paper we introduce LIBSDC, a tunable, transparent silent data corruption detection and correction library for HPC applications. LIBSDC provides comprehensive SDC protection for program memory by implementing on-demand page integrity verification. Experimental benchmarks with Mantevo HPCCG show that once tuned, LIBSDC is able to achieve SDC protection with 50\% overhead of resources, less than the 100\% needed for double modular redundancy.

99 GENERAL AND MISCELLANEOUS↗

Using Whisper-1.1 to Guide Improvements to Nuclear Data Evaluations

Along with the latest release of the general purpose Monte Carlo radiation transport code, MCNP6.2, came the first officially released version of Whisper, version 1.1, a statistical analysis code used for nuclear criticality safety (NCS) validation. The Whisper software package is primarily used to calculate the upper subcritical limit (USL) of a particular application case along with components of the margin of subcriticality (MOS). In the calculation of the MOS due to nuclear data uncertainties, Whisper uses the generalized linear-least-squares (GLLS) approach to obtain adjusted nuclear data uncertainties which are then propagated to estimate the nuclear data uncertainties in the k eff of the application. Due to the fact that Whisper contains the simulated and measured k eff values for over 1100 benchmarks, nuclear data sensitivity profiles for each benchmark along with the nuclear data covariance matrices, all of which are used in the GLLS method, it is possible to easily utilize these data available to help guide improvements to nuclear data evaluations. In the present work, the Whisper data and the GLLS method are used together to suggest an adjusted nuclear data cross section evaluation specifically for 233 U such that the agreement between the calculated and experimental k eff measurements of the relevant benchmarks are improved. With this adjusted nuclear data available, feedback to the theoretical and experimental nuclear data community is provided.

97 MATHEMATICS AND COMPUTING↗

The International Experimental Thermal Hydraulic Systems database – TIETHYS: A new NEA validation tool

Nuclear reactor codes require validation with appropriate data representing the plant for specific scenarios. The thermal-hydraulic data is scattered in different locations and in different formats. Some of the data is in danger of being lost. A relational database is being developed to organize the international thermal hydraulic test data for various reactor concepts and different scenarios. At the reactor system level, that data is organized to include separate effect tests and integral effect tests for specific scenarios and corresponding phenomena. The database relies on the phenomena identification sections of expert developed PIRTs. The database will provide a summary of appropriate data, review of facility information, test description, instrumentation, references for the experimental data and some examples of application of the data for validation. The current database platform includes scenarios for PWR, BWR, VVER, and specific benchmarks for CFD modelling data and is to be expanded to include references for molten salt reactors. There are place holders for high temperature gas cooled reactors, CANDU and liquid metal reactors. This relational database is called The International Experimental Thermal Hydraulic Systems (TIETHYS) database and currently resides at Nuclear Energy Agency (NEA) of the OECD and is freely open to public access. Going forward the database will be extended to include additional links and data as they become available. https://www.oecd-nea.org/tiethysweb/

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of RELAP5-3D He-FUS3 Data

The RELAP5-3D computer code was validated using data from the HE FUS3 experimental facility. HE FUS3 is a helium-cooled, electrically-heated experimental facility that was used to generate experimental data for a benchmark exercise aimed at the validation of system transient analysis codes for very-high-temperature gas reactor applications. RELAP5-3D was validated using results from seven steady-state tests and one transient that simulated a loss-of-flow accident.

97 MATHEMATICS AND COMPUTING↗

Industry analytics to optimize time based maintenance for I and C components - 363

Using Industry Analytics to optimize time based maintenance for I and C components allows a nuclear site to increase cost efficiency without impacting equipment reliability. Reductions in frequency or deletions for non-value based Preventive Maintenance (PM) improves cost efficiency by decreasing man-hours, parts costs, and planning costs of that PM; while maintenance performed too frequently can induce maintenance related failures. Benchmarking Industry PM Performance and Equipment Failure data allows sites to efficiently optimize time based maintenance frequencies. Equipment Failure history identifies gaps in maintenance frequencies as well maintenance-induced failures. Overlapping the PM frequency from a site with Industry PM Performance identifies opportunities to justify cost savings by reducing the PM frequency. The opportunities are then validated by the site's living PM program to ensure that the site can support the extension. This paper will discuss an Industry analytical technique used for maintenance frequency reductions. The major aspects evaluated under the technique are validation of the Industry data, review of the component's history and comparison of additional information. Industry data from 180 sites is used as a benchmark to identify opportunities for PM frequency extension on like-for-like components based on manufacturer/model and application. The component history composed of preventive maintenance feedback history and corrective maintenance history is reviewed to determine if the frequency can be extended without adversely affecting equipment reliability. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

JRC-IRMM/ORNL Collaboration on Nuclear Data for Nuclear Criticality Safety - 14486

Concerns about using cross sections recommended in the main evaluated data libraries (i.e. ENDF/B, JEFF and JENDL) for nuclear criticality calculations have been a prime motivator for new cross section measurements. The measurements and evaluations discussed in this work are part of a collaboration between the Oak Ridge National Laboratory (ORNL) and the Institute for Reference Material and Measurements of the Joint Research Center (JRC-IRMM) of the European Commission (EC). They are performed in response to the US Nuclear Criticality Safety Program (NCSP) data needs. In particular, the NCSP five-year plan encompasses a listing of elements that have been identified for measurements and evaluations to address issues on criticality safety applications. This listing is based on data deficiency concerns in practical applications that are conveyed by criticality safety practitioners. In general these deficiencies are obtained through the analysis of benchmark calculations. A wealth of evaluations in the main libraries were derived from results of measurements made with poor time-of-flight resolution, and also the description of some data in the neutron energy range above several tens of keV is crude. This impacts both the resolved and unresolved resonance region, and leads to bias effects when resonance structures play an important role. As a consequence only average corrections can be applied in calculations for nuclear criticality calculations where self-shielding, multiple scattering, or Doppler broadening are important. This can lead to erroneous results. Furthermore, many evaluations for nuclides having small neutron-capture cross sections show erroneously high cross sections because the influence of the neutron sensitivity of the old measurement systems was underestimated. Although their neutron capture cross sections are small, these nuclides, if occurring in large amounts, can be important absorbers in criticality calculations, so an accurate determination of these cross sections is required. Over the last seven years the JRC-IRMM/ORNL collaboration has produced many neutron induced cross section data using the Geel Electron Linear Accelerator (GELINA) neutron time-of-flight facility. This facility is ideally suited to measure total, fission and capture cross sections in the energy range from 1 eV to ∼600 keV, which is important for nuclear criticality calculations. In this paper the facility and experimental set-ups at GELINA will be described together with the data reduction and analysis procedures which result in experimental observables including their full covariance information. The importance of combining transmission and partial cross section data will be emphasized. We will give a list of the measured nuclides and discuss the impact of the resulting data and evaluations. (authors)

42 ENGINEERING↗

wa-hls4ml and lui-gnn: A benchmark and GNN-based surrogate model for hls4ml resource and latency estimation

As machine learning (ML) increasingly serves as a tool for addressing real-time challenges in scientific applications, the development of advanced tooling has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as model synthesis, are now becoming limiting factors in the rapid iteration of designs. To reduce these emerging constraints, multiple efforts are being launched toward designing an ML-based surrogate model that estimates resource usage of synthesized accelerator architectures. This model would reduce the design iteration time, especially when designing within a set of given hardware constraints. This approach shows considerable potential, but as it stands, the effort is early and would benefit from coordination and standardization to assist future work as it emerges. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of more than 100,000 fully connected neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. In addition to the resource utilization and latency data provided, the dataset includes generated artifacts and log files for many of the synthesized neural networks, in order to support future research in ML-based code generation. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, as well as the average performance across a subset of the dataset. We measure the performance of a given predictor model through multiple metrics, including $R^2$ score and SMAPE on regression tasks, as well as inference time to further characterize the estimator under test. Additionally, we introduce the latency/utilization inference graph neural network (lui-gnn), a surrogate model that uses a graph neural network to represent input architectures in the form of a directed graph. This graph representation allows for a diverse set of model architectures to all be effectively handled by a surrogate model. We present the architecture and performance of the model, as evaluated by the new proposed benchmark, including SMAPE, $R^2$ score, and inference times, and find that lui-gnn generally predicts latency and utilization for the 75\% quantile within several percent of the synthesized resources on the synthetic test dataset, indicating that this approach of estimating resource and latency via a surrogate models has promise and warrants further research.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Applying Graph Partitioning Methods in Measurement-Based Dynamic Load Balancing

Load imbalance can lead to wasted CPU hours especially when running on a large number of processors. Achieving the best parallel efficiency for a program requires optimal load balancing which is a NP-hard problem. Charm++, a migratable objects based programming model, provides a measurement-based dynamic load balancing frame work. This paper explores the use of graph partitioning algorithms, traditionally used for partitioning physical domains/meshes, for measurement based dynamic load balancing of parallel applications. In particular, we present repartitioning methods developed in a graph partitioning toolbox called Scotch that consider the previous mapping to minimize migration costs. We also discuss a new imbalance reduction algorithm for graphs with irregular load distributions. We compare several load balancing algorithms using a micro-benchmark and the NAS BT multi-zone bench mark. New algorithms developed in Scotch lead to better performance compared to other existing partitioners, both in terms of the application execution time and fewer number of objects migrated.

97 MATHEMATICS AND COMPUTING↗

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗

The MCNP6 Analytic Criticality Benchmark Suite

Analytical benchmarks provide an invaluable tool for verifying computer codes used to simulate neutron transport. Several collections of analytical benchmark problems [1-4] are used routinely in the verification of production Monte Carlo codes such as MCNP® [5,6]. Verification of a computer code is a necessary prerequisite to the more complex validation process. The verification process confirms that a code performs its intended functions correctly. The validation process involves determining the absolute accuracy of code results vs. nature. In typical validations, results are computed for a set of benchmark experiments using a particular methodology (code, cross-section data with uncertainties, and modeling) and compared to the measured results from the set of benchmark experiments. The validation process determines bias, bias uncertainty, and possibly additional margins. Verification is generally performed by the code developers, while validation is generally performed by code users for a particular application space. The VERIFICATION_KEFF suite of criticality problems [1,2] was originally a set of 75 criticality problems found in the literature for which exact analytical solutions are available. Even though the spatial and energy detail is necessarily limited in analytical benchmarks, typically to a few regions or energy groups, the exact solutions obtained can be used to verify that the basic algorithms, mathematics, and methods used in complex production codes perform correctly. The present work has focused on revisiting this benchmark suite. A thorough review of the problems resulted in discarding some of them as not suitable for MCNP benchmarking. For the remaining problems, many of them were reformulated to permit execution in either multigroup mode or in the normal continuous-energy mode for MCNP. Execution of the benchmarks in continuous-energy mode provides a significant advance to MCNP verification methods.

97 MATHEMATICS AND COMPUTING↗

I/O Performance of Virtualized Cloud Environments

The scientific community is exploring the suitability of cloud infrastructure to handle High Performance Computing (HPC) applications. The goal of Magellan, a project funded through DOE ASCR, is to investigate the potential role of cloud computing to address the computing needs of the Department of Energy?s Office of Science, especially for mid-range computing and data-intensive applications which are not served through existing DOE centers today. Prior work has shown that applications with significant communication orI/O tend to perform poorly in virtualized cloud environments. However, there is a limited understanding of the I/O characteristics in virtualized cloud environments. This paper will present our results in benchmarking the I/O performance over different cloud and HPC platforms to identify the major bottlenecks in existing infrastructure. We compare the I/O performance using IOR benchmark on two cloud platforms - Amazon and Magellan. We analyze the performance of different storage options available, different instance types in multiple availability zones. Finally, we perform large-scale tests in order to analyze the variability in the I/O patterns over time and region. Our results highlight the overhead and variability in I/O performance on both public and private cloud solutions. Our results will help applications decide between the different storage options enabling applications to make effective choices.

97 MATHEMATICS AND COMPUTING↗

DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

Abstract Recent advances in computer vision (CV) and natural language processing have been driven by exploiting big data on practical applications. However, these research fields are still limited by the sheer volume, versatility, and diversity of the available datasets. CV tasks, such as image captioning, which has primarily been carried out on natural images, still struggle to produce accurate and meaningful captions on sketched images often included in scientific and technical documents. The advancement of other tasks such as 3D reconstruction from 2D images requires larger datasets with multiple viewpoints. We introduce DeepPatent2, a large-scale dataset, providing more than 2.7 million technical drawings with 132,890 object names and 22,394 viewpoints extracted from 14 years of US design patent documents. We demonstrate the usefulness of DeepPatent2 with conceptual captioning. We further provide the potential usefulness of our dataset to facilitate other research areas such as 3D image reconstruction and image retrieval.

97 MATHEMATICS AND COMPUTING↗

Planetary benchmarks

Design criteria and technology requirements for a system of radar reference devices to be fixed to the surfaces of the inner planets are discussed. Offshoot applications include the use of radar corner reflectors as landing beacons on the planetary surfaces and some deep space applications that may yield a greatly enhanced knowledge of the gravitational and electromagnetic structure of the solar system. Passive retroreflectors with dimensions of about 4 meters and weighing about 10 kg are feasible for use with orbiting radar at Venus and Mars. Earth-based observation of passive reflectors, however, would require very large and complex structures to be delivered to the surfaces. For Earth-based measurements, surface transponders offer a distinct advantage in accuracy over passive reflectors. A conceptual design for a high temperature transponder is presented. The design appears feasible for the Venus surface using existing electronics and power components.

Uphoff, C.↗

An Evaluation of Molecular Dynamics Performance on the Hybrid Cray XK6 Supercomputer

For many years, the drive towards computational physics studies that match the size and time-scales of experiment has been fueled by increases in processor and interconnect performance that could be exploited with relatively little modification to existing codes. Engineering and electrical power constraints have disrupted this trend, requiring more drastic changes to both hardware and software solutions. Here, we present details of the Cray XK6 architecture that achieves increased performance with the use of GPU accelerators. We review software development efforts in the LAMMPS molecular dynamics package that have been implemented in order to utilize hybrid high performance computers. We present benchmark results for solid-state, biological, and mesoscopic systems and discuss some challenges for utilizing hybrid systems. We present some early work in improving application performance on the XK6 and performance results for the simulation of liquid copper nanostructures with the embedded atom method.

43 PARTICLE ACCELERATORS↗

Development of Shielding Benchmarks Using the Godiva IV Assembly

The Nuclear Criticality Safety Program (NCSP) is developing a shielding benchmark using the Godiva IV assembly as a source. Its present status is reviewed herein. Even eight decades into the nuclear era, substantial work remains to develop a database of shielding benchmarks to support future nuclear development. A nuclear simulation is only as good as its supporting data, inputs, and validation basis. Uncertainty in these areas is addressed using conservatism, which adds margin and, occasionally, cost. In many shielding situations, high accuracy is not necessary because additional material is not particularly expensive. After all, 1–2 cm of lead often reduces the gamma ray dose substantially. However, in certain areas, conservatism can add unnecessary cost. These areas include mobile shielding applications such as casks, ships, microreactors, and spacecraft, where weight and, thus, margin is expensive. Although these characteristics are side benefits for NCSP shielding benchmark development, the main driver is enabling more reliable placement of criticality accident alarm systems (CAASs) in nuclear material facilities, such as those dedicated to the production of advanced reactor fuels. CAAS placement relies on more than accurate data and code validation. It also relies on sufficiently accurate materials specifications, geometry specifications, and a well-defined, alarm-producing baseline accident. All these things require tacit knowledge and understanding of the problem being evaluated. Benchmarks can help ensure this understanding.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗