Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Benchmark problems for numerical implementations of phase field models

Here, we present the first set of benchmark problems for phase field models that are being developed by the Center for Hierarchical Materials Design (CHiMaD) and the National Institute of Standards and Technology (NIST). While many scientific research areas use a limited set of well-established software, the growing phase field community continues to develop a wide variety of codes and lacks benchmark problems to consistently evaluate the numerical performance of new implementations. Phase field modeling has become significantly more popular as computational power has increased and is now becoming mainstream, driving the need for benchmark problems to validate and verify new implementations. We follow the example set by the micromagnetics community to develop an evolving set of benchmark problems that test the usability, computational resources, numerical capabilities and physical scope of phase field simulation codes. In this paper, we propose two benchmark problems that cover the physics of solute diffusion and growth and coarsening of a second phase via a simple spinodal decomposition model and a more complex Ostwald ripening model. We demonstrate the utility of benchmark problems by comparing the results of simulations performed with two different adaptive time stepping techniques, and we discuss the needs of future benchmark problems. The development of benchmark problems will enable the results of quantitative phase field models to be confidently incorporated into integrated computational materials science and engineering (ICME), an important goal of the Materials Genome Initiative.

36 MATERIALS SCIENCE↗

Sci-Sat AM: Radiation Dosimetry and Practical Therapy Solutions - 05: Not all geometries are equivalent for magnetic field Fano cavity tests

The coupling of MRI and radiation treatment systems for the application of magnetic resonance guided radiation therapy necessitates a reliable magnetic field capable Monte Carlo (MC) code. In addition to the influence of the magnetic field on dose distributions, the question of proper calibration has arisen due to the several percent variation of ion chamber and solid state detector responses in magnetic fields when compared to the 0 T case (Reynolds et al., Med Phys, 2013). In the absence of a magnetic field, EGSnrc has been shown to pass the Fano cavity test (a rigorous benchmarking tool of MC codes) at the 0.1 % level (Kawrakow, Med.Phys, 2000), and similar results should be required of magnetic field capable MC algorithms. To properly test such developing MC codes, the Fano cavity theorem has been adapted to function in a magnetic field (Bouchard et al., PMB, 2015). In this work, the Fano cavity test is applied in a slab and ion-chamber-like geometries to test the transport options of an implemented magnetic field algorithm in EGSnrc. Results show that the deviation of the MC dose from the expected Fano cavity theory value is highly sensitive to the choice of geometry, and the ion chamber geometry appears to pass the test more easily than larger slab geometries. As magnetic field MC codes begin to be used for dose simulations and correction factor calculations, care must be taken to apply the most rigorous Fano test geometries to ensure reliability of such algorithms.

60 APPLIED LIFE SCIENCES↗

The G+M eclipsing binary V530 Orionis: a stringent test of magnetic stellar evolution models for low-mass stars

We report extensive photometric and spectroscopic observations of the 6.1 day period, G+M-type detached double-lined eclipsing binary V530 Ori, an important new benchmark system for testing stellar evolution models for low-mass stars. We determine accurate masses and radii for the components with errors of 0.7% and 1.3%, as follows: M {sub A} = 1.0038 ± 0.0066 M {sub ☉}, M {sub B} = 0.5955 ± 0.0022 M {sub ☉}, R {sub A} = 0.980 ± 0.013 R {sub ☉}, and R {sub B} = 0.5873 ± 0.0067 R {sub ☉}. The effective temperatures are 5890 ± 100 K (G1 V) and 3880 ± 120 K (M1 V), respectively. A detailed chemical analysis probing more than 20 elements in the primary spectrum shows the system to have a slightly subsolar abundance, with [Fe/H] = –0.12 ± 0.08. A comparison with theory reveals that standard models underpredict the radius and overpredict the temperature of the secondary, as has been found previously for other M dwarfs. On the other hand, models from the Dartmouth series incorporating magnetic fields are able to match the observations of the secondary star at the same age as the primary (∼3 Gyr) with a surface field strength of 2.1 ± 0.4 kG when using a rotational dynamo prescription, or 1.3 ± 0.4 kG with a turbulent dynamo approach, not far from our empirical estimate for this star of 0.83 ± 0.65 kG. The observations are most consistent with magnetic fields playing only a small role in changing the global properties of the primary. The V530 Ori system thus provides an important demonstration that recent advances in modeling appear to be on the right track to explain the long-standing problem of radius inflation and temperature suppression in low-mass stars.

79 ASTRONOMY AND ASTROPHYSICS↗

CALiPER Application Summary Report 22: LED MR16 Lamps

An initial sample of 27 LED MR16 lamps and 8 halogen benchmarks underwent photometric testing according to IES LM-79-08. CALiPER Application Summary Report 22 focuses on the initial performance based on light output, efficacy, distribution, color quality, electrical characteristics, and form factor, with comparisons to the benchmarks and ENERGY STAR qualification thresholds.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Integral Experiment Final Design for Thermal/Epithermal eXperiments (TEX) using Highly Enriched Uranium with Polyethylene at Low Temperature (IER-479 CED-2 Report)

The goal of IER-479 is to design uranium critical experiments that can be used to validate low temperature cross sections and criticality safety analyses over multiple neutron energy regimes. Currently, there are no benchmarks in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook at temperatures lower than room temperature (International Criticality Safety Benchmark Evaluation Project Handbook, 2019). However, there are many needs for validation of criticality safety analysis at lower temperatures, including meeting transportation requirements and operations conducted outside or in unheated facilities. Additionally, NCSP has funded North Carolina State (NCSU) to generate new thermal scattering laws, including at lower temperatures, and the lack of integral benchmarks impedes data testing of these new cross sections. To address these needs, this report will present a critical experiment design covering various fission energy regimes with a goal temperature of -40°C (-40°F), which is based on the lower bound of expected non-cryogenic operational temperatures. The goal of the U.S. Nuclear Criticality Safety Program’s (NCSP) Thermal/Epithermal eXperiments (TEX) is to design and conduct new critical experiments to address high priority nuclear data needs from the nuclear criticality safety and nuclear data communities. The TEX program includes two series of baseline experimental configurations, one based on plutonium fuel (plutonium-aluminum Zero Power Physics Reactor (ZPPR) plates) and the other based on uranium fuel (highly enriched uranium (HEU) plates), that are moderated with varying thickness of polyethylene to create assemblies which span the thermal, intermediate, and fast fission energy regimes. The configurations are designed to be easily modified (for example, to add diluent materials of interest) to allow for efficient generation of additional benchmark configurations and allow for added nuclear data testing utility when comparing modified configurations to baseline configurations. The goal of IER-479 is to use the TEX-HEU concept (stack of HEU plates and polyethylene moderators) to design a critical experiment that can be used to validate low temperature cross sections and criticality safety analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗

Bridging the gap between parallel file systems and local file systems : a case study with PVFS.

Parallel I/O plays an increasingly important role in today's data intensive computing applications. While much attention has been paid to parallel read performance, most of this work has focused on the parallel file system, middleware, or application layers, ignoring the potential for improvement through more effective use of local storage. In this paper, we present the design and implementation of segment-structured on-disk data grouping and prefetching (SOGP), a technique that leverages additional local storage to boost the local data read performance for parallel file systems, especially for those applications with partially overlapped access patterns. Parallel virtual file system (PVFS) is chosen as an example. Our experiments show that an SOGP-enhanced PVFS prototype system can outperform a traditional Linux-Ext3-based PVFS for many applications and benchmarks, in some tests by as much as 230% in terms of I/O bandwidth.

99 GENERAL AND MISCELLANEOUS↗

Taming Wild Horses: The Need for Virtual Time-based Scheduling of VMs in Network Simulations

The next generation of scalable network simulators employ virtual machines (VMs) to act as high-fidelity models of traffic producer/consumer nodes in simulated networks. However, network simulations could be inaccurate if VMs are not scheduled according to virtual time, especially when many VMs are hosted per simulator core in a multi-core simulator environment. Since VMs are by default free-running, on the outset, it is not clear if, and to what extent, their untamed execution affects the results in simulated scenarios. Here, we provide the first quantitative basis for establishing the need for generalized virtual time scheduling of VMs in network simulators, based on an actual prototyped implementations. To exercise breadth, our system is tested with multiple disparate applications: (a) a set of message passing parallel programs, (b) a computer worm propagation phenomenon, and (c) a mobile ad-hoc wireless network simulation. We define and use error metrics and benchmarks in scaled tests to empirically report the poor match of traditional, fairness-based VM scheduling to VM-based network simulation, and also clearly show the better performance of our simulation-specific scheduler, with up to 64 VMs hosted on a 12-core simulator node.

99 GENERAL AND MISCELLANEOUS↗

Verification of MCNP6.1, MCNP6.1.1, and MCNP6.2-pre for Criticality Safety Applications

Several suites of verification/validation benchmark problems were run in early 2016 to verify that MCNP6.1, MCNP6.1.1, and MCNP6.2-pre are performing correctly for nuclear criticality safety (NCS) applications. MCNP6.1 is the production version of MCNP{sup R} released in 2013; MCNP6.1.1 is the update released in 2014; MCNP6.2-pre is the pre-release development version of MCNP6.2, which is targeted for release in the near future. All versions of MCNP6 include all of the standard features for NCS calculations that have been available for the past 15 years, along with new features for sensitivity-uncertainty based methods for NCS validation. Results from the benchmark suites were compared with results from previous verification testing. Several standard criticality benchmark suites were used for the verification calculations: - VERIFICATION-KEFF - A suite of criticality problems for which exact analytical results are available, - VALIDATION-CRITICALITY - 31 ICSBEP problems, using ENDF/B-VII.1, - VALIDATION-CRIT-EXPANDED - 119 ICSBEP problems, using ENDF/B-VII.1. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Quantum Monte Carlo Endstation for Petascale Computing

The major achievements enabled by QMC Endstation grant include * Performance improvement on clusters of x86 multi-core systems, especially on Cray XT systems * New and improved methods for the wavefunction optimizations * New forms of trial wavefunctions * Implementation of the full application on NVIDIA GPUs using CUDA The scaling studies of QMCPACK on large-scale systems show excellent parallel efficiency up to 216K cores on Jaguarpf (Cray XT5). The GPU implementation shows speedups of 10-15x over the CPU implementation on older generation of x86. We have implemented hybrid OpenMP/MPI scheme in QMC to take advantage of multi-core shared memory processors of petascale systems. Our hybrid scheme has several advantages over the standard MPI-only scheme. * Memory optimized: large read-only data to store one-body orbitals and other shared properties to represent the trial wave function and many-body Hamiltonian can be shared among threads, which reduces the memory footprint of a large-scale problem. * Cache optimized: the data associated with an active Walker are in cache during the compute-intensive drift-diffusion process and the operations on an Walker are optimized for cache reuse. Thread-local objects are used to ensure the data affinity to a thread. * Load balanced: Walkers in an ensemble are evenly distributed among threads and MPI tasks. The two-level parallelism reduces the population imbalance among MPI tasks and reduces the number of point-to-point communications of large messages (serialized objects) for the Walker exchange. * Communication optimized: the communication overhead, especially for the collective operations necessary to determine ET and measure the properties of an ensemble, is significantly lowered by using less MPI tasks. The multiple forms of parallelism afforded by QMC algorithms make them ideal candidates for acceleration in the many-core paradigm. We presented the results of our effort to port the QMCPACK simulation code to the NVIDIA CUDA GPU platform. We restructured the CPU algorithms to express additional parallelism, minimize GPU-CPU communication, and efficiently utilize the GPU memory hierarchy. Using mixed precision on GT200 GPUs and MPI for intercommunication and load balancing, we observe typical full-application speedups of approximately 10x to 15x relative to quad-core Xeon CPUs alone, while reproducing the double-precision CPU results within statistical error. We developed an all-electron quantum Monte Carlo (QMC) method for solids that does not rely on pseudopotentials, and used it to construct a primary ultra-high-pressure calibration based on the equation of state of cubic boron nitride. We computed the static contribution to the free energy with the QMC method and obtained the phonon contribution from density functional theory, yielding a high-accuracy calibration up to 900 GPa usable directly in experiment. We computed the anharmonic Raman frequency shift with QMC simulations as a function of pressure and temperature, allowing optical pressure calibration. In contrast to present experimental approaches, small systematic errors in the theoretical EOS do not increase with pressure, and no extrapolation is needed. This all-electron method is applicable to first-row solids, providing a new reference for ab initio calculations of solids and benchmarks for pseudopotential accuracy. We compared experimental and theoretical results on the momentum distribution and the quasiparticle renormalization factor in sodium. From an x-ray Compton-profile measurement of the valence-electron momentum density, we derived its discontinuity at the Fermi wavevector finding an accurate measure of the renormalization factor that we compared with quantum-Monte-Carlo and G0W0 calculations performed both on crystalline sodium and on the homogeneous electron gas. Our calculated results are in good agreement with the experiment. We have been studying the heat of formation for various Kubas complexes of molecular hydrogen on Ti(1,2)ethylene-nH2 using Diffusion Monte Carlo. This work has been started and is ongoing. We are studying systems involving 1 and 2 Ti bonding sites with up to 10 hydrogen molecules in numerous configurations. This work will establish a benchmark that will test the accuracy of density functional calculations and establish the feasibility of our methods for similar systems.

97 MATHEMATICS AND COMPUTING↗

Benchmarking Data for the Proposed Signature of Used Fuel Casks

A set of benchmarking measurements to test facets of the proposed extended storage signature was conducted on May 17, 2016. The measurements were designed to test the overall concept of how the proposed signature can be used to identify a used fuel cask based only on the distribution of neutron sources within the cask. To simulate the distribution, 4 Cf-252 sources were chosen and arranged on a 3x3 grid in 3 different patterns and raw neutron totals counts were taken at 6 locations around the grid. This is a very simplified test of the typical geometry studied previously in simulation with simulated used nuclear fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Development of a versatile hybrid testing system for seismic experimentation

The hybrid testing method for earthquake engineering was developed to evaluate the seismic performance of civil structural systems. During hybrid testing, part of the structure, called physical substructure, is physically tested using hydraulic loading equipment while the rest of the structure, named numerical substructure, is numerically simulated with a computer model. Thus, hybrid testing allows a complex physical substructure being tested experimentally, while the relatively simple part of the structure is numerically simulated to economically obtain the full structural response. Recently, a versatile hybrid testing system was built at Western Michigan University consisting of a shake table, an actuator/reaction system, and an advanced hybrid testing controller. Such a testing system is capable of conducting various seismic experiments such as displacement-based pseudodynamic substructure testing as well as force-based real time dynamic hybrid testing. Because of its versatility and easy operation at the benchmark scale, the developed testing system is particularly suitable for the development of advanced hybrid testing techniques and, earthquake engineering education/outreach activities. The development of the testing system is described in this article focusing on the hardware and software integrations. A three story shake table hybrid test is presented as an example to demonstrate the system’s capability and feasibility.

42 ENGINEERING↗

Better Engineering with Testbeds to Reduce Uncertainties in Simulations and Tests

Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) -- formerly Benchmark Extensible Tractable Testbed Engineering Resource (LA-UR-16-23828) -- are experiments, with accompanying models and simulations, that support engineering capability development by helping to identify weaknesses and address needs. Weapon systems, subassemblies, and components are often complex and difficult to test and analyze, resulting in low confidence and high uncertainties in experimental and simulated results. The complexities make it difficult to distinguish between inherent uncertainties and errors due to insufficient capabilities. TRUST will first use simplified geometries and materials such that testing, data collection, modeling and simulation can be accomplished with high confidence and low uncertainty. Modifications and combinations of simple and well characterized TRUST can then be used to increase complexity in order to reproduce relevant mechanics and identify weaknesses. The ultimate goal is to help improve capabilities and increase confidence by building TRUST. This document presents the motivation, concept, benefits and examples for TRUST.

42 ENGINEERING↗

Benchmarking MELCOR's NAC Package to ABCOVE Tests AB5 and AB6

This report presents analyses of the AB5 and AB6 ABCOVE sodium spray fire experiments with the MELCOR code. This code simulates the progression of accident events for analysis and auditing purposes of nuclear facilities during accident conditions. Historically, the ABCOVE experiments have contributed to the validation of aerosol physics and related phenomena. Given advancements in sodium-cooled reactor designs, characterization of the sodium spray combustion may further the review and validation of newly incorporated sodium properties and physics packages, namely, the sodium equations of state (EOS) and the sodium combustion (NAC) package within MELCOR. By analyzing the AB5 and AB6 experiments with and without the NAC package, sodium specificity for spray combustion and aerosol formation as well as speciation of the combustion products are reviewed with the new packages. This effort provides code users with a demonstration of the current code capabilities. This report provides the current best practices for the NAC package as well as a discussion of any issues observed while performing the presented analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking MELCOR's NAC Package to ABCOVE Test AB7

This report presents analyses of the AB7 ABCOVE sodium spray fire experiment with the MELCOR code. This code simulates the progression of accident events for analysis and auditing purposes of nuclear facilities during accident conditions. Historically, the ABCOVE experiments have contributed to the validation of aerosol physics and related phenomena. Given advancements in sodium-cooled reactor designs, characterization of the sodium spray combustion may further the review and validation of newly incorporated sodium properties and physics packages, namely, the sodium equations of state (EOS) and the sodium combustion (NAC) package within MELCOR. Previously, the AB5 and AB6 experiments were analyzed with and without the NAC package. This work builds on the previous analyses with a demonstration of the current code capabilities of MELCOR with a more mild Na spray and pool fire scenario.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A flux-matched gyrokinetic analysis of DIII-D L-mode turbulence

Previous nonlinear gyrokinetic simulations of specific DIII-D L-mode cases have been found to significantly underpredict the ion heat transport and associated density and temperature fluctuation levels by up to almost one of order of magnitude in the outer-core domain, i.e., roughly in the last third of the minor radius. Since then, this so-called shortfall issue has been subject to various speculations on possible reasons and furthermore motivation for a number of dedicated comparisons for L-mode plasmas in comparable machines. However, only a rather limited number of simulations and gyrokinetic codes has been applied to the original scenario, thus calling for further dedicated investigations in order to broaden the scientific basis. The present work contributes along these lines by employing another well-established gyrokinetic code in a numerically and physically comprehensive manner. Contrary to the previous studies, only a mild underprediction is observed at the outer radial positions which can furthermore be overcome by varying the ion temperature gradient within the error bars associated with the experimental measurement. The significance and reliability of these simulations are demonstrated by benchmarks, numerical convergence tests, and furthermore by extensive validation studies. The latter involve cross-phase and cross-power spectra analyses of various fluctuating quantities and confirm a high degree of realism. The code discrepancies come as a surprise since the involved software packages had been benchmarked repeatedly and very successfully in the past. Further collaborative effort in identifying the underlying difference is hence required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗