Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

GASNet-EX Performance Improvements Due to Specialization for the Cray Aries Network

This document is a deliverable for milestone STPM17-6 of the Exascale Computing Project, delivered by WBS 2.3.1.14. It reports on the improvements in performance observed on Cray XC-series systems due to enhancements made to the GASNet-EX software. These enhancements, known as “specializations”, primarily consist of replacing network-independent implementations of several recently added features with implementations tailored to the Cray Aries network. Performance gains from specialization include (1) Negotiated-Payload Active Messages improve bandwidth of a ping-pong test by up to 14%, (2) Immediate Operations reduce running time of a synthetic benchmark by up to 93%, (3) non-bulk RMA Put bandwidth is increased by up to 32%, (4) Remote Atomic performance is 70% faster than the reference on a point-to-point test and allows a hot-spot test to scale robustly, and (5) non-contiguous RMA interfaces see up to 8.6x speedups for an intra-node benchmark and 26% for inter-node. These improvements are available in the GASNet-EX 2018.3.0 release.

97 MATHEMATICS AND COMPUTING↗

GASNet-EX Performance Improvements Due to Specialization for the Cray Aries Network

GASNet-EX is a portable, open-source, high-performance communication library designed to efficiently support the networking requirements of PGAS runtime systems and other alternative models on future exascale machines. This paper reports on the improvements in performance observed on Cray XC-series systems due to enhancements made to the GASNet-EX software. These enhancements, known as "specializations", primarily consist of replacing network-independent implementations of several recently added features with implementations tailored to the Cray Aries network. Performance gains from specialization include (1) Negotiated-Payload Active Messages improve bandwidth of a ping-pong test by up to 14%, (2) Immediate Operations reduce running time of a synthetic benchmark by up to 93%, (3) non-bulk RMA Put bandwidth is increased by up to 32%, (4) Remote Atomic performance is 70% faster than the reference on a point-to-point test and allows a hot-spot test to scale robustly, and (5) non-contiguous RMA interfaces see up to 8.6x speedups for an intra-node benchmark and 26% for inter-node. These improvements are all available in GASNet-EX version 2018.3.0 and later.

97 MATHEMATICS AND COMPUTING↗

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗

Does DFT-SAPT method provide spectroscopic accuracy?

Ground state potential energy curves for homonuclear and heteronuclear dimers consisting of noble gas atoms from He to Kr were calculated within the symmetry adapted perturbation theory based on the density functional theory (DFT-SAPT). These potentials together with spectroscopic data derived from them were compared to previous high-precision coupled cluster with singles and doubles including the connected triples theory calculations (or better if available) as well as to experimental data used as the benchmark. The impact of midbond functions on DFT-SAPT results was tested to study the convergence of the interaction energies. It was shown that, for most of the complexes, DFT-SAPT potential calculated at the complete basis set (CBS) limit is lower than the corresponding benchmark potential in the region near its minimum and hence, spectroscopic accuracy cannot be achieved. The influence of the residual term δ(HF) on the interaction energy was also studied. As a result, we have found that this term improves the agreement with the benchmark in the repulsive region for the dimers considered, but leads to even larger overestimation of potential depth D{sub e}. Although the standard hybrid exchange-correlation (xc) functionals with asymptotic correction within the second order DFT-SAPT do not provide the spectroscopic accuracy at the CBS limit, it is possible to adjust empirically basis sets yielding highly accurate results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performance and Techno-Economic Evaluation of a Three-Phase, 50-kW SiC-Based PV Inverter

The technical capabilities and benefits of silicon carbide (SiC) compared to silicon (Si) based power electronics converters as well as the premium associated with using SiC instead of Si are well understood. This work proves that the benefits provided by SiC, such as increased efficiency, would result in a lower levelized cost of energy (LCOE) compared to both commercially available, state-of-the-art inverters and the benchmark commercial system cost calculated for the U.S. Department of Energy Solar Energy Technologies Office's SunShot program. The LCOE is calculated to be same as the commercial benchmark despite the installed system cost being 8% more than the benchmark. The LCOE calculation is based on both experiential values obtained from testing the SiC photovoltaic (PV) inverter and on the bottoms-up modeled volume cost for the same 50-kW SiC-based inverter. The PV system used for the LCOE model is also explained, and the system cost breakout is presented in this paper. Furthermore, multiple scenarios with variations in the PV system are presented to show their effect on the system LCOE.

14 SOLAR ENERGY↗

Tribological bench and engine dynamometer tests of a low viscosity SAE 0W-16 engine oil using a combination of ionic liquid and ZDDP as anti-wear additives

We have previously reported an oil-miscible phosphonium-organophosphate ionic liquid (IL) with an effective anti-wear (AW) functionality when added to a base oil by itself or combined with a conventional zinc dialkyldithiophosphate (ZDDP) for a synergistic effect. In this research, we investigated whether this synergy manifests in formulated engine oils. An experimental SAE 0W-16 engine oil was generated containing a combination of IL and ZDDP with equal phosphorus contribution. The prototype engine oil was first evaluated using tribological bench tests: AW performance in boundary lubrication (BL) and friction behavior (Stribeck curves) in elastohydrodynamic, mixed, and BL. In addition, the forthcoming standard Sequence VIE engine dynamometer test was then conducted to demonstrate improved fuel economy. Results were benchmarked against those of another experimental engine oil with almost the same formulation except using ZDDP only without the IL (similar total phosphorus content). The IL-ZDDP formulation consistently outperforms the ZDDP-only formulation in friction reduction and wear protection, and results from the bench and engine tests are well correlated.

42 ENGINEERING↗

Biphasic solvents for post-combustion CO 2 capture from natural gas flue Gas

Fossil fuel fired power plants are generally expected to remain one of the most significant global sources of electricity for decades to come. Consequently, carbon management technologies are needed to reduce or eliminate ongoing emissions from these sources. Amongst the many techniques for carbon capture, aqueous amine-based absorbents (monoethanolamine, MEA, in particular) are, presently, considered the leading technology for post-combustion CO 2 point-source capture. These technologies are nevertheless limited by their high capital and regeneration energy costs. Biphasic solvents have been identified as an attractive alternative to traditional MEA based absorbents due to their potential energy savings. Thus far, however, the research on biphasic solvents has largely focused on their performance in coal flue gas while more dilute natural gas flue gas applications have received relatively little attention. Here, this work examines the performances of two novel biphasic solvent blends, diethylenetriamine (DETA) and triethylenetetramine (TETA), in CO 2 capture from a natural gas flue gas simulant. Across several regeneration tests, both solvents achieved considerable energy savings over the benchmark MEA solution. Specifically, the energy consumption per mol CO 2 recovered for the DETA-based and TETA-based solvents was 46 % and 35 % less than that of the benchmark MEA solution, respectively. Molecular dynamics simulations were also performed to gain a deeper understanding of the phase separation phenomena that occur as a consequence of CO 2 absorption. These simulations indicated that phase change was driven by the strong interaction between the absorption products and water, while the degree of separation depended on the CO 2 loading.

Biphasic solvents↗

GPU acceleration of all-electron electronic structure theory using localized numeric atom-centered basis functions

We present an implementation of all-electron density-functional theory for massively parallel GPU-based platforms, using localized atom-centered basis functions and real-space integration grids. Special attention is paid to domain decomposition of the problem on non-uniform grids, which enables compute- and memory-parallel execution across thousands of nodes for real-space operations, e.g. the update of the electron density, the integration of the real-space Hamiltonian matrix, and calculation of Pulay forces. To assess the performance of our GPU implementation, we performed benchmarks on three different architectures using a 103-material test set. We find that operations which rely on dense serial linear algebra show dramatic speedups from GPU acceleration: in particular, SCF iterations including force and stress calculations exhibit speedups ranging from 4.5 to 6.6. For the architectures and problem types investigated here, this translates to an expected overall speedup between 3–4 for the entire calculation (including non-GPU accelerated parts), for problems featuring several tens to hundreds of atoms. Additional calculations for a 375-atom Bi2Se3 bilayer show that the present GPU strategy scales for large-scale distributed-parallel simulations.

42 ENGINEERING↗

Stochastic AC optimal power flow: A data-driven approach

There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow (AC-OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. Herein this paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm’s performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library.

42 ENGINEERING↗

Effect of Inlet Throttling on Thermohydraulic Instability in a Large Scale Waterbased RCCS: A System-Level Analysis with RELAP5-3D

This paper presents results from system -level modeling of a water -based reactor cavity cooling system using RELAP5-3D. The computational model is benchmarked with experimental data from a half -scale RCCS test facility at Argonne National Laboratory. The model prediction is first compared with a two-phase oscillatory baseline experimental case where mixed accuracy is obtained. The model shows reasonable prediction of mass flow rate, pressure, and temperature but significant overprediction of void fraction. The model prediction is then compared with a fault case where the inlet of the risers is gradually reduced using a throttling valve. As the valve is closed, the model is able to predict some major flow phenomena observed in the experiment such as the dampening of oscillations, the reintroduction of oscillations, as well as boiling, flashing, and geysering in the risers. However, the timeline of these events are not well captured by the model. The model is also used to investigate the evolution of flow regime in the chimney. This work highlights that the semiempirical constitutive relations used in RELAP-3D could have a strong influence on the accuracy of the model in two-phase oscillatory flows.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A CFD Simulation Process for Fast Reactor Fuel Assemblies

A CFD modeling and simulation process for large-scale problems using an arbitrary fast reactor fuel assembly design was evaluated. Three-dimensional flow distributions of sodium for several fast reactor fuel assembly pin spacing configurations were simulated on high performance computers using commercial CFD software. This research focused on 19-pin fuel assembly “benchmark” geometry, similar in design to the Advanced Burner Test Reactor, where each pin is separated by helical wire-wrap spacers. Several two-equation turbulence models including the k–e and SST (Menter) k–? were evaluated. Considerable effort was taken to resolve the momentum boundary layer, so as to eliminate the need for wall functions and reduce computational uncertainty. High performance computers were required to generate the hybrid meshes needed to predict secondary flows created by the wire-wrap spacers; computational meshes ranging from 65 to 85 million elements were common. A general validation methodology was followed, including mesh refinement and comparison of numerical results with empirical correlations. Predictions for velocity, temperature, and pressure distribution are shown. The uncertainty of numerical models, importance of high fidelity experimental data, and the challenges associated with simulating and validating large production-type problems are presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A flexible experimental setup for femtosecond time-resolved broad-band ellipsometry and magneto-optics

A versatile experimental setup for femtosecond time-resolved ellipsometry and magneto-optical Kerr effect measurements in the visible light range is described. The apparatus is based on the pump-probe technique and combines a broad-band probing beam with an intense near-infrared pump. According to Fresnel scattering matrix formalism, the analysis of the reflected beam at different polarization states of the incident probe light allows one to determine the diagonal and the off-diagonal elements of the dielectric tensor in the investigated sample. Moreover, the pump-probe method permits to study the dynamics of the dielectric response after a short and intense optical excitation. The performance of the experimental apparatus is tested on CrO{sub 2} single crystals as a benchmark.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Efficient generation of sum-of-products representations of high-dimensional potential energy surfaces based on multimode expansions

The transformation of multi-dimensional potential energy surfaces (PESs) from a grid-based multimode representation to an analytical one is a standard procedure in quantum chemical programs. Within the framework of linear least squares fitting, a simple and highly efficient algorithm is presented, which relies on a direct product representation of the PES and a repeated use of Kronecker products. It shows the same scalings in computational cost and memory requirements as the POTFIT approach. In comparison to customary linear least squares fitting algorithms, this corresponds to a speed-up and memory saving by several orders of magnitude. Different fitting bases are tested, namely, polynomials, B-splines, and distributed Gaussians. Benchmark calculations are provided for the PESs of a set of small molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A hybrid approach to excited-state-specific variational Monte Carlo and doubly excited states

We extend our hybrid linear-method/accelerated-descent variational Monte Carlo optimization approach to excited states and investigate its efficacy in double excitations. In addition to showing a superior statistical efficiency when compared to the linear method, our tests on small molecules show good energetic agreement with benchmark methods. We also demonstrate the ability to treat double excitations in systems that are too large for a full treatment by using selected configuration interaction methods via an application to 4-aminobenzonitrile. Finally, we investigate the stability of state-specific variance optimization against collapse to other states’ variance minima and find that symmetry, Ansatz quality, and sample size all have roles to play in achieving stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Results of the KRUSTY Warm Critical Experiments

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY warm critical experiments, which were completed prior to the final system test. The first set of criticals comprised cold or zero-power criticals; i.e., the core was not heated by fission power. These were followed by three warm criticals, where fission power heated the core to 200°C, 300°C, and 450°C, respectively. These criticals provided the data, confidence, and regulatory framework that were needed to proceed with the KRUSTY nuclear system test. The criticals also provided valuable data for the benchmarking of codes applicable to all nuclear systems. Finally, a comparison of KRUSTY results to pretest predictions is provided, and overall, the models matched the experimental results very closely.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Resilience Assessment for Distribution Systems during Hurricanes: A Learning-Based Framework

This paper presents a proactive strategy for hurricane-resilient distribution systems. It proposes a Bayesian Neural Network-based outage prediction model considering various parameters, including electrical components, and weather and environmental factors. Addressing challenges in imbalanced outage datasets, a Bias-Variance Tradeoff method is proposed. A resilience assessment model quantifies resilience indices, providing insights into system weaknesses. The approach identifies weak points and serves as a planning benchmark. Numerical results on the modified IEEE 123-node test system demonstrate effectiveness in realistic hurricane scenarios.

Vahedi, Soroush↗

Rethinking the Price Formation Problem–Part 1: Participant Incentives under Uncertainty

Operators of organized wholesale electricity markets attempt to form prices in such a way that the private incentives of market participants are consistent with a socially optimal commitment and dispatch schedule. In the U.S. context, several competing price formation schemes have been proposed to address the non-convex production cost functions characteristic of most generation technologies. Here, this paper considers how the design and analysis of price formation policies for non-convex markets are affected by the uncertainty inherent in electricity demand and supply. We argue that by excluding uncertainty, the analytical framework underlying existing policies mischaracterizes the incentives of market participants, leading to inefficient price formation and poor incentives for flexibility. We establish favorable theoretical properties of a new construct, ex ante convex hull pricing , and demonstrate the difference between this idealized benchmark and existing methods on a large-scale test system. Given increased operational uncertainty with a transition to wind and solar generation, distortions caused by poor incentives for flexibility are likely to grow without improved price formation in organized wholesale markets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

STEPS: A Portable Numerical Simulation Toolkit for Electrical Power System Dynamic Studies

Numerical simulation is the key technique for large scale power system analysis. Redistribution of global renewable power via international interconnections requires new simulation tools to study the interconnected systems with different nominal frequencies as a whole. In this paper we introduce an open source simulation toolkit for electrical power systems (STEPS) which is hosted at Github. Its kernel is coded in C++ with major functions of power flow and electro-mechanical dynamic simulation. Flexible options are provided and configurable to improve power flow solution and dynamic simulation. Common devices and models are supported in STEPS for AC/DC hybrid system studies. Studies of interconnected systems with different nominal frequencies is supported in STEPS for research of international interconnection. Application program interfaces are provided and wrapped with Python to enable high-level interfaces for general applications. STEPS is thread safe and parallel computation is supported in both kernel and script levels to accelerate simulation. It is portable and works on Windows and GNU/Linux platforms. Cases from small to large scale systems are thoroughly tested to validate the toolkit with commercial packages as benchmarks.

42 ENGINEERING↗