Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Biphasic solvents for post-combustion CO 2 capture from natural gas flue Gas

Fossil fuel fired power plants are generally expected to remain one of the most significant global sources of electricity for decades to come. Consequently, carbon management technologies are needed to reduce or eliminate ongoing emissions from these sources. Amongst the many techniques for carbon capture, aqueous amine-based absorbents (monoethanolamine, MEA, in particular) are, presently, considered the leading technology for post-combustion CO 2 point-source capture. These technologies are nevertheless limited by their high capital and regeneration energy costs. Biphasic solvents have been identified as an attractive alternative to traditional MEA based absorbents due to their potential energy savings. Thus far, however, the research on biphasic solvents has largely focused on their performance in coal flue gas while more dilute natural gas flue gas applications have received relatively little attention. Here, this work examines the performances of two novel biphasic solvent blends, diethylenetriamine (DETA) and triethylenetetramine (TETA), in CO 2 capture from a natural gas flue gas simulant. Across several regeneration tests, both solvents achieved considerable energy savings over the benchmark MEA solution. Specifically, the energy consumption per mol CO 2 recovered for the DETA-based and TETA-based solvents was 46 % and 35 % less than that of the benchmark MEA solution, respectively. Molecular dynamics simulations were also performed to gain a deeper understanding of the phase separation phenomena that occur as a consequence of CO 2 absorption. These simulations indicated that phase change was driven by the strong interaction between the absorption products and water, while the degree of separation depended on the CO 2 loading.

Biphasic solvents↗

GPU acceleration of all-electron electronic structure theory using localized numeric atom-centered basis functions

We present an implementation of all-electron density-functional theory for massively parallel GPU-based platforms, using localized atom-centered basis functions and real-space integration grids. Special attention is paid to domain decomposition of the problem on non-uniform grids, which enables compute- and memory-parallel execution across thousands of nodes for real-space operations, e.g. the update of the electron density, the integration of the real-space Hamiltonian matrix, and calculation of Pulay forces. To assess the performance of our GPU implementation, we performed benchmarks on three different architectures using a 103-material test set. We find that operations which rely on dense serial linear algebra show dramatic speedups from GPU acceleration: in particular, SCF iterations including force and stress calculations exhibit speedups ranging from 4.5 to 6.6. For the architectures and problem types investigated here, this translates to an expected overall speedup between 3–4 for the entire calculation (including non-GPU accelerated parts), for problems featuring several tens to hundreds of atoms. Additional calculations for a 375-atom Bi2Se3 bilayer show that the present GPU strategy scales for large-scale distributed-parallel simulations.

42 ENGINEERING↗

Stochastic AC optimal power flow: A data-driven approach

There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow (AC-OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. Herein this paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm’s performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library.

42 ENGINEERING↗

Effect of Inlet Throttling on Thermohydraulic Instability in a Large Scale Waterbased RCCS: A System-Level Analysis with RELAP5-3D

This paper presents results from system -level modeling of a water -based reactor cavity cooling system using RELAP5-3D. The computational model is benchmarked with experimental data from a half -scale RCCS test facility at Argonne National Laboratory. The model prediction is first compared with a two-phase oscillatory baseline experimental case where mixed accuracy is obtained. The model shows reasonable prediction of mass flow rate, pressure, and temperature but significant overprediction of void fraction. The model prediction is then compared with a fault case where the inlet of the risers is gradually reduced using a throttling valve. As the valve is closed, the model is able to predict some major flow phenomena observed in the experiment such as the dampening of oscillations, the reintroduction of oscillations, as well as boiling, flashing, and geysering in the risers. However, the timeline of these events are not well captured by the model. The model is also used to investigate the evolution of flow regime in the chimney. This work highlights that the semiempirical constitutive relations used in RELAP-3D could have a strong influence on the accuracy of the model in two-phase oscillatory flows.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A CFD Simulation Process for Fast Reactor Fuel Assemblies

A CFD modeling and simulation process for large-scale problems using an arbitrary fast reactor fuel assembly design was evaluated. Three-dimensional flow distributions of sodium for several fast reactor fuel assembly pin spacing configurations were simulated on high performance computers using commercial CFD software. This research focused on 19-pin fuel assembly “benchmark” geometry, similar in design to the Advanced Burner Test Reactor, where each pin is separated by helical wire-wrap spacers. Several two-equation turbulence models including the k–e and SST (Menter) k–? were evaluated. Considerable effort was taken to resolve the momentum boundary layer, so as to eliminate the need for wall functions and reduce computational uncertainty. High performance computers were required to generate the hybrid meshes needed to predict secondary flows created by the wire-wrap spacers; computational meshes ranging from 65 to 85 million elements were common. A general validation methodology was followed, including mesh refinement and comparison of numerical results with empirical correlations. Predictions for velocity, temperature, and pressure distribution are shown. The uncertainty of numerical models, importance of high fidelity experimental data, and the challenges associated with simulating and validating large production-type problems are presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A flexible experimental setup for femtosecond time-resolved broad-band ellipsometry and magneto-optics

A versatile experimental setup for femtosecond time-resolved ellipsometry and magneto-optical Kerr effect measurements in the visible light range is described. The apparatus is based on the pump-probe technique and combines a broad-band probing beam with an intense near-infrared pump. According to Fresnel scattering matrix formalism, the analysis of the reflected beam at different polarization states of the incident probe light allows one to determine the diagonal and the off-diagonal elements of the dielectric tensor in the investigated sample. Moreover, the pump-probe method permits to study the dynamics of the dielectric response after a short and intense optical excitation. The performance of the experimental apparatus is tested on CrO{sub 2} single crystals as a benchmark.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Efficient generation of sum-of-products representations of high-dimensional potential energy surfaces based on multimode expansions

The transformation of multi-dimensional potential energy surfaces (PESs) from a grid-based multimode representation to an analytical one is a standard procedure in quantum chemical programs. Within the framework of linear least squares fitting, a simple and highly efficient algorithm is presented, which relies on a direct product representation of the PES and a repeated use of Kronecker products. It shows the same scalings in computational cost and memory requirements as the POTFIT approach. In comparison to customary linear least squares fitting algorithms, this corresponds to a speed-up and memory saving by several orders of magnitude. Different fitting bases are tested, namely, polynomials, B-splines, and distributed Gaussians. Benchmark calculations are provided for the PESs of a set of small molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A hybrid approach to excited-state-specific variational Monte Carlo and doubly excited states

We extend our hybrid linear-method/accelerated-descent variational Monte Carlo optimization approach to excited states and investigate its efficacy in double excitations. In addition to showing a superior statistical efficiency when compared to the linear method, our tests on small molecules show good energetic agreement with benchmark methods. We also demonstrate the ability to treat double excitations in systems that are too large for a full treatment by using selected configuration interaction methods via an application to 4-aminobenzonitrile. Finally, we investigate the stability of state-specific variance optimization against collapse to other states’ variance minima and find that symmetry, Ansatz quality, and sample size all have roles to play in achieving stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Results of the KRUSTY Warm Critical Experiments

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY warm critical experiments, which were completed prior to the final system test. The first set of criticals comprised cold or zero-power criticals; i.e., the core was not heated by fission power. These were followed by three warm criticals, where fission power heated the core to 200°C, 300°C, and 450°C, respectively. These criticals provided the data, confidence, and regulatory framework that were needed to proceed with the KRUSTY nuclear system test. The criticals also provided valuable data for the benchmarking of codes applicable to all nuclear systems. Finally, a comparison of KRUSTY results to pretest predictions is provided, and overall, the models matched the experimental results very closely.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Resilience Assessment for Distribution Systems during Hurricanes: A Learning-Based Framework

This paper presents a proactive strategy for hurricane-resilient distribution systems. It proposes a Bayesian Neural Network-based outage prediction model considering various parameters, including electrical components, and weather and environmental factors. Addressing challenges in imbalanced outage datasets, a Bias-Variance Tradeoff method is proposed. A resilience assessment model quantifies resilience indices, providing insights into system weaknesses. The approach identifies weak points and serves as a planning benchmark. Numerical results on the modified IEEE 123-node test system demonstrate effectiveness in realistic hurricane scenarios.

Vahedi, Soroush↗

Rethinking the Price Formation Problem–Part 1: Participant Incentives under Uncertainty

Operators of organized wholesale electricity markets attempt to form prices in such a way that the private incentives of market participants are consistent with a socially optimal commitment and dispatch schedule. In the U.S. context, several competing price formation schemes have been proposed to address the non-convex production cost functions characteristic of most generation technologies. Here, this paper considers how the design and analysis of price formation policies for non-convex markets are affected by the uncertainty inherent in electricity demand and supply. We argue that by excluding uncertainty, the analytical framework underlying existing policies mischaracterizes the incentives of market participants, leading to inefficient price formation and poor incentives for flexibility. We establish favorable theoretical properties of a new construct, ex ante convex hull pricing , and demonstrate the difference between this idealized benchmark and existing methods on a large-scale test system. Given increased operational uncertainty with a transition to wind and solar generation, distortions caused by poor incentives for flexibility are likely to grow without improved price formation in organized wholesale markets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

STEPS: A Portable Numerical Simulation Toolkit for Electrical Power System Dynamic Studies

Numerical simulation is the key technique for large scale power system analysis. Redistribution of global renewable power via international interconnections requires new simulation tools to study the interconnected systems with different nominal frequencies as a whole. In this paper we introduce an open source simulation toolkit for electrical power systems (STEPS) which is hosted at Github. Its kernel is coded in C++ with major functions of power flow and electro-mechanical dynamic simulation. Flexible options are provided and configurable to improve power flow solution and dynamic simulation. Common devices and models are supported in STEPS for AC/DC hybrid system studies. Studies of interconnected systems with different nominal frequencies is supported in STEPS for research of international interconnection. Application program interfaces are provided and wrapped with Python to enable high-level interfaces for general applications. STEPS is thread safe and parallel computation is supported in both kernel and script levels to accelerate simulation. It is portable and works on Windows and GNU/Linux platforms. Cases from small to large scale systems are thoroughly tested to validate the toolkit with commercial packages as benchmarks.

42 ENGINEERING↗

Learning Provably Stable Local Volt/Var Controllers for Efficient Network Operation

Here this paper develops a data-driven framework to synthesize local Volt/Var control strategies for distributed energy resources (DERs) in power distribution grids (DGs). Aiming to improve DG operational efficiency, as quantified by a generic optimal reactive power flow (ORPF) problem, we propose a two-stage approach. The first stage involves learning the manifold of optimal operating points determined by an ORPF instance. To synthesize local Volt/Var controllers, the learning task is partitioned into learning local surrogates (one per DER) of the optimal manifold with voltage input and reactive power output. Since these surrogates characterize efficient DG operating points, in the second stage, we develop local control schemes that steer the DG to these operating points. We identify the conditions on the surrogates and control parameters to ensure that the locally acting controllers collectively converge, in a global asymptotic sense, to a DG operating point agreeing with the local surrogates. We use neural networks to model the surrogates and enforce the identified conditions in the training phase. AC power flow simulations on the IEEE 37-bus network empirically bolster the theoretical stability guarantees obtained under linearized power flow assumptions. The tests further highlight the optimality improvement compared to prevalent benchmark methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Treatment planning of a skin-sparing conical breast brachytherapy applicator using conventional brachytherapy software

Purpose: AccuBoost is a noninvasive image-guided technique for the delivery of partial breast irradiation to the tumor bed and currently serves as an alternate to conventional electron beam boost. To irradiate the target volume while providing dose sparing to the skin, the round applicator design was augmented through the addition of an internally truncated conical shield and the reduction of the source to skin distance. Methods: Brachytherapy dose distributions for two types of conical applicators were simulated and estimated using Monte Carlo (MC) methods for radiation transport and a conventional treatment planning system (TPS). MC-derived and TPS-generated dose volume histograms (DVHs) and dose distribution data were compared for both the conical and round applicators for benchmarking purposes. Results: Agreement using the gamma-index test was {>=}99.95% for distance to agreement and dose accuracy criteria of 2 mm and 2%, respectively. After observing good agreement, TPS DVHs and dose distributions for the conical and round applicators were obtained and compared. Brachytherapy dose distributions generated using Pinnacle{sup 3} for ten CT data sets showed that the parallel-opposed beams of the conical applicators provided similar PTV coverage to the round applicators and reduced the maximum dose to skin, chest wall, and lung by up to 27%, 42%, and 43%, respectively. Conclusions: Brachytherapy dose distributions for the conical applicators have been generated using MC methods and entered into the Pinnacle{sup 3} TPS via the Tufts technique. Treatment planning metrics for the conical AccuBoost applicators were significantly improved in comparison to those for conventional electron beam breast boost.

60 APPLIED LIFE SCIENCES↗

A method for modeling laterally asymmetric proton beamlets resulting from collimation

Purpose: To introduce a method to model the 3D dose distribution of laterally asymmetric proton beamlets resulting from collimation. The model enables rapid beamlet calculation for spot scanning (SS) delivery using a novel penumbra-reducing dynamic collimation system (DCS) with two pairs of trimmers oriented perpendicular to each other. Methods: Trimmed beamlet dose distributions in water were simulated with MCNPX and the collimating effects noted in the simulations were validated by experimental measurement. The simulated beamlets were modeled analytically using integral depth dose curves along with an asymmetric Gaussian function to represent fluence in the beam’s eye view (BEV). The BEV parameters consisted of Gaussian standard deviations (sigmas) along each primary axis (σ{sub x1},σ{sub x2},σ{sub y1},σ{sub y2}) together with the spatial location of the maximum dose (μ{sub x},μ{sub y}). Percent depth dose variation with trimmer position was accounted for with a depth-dependent correction function. Beamlet growth with depth was accounted for by combining the in-air divergence with Hong’s fit of the Highland approximation along each axis in the BEV. Results: The beamlet model showed excellent agreement with the Monte Carlo simulation data used as a benchmark. The overall passing rate for a 3D gamma test with 3%/3 mm passing criteria was 96.1% between the analytical model and Monte Carlo data in an example treatment plan. Conclusions: The analytical model is capable of accurately representing individual asymmetric beamlets resulting from use of the DCS. This method enables integration of the DCS into a treatment planning system to perform dose computation in patient datasets. The method could be generalized for use with any SS collimation system in which blades, leaves, or trimmers are used to laterally sharpen beamlets.

07 ISOTOPE AND RADIATION SOURCES↗

GPCNeT

Network congestion is one of the biggest problems facing HPC systems today, affecting system throughput, performance, user experience, and reproducibility. Congestion manifests as run-to-run variability due to contention for shared resources (e.g., filesystems) or routes between compute endpoints. Despite its significance, current network benchmarks fail to proxy the real-world network utilization seen on congested systems. We propose a new open-source benchmark suite called the Global Performance and Congestion Network Tests (GPCNeT) to advance the state of the practice in this area. The guiding principles used in designing GPCNeT are described and the methodology employed to maximize its utility is presented. The capabilities of GPCNeT are evaluated by analyzing results from several world's largest HPC systems, including an evaluation of congestion management on a next-generation network. The results show that systems of all technologies and scales are susceptible to congestion and this work motivates the need for congestion control in next-generation networks.

Chunduri, Sudheer↗

New Methods of Uncertainty Quantification for Mixed Discrete-Continuous Variable Models

The scale and complexity of problems such as designing power grids or planning for climate change is growing rapidly, driving the development of complicated computer models. More complex models have longer run times and incorporate larger numbers of inputs, both continuous and discrete. For example, a detailed physics model may have continuous variables such as temperature, height or pressure along with discrete variables that indicate the choice of a material for a particular piece or the model to be used to calculate air flow. A power grid design model may have continuous variables such as generation capacity, power flow or demand along with discrete variables such as number of generators, number of transmission lines or binary variables to indicate whether or not a node is chosen for generation expansion. A growing awareness of uncertainty and the desire to make risk-informed decisions is causing uncertainty quantification (UQ) to be more routine and often required. UQ provides the underpinnings necessary to establish confidence in models and their use; therefore, much time and effort is being invested in creating efficient approaches for UQ. However, these efforts have been focused on models that take continuous variables as inputs. When discrete inputs are thrown into the mix, the basic approach is to repeat the UQ analysis for each combination of discrete inputs or some subset thereof; this rapidly becomes intractable. Because of the computational complexity inherent in mixed discrete-continuous models, researchers will focus on the uncertainty in their particular problem finding ways to take advantage of symmetries, simplifications or structures. For example, uncertainty propagation in certain dynamical systems can be efficiently carried out after various decomposition steps or uncertainty propagation in stochastic programming is confined to scenario generation. Unfortunately models are not always available for such machinations: models may be embedded in legacy codes, may utilize commercial off the shelf codes or may be created by stringing a series of codes together. It is also time consuming to start each problem from scratch; worse there may not be any simplifications or symmetries to take advantage of. For these situations a UQ method developed for any black box function is necessary. This report documents a new conceptual model for performing UQ for mixed discrete-continuous models which not only applies to any simulator function, but allows the use of the efficient UQ methods that have been developed for continuous inputs only. The conceptual model is presented and an estimation procedure is fleshed out for one class of problems. This is applied to variations of a mixed discrete-continuous optimization test problem. This procedure provides comparable results to a benchmark solution with fewer function evaluations.

Bauman, Lara E.↗

Mixing Study for JT-71/72 Tanks

All modeling calculations for the mixing operations of miscible fluids contained in HB-Line tanks, JT-71/72, were performed by taking a three-dimensional Computational Fluid Dynamics (CFD) approach. The CFD modeling results were benchmarked against the literature results and the previous SRNL test results to validate the model. Final performance calculations were performed by using the validated model to quantify the mixing time for the HB-Line tanks. The mixing study results for the JT-71/72 tanks show that, for the cases modeled, the mixing time required for blending of the tank contents is no more than 35 minutes, which is well below 2.5 hours of recirculation pump operation. Therefore, the results demonstrate the adequacy of 2.5 hours’ mixing time of the tank contents by one recirculation pump to get well mixed.

42 ENGINEERING↗