Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Introducing the embedded random phase approximation: H 2 dissociative adsorption on Cu(111) as an exemplar

The random phase approximation (RPA) as a means of treating electron correlation recently has been shown to outperform standard density functional theory (DFT) approximations in a variety of cases. However, the computational cost of the RPA is substantially more than DFT, especially when aiming to study extended surfaces. Properly accounting for sufficient surface ensemble size, Brillouin zone sampling, and vacuum separation of periodic images in standard periodic-planewave-based DFT code raises the cost to achieve converged results. Here, we show that sub-system embedding schemes enable use of the RPA for modeling heterogeneous reactions at reduced computational cost. Further, we explore two different embedded RPA (emb-RPA) approaches, periodic emb-RPA and cluster emb-RPA. We use the (experimentally and theoretically) well-studied H 2 dissociative adsorption on Cu(111) as our exemplar, and first perform full periodic RPA calculations as a benchmark. The full RPA results match well the semi-empirical barrier fit to experimental observables and others derived from high-level computations, e.g., from recent embedded n-electron valence second order perturbation theory [Zhao et al., J. Chem. Theory Comput. 16(11), 7078–7088 (2020)] and quantum Monte Carlo [Doblhoff-Dier et al., J. Chem. Theory Comput. 13(7), 3208–3219 (2017)] simulations. Among the two emb-RPA approaches tested, the cluster emb-RPA accurately reproduces the energy profile (maximum error of 50 meV along the reaction pathway) while reducing the computational cost by approximately two orders of magnitude. We therefore expect that the embedded cluster approach will enable wider RPA implementation in heterogeneous catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evolution of shape and collectivity along the Ge isotopic chain: The case of 80 Ge

In this work, the shape and collectivity of 80 Ge were investigated via a sub-barrier-energy Coulomb excitation measurement using the JANUS setup at the NSCL ReA3 facility. The 80 Ge spectroscopic quadrupole moment $Q_{s}(2^{+}_{1})$ of the $2^{+}_{1}$ state was measured for the first time, and the precision of the 80 Ge $B(E2; 0^{+}_{1}$ → $2^{+}_{1}$) transition strength was increased. The experimental $Q_{s}(2^{+}_{1})$ value indicates a large, prolate deformation for 80 Ge, which is consistent with large-scale shell-model calculations performed for comparison. These results provide important benchmarks for models that try to describe nuclear shape in neutron-rich nuclei near the magic number N=50.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Calculated fission-fragment yield systematics in the region 74 <=Z <= 94 and 90 <=N <= 150

Background: In the seminal experiment by Schmidt et al . [Nucl. Phys. A 665 , 221 (2000)] in which fission-fragment charge distributions were obtained for 70 nuclides, asymmetric distributions were seen above nucleon number A ≈ 226 and symmetric ones below. Because asymmetric fission had often loosely been explained as a preference for the nucleus to always exploit the extra binding of fragments near ¹³²Sn it was assumed that all systems below A ≈ 226 would fission symmetrically because available isotopes do not have a proton-to-neutron Z/N ratio that allows division into fragments near ¹³²Sn. But the finding by Andreyev et al . [Phys. Rev. Lett. 105 , 252502 (2010)] did not conform to this expectation because the compound system ¹⁸⁰Hg was shown to fission asymmetrically. It was suggested that this was a new type of asymmetric fission, because no strong shell effects occur for any possible fragment division. Purpose: We calculate a reference database for fission-fragment mass yields for a large region of the nuclear chart comprising 987 nuclides. A particular aim is to establish whether ¹⁸⁰Hg is part of a contiguous region of asymmetric fission, and if so, its extent, or if not, in contrast to the actinides, there are scattered smaller groups of nuclei that fission asymmetrically in this area of the nuclear chart. Methods: We use the by now well benchmarked Brownian shape-motion method and perform random walks on the previously calculated five-dimensional potential-energy surfaces. The calculated shell corrections are damped out with energy according to a prescription developed earlier. Results: We have obtained a theoretical reference database of fission-fragment mass yields for 987 nuclides. These results show an extended region of asymmetric fission with approximate extension 74 ≤ Z ≤ 85 and 100 ≤ N ≤ 120. The calculated yields are highly variable. We show 20 representative plots of these variable features and summarize the main aspects of our results in terms of “nuclear-chart” plots showing calculated degrees of asymmetry versus N and Z. Conclusions: Experimental data in this region are rare: only ten or so yield distributions have been measured, some with very limited statistics. We agree with several measurements with higher statistics. Regions where there might be differences between our calculated results and measurements lie near the calculated transition line between symmetric and asymmetric fission. To draw more definite conclusions about the accuracy of the present implementation of the Brownian shape-motion approach in this region experimental data, with reliable statistics, for a fair number of suitably located additional nuclides are clearly needed. Because the nuclear potential-energy structure is so different in this region compared to the actinide region, additional experimental data together with fission theory studies that incorporate additional, dynamical aspects should provide much new insight.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Decoding polymer self-dynamics using a two-step approach

The self-correlation function and corresponding self-intermediate scattering function in Fourier space are important quantities for describing the molecular motions of liquids. This work draws attention to a largely overlooked issue concerning the analysis of these space-time density-density correlation functions of polymers. Here, we show that the interpretation of non-Gaussian behavior of polymers is generally complicated by intrachain averaging of distinct self-dynamics of different segments. By the very nature of the mathematics involved, the averaging process not only conceals critical dynamical information, but also contributes to the observed non-Gaussian dynamics. To fully expose this issue and provide a thorough benchmark of polymer self-dynamics, we perform analyses of coarse-grained molecular dynamics simulations of linear and ring polymer melts as well as several theoretical models using a “two-step” approach, where interchain and intrachain averagings of segmental self-dynamics are separated. While past investigations primarily focused on the average behavior, our results indicate that a more nuanced approach to polymer self-dynamics is clearly required.

36 MATERIALS SCIENCE↗

Detecting Anomalies in Time Series Using Kernel Density Approaches

This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.

Frehner, Robin↗

Spatial Support Vector Regression to Detect Silent Errors in the Exascale Era

As the exascale era approaches, the increasing capacity of high-performance computing (HPC) systems with targeted power and energy budget goals introduces significant challenges in reliability. Silent data corruptions (SDCs) or silent errors are one of the major sources that corrupt the executionresults of HPC applications without being detected. In this work, we explore a low-memory-overhead SDC detector, by leveraging epsilon-insensitive support vector machine regression, to detect SDCs that occur in HPC applications that can be characterized by an impact error bound. The key contributions are three fold. (1) Our design takes spatialfeatures (i.e., neighbouring data values for each data point in a snapshot) into training data, such that little memory overhead (less than 1%) is introduced. (2) We provide an in-depth study on the detection ability and performance with different parameters, and we optimize the detection range carefully. (3) Experiments with eight real-world HPC applications show thatour detector can achieve the detection sensitivity (i.e., recall) up to 99% yet suffer a less than 1% of false positive rate for most cases. Our detector incurs low performance overhead, 5% on average, for all benchmarks studied in the paper. Compared with other state-of-the-art techniques, our detector exhibits the best tradeoff considering the detection ability and overheads.

Subasi, Omer↗

SharP Hash: A High-Performing Distributed Hash for Extreme-Scale Systems

A high-performing distributed hash is critical for achieving performance in many applications and system software using extreme-scale systems. It is also a central part of many Big-Data frameworks including Memcached, file systems, and job schedulers. However, there is a lack of high-performing distributed hash implementations. In this work, we propose, design, and implement, SharP Hash, a high-performing, RDMA-based distributed hash for extreme-scale systems. SharP Hash's high performance is obtained through the use of high-performing networks and one-sided semantics. We perform an evaluation of SharP Hash and demonstrate its performance characteristics with a synthetic micro-benchmark and implementation of a Key Value (KV) store, Memcached.

97 MATHEMATICS AND COMPUTING↗

Rapidly Measuring Loop Footprints

Knowing a loop’s footprint — the unique data items it accesses — enables important locality and capacity analysis. Unfortunately, current methods for computing footprint cause integer factors of slowdown and are therefore difficult to use with realistic inputs. Current methods are slow because they are based on software tracing of load instructions and data addresses. We present an approach that combines lightweight measurements and static binary analysis. We use static analysis to reason about each load’s expected reuse. We then calculate the footprint for each loop using inference rules informed by measurements from common performance counters. We validate our method on benchmarks that vary access patterns (strided vs. unpredictable), reuse (varying and repeated accesses per element), and sparsity (all words in a cache line vs. some). For strided patterns, errors are within 1%; for unpredictable ones, errors are 5–10%. Our overheads are under 10%. A tool based on software tracing has an error of less than 1%, but either introduces at least 130× overhead or hangs.

Kilic, Ozgur O.↗

Delivering Science on Day One

While benchmarking software is useful for testing the performance limits and stability of Argonne National Laboratory’s new Theta supercomputer, there is no substitute for running real applications to explore the system’s potential. The Argonne Leadership Computing Facility’s Theta Early Science Program, modeled after its highly successful code migration program for the Mira supercomputer, has one primary aim: to deliver science on day one. Here is a closer look at the type of science problems that will be getting early access to Theta, a next-generation machine being rolled out this year.

Williams, Timothy J.↗

Porting the Kitten Lightweight Kernel Operating System to RISC-V

Hardware design in high-performance computing (HPC) is often highly experimental. Exploring new designs is difficult and time-consuming, requiring lengthy vendor cooperation. RISC-V is an open-source processor ISA that improves the accessibility of chip design, including the ability to do hardware/software co-design using open-source hardware and tools. Co-design allows design decisions to easily flow across the hardware/software boundary and influence future design ideas. However, new hardware designs require corresponding software to drive and test them. Conventional operating systems like Linux are massively complex and modification is time-prohibitive. In this paper, we describe our port of the Kitten lightweight kernel operating system to RISC-V in order to provide an alternative to Linux for conducting co-design research. Kitten's small code base and simple resource management policies are well matched for quickly exploring new hardware ideas that may require radical operating system modifications and restructuring. Our evaluation shows that Kitten on RISC-V is functional and provides similar performance to Linux for single-core benchmarks. This provides a solid foundation for using Kitten in future co-design research involving RISC-V.

Gordon, Nick↗

Modeling of Electric Water Heaters for Demand Response: A Baseline PDE Model

Demand response (DR)control can effectively relieve balancing and frequency regulation burdens on conventional generators, facilitate integrating more renewable energy, and reduce generation and transmission investments needed to meet peak demands. Electric water heaters (EWHs) have a great potential in implementing DR control strategies because: (a) the EWH power consumption has a high correlation with daily load patterns; (b) they constitute a significant percentage of domestic electrical load; (c) the heating element is a resistor, without reactive power consumption; and (d) they can be used as energy storage devices when needed. Accurately modeling the dynamic behavior of EWHs is essential for designing DR controls. Various water heater models, simplified to different extents, were published in the literature; however, few of them were validated against field measurements, which may result in inaccuracy when implementing DR controls. In this paper, a partial differential equation physics-based model, developed to capture detailed temperature profiles at different tank locations, is validated against field test data for more than 10 days. The developed model shows very good performance in capturing water thermal dynamics for benchmark testing purposes

Balancing service, demand response, electric water↗

Systematic Assessment of Terrestrial Biogeochemistry in Coupled Climate-Carbon Models

With representation of the global carbon cycle becoming increasingly complex in climate models, it is important to develop ways to quantitatively evaluate model performance against in situ and remote sensing observations. Here we present a systematic framework, the Carbon-LAnd Model Intercomparison Project (C-LAMP), for assessing terrestrial biogeochemistry models coupled to climate models using observations that span a wide range of temporal and spatial scales. As an example of the value of such comparisons, we used this framework to evaluate two biogeochemistry models that are integrated within the Community Climate System Model (CCSM) - Carnegie-Ames-Stanford Approach (CASA) and carbon-nitrogen (CN). Both models underestimated the magnitude of net carbon uptake during the growing season in temperate and boreal forest ecosystems, based on comparison with atmospheric CO{sub 2} measurements and eddy covariance measurements of net ecosystem exchange. Comparison with MODerate Resolution Imaging Spectroradiometer (MODIS) measurements show that this low bias in model fluxes was caused, at least in part, by 1-3 month delays in the timing of maximum leaf area. In the tropics, the models overestimated carbon storage in woody biomass based on comparison with datasets from the Amazon. Reducing this model bias will probably weaken the sensitivity of terrestrial carbon fluxes to both atmospheric CO{sub 2} and climate. Global carbon sinks during the 1990s differed by a factor of two (2.4 Pg C yr{sup -1} for CASA vs. 1.2 Pg C yr{sup -1} for CN), with fluxes from both models compatible with the atmospheric budget given uncertainties in other terms. The models captured some of the timing of interannual global terrestrial carbon exchange during 1988-2004 based on comparison with atmospheric inversion results from TRANSCOM (r=0.66 for CASA and r=0.73 for CN). Adding (CASA) or improving (CN) the representation of deforestation fires may further increase agreement with the atmospheric record. Information from C-LAMP has enhanced model performance within CCSM and serves as a benchmark for future development. We propose that an open source, community-wide platform for model-data intercomparison is needed to speed model development and to strengthen ties between modeling and measurement communities. Important next steps include the design and analysis of land use change simulations (in both uncoupled and coupled modes), and the entrainment of additional ecological and earth system observations. Model results from C-LAMP are publicly available on the Earth System Grid.

09 BIOMASS FUELS↗

Direct Numerical Simulation of Transitional and Turbulent Flows Over Multi-Scale Surface Roughness—Part II: The Effect of Roughness on the Performance of a High-Pressure Turbine Blade

Abstract Turbine blades generally present surface roughness introduced in the manufacturing process or caused by in-service degradation, which can have a significant impact on aero-thermal performance. A better understanding of the fundamental physical mechanisms arising from the interaction between the roughness and the turbine flow at engine-relevant conditions can provide insights for the design of blades with improved efficiency and longer operational life. To this end, a high-fidelity numerical framework combining a well-validated solver for direct numerical simulation and a second-order accurate immersed boundary method is employed to predict roughness-induced aero-thermal effects on an LS89 high-pressure turbine (HPT) blade at engine-relevant conditions. Different amplitudes and distributions of surface roughness are investigated and a reference smooth-blade simulation under the same flow conditions is conducted for comparison. Roughness of increasing amplitude progressively shifts the blade suction side boundary layer transition upstream, producing larger values of the turbulent kinetic energy and higher total wake losses. The on-surface data-capturing capabilities of the numerical framework provide direct measurements of the heat flux and the skin friction coefficient, hence offering quantitative information between the surface topology and engineering-relevant performance parameters. This work may provide a benchmark for future numerical studies of turbomachinery flows with roughness.

Engineering↗

Digital acoustic sensor performance across the infrasound range in non-isolated conditions

The next generation of acoustic sensors is emerging to supplement legacy sensors traditionally used in regional and global networks. These devices operate under similar principles as traditional sensors, without the need of a separate external digitizer. The calibration of these sensors against their predecessors is crucial to the modernization of conventional technologies. This work describes the characterization of the next-generation MB3 digital microbarometer and the iPrecision smartphone microphone in a non-isolated calibration room across the infrasound (i.e., 0.01–20 Hz) range. The intent is to evaluate nominal instrument performance before deployment. A portable rotary subwoofer is used as a controllable infrasound source to generate single-tone sinusoidal and broadband noise pressure waves in a room configured for calibration purposes. For each device, comparison measurements are made, from which the digital sensitivity and the parametric response is developed. The results provide insight into the performance of the sensors in non-isolated environments. By overlapping the responses of the test sensors, digital sensor performance across the infrasound range can be benchmarked. These responses may serve as a double-reference scheme in future pressure measurements and digital calibrations of acoustic sensors.

47 OTHER INSTRUMENTATION↗

SwitchX : Gmin-Gmax Switching for Energy-efficient and Robust Implementation of Binarized Neural Networks on ReRAM Xbars

Memristive crossbars can efficiently implement Binarized Neural Networks (BNNs) wherein the weights are stored in high-resistance states (HRS) and low-resistance states (LRS) of the synapses. We propose SwitchX mapping of BNN weights onto ReRAM crossbars such that the impact of crossbar non-idealities, that lead to degradation in computational accuracy, are minimized. Essentially, SwitchX maps the binary weights in such a manner that a crossbar instance comprises of more HRS than LRS synapses. We find BNNs mapped onto crossbars with SwitchX to exhibit better robustness against adversarial attacks than the standard crossbar mapped BNNs, the baseline. Finally, we combine SwitchX with state-aware training (that further increases the feasibility of HRS states during weight mapping) to boost the robustness of a BNN on hardware. We find that this approach yields stronger defense against adversarial attacks than adversarial training, a state-of the-art software defense. We perform experiments on a VGG16 BNN with benchmark datasets (CIFAR-10, CIFAR-100 and TinyImagenet) and use Fast Gradient Sign Method (ϵ = 0.05 to 0.3) and Projected Gradient Descent (ϵ = $\frac{2}{255}$ to $\frac{32}{255}$, α = $\frac{2}{255}$) adversarial attacks. We show that SwitchX combined with state-aware training can yield upto ~35% improvements in clean accuracy and ~6–16% in adversarial accuracies against conventional BNNs. Furthermore, an important by-product of SwitchX mapping is increased crossbar power savings, owing to an increased proportion of HRS synapses, which is furthered with state-aware training. We obtain upto ~21–22% savings in crossbar power consumption for state-aware trained BNN mapped via SwitchX on 16 × 16 and 32 × 32 crossbars using the CIFAR-10 and CIFAR-100 datasets.

97 MATHEMATICS AND COMPUTING↗

pnnl/oedisi_dopf

OpenEDI - System Integration (OEDI-SI) - PNNL Distributed Optimal Power Flow (DOPF)

Slay, Tylor↗

HNQ Version 0.1

HNQ is a low level benchmark code used to characterize storage hardware performance.

Ward, Lee↗

Benchmarking Simulated Precipitation Variability Amplitude across Time Scales

Here, objective performance metrics that measure precipitation variability across time scales from subdaily to interannual are presented and applied to Historical simulations of Coupled Model Intercomparison Project phase 5 and 6 (CMIP5 and CMIP6) models. Three satellite-based precipitation estimates (IMERG, TRMM, and CMORPH) are used as reference data. We apply two independent methods to estimate temporal variability of precipitation and compare the consistency in their results. The first method is derived from power spectra analysis of 3-hourly precipitation, measuring forced variability by solar insolation (diurnal and annual cycles) and internal variability at different time scales (subdaily, synoptic, subseasonal, seasonal, and interannual). The second method is based on time averaging and facilitates estimating the seasonality of subdaily variability. Supporting the robustness of our metric, we find a near equivalence between the results obtained from the two methods when examining simulated-to-observed ratios over large domains (global, tropics, extratropics, land, or ocean). Additionally, we demonstrate that our model evaluation is not very sensitive to the discrepancies between observations. Our results reveal that CMIP5 and CMIP6 models in general overestimate the forced variability while they underestimate the internal variability, especially in the tropical ocean and higher-frequency variability. The underestimation of subdaily variability is consistent across different seasons. The internal variability is overall improved in CMIP6, but remains underestimated, and there is little evidence of improvement in forced variability. Increased horizontal resolution results in some improvement of internal variability at subdaily and synoptic time scales, but not at longer time scales.

54 ENVIRONMENTAL SCIENCES↗