Search NASA⌕ Search

SEARCH · Search NASA

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Performance and Energy Usage of Workloads on KNL and Haswell Architectures. In: High Performance Computing Systems. Performance Modeling, Benchmarking, and Simulation

Manycore architectures are an energy-efficient step towards exascale computing within a constrained power budget. The Intel Knights Landing (KNL) manycore chip is a specific example of this and has seen early adoption by a number of HPC facilities. It is therefore important to understand the performance and energy usage characteristics of KNL. In this paper, we evaluate the performance and energy efficiency of KNL in contrast to the Xeon (Haswell) architecture for applications representative of the workload of users at NERSC. We consider the optimal MPI/OpenMP configuration of each application and use the results to characterize KNL in contrast to Haswell. As well as traditional DDR memory, KNL contains MCDRAM and we also evaluate its efficacy. Our results show that, averaged over our benchmarks, KNL is 1.84 × more energy efficient than Haswell and has 1.27 × greater performance.

Benchmarking↗

Middleware Evaluation and Benchmarking for Use in Mission Operations Centers

Middleware technologies have been promoted as timesaving, cost-cutting alternatives to the point-to-point communication used in traditional mission operations systems. However, missions have been slow to adopt the new technology. The lack of existing middleware-based missions has given rise to uncertainty about middleware's ability to perform in an operational setting. Most mission architects are also unfamiliar with the technology and do not know the benefits and detriments to architectural choices - or even what choices are available. We will present the findings of a study that evaluated several middleware options specifically for use in a mission operations system. We will address some common misconceptions regarding the applicability of middleware-based architectures, and we will identify the design decisions and tradeoffs that must be made when choosing a middleware solution. The Middleware Comparison and Benchmark Study was conducted at NASA Goddard Space Flight Center to comprehensively evaluate candidate middleware products, compare and contrast the performance of middleware solutions with the traditional point- to-point socket approach, and assess data delivery and reliability strategies. The study focused on requirements of the Global Precipitation Measurement (GPM) mission, validating the potential use of middleware in the GPM mission ground system. The study was jointly funded by GPM and the Goddard Mission Services Evolution Center (GMSEC), a virtual organization for providing mission enabling solutions and promoting the use of appropriate new technologies for mission support. The study was broken into two phases. To perform the generic middleware benchmarking and performance analysis, a network was created with data producers and consumers passing data between themselves. The benchmark monitored the delay, throughput, and reliability of the data as the characteristics were changed. Measurements were taken under a variety of topologies, data demands, and data characteristics, using several middleware products. All results were compared to systems using traditional point-to-point socket communication. By comparing performance results under Merent settings, inferences could be made about each middleware's ability to meet certain requirements of the GPM mission. The second phase simulated a middleware-based mission operations center. Actual mission support tools were either used or simulated to create real world demands on the middleware. Network and computer demands were watched closely to verify that no specific idiosyncrasies of mission operations activities would prove unsupportable by the middleware. In our presentation, we will address some commonly accepted misconceptions concerning middleware in mission support architectures. Specifically, we will focus on the perception that middleware solutions are too slow or impose too much overhead for real-time mission operations, and that middleware solutions are too expensive for small

Antonucci, Rob↗

A Meta-Generalized Gradient Approximation for the Cavity-Dependent Exchange-Correlation Interaction in Strongly Coupled Light–Matter Systems

Strong light–matter coupling in optical cavities enables the manipulation of chemical and physical properties without altering molecular composition. Theoretical modeling of such phenomena requires exchange-correlation (XC) functionals that account for both electron–electron and electron–photon (ep) interactions within quantum electrodynamical density functional theory (QEDFT). In this work, we develop a meta-generalized gradient approximation (meta-GGA) specifically targeting the cavity-dependent XC interaction in strongly coupled light–matter systems. This novel approximation is built upon a new semilocal polarizability approximation, which draws from the jellium-with-a-gap model, and can be extended to a “global hybrid” variant that goes beyond the isotropic model from previous approximations. The polarizability model yields significantly improved dispersion coefficients and benchmark calculations with the cavity-dependent XC functional demonstrate improved agreement with QED Hartree–Fock (QED-HF) reference energies. Application to the regioselectivity of brominated nitrobenzene intermediates reveals the functional’s capacity to capture cavity-induced energetic shifts. In conclusion, our results advance the Jacob’s ladder of functionals for QEDFT and provide a practical tool for modeling polaritonic chemistry.

Approximation↗

Evaluating fast methods for static polarizabilities on extended conjugated oligomers

Given the importance of accurate polarizability calculations to many chemical applications, coupled with the need for efficiency when calculating the properties of sets of molecules or large oligomers, we present a benchmark study examining possible calculation methods for polarizable materials. We first investigate the accuracy of the additive model used in GFN2, a highly-efficient semi-empirical tight-binding method, and the D4 dispersion model, comparing its predicted additive polarizabilities to ωB97XD results for a subset of PubChemQC and a compiled benchmark set of molecules spanning polarizabilities from approximately 3 Å 3 to 600 Å 3 , with some compounds in the range of approximately 1200–1400 Å 3 . Although we find additive GFN2 polarizabilities, and thus D4, to have large errors with polarizability calculations on large conjugated oligomers, it would appear an empirical quadratic correction can largely remedy this. We also compare the accuracy of DFT polarizability calculations run using basis sets of varying size and level of augmentation, determining that a non-augmented basis set may be used for large, highly polarizable species in conjunction with a linear correction factor to achieve accuracy extremely close to that of aug-cc-pVTZ.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Overview of the OECD-NEA Working Party on International Nuclear Data Evaluation Cooperation (WPEC)

The OECD Nuclear Energy Agency (NEA) Working Party on International Nuclear Data Evaluation Cooperation (WPEC) was established in 1989 to facilitate collaboration in nuclear data activities. Over its thirty year history, different Subgroups have been created to address topics in nearly every aspect of nuclear data, including: experimental measurements, evaluation, validation, model development, quality assurance of databases and the development of software tools. WPEC has recently completed activities on fission yield evaluation, the general nuclear database structure (GNDS) to replace the ENDF-6 format, methods to provide feedback to evaluation, studies of specific capture cross sections, new methods in thermal scattering kernel evaluation and the Collaborative International Evaluated Library Organisation (CIELO) Pilot Project. Ongoing activities in GNDS application programming interface (API) development, methods for covariance evaluation and quality assurance in nuclear data validation using the International Criticality Safety Benchmark Evaluation Project (ICSBEP) database are complemented by the work of two Expert Groups that oversee the High-Priority Request List (HPRL) for Nuclear Data and the continuous development of the GNDS. New activities on the use of integral experiments for nuclear data validation and adjustment, as well as the use of the Shielding Integral Benchmark Archive and Database (SINBAD) for validation have begun and will be coordinated alongside future Subgroups. After three decades we will review the status of WPEC, how it integrates other collections and activities organised by the NEA and how it dovetails with the initiatives of the IAEA and other bodies to effectively coordinate international activities in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

Numerical investigation of liquid wall ablation in inertial fusion energy chambers

This paper presents a novel approach for modeling liquid wall ablation in liquid wall-protected inertial fusion energy (IFE) chambers. These systems are promising candidates for the implementation of fusion technology, yet significant gaps remain in understanding the underlying physical processes and their implications for design. Following target ignition, a portion of the fusion energy is released as x-rays, which deposit their energy into an array of liquid jets, leading to partial vaporization. Accurately modeling this heat deposition and vaporization process remains challenging due to the complex geometries typical of (pre-conceptual) IFE chamber designs. Furthermore, the subsequent expansion of vaporized material into the chamber’s vacuum environment poses difficulties for conventional CFD methods based on continuum assumptions, which can lead to significant inaccuracies. To address some aspects of these challenges, this work introduces a ray-tracing-based methodology to map the spatial distribution of ablated material in liquid wall-protected systems. In addition, a vacuum-tracking scheme is developed to extend the applicability of an OpenFOAM-based solver to gas dynamics in rarefied environments. The proposed approach has been verified through numerical benchmarks and applied to a practical case involving the HYLIFE-II (High Yield Lithium Injection Fusion Energy) chamber. The methodology advances the modeling capabilities for liquid wall-protected IFE systems and provides valuable tools to support their design and optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Investigation of storage options for scientific computing on Grid and Cloud facilities

In recent years, several new storage technologies, such as Lustre, Hadoop, OrangeFS, and BlueArc, have emerged. While several groups have run benchmarks to characterize them under a variety of configurations, more work is needed to evaluate these technologies for the use cases of scientific computing on Grid clusters and Cloud facilities. This paper discusses our evaluation of the technologies as deployed on a test bed at FermiCloud, one of the Fermilab infrastructure-as-a-service Cloud facilities. The test bed consists of 4 server-class nodes with 40 TB of disk space and up to 50 virtual machine clients, some running on the storage server nodes themselves. With this configuration, the evaluation compares the performance of some of these technologies when deployed on virtual machines and on bare metal nodes. In addition to running standard benchmarks such as IOZone to check the sanity of our installation, we have run I/O intensive tests using physics-analysis applications. This paper presents how the storage solutions perform in a variety of realistic use cases of scientific computing. One interesting difference among the storage systems tested is found in a decrease in total read throughput with increasing number of client processes, which occurs in some implementations but not others.

Garzoglio, Gabriele↗

Standard Energy Efficiency Data Platform

The SEED platform is expected to be a building energy performance data management tool that provides federal, state and local governments, building owners and operators with an easy, flexible and cost-effective method to collect information about groups of buildings, oversee compliance with energy disclosure laws and demonstrate the economic and environmental benefits of energy efficiency. It will allow users to leverage a local application to manage data disclosure and large data sets without the IT investment of developing custom applications. The first users of SEED will be agencies that need to collect, store, and report/share large data sets generated by benchmarking, energy auditing, retro-commissioning or retrofitting of many buildings. Similarly, building owners and operators will use SEED to manage their own energy data in a common format and centralized location. SEED users will also control the disclosure of their information for compliance requirements, recognition programs such as ENERGY STAR, or data sharing with the Buildings Performance Database and/or other third parties at their discretion.

Cheifetz, D.Magnus↗

Validation of COG10 and ENDFB6R7 on the Auk Workstation for General Application to Highly Enriched Uranium Systems

The COG 10 code package1 on the Auk workstation is now validated with the ENBFB6R7 neutron cross section library for general application to highly enriched uranium (HEU) systems by comparison of the calculated keffective to the expected keffective of several relevant experimental benchmarks. This validation is supplemental to the installation and verification of COG 10 on the Auk workstation2.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Benchmark Comparison of HyRAM and ALDEA Software for Hydrogen Release Behavior

There are several different calculation approaches and tools that can be used to evaluate the risk of hydrogen energy applications. A comparative study of Air Liquide’s ALDEA (Air Liquide Dispersion and Explosion Assessment) tools suite and Sandia’s HyRAM (Hydrogen Risk Assessment Models) toolkit has been conducted. The purpose of this study was to understand and evaluate the differences between the two calculation approaches, and identify areas for model improvements. There were several scenarios examined in this effort regarding hydrogen release dynamics. These scenarios include free jet release cases at varying pressures, vessel blowdown, and hydrogen build-up scenarios with and without ventilation. For each scenario, the input and output of the HyRAM calculations are documented, along with a comparison to the ALDEA results. Generally, the results from the two different tools were reasonably aligned. However, there were fundamental differences in evaluation methodology and functional limitations in HyRAM that caused discrepancies in some calculations.

08 HYDROGEN↗

The Aerosol Model Benchmarking Repository: A toolkit for model intercomparison

The Aerosol Model Benchmarking Repository and Standards (AMBRS) project was initiated to provide tools and to establish community standards for benchmarking aerosol models. This report describes a set of open-source tools for building, running, and analyzing aerosol box model simulations in a standardized framework. The framework consists of three core components: AMBuilder, a CMake-based build system that compiles supported models consistently; AMBRS, a Python module that defines unified numerical experiments and executes them with aligned inputs; and PyParticle, an aerosol analysis package that standardizes output, computes diagnostics, and visualizes simulation results. Together, these tools enable reproducible intercomparison of aerosol schemes and support process-level evaluation of how model simplifications affect predictions of size distributions, cloud condensation nuclei activity, and other relevant properties relevant for the Earth-Energy system. Beyond its role in benchmarking, AMBRS provides a platform for studying aerosol processes across scales and can be used to generate training data for AI/ML applications in support of a broader hierarchical aerosol modeling strategy.

54 ENVIRONMENTAL SCIENCES↗

Pulsed-Neutron Experiments at the Inherently Safe Subcritical Assembly

The pulsed neutron technique is a powerful, dynamic method to assay the reactivity of a multiplying system. This work presents the novel application of the pulsed neutron technique to the Inherently Safe Subcritical Assembly, an experimental configuration accepted by the International Criticality Safety Benchmark Evaluation Project Handbook. The experiments were replicated with COG11.3, a continuous-energy Monte Carlo code. The pulsed neutron data were analyzed using the Sjöstrand and Gozani area-ratio methods and by extracting the prompt neutron decay constant. Subsequent static k-eigenvalue and 𝛼-eigenvalue simulations were also performed for the same configurations. Neutron detector dead-time effects from the experiments were corrected using the Backwards Extrapolation Method and shown to have a negligible impact on the estimated reactivities. The results highlight that capturing time-dependent effects like delayed neutron precursor buildup are essential to accurately reproduce experimental results. They also highlight the importance of shielding the detectors from generator source neutrons in deeply subcritical configurations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure

We present nbodykit, an open-source, massively parallel Python toolkit for analyzing large-scale structure (LSS) data. Using Python bindings of the Message Passing Interface, we provide parallel implementations of many commonly used algorithms in LSS. nbodykit is both an interactive and scalable piece of scientific software, performing well in a supercomputing environment while still taking advantage of the interactive tools provided by the Python ecosystem. Existing functionality includes estimators of the power spectrum, two- and three-point correlation functions, a friends-of-friends grouping algorithm, mock catalog creation via the halo occupation distribution technique, and approximate N-body simulations via the FastPM scheme. The package also provides a set of distributed data containers, insulated from the algorithms themselves, that enables nbodykit to provide a unified treatment of both simulation and observational data sets. nbodykit can be easily deployed in a high-performance computing environment, overcoming some of the traditional difficulties of using Python on supercomputers. We provide performance benchmarks illustrating the scalability of the software. The modular, component-based approach of nbodykit allows researchers to easily build complex applications using its tools. The package is extensively documented at http://nbodykit.readthedocs.io, which also includes an interactive set of example recipes for new users to explore. As open-source software, we hope nbodykit provides a common framework for the community to use and develop in confronting the analysis challenges of future LSS surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Passive millimeter-wave imaging

Millimeter-wave hardware systems are being developed. Our approach begins with identifying and defining the applications. System requirements are then specified based on mission needs using our end-to-end performance model. The model was benchmarked against existing data bases and, where data is deficient, it is acquired via field measurements. The derived system requirements are then validated with the appropriate field measurements using our imaging testbeds and hardware breadboards. The result is a final system that satisfies all the requirements of the target mission.

Young, Stephen K.↗

Second Computational Aeroacoustics (CAA) Workshop on Benchmark Problems

The proceedings of the Second Computational Aeroacoustics (CAA) Workshop on Benchmark Problems held at Florida State University are the subject of this report. For this workshop, problems arising in typical industrial applications of CAA were chosen. Comparisons between numerical solutions and exact solutions are presented where possible.

Tam, C. K. W.↗

Buckling and Damage Resistance of Transversely-Loaded Composite Shells

Experimental and numerical work was conducted to better understand composite shell response to transverse loadings which simulate damage-causing impact events. The quasi-static, centered, transverse loading response of laminated graphite/epoxy shells in a [+/-45(sub n)/O(sub n)](sub s) layup having geometric characteristics of a commercial fuselage are studied. The singly-curved composite shell structures are hinged along the straight circumferential edges and are either free or simply supported along the curved axial edges. Key components of the shell response are response instabilities due to limit-point and/or bifurcation buckling. Experimentally, deflection-controlled shell response is characterized via load-deflection data, deformation-shape evolutions, and the resulting damage state. Finite element models are used to study the kinematically nonlinear shell response, including bifurcation, limit-points, and postbuckling. A novel technique is developed for evaluating bifurcation from nonlinear prebuckling states utilizing asymmetric spatial discretization to introduce numerical perturbations. Advantages of the asymmetric meshing technique (AMT) over traditional techniques include efficiency, robustness, ease of application, and solution of the actual (not modified) problems. The AMT is validated by comparison to traditional numerical analysis of a benchmark problem and verified by comparison to experimental data. Applying the technique, bifurcation in a benchmark shell-buckling problem is correctly identified. Excellent agreement between the numerical and experimental results are obtained for a number of composite shells although predictive capability decreases for stiffer (thicker) specimens which is attributed to compliance of the test fixture. Restraining the axial edge (simple support) has the effect of creating a more complex response which involves unstable bifurcation, limit-point buckling, and dynamic collapse. Such shells were noted to bifurcate into asymmetric deformation modes but were undamaged during testing. Shells in this study which were damaged were not observed to bifurcate. Thus, a direct link between bifurcation and atypical damage could not be established although the mechanism (bifurcation) was identified. Recommendations for further work in these related areas are provided and include extensions of the AMT to other shell geometries and structural problems.

Wardle, Brian L.↗

High Performance Computing at NASA

The speaker will give an overview of high performance computing in the U.S. in general and within NASA in particular, including a description of the recently signed NASA-IBM cooperative agreement. The latest performance figures of various parallel systems on the NAS Parallel Benchmarks will be presented. The speaker was one of the authors of the NAS (National Aerospace Standards) Parallel Benchmarks, which are now widely cited in the industry as a measure of sustained performance on realistic high-end scientific applications. It will be shown that significant progress has been made by the highly parallel supercomputer industry during the past year or so, with several new systems, based on high-performance RISC processors, that now deliver superior performance per dollar compared to conventional supercomputers. Various pitfalls in reporting performance will be discussed. The speaker will then conclude by assessing the general state of the high performance computing field.

Bailey, David H.↗