Search NASA⌕ Search

SEARCH · Search NASA

Results for “software performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Roofline model toolkit: A practical tool for architectural and program analysis

We present preliminary results of the Roofline Toolkit for multicore, many core, and accelerated architectures. This paper focuses on the processor architecture characterization engine, a collection of portable instrumented micro benchmarks implemented with Message Passing Interface (MPI), and OpenMP used to express thread-level parallelism. These benchmarks are specialized to quantify the behavior of different architectural features. Compared to previous work on performance characterization, these microbenchmarks focus on capturing the performance of each level of the memory hierarchy, along with thread-level parallelism, instruction-level parallelism and explicit SIMD parallelism, measured in the context of the compilers and run-time environments. We also measure sustained PCIe throughput with four GPU memory managed mechanisms. By combining results from the architecture characterization with the Roofline model based solely on architectural specifications, this work offers insights for performance prediction of current and future architectures and their software systems. To that end, we instrument three applications and plot their resultant performance on the corresponding Roofline model when run on a Blue Gene/Q architecture.

97 MATHEMATICS AND COMPUTING↗

TEMPI: An Interposed MPI Library with Canonical Representation of MPI Datatypes [Poster]

TEMPI provides a transparent non-contiguous data-handling layer compatible with various MPIs. MPI Datatypes are a powerful abstraction for allowing an MPI implementation to operate on non-contiguous data. CUDA-aware MPI implementations must also manage transfer of such data between the host system and GPU. The non-unique and recursive nature of MPI datatypes mean that providing fast GPU handling is a challenge. The same noncontiguous pattern may be described in a variety of ways, all of which should be treated equivalently by an implementation. This work introduces a novel technique to do this for strided datatypes. Methods for transferring non-contiguous data between the CPU and GPU depends on the properties of the data layout. This work shows that a simple performance model can accurately select the fastest method. Unfortunately, the combination of MPI software and system hardware available may not provide sufficient performance. The contributions of this work are deployed on OLCF Summit through an interposer library which does not require privileged access to the system to use

97 MATHEMATICS AND COMPUTING↗

Milestone 49 Report: Batched Sparse LA Phase 5 Implementation

Batched sparse linear algebra operations in general, and solvers in particular, have become the major algorithmic development activity and foremost performance engineering effort in the numerical software libraries work on modern hardware with accelerators such as GPUs. Many applications, ECP and non-ECP alike, require simultaneous solutions of many small linear systems of equations that are structurally sparse in one form or another. In order to move towards high hardware utilization levels, it is important to provide these applications with appropriate interface designs to be both functionally efficient and performance portable and give full access to the appropriate batched sparse solvers running on modern hardware accelerators prevalent across DOE supercomputing sites since the inception of ECP. To this end, we present here a summary of recent advances on the interface designs in use by HPC software libraries supporting batched sparse linear algebra and the development of sparse batched kernel codes for solvers and preconditioners. We also address the potential interoperability opportunities to keep the corresponding software portable between the major hardware accelerators from AMD, Intel, and NVIDIA, while maintaining the appropriate disclosure levels conforming to the active NDA agreements. The presented interface specifications include a mix of batched band, sparse iterative, and sparse direct solvers with their accompanying functionality that is already required by the application codes or we anticipated to be needed in the near future. This report summarizes progress in Kokkos Kernels and the xSDK libraries MAGMA, Ginkgo, hypre, PETSc, and SuperLU.

97 MATHEMATICS AND COMPUTING↗

Fractionated stereotactic radiotherapy: A method to evaluate geometric and dosimetric uncertainties using radiochromic films

In the authors' hospital, stereotactic radiotherapy treatments are performed with a Varian Clinac 600C equipped with a BrainLAB m3 micro-multileaf-collimator generally using the dynamic conformal arc technique. Patient immobilization during the treatment is achieved with a fixation mask supplied by BrainLAB, made with two reinforced thermoplastic sheets fitting the patient's head. With this work the authors propose a method to evaluate treatment geometric accuracy and, consequently, to determine the amount of the margin to keep in the CTV-PTV expansion during the treatment planning. The reproducibility of the isocenter position was tested by simulating a complete treatment on the anthropomorphic phantom Alderson Rando, inserting in between two phantom slices a high sensitivity Gafchromic EBT film, properly prepared and calibrated, and repeating several treatment sessions, each time removing the fixing mask and replacing the film inside the phantom. The comparison between the dose distributions measured on films and computed by TPS, after a precise image registration procedure performed by a commercial piece of software (FILMQA, 3cognition LLC (Division of ISP), Wayne, NJ), allowed the authors to measure the repositioning errors, obtaining about 0.5 mm in case of central spherical PTV and about 1.5 mm in case of peripheral irregular PTV. Moreover, an evaluation of the errors in the registration procedure was performed, giving negligible values with respect to the quantities to be measured. The above intrinsic two-dimensional estimate of treatment accuracy has to be increased for the error in the third dimension, but the 2 mm margin the authors generally use for the CTV-PTV expansion seems adequate anyway. Using the same EBT films, a dosimetric verification of the treatment planning system was done. Measured dose values are larger or smaller than the nominal ones depending on geometric irradiation conditions, but, in the authors' experimental conditions, always within 4%.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

HOMP (Hybrid Operation and Maintenance Platform) [SWR-22-81]

The HOMP software module is contained within NREL's Hybrid Optimization and Performance Platform (HOPP) at this URL: https://github.com/NREL/HOPP/tree/feature/HOMP. HOMP is a python-based software module which can be used concurrently with the Hybrid Optimization and Performance Platform (HOPP) to model, simulate, and optimize degradation, reliability, and operations and maintenance of hybrid power plant components. The program currently models lithium ion battery, PEM electrolyzer, wind turbine, and solar PV array components, which enables users to understand the design and operation tradeoffs of hybrid power plants. For instance, HOMP enables users to answer questions like: how large does a battery bank need to be to achieve optimal charge/discharge rates for performance and reliability? How does plant design change for different objectives (e.g., profit versus resilience)? Under what conditions is it better to produce electricity versus hydrogen? How do we optimally control hybrid power plants to reduce downtime and increase performance?

Clark, Caitlyn↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

3D Characterization and Time-Lapse Imaging of the Desiccation Treatability Test at the Hanford BC-Cribs and Trenches Site using High Performance Computing applied to Electrical Resistivity Imaging - 12271

Contaminated vadose zone materials are a potential source of long-term groundwater contamination at many sites across the Department of Energy (DOE) complex. Deep vadose zone contamination presents a particularly challenging remedial problem due to the difficultly of locating contaminants and the expense of access and ex situ treatment. In situ remediation techniques, whereby remedial amendments must be delivered to contaminated soils, have been identified as a potential alternative. However, amendment delivery is typically uncertain and post delivery remedial performance is often not well understood due to limited information available from sparsely spaced boreholes. Recent advancements in electrical resistivity tomography (ERT) are being used to address these challenges at the Hanford site by providing remote, three-dimensional images of contaminant distribution and four-dimensional (three spatial dimensions plus the time dimension) images of in-situ vadose zone remediation processes. These capabilities were recently demonstrated with a large scale surface characterization effort and during a smaller scale desiccation treatability test at the Hanford BC-Cribs area. The results of these efforts demonstrate the utility of leveraging high-performance computing resources to process ERT data for 3D reconnaissance mapping of subsurface contaminants and for detailed 3D monitoring of vadose zone remediation efforts. Two examples of ERT imaging at a former waste disposal facility have been demonstrated at different scales; a large scale reconnaissance survey spanning many hundreds of meters and a detailed monitoring application spanning a few tens of meters. Although ERT is applicable at many scales, resolution is generally governed by proximity to electrodes. For instance, the BCCT reconnaissance survey demonstrated herein lost resolution with depth (i.e. away from surface electrodes), and was unable to detect a high conductivity anomaly at approximately 75 m below ground surface in the cribs area; the deep anomalies were detected during highly focused borehole sampling. Conversely, the desiccation site characterization and monitoring demonstrated high resolution at a small scale, but only because of close proximity to survey electrodes. Although proximity to electrodes is not the only factor governing ERT resolution, it is often the primary factor for determining how an ERT system should be effectively deployed for a given application. Regardless of resolution limitations, the utility of ERT for remotely detecting wastes and monitoring subsurface processes is evident. ERT imaging is not a final detection or monitoring solution alone, but provides a necessary capability to remotely detect subsurface conditions and understand subsurface processes. Such a capability can significantly increase the efficacy and reduce the cost of remediation by guiding sampling efforts and informing remedial system design and operation. However, given the computational demands of 3D ERT characterization and monitoring inversions, the full imaging capability enabled by contemporary ERT survey systems can generally only be realized with high performance computing resources, both hardware and software. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

ExaSAT: An exascale co-design tool for performance modeling

One of the emerging challenges to designing HPC systems is understanding and projecting the requirements of exascale applications. In order to determine the performance consequences of different hardware designs, analytic models are essential because they can provide fast feedback to the co-design centers and chip designers without costly simulations. However, current attempts to analytically model program performance typically rely on the user manually specifying a performance model. Here we introduce the ExaSAT framework that automates the extraction of parameterized performance models directly from source code using compiler analysis. The parameterized analytic model enables quantitative evaluation of a broad range of hardware design trade-offs and software optimizations on a variety of different performance metrics, with a primary focus on data movement as a metric. Finally, we demonstrate the ExaSAT framework’s ability to perform deep code analysis of a proxy application from the Department of Energy Combustion Co-design Center to illustrate its value to the exascale co-design process. ExaSAT analysis provides insights into the hardware and software trade-offs and lays the groundwork for exploring a more targeted set of design points using cycle-accurate architectural simulators.

97 MATHEMATICS AND COMPUTING↗

Diablo Test Suite: Code Coverage Analysis

An analysis of the Diablo source code covered by its Software Quality Assurance test suite was performed. Intel’s code coverage tool was used to determine the percentage of covered files, blocks, and functions. Excluding non-functional legacy files and single use developer-only files, the code coverage tool showed that 55% of blocks, the most applicable metric and closest to lines of code, are covered. For a large software code, 70-80% coverage is generally considered a reasonable target.A significant percentage of the uncovered code can be categorized as features that are not practical to test, duplicate/unused legacy code, and niche features only used by select individuals. Additionally, large segments of code dedicated to debugging and error handling are untested, as the test problems do not error out. The remaining untested code can be considered general purpose for use by the analyst/user community. These untested general purpose features are identified in the document and should be prioritized when new testing is added. Suggestions for additional test problems that would have the biggest impact on increasing the code coverage metric are presented. Finally, it is important to note that the single biggest way to increase the overall coverage metric is to delete old and unused code. While admittedly tedious to perform, future code development would also benefit markedly from this. Deleting unused code would likely push the coverage metric north of 60%, which is not too far off the 70-80% target. Overall, the current test suite covers the majority of commonly used features in Diablo, but there remains significant room for improvement. These areas for improvement have been identified.

97 MATHEMATICS AND COMPUTING↗

SU-F-T-586: Pre-Treatment QA of InCise2 MLC Plans On a Cyberknife-M6 Using the Delta4 System in SBRT

Purpose: Performing pre-treatment quality assurance (QA) with the Delta4 system (ScandiDos Inc., Madison, WI) is well established for linac-based radiotherapy. This is not true when using a Cyberknife (Accuray Inc., Sunnyvale, CA) where, typically film-based QA is applied. The goal of this work was to test the feasibility to use the Delta4 system for pre-treatment QA for stereotactic body radiation therapy (SBRT) using a Cyberknife-M6 equipped with the InCise2 multileaf collimator (MLC). Methods: In order to perform measurements without accelerator pulse signal, the Tomotherapy option within the Delta4 software was used. Absolute calibration of the Delta4 phantom was performed using a 10×10 cm{sup 2} field shaped by the InCise2 MLC of the Cyberknife-M6. Five fiducials were attached to the Delta4 phantom in order to be able to track the phantom before and during measurements. For eight SBRT treatment plans (two liver, two prostate, one lung, three bone metastases) additional verification plans were recalculated on the Delta4 phantom using MultiPlan. Dicom data was exported from MultiPlan and was adapted in order to be compatible with the Delta4 software. The measured and calculated dose distributions were compared using the gamma analysis of the Delta4 system. Results: All eight SBRT plans were successfully measured with the aid of the Delta4 system. In the mean, 98.0±1.9%, 95.8±4.1% and 88.40±11.4% of measured dose points passed the gamma analysis using a global dose deviation criterion of 3% (100% corresponds to the dose maximum) and a distance-to-agreement criterion of 3 mm, 2 mm and 1 mm, respectively, and a threshold of 20%. Conclusion: Pre-treatment QA of SBRT plans using the Delta4 system on a Cyberknife-M6 is feasible. Measured dose distributions of SBRT plans showed clinically acceptable agreement with the corresponding calculated dose distributions.

60 APPLIED LIFE SCIENCES↗

On a stochastic approach to a code performance estimation

The main goal of an efficient profiling of software is to minimize the runtime overhead under certain constraints and requirements. The traces built by a profiler during the work, affect the performance of the system itself. One of important aspect of an overhead arises from the randomness of variability in the context in which the application is embedded, e.g., due to possible cache misses, etc. Such uncertainty needs to be taken into account in the design phase. In order to overcome these difficulties we propose to investigate this issue through the analysis of the probability distribution of the difference between profiler’s times for the same code. The approximating model is based on the finite normal mixtures within the framework of the method of moving separation of mixtures. We demonstrate some results for the MATLAB profiler using plotting of 3D surfaces by the function surf. The idea can be used for an estimating of a program efficiency.

97 MATHEMATICS AND COMPUTING↗

Benchmarking the Performance of Neuromorphic and Spiking Neural Network Simulators

Software simulators play a critical role in the development of new algorithms and system architectures in any field of engineering. Neuromorphic computing, which has shown potential in building brain-inspired energy-efficient hardware, suffers a slow-down in the development cycle due to a lack of flexible and easy-to-use simulators of either neuromorphic hardware itself or of spiking neural networks (SNNs), the type of neural network computation executed on most neuromorphic systems. While there are several openly available neuromorphic or SNN simulation packages developed by a variety of research groups, they have mostly targeted computational neuroscience simulations, and only a few have targeted small-scale machine learning tasks with SNNs. Evaluations or comparisons of these simulators have often targeted computational neuroscience-style workloads. In this work, we seek to evaluate the performance of several publicly available SNN simulators with respect to non-computational neuroscience workloads, in terms of speed, flexibility, and scalability. We evaluate the performance of the NEST, Brian2, Brian2GeNN, BindsNET and Nengo packages under a common front-end neuromorphic framework. Our evaluation tasks include a variety of different network architectures and workload types to mimic the computation common in different algorithms, including feed-forward network inference, genetic algorithms, and reservoir computing. We also study the scalability of each of these simulators when running on different computing hardware, from single core CPU workstations to multi-node supercomputers. Our results show that the BindsNET simulator has the best speed and scalability for most of the SNN workloads (sparse, dense, and layered SNN architectures) on a single core CPU. However, when comparing the simulators leveraging the GPU capabilities, Brian2GeNN outperforms the others for these workloads in terms of scalability. NEST performs the best for small sparse networks and is also the most flexible simulator in terms of reconfiguration capability NEST shows a speedup of at least 2x compared to the other packages when running evolutionary algorithms for SNNs. The multi-node and multi-thread capabilities of NEST show at least 2x speedup compared to the rest of the simulators (single core CPU or GPU based simulators) for large and sparse networks. We conclude our work by providing a set of recommendations on the suitability of employing these simulators for different tasks and scales of operations. We also present the characteristics for a future generic ideal SNN simulator for different neuromorphic computing workloads.

97 MATHEMATICS AND COMPUTING↗

Ground Source Heat Pump Sub-Slab Heat Exchange Loop Performance in a Cold Climate

This report presents a cold-climate project that examines an alternative approach to ground source heat pump (GSHP) ground loop design. The innovative ground loop design is an attempt to reduce the installed cost of the ground loop heat exchange portion of the system by containing the entire ground loop within the excavated location beneath the basement slab. Prior to the installation and operation of the sub-slab heat exchanger, energy modeling using TRNSYS software and concurrent design efforts were performed to determine the size and orientation of the system. One key parameter in the design is the installation of the GSHP in a low-load home, which considerably reduces the needed capacity of the ground loop heat exchanger. This report analyzes data from two cooling seasons and one heating season. Upon completion of the monitoring phase, measurements revealed that the initial TRNSYS simulated horizontal sub-slab ground loop heat exchanger fluid temperatures and heat transfer rates differed from the measured values. To determine the cause of this discrepancy, an updated model was developed utilizing a new TRNSYS subroutine for simulating sub-slab heat exchangers. Measurements of fluid temperature, soil temperature, and heat transfer were used to validate the updated model.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Ground Source Heat Pump Sub-Slab Heat Exchange Loop Performance in a Cold Climate

This report presents a cold-climate project that examines an alternative approach to ground source heat pump (GSHP) ground loop design. The innovative ground loop design is an attempt to reduce the installed cost of the ground loop heat exchange portion of the system by containing the entire ground loop within the excavated location beneath the basement slab. Prior to the installation and operation of the sub-slab heat exchanger, energy modeling using TRNSYS software and concurrent design efforts were performed to determine the size and orientation of the system. One key parameter in the design is the installation of the GSHP in a low-load home, which considerably reduces the needed capacity of the ground loop heat exchanger. This report analyzes data from two cooling seasons and one heating season.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NWChem: a Comprehensive and Scalable Open-Source Solution for Large Scale Molecular Simulations

The NWChem computational chemistry package offers extensive capabilities for large scale simulations of chemical and biological systems. Utilizing a common computational framework, diverse theoretical descriptions can be used to provide the best solution for a given scientific problem. Scalable parallel implementations and modular software design enables efficient utilization of current computational architectures. This paper provides an overview of NWChem focusing primarily on the core theoretical descriptions provided by the code and their parallel performance. In addition, future plans are outlined.

99 GENERAL AND MISCELLANEOUS↗

Automated J-R Curve Analysis Based on the ASTM E1820 Normalization Method

The J-integral vs. crack growth resistance curve (J-R curve) is a useful tool for evaluating material fracture toughness in the ductile condition. A widely accepted practice for conducting tests to obtain J-R curves is ASTM standard E1820, in which the normalization method was introduced as an alternative method for determining the J-R curve. The normalization method requires solely force-displacement data, together with initial and final crack size measurements from a specimen to derive the J-R curve. Because of the elimination of the compliance measurement, the normalization method significantly simplifies testing requirements to obtain J-R curve. Despite these advantages, the analysis procedures of the normalization method are quite complicated to follow, which may limit the wide application of this method. To address this, we have developed a software with user-friendly graphic interface to perform automated normalization analysis. Any users, even without detailed knowledge of the normalization analysis, can use this software to derive J-R curves based on the ASTM E1820 normalization method.

Chen, Xiang↗

Report of experiments and evidence for ASC L2 milestone 4467: demonstration of a legacy application's path to exascale

This report documents thirteen of Sandia's contributions to the Computational Systems and Software Environment (CSSE) within the Advanced Simulation and Computing (ASC) program between fiscal years 2009 and 2012. It describes their impact on ASC applications. Most contributions are implemented in lower software levels allowing for application improvement without source code changes. Improvements are identified in such areas as reduced run time, characterizing power usage, and Input/Output (I/O). Other experiments are more forward looking, demonstrating potential bottlenecks using mini-application versions of the legacy codes and simulating their network activity on Exascale-class hardware. The purpose of this report is to prove that the team has completed milestone 4467-Demonstration of a Legacy Application's Path to Exascale. Cielo is expected to be the last capability system on which existing ASC codes can run without significant modifications. This assertion will be tested to determine where the breaking point is for an existing highly scalable application. The goal is to stretch the performance boundaries of the application by applying recent CSSE RD in areas such as resilience, power, I/O, visualization services, SMARTMAP, lightweight LWKs, virtualization, simulation, and feedback loops. Dedicated system time reservations and/or CCC allocations will be used to quantify the impact of system-level changes to extend the life and performance of the ASC code base. Finally, a simulation of anticipated exascale-class hardware will be performed using SST to supplement the calculations. Determine where the breaking point is for an existing highly scalable application: Chapter 15 presented the CSSE work that sought to identify the breaking point in two ASC legacy applications-Charon and CTH. Their mini-app versions were also employed to complete the task. There is no single breaking point as more than one issue was found with the two codes. The results were that applications can expect to encounter performance issues related to the computing environment, system software, and algorithms. Careful profiling of runtime performance will be needed to identify the source of an issue, in strong combination with knowledge of system software and application source code.

99 GENERAL AND MISCELLANEOUS↗

PIPER: Performance Insights for Programmers and Exascale Runtimes

During the lifetime of the project, the PIPER at the University of Utah worked in collaboration with the team from the partner institutions to establish a set of software tools for analyzing and improving the performance parallel computing tools. These activities complement and complete the work performed by the other X-Stack 2 projects with the definition of a common data models and computing infrastructures, which have been a central element in the targeted performance analysis pipeline and new programming models. The University of Utah team have focused mainly on developing data analysis and visualization systems to facilitate exploration, comparison and evaluation of the behavior and performance of complex algorithms in modern HPC infrastructures. This is involved several demonstrations of the performance achieved and presentation of the results in a way that facilitates the users understand bottlenecks and ways to overcome them. One major focus of the University of Utah activities has been the analysis of the performance characteristics of Fat-Tree and Dragonfly topology networks. The work involved the development of practical visualization systems especially in collaboration with the team at LLNL, and published several papers and gave invited talks at prestigious venues such as the Salishan Conference on High-Speed Computing or the International Conference on High Performance Computing, Data, and Analytics. In addition, the university of Utah team has advanced the core activities on analyzing the performance characteristics of I/O and other data movement systems and their practical use for scaling Uintah and other simulation codes poised for use in the exascale computing environments of the future.

42 ENGINEERING↗